2024-04-25T01:32:11.553 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T01:32:11.553 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672336 --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/iozone}} --owner scheduled_teuthology@teuthology --verbose --name teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi -- /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672336/orig.config.yaml 2024-04-25T01:32:11.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T01:32:11.699 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672336 branch: squid description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/iozone}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7672336' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: fs: - name: a - name: b session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - Replacing daemon mds sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: cephfs_name: a client.1: cephfs_name: b install: ceph: flavor: default sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 kclient: client.0: cephfs_name: a client.1: cephfs_name: b syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 8528 sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 sleep_before_teardown: 0 subset: 122/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi077.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLbiWRlvXQKTSoKR06Ueq0MnPNY+zyQd5DGsGrxJOE4jsKbW0ijpCbw7wZwcTi5vOq0RsF3EZ9OYi0mlOO6A7e0= smithi121.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKV++hS67ntohN1Uusfa4cZBqzo0BPfTi6JkpSvv0ZH5xhggS83F3T4A7JVDhFyyatvumdPf3HjNk+Hy+aCnJ9U= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - mds_thrash: null - workunit: clients: all: - suites/iozone.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-24_21:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T01:32:11.700 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa; will attempt to use it 2024-04-25T01:32:11.700 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa/tasks 2024-04-25T01:32:11.701 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T01:32:11.702 INFO:teuthology.task.internal:Checking packages... 2024-04-25T01:32:11.726 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd2c45d977142e024a59b68a8f1dce8f0b9840551' 2024-04-25T01:32:11.727 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T01:32:11.727 INFO:teuthology.packaging:ref: None 2024-04-25T01:32:11.727 INFO:teuthology.packaging:tag: None 2024-04-25T01:32:11.727 INFO:teuthology.packaging:branch: squid 2024-04-25T01:32:11.727 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T01:32:11.727 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-04-25T01:32:11.944 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2445.gd2c45d97 2024-04-25T01:32:11.946 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T01:32:11.953 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T01:32:11.953 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T01:32:11.962 INFO:teuthology.task.internal:Saving configuration 2024-04-25T01:32:11.982 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T01:32:11.989 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T01:32:12.013 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672336', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 01:25:15.174447', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLbiWRlvXQKTSoKR06Ueq0MnPNY+zyQd5DGsGrxJOE4jsKbW0ijpCbw7wZwcTi5vOq0RsF3EZ9OYi0mlOO6A7e0='} 2024-04-25T01:32:12.036 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672336', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 01:25:15.173021', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKV++hS67ntohN1Uusfa4cZBqzo0BPfTi6JkpSvv0ZH5xhggS83F3T4A7JVDhFyyatvumdPf3HjNk+Hy+aCnJ9U='} 2024-04-25T01:32:12.036 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T01:32:12.042 INFO:teuthology.task.internal:roles: ubuntu@smithi077.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-25T01:32:12.042 INFO:teuthology.task.internal:roles: ubuntu@smithi121.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2024-04-25T01:32:12.042 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T01:32:12.115 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fac5a71e040>, signals=[15]) 2024-04-25T01:32:12.115 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T01:32:12.121 INFO:teuthology.task.internal:Opening connections... 2024-04-25T01:32:12.121 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T01:32:12.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T01:32:12.200 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi121.front.sepia.ceph.com 2024-04-25T01:32:12.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T01:32:12.275 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T01:32:12.282 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2024-04-25T01:32:12.300 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2024-04-25T01:32:12.301 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2024-04-25T01:32:12.357 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream" 2024-04-25T01:32:12.358 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="9" 2024-04-25T01:32:12.358 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos" 2024-04-25T01:32:12.358 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora" 2024-04-25T01:32:12.358 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="9" 2024-04-25T01:32:12.358 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el9" 2024-04-25T01:32:12.358 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T01:32:12.358 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2024-04-25T01:32:12.358 INFO:teuthology.orchestra.run.smithi077.stdout:LOGO="fedora-logo-icon" 2024-04-25T01:32:12.358 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T01:32:12.358 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/" 2024-04-25T01:32:12.358 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T01:32:12.359 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T01:32:12.359 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T01:32:12.359 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2024-04-25T01:32:12.385 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2024-04-25T01:32:12.403 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2024-04-25T01:32:12.403 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2024-04-25T01:32:12.461 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2024-04-25T01:32:12.461 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="9" 2024-04-25T01:32:12.461 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2024-04-25T01:32:12.461 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2024-04-25T01:32:12.461 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="9" 2024-04-25T01:32:12.461 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el9" 2024-04-25T01:32:12.461 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T01:32:12.461 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2024-04-25T01:32:12.461 INFO:teuthology.orchestra.run.smithi121.stdout:LOGO="fedora-logo-icon" 2024-04-25T01:32:12.461 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T01:32:12.461 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2024-04-25T01:32:12.462 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T01:32:12.462 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T01:32:12.462 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T01:32:12.462 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2024-04-25T01:32:12.485 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T01:32:12.495 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T01:32:12.501 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T01:32:12.501 DEBUG:teuthology.orchestra.run.smithi077:> test '!' -e /home/ubuntu/cephtest 2024-04-25T01:32:12.504 DEBUG:teuthology.orchestra.run.smithi121:> test '!' -e /home/ubuntu/cephtest 2024-04-25T01:32:12.520 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T01:32:12.526 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T01:32:12.526 DEBUG:teuthology.orchestra.run.smithi077:> test -z $(ls -A /var/lib/ceph) 2024-04-25T01:32:12.560 DEBUG:teuthology.orchestra.run.smithi121:> test -z $(ls -A /var/lib/ceph) 2024-04-25T01:32:12.749 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T01:32:12.806 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T01:32:12.821 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-04-25T01:32:12.821 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}} 2024-04-25T01:32:12.821 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-04-25T01:32:12.821 DEBUG:teuthology.orchestra.run.smithi077:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T01:32:12.822 DEBUG:teuthology.orchestra.run.smithi121:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T01:32:12.838 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T01:32:12.838 DEBUG:teuthology.orchestra.run.smithi077:> uname -r 2024-04-25T01:32:12.839 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T01:32:12.839 DEBUG:teuthology.orchestra.run.smithi121:> uname -r 2024-04-25T01:32:12.896 INFO:teuthology.orchestra.run.smithi121.stdout:5.14.0-437.el9.x86_64 2024-04-25T01:32:12.896 INFO:teuthology.task.kernel:Running kernel on smithi121: 5.14.0-437.el9.x86_64 2024-04-25T01:32:12.896 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum install -y kernel 2024-04-25T01:32:12.897 INFO:teuthology.orchestra.run.smithi077.stdout:5.14.0-437.el9.x86_64 2024-04-25T01:32:12.898 INFO:teuthology.task.kernel:Running kernel on smithi077: 5.14.0-437.el9.x86_64 2024-04-25T01:32:12.898 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum install -y kernel 2024-04-25T01:32:15.563 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - BaseOS 7.3 MB/s | 8.0 MB 00:01 2024-04-25T01:32:15.887 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - BaseOS 6.1 MB/s | 8.0 MB 00:01 2024-04-25T01:32:17.389 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-04-25T01:32:22.407 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.2 MB 00:01 2024-04-25T01:32:24.249 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 16 kB 00:00 2024-04-25T01:32:25.258 INFO:teuthology.orchestra.run.smithi077.stdout:Extra Packages for Enterprise Linux 23 MB/s | 21 MB 00:00 2024-04-25T01:32:26.003 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - AppStream 2.1 MB/s | 19 MB 00:09 2024-04-25T01:32:30.037 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-04-25T01:32:30.234 INFO:teuthology.orchestra.run.smithi077.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-04-25T01:32:31.654 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 16 kB 00:00 2024-04-25T01:32:32.090 INFO:teuthology.orchestra.run.smithi077.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T01:32:32.090 INFO:teuthology.orchestra.run.smithi077.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T01:32:32.177 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:32:32.178 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-04-25T01:32:32.178 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-25T01:32:32.281 DEBUG:teuthology.orchestra.run.smithi077:> echo no | sudo yum reinstall kernel || true 2024-04-25T01:32:32.819 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:02 ago on Thu 25 Apr 2024 01:32:30 AM UTC. 2024-04-25T01:32:32.938 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:32:32.957 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:32:32.957 INFO:teuthology.orchestra.run.smithi077.stdout: Package Architecture Version Repository Size 2024-04-25T01:32:32.957 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:32:32.957 INFO:teuthology.orchestra.run.smithi077.stdout:Reinstalling: 2024-04-25T01:32:32.958 INFO:teuthology.orchestra.run.smithi077.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T01:32:32.958 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:32:32.958 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-25T01:32:32.958 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:32:32.958 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:32:32.958 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 255 k 2024-04-25T01:32:32.958 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 0 2024-04-25T01:32:32.958 INFO:teuthology.orchestra.run.smithi077.stderr:Operation aborted. 2024-04-25T01:32:33.011 INFO:teuthology.orchestra.run.smithi077.stdout:Is this ok [y/N]: 2024-04-25T01:32:33.011 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum reinstall -y kernel || true 2024-04-25T01:32:33.238 INFO:teuthology.orchestra.run.smithi121.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-04-25T01:32:33.501 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 01:32:30 AM UTC. 2024-04-25T01:32:33.619 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:32:33.619 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:32:33.620 INFO:teuthology.orchestra.run.smithi077.stdout: Package Architecture Version Repository Size 2024-04-25T01:32:33.620 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:32:33.620 INFO:teuthology.orchestra.run.smithi077.stdout:Reinstalling: 2024-04-25T01:32:33.620 INFO:teuthology.orchestra.run.smithi077.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T01:32:33.620 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:32:33.620 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-25T01:32:33.620 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-25T01:32:33.620 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:32:33.620 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 255 k 2024-04-25T01:32:33.620 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 0 2024-04-25T01:32:33.621 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-25T01:32:34.394 INFO:teuthology.orchestra.run.smithi077.stdout:kernel-5.14.0-437.el9.x86_64.rpm 396 kB/s | 255 kB 00:00 2024-04-25T01:32:34.394 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:32:34.394 INFO:teuthology.orchestra.run.smithi077.stdout:Total 329 kB/s | 255 kB 00:00 2024-04-25T01:32:34.418 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-25T01:32:34.616 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-25T01:32:34.616 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-25T01:32:34.620 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-25T01:32:34.621 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-25T01:32:34.750 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-25T01:32:34.829 INFO:teuthology.orchestra.run.smithi077.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T01:32:34.829 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T01:32:35.472 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T01:32:35.473 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T01:32:36.186 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T01:32:36.187 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:32:36.187 INFO:teuthology.orchestra.run.smithi077.stdout:Reinstalled: 2024-04-25T01:32:36.187 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T01:32:36.187 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:32:36.187 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-25T01:32:36.382 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T01:32:36.429 INFO:teuthology.orchestra.run.smithi077.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T01:32:36.430 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T01:32:36.430 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T01:32:36.430 DEBUG:teuthology.parallel:result is None 2024-04-25T01:32:38.338 INFO:teuthology.orchestra.run.smithi121.stdout:lab-extras 11 kB/s | 1.7 kB 00:00 2024-04-25T01:32:40.219 INFO:teuthology.orchestra.run.smithi121.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T01:32:40.219 INFO:teuthology.orchestra.run.smithi121.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T01:32:40.313 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-04-25T01:32:40.314 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2024-04-25T01:32:40.314 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-04-25T01:32:40.422 DEBUG:teuthology.orchestra.run.smithi121:> echo no | sudo yum reinstall kernel || true 2024-04-25T01:32:40.955 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:00:02 ago on Thu 25 Apr 2024 01:32:38 AM UTC. 2024-04-25T01:32:41.082 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-04-25T01:32:41.094 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-04-25T01:32:41.094 INFO:teuthology.orchestra.run.smithi121.stdout: Package Architecture Version Repository Size 2024-04-25T01:32:41.094 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-04-25T01:32:41.094 INFO:teuthology.orchestra.run.smithi121.stdout:Reinstalling: 2024-04-25T01:32:41.094 INFO:teuthology.orchestra.run.smithi121.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T01:32:41.094 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:32:41.094 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-04-25T01:32:41.094 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-04-25T01:32:41.095 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:32:41.095 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 255 k 2024-04-25T01:32:41.095 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 0 2024-04-25T01:32:41.095 INFO:teuthology.orchestra.run.smithi121.stderr:Operation aborted. 2024-04-25T01:32:41.148 INFO:teuthology.orchestra.run.smithi121.stdout:Is this ok [y/N]: 2024-04-25T01:32:41.149 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum reinstall -y kernel || true 2024-04-25T01:32:41.637 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 01:32:38 AM UTC. 2024-04-25T01:32:41.752 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-04-25T01:32:41.753 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-04-25T01:32:41.753 INFO:teuthology.orchestra.run.smithi121.stdout: Package Architecture Version Repository Size 2024-04-25T01:32:41.753 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-04-25T01:32:41.753 INFO:teuthology.orchestra.run.smithi121.stdout:Reinstalling: 2024-04-25T01:32:41.754 INFO:teuthology.orchestra.run.smithi121.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T01:32:41.754 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:32:41.754 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-04-25T01:32:41.754 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-04-25T01:32:41.754 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:32:41.754 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 255 k 2024-04-25T01:32:41.754 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 0 2024-04-25T01:32:41.754 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-04-25T01:32:42.123 INFO:teuthology.orchestra.run.smithi121.stdout:kernel-5.14.0-437.el9.x86_64.rpm 831 kB/s | 255 kB 00:00 2024-04-25T01:32:42.123 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:32:42.123 INFO:teuthology.orchestra.run.smithi121.stdout:Total 690 kB/s | 255 kB 00:00 2024-04-25T01:32:42.145 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-04-25T01:32:42.337 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-04-25T01:32:42.337 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-04-25T01:32:42.342 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-04-25T01:32:42.342 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-04-25T01:32:42.465 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-04-25T01:32:42.541 INFO:teuthology.orchestra.run.smithi121.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T01:32:42.541 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T01:32:43.185 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T01:32:43.185 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T01:32:43.850 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T01:32:43.850 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:32:43.850 INFO:teuthology.orchestra.run.smithi121.stdout:Reinstalled: 2024-04-25T01:32:43.850 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T01:32:43.850 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:32:43.850 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-04-25T01:32:44.018 DEBUG:teuthology.orchestra.run.smithi121:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T01:32:44.065 INFO:teuthology.orchestra.run.smithi121.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T01:32:44.065 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T01:32:44.065 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T01:32:44.066 DEBUG:teuthology.parallel:result is None 2024-04-25T01:32:44.066 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T01:32:44.074 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T01:32:44.074 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T01:32:44.077 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T01:32:44.092 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T01:32:44.100 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T01:32:44.109 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T01:32:44.109 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T01:32:44.135 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T01:32:44.235 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T01:32:44.244 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T01:32:44.244 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T01:32:44.247 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T01:32:44.274 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T01:32:44.289 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T01:32:44.297 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T01:32:44.322 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T01:32:44.323 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T01:32:44.329 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T01:32:44.330 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T01:32:44.332 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T01:32:44.356 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T01:32:44.367 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T01:32:44.367 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T01:32:44.400 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T01:32:44.414 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T01:32:44.495 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T01:32:44.546 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T01:32:44.628 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T01:32:44.667 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:32:44.667 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T01:32:44.730 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T01:32:44.771 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T01:32:44.815 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T01:32:44.897 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T01:32:44.935 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-25T01:32:44.936 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T01:32:44.999 DEBUG:teuthology.orchestra.run.smithi077:> sudo service rsyslog restart 2024-04-25T01:32:45.002 DEBUG:teuthology.orchestra.run.smithi121:> sudo service rsyslog restart 2024-04-25T01:32:45.037 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T01:32:45.082 INFO:teuthology.orchestra.run.smithi121.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T01:32:45.567 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T01:32:45.575 INFO:teuthology.task.internal:Starting timer... 2024-04-25T01:32:45.575 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T01:32:45.589 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T01:32:45.601 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-25T01:32:45.602 DEBUG:teuthology.orchestra.run.smithi077:> sudo service auditd rotate 2024-04-25T01:32:45.670 INFO:teuthology.orchestra.run.smithi077.stdout:Rotating logs: 2024-04-25T01:32:45.671 DEBUG:teuthology.orchestra.run.smithi121:> sudo service auditd rotate 2024-04-25T01:32:45.743 INFO:teuthology.orchestra.run.smithi121.stdout:Rotating logs: 2024-04-25T01:32:45.745 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T01:32:45.745 DEBUG:teuthology.orchestra.run.smithi077:> /usr/sbin/getenforce 2024-04-25T01:32:45.769 INFO:teuthology.orchestra.run.smithi077.stdout:Permissive 2024-04-25T01:32:45.769 DEBUG:teuthology.orchestra.run.smithi121:> /usr/sbin/getenforce 2024-04-25T01:32:45.805 INFO:teuthology.orchestra.run.smithi121.stdout:Permissive 2024-04-25T01:32:45.805 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi077.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi121.front.sepia.ceph.com': 'permissive'} 2024-04-25T01:32:45.805 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T01:32:45.833 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T01:32:45.833 DEBUG:teuthology.orchestra.run.smithi121:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T01:32:45.870 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T01:32:45.870 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T01:32:45.871 DEBUG:teuthology.orchestra.run.smithi077:> sudo /usr/sbin/setenforce permissive 2024-04-25T01:32:45.899 DEBUG:teuthology.orchestra.run.smithi121:> sudo /usr/sbin/setenforce permissive 2024-04-25T01:32:45.936 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T01:32:45.947 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-25T01:32:45.953 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-25T01:32:46.080 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T01:32:46.096 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T01:32:46.098 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi077.front.sepia.ceph.com,smithi121.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T01:36:15.689 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi077.front.sepia.ceph.com'), Remote(name='ubuntu@smithi121.front.sepia.ceph.com')] 2024-04-25T01:36:15.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-04-25T01:36:15.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T01:36:15.766 DEBUG:teuthology.orchestra.run.smithi077:> true 2024-04-25T01:36:15.852 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-04-25T01:36:15.853 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-04-25T01:36:15.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T01:36:15.929 DEBUG:teuthology.orchestra.run.smithi121:> true 2024-04-25T01:36:16.022 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-04-25T01:36:16.023 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T01:36:16.033 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T01:36:16.033 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T01:36:16.034 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T01:36:16.036 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T01:36:16.036 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T01:36:16.061 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T01:36:16.074 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T01:36:16.090 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T01:36:16.096 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: ntpd: command not found 2024-04-25T01:36:16.104 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T01:36:16.107 INFO:teuthology.orchestra.run.smithi077.stdout:506 Cannot talk to daemon 2024-04-25T01:36:16.119 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T01:36:16.127 INFO:teuthology.orchestra.run.smithi121.stderr:sudo: ntpd: command not found 2024-04-25T01:36:16.132 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T01:36:16.137 INFO:teuthology.orchestra.run.smithi121.stdout:506 Cannot talk to daemon 2024-04-25T01:36:16.150 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T01:36:16.163 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T01:36:16.191 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: ntpq: command not found 2024-04-25T01:36:16.194 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T01:36:16.195 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2024-04-25T01:36:16.195 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:36:16.195 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:36:16.195 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:36:16.195 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:36:16.216 INFO:teuthology.orchestra.run.smithi121.stderr:bash: line 1: ntpq: command not found 2024-04-25T01:36:16.220 INFO:teuthology.orchestra.run.smithi121.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T01:36:16.220 INFO:teuthology.orchestra.run.smithi121.stdout:=============================================================================== 2024-04-25T01:36:16.220 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:36:16.220 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:36:16.220 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:36:16.220 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:36:16.221 INFO:teuthology.run_tasks:Running task install... 2024-04-25T01:36:16.233 DEBUG:teuthology.task.install:project ceph 2024-04-25T01:36:16.233 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}} 2024-04-25T01:36:16.233 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'} 2024-04-25T01:36:16.233 INFO:teuthology.task.install:Using flavor: default 2024-04-25T01:36:16.239 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T01:36:16.239 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T01:36:16.239 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'tag': None, 'wait_for_package': False} 2024-04-25T01:36:16.240 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T01:36:16.241 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'tag': None, 'wait_for_package': False} 2024-04-25T01:36:16.242 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T01:36:16.399 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/ 2024-04-25T01:36:16.399 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2445.gd2c45d97 2024-04-25T01:36:16.508 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T01:36:16.508 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-25T01:36:16.508 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T01:36:16.534 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T01:36:16.534 DEBUG:teuthology.orchestra.run.smithi121:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2c45d977142e024a59b68a8f1dce8f0b9840551/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T01:36:16.599 DEBUG:teuthology.orchestra.run.smithi121:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T01:36:16.622 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/ 2024-04-25T01:36:16.623 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2445.gd2c45d97 2024-04-25T01:36:16.671 DEBUG:teuthology.orchestra.run.smithi121:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T01:36:16.734 INFO:teuthology.orchestra.run.smithi121.stdout:check_obsoletes = 1 2024-04-25T01:36:16.735 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum clean all 2024-04-25T01:36:16.898 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T01:36:16.898 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:36:16.898 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T01:36:16.927 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T01:36:16.927 DEBUG:teuthology.orchestra.run.smithi077:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2c45d977142e024a59b68a8f1dce8f0b9840551/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T01:36:16.958 INFO:teuthology.orchestra.run.smithi121.stdout:48 files removed 2024-04-25T01:36:16.984 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T01:36:16.994 DEBUG:teuthology.orchestra.run.smithi077:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T01:36:17.069 DEBUG:teuthology.orchestra.run.smithi077:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T01:36:17.134 INFO:teuthology.orchestra.run.smithi077.stdout:check_obsoletes = 1 2024-04-25T01:36:17.136 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum clean all 2024-04-25T01:36:17.362 INFO:teuthology.orchestra.run.smithi077.stdout:48 files removed 2024-04-25T01:36:17.389 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T01:36:17.712 INFO:teuthology.orchestra.run.smithi121.stdout:ceph packages for x86_64 176 kB/s | 83 kB 00:00 2024-04-25T01:36:18.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph packages for x86_64 203 kB/s | 83 kB 00:00 2024-04-25T01:36:18.104 INFO:teuthology.orchestra.run.smithi121.stdout:ceph noarch packages 33 kB/s | 11 kB 00:00 2024-04-25T01:36:18.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph noarch packages 33 kB/s | 11 kB 00:00 2024-04-25T01:36:18.463 INFO:teuthology.orchestra.run.smithi121.stdout:ceph source packages 5.8 kB/s | 1.9 kB 00:00 2024-04-25T01:36:18.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph source packages 4.7 kB/s | 1.9 kB 00:00 2024-04-25T01:36:18.930 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.0 MB 00:00 2024-04-25T01:36:21.606 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.0 MB 00:02 2024-04-25T01:36:22.531 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - AppStream 7.5 MB/s | 19 MB 00:02 2024-04-25T01:36:28.408 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - AppStream 3.3 MB/s | 19 MB 00:05 2024-04-25T01:36:28.598 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.2 MB 00:02 2024-04-25T01:36:30.232 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 16 kB 00:00 2024-04-25T01:36:32.941 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - CRB 6.6 MB/s | 6.2 MB 00:00 2024-04-25T01:36:35.025 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 16 kB 00:00 2024-04-25T01:36:36.660 INFO:teuthology.orchestra.run.smithi077.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-04-25T01:36:41.802 INFO:teuthology.orchestra.run.smithi077.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-04-25T01:36:43.920 INFO:teuthology.orchestra.run.smithi077.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T01:36:43.920 INFO:teuthology.orchestra.run.smithi077.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T01:36:43.931 INFO:teuthology.orchestra.run.smithi077.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T01:36:43.932 INFO:teuthology.orchestra.run.smithi077.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T01:36:43.933 INFO:teuthology.orchestra.run.smithi077.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T01:36:43.934 INFO:teuthology.orchestra.run.smithi077.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T01:36:43.935 INFO:teuthology.orchestra.run.smithi077.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T01:36:43.938 INFO:teuthology.orchestra.run.smithi077.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T01:36:43.939 INFO:teuthology.orchestra.run.smithi077.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T01:36:43.999 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-25T01:36:44.007 INFO:teuthology.orchestra.run.smithi077.stdout:======================================================================================= 2024-04-25T01:36:44.007 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-04-25T01:36:44.007 INFO:teuthology.orchestra.run.smithi077.stdout:======================================================================================= 2024-04-25T01:36:44.007 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-25T01:36:44.007 INFO:teuthology.orchestra.run.smithi077.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T01:36:44.007 INFO:teuthology.orchestra.run.smithi077.stdout: ceph x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 6.6 k 2024-04-25T01:36:44.008 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.4 M 2024-04-25T01:36:44.008 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 890 k 2024-04-25T01:36:44.008 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 145 k 2024-04-25T01:36:44.008 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 1.5 M 2024-04-25T01:36:44.008 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 141 k 2024-04-25T01:36:44.008 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 3.5 M 2024-04-25T01:36:44.009 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 7.4 M 2024-04-25T01:36:44.009 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 49 k 2024-04-25T01:36:44.009 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 10 M 2024-04-25T01:36:44.009 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 48 M 2024-04-25T01:36:44.009 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-volume noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 264 k 2024-04-25T01:36:44.009 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 762 k 2024-04-25T01:36:44.010 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 222 k 2024-04-25T01:36:44.010 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-shell x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 27 k 2024-04-25T01:36:44.010 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-top noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 18 k 2024-04-25T01:36:44.010 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T01:36:44.010 INFO:teuthology.orchestra.run.smithi077.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T01:36:44.010 INFO:teuthology.orchestra.run.smithi077.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T01:36:44.010 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 32 k 2024-04-25T01:36:44.010 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 745 k 2024-04-25T01:36:44.011 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 127 k 2024-04-25T01:36:44.011 INFO:teuthology.orchestra.run.smithi077.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T01:36:44.011 INFO:teuthology.orchestra.run.smithi077.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T01:36:44.011 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T01:36:44.011 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T01:36:44.012 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T01:36:44.012 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T01:36:44.012 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 162 k 2024-04-25T01:36:44.012 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 321 k 2024-04-25T01:36:44.013 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 299 k 2024-04-25T01:36:44.013 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 99 k 2024-04-25T01:36:44.013 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 85 k 2024-04-25T01:36:44.013 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-25T01:36:44.013 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 171 k 2024-04-25T01:36:44.013 INFO:teuthology.orchestra.run.smithi077.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T01:36:44.013 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrading: 2024-04-25T01:36:44.013 INFO:teuthology.orchestra.run.smithi077.stdout: librados2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.4 M 2024-04-25T01:36:44.014 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-25T01:36:44.014 INFO:teuthology.orchestra.run.smithi077.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T01:36:44.014 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T01:36:44.014 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-04-25T01:36:44.014 INFO:teuthology.orchestra.run.smithi077.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T01:36:44.014 INFO:teuthology.orchestra.run.smithi077.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T01:36:44.014 INFO:teuthology.orchestra.run.smithi077.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T01:36:44.014 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 21 M 2024-04-25T01:36:44.014 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 32 k 2024-04-25T01:36:44.015 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 2.4 M 2024-04-25T01:36:44.015 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 249 k 2024-04-25T01:36:44.015 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 4.7 M 2024-04-25T01:36:44.015 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 17 M 2024-04-25T01:36:44.015 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 15 k 2024-04-25T01:36:44.015 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 25 k 2024-04-25T01:36:44.015 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T01:36:44.015 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T01:36:44.015 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T01:36:44.015 INFO:teuthology.orchestra.run.smithi077.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T01:36:44.015 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T01:36:44.015 INFO:teuthology.orchestra.run.smithi077.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T01:36:44.015 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T01:36:44.016 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T01:36:44.016 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 163 k 2024-04-25T01:36:44.016 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T01:36:44.016 INFO:teuthology.orchestra.run.smithi077.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T01:36:44.016 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T01:36:44.016 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T01:36:44.016 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T01:36:44.016 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 501 k 2024-04-25T01:36:44.016 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T01:36:44.016 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.3 M 2024-04-25T01:36:44.016 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T01:36:44.016 INFO:teuthology.orchestra.run.smithi077.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T01:36:44.016 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T01:36:44.017 INFO:teuthology.orchestra.run.smithi077.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T01:36:44.017 INFO:teuthology.orchestra.run.smithi077.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T01:36:44.017 INFO:teuthology.orchestra.run.smithi077.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T01:36:44.017 INFO:teuthology.orchestra.run.smithi077.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T01:36:44.017 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T01:36:44.017 INFO:teuthology.orchestra.run.smithi077.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T01:36:44.017 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T01:36:44.017 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T01:36:44.017 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T01:36:44.017 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T01:36:44.017 INFO:teuthology.orchestra.run.smithi077.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T01:36:44.017 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T01:36:44.017 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T01:36:44.017 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T01:36:44.018 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 45 k 2024-04-25T01:36:44.018 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 133 k 2024-04-25T01:36:44.018 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T01:36:44.018 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T01:36:44.018 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T01:36:44.018 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T01:36:44.018 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T01:36:44.018 INFO:teuthology.orchestra.run.smithi077.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T01:36:44.018 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T01:36:44.018 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T01:36:44.018 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T01:36:44.018 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T01:36:44.019 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T01:36:44.019 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T01:36:44.019 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T01:36:44.019 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T01:36:44.019 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T01:36:44.019 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T01:36:44.019 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T01:36:44.019 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T01:36:44.019 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T01:36:44.019 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T01:36:44.019 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T01:36:44.019 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T01:36:44.019 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T01:36:44.019 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T01:36:44.020 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T01:36:44.020 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T01:36:44.020 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T01:36:44.020 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T01:36:44.020 INFO:teuthology.orchestra.run.smithi077.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T01:36:44.020 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T01:36:44.020 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T01:36:44.020 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T01:36:44.020 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T01:36:44.020 INFO:teuthology.orchestra.run.smithi077.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T01:36:44.020 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T01:36:44.020 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T01:36:44.020 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T01:36:44.020 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T01:36:44.021 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T01:36:44.021 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T01:36:44.021 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T01:36:44.021 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T01:36:44.021 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T01:36:44.021 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T01:36:44.021 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T01:36:44.021 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T01:36:44.021 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T01:36:44.021 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T01:36:44.021 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T01:36:44.021 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T01:36:44.021 INFO:teuthology.orchestra.run.smithi077.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T01:36:44.021 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T01:36:44.022 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T01:36:44.022 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T01:36:44.022 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T01:36:44.022 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T01:36:44.022 INFO:teuthology.orchestra.run.smithi077.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T01:36:44.022 INFO:teuthology.orchestra.run.smithi077.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T01:36:44.022 INFO:teuthology.orchestra.run.smithi077.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T01:36:44.022 INFO:teuthology.orchestra.run.smithi077.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T01:36:44.022 INFO:teuthology.orchestra.run.smithi077.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T01:36:44.022 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T01:36:44.022 INFO:teuthology.orchestra.run.smithi077.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T01:36:44.022 INFO:teuthology.orchestra.run.smithi077.stdout:Installing weak dependencies: 2024-04-25T01:36:44.022 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T01:36:44.023 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:36:44.023 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-25T01:36:44.023 INFO:teuthology.orchestra.run.smithi077.stdout:======================================================================================= 2024-04-25T01:36:44.023 INFO:teuthology.orchestra.run.smithi077.stdout:Install 148 Packages 2024-04-25T01:36:44.023 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrade 4 Packages 2024-04-25T01:36:44.023 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:36:44.024 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 220 M 2024-04-25T01:36:44.024 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-25T01:36:44.670 INFO:teuthology.orchestra.run.smithi077.stdout:(1/152): ceph-19.0.0-2445.gd2c45d97.el9.x86_64. 27 kB/s | 6.6 kB 00:00 2024-04-25T01:36:45.045 INFO:teuthology.orchestra.run.smithi077.stdout:(2/152): ceph-base-19.0.0-2445.gd2c45d97.el9.x8 8.7 MB/s | 5.4 MB 00:00 2024-04-25T01:36:45.087 INFO:teuthology.orchestra.run.smithi077.stdout:(3/152): ceph-immutable-object-cache-19.0.0-244 3.4 MB/s | 145 kB 00:00 2024-04-25T01:36:45.162 INFO:teuthology.orchestra.run.smithi077.stdout:(4/152): ceph-fuse-19.0.0-2445.gd2c45d97.el9.x8 1.8 MB/s | 890 kB 00:00 2024-04-25T01:36:45.296 INFO:teuthology.orchestra.run.smithi077.stdout:(5/152): ceph-mds-19.0.0-2445.gd2c45d97.el9.x86 11 MB/s | 2.4 MB 00:00 2024-04-25T01:36:45.696 INFO:teuthology.orchestra.run.smithi077.stdout:(6/152): ceph-mon-19.0.0-2445.gd2c45d97.el9.x86 12 MB/s | 4.7 MB 00:00 2024-04-25T01:36:45.863 INFO:teuthology.orchestra.run.smithi077.stdout:(7/152): ceph-mgr-19.0.0-2445.gd2c45d97.el9.x86 2.1 MB/s | 1.5 MB 00:00 2024-04-25T01:36:46.988 INFO:teuthology.orchestra.run.smithi077.stdout:(8/152): ceph-common-19.0.0-2445.gd2c45d97.el9. 8.2 MB/s | 21 MB 00:02 2024-04-25T01:36:47.173 INFO:teuthology.orchestra.run.smithi077.stdout:(9/152): ceph-osd-19.0.0-2445.gd2c45d97.el9.x86 11 MB/s | 17 MB 00:01 2024-04-25T01:36:48.034 INFO:teuthology.orchestra.run.smithi077.stdout:(10/152): ceph-selinux-19.0.0-2445.gd2c45d97.el 120 kB/s | 25 kB 00:00 2024-04-25T01:36:48.035 INFO:teuthology.orchestra.run.smithi077.stdout:(11/152): cephfs-mirror-19.0.0-2445.gd2c45d97.e 2.6 MB/s | 222 kB 00:00 2024-04-25T01:36:48.035 INFO:teuthology.orchestra.run.smithi077.stdout:(12/152): cephfs-shell-19.0.0-2445.gd2c45d97.el 361 kB/s | 27 kB 00:00 2024-04-25T01:36:48.035 INFO:teuthology.orchestra.run.smithi077.stdout:(13/152): libcephfs-devel-19.0.0-2445.gd2c45d97 380 kB/s | 32 kB 00:00 2024-04-25T01:36:48.035 INFO:teuthology.orchestra.run.smithi077.stdout:(14/152): libcephfs2-19.0.0-2445.gd2c45d97.el9. 4.6 MB/s | 745 kB 00:00 2024-04-25T01:36:48.035 INFO:teuthology.orchestra.run.smithi077.stdout:(15/152): libcephsqlite-19.0.0-2445.gd2c45d97.e 1.7 MB/s | 163 kB 00:00 2024-04-25T01:36:48.035 INFO:teuthology.orchestra.run.smithi077.stdout:(16/152): ceph-radosgw-19.0.0-2445.gd2c45d97.el 5.2 MB/s | 10 MB 00:01 2024-04-25T01:36:48.035 INFO:teuthology.orchestra.run.smithi077.stdout:(17/152): librados-devel-19.0.0-2445.gd2c45d97. 721 kB/s | 127 kB 00:00 2024-04-25T01:36:48.035 INFO:teuthology.orchestra.run.smithi077.stdout:(18/152): libradosstriper1-19.0.0-2445.gd2c45d9 5.9 MB/s | 501 kB 00:00 2024-04-25T01:36:48.035 INFO:teuthology.orchestra.run.smithi077.stdout:(19/152): python3-ceph-argparse-19.0.0-2445.gd2 541 kB/s | 45 kB 00:00 2024-04-25T01:36:48.101 INFO:teuthology.orchestra.run.smithi077.stdout:(20/152): python3-ceph-common-19.0.0-2445.gd2c4 1.4 MB/s | 133 kB 00:00 2024-04-25T01:36:48.193 INFO:teuthology.orchestra.run.smithi077.stdout:(21/152): python3-cephfs-19.0.0-2445.gd2c45d97. 1.7 MB/s | 162 kB 00:00 2024-04-25T01:36:48.301 INFO:teuthology.orchestra.run.smithi077.stdout:(22/152): python3-rados-19.0.0-2445.gd2c45d97.e 2.9 MB/s | 321 kB 00:00 2024-04-25T01:36:48.410 INFO:teuthology.orchestra.run.smithi077.stdout:(23/152): python3-rbd-19.0.0-2445.gd2c45d97.el9 2.7 MB/s | 299 kB 00:00 2024-04-25T01:36:48.502 INFO:teuthology.orchestra.run.smithi077.stdout:(24/152): librgw2-19.0.0-2445.gd2c45d97.el9.x86 8.4 MB/s | 5.3 MB 00:00 2024-04-25T01:36:48.527 INFO:teuthology.orchestra.run.smithi077.stdout:(25/152): python3-rgw-19.0.0-2445.gd2c45d97.el9 851 kB/s | 99 kB 00:00 2024-04-25T01:36:48.586 INFO:teuthology.orchestra.run.smithi077.stdout:(26/152): rbd-fuse-19.0.0-2445.gd2c45d97.el9.x8 1.0 MB/s | 85 kB 00:00 2024-04-25T01:36:48.686 INFO:teuthology.orchestra.run.smithi077.stdout:(27/152): rbd-nbd-19.0.0-2445.gd2c45d97.el9.x86 1.7 MB/s | 171 kB 00:00 2024-04-25T01:36:48.803 INFO:teuthology.orchestra.run.smithi077.stdout:(28/152): ceph-grafana-dashboards-19.0.0-2445.g 272 kB/s | 32 kB 00:00 2024-04-25T01:36:48.928 INFO:teuthology.orchestra.run.smithi077.stdout:(29/152): rbd-mirror-19.0.0-2445.gd2c45d97.el9. 7.7 MB/s | 3.1 MB 00:00 2024-04-25T01:36:48.945 INFO:teuthology.orchestra.run.smithi077.stdout:(30/152): ceph-mgr-cephadm-19.0.0-2445.gd2c45d9 995 kB/s | 141 kB 00:00 2024-04-25T01:36:49.387 INFO:teuthology.orchestra.run.smithi077.stdout:(31/152): ceph-mgr-dashboard-19.0.0-2445.gd2c45 7.7 MB/s | 3.5 MB 00:00 2024-04-25T01:36:49.488 INFO:teuthology.orchestra.run.smithi077.stdout:(32/152): ceph-mgr-modules-core-19.0.0-2445.gd2 2.4 MB/s | 249 kB 00:00 2024-04-25T01:36:49.571 INFO:teuthology.orchestra.run.smithi077.stdout:(33/152): ceph-mgr-rook-19.0.0-2445.gd2c45d97.e 593 kB/s | 49 kB 00:00 2024-04-25T01:36:49.680 INFO:teuthology.orchestra.run.smithi077.stdout:(34/152): ceph-prometheus-alerts-19.0.0-2445.gd 141 kB/s | 15 kB 00:00 2024-04-25T01:36:49.797 INFO:teuthology.orchestra.run.smithi077.stdout:(35/152): ceph-volume-19.0.0-2445.gd2c45d97.el9 2.2 MB/s | 264 kB 00:00 2024-04-25T01:36:50.289 INFO:teuthology.orchestra.run.smithi077.stdout:(36/152): ceph-mgr-diskprediction-local-19.0.0- 5.5 MB/s | 7.4 MB 00:01 2024-04-25T01:36:50.322 INFO:teuthology.orchestra.run.smithi077.stdout:(37/152): cephadm-19.0.0-2445.gd2c45d97.el9.noa 1.4 MB/s | 762 kB 00:00 2024-04-25T01:36:50.373 INFO:teuthology.orchestra.run.smithi077.stdout:(38/152): cephfs-top-19.0.0-2445.gd2c45d97.el9. 219 kB/s | 18 kB 00:00 2024-04-25T01:36:50.515 INFO:teuthology.orchestra.run.smithi077.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 418 kB/s | 80 kB 00:00 2024-04-25T01:36:50.740 INFO:teuthology.orchestra.run.smithi077.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 803 kB 00:00 2024-04-25T01:36:50.773 INFO:teuthology.orchestra.run.smithi077.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 755 kB/s | 195 kB 00:00 2024-04-25T01:36:51.091 INFO:teuthology.orchestra.run.smithi077.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 722 kB/s | 253 kB 00:00 2024-04-25T01:36:51.333 INFO:teuthology.orchestra.run.smithi077.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 441 kB/s | 106 kB 00:00 2024-04-25T01:36:51.408 INFO:teuthology.orchestra.run.smithi077.stdout:(44/152): python3-cryptography-36.0.1-4.el9.x86 1.9 MB/s | 1.2 MB 00:00 2024-04-25T01:36:51.608 INFO:teuthology.orchestra.run.smithi077.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 491 kB/s | 135 kB 00:00 2024-04-25T01:36:51.633 INFO:teuthology.orchestra.run.smithi077.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 554 kB/s | 125 kB 00:00 2024-04-25T01:36:51.801 INFO:teuthology.orchestra.run.smithi077.stdout:(47/152): automake-1.16.2-8.el9.noarch.rpm 4.0 MB/s | 689 kB 00:00 2024-04-25T01:36:51.859 INFO:teuthology.orchestra.run.smithi077.stdout:(48/152): python3-urllib3-1.26.5-5.el9.noarch.r 857 kB/s | 215 kB 00:00 2024-04-25T01:36:51.901 INFO:teuthology.orchestra.run.smithi077.stdout:(49/152): bison-3.7.4-5.el9.x86_64.rpm 9.2 MB/s | 943 kB 00:00 2024-04-25T01:36:51.943 INFO:teuthology.orchestra.run.smithi077.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 516 kB/s | 21 kB 00:00 2024-04-25T01:36:51.985 INFO:teuthology.orchestra.run.smithi077.stdout:(51/152): flex-2.6.4-9.el9.x86_64.rpm 7.4 MB/s | 313 kB 00:00 2024-04-25T01:36:52.010 INFO:teuthology.orchestra.run.smithi077.stdout:(52/152): boost-program-options-1.75.0-8.el9.x8 708 kB/s | 107 kB 00:00 2024-04-25T01:36:52.036 INFO:teuthology.orchestra.run.smithi077.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 649 kB/s | 33 kB 00:00 2024-04-25T01:36:52.078 INFO:teuthology.orchestra.run.smithi077.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 437 kB/s | 18 kB 00:00 2024-04-25T01:36:52.120 INFO:teuthology.orchestra.run.smithi077.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 268 kB/s | 11 kB 00:00 2024-04-25T01:36:52.161 INFO:teuthology.orchestra.run.smithi077.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 160 kB 00:00 2024-04-25T01:36:52.220 INFO:teuthology.orchestra.run.smithi077.stdout:(57/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-04-25T01:36:52.245 INFO:teuthology.orchestra.run.smithi077.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 541 kB/s | 45 kB 00:00 2024-04-25T01:36:52.282 INFO:teuthology.orchestra.run.smithi077.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-04-25T01:36:52.313 INFO:teuthology.orchestra.run.smithi077.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 8.5 MB/s | 582 kB 00:00 2024-04-25T01:36:52.338 INFO:teuthology.orchestra.run.smithi077.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 435 kB/s | 25 kB 00:00 2024-04-25T01:36:52.363 INFO:teuthology.orchestra.run.smithi077.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-04-25T01:36:52.389 INFO:teuthology.orchestra.run.smithi077.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-04-25T01:36:52.414 INFO:teuthology.orchestra.run.smithi077.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-04-25T01:36:52.498 INFO:teuthology.orchestra.run.smithi077.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 324 kB/s | 35 kB 00:00 2024-04-25T01:36:52.590 INFO:teuthology.orchestra.run.smithi077.stdout:(66/152): openblas-openmp-0.3.21-2.el9.x86_64.r 27 MB/s | 4.7 MB 00:00 2024-04-25T01:36:52.665 INFO:teuthology.orchestra.run.smithi077.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 27 MB/s | 4.4 MB 00:00 2024-04-25T01:36:52.715 INFO:teuthology.orchestra.run.smithi077.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-04-25T01:36:52.749 INFO:teuthology.orchestra.run.smithi077.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 11 MB/s | 911 kB 00:00 2024-04-25T01:36:52.774 INFO:teuthology.orchestra.run.smithi077.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-04-25T01:36:52.833 INFO:teuthology.orchestra.run.smithi077.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-04-25T01:36:52.908 INFO:teuthology.orchestra.run.smithi077.stdout:(72/152): postgresql-server-13.14-1.el9.x86_64. 36 MB/s | 5.8 MB 00:00 2024-04-25T01:36:52.934 INFO:teuthology.orchestra.run.smithi077.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 875 kB/s | 87 kB 00:00 2024-04-25T01:36:52.976 INFO:teuthology.orchestra.run.smithi077.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 5.7 MB/s | 244 kB 00:00 2024-04-25T01:36:53.060 INFO:teuthology.orchestra.run.smithi077.stdout:(75/152): python3-babel-2.9.1-2.el9.noarch.rpm 40 MB/s | 6.0 MB 00:00 2024-04-25T01:36:53.085 INFO:teuthology.orchestra.run.smithi077.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 2.2 MB/s | 248 kB 00:00 2024-04-25T01:36:53.110 INFO:teuthology.orchestra.run.smithi077.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-04-25T01:36:53.135 INFO:teuthology.orchestra.run.smithi077.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-04-25T01:36:53.169 INFO:teuthology.orchestra.run.smithi077.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-04-25T01:36:53.194 INFO:teuthology.orchestra.run.smithi077.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 595 kB/s | 35 kB 00:00 2024-04-25T01:36:53.236 INFO:teuthology.orchestra.run.smithi077.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-04-25T01:36:53.303 INFO:teuthology.orchestra.run.smithi077.stdout:(82/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 5.1 MB 00:00 2024-04-25T01:36:53.328 INFO:teuthology.orchestra.run.smithi077.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-04-25T01:36:53.353 INFO:teuthology.orchestra.run.smithi077.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-04-25T01:36:53.379 INFO:teuthology.orchestra.run.smithi077.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 843 kB/s | 42 kB 00:00 2024-04-25T01:36:53.804 INFO:teuthology.orchestra.run.smithi077.stdout:(86/152): ceph-test-19.0.0-2445.gd2c45d97.el9.x 7.3 MB/s | 48 MB 00:06 2024-04-25T01:36:53.829 INFO:teuthology.orchestra.run.smithi077.stdout:(87/152): python3-protobuf-3.14.0-13.el9.noarch 566 kB/s | 269 kB 00:00 2024-04-25T01:36:53.855 INFO:teuthology.orchestra.run.smithi077.stdout:(88/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 334 kB/s | 159 kB 00:00 2024-04-25T01:36:53.880 INFO:teuthology.orchestra.run.smithi077.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-25T01:36:53.905 INFO:teuthology.orchestra.run.smithi077.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-04-25T01:36:53.947 INFO:teuthology.orchestra.run.smithi077.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 999 kB/s | 42 kB 00:00 2024-04-25T01:36:53.972 INFO:teuthology.orchestra.run.smithi077.stdout:(92/152): python3-pyasn1-modules-0.4.8-6.el9.no 1.6 MB/s | 279 kB 00:00 2024-04-25T01:36:53.998 INFO:teuthology.orchestra.run.smithi077.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 882 kB/s | 44 kB 00:00 2024-04-25T01:36:54.023 INFO:teuthology.orchestra.run.smithi077.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-04-25T01:36:54.048 INFO:teuthology.orchestra.run.smithi077.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-04-25T01:36:54.074 INFO:teuthology.orchestra.run.smithi077.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-04-25T01:36:54.099 INFO:teuthology.orchestra.run.smithi077.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 305 kB 00:00 2024-04-25T01:36:54.124 INFO:teuthology.orchestra.run.smithi077.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-04-25T01:36:54.150 INFO:teuthology.orchestra.run.smithi077.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-04-25T01:36:54.175 INFO:teuthology.orchestra.run.smithi077.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-25T01:36:54.200 INFO:teuthology.orchestra.run.smithi077.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 890 kB/s | 45 kB 00:00 2024-04-25T01:36:54.409 INFO:teuthology.orchestra.run.smithi077.stdout:(102/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-04-25T01:36:54.434 INFO:teuthology.orchestra.run.smithi077.stdout:(103/152): lua-devel-5.4.4-4.el9.x86_64.rpm 86 kB/s | 22 kB 00:00 2024-04-25T01:36:54.643 INFO:teuthology.orchestra.run.smithi077.stdout:(104/152): gperftools-libs-2.9.1-2.el9.x86_64.r 1.4 MB/s | 309 kB 00:00 2024-04-25T01:36:54.693 INFO:teuthology.orchestra.run.smithi077.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 389 kB/s | 19 kB 00:00 2024-04-25T01:36:54.735 INFO:teuthology.orchestra.run.smithi077.stdout:(106/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.6 MB/s | 548 kB 00:00 2024-04-25T01:36:54.777 INFO:teuthology.orchestra.run.smithi077.stdout:(107/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 627 kB/s | 26 kB 00:00 2024-04-25T01:36:54.827 INFO:teuthology.orchestra.run.smithi077.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 970 kB/s | 49 kB 00:00 2024-04-25T01:36:54.852 INFO:teuthology.orchestra.run.smithi077.stdout:(109/152): protobuf-compiler-3.14.0-13.el9.x86_ 1.3 MB/s | 863 kB 00:00 2024-04-25T01:36:54.895 INFO:teuthology.orchestra.run.smithi077.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-04-25T01:36:55.020 INFO:teuthology.orchestra.run.smithi077.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 905 kB/s | 151 kB 00:00 2024-04-25T01:36:55.162 INFO:teuthology.orchestra.run.smithi077.stdout:(112/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.1 MB/s | 838 kB 00:00 2024-04-25T01:36:55.204 INFO:teuthology.orchestra.run.smithi077.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-04-25T01:36:55.246 INFO:teuthology.orchestra.run.smithi077.stdout:(114/152): python3-cachetools-4.2.4-1.el9.noarc 775 kB/s | 32 kB 00:00 2024-04-25T01:36:55.287 INFO:teuthology.orchestra.run.smithi077.stdout:(115/152): python3-certifi-2021.10.8-2.el9.noar 362 kB/s | 15 kB 00:00 2024-04-25T01:36:55.313 INFO:teuthology.orchestra.run.smithi077.stdout:(116/152): python3-asyncssh-2.13.2-5.el9.noarch 1.8 MB/s | 548 kB 00:00 2024-04-25T01:36:55.372 INFO:teuthology.orchestra.run.smithi077.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-04-25T01:36:55.455 INFO:teuthology.orchestra.run.smithi077.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 2.5 MB/s | 358 kB 00:00 2024-04-25T01:36:55.497 INFO:teuthology.orchestra.run.smithi077.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-04-25T01:36:55.522 INFO:teuthology.orchestra.run.smithi077.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 527 kB/s | 35 kB 00:00 2024-04-25T01:36:55.557 INFO:teuthology.orchestra.run.smithi077.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 3.4 MB/s | 206 kB 00:00 2024-04-25T01:36:55.615 INFO:teuthology.orchestra.run.smithi077.stdout:(122/152): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-04-25T01:36:55.657 INFO:teuthology.orchestra.run.smithi077.stdout:(123/152): python3-jaraco-8.2.1-3.el9.noarch.rp 257 kB/s | 11 kB 00:00 2024-04-25T01:36:55.724 INFO:teuthology.orchestra.run.smithi077.stdout:(124/152): libarrow-9.0.0-10.el9.x86_64.rpm 4.3 MB/s | 4.4 MB 00:01 2024-04-25T01:36:55.751 INFO:teuthology.orchestra.run.smithi077.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 188 kB/s | 18 kB 00:00 2024-04-25T01:36:55.776 INFO:teuthology.orchestra.run.smithi077.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 443 kB/s | 23 kB 00:00 2024-04-25T01:36:55.802 INFO:teuthology.orchestra.run.smithi077.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-04-25T01:36:55.812 INFO:teuthology.orchestra.run.smithi121.stdout:Extra Packages for Enterprise Linux 842 kB/s | 21 MB 00:25 2024-04-25T01:36:55.827 INFO:teuthology.orchestra.run.smithi077.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-04-25T01:36:55.877 INFO:teuthology.orchestra.run.smithi077.stdout:(129/152): python3-logutils-0.3.5-21.el9.noarch 929 kB/s | 46 kB 00:00 2024-04-25T01:36:55.936 INFO:teuthology.orchestra.run.smithi077.stdout:(130/152): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-04-25T01:36:55.986 INFO:teuthology.orchestra.run.smithi077.stdout:(131/152): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-04-25T01:36:56.070 INFO:teuthology.orchestra.run.smithi077.stdout:(132/152): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-04-25T01:36:56.112 INFO:teuthology.orchestra.run.smithi077.stdout:(133/152): python3-portend-3.1.0-2.el9.noarch.r 396 kB/s | 16 kB 00:00 2024-04-25T01:36:56.162 INFO:teuthology.orchestra.run.smithi077.stdout:(134/152): python3-grpcio-1.46.7-10.el9.x86_64. 3.2 MB/s | 2.0 MB 00:00 2024-04-25T01:36:56.196 INFO:teuthology.orchestra.run.smithi077.stdout:(135/152): python3-kubernetes-26.1.0-2.el9.noar 2.6 MB/s | 1.0 MB 00:00 2024-04-25T01:36:56.221 INFO:teuthology.orchestra.run.smithi077.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 481 kB/s | 28 kB 00:00 2024-04-25T01:36:56.246 INFO:teuthology.orchestra.run.smithi077.stdout:(137/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 671 kB/s | 90 kB 00:00 2024-04-25T01:36:56.271 INFO:teuthology.orchestra.run.smithi077.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 409 kB/s | 31 kB 00:00 2024-04-25T01:36:56.313 INFO:teuthology.orchestra.run.smithi077.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-04-25T01:36:56.338 INFO:teuthology.orchestra.run.smithi077.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 536 kB/s | 36 kB 00:00 2024-04-25T01:36:56.364 INFO:teuthology.orchestra.run.smithi077.stdout:(141/152): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-04-25T01:36:56.381 INFO:teuthology.orchestra.run.smithi077.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 758 kB/s | 51 kB 00:00 2024-04-25T01:36:56.406 INFO:teuthology.orchestra.run.smithi077.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 3.3 MB/s | 230 kB 00:00 2024-04-25T01:36:56.431 INFO:teuthology.orchestra.run.smithi077.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-04-25T01:36:56.448 INFO:teuthology.orchestra.run.smithi077.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 476 kB/s | 20 kB 00:00 2024-04-25T01:36:56.499 INFO:teuthology.orchestra.run.smithi077.stdout:(146/152): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-04-25T01:36:56.541 INFO:teuthology.orchestra.run.smithi077.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-04-25T01:36:56.774 INFO:teuthology.orchestra.run.smithi077.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 4.9 MB/s | 1.6 MB 00:00 2024-04-25T01:36:57.066 INFO:teuthology.orchestra.run.smithi077.stdout:(149/152): librbd1-19.0.0-2445.gd2c45d97.el9.x8 6.0 MB/s | 3.1 MB 00:00 2024-04-25T01:36:57.150 INFO:teuthology.orchestra.run.smithi077.stdout:(150/152): librados2-19.0.0-2445.gd2c45d97.el9. 5.2 MB/s | 3.4 MB 00:00 2024-04-25T01:36:57.383 INFO:teuthology.orchestra.run.smithi077.stdout:(151/152): openssl-3.2.1-1.el9.x86_64.rpm 2.2 MB/s | 1.3 MB 00:00 2024-04-25T01:36:57.933 INFO:teuthology.orchestra.run.smithi077.stdout:(152/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 2.8 MB/s | 2.4 MB 00:00 2024-04-25T01:36:57.937 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:36:57.937 INFO:teuthology.orchestra.run.smithi077.stdout:Total 16 MB/s | 220 MB 00:13 2024-04-25T01:36:59.033 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-25T01:36:59.177 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-25T01:36:59.177 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-25T01:37:00.879 INFO:teuthology.orchestra.run.smithi121.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-25T01:37:00.929 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-25T01:37:00.930 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-25T01:37:03.004 INFO:teuthology.orchestra.run.smithi121.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T01:37:03.005 INFO:teuthology.orchestra.run.smithi121.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T01:37:03.016 INFO:teuthology.orchestra.run.smithi121.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T01:37:03.017 INFO:teuthology.orchestra.run.smithi121.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T01:37:03.017 INFO:teuthology.orchestra.run.smithi121.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T01:37:03.018 INFO:teuthology.orchestra.run.smithi121.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T01:37:03.021 INFO:teuthology.orchestra.run.smithi121.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T01:37:03.022 INFO:teuthology.orchestra.run.smithi121.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T01:37:03.023 INFO:teuthology.orchestra.run.smithi121.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T01:37:03.083 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-04-25T01:37:03.092 INFO:teuthology.orchestra.run.smithi121.stdout:======================================================================================= 2024-04-25T01:37:03.092 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2024-04-25T01:37:03.092 INFO:teuthology.orchestra.run.smithi121.stdout:======================================================================================= 2024-04-25T01:37:03.092 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-04-25T01:37:03.092 INFO:teuthology.orchestra.run.smithi121.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T01:37:03.093 INFO:teuthology.orchestra.run.smithi121.stdout: ceph x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 6.6 k 2024-04-25T01:37:03.093 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.4 M 2024-04-25T01:37:03.093 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 890 k 2024-04-25T01:37:03.093 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 145 k 2024-04-25T01:37:03.093 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 1.5 M 2024-04-25T01:37:03.093 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 141 k 2024-04-25T01:37:03.093 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 3.5 M 2024-04-25T01:37:03.093 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 7.4 M 2024-04-25T01:37:03.093 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 49 k 2024-04-25T01:37:03.093 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 10 M 2024-04-25T01:37:03.093 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 48 M 2024-04-25T01:37:03.093 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-volume noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 264 k 2024-04-25T01:37:03.093 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 762 k 2024-04-25T01:37:03.093 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 222 k 2024-04-25T01:37:03.094 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-shell x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 27 k 2024-04-25T01:37:03.094 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-top noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 18 k 2024-04-25T01:37:03.094 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T01:37:03.094 INFO:teuthology.orchestra.run.smithi121.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T01:37:03.094 INFO:teuthology.orchestra.run.smithi121.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T01:37:03.094 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 32 k 2024-04-25T01:37:03.094 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 745 k 2024-04-25T01:37:03.094 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 127 k 2024-04-25T01:37:03.094 INFO:teuthology.orchestra.run.smithi121.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T01:37:03.094 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T01:37:03.094 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T01:37:03.094 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T01:37:03.094 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T01:37:03.094 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T01:37:03.095 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 162 k 2024-04-25T01:37:03.095 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 321 k 2024-04-25T01:37:03.095 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 299 k 2024-04-25T01:37:03.095 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 99 k 2024-04-25T01:37:03.095 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 85 k 2024-04-25T01:37:03.095 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-25T01:37:03.095 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 171 k 2024-04-25T01:37:03.095 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T01:37:03.095 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrading: 2024-04-25T01:37:03.095 INFO:teuthology.orchestra.run.smithi121.stdout: librados2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.4 M 2024-04-25T01:37:03.095 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-25T01:37:03.095 INFO:teuthology.orchestra.run.smithi121.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T01:37:03.095 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T01:37:03.096 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-04-25T01:37:03.096 INFO:teuthology.orchestra.run.smithi121.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T01:37:03.096 INFO:teuthology.orchestra.run.smithi121.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T01:37:03.096 INFO:teuthology.orchestra.run.smithi121.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T01:37:03.096 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 21 M 2024-04-25T01:37:03.096 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 32 k 2024-04-25T01:37:03.096 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 2.4 M 2024-04-25T01:37:03.096 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 249 k 2024-04-25T01:37:03.096 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 4.7 M 2024-04-25T01:37:03.096 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 17 M 2024-04-25T01:37:03.096 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 15 k 2024-04-25T01:37:03.096 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 25 k 2024-04-25T01:37:03.096 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T01:37:03.096 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T01:37:03.097 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T01:37:03.097 INFO:teuthology.orchestra.run.smithi121.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T01:37:03.097 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T01:37:03.097 INFO:teuthology.orchestra.run.smithi121.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T01:37:03.097 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T01:37:03.097 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T01:37:03.097 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 163 k 2024-04-25T01:37:03.097 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T01:37:03.097 INFO:teuthology.orchestra.run.smithi121.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T01:37:03.097 INFO:teuthology.orchestra.run.smithi121.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T01:37:03.097 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T01:37:03.097 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T01:37:03.097 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 501 k 2024-04-25T01:37:03.097 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T01:37:03.098 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.3 M 2024-04-25T01:37:03.098 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T01:37:03.098 INFO:teuthology.orchestra.run.smithi121.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T01:37:03.098 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T01:37:03.098 INFO:teuthology.orchestra.run.smithi121.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T01:37:03.098 INFO:teuthology.orchestra.run.smithi121.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T01:37:03.098 INFO:teuthology.orchestra.run.smithi121.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T01:37:03.098 INFO:teuthology.orchestra.run.smithi121.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T01:37:03.098 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T01:37:03.098 INFO:teuthology.orchestra.run.smithi121.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T01:37:03.098 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T01:37:03.098 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T01:37:03.098 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T01:37:03.099 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T01:37:03.099 INFO:teuthology.orchestra.run.smithi121.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T01:37:03.099 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T01:37:03.099 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T01:37:03.099 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T01:37:03.099 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 45 k 2024-04-25T01:37:03.099 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 133 k 2024-04-25T01:37:03.099 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T01:37:03.099 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T01:37:03.099 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T01:37:03.099 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T01:37:03.099 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T01:37:03.099 INFO:teuthology.orchestra.run.smithi121.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T01:37:03.099 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T01:37:03.100 INFO:teuthology.orchestra.run.smithi121.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T01:37:03.100 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T01:37:03.100 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T01:37:03.100 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T01:37:03.100 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T01:37:03.100 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T01:37:03.100 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T01:37:03.100 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T01:37:03.100 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T01:37:03.100 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T01:37:03.100 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T01:37:03.100 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T01:37:03.100 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T01:37:03.100 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T01:37:03.101 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T01:37:03.101 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T01:37:03.101 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T01:37:03.101 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T01:37:03.101 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T01:37:03.101 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T01:37:03.101 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T01:37:03.101 INFO:teuthology.orchestra.run.smithi121.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T01:37:03.101 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T01:37:03.101 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T01:37:03.101 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T01:37:03.101 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T01:37:03.101 INFO:teuthology.orchestra.run.smithi121.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T01:37:03.101 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T01:37:03.102 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T01:37:03.102 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T01:37:03.102 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T01:37:03.102 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T01:37:03.102 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T01:37:03.102 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T01:37:03.102 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T01:37:03.102 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T01:37:03.102 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T01:37:03.102 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T01:37:03.102 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T01:37:03.102 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T01:37:03.102 INFO:teuthology.orchestra.run.smithi121.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T01:37:03.102 INFO:teuthology.orchestra.run.smithi121.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T01:37:03.103 INFO:teuthology.orchestra.run.smithi121.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T01:37:03.103 INFO:teuthology.orchestra.run.smithi121.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T01:37:03.103 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T01:37:03.103 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T01:37:03.103 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T01:37:03.103 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T01:37:03.103 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T01:37:03.103 INFO:teuthology.orchestra.run.smithi121.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T01:37:03.103 INFO:teuthology.orchestra.run.smithi121.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T01:37:03.103 INFO:teuthology.orchestra.run.smithi121.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T01:37:03.103 INFO:teuthology.orchestra.run.smithi121.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T01:37:03.103 INFO:teuthology.orchestra.run.smithi121.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T01:37:03.103 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T01:37:03.103 INFO:teuthology.orchestra.run.smithi121.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T01:37:03.104 INFO:teuthology.orchestra.run.smithi121.stdout:Installing weak dependencies: 2024-04-25T01:37:03.104 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T01:37:03.104 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:37:03.104 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-04-25T01:37:03.104 INFO:teuthology.orchestra.run.smithi121.stdout:======================================================================================= 2024-04-25T01:37:03.104 INFO:teuthology.orchestra.run.smithi121.stdout:Install 148 Packages 2024-04-25T01:37:03.104 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrade 4 Packages 2024-04-25T01:37:03.104 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:37:03.104 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 220 M 2024-04-25T01:37:03.105 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-04-25T01:37:03.955 INFO:teuthology.orchestra.run.smithi121.stdout:(1/152): ceph-19.0.0-2445.gd2c45d97.el9.x86_64. 36 kB/s | 6.6 kB 00:00 2024-04-25T01:37:04.163 INFO:teuthology.orchestra.run.smithi121.stdout:(2/152): ceph-fuse-19.0.0-2445.gd2c45d97.el9.x8 4.2 MB/s | 890 kB 00:00 2024-04-25T01:37:04.213 INFO:teuthology.orchestra.run.smithi121.stdout:(3/152): ceph-immutable-object-cache-19.0.0-244 2.8 MB/s | 145 kB 00:00 2024-04-25T01:37:04.481 INFO:teuthology.orchestra.run.smithi121.stdout:(4/152): ceph-mds-19.0.0-2445.gd2c45d97.el9.x86 8.9 MB/s | 2.4 MB 00:00 2024-04-25T01:37:04.673 INFO:teuthology.orchestra.run.smithi121.stdout:(5/152): ceph-mgr-19.0.0-2445.gd2c45d97.el9.x86 7.8 MB/s | 1.5 MB 00:00 2024-04-25T01:37:04.814 INFO:teuthology.orchestra.run.smithi121.stdout:(6/152): ceph-base-19.0.0-2445.gd2c45d97.el9.x8 5.1 MB/s | 5.4 MB 00:01 2024-04-25T01:37:05.140 INFO:teuthology.orchestra.run.smithi121.stdout:(7/152): ceph-mon-19.0.0-2445.gd2c45d97.el9.x86 10 MB/s | 4.7 MB 00:00 2024-04-25T01:37:06.606 INFO:teuthology.orchestra.run.smithi121.stdout:(8/152): ceph-osd-19.0.0-2445.gd2c45d97.el9.x86 9.4 MB/s | 17 MB 00:01 2024-04-25T01:37:06.715 INFO:teuthology.orchestra.run.smithi121.stdout:(9/152): ceph-radosgw-19.0.0-2445.gd2c45d97.el9 6.5 MB/s | 10 MB 00:01 2024-04-25T01:37:06.740 INFO:teuthology.orchestra.run.smithi121.stdout:(10/152): ceph-selinux-19.0.0-2445.gd2c45d97.el 188 kB/s | 25 kB 00:00 2024-04-25T01:37:06.949 INFO:teuthology.orchestra.run.smithi121.stdout:(11/152): ceph-common-19.0.0-2445.gd2c45d97.el9 6.6 MB/s | 21 MB 00:03 2024-04-25T01:37:06.974 INFO:teuthology.orchestra.run.smithi121.stdout:(12/152): cephfs-mirror-19.0.0-2445.gd2c45d97.e 951 kB/s | 222 kB 00:00 2024-04-25T01:37:07.020 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-25T01:37:07.033 INFO:teuthology.orchestra.run.smithi121.stdout:(13/152): cephfs-shell-19.0.0-2445.gd2c45d97.el 325 kB/s | 27 kB 00:00 2024-04-25T01:37:07.066 INFO:teuthology.orchestra.run.smithi121.stdout:(14/152): libcephfs-devel-19.0.0-2445.gd2c45d97 345 kB/s | 32 kB 00:00 2024-04-25T01:37:07.113 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T01:37:07.150 INFO:teuthology.orchestra.run.smithi121.stdout:(15/152): libcephsqlite-19.0.0-2445.gd2c45d97.e 1.9 MB/s | 163 kB 00:00 2024-04-25T01:37:07.151 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T01:37:07.192 INFO:teuthology.orchestra.run.smithi121.stdout:(16/152): libcephfs2-19.0.0-2445.gd2c45d97.el9. 4.6 MB/s | 745 kB 00:00 2024-04-25T01:37:07.204 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T01:37:07.238 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T01:37:07.250 INFO:teuthology.orchestra.run.smithi121.stdout:(17/152): librados-devel-19.0.0-2445.gd2c45d97. 1.2 MB/s | 127 kB 00:00 2024-04-25T01:37:07.264 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T01:37:07.292 INFO:teuthology.orchestra.run.smithi121.stdout:(18/152): libradosstriper1-19.0.0-2445.gd2c45d9 4.9 MB/s | 501 kB 00:00 2024-04-25T01:37:07.306 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T01:37:07.351 INFO:teuthology.orchestra.run.smithi121.stdout:(19/152): python3-ceph-argparse-19.0.0-2445.gd2 773 kB/s | 45 kB 00:00 2024-04-25T01:37:07.435 INFO:teuthology.orchestra.run.smithi121.stdout:(20/152): python3-ceph-common-19.0.0-2445.gd2c4 1.6 MB/s | 133 kB 00:00 2024-04-25T01:37:07.518 INFO:teuthology.orchestra.run.smithi121.stdout:(21/152): python3-cephfs-19.0.0-2445.gd2c45d97. 1.9 MB/s | 162 kB 00:00 2024-04-25T01:37:07.611 INFO:teuthology.orchestra.run.smithi121.stdout:(22/152): python3-rados-19.0.0-2445.gd2c45d97.e 3.4 MB/s | 321 kB 00:00 2024-04-25T01:37:07.628 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T01:37:07.702 INFO:teuthology.orchestra.run.smithi121.stdout:(23/152): librgw2-19.0.0-2445.gd2c45d97.el9.x86 12 MB/s | 5.3 MB 00:00 2024-04-25T01:37:07.728 INFO:teuthology.orchestra.run.smithi121.stdout:(24/152): python3-rbd-19.0.0-2445.gd2c45d97.el9 2.5 MB/s | 299 kB 00:00 2024-04-25T01:37:07.732 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-25T01:37:07.769 INFO:teuthology.orchestra.run.smithi121.stdout:(25/152): python3-rgw-19.0.0-2445.gd2c45d97.el9 1.5 MB/s | 99 kB 00:00 2024-04-25T01:37:07.828 INFO:teuthology.orchestra.run.smithi121.stdout:(26/152): rbd-fuse-19.0.0-2445.gd2c45d97.el9.x8 850 kB/s | 85 kB 00:00 2024-04-25T01:37:07.845 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-25T01:37:07.874 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-25T01:37:07.921 INFO:teuthology.orchestra.run.smithi121.stdout:(27/152): rbd-nbd-19.0.0-2445.gd2c45d97.el9.x86 1.8 MB/s | 171 kB 00:00 2024-04-25T01:37:07.965 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-25T01:37:08.004 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/156 2024-04-25T01:37:08.004 INFO:teuthology.orchestra.run.smithi121.stdout:(28/152): ceph-grafana-dashboards-19.0.0-2445.g 382 kB/s | 32 kB 00:00 2024-04-25T01:37:08.096 INFO:teuthology.orchestra.run.smithi121.stdout:(29/152): rbd-mirror-19.0.0-2445.gd2c45d97.el9. 9.5 MB/s | 3.1 MB 00:00 2024-04-25T01:37:08.121 INFO:teuthology.orchestra.run.smithi121.stdout:(30/152): ceph-mgr-cephadm-19.0.0-2445.gd2c45d9 1.2 MB/s | 141 kB 00:00 2024-04-25T01:37:08.151 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T01:37:08.201 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T01:37:08.229 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-25T01:37:08.331 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-25T01:37:08.355 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 14/156 2024-04-25T01:37:08.409 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 14/156 2024-04-25T01:37:08.431 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T01:37:08.453 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T01:37:08.455 INFO:teuthology.orchestra.run.smithi121.stdout:(31/152): ceph-mgr-dashboard-19.0.0-2445.gd2c45 9.8 MB/s | 3.5 MB 00:00 2024-04-25T01:37:08.555 INFO:teuthology.orchestra.run.smithi121.stdout:(32/152): ceph-mgr-modules-core-19.0.0-2445.gd2 2.4 MB/s | 249 kB 00:00 2024-04-25T01:37:08.623 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T01:37:08.639 INFO:teuthology.orchestra.run.smithi121.stdout:(33/152): ceph-mgr-rook-19.0.0-2445.gd2c45d97.e 592 kB/s | 49 kB 00:00 2024-04-25T01:37:08.664 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T01:37:08.764 INFO:teuthology.orchestra.run.smithi121.stdout:(34/152): ceph-prometheus-alerts-19.0.0-2445.gd 122 kB/s | 15 kB 00:00 2024-04-25T01:37:08.784 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T01:37:08.876 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T01:37:08.881 INFO:teuthology.orchestra.run.smithi121.stdout:(35/152): ceph-mgr-diskprediction-local-19.0.0- 9.7 MB/s | 7.4 MB 00:00 2024-04-25T01:37:08.905 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T01:37:08.906 INFO:teuthology.orchestra.run.smithi121.stdout:(36/152): ceph-volume-19.0.0-2445.gd2c45d97.el9 1.8 MB/s | 264 kB 00:00 2024-04-25T01:37:08.940 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T01:37:08.982 INFO:teuthology.orchestra.run.smithi121.stdout:(37/152): cephadm-19.0.0-2445.gd2c45d97.el9.noa 7.5 MB/s | 762 kB 00:00 2024-04-25T01:37:09.007 INFO:teuthology.orchestra.run.smithi121.stdout:(38/152): cephfs-top-19.0.0-2445.gd2c45d97.el9. 182 kB/s | 18 kB 00:00 2024-04-25T01:37:09.013 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T01:37:09.048 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T01:37:09.092 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T01:37:09.124 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T01:37:09.151 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T01:37:09.220 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T01:37:09.274 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T01:37:09.304 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T01:37:09.384 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T01:37:09.449 INFO:teuthology.orchestra.run.smithi121.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 172 kB/s | 80 kB 00:00 2024-04-25T01:37:09.624 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T01:37:09.632 INFO:teuthology.orchestra.run.smithi121.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 195 kB 00:00 2024-04-25T01:37:09.659 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 31/156 2024-04-25T01:37:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 32/156 2024-04-25T01:37:09.731 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 33/156 2024-04-25T01:37:09.775 INFO:teuthology.orchestra.run.smithi121.stdout:(41/152): libgfortran-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 803 kB 00:00 2024-04-25T01:37:09.800 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T01:37:09.817 INFO:teuthology.orchestra.run.smithi121.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-04-25T01:37:09.854 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T01:37:09.927 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T01:37:09.942 INFO:teuthology.orchestra.run.smithi121.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 852 kB/s | 106 kB 00:00 2024-04-25T01:37:10.050 INFO:teuthology.orchestra.run.smithi121.stdout:(44/152): python3-cryptography-36.0.1-4.el9.x86 4.5 MB/s | 1.2 MB 00:00 2024-04-25T01:37:10.060 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T01:37:10.067 INFO:teuthology.orchestra.run.smithi121.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-04-25T01:37:10.114 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T01:37:10.560 INFO:teuthology.orchestra.run.smithi121.stdout:(46/152): ceph-test-19.0.0-2445.gd2c45d97.el9.x 13 MB/s | 48 MB 00:03 2024-04-25T01:37:10.585 INFO:teuthology.orchestra.run.smithi121.stdout:(47/152): python3-requests-2.25.1-8.el9.noarch. 234 kB/s | 125 kB 00:00 2024-04-25T01:37:10.610 INFO:teuthology.orchestra.run.smithi121.stdout:(48/152): python3-urllib3-1.26.5-5.el9.noarch.r 396 kB/s | 215 kB 00:00 2024-04-25T01:37:10.627 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T01:37:10.709 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T01:37:10.727 INFO:teuthology.orchestra.run.smithi121.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 918 kB/s | 107 kB 00:00 2024-04-25T01:37:10.739 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T01:37:10.752 INFO:teuthology.orchestra.run.smithi121.stdout:(50/152): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 689 kB 00:00 2024-04-25T01:37:10.778 INFO:teuthology.orchestra.run.smithi121.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 428 kB/s | 21 kB 00:00 2024-04-25T01:37:10.782 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T01:37:10.819 INFO:teuthology.orchestra.run.smithi121.stdout:(52/152): bison-3.7.4-5.el9.x86_64.rpm 3.9 MB/s | 943 kB 00:00 2024-04-25T01:37:10.820 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 43/156 2024-04-25T01:37:10.836 INFO:teuthology.orchestra.run.smithi121.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 561 kB/s | 33 kB 00:00 2024-04-25T01:37:10.861 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T01:37:10.862 INFO:teuthology.orchestra.run.smithi121.stdout:(54/152): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-04-25T01:37:10.887 INFO:teuthology.orchestra.run.smithi121.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-04-25T01:37:10.912 INFO:teuthology.orchestra.run.smithi121.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-04-25T01:37:10.937 INFO:teuthology.orchestra.run.smithi121.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-04-25T01:37:10.954 INFO:teuthology.orchestra.run.smithi121.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-04-25T01:37:10.996 INFO:teuthology.orchestra.run.smithi121.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-04-25T01:37:11.015 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T01:37:11.038 INFO:teuthology.orchestra.run.smithi121.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 6.8 MB/s | 582 kB 00:00 2024-04-25T01:37:11.055 INFO:teuthology.orchestra.run.smithi121.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 435 kB/s | 25 kB 00:00 2024-04-25T01:37:11.072 INFO:teuthology.orchestra.run.smithi121.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-04-25T01:37:11.107 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T01:37:11.122 INFO:teuthology.orchestra.run.smithi121.stdout:(63/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 10 MB/s | 3.0 MB 00:00 2024-04-25T01:37:11.148 INFO:teuthology.orchestra.run.smithi121.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-04-25T01:37:11.161 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T01:37:11.173 INFO:teuthology.orchestra.run.smithi121.stdout:(65/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-04-25T01:37:11.198 INFO:teuthology.orchestra.run.smithi121.stdout:(66/152): openblas-0.3.21-2.el9.x86_64.rpm 467 kB/s | 35 kB 00:00 2024-04-25T01:37:11.233 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T01:37:11.257 INFO:teuthology.orchestra.run.smithi121.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 27 MB/s | 1.6 MB 00:00 2024-04-25T01:37:11.265 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T01:37:11.302 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T01:37:11.324 INFO:teuthology.orchestra.run.smithi121.stdout:(68/152): openblas-openmp-0.3.21-2.el9.x86_64.r 27 MB/s | 4.7 MB 00:00 2024-04-25T01:37:11.348 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T01:37:11.385 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T01:37:11.391 INFO:teuthology.orchestra.run.smithi121.stdout:(69/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-04-25T01:37:11.416 INFO:teuthology.orchestra.run.smithi121.stdout:(70/152): postgresql-contrib-13.14-1.el9.x86_64 5.6 MB/s | 911 kB 00:00 2024-04-25T01:37:11.428 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T01:37:11.441 INFO:teuthology.orchestra.run.smithi121.stdout:(71/152): postgresql-private-libs-13.14-1.el9.x 1.1 MB/s | 133 kB 00:00 2024-04-25T01:37:11.470 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T01:37:11.475 INFO:teuthology.orchestra.run.smithi121.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-04-25T01:37:11.500 INFO:teuthology.orchestra.run.smithi121.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-04-25T01:37:11.542 INFO:teuthology.orchestra.run.smithi121.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 5.7 MB/s | 244 kB 00:00 2024-04-25T01:37:11.605 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T01:37:11.617 INFO:teuthology.orchestra.run.smithi121.stdout:(75/152): postgresql-server-13.14-1.el9.x86_64. 26 MB/s | 5.8 MB 00:00 2024-04-25T01:37:11.642 INFO:teuthology.orchestra.run.smithi121.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-04-25T01:37:11.651 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T01:37:11.668 INFO:teuthology.orchestra.run.smithi121.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-04-25T01:37:11.672 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T01:37:11.693 INFO:teuthology.orchestra.run.smithi121.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-04-25T01:37:11.714 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T01:37:11.718 INFO:teuthology.orchestra.run.smithi121.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-04-25T01:37:11.744 INFO:teuthology.orchestra.run.smithi121.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 691 kB/s | 35 kB 00:00 2024-04-25T01:37:11.807 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T01:37:11.819 INFO:teuthology.orchestra.run.smithi121.stdout:(81/152): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-04-25T01:37:11.847 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T01:37:11.853 INFO:teuthology.orchestra.run.smithi121.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-04-25T01:37:11.878 INFO:teuthology.orchestra.run.smithi121.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-04-25T01:37:11.887 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T01:37:11.903 INFO:teuthology.orchestra.run.smithi121.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-04-25T01:37:11.913 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T01:37:11.929 INFO:teuthology.orchestra.run.smithi121.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-04-25T01:37:11.938 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T01:37:11.954 INFO:teuthology.orchestra.run.smithi121.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-04-25T01:37:11.979 INFO:teuthology.orchestra.run.smithi121.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-25T01:37:12.004 INFO:teuthology.orchestra.run.smithi121.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-04-25T01:37:12.013 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T01:37:12.045 INFO:teuthology.orchestra.run.smithi121.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 777 kB/s | 51 kB 00:00 2024-04-25T01:37:12.071 INFO:teuthology.orchestra.run.smithi121.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 804 kB/s | 54 kB 00:00 2024-04-25T01:37:12.139 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T01:37:12.155 INFO:teuthology.orchestra.run.smithi121.stdout:(91/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-04-25T01:37:12.170 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T01:37:12.180 INFO:teuthology.orchestra.run.smithi121.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 383 kB/s | 42 kB 00:00 2024-04-25T01:37:12.198 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T01:37:12.205 INFO:teuthology.orchestra.run.smithi121.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 884 kB/s | 44 kB 00:00 2024-04-25T01:37:12.231 INFO:teuthology.orchestra.run.smithi121.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-04-25T01:37:12.232 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T01:37:12.256 INFO:teuthology.orchestra.run.smithi121.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-04-25T01:37:12.272 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T01:37:12.281 INFO:teuthology.orchestra.run.smithi121.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-04-25T01:37:12.303 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T01:37:12.307 INFO:teuthology.orchestra.run.smithi121.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 305 kB 00:00 2024-04-25T01:37:12.333 INFO:teuthology.orchestra.run.smithi121.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-04-25T01:37:12.333 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T01:37:12.349 INFO:teuthology.orchestra.run.smithi121.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 2.2 MB/s | 94 kB 00:00 2024-04-25T01:37:12.366 INFO:teuthology.orchestra.run.smithi121.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 64 kB 00:00 2024-04-25T01:37:12.368 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T01:37:12.383 INFO:teuthology.orchestra.run.smithi121.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-04-25T01:37:12.485 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T01:37:12.608 INFO:teuthology.orchestra.run.smithi121.stdout:(102/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-04-25T01:37:12.625 INFO:teuthology.orchestra.run.smithi121.stdout:(103/152): lua-devel-5.4.4-4.el9.x86_64.rpm 86 kB/s | 22 kB 00:00 2024-04-25T01:37:12.728 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T01:37:12.761 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T01:37:12.851 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T01:37:12.900 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T01:37:12.931 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T01:37:12.978 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T01:37:13.075 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T01:37:13.092 INFO:teuthology.orchestra.run.smithi121.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 1.2 MB/s | 863 kB 00:00 2024-04-25T01:37:13.132 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T01:37:13.142 INFO:teuthology.orchestra.run.smithi121.stdout:(105/152): gperftools-libs-2.9.1-2.el9.x86_64.r 598 kB/s | 309 kB 00:00 2024-04-25T01:37:13.218 INFO:teuthology.orchestra.run.smithi121.stdout:(106/152): abseil-cpp-20211102.0-3.el9.x86_64.r 901 kB/s | 548 kB 00:00 2024-04-25T01:37:13.354 INFO:teuthology.orchestra.run.smithi121.stdout:(107/152): grpc-data-1.46.7-10.el9.noarch.rpm 74 kB/s | 19 kB 00:00 2024-04-25T01:37:13.487 INFO:teuthology.orchestra.run.smithi121.stdout:(108/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 96 kB/s | 26 kB 00:00 2024-04-25T01:37:13.712 INFO:teuthology.orchestra.run.smithi121.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 135 kB/s | 49 kB 00:00 2024-04-25T01:37:13.838 INFO:teuthology.orchestra.run.smithi121.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 192 kB/s | 67 kB 00:00 2024-04-25T01:37:13.849 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T01:37:13.896 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T01:37:13.930 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T01:37:14.021 INFO:teuthology.orchestra.run.smithi121.stdout:(111/152): libarrow-9.0.0-10.el9.x86_64.rpm 5.0 MB/s | 4.4 MB 00:00 2024-04-25T01:37:14.030 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T01:37:14.087 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T01:37:14.138 INFO:teuthology.orchestra.run.smithi121.stdout:(112/152): luarocks-3.9.2-1.el9.noarch.rpm 355 kB/s | 151 kB 00:00 2024-04-25T01:37:14.176 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T01:37:14.215 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T01:37:14.392 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T01:37:14.421 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T01:37:14.480 INFO:teuthology.orchestra.run.smithi121.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 127 kB/s | 43 kB 00:00 2024-04-25T01:37:14.498 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T01:37:14.505 INFO:teuthology.orchestra.run.smithi121.stdout:(114/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.2 MB/s | 838 kB 00:00 2024-04-25T01:37:14.614 INFO:teuthology.orchestra.run.smithi121.stdout:(115/152): python3-asyncssh-2.13.2-5.el9.noarch 925 kB/s | 548 kB 00:00 2024-04-25T01:37:14.747 INFO:teuthology.orchestra.run.smithi121.stdout:(116/152): python3-cachetools-4.2.4-1.el9.noarc 120 kB/s | 32 kB 00:00 2024-04-25T01:37:14.772 INFO:teuthology.orchestra.run.smithi121.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 56 kB/s | 15 kB 00:00 2024-04-25T01:37:15.048 INFO:teuthology.orchestra.run.smithi121.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 396 kB/s | 172 kB 00:00 2024-04-25T01:37:15.124 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T01:37:15.244 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T01:37:15.256 INFO:teuthology.orchestra.run.smithi121.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 704 kB/s | 358 kB 00:00 2024-04-25T01:37:15.281 INFO:teuthology.orchestra.run.smithi121.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 596 kB/s | 303 kB 00:00 2024-04-25T01:37:15.315 INFO:teuthology.orchestra.run.smithi121.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 132 kB/s | 35 kB 00:00 2024-04-25T01:37:15.749 INFO:teuthology.orchestra.run.smithi121.stdout:(122/152): python3-grpcio-tools-1.46.7-10.el9.x 333 kB/s | 144 kB 00:00 2024-04-25T01:37:15.774 INFO:teuthology.orchestra.run.smithi121.stdout:(123/152): python3-google-auth-2.29.0-1.el9.noa 397 kB/s | 206 kB 00:00 2024-04-25T01:37:15.941 INFO:teuthology.orchestra.run.smithi121.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 56 kB/s | 11 kB 00:00 2024-04-25T01:37:16.049 INFO:teuthology.orchestra.run.smithi121.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 64 kB/s | 18 kB 00:00 2024-04-25T01:37:16.142 INFO:teuthology.orchestra.run.smithi121.stdout:(126/152): python3-grpcio-1.46.7-10.el9.x86_64. 2.4 MB/s | 2.0 MB 00:00 2024-04-25T01:37:16.234 INFO:teuthology.orchestra.run.smithi121.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 79 kB/s | 23 kB 00:00 2024-04-25T01:37:16.325 INFO:teuthology.orchestra.run.smithi121.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 71 kB/s | 19 kB 00:00 2024-04-25T01:37:16.409 INFO:teuthology.orchestra.run.smithi121.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 74 kB/s | 20 kB 00:00 2024-04-25T01:37:16.444 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T01:37:16.535 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T01:37:16.562 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T01:37:16.596 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T01:37:16.667 INFO:teuthology.orchestra.run.smithi121.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 135 kB/s | 46 kB 00:00 2024-04-25T01:37:16.751 INFO:teuthology.orchestra.run.smithi121.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 231 kB/s | 79 kB 00:00 2024-04-25T01:37:16.906 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T01:37:16.918 INFO:teuthology.orchestra.run.smithi121.stdout:(132/152): python3-kubernetes-26.1.0-2.el9.noar 1.5 MB/s | 1.0 MB 00:00 2024-04-25T01:37:16.942 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/156 2024-04-25T01:37:17.018 INFO:teuthology.orchestra.run.smithi121.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 165 kB/s | 58 kB 00:00 2024-04-25T01:37:17.032 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/156 2024-04-25T01:37:17.064 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 100/156 2024-04-25T01:37:17.100 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T01:37:17.202 INFO:teuthology.orchestra.run.smithi121.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 58 kB/s | 16 kB 00:00 2024-04-25T01:37:17.352 INFO:teuthology.orchestra.run.smithi121.stdout:(135/152): python3-pecan-1.4.2-3.el9.noarch.rpm 453 kB/s | 272 kB 00:00 2024-04-25T01:37:17.377 INFO:teuthology.orchestra.run.smithi121.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 251 kB/s | 90 kB 00:00 2024-04-25T01:37:17.470 INFO:teuthology.orchestra.run.smithi121.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 106 kB/s | 28 kB 00:00 2024-04-25T01:37:17.569 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T01:37:17.596 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/156 2024-04-25T01:37:17.611 INFO:teuthology.orchestra.run.smithi121.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 119 kB/s | 31 kB 00:00 2024-04-25T01:37:17.666 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/156 2024-04-25T01:37:17.689 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 104/156 2024-04-25T01:37:17.812 INFO:teuthology.orchestra.run.smithi121.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 173 kB/s | 59 kB 00:00 2024-04-25T01:37:17.837 INFO:teuthology.orchestra.run.smithi121.stdout:(140/152): python3-routes-2.5.1-5.el9.noarch.rp 410 kB/s | 188 kB 00:00 2024-04-25T01:37:17.871 INFO:teuthology.orchestra.run.smithi121.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 138 kB/s | 36 kB 00:00 2024-04-25T01:37:18.154 INFO:teuthology.orchestra.run.smithi121.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 149 kB/s | 51 kB 00:00 2024-04-25T01:37:18.213 INFO:teuthology.orchestra.run.smithi121.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 262 kB/s | 90 kB 00:00 2024-04-25T01:37:18.346 INFO:teuthology.orchestra.run.smithi121.stdout:(144/152): python3-webob-1.8.7-6.el9.noarch.rpm 451 kB/s | 230 kB 00:00 2024-04-25T01:37:18.480 INFO:teuthology.orchestra.run.smithi121.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 75 kB/s | 20 kB 00:00 2024-04-25T01:37:18.739 INFO:teuthology.orchestra.run.smithi121.stdout:(146/152): python3-werkzeug-2.0.3-3.el9.1.noarc 731 kB/s | 427 kB 00:00 2024-04-25T01:37:19.434 INFO:teuthology.orchestra.run.smithi121.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 450 kB/s | 192 kB 00:00 2024-04-25T01:37:19.434 INFO:teuthology.orchestra.run.smithi121.stdout:(148/152): librados2-19.0.0-2445.gd2c45d97.el9. 12 MB/s | 3.4 MB 00:00 2024-04-25T01:37:19.434 INFO:teuthology.orchestra.run.smithi121.stdout:(149/152): librbd1-19.0.0-2445.gd2c45d97.el9.x8 7.4 MB/s | 3.1 MB 00:00 2024-04-25T01:37:19.434 INFO:teuthology.orchestra.run.smithi121.stdout:(150/152): thrift-0.15.0-2.el9.x86_64.rpm 2.1 MB/s | 1.6 MB 00:00 2024-04-25T01:37:19.848 INFO:teuthology.orchestra.run.smithi121.stdout:(151/152): openssl-3.2.1-1.el9.x86_64.rpm 1.7 MB/s | 1.3 MB 00:00 2024-04-25T01:37:19.941 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-25T01:37:19.977 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-25T01:37:20.148 INFO:teuthology.orchestra.run.smithi121.stdout:(152/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 2.5 MB/s | 2.4 MB 00:00 2024-04-25T01:37:20.151 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:37:20.151 INFO:teuthology.orchestra.run.smithi121.stdout:Total 13 MB/s | 220 MB 00:17 2024-04-25T01:37:20.517 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-25T01:37:20.556 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 106/156 2024-04-25T01:37:20.655 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 106/156 2024-04-25T01:37:20.655 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T01:37:20.655 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T01:37:20.655 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:37:20.674 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 107/156 2024-04-25T01:37:21.271 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-04-25T01:37:21.415 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-04-25T01:37:21.416 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-04-25T01:37:23.186 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-04-25T01:37:23.186 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-04-25T01:37:29.076 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-04-25T01:37:29.160 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T01:37:29.198 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T01:37:29.251 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T01:37:29.294 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T01:37:29.336 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T01:37:29.378 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T01:37:29.700 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T01:37:29.820 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-25T01:37:29.925 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-25T01:37:29.955 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-25T01:37:30.030 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-25T01:37:30.067 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/156 2024-04-25T01:37:30.216 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T01:37:30.272 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T01:37:30.300 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-25T01:37:30.413 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-25T01:37:30.435 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 14/156 2024-04-25T01:37:30.498 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 14/156 2024-04-25T01:37:30.520 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T01:37:30.540 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T01:37:30.728 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T01:37:30.761 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T01:37:30.868 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T01:37:30.963 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T01:37:31.001 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T01:37:31.036 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T01:37:31.101 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T01:37:31.144 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T01:37:31.196 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T01:37:31.228 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T01:37:31.256 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T01:37:31.325 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T01:37:31.378 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T01:37:31.417 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T01:37:31.452 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T01:37:31.528 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T01:37:31.564 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 31/156 2024-04-25T01:37:31.607 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 32/156 2024-04-25T01:37:31.636 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 33/156 2024-04-25T01:37:31.705 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T01:37:31.750 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T01:37:31.825 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T01:37:31.966 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T01:37:32.019 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T01:37:32.081 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 107/156 2024-04-25T01:37:32.081 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /sys 2024-04-25T01:37:32.081 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /proc 2024-04-25T01:37:32.081 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /mnt 2024-04-25T01:37:32.081 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /var/tmp 2024-04-25T01:37:32.081 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /home 2024-04-25T01:37:32.081 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /root 2024-04-25T01:37:32.081 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /tmp 2024-04-25T01:37:32.081 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:37:32.239 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 108/156 2024-04-25T01:37:32.254 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 108/156 2024-04-25T01:37:32.255 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:37:32.255 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T01:37:32.255 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:37:32.545 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T01:37:32.632 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T01:37:32.661 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T01:37:32.704 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T01:37:32.742 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 43/156 2024-04-25T01:37:32.783 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T01:37:32.936 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T01:37:32.978 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T01:37:33.033 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T01:37:33.105 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T01:37:33.137 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T01:37:33.173 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T01:37:33.220 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T01:37:33.256 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T01:37:33.299 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T01:37:33.341 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T01:37:33.486 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T01:37:33.530 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T01:37:33.561 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T01:37:33.602 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T01:37:33.696 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T01:37:33.709 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 109/156 2024-04-25T01:37:33.734 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 109/156 2024-04-25T01:37:33.734 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:37:33.734 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T01:37:33.734 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T01:37:33.735 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T01:37:33.735 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:37:33.736 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T01:37:33.776 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T01:37:33.803 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T01:37:33.826 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T01:37:33.901 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T01:37:33.960 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 110/156 2024-04-25T01:37:33.982 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 110/156 2024-04-25T01:37:33.982 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:37:33.982 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T01:37:33.982 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T01:37:33.982 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T01:37:33.982 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:37:34.028 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T01:37:34.059 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T01:37:34.086 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T01:37:34.121 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T01:37:34.160 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T01:37:34.192 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T01:37:34.221 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T01:37:34.256 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T01:37:34.291 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T01:37:34.331 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T01:37:34.419 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 111/156 2024-04-25T01:37:34.441 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 111/156 2024-04-25T01:37:34.441 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:37:34.441 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T01:37:34.441 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T01:37:34.441 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T01:37:34.441 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:37:34.442 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T01:37:34.541 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T01:37:34.606 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T01:37:34.650 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T01:37:34.661 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T01:37:34.697 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T01:37:34.727 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T01:37:34.775 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T01:37:34.847 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T01:37:34.893 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T01:37:34.895 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T01:37:34.946 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T01:37:34.972 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T01:37:35.061 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T01:37:35.200 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T01:37:35.245 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T01:37:35.277 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T01:37:35.305 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T01:37:35.668 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T01:37:35.709 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T01:37:35.711 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 123/156 2024-04-25T01:37:35.737 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 123/156 2024-04-25T01:37:35.743 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T01:37:35.768 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 124/156 2024-04-25T01:37:35.830 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 125/156 2024-04-25T01:37:35.841 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T01:37:35.861 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 126/156 2024-04-25T01:37:35.893 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T01:37:35.980 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T01:37:36.029 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T01:37:36.205 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T01:37:36.243 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T01:37:36.320 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T01:37:36.895 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 126/156 2024-04-25T01:37:36.929 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 127/156 2024-04-25T01:37:36.971 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T01:37:37.083 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T01:37:37.895 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 127/156 2024-04-25T01:37:37.929 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 128/156 2024-04-25T01:37:38.031 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 128/156 2024-04-25T01:37:38.192 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 129/156 2024-04-25T01:37:38.223 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/156 2024-04-25T01:37:38.246 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/156 2024-04-25T01:37:38.246 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:37:38.246 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T01:37:38.246 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T01:37:38.246 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T01:37:38.246 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:37:38.291 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 131/156 2024-04-25T01:37:38.301 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 131/156 2024-04-25T01:37:38.302 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T01:37:38.389 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T01:37:38.399 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 132/156 2024-04-25T01:37:38.417 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T01:37:38.450 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T01:37:38.455 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 133/156 2024-04-25T01:37:38.761 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T01:37:38.804 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/156 2024-04-25T01:37:38.895 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/156 2024-04-25T01:37:38.926 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 100/156 2024-04-25T01:37:38.962 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T01:37:39.351 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T01:37:39.385 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 135/156 2024-04-25T01:37:39.408 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 135/156 2024-04-25T01:37:39.408 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:37:39.408 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T01:37:39.408 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T01:37:39.408 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T01:37:39.408 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:37:39.434 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T01:37:39.452 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 136/156 2024-04-25T01:37:39.465 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/156 2024-04-25T01:37:39.474 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 136/156 2024-04-25T01:37:39.474 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:37:39.474 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T01:37:39.474 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:37:39.528 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 137/156 2024-04-25T01:37:39.537 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/156 2024-04-25T01:37:39.550 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 137/156 2024-04-25T01:37:39.550 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:37:39.550 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T01:37:39.550 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T01:37:39.550 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T01:37:39.551 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:37:39.567 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 104/156 2024-04-25T01:37:39.854 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/156 2024-04-25T01:37:39.876 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/156 2024-04-25T01:37:39.876 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:37:39.876 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T01:37:39.876 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T01:37:39.877 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T01:37:39.877 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:37:41.784 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-25T01:37:41.830 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-25T01:37:42.367 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-25T01:37:42.409 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 106/156 2024-04-25T01:37:42.508 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 106/156 2024-04-25T01:37:42.508 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T01:37:42.508 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T01:37:42.508 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:37:42.535 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 107/156 2024-04-25T01:37:44.366 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 139/156 2024-04-25T01:37:44.408 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 140/156 2024-04-25T01:37:44.448 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 141/156 2024-04-25T01:37:44.480 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T01:37:44.508 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T01:37:44.687 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 144/156 2024-04-25T01:37:44.729 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T01:37:44.770 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 146/156 2024-04-25T01:37:45.329 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T01:37:45.374 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T01:37:45.393 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T01:37:46.225 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 148/156 2024-04-25T01:37:46.304 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T01:37:46.345 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T01:37:46.427 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T01:37:46.458 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T01:37:46.459 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T01:37:46.535 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T01:37:46.575 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T01:37:46.575 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T01:37:46.654 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T01:37:46.724 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T01:37:52.477 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T01:37:52.477 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 1/156 2024-04-25T01:37:52.477 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2/156 2024-04-25T01:37:52.477 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 3/156 2024-04-25T01:37:52.477 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 4/156 2024-04-25T01:37:52.477 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 5/156 2024-04-25T01:37:52.477 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 6/156 2024-04-25T01:37:52.477 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 7/156 2024-04-25T01:37:52.477 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-25T01:37:52.477 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-25T01:37:52.478 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/156 2024-04-25T01:37:52.478 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 11/156 2024-04-25T01:37:52.478 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 12/156 2024-04-25T01:37:52.478 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-25T01:37:52.478 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 14/156 2024-04-25T01:37:52.478 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 15/156 2024-04-25T01:37:52.478 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 16/156 2024-04-25T01:37:52.478 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 17/156 2024-04-25T01:37:52.478 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 18/156 2024-04-25T01:37:52.478 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 19/156 2024-04-25T01:37:52.478 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 20/156 2024-04-25T01:37:52.478 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 21/156 2024-04-25T01:37:52.478 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 22/156 2024-04-25T01:37:52.478 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 23/156 2024-04-25T01:37:52.479 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 24/156 2024-04-25T01:37:52.479 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 25/156 2024-04-25T01:37:52.479 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 26/156 2024-04-25T01:37:52.479 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 27/156 2024-04-25T01:37:52.491 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 28/156 2024-04-25T01:37:52.491 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 29/156 2024-04-25T01:37:52.491 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 30/156 2024-04-25T01:37:52.491 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 31/156 2024-04-25T01:37:52.491 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 32/156 2024-04-25T01:37:52.491 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 33/156 2024-04-25T01:37:52.491 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 34/156 2024-04-25T01:37:52.491 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 35/156 2024-04-25T01:37:52.491 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 36/156 2024-04-25T01:37:52.492 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 37/156 2024-04-25T01:37:52.492 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 38/156 2024-04-25T01:37:52.492 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 39/156 2024-04-25T01:37:52.492 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T01:37:52.492 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T01:37:52.492 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T01:37:52.492 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T01:37:52.492 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T01:37:52.492 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T01:37:52.492 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T01:37:52.492 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T01:37:52.492 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T01:37:52.492 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T01:37:52.492 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T01:37:52.492 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T01:37:52.493 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T01:37:52.493 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T01:37:52.493 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T01:37:52.493 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T01:37:52.493 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T01:37:52.493 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T01:37:52.493 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T01:37:52.493 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T01:37:52.493 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T01:37:52.493 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T01:37:52.493 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T01:37:52.493 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T01:37:52.493 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T01:37:52.493 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T01:37:52.494 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T01:37:52.494 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T01:37:52.494 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T01:37:52.494 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T01:37:52.494 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T01:37:52.494 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T01:37:52.494 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T01:37:52.494 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T01:37:52.494 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T01:37:52.495 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T01:37:52.495 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T01:37:52.495 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T01:37:52.495 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T01:37:52.495 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T01:37:52.495 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T01:37:52.495 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T01:37:52.495 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T01:37:52.495 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T01:37:52.495 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T01:37:52.495 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T01:37:52.495 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T01:37:52.495 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T01:37:52.495 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T01:37:52.496 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T01:37:52.496 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T01:37:52.496 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T01:37:52.496 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T01:37:52.496 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T01:37:52.496 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T01:37:52.496 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T01:37:52.496 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T01:37:52.496 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T01:37:52.496 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T01:37:52.496 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T01:37:52.496 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T01:37:52.496 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T01:37:52.496 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T01:37:52.497 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T01:37:52.497 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T01:37:52.497 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T01:37:52.497 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T01:37:52.497 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T01:37:52.497 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T01:37:52.497 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T01:37:52.497 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T01:37:52.497 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T01:37:52.497 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T01:37:52.497 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T01:37:52.497 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T01:37:52.497 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T01:37:52.497 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T01:37:52.497 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T01:37:52.498 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T01:37:52.498 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T01:37:52.498 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T01:37:52.498 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T01:37:52.498 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T01:37:52.498 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T01:37:52.498 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T01:37:52.498 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T01:37:52.498 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T01:37:52.498 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T01:37:52.498 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T01:37:52.498 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T01:37:52.498 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T01:37:52.499 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T01:37:52.499 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T01:37:52.499 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T01:37:52.499 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T01:37:52.499 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T01:37:52.499 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T01:37:52.499 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T01:37:52.499 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T01:37:52.499 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T01:37:52.499 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T01:37:52.499 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T01:37:52.499 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T01:37:52.499 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T01:37:52.500 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T01:37:52.500 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T01:37:52.500 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T01:37:52.500 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T01:37:52.500 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T01:37:52.500 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 149/156 2024-04-25T01:37:52.500 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T01:37:52.500 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 151/156 2024-04-25T01:37:52.500 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T01:37:52.500 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T01:37:52.500 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T01:37:52.500 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T01:37:53.952 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 107/156 2024-04-25T01:37:53.953 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /sys 2024-04-25T01:37:53.953 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /proc 2024-04-25T01:37:53.953 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /mnt 2024-04-25T01:37:53.953 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /var/tmp 2024-04-25T01:37:53.953 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /home 2024-04-25T01:37:53.953 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /root 2024-04-25T01:37:53.953 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /tmp 2024-04-25T01:37:53.953 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:37:54.123 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 108/156 2024-04-25T01:37:54.139 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 108/156 2024-04-25T01:37:54.139 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:37:54.139 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T01:37:54.139 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:37:54.615 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T01:37:54.615 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:37:54.616 INFO:teuthology.orchestra.run.smithi077.stdout:Upgraded: 2024-04-25T01:37:54.616 INFO:teuthology.orchestra.run.smithi077.stdout: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.616 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.616 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T01:37:54.616 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T01:37:54.616 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-25T01:37:54.616 INFO:teuthology.orchestra.run.smithi077.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T01:37:54.616 INFO:teuthology.orchestra.run.smithi077.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T01:37:54.616 INFO:teuthology.orchestra.run.smithi077.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T01:37:54.616 INFO:teuthology.orchestra.run.smithi077.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T01:37:54.616 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.616 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.617 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.617 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.617 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:37:54.617 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.617 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.617 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.617 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:37:54.617 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:37:54.617 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:37:54.617 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:37:54.617 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:37:54.617 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.617 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.617 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:37:54.618 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.618 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.618 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.618 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:37:54.618 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:37:54.618 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.618 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.618 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:37:54.618 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T01:37:54.618 INFO:teuthology.orchestra.run.smithi077.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T01:37:54.618 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T01:37:54.619 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T01:37:54.619 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T01:37:54.619 INFO:teuthology.orchestra.run.smithi077.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T01:37:54.619 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T01:37:54.619 INFO:teuthology.orchestra.run.smithi077.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T01:37:54.619 INFO:teuthology.orchestra.run.smithi077.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T01:37:54.619 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T01:37:54.619 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T01:37:54.619 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.619 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.620 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.620 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T01:37:54.620 INFO:teuthology.orchestra.run.smithi077.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T01:37:54.620 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T01:37:54.620 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T01:37:54.620 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T01:37:54.620 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.620 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.620 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T01:37:54.620 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.620 INFO:teuthology.orchestra.run.smithi077.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T01:37:54.621 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T01:37:54.621 INFO:teuthology.orchestra.run.smithi077.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T01:37:54.621 INFO:teuthology.orchestra.run.smithi077.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T01:37:54.621 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T01:37:54.621 INFO:teuthology.orchestra.run.smithi077.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T01:37:54.621 INFO:teuthology.orchestra.run.smithi077.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T01:37:54.621 INFO:teuthology.orchestra.run.smithi077.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T01:37:54.621 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T01:37:54.621 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T01:37:54.621 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T01:37:54.621 INFO:teuthology.orchestra.run.smithi077.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T01:37:54.621 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T01:37:54.621 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T01:37:54.621 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T01:37:54.622 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T01:37:54.622 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T01:37:54.622 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T01:37:54.622 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T01:37:54.622 INFO:teuthology.orchestra.run.smithi077.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T01:37:54.622 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T01:37:54.622 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T01:37:54.622 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T01:37:54.622 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.622 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.622 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.623 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T01:37:54.623 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T01:37:54.623 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T01:37:54.623 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T01:37:54.623 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T01:37:54.623 INFO:teuthology.orchestra.run.smithi077.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T01:37:54.623 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T01:37:54.623 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T01:37:54.623 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T01:37:54.623 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T01:37:54.623 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T01:37:54.623 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T01:37:54.623 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T01:37:54.623 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T01:37:54.624 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T01:37:54.624 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T01:37:54.624 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T01:37:54.624 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T01:37:54.624 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T01:37:54.624 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T01:37:54.624 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T01:37:54.624 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T01:37:54.624 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T01:37:54.624 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T01:37:54.624 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T01:37:54.624 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T01:37:54.624 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T01:37:54.625 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T01:37:54.625 INFO:teuthology.orchestra.run.smithi077.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T01:37:54.625 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T01:37:54.625 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T01:37:54.625 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T01:37:54.625 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T01:37:54.625 INFO:teuthology.orchestra.run.smithi077.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T01:37:54.625 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T01:37:54.625 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T01:37:54.625 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T01:37:54.625 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T01:37:54.625 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T01:37:54.625 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T01:37:54.625 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.626 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.626 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T01:37:54.626 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T01:37:54.626 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T01:37:54.626 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.626 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T01:37:54.626 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T01:37:54.626 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T01:37:54.626 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T01:37:54.626 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T01:37:54.626 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T01:37:54.626 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T01:37:54.626 INFO:teuthology.orchestra.run.smithi077.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T01:37:54.626 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T01:37:54.627 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T01:37:54.627 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T01:37:54.627 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T01:37:54.627 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T01:37:54.627 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T01:37:54.627 INFO:teuthology.orchestra.run.smithi077.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T01:37:54.627 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.627 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.627 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:37:54.627 INFO:teuthology.orchestra.run.smithi077.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T01:37:54.627 INFO:teuthology.orchestra.run.smithi077.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T01:37:54.627 INFO:teuthology.orchestra.run.smithi077.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T01:37:54.627 INFO:teuthology.orchestra.run.smithi077.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T01:37:54.627 INFO:teuthology.orchestra.run.smithi077.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T01:37:54.628 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T01:37:54.628 INFO:teuthology.orchestra.run.smithi077.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T01:37:54.628 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:37:54.628 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-25T01:37:55.020 DEBUG:teuthology.parallel:result is None 2024-04-25T01:37:55.610 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 109/156 2024-04-25T01:37:55.636 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 109/156 2024-04-25T01:37:55.636 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:37:55.636 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T01:37:55.636 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T01:37:55.636 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T01:37:55.636 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:37:55.860 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 110/156 2024-04-25T01:37:55.883 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 110/156 2024-04-25T01:37:55.883 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:37:55.883 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T01:37:55.883 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T01:37:55.883 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T01:37:55.883 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:37:56.319 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 111/156 2024-04-25T01:37:56.342 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 111/156 2024-04-25T01:37:56.342 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:37:56.342 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T01:37:56.343 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T01:37:56.343 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T01:37:56.343 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:37:56.458 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T01:37:56.506 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T01:37:56.562 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T01:37:56.746 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T01:37:56.795 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T01:37:56.872 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T01:37:56.969 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T01:37:57.109 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T01:37:57.145 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T01:37:57.177 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T01:37:57.205 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T01:37:57.637 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 123/156 2024-04-25T01:37:57.670 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 123/156 2024-04-25T01:37:57.701 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 124/156 2024-04-25T01:37:57.763 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 125/156 2024-04-25T01:37:57.801 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 126/156 2024-04-25T01:37:58.830 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 126/156 2024-04-25T01:37:58.870 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 127/156 2024-04-25T01:37:59.830 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 127/156 2024-04-25T01:37:59.872 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 128/156 2024-04-25T01:37:59.974 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 128/156 2024-04-25T01:38:00.141 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 129/156 2024-04-25T01:38:00.172 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/156 2024-04-25T01:38:00.197 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/156 2024-04-25T01:38:00.197 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:38:00.197 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T01:38:00.197 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T01:38:00.197 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T01:38:00.198 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:00.240 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 131/156 2024-04-25T01:38:00.251 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 131/156 2024-04-25T01:38:00.349 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 132/156 2024-04-25T01:38:00.396 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 133/156 2024-04-25T01:38:01.288 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T01:38:01.317 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 135/156 2024-04-25T01:38:01.340 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 135/156 2024-04-25T01:38:01.340 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:38:01.340 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T01:38:01.341 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T01:38:01.341 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T01:38:01.341 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:01.384 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 136/156 2024-04-25T01:38:01.407 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 136/156 2024-04-25T01:38:01.407 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:38:01.407 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T01:38:01.407 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:01.452 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 137/156 2024-04-25T01:38:01.474 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 137/156 2024-04-25T01:38:01.474 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:38:01.474 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T01:38:01.474 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T01:38:01.474 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T01:38:01.474 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:01.786 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/156 2024-04-25T01:38:01.808 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/156 2024-04-25T01:38:01.809 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:38:01.809 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T01:38:01.809 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T01:38:01.809 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T01:38:01.809 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:06.323 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 139/156 2024-04-25T01:38:06.364 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 140/156 2024-04-25T01:38:06.405 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 141/156 2024-04-25T01:38:06.438 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T01:38:06.464 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T01:38:06.648 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 144/156 2024-04-25T01:38:06.694 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T01:38:06.724 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 146/156 2024-04-25T01:38:07.336 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T01:38:07.380 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T01:38:07.399 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T01:38:08.219 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 148/156 2024-04-25T01:38:08.309 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T01:38:08.350 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T01:38:08.431 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T01:38:08.472 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T01:38:08.472 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T01:38:08.548 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T01:38:08.581 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T01:38:08.581 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T01:38:08.706 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T01:38:08.770 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T01:38:14.748 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T01:38:14.748 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 1/156 2024-04-25T01:38:14.749 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2/156 2024-04-25T01:38:14.749 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 3/156 2024-04-25T01:38:14.749 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 4/156 2024-04-25T01:38:14.749 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 5/156 2024-04-25T01:38:14.749 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 6/156 2024-04-25T01:38:14.749 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 7/156 2024-04-25T01:38:14.749 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-25T01:38:14.749 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-25T01:38:14.749 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/156 2024-04-25T01:38:14.749 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 11/156 2024-04-25T01:38:14.749 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 12/156 2024-04-25T01:38:14.749 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-25T01:38:14.750 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 14/156 2024-04-25T01:38:14.750 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 15/156 2024-04-25T01:38:14.750 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 16/156 2024-04-25T01:38:14.750 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 17/156 2024-04-25T01:38:14.750 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 18/156 2024-04-25T01:38:14.750 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 19/156 2024-04-25T01:38:14.750 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 20/156 2024-04-25T01:38:14.750 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 21/156 2024-04-25T01:38:14.750 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 22/156 2024-04-25T01:38:14.750 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 23/156 2024-04-25T01:38:14.750 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 24/156 2024-04-25T01:38:14.750 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 25/156 2024-04-25T01:38:14.751 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 26/156 2024-04-25T01:38:14.751 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 27/156 2024-04-25T01:38:14.751 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 28/156 2024-04-25T01:38:14.751 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 29/156 2024-04-25T01:38:14.751 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 30/156 2024-04-25T01:38:14.751 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 31/156 2024-04-25T01:38:14.751 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 32/156 2024-04-25T01:38:14.751 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 33/156 2024-04-25T01:38:14.751 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 34/156 2024-04-25T01:38:14.751 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 35/156 2024-04-25T01:38:14.751 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 36/156 2024-04-25T01:38:14.751 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 37/156 2024-04-25T01:38:14.751 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 38/156 2024-04-25T01:38:14.752 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 39/156 2024-04-25T01:38:14.752 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T01:38:14.752 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T01:38:14.752 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T01:38:14.752 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T01:38:14.752 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T01:38:14.752 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T01:38:14.752 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T01:38:14.752 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T01:38:14.752 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T01:38:14.752 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T01:38:14.752 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T01:38:14.752 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T01:38:14.753 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T01:38:14.753 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T01:38:14.753 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T01:38:14.753 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T01:38:14.753 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T01:38:14.753 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T01:38:14.753 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T01:38:14.753 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T01:38:14.753 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T01:38:14.753 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T01:38:14.753 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T01:38:14.753 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T01:38:14.754 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T01:38:14.754 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T01:38:14.754 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T01:38:14.754 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T01:38:14.754 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T01:38:14.754 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T01:38:14.754 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T01:38:14.754 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T01:38:14.754 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T01:38:14.754 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T01:38:14.754 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T01:38:14.754 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T01:38:14.754 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T01:38:14.755 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T01:38:14.755 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T01:38:14.755 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T01:38:14.755 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T01:38:14.755 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T01:38:14.755 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T01:38:14.755 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T01:38:14.755 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T01:38:14.755 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T01:38:14.755 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T01:38:14.755 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T01:38:14.755 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T01:38:14.756 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T01:38:14.756 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T01:38:14.756 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T01:38:14.756 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T01:38:14.756 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T01:38:14.756 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T01:38:14.756 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T01:38:14.756 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T01:38:14.756 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T01:38:14.756 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T01:38:14.756 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T01:38:14.757 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T01:38:14.757 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T01:38:14.757 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T01:38:14.757 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T01:38:14.757 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T01:38:14.757 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T01:38:14.757 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T01:38:14.757 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T01:38:14.757 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T01:38:14.757 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T01:38:14.757 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T01:38:14.757 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T01:38:14.757 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T01:38:14.758 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T01:38:14.758 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T01:38:14.758 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T01:38:14.758 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T01:38:14.758 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T01:38:14.758 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T01:38:14.758 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T01:38:14.758 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T01:38:14.758 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T01:38:14.758 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T01:38:14.758 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T01:38:14.758 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T01:38:14.759 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T01:38:14.759 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T01:38:14.759 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T01:38:14.759 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T01:38:14.759 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T01:38:14.759 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T01:38:14.759 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T01:38:14.759 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T01:38:14.759 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T01:38:14.759 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T01:38:14.759 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T01:38:14.759 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T01:38:14.759 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T01:38:14.759 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T01:38:14.760 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T01:38:14.760 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T01:38:14.760 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T01:38:14.760 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T01:38:14.760 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T01:38:14.760 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T01:38:14.760 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T01:38:14.760 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T01:38:14.760 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T01:38:14.760 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T01:38:14.760 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 149/156 2024-04-25T01:38:14.761 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T01:38:14.761 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 151/156 2024-04-25T01:38:14.761 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T01:38:14.761 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T01:38:14.761 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T01:38:14.761 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T01:38:16.875 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T01:38:16.875 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:16.875 INFO:teuthology.orchestra.run.smithi121.stdout:Upgraded: 2024-04-25T01:38:16.875 INFO:teuthology.orchestra.run.smithi121.stdout: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.876 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.876 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T01:38:16.876 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T01:38:16.876 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-04-25T01:38:16.876 INFO:teuthology.orchestra.run.smithi121.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T01:38:16.876 INFO:teuthology.orchestra.run.smithi121.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T01:38:16.876 INFO:teuthology.orchestra.run.smithi121.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T01:38:16.876 INFO:teuthology.orchestra.run.smithi121.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T01:38:16.876 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.876 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.876 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.876 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.876 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:38:16.877 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.877 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.877 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.877 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:38:16.877 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:38:16.877 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:38:16.877 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:38:16.877 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:38:16.877 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.877 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.877 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:38:16.877 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.877 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.877 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.878 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:38:16.878 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:38:16.878 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.878 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.878 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:38:16.878 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T01:38:16.878 INFO:teuthology.orchestra.run.smithi121.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T01:38:16.878 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T01:38:16.878 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T01:38:16.878 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T01:38:16.878 INFO:teuthology.orchestra.run.smithi121.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T01:38:16.879 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T01:38:16.879 INFO:teuthology.orchestra.run.smithi121.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T01:38:16.879 INFO:teuthology.orchestra.run.smithi121.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T01:38:16.879 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T01:38:16.879 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T01:38:16.879 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.879 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.879 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.879 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T01:38:16.879 INFO:teuthology.orchestra.run.smithi121.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T01:38:16.879 INFO:teuthology.orchestra.run.smithi121.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T01:38:16.879 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T01:38:16.879 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T01:38:16.880 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.880 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.880 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T01:38:16.880 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.880 INFO:teuthology.orchestra.run.smithi121.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T01:38:16.880 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T01:38:16.880 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T01:38:16.881 INFO:teuthology.orchestra.run.smithi121.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T01:38:16.881 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T01:38:16.881 INFO:teuthology.orchestra.run.smithi121.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T01:38:16.881 INFO:teuthology.orchestra.run.smithi121.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T01:38:16.881 INFO:teuthology.orchestra.run.smithi121.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T01:38:16.881 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T01:38:16.881 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T01:38:16.882 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T01:38:16.882 INFO:teuthology.orchestra.run.smithi121.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T01:38:16.882 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T01:38:16.882 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T01:38:16.882 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T01:38:16.882 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T01:38:16.882 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T01:38:16.883 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T01:38:16.883 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T01:38:16.883 INFO:teuthology.orchestra.run.smithi121.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T01:38:16.883 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T01:38:16.883 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T01:38:16.883 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T01:38:16.883 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.884 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.884 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.884 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T01:38:16.884 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T01:38:16.884 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T01:38:16.884 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T01:38:16.884 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T01:38:16.885 INFO:teuthology.orchestra.run.smithi121.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T01:38:16.885 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T01:38:16.885 INFO:teuthology.orchestra.run.smithi121.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T01:38:16.885 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T01:38:16.885 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T01:38:16.885 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T01:38:16.886 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T01:38:16.886 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T01:38:16.886 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T01:38:16.886 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T01:38:16.887 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T01:38:16.887 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T01:38:16.887 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T01:38:16.887 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T01:38:16.887 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T01:38:16.887 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T01:38:16.887 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T01:38:16.888 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T01:38:16.888 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T01:38:16.888 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T01:38:16.888 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T01:38:16.888 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T01:38:16.888 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T01:38:16.888 INFO:teuthology.orchestra.run.smithi121.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T01:38:16.888 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T01:38:16.889 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T01:38:16.889 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T01:38:16.889 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T01:38:16.889 INFO:teuthology.orchestra.run.smithi121.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T01:38:16.889 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T01:38:16.889 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T01:38:16.889 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T01:38:16.890 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T01:38:16.890 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T01:38:16.890 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T01:38:16.890 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.890 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.891 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T01:38:16.891 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T01:38:16.891 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T01:38:16.891 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.891 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T01:38:16.891 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T01:38:16.891 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T01:38:16.892 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T01:38:16.892 INFO:teuthology.orchestra.run.smithi121.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T01:38:16.892 INFO:teuthology.orchestra.run.smithi121.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T01:38:16.892 INFO:teuthology.orchestra.run.smithi121.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T01:38:16.892 INFO:teuthology.orchestra.run.smithi121.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T01:38:16.892 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T01:38:16.893 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T01:38:16.893 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T01:38:16.893 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T01:38:16.893 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T01:38:16.893 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T01:38:16.893 INFO:teuthology.orchestra.run.smithi121.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T01:38:16.893 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.893 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.893 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:38:16.893 INFO:teuthology.orchestra.run.smithi121.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T01:38:16.893 INFO:teuthology.orchestra.run.smithi121.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T01:38:16.893 INFO:teuthology.orchestra.run.smithi121.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T01:38:16.894 INFO:teuthology.orchestra.run.smithi121.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T01:38:16.894 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T01:38:16.894 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T01:38:16.894 INFO:teuthology.orchestra.run.smithi121.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T01:38:16.894 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:16.894 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-04-25T01:38:17.280 DEBUG:teuthology.parallel:result is None 2024-04-25T01:38:17.281 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T01:38:17.436 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T01:38:17.462 INFO:teuthology.orchestra.run.smithi077.stdout:19.0.0-2445.gd2c45d97.el9 2024-04-25T01:38:17.462 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445.gd2c45d97.el9 2024-04-25T01:38:17.463 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445.gd2c45d97 is installed. 2024-04-25T01:38:17.465 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T01:38:17.683 DEBUG:teuthology.orchestra.run.smithi121:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T01:38:17.704 INFO:teuthology.orchestra.run.smithi121.stdout:19.0.0-2445.gd2c45d97.el9 2024-04-25T01:38:17.704 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445.gd2c45d97.el9 2024-04-25T01:38:17.704 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445.gd2c45d97 is installed. 2024-04-25T01:38:17.706 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T01:38:17.707 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:38:17.707 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T01:38:17.738 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-25T01:38:17.739 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T01:38:17.772 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T01:38:17.773 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:38:17.773 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T01:38:17.805 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T01:38:17.870 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-25T01:38:17.870 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T01:38:17.894 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T01:38:17.958 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T01:38:17.958 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:38:17.959 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T01:38:17.986 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T01:38:18.050 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-25T01:38:18.050 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T01:38:18.074 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T01:38:18.137 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T01:38:18.137 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:38:18.137 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T01:38:18.161 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T01:38:18.225 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-25T01:38:18.225 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T01:38:18.249 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T01:38:18.313 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T01:38:18.400 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T01:38:18.401 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 777 /var/log/ceph 2024-04-25T01:38:18.403 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 777 /var/log/ceph 2024-04-25T01:38:18.427 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T01:38:18.427 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T01:38:18.469 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T01:38:18.492 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T01:38:18.492 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T01:38:18.533 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T01:38:18.563 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-25T01:38:18.564 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-25T01:38:18.564 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-25T01:38:18.564 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:38:18.564 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T01:38:18.609 DEBUG:teuthology.orchestra.run.smithi077:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T01:38:18.718 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T01:38:18.755 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-25T01:38:18.755 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T01:38:18.771 DEBUG:teuthology.orchestra.run.smithi121:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T01:38:18.878 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T01:38:18.923 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T01:38:18.923 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'Replacing daemon mds'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T01:38:18.924 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672336', 'branch': 'squid', 'description': 'fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/iozone}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7672336', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'fs': [{'name': 'a'}, {'name': 'b'}], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'Replacing daemon mds'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'cephfs_name': 'a'}, 'client.1': {'cephfs_name': 'b'}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'kclient': {'client.0': {'cephfs_name': 'a'}, 'client.1': {'cephfs_name': 'b'}, 'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 8528, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'sleep_before_teardown': 0, 'subset': '122/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi077.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLbiWRlvXQKTSoKR06Ueq0MnPNY+zyQd5DGsGrxJOE4jsKbW0ijpCbw7wZwcTi5vOq0RsF3EZ9OYi0mlOO6A7e0=', 'smithi121.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKV++hS67ntohN1Uusfa4cZBqzo0BPfTi6JkpSvv0ZH5xhggS83F3T4A7JVDhFyyatvumdPf3HjNk+Hy+aCnJ9U='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'fs': [{'name': 'a'}, {'name': 'b'}], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'Replacing daemon mds'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'mds_thrash': None}, {'workunit': {'clients': {'all': ['suites/iozone.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-24_21:24:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T01:38:18.924 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T01:38:18.926 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T01:38:18.973 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T01:38:18.981 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T01:38:19.039 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:38:19.039 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T01:38:19.057 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T01:38:19.057 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_1 2024-04-25T01:38:19.112 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T01:38:19.112 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T01:38:19.112 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-25T01:38:19.112 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T01:38:19.112 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T01:38:19.112 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-04-25 01:37:47.118099743 +0000 2024-04-25T01:38:19.113 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-04-25 01:35:55.772877114 +0000 2024-04-25T01:38:19.113 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-04-25 01:35:55.772877114 +0000 2024-04-25T01:38:19.113 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-04-25 01:35:55.772877114 +0000 2024-04-25T01:38:19.113 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T01:38:19.174 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-04-25T01:38:19.174 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-04-25T01:38:19.174 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.00020227 s, 2.5 MB/s 2024-04-25T01:38:19.175 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T01:38:19.231 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_2 2024-04-25T01:38:19.286 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T01:38:19.286 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T01:38:19.286 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-25T01:38:19.286 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T01:38:19.286 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T01:38:19.286 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-04-25 01:37:47.118099743 +0000 2024-04-25T01:38:19.287 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-04-25 01:35:56.109870121 +0000 2024-04-25T01:38:19.287 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-04-25 01:35:56.109870121 +0000 2024-04-25T01:38:19.287 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-04-25 01:35:56.109870121 +0000 2024-04-25T01:38:19.287 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T01:38:19.348 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-04-25T01:38:19.348 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-04-25T01:38:19.348 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000176788 s, 2.9 MB/s 2024-04-25T01:38:19.350 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T01:38:19.404 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_3 2024-04-25T01:38:19.459 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T01:38:19.459 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T01:38:19.459 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-04-25T01:38:19.459 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T01:38:19.459 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T01:38:19.459 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-04-25 01:37:47.119099722 +0000 2024-04-25T01:38:19.459 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-04-25 01:35:56.442863211 +0000 2024-04-25T01:38:19.459 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-04-25 01:35:56.442863211 +0000 2024-04-25T01:38:19.459 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-04-25 01:35:56.442863211 +0000 2024-04-25T01:38:19.460 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T01:38:19.521 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-04-25T01:38:19.521 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-04-25T01:38:19.521 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000226249 s, 2.3 MB/s 2024-04-25T01:38:19.522 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T01:38:19.578 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_4 2024-04-25T01:38:19.633 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T01:38:19.633 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T01:38:19.633 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-25T01:38:19.633 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T01:38:19.633 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T01:38:19.633 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-04-25 01:37:47.119099722 +0000 2024-04-25T01:38:19.633 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-04-25 01:35:56.778856239 +0000 2024-04-25T01:38:19.633 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-04-25 01:35:56.778856239 +0000 2024-04-25T01:38:19.633 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-04-25 01:35:56.778856239 +0000 2024-04-25T01:38:19.633 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T01:38:19.695 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-04-25T01:38:19.696 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-04-25T01:38:19.696 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.00025303 s, 2.0 MB/s 2024-04-25T01:38:19.697 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T01:38:19.753 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T01:38:19.753 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-25T01:38:19.753 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T01:38:19.769 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T01:38:19.769 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_1 2024-04-25T01:38:19.823 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T01:38:19.823 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T01:38:19.823 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-25T01:38:19.824 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T01:38:19.824 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T01:38:19.824 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-04-25 01:38:09.153830114 +0000 2024-04-25T01:38:19.824 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-04-25 01:35:56.060379967 +0000 2024-04-25T01:38:19.824 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-04-25 01:35:56.060379967 +0000 2024-04-25T01:38:19.824 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-04-25 01:35:56.060379967 +0000 2024-04-25T01:38:19.824 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T01:38:19.886 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-04-25T01:38:19.886 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-04-25T01:38:19.886 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000243194 s, 2.1 MB/s 2024-04-25T01:38:19.887 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T01:38:19.942 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_2 2024-04-25T01:38:19.998 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T01:38:19.998 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T01:38:19.998 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-25T01:38:19.998 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T01:38:19.998 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T01:38:19.998 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-04-25 01:38:09.153830114 +0000 2024-04-25T01:38:19.998 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-04-25 01:35:56.411375251 +0000 2024-04-25T01:38:19.998 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-04-25 01:35:56.411375251 +0000 2024-04-25T01:38:19.998 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-04-25 01:35:56.411375251 +0000 2024-04-25T01:38:19.999 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T01:38:20.060 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-04-25T01:38:20.060 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-04-25T01:38:20.060 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000201927 s, 2.5 MB/s 2024-04-25T01:38:20.061 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T01:38:20.116 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_3 2024-04-25T01:38:20.170 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T01:38:20.170 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T01:38:20.170 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-25T01:38:20.171 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T01:38:20.171 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T01:38:20.171 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-04-25 01:38:09.153830114 +0000 2024-04-25T01:38:20.171 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-04-25 01:35:56.767370467 +0000 2024-04-25T01:38:20.171 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-04-25 01:35:56.767370467 +0000 2024-04-25T01:38:20.171 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-04-25 01:35:56.767370467 +0000 2024-04-25T01:38:20.171 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T01:38:20.233 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-04-25T01:38:20.233 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-04-25T01:38:20.233 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000203569 s, 2.5 MB/s 2024-04-25T01:38:20.234 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T01:38:20.290 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_4 2024-04-25T01:38:20.345 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T01:38:20.345 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T01:38:20.345 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-25T01:38:20.346 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T01:38:20.346 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T01:38:20.346 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-04-25 01:38:09.154830101 +0000 2024-04-25T01:38:20.346 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-04-25 01:35:57.110365858 +0000 2024-04-25T01:38:20.346 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-04-25 01:35:57.110365858 +0000 2024-04-25T01:38:20.346 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-04-25 01:35:57.110365858 +0000 2024-04-25T01:38:20.346 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T01:38:20.407 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-04-25T01:38:20.407 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-04-25T01:38:20.407 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000227251 s, 2.3 MB/s 2024-04-25T01:38:20.408 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T01:38:20.464 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T01:38:20.464 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi077.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi121.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T01:38:20.464 INFO:tasks.ceph:Generating config... 2024-04-25T01:38:20.465 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T01:38:20.465 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-04-25T01:38:20.465 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T01:38:20.466 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T01:38:20.466 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T01:38:20.466 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T01:38:20.466 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-25T01:38:20.466 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T01:38:20.466 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T01:38:20.466 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T01:38:20.466 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-25T01:38:20.466 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-25T01:38:20.466 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-25T01:38:20.466 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-25T01:38:20.466 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T01:38:20.466 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T01:38:20.467 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T01:38:20.467 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T01:38:20.467 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-04-25T01:38:20.467 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-04-25T01:38:20.467 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-04-25T01:38:20.469 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-04-25T01:38:20.469 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-04-25T01:38:20.469 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T01:38:20.469 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T01:38:20.469 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T01:38:20.470 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-25T01:38:20.470 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T01:38:20.470 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T01:38:20.470 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T01:38:20.470 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T01:38:20.470 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T01:38:20.470 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-25T01:38:20.470 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T01:38:20.470 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-25T01:38:20.470 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-25T01:38:20.470 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-25T01:38:20.470 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T01:38:20.470 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T01:38:20.470 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-25T01:38:20.470 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-25T01:38:20.471 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T01:38:20.471 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T01:38:20.471 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-25T01:38:20.471 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-04-25T01:38:20.471 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T01:38:20.471 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T01:38:20.471 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T01:38:20.471 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-04-25T01:38:20.471 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-04-25T01:38:20.471 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-04-25T01:38:20.471 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-04-25T01:38:20.471 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-25T01:38:20.471 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T01:38:20.471 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-25T01:38:20.471 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T01:38:20.471 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T01:38:20.472 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T01:38:20.472 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T01:38:20.526 INFO:teuthology.orchestra.run.smithi077.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T01:38:20.528 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T01:38:20.572 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T01:38:20.637 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.77'), ('mon.b', '172.21.15.121'), ('mon.c', '[v2:172.21.15.121:3301,v1:172.21.15.121:6790]')] 2024-04-25T01:38:20.638 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.77,172.21.15.121,[v2:172.21.15.121:3301,v1:172.21.15.121:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T01:38:20.639 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:38:20.639 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T01:38:20.693 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.77 --add b 172.21.15.121 --addv c '[v2:172.21.15.121:3301,v1:172.21.15.121:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T01:38:20.779 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T01:38:20.779 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool: generated fsid 70f1c0d7-4e08-4883-a8bd-1451a32d9af1 2024-04-25T01:38:20.779 INFO:teuthology.orchestra.run.smithi077.stdout:setting min_mon_release = quincy 2024-04-25T01:38:20.780 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 0 2024-04-25T01:38:20.780 INFO:teuthology.orchestra.run.smithi077.stdout:fsid 70f1c0d7-4e08-4883-a8bd-1451a32d9af1 2024-04-25T01:38:20.780 INFO:teuthology.orchestra.run.smithi077.stdout:last_changed 2024-04-25T01:38:20.800991+0000 2024-04-25T01:38:20.780 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-04-25T01:38:20.800991+0000 2024-04-25T01:38:20.780 INFO:teuthology.orchestra.run.smithi077.stdout:min_mon_release 17 (quincy) 2024-04-25T01:38:20.780 INFO:teuthology.orchestra.run.smithi077.stdout:election_strategy: 1 2024-04-25T01:38:20.780 INFO:teuthology.orchestra.run.smithi077.stdout:0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.a 2024-04-25T01:38:20.780 INFO:teuthology.orchestra.run.smithi077.stdout:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-04-25T01:38:20.780 INFO:teuthology.orchestra.run.smithi077.stdout:2: [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] mon.c 2024-04-25T01:38:20.780 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T01:38:20.781 DEBUG:teuthology.orchestra.run.smithi077:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T01:38:20.796 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 70f1c0d7-4e08-4883-a8bd-1451a32d9af1... 2024-04-25T01:38:20.796 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T01:38:20.839 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T01:38:20.876 INFO:teuthology.orchestra.run.smithi077.stdout:[global] 2024-04-25T01:38:20.876 INFO:teuthology.orchestra.run.smithi077.stdout: chdir = "" 2024-04-25T01:38:20.877 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T01:38:20.877 INFO:teuthology.orchestra.run.smithi077.stdout: auth supported = cephx 2024-04-25T01:38:20.877 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:38:20.877 INFO:teuthology.orchestra.run.smithi077.stdout: filestore xattr use omap = true 2024-04-25T01:38:20.877 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:38:20.877 INFO:teuthology.orchestra.run.smithi077.stdout: mon clock drift allowed = 1.000 2024-04-25T01:38:20.878 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:38:20.878 INFO:teuthology.orchestra.run.smithi077.stdout: osd crush chooseleaf type = 0 2024-04-25T01:38:20.878 INFO:teuthology.orchestra.run.smithi077.stdout: auth debug = true 2024-04-25T01:38:20.878 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:38:20.878 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on old message = true 2024-04-25T01:38:20.879 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on bug = true 2024-04-25T01:38:20.879 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:38:20.879 INFO:teuthology.orchestra.run.smithi077.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T01:38:20.879 INFO:teuthology.orchestra.run.smithi077.stdout: mon pg warn max object skew = 0 2024-04-25T01:38:20.879 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:38:20.879 INFO:teuthology.orchestra.run.smithi077.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T01:38:20.879 INFO:teuthology.orchestra.run.smithi077.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T01:38:20.879 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:38:20.879 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default size = 2 2024-04-25T01:38:20.879 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:38:20.879 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow primary affinity = true 2024-04-25T01:38:20.879 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow pg remap = true 2024-04-25T01:38:20.879 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on legacy crush tunables = false 2024-04-25T01:38:20.879 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on crush straw calc version zero = false 2024-04-25T01:38:20.880 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on no sortbitwise = false 2024-04-25T01:38:20.880 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on osd down out interval zero = false 2024-04-25T01:38:20.880 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on too few osds = false 2024-04-25T01:38:20.880 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T01:38:20.880 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T01:38:20.880 INFO:teuthology.orchestra.run.smithi077.stdout: mon_allow_pool_size_one = true 2024-04-25T01:38:20.880 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:38:20.880 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T01:38:20.880 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:38:20.880 INFO:teuthology.orchestra.run.smithi077.stdout: osd default data pool replay window = 5 2024-04-25T01:38:20.880 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:38:20.880 INFO:teuthology.orchestra.run.smithi077.stdout: mon allow pool delete = true 2024-04-25T01:38:20.880 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:38:20.880 INFO:teuthology.orchestra.run.smithi077.stdout: mon cluster log file level = debug 2024-04-25T01:38:20.880 INFO:teuthology.orchestra.run.smithi077.stdout: debug asserts on shutdown = true 2024-04-25T01:38:20.881 INFO:teuthology.orchestra.run.smithi077.stdout: mon health detail to clog = false 2024-04-25T01:38:20.881 INFO:teuthology.orchestra.run.smithi077.stdout: mon host = "172.21.15.77,172.21.15.121,[v2:172.21.15.121:3301,v1:172.21.15.121:6790]" 2024-04-25T01:38:20.882 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on skipped message = False 2024-04-25T01:38:20.882 INFO:teuthology.orchestra.run.smithi077.stdout: fsid = 70f1c0d7-4e08-4883-a8bd-1451a32d9af1 2024-04-25T01:38:20.882 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:38:20.882 INFO:teuthology.orchestra.run.smithi077.stdout:[osd] 2024-04-25T01:38:20.882 INFO:teuthology.orchestra.run.smithi077.stdout: osd journal size = 100 2024-04-25T01:38:20.882 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:38:20.882 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub load threshold = 5.0 2024-04-25T01:38:20.883 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub max interval = 600 2024-04-25T01:38:20.883 INFO:teuthology.orchestra.run.smithi077.stdout: osd mclock profile = high_recovery_ops 2024-04-25T01:38:20.883 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:38:20.883 INFO:teuthology.orchestra.run.smithi077.stdout: osd recover clone overlap = true 2024-04-25T01:38:20.883 INFO:teuthology.orchestra.run.smithi077.stdout: osd recovery max chunk = 1048576 2024-04-25T01:38:20.883 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:38:20.883 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug shutdown = true 2024-04-25T01:38:20.883 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug op order = true 2024-04-25T01:38:20.883 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug verify stray on activate = true 2024-04-25T01:38:20.883 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug trim objects = true 2024-04-25T01:38:20.883 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:38:20.883 INFO:teuthology.orchestra.run.smithi077.stdout: osd open classes on start = true 2024-04-25T01:38:20.883 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug pg log writeout = true 2024-04-25T01:38:20.884 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:38:20.884 INFO:teuthology.orchestra.run.smithi077.stdout: osd deep scrub update digest min age = 30 2024-04-25T01:38:20.884 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:38:20.884 INFO:teuthology.orchestra.run.smithi077.stdout: osd map max advance = 10 2024-04-25T01:38:20.884 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:38:20.884 INFO:teuthology.orchestra.run.smithi077.stdout: journal zero on create = true 2024-04-25T01:38:20.884 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:38:20.884 INFO:teuthology.orchestra.run.smithi077.stdout: filestore ondisk finisher threads = 3 2024-04-25T01:38:20.884 INFO:teuthology.orchestra.run.smithi077.stdout: filestore apply finisher threads = 3 2024-04-25T01:38:20.884 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:38:20.884 INFO:teuthology.orchestra.run.smithi077.stdout: bdev debug aio = true 2024-04-25T01:38:20.884 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug misdirected ops = true 2024-04-25T01:38:20.884 INFO:teuthology.orchestra.run.smithi077.stdout: bdev async discard = True 2024-04-25T01:38:20.884 INFO:teuthology.orchestra.run.smithi077.stdout: bdev enable discard = True 2024-04-25T01:38:20.884 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore allocator = bitmap 2024-04-25T01:38:20.885 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore block size = 96636764160 2024-04-25T01:38:20.885 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore fsck on mount = True 2024-04-25T01:38:20.885 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluefs = 1/20 2024-04-25T01:38:20.885 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluestore = 1/20 2024-04-25T01:38:20.885 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-04-25T01:38:20.885 INFO:teuthology.orchestra.run.smithi077.stdout: debug osd = 20 2024-04-25T01:38:20.885 INFO:teuthology.orchestra.run.smithi077.stdout: debug rocksdb = 4/10 2024-04-25T01:38:20.885 INFO:teuthology.orchestra.run.smithi077.stdout: mon client directed command retry = 5 2024-04-25T01:38:20.885 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T01:38:20.885 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd full ratio = 0.9 2024-04-25T01:38:20.885 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd nearfull ratio = 0.8 2024-04-25T01:38:20.885 INFO:teuthology.orchestra.run.smithi077.stdout: ms inject delay max = 1 2024-04-25T01:38:20.885 INFO:teuthology.orchestra.run.smithi077.stdout: ms inject delay probability = 0.005 2024-04-25T01:38:20.885 INFO:teuthology.orchestra.run.smithi077.stdout: ms inject delay type = client mds 2024-04-25T01:38:20.886 INFO:teuthology.orchestra.run.smithi077.stdout: ms inject socket failures = 2500 2024-04-25T01:38:20.886 INFO:teuthology.orchestra.run.smithi077.stdout: osd blocked scrub grace period = 3600 2024-04-25T01:38:20.886 INFO:teuthology.orchestra.run.smithi077.stdout: osd failsafe full ratio = 0.95 2024-04-25T01:38:20.886 INFO:teuthology.orchestra.run.smithi077.stdout: osd max markdown count = 1000 2024-04-25T01:38:20.886 INFO:teuthology.orchestra.run.smithi077.stdout: osd objectstore = bluestore 2024-04-25T01:38:20.886 INFO:teuthology.orchestra.run.smithi077.stdout: osd op complaint time = 180 2024-04-25T01:38:20.886 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:38:20.886 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr] 2024-04-25T01:38:20.886 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-04-25T01:38:20.886 INFO:teuthology.orchestra.run.smithi077.stdout: debug mgr = 20 2024-04-25T01:38:20.886 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-04-25T01:38:20.886 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-04-25T01:38:20.886 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-04-25T01:38:20.886 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-04-25T01:38:20.887 INFO:teuthology.orchestra.run.smithi077.stdout: mgr/telemetry/nag = false 2024-04-25T01:38:20.887 INFO:teuthology.orchestra.run.smithi077.stdout: debug client = 20 2024-04-25T01:38:20.887 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:38:20.887 INFO:teuthology.orchestra.run.smithi077.stdout:[mon] 2024-04-25T01:38:20.887 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-04-25T01:38:20.887 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-04-25T01:38:20.887 INFO:teuthology.orchestra.run.smithi077.stdout: debug paxos = 20 2024-04-25T01:38:20.887 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-04-25T01:38:20.887 INFO:teuthology.orchestra.run.smithi077.stdout: mon data avail warn = 5 2024-04-25T01:38:20.887 INFO:teuthology.orchestra.run.smithi077.stdout: mon mgr mkfs grace = 240 2024-04-25T01:38:20.887 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-04-25T01:38:20.887 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd reporter subtree level = osd 2024-04-25T01:38:20.887 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd prime pg temp = true 2024-04-25T01:38:20.887 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-04-25T01:38:20.887 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:38:20.888 INFO:teuthology.orchestra.run.smithi077.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T01:38:20.888 INFO:teuthology.orchestra.run.smithi077.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T01:38:20.888 INFO:teuthology.orchestra.run.smithi077.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T01:38:20.888 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:38:20.888 INFO:teuthology.orchestra.run.smithi077.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T01:38:20.888 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T01:38:20.888 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T01:38:20.888 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:38:20.888 INFO:teuthology.orchestra.run.smithi077.stdout: # 1m isn't quite enough 2024-04-25T01:38:20.888 INFO:teuthology.orchestra.run.smithi077.stdout: mon_down_mkfs_grace = 2m 2024-04-25T01:38:20.888 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:38:20.888 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_filestore_osds = false 2024-04-25T01:38:20.888 INFO:teuthology.orchestra.run.smithi077.stdout: mon down mkfs grace = 300 2024-04-25T01:38:20.888 INFO:teuthology.orchestra.run.smithi077.stdout: mon op complaint time = 120 2024-04-25T01:38:20.889 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:38:20.889 INFO:teuthology.orchestra.run.smithi077.stdout:[client] 2024-04-25T01:38:20.889 INFO:teuthology.orchestra.run.smithi077.stdout: rgw cache enabled = true 2024-04-25T01:38:20.889 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable ops log = true 2024-04-25T01:38:20.889 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable usage log = true 2024-04-25T01:38:20.889 INFO:teuthology.orchestra.run.smithi077.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T01:38:20.889 INFO:teuthology.orchestra.run.smithi077.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T01:38:20.889 INFO:teuthology.orchestra.run.smithi077.stdout: client mount timeout = 600 2024-04-25T01:38:20.889 INFO:teuthology.orchestra.run.smithi077.stdout: client_shutdown_timeout = 120 2024-04-25T01:38:20.889 INFO:teuthology.orchestra.run.smithi077.stdout: debug client = 20 2024-04-25T01:38:20.889 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-04-25T01:38:20.889 INFO:teuthology.orchestra.run.smithi077.stdout: rados mon op timeout = 900 2024-04-25T01:38:20.889 INFO:teuthology.orchestra.run.smithi077.stdout: rados osd op timeout = 900 2024-04-25T01:38:20.889 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.a] 2024-04-25T01:38:20.889 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.b] 2024-04-25T01:38:20.890 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.c] 2024-04-25T01:38:20.890 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.a] 2024-04-25T01:38:20.890 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.c] 2024-04-25T01:38:20.890 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.b] 2024-04-25T01:38:20.890 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.d] 2024-04-25T01:38:20.890 INFO:teuthology.orchestra.run.smithi077.stdout:[mds] 2024-04-25T01:38:20.890 INFO:teuthology.orchestra.run.smithi077.stdout: debug mds = 20 2024-04-25T01:38:20.890 INFO:teuthology.orchestra.run.smithi077.stdout: debug mds balancer = 20 2024-04-25T01:38:20.890 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-04-25T01:38:20.890 INFO:teuthology.orchestra.run.smithi077.stdout: mds bal fragment size max = 10000 2024-04-25T01:38:20.890 INFO:teuthology.orchestra.run.smithi077.stdout: mds bal merge size = 5 2024-04-25T01:38:20.890 INFO:teuthology.orchestra.run.smithi077.stdout: mds bal split bits = 3 2024-04-25T01:38:20.890 INFO:teuthology.orchestra.run.smithi077.stdout: mds bal split size = 100 2024-04-25T01:38:20.891 INFO:teuthology.orchestra.run.smithi077.stdout: mds debug frag = True 2024-04-25T01:38:20.891 INFO:teuthology.orchestra.run.smithi077.stdout: mds debug scatterstat = True 2024-04-25T01:38:20.891 INFO:teuthology.orchestra.run.smithi077.stdout: mds op complaint time = 180 2024-04-25T01:38:20.891 INFO:teuthology.orchestra.run.smithi077.stdout: mds verify scatter = True 2024-04-25T01:38:20.891 INFO:teuthology.orchestra.run.smithi077.stdout: mon client directed command retry = 5 2024-04-25T01:38:20.891 INFO:teuthology.orchestra.run.smithi077.stdout: ms inject delay max = 1 2024-04-25T01:38:20.891 INFO:teuthology.orchestra.run.smithi077.stdout: ms inject delay probability = 0.005 2024-04-25T01:38:20.891 INFO:teuthology.orchestra.run.smithi077.stdout: ms inject delay type = client mds osd 2024-04-25T01:38:20.891 INFO:teuthology.orchestra.run.smithi077.stdout: ms inject socket failures = 2500 2024-04-25T01:38:20.891 INFO:teuthology.orchestra.run.smithi077.stdout: osd op complaint time = 180 2024-04-25T01:38:20.891 INFO:teuthology.orchestra.run.smithi077.stdout: rados mon op timeout = 900 2024-04-25T01:38:20.891 INFO:teuthology.orchestra.run.smithi077.stdout: rados osd op timeout = 900 2024-04-25T01:38:20.893 INFO:teuthology.orchestra.run.smithi121.stdout:[global] 2024-04-25T01:38:20.893 INFO:teuthology.orchestra.run.smithi121.stdout: chdir = "" 2024-04-25T01:38:20.893 INFO:teuthology.orchestra.run.smithi121.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T01:38:20.893 INFO:teuthology.orchestra.run.smithi121.stdout: auth supported = cephx 2024-04-25T01:38:20.893 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:20.893 INFO:teuthology.orchestra.run.smithi121.stdout: filestore xattr use omap = true 2024-04-25T01:38:20.893 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:20.894 INFO:teuthology.orchestra.run.smithi121.stdout: mon clock drift allowed = 1.000 2024-04-25T01:38:20.894 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:20.894 INFO:teuthology.orchestra.run.smithi121.stdout: osd crush chooseleaf type = 0 2024-04-25T01:38:20.894 INFO:teuthology.orchestra.run.smithi121.stdout: auth debug = true 2024-04-25T01:38:20.894 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:20.894 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on old message = true 2024-04-25T01:38:20.894 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on bug = true 2024-04-25T01:38:20.894 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:20.894 INFO:teuthology.orchestra.run.smithi121.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T01:38:20.894 INFO:teuthology.orchestra.run.smithi121.stdout: mon pg warn max object skew = 0 2024-04-25T01:38:20.894 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:20.894 INFO:teuthology.orchestra.run.smithi121.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T01:38:20.894 INFO:teuthology.orchestra.run.smithi121.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T01:38:20.895 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:20.895 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default size = 2 2024-04-25T01:38:20.895 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:20.895 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow primary affinity = true 2024-04-25T01:38:20.895 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow pg remap = true 2024-04-25T01:38:20.895 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on legacy crush tunables = false 2024-04-25T01:38:20.895 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on crush straw calc version zero = false 2024-04-25T01:38:20.895 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on no sortbitwise = false 2024-04-25T01:38:20.895 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on osd down out interval zero = false 2024-04-25T01:38:20.895 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on too few osds = false 2024-04-25T01:38:20.895 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T01:38:20.895 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T01:38:20.895 INFO:teuthology.orchestra.run.smithi121.stdout: mon_allow_pool_size_one = true 2024-04-25T01:38:20.895 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:20.895 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T01:38:20.896 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:20.896 INFO:teuthology.orchestra.run.smithi121.stdout: osd default data pool replay window = 5 2024-04-25T01:38:20.896 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:20.896 INFO:teuthology.orchestra.run.smithi121.stdout: mon allow pool delete = true 2024-04-25T01:38:20.896 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:20.896 INFO:teuthology.orchestra.run.smithi121.stdout: mon cluster log file level = debug 2024-04-25T01:38:20.896 INFO:teuthology.orchestra.run.smithi121.stdout: debug asserts on shutdown = true 2024-04-25T01:38:20.896 INFO:teuthology.orchestra.run.smithi121.stdout: mon health detail to clog = false 2024-04-25T01:38:20.896 INFO:teuthology.orchestra.run.smithi121.stdout: mon host = "172.21.15.77,172.21.15.121,[v2:172.21.15.121:3301,v1:172.21.15.121:6790]" 2024-04-25T01:38:20.896 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on skipped message = False 2024-04-25T01:38:20.896 INFO:teuthology.orchestra.run.smithi121.stdout: fsid = 70f1c0d7-4e08-4883-a8bd-1451a32d9af1 2024-04-25T01:38:20.896 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:20.896 INFO:teuthology.orchestra.run.smithi121.stdout:[osd] 2024-04-25T01:38:20.896 INFO:teuthology.orchestra.run.smithi121.stdout: osd journal size = 100 2024-04-25T01:38:20.897 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:20.897 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub load threshold = 5.0 2024-04-25T01:38:20.897 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub max interval = 600 2024-04-25T01:38:20.897 INFO:teuthology.orchestra.run.smithi121.stdout: osd mclock profile = high_recovery_ops 2024-04-25T01:38:20.897 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:20.897 INFO:teuthology.orchestra.run.smithi121.stdout: osd recover clone overlap = true 2024-04-25T01:38:20.897 INFO:teuthology.orchestra.run.smithi121.stdout: osd recovery max chunk = 1048576 2024-04-25T01:38:20.897 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:20.897 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug shutdown = true 2024-04-25T01:38:20.897 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug op order = true 2024-04-25T01:38:20.897 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug verify stray on activate = true 2024-04-25T01:38:20.897 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug trim objects = true 2024-04-25T01:38:20.897 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:20.897 INFO:teuthology.orchestra.run.smithi121.stdout: osd open classes on start = true 2024-04-25T01:38:20.897 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug pg log writeout = true 2024-04-25T01:38:20.898 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:20.898 INFO:teuthology.orchestra.run.smithi121.stdout: osd deep scrub update digest min age = 30 2024-04-25T01:38:20.898 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:20.898 INFO:teuthology.orchestra.run.smithi121.stdout: osd map max advance = 10 2024-04-25T01:38:20.898 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:20.898 INFO:teuthology.orchestra.run.smithi121.stdout: journal zero on create = true 2024-04-25T01:38:20.898 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:20.898 INFO:teuthology.orchestra.run.smithi121.stdout: filestore ondisk finisher threads = 3 2024-04-25T01:38:20.898 INFO:teuthology.orchestra.run.smithi121.stdout: filestore apply finisher threads = 3 2024-04-25T01:38:20.898 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:20.898 INFO:teuthology.orchestra.run.smithi121.stdout: bdev debug aio = true 2024-04-25T01:38:20.898 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug misdirected ops = true 2024-04-25T01:38:20.898 INFO:teuthology.orchestra.run.smithi121.stdout: bdev async discard = True 2024-04-25T01:38:20.899 INFO:teuthology.orchestra.run.smithi121.stdout: bdev enable discard = True 2024-04-25T01:38:20.899 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore allocator = bitmap 2024-04-25T01:38:20.899 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore block size = 96636764160 2024-04-25T01:38:20.899 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore fsck on mount = True 2024-04-25T01:38:20.899 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluefs = 1/20 2024-04-25T01:38:20.899 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluestore = 1/20 2024-04-25T01:38:20.899 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-04-25T01:38:20.899 INFO:teuthology.orchestra.run.smithi121.stdout: debug osd = 20 2024-04-25T01:38:20.899 INFO:teuthology.orchestra.run.smithi121.stdout: debug rocksdb = 4/10 2024-04-25T01:38:20.899 INFO:teuthology.orchestra.run.smithi121.stdout: mon client directed command retry = 5 2024-04-25T01:38:20.899 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T01:38:20.899 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd full ratio = 0.9 2024-04-25T01:38:20.899 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd nearfull ratio = 0.8 2024-04-25T01:38:20.899 INFO:teuthology.orchestra.run.smithi121.stdout: ms inject delay max = 1 2024-04-25T01:38:20.900 INFO:teuthology.orchestra.run.smithi121.stdout: ms inject delay probability = 0.005 2024-04-25T01:38:20.900 INFO:teuthology.orchestra.run.smithi121.stdout: ms inject delay type = client mds 2024-04-25T01:38:20.900 INFO:teuthology.orchestra.run.smithi121.stdout: ms inject socket failures = 2500 2024-04-25T01:38:20.900 INFO:teuthology.orchestra.run.smithi121.stdout: osd blocked scrub grace period = 3600 2024-04-25T01:38:20.900 INFO:teuthology.orchestra.run.smithi121.stdout: osd failsafe full ratio = 0.95 2024-04-25T01:38:20.900 INFO:teuthology.orchestra.run.smithi121.stdout: osd max markdown count = 1000 2024-04-25T01:38:20.900 INFO:teuthology.orchestra.run.smithi121.stdout: osd objectstore = bluestore 2024-04-25T01:38:20.900 INFO:teuthology.orchestra.run.smithi121.stdout: osd op complaint time = 180 2024-04-25T01:38:20.900 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:20.900 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr] 2024-04-25T01:38:20.900 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-04-25T01:38:20.900 INFO:teuthology.orchestra.run.smithi121.stdout: debug mgr = 20 2024-04-25T01:38:20.900 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2024-04-25T01:38:20.900 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2024-04-25T01:38:20.901 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2024-04-25T01:38:20.901 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2024-04-25T01:38:20.901 INFO:teuthology.orchestra.run.smithi121.stdout: mgr/telemetry/nag = false 2024-04-25T01:38:20.901 INFO:teuthology.orchestra.run.smithi121.stdout: debug client = 20 2024-04-25T01:38:20.901 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:20.901 INFO:teuthology.orchestra.run.smithi121.stdout:[mon] 2024-04-25T01:38:20.901 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-04-25T01:38:20.901 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2024-04-25T01:38:20.901 INFO:teuthology.orchestra.run.smithi121.stdout: debug paxos = 20 2024-04-25T01:38:20.901 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2024-04-25T01:38:20.901 INFO:teuthology.orchestra.run.smithi121.stdout: mon data avail warn = 5 2024-04-25T01:38:20.901 INFO:teuthology.orchestra.run.smithi121.stdout: mon mgr mkfs grace = 240 2024-04-25T01:38:20.901 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2024-04-25T01:38:20.901 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd reporter subtree level = osd 2024-04-25T01:38:20.901 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd prime pg temp = true 2024-04-25T01:38:20.902 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2024-04-25T01:38:20.902 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:20.902 INFO:teuthology.orchestra.run.smithi121.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T01:38:20.902 INFO:teuthology.orchestra.run.smithi121.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T01:38:20.902 INFO:teuthology.orchestra.run.smithi121.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T01:38:20.902 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:20.902 INFO:teuthology.orchestra.run.smithi121.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T01:38:20.902 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T01:38:20.902 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T01:38:20.902 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:20.902 INFO:teuthology.orchestra.run.smithi121.stdout: # 1m isn't quite enough 2024-04-25T01:38:20.902 INFO:teuthology.orchestra.run.smithi121.stdout: mon_down_mkfs_grace = 2m 2024-04-25T01:38:20.902 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:20.903 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_filestore_osds = false 2024-04-25T01:38:20.903 INFO:teuthology.orchestra.run.smithi121.stdout: mon down mkfs grace = 300 2024-04-25T01:38:20.903 INFO:teuthology.orchestra.run.smithi121.stdout: mon op complaint time = 120 2024-04-25T01:38:20.903 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-04-25T01:38:20.903 INFO:teuthology.orchestra.run.smithi121.stdout:[client] 2024-04-25T01:38:20.903 INFO:teuthology.orchestra.run.smithi121.stdout: rgw cache enabled = true 2024-04-25T01:38:20.903 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable ops log = true 2024-04-25T01:38:20.903 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable usage log = true 2024-04-25T01:38:20.903 INFO:teuthology.orchestra.run.smithi121.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T01:38:20.903 INFO:teuthology.orchestra.run.smithi121.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T01:38:20.903 INFO:teuthology.orchestra.run.smithi121.stdout: client mount timeout = 600 2024-04-25T01:38:20.903 INFO:teuthology.orchestra.run.smithi121.stdout: client_shutdown_timeout = 120 2024-04-25T01:38:20.903 INFO:teuthology.orchestra.run.smithi121.stdout: debug client = 20 2024-04-25T01:38:20.903 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-04-25T01:38:20.903 INFO:teuthology.orchestra.run.smithi121.stdout: rados mon op timeout = 900 2024-04-25T01:38:20.904 INFO:teuthology.orchestra.run.smithi121.stdout: rados osd op timeout = 900 2024-04-25T01:38:20.904 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.a] 2024-04-25T01:38:20.904 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.b] 2024-04-25T01:38:20.904 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.c] 2024-04-25T01:38:20.904 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.a] 2024-04-25T01:38:20.904 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.c] 2024-04-25T01:38:20.904 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.b] 2024-04-25T01:38:20.904 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.d] 2024-04-25T01:38:20.904 INFO:teuthology.orchestra.run.smithi121.stdout:[mds] 2024-04-25T01:38:20.904 INFO:teuthology.orchestra.run.smithi121.stdout: debug mds = 20 2024-04-25T01:38:20.904 INFO:teuthology.orchestra.run.smithi121.stdout: debug mds balancer = 20 2024-04-25T01:38:20.904 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-04-25T01:38:20.904 INFO:teuthology.orchestra.run.smithi121.stdout: mds bal fragment size max = 10000 2024-04-25T01:38:20.904 INFO:teuthology.orchestra.run.smithi121.stdout: mds bal merge size = 5 2024-04-25T01:38:20.904 INFO:teuthology.orchestra.run.smithi121.stdout: mds bal split bits = 3 2024-04-25T01:38:20.904 INFO:teuthology.orchestra.run.smithi121.stdout: mds bal split size = 100 2024-04-25T01:38:20.905 INFO:teuthology.orchestra.run.smithi121.stdout: mds debug frag = True 2024-04-25T01:38:20.905 INFO:teuthology.orchestra.run.smithi121.stdout: mds debug scatterstat = True 2024-04-25T01:38:20.905 INFO:teuthology.orchestra.run.smithi121.stdout: mds op complaint time = 180 2024-04-25T01:38:20.905 INFO:teuthology.orchestra.run.smithi121.stdout: mds verify scatter = True 2024-04-25T01:38:20.905 INFO:teuthology.orchestra.run.smithi121.stdout: mon client directed command retry = 5 2024-04-25T01:38:20.905 INFO:teuthology.orchestra.run.smithi121.stdout: ms inject delay max = 1 2024-04-25T01:38:20.905 INFO:teuthology.orchestra.run.smithi121.stdout: ms inject delay probability = 0.005 2024-04-25T01:38:20.905 INFO:teuthology.orchestra.run.smithi121.stdout: ms inject delay type = client mds osd 2024-04-25T01:38:20.905 INFO:teuthology.orchestra.run.smithi121.stdout: ms inject socket failures = 2500 2024-04-25T01:38:20.905 INFO:teuthology.orchestra.run.smithi121.stdout: osd op complaint time = 180 2024-04-25T01:38:20.905 INFO:teuthology.orchestra.run.smithi121.stdout: rados mon op timeout = 900 2024-04-25T01:38:20.905 INFO:teuthology.orchestra.run.smithi121.stdout: rados osd op timeout = 900 2024-04-25T01:38:20.905 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T01:38:20.906 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T01:38:20.985 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T01:38:20.985 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:38:20.985 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T01:38:21.000 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:38:21.001 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T01:38:21.055 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T01:38:21.055 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:38:21.055 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T01:38:21.055 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T01:38:21.127 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:38:21.127 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T01:38:21.182 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi121.front.sepia.ceph.com 2024-04-25T01:38:21.182 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-25T01:38:21.182 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T01:38:21.182 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T01:38:21.215 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-25T01:38:21.215 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T01:38:21.269 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T01:38:21.269 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T01:38:21.270 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T01:38:21.317 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T01:38:21.319 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T01:38:21.379 INFO:teuthology.orchestra.run.smithi121.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T01:38:21.382 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T01:38:21.382 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T01:38:21.429 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T01:38:21.432 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T01:38:21.455 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T01:38:21.542 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T01:38:21.544 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-25T01:38:21.567 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T01:38:21.615 INFO:teuthology.orchestra.run.smithi121.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T01:38:21.617 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T01:38:21.640 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T01:38:21.727 INFO:teuthology.orchestra.run.smithi121.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T01:38:21.730 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-25T01:38:21.752 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T01:38:21.752 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T01:38:21.792 INFO:teuthology.orchestra.run.smithi077.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T01:38:21.804 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-25T01:38:21.843 INFO:teuthology.orchestra.run.smithi121.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-25T01:38:21.854 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T01:38:21.854 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi077.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi121.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T01:38:21.855 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T01:38:21.877 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T01:38:21.877 INFO:tasks.ceph:role: osd.0 2024-04-25T01:38:21.877 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T01:38:21.878 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T01:38:21.948 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T01:38:21.948 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T01:38:21.948 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T01:38:21.948 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T01:38:21.948 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T01:38:21.948 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-04-25T01:38:21.948 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T01:38:21.948 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T01:38:21.948 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T01:38:21.948 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T01:38:22.464 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-04-25T01:38:22.465 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-04-25T01:38:22.466 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T01:38:22.587 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T01:38:22.620 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T01:38:22.684 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T01:38:22.684 INFO:tasks.ceph:role: osd.1 2024-04-25T01:38:22.684 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T01:38:22.684 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T01:38:22.755 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T01:38:22.755 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T01:38:22.756 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T01:38:22.756 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T01:38:22.756 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T01:38:22.756 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-04-25T01:38:22.756 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T01:38:22.756 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T01:38:22.756 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T01:38:22.756 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T01:38:23.215 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-04-25T01:38:23.217 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-04-25T01:38:23.218 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T01:38:23.302 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T01:38:23.371 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T01:38:23.436 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T01:38:23.436 INFO:tasks.ceph:role: osd.2 2024-04-25T01:38:23.436 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T01:38:23.437 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T01:38:23.508 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T01:38:23.508 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T01:38:23.508 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T01:38:23.508 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T01:38:23.508 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T01:38:23.509 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-04-25T01:38:23.509 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T01:38:23.509 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T01:38:23.509 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T01:38:23.509 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T01:38:24.046 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-04-25T01:38:24.048 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-04-25T01:38:24.048 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T01:38:24.201 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T01:38:24.233 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T01:38:24.299 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T01:38:24.299 INFO:tasks.ceph:role: osd.3 2024-04-25T01:38:24.299 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T01:38:24.299 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T01:38:24.372 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T01:38:24.373 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T01:38:24.373 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T01:38:24.373 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T01:38:24.373 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T01:38:24.373 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-04-25T01:38:24.373 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T01:38:24.373 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T01:38:24.373 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T01:38:24.373 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T01:38:24.875 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-04-25T01:38:24.877 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-04-25T01:38:24.877 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T01:38:24.965 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T01:38:24.996 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T01:38:25.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:25.105+0000 7f7f57630640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T01:38:25.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:25.106+0000 7f7f57630640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T01:38:25.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:25.106+0000 7f7f57630640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T01:38:25.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:25.106+0000 7f7f57630640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T01:38:25.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:25.106+0000 7f7f57630640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T01:38:25.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:25.106+0000 7f7f57630640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T01:38:27.939 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T01:38:27.965 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T01:38:28.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:28.070+0000 7f9d00c0f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T01:38:28.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:28.071+0000 7f9d00c0f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T01:38:28.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:28.071+0000 7f9d00c0f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T01:38:28.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:28.071+0000 7f9d00c0f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T01:38:28.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:28.071+0000 7f9d00c0f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T01:38:28.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:28.071+0000 7f9d00c0f640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T01:38:30.898 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T01:38:30.923 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T01:38:31.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:31.027+0000 7fec5dc2e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T01:38:31.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:31.027+0000 7fec5dc2e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T01:38:31.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:31.027+0000 7fec5dc2e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T01:38:31.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:31.027+0000 7fec5dc2e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T01:38:31.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:31.027+0000 7fec5dc2e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T01:38:31.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:31.028+0000 7fec5dc2e640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T01:38:33.850 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T01:38:33.874 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T01:38:33.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:33.977+0000 7f2b36ba3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T01:38:33.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:33.977+0000 7f2b36ba3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T01:38:33.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:33.978+0000 7f2b36ba3640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T01:38:33.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:33.978+0000 7f2b36ba3640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T01:38:33.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:33.978+0000 7f2b36ba3640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T01:38:33.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:33.978+0000 7f2b36ba3640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T01:38:36.808 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T01:38:36.873 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T01:38:36.903 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T01:38:36.903 INFO:tasks.ceph:role: osd.4 2024-04-25T01:38:36.903 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi121.front.sepia.ceph.com 2024-04-25T01:38:36.904 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T01:38:36.978 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T01:38:36.978 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T01:38:36.978 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T01:38:36.978 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T01:38:36.978 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T01:38:36.978 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2024-04-25T01:38:36.979 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T01:38:36.979 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T01:38:36.979 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T01:38:36.979 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T01:38:37.497 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2024-04-25T01:38:37.499 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2024-04-25T01:38:37.500 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-25T01:38:37.622 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T01:38:37.653 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T01:38:37.717 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T01:38:37.717 INFO:tasks.ceph:role: osd.5 2024-04-25T01:38:37.717 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi121.front.sepia.ceph.com 2024-04-25T01:38:37.717 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T01:38:37.789 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T01:38:37.789 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T01:38:37.789 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T01:38:37.789 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T01:38:37.789 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T01:38:37.789 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2024-04-25T01:38:37.789 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T01:38:37.789 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T01:38:37.789 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T01:38:37.789 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T01:38:38.252 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2024-04-25T01:38:38.254 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2024-04-25T01:38:38.254 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-25T01:38:38.347 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T01:38:38.374 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-25T01:38:38.438 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T01:38:38.438 INFO:tasks.ceph:role: osd.6 2024-04-25T01:38:38.438 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi121.front.sepia.ceph.com 2024-04-25T01:38:38.438 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T01:38:38.509 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T01:38:38.509 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T01:38:38.509 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T01:38:38.509 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T01:38:38.510 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T01:38:38.510 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2024-04-25T01:38:38.510 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T01:38:38.510 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T01:38:38.510 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T01:38:38.510 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T01:38:38.995 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2024-04-25T01:38:38.997 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2024-04-25T01:38:38.998 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-25T01:38:39.144 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-25T01:38:39.174 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-25T01:38:39.237 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T01:38:39.237 INFO:tasks.ceph:role: osd.7 2024-04-25T01:38:39.237 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi121.front.sepia.ceph.com 2024-04-25T01:38:39.237 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T01:38:39.308 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T01:38:39.308 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T01:38:39.308 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T01:38:39.308 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T01:38:39.308 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T01:38:39.308 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2024-04-25T01:38:39.308 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T01:38:39.308 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T01:38:39.308 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T01:38:39.308 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T01:38:39.813 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2024-04-25T01:38:39.816 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2024-04-25T01:38:39.816 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-25T01:38:39.963 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-25T01:38:39.992 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T01:38:40.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:38:40.113+0000 7fa9ec72c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T01:38:40.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:38:40.113+0000 7fa9ec72c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T01:38:40.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:38:40.113+0000 7fa9ec72c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T01:38:40.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:38:40.113+0000 7fa9ec72c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T01:38:40.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:38:40.113+0000 7fa9ec72c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T01:38:40.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:38:40.114+0000 7fa9ec72c640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T01:38:42.941 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T01:38:42.969 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T01:38:43.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:38:43.076+0000 7fe29ec1a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T01:38:43.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:38:43.076+0000 7fe29ec1a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T01:38:43.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:38:43.076+0000 7fe29ec1a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T01:38:43.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:38:43.076+0000 7fe29ec1a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T01:38:43.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:38:43.076+0000 7fe29ec1a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T01:38:43.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:38:43.077+0000 7fe29ec1a640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T01:38:45.912 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T01:38:45.940 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T01:38:46.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:38:46.046+0000 7f0295b2c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-25T01:38:46.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:38:46.047+0000 7f0295b2c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-25T01:38:46.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:38:46.047+0000 7f0295b2c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T01:38:46.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:38:46.047+0000 7f0295b2c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T01:38:46.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:38:46.047+0000 7f0295b2c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T01:38:46.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:38:46.047+0000 7f0295b2c640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-25T01:38:48.888 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-25T01:38:48.914 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T01:38:48.925 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:38:48.932 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:38:49.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:38:49.020+0000 7fbf29a32640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-25T01:38:49.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:38:49.020+0000 7fbf29a32640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-25T01:38:49.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:38:49.020+0000 7fbf29a32640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T01:38:49.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:38:49.020+0000 7fbf29a32640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T01:38:49.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:38:49.020+0000 7fbf29a32640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T01:38:49.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:38:49.021+0000 7fbf29a32640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-25T01:38:51.863 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-25T01:38:51.890 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T01:38:51.891 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:38:51.891 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T01:38:51.919 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:38:51.919 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T01:38:51.987 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:38:51.987 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-25T01:38:52.054 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:38:52.054 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T01:38:52.120 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:38:52.120 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T01:38:52.186 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:38:52.186 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T01:38:52.251 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:38:52.251 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T01:38:52.316 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-25T01:38:52.316 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T01:38:52.345 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-25T01:38:52.345 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T01:38:52.415 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-25T01:38:52.415 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-25T01:38:52.481 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-25T01:38:52.481 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T01:38:52.548 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-25T01:38:52.548 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T01:38:52.614 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-25T01:38:52.614 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-25T01:38:52.680 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-25T01:38:52.680 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-25T01:38:52.745 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:38:52.746 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T01:38:52.763 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-25T01:38:52.763 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-25T01:38:52.801 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T01:38:52.801 DEBUG:teuthology.orchestra.run.smithi077:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T01:38:52.805 DEBUG:teuthology.orchestra.run.smithi121:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T01:38:52.845 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr.y] 2024-04-25T01:38:52.845 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQANtClmafswFBAAkvWn2WlUDpAyrrQQwjmqww== 2024-04-25T01:38:52.845 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.a] 2024-04-25T01:38:52.845 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQANtClmJ/roGhAA2b6L8paMdF8yjF/+UYZfvw== 2024-04-25T01:38:52.845 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.c] 2024-04-25T01:38:52.845 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQANtClmsEucIRAAtLtF4JqHoVBaoM0xpEGvKw== 2024-04-25T01:38:52.845 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.0] 2024-04-25T01:38:52.845 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQARtClm98ZfBhAAwj+mdpXc6Mobp0HoEDk5Lw== 2024-04-25T01:38:52.845 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.1] 2024-04-25T01:38:52.845 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAUtClmGhFLBBAAy+ZM2BMe/IWumi+3lMzewg== 2024-04-25T01:38:52.845 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.2] 2024-04-25T01:38:52.845 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAXtClm/yC1ARAAjrM8LR3wJUtQLluNudfpnQ== 2024-04-25T01:38:52.846 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.3] 2024-04-25T01:38:52.846 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAZtClmWEVXOhAAG3NNV7+/qkd+wi4O21FCoA== 2024-04-25T01:38:52.846 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr.x] 2024-04-25T01:38:52.846 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQANtClm63LmFxAA6+UUoHSJPv+v+lmvM52LZw== 2024-04-25T01:38:52.846 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.b] 2024-04-25T01:38:52.846 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQANtClmeyf1JRAA89ZMSY4UxoDZNgUKBfTF3A== 2024-04-25T01:38:52.846 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.d] 2024-04-25T01:38:52.846 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQANtClmjXSlLBAACguvv6GLF2pDAhfrLwSVHg== 2024-04-25T01:38:52.846 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.4] 2024-04-25T01:38:52.846 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAgtClmG9jXBhAAcXZLoUZ2i3r9TkZGb1ipig== 2024-04-25T01:38:52.846 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.5] 2024-04-25T01:38:52.846 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAjtClmZTukBBAACYY61jLlXKW5wn4rlkrklw== 2024-04-25T01:38:52.846 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.6] 2024-04-25T01:38:52.847 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAmtClmfZPfAhAAhqg5UWbDe3hGBXjOfo6Cyw== 2024-04-25T01:38:52.847 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.7] 2024-04-25T01:38:52.847 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAptClmqyc7ARAA1twoHvTDKfQ+gKiZed5YZA== 2024-04-25T01:38:52.847 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2024-04-25T01:38:52.847 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQANtClmQLeGMBAAZ/AwedwlGirU2EJL5rQcEg== 2024-04-25T01:38:52.847 INFO:teuthology.orchestra.run.smithi077.stdout:[client.1] 2024-04-25T01:38:52.847 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQANtClmdwqJMxAALxgjrSeOohbaW92dfp1qCw== 2024-04-25T01:38:52.864 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr.y] 2024-04-25T01:38:52.864 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQANtClmafswFBAAkvWn2WlUDpAyrrQQwjmqww== 2024-04-25T01:38:52.864 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.a] 2024-04-25T01:38:52.865 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQANtClmJ/roGhAA2b6L8paMdF8yjF/+UYZfvw== 2024-04-25T01:38:52.865 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.c] 2024-04-25T01:38:52.865 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQANtClmsEucIRAAtLtF4JqHoVBaoM0xpEGvKw== 2024-04-25T01:38:52.865 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.0] 2024-04-25T01:38:52.865 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQARtClm98ZfBhAAwj+mdpXc6Mobp0HoEDk5Lw== 2024-04-25T01:38:52.866 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.1] 2024-04-25T01:38:52.866 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAUtClmGhFLBBAAy+ZM2BMe/IWumi+3lMzewg== 2024-04-25T01:38:52.866 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.2] 2024-04-25T01:38:52.866 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAXtClm/yC1ARAAjrM8LR3wJUtQLluNudfpnQ== 2024-04-25T01:38:52.866 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.3] 2024-04-25T01:38:52.866 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAZtClmWEVXOhAAG3NNV7+/qkd+wi4O21FCoA== 2024-04-25T01:38:52.867 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr.x] 2024-04-25T01:38:52.867 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQANtClm63LmFxAA6+UUoHSJPv+v+lmvM52LZw== 2024-04-25T01:38:52.867 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.b] 2024-04-25T01:38:52.867 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQANtClmeyf1JRAA89ZMSY4UxoDZNgUKBfTF3A== 2024-04-25T01:38:52.867 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.d] 2024-04-25T01:38:52.867 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQANtClmjXSlLBAACguvv6GLF2pDAhfrLwSVHg== 2024-04-25T01:38:52.867 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.4] 2024-04-25T01:38:52.867 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAgtClmG9jXBhAAcXZLoUZ2i3r9TkZGb1ipig== 2024-04-25T01:38:52.868 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.5] 2024-04-25T01:38:52.868 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAjtClmZTukBBAACYY61jLlXKW5wn4rlkrklw== 2024-04-25T01:38:52.868 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.6] 2024-04-25T01:38:52.868 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAmtClmfZPfAhAAhqg5UWbDe3hGBXjOfo6Cyw== 2024-04-25T01:38:52.868 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.7] 2024-04-25T01:38:52.868 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAptClmqyc7ARAA1twoHvTDKfQ+gKiZed5YZA== 2024-04-25T01:38:52.868 INFO:teuthology.orchestra.run.smithi121.stdout:[client.0] 2024-04-25T01:38:52.868 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQANtClmQLeGMBAAZ/AwedwlGirU2EJL5rQcEg== 2024-04-25T01:38:52.869 INFO:teuthology.orchestra.run.smithi121.stdout:[client.1] 2024-04-25T01:38:52.869 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQANtClmdwqJMxAALxgjrSeOohbaW92dfp1qCw== 2024-04-25T01:38:52.870 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T01:38:52.891 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T01:38:52.960 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T01:38:52.962 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T01:38:53.014 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T01:38:53.016 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T01:38:53.067 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T01:38:53.070 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T01:38:53.118 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T01:38:53.121 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T01:38:53.170 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T01:38:53.172 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T01:38:53.220 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T01:38:53.223 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T01:38:53.271 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T01:38:53.274 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T01:38:53.321 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T01:38:53.323 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T01:38:53.374 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T01:38:53.376 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T01:38:53.427 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T01:38:53.429 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T01:38:53.477 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T01:38:53.480 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T01:38:53.528 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T01:38:53.530 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T01:38:53.578 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T01:38:53.580 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T01:38:53.629 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T01:38:53.631 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T01:38:53.681 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T01:38:53.684 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T01:38:53.735 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T01:38:53.736 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T01:38:53.759 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T01:38:53.853 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T01:38:53.877 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T01:38:53.901 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T01:38:53.995 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T01:38:54.018 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T01:38:54.082 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T01:38:54.175 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T01:38:54.198 DEBUG:teuthology.orchestra.run.smithi077:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T01:38:54.201 DEBUG:teuthology.orchestra.run.smithi121:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T01:38:54.253 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T01:38:54.253 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T01:38:54.253 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T01:38:54.256 INFO:tasks.ceph.mon.a:Started 2024-04-25T01:38:54.256 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T01:38:54.256 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T01:38:54.296 INFO:tasks.ceph.mon.b:Started 2024-04-25T01:38:54.296 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T01:38:54.296 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T01:38:54.298 INFO:tasks.ceph.mon.c:Started 2024-04-25T01:38:54.298 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T01:38:54.298 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T01:38:54.298 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T01:38:54.301 INFO:tasks.ceph.mgr.y:Started 2024-04-25T01:38:54.301 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T01:38:54.301 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T01:38:54.303 INFO:tasks.ceph.mgr.x:Started 2024-04-25T01:38:54.303 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T01:38:54.303 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T01:38:54.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.419+0000 7fa7cb3f9640 1 Processor -- start 2024-04-25T01:38:54.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.419+0000 7fa7cb3f9640 1 -- start start 2024-04-25T01:38:54.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.420+0000 7fa7cb3f9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa7c40c1cc0 0x7fa7c4156520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:38:54.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.420+0000 7fa7cb3f9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7c4156a60 0x7fa7c41608e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:38:54.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.420+0000 7fa7cb3f9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7c41539d0 con 0x7fa7c41535f0 2024-04-25T01:38:54.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.420+0000 7fa7cb3f9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa7c406b7c0 con 0x7fa7c40c1cc0 2024-04-25T01:38:54.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.420+0000 7fa7cb3f9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fa7c406e940 con 0x7fa7c4156a60 2024-04-25T01:38:54.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.420+0000 7fa7c8994640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa7c40c1cc0 0x7fa7c4156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:38:54.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.420+0000 7fa7c8994640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa7c40c1cc0 0x7fa7c4156520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54002/0 (socket says 172.21.15.77:54002) 2024-04-25T01:38:54.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.420+0000 7fa7c8994640 1 -- 172.21.15.77:0/453346272 learned_addr learned my addr 172.21.15.77:0/453346272 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:38:54.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.420+0000 7fa7c9195640 1 --1- 172.21.15.77:0/453346272 >> v1:172.21.15.77:6789/0 conn(0x7fa7c41535f0 0x7fa7c40c8550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46092/0 (socket says 172.21.15.77:46092) 2024-04-25T01:38:54.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.420+0000 7fa7c8994640 1 -- 172.21.15.77:0/453346272 >> v2:172.21.15.77:3300/0 conn(0x7fa7c40c1cc0 msgr2=0x7fa7c4156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T01:38:54.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.420+0000 7fa7c8994640 1 -- 172.21.15.77:0/453346272 >> v2:172.21.15.77:3300/0 conn(0x7fa7c40c1cc0 msgr2=0x7fa7c4156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T01:38:54.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.420+0000 7fa7c8994640 1 --2- 172.21.15.77:0/453346272 >> v2:172.21.15.77:3300/0 conn(0x7fa7c40c1cc0 0x7fa7c4156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T01:38:54.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.420+0000 7fa7c8994640 1 --2- 172.21.15.77:0/453346272 >> v2:172.21.15.77:3300/0 conn(0x7fa7c40c1cc0 0x7fa7c4156520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T01:38:54.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.420+0000 7fa7c9996640 1 --2- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7c4156a60 0x7fa7c41608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:38:54.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.420+0000 7fa7c9996640 1 -- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7c4156a60 msgr2=0x7fa7c41608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T01:38:54.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.420+0000 7fa7c9996640 1 -- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7c4156a60 msgr2=0x7fa7c41608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T01:38:54.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.420+0000 7fa7c9996640 1 --2- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7c4156a60 0x7fa7c41608e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T01:38:54.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.420+0000 7fa7c9996640 1 --2- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7c4156a60 0x7fa7c41608e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T01:38:54.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.621+0000 7fa7c8994640 1 --2- 172.21.15.77:0/453346272 >> v2:172.21.15.77:3300/0 conn(0x7fa7c40c1cc0 0x7fa7c4156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:38:54.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.621+0000 7fa7c8994640 1 -- 172.21.15.77:0/453346272 >> v2:172.21.15.77:3300/0 conn(0x7fa7c40c1cc0 msgr2=0x7fa7c4156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T01:38:54.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.621+0000 7fa7c8994640 1 -- 172.21.15.77:0/453346272 >> v2:172.21.15.77:3300/0 conn(0x7fa7c40c1cc0 msgr2=0x7fa7c4156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T01:38:54.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.621+0000 7fa7c8994640 1 --2- 172.21.15.77:0/453346272 >> v2:172.21.15.77:3300/0 conn(0x7fa7c40c1cc0 0x7fa7c4156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T01:38:54.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.621+0000 7fa7c8994640 1 --2- 172.21.15.77:0/453346272 >> v2:172.21.15.77:3300/0 conn(0x7fa7c40c1cc0 0x7fa7c4156520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T01:38:54.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.621+0000 7fa7c9996640 1 --2- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7c4156a60 0x7fa7c41608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:38:54.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.621+0000 7fa7c9996640 1 -- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7c4156a60 msgr2=0x7fa7c41608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T01:38:54.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.621+0000 7fa7c9996640 1 -- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7c4156a60 msgr2=0x7fa7c41608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T01:38:54.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.621+0000 7fa7c9996640 1 --2- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7c4156a60 0x7fa7c41608e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T01:38:54.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:54.621+0000 7fa7c9996640 1 --2- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7c4156a60 0x7fa7c41608e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T01:38:55.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:55.022+0000 7fa7c8994640 1 --2- 172.21.15.77:0/453346272 >> v2:172.21.15.77:3300/0 conn(0x7fa7c40c1cc0 0x7fa7c4156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:38:55.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:55.022+0000 7fa7c8994640 1 -- 172.21.15.77:0/453346272 >> v2:172.21.15.77:3300/0 conn(0x7fa7c40c1cc0 msgr2=0x7fa7c4156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T01:38:55.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:55.022+0000 7fa7c8994640 1 -- 172.21.15.77:0/453346272 >> v2:172.21.15.77:3300/0 conn(0x7fa7c40c1cc0 msgr2=0x7fa7c4156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T01:38:55.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:55.022+0000 7fa7c8994640 1 --2- 172.21.15.77:0/453346272 >> v2:172.21.15.77:3300/0 conn(0x7fa7c40c1cc0 0x7fa7c4156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T01:38:55.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:55.022+0000 7fa7c8994640 1 --2- 172.21.15.77:0/453346272 >> v2:172.21.15.77:3300/0 conn(0x7fa7c40c1cc0 0x7fa7c4156520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T01:38:55.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:55.022+0000 7fa7c9996640 1 --2- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7c4156a60 0x7fa7c41608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:38:55.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:55.022+0000 7fa7c9996640 1 -- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7c4156a60 msgr2=0x7fa7c41608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T01:38:55.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:55.022+0000 7fa7c9996640 1 -- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7c4156a60 msgr2=0x7fa7c41608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T01:38:55.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:55.022+0000 7fa7c9996640 1 --2- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7c4156a60 0x7fa7c41608e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T01:38:55.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:55.022+0000 7fa7c9996640 1 --2- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7c4156a60 0x7fa7c41608e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T01:38:55.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:55.823+0000 7fa7c8994640 1 --2- 172.21.15.77:0/453346272 >> v2:172.21.15.77:3300/0 conn(0x7fa7c40c1cc0 0x7fa7c4156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:38:55.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:55.823+0000 7fa7c8994640 1 -- 172.21.15.77:0/453346272 >> v2:172.21.15.77:3300/0 conn(0x7fa7c40c1cc0 msgr2=0x7fa7c4156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T01:38:55.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:55.823+0000 7fa7c8994640 1 -- 172.21.15.77:0/453346272 >> v2:172.21.15.77:3300/0 conn(0x7fa7c40c1cc0 msgr2=0x7fa7c4156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T01:38:55.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:55.823+0000 7fa7c8994640 1 --2- 172.21.15.77:0/453346272 >> v2:172.21.15.77:3300/0 conn(0x7fa7c40c1cc0 0x7fa7c4156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T01:38:55.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:55.823+0000 7fa7c8994640 1 --2- 172.21.15.77:0/453346272 >> v2:172.21.15.77:3300/0 conn(0x7fa7c40c1cc0 0x7fa7c4156520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T01:38:55.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:55.823+0000 7fa7c9996640 1 --2- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7c4156a60 0x7fa7c41608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:38:55.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:55.823+0000 7fa7c9996640 1 -- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7c4156a60 msgr2=0x7fa7c41608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T01:38:55.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:55.823+0000 7fa7c9996640 1 -- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7c4156a60 msgr2=0x7fa7c41608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T01:38:55.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:55.823+0000 7fa7c9996640 1 --2- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7c4156a60 0x7fa7c41608e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T01:38:55.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:55.823+0000 7fa7c9996640 1 --2- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7c4156a60 0x7fa7c41608e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T01:38:57.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:57.420+0000 7fa7baffd640 1 -- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7c4156a60 msgr2=0x7fa7c41608e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T01:38:57.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:57.420+0000 7fa7baffd640 1 --2- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7c4156a60 0x7fa7c41608e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:38:57.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:57.420+0000 7fa7baffd640 1 -- 172.21.15.77:0/453346272 >> v2:172.21.15.77:3300/0 conn(0x7fa7c40c1cc0 msgr2=0x7fa7c4156520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T01:38:57.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:57.420+0000 7fa7baffd640 1 --2- 172.21.15.77:0/453346272 >> v2:172.21.15.77:3300/0 conn(0x7fa7c40c1cc0 0x7fa7c4156520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:38:57.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:57.420+0000 7fa7baffd640 1 -- 172.21.15.77:0/453346272 >> v1:172.21.15.77:6789/0 conn(0x7fa7c41535f0 legacy=0x7fa7c40c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:38:57.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:57.420+0000 7fa7baffd640 1 --2- 172.21.15.77:0/453346272 >> v2:172.21.15.121:3300/0 conn(0x7fa7a8007350 0x7fa7a8009810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:38:57.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:57.420+0000 7fa7baffd640 1 -- 172.21.15.77:0/453346272 --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7c4156070 con 0x7fa7a80036e0 2024-04-25T01:38:57.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:57.420+0000 7fa7baffd640 1 -- 172.21.15.77:0/453346272 --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fa7c406b7c0 con 0x7fa7a8007350 2024-04-25T01:38:57.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:57.420+0000 7fa7c8994640 1 --2- 172.21.15.77:0/453346272 >> v2:172.21.15.121:3300/0 conn(0x7fa7a8007350 0x7fa7a8009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:38:57.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:57.420+0000 7fa7c8994640 1 -- 172.21.15.77:0/453346272 >> v2:172.21.15.121:3300/0 conn(0x7fa7a8007350 msgr2=0x7fa7a8009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T01:38:57.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:57.420+0000 7fa7c8994640 1 -- 172.21.15.77:0/453346272 >> v2:172.21.15.121:3300/0 conn(0x7fa7a8007350 msgr2=0x7fa7a8009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T01:38:57.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:57.420+0000 7fa7c8994640 1 --2- 172.21.15.77:0/453346272 >> v2:172.21.15.121:3300/0 conn(0x7fa7a8007350 0x7fa7a8009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T01:38:57.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:57.420+0000 7fa7c8994640 1 --2- 172.21.15.77:0/453346272 >> v2:172.21.15.121:3300/0 conn(0x7fa7a8007350 0x7fa7a8009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T01:38:57.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:57.621+0000 7fa7c8994640 1 --2- 172.21.15.77:0/453346272 >> v2:172.21.15.121:3300/0 conn(0x7fa7a8007350 0x7fa7a8009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:38:57.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:57.621+0000 7fa7c8994640 1 -- 172.21.15.77:0/453346272 >> v2:172.21.15.121:3300/0 conn(0x7fa7a8007350 msgr2=0x7fa7a8009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T01:38:57.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:57.621+0000 7fa7c8994640 1 -- 172.21.15.77:0/453346272 >> v2:172.21.15.121:3300/0 conn(0x7fa7a8007350 msgr2=0x7fa7a8009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T01:38:57.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:57.621+0000 7fa7c8994640 1 --2- 172.21.15.77:0/453346272 >> v2:172.21.15.121:3300/0 conn(0x7fa7a8007350 0x7fa7a8009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T01:38:57.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:57.621+0000 7fa7c8994640 1 --2- 172.21.15.77:0/453346272 >> v2:172.21.15.121:3300/0 conn(0x7fa7a8007350 0x7fa7a8009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T01:38:58.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:58.022+0000 7fa7c8994640 1 --2- 172.21.15.77:0/453346272 >> v2:172.21.15.121:3300/0 conn(0x7fa7a8007350 0x7fa7a8009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:38:58.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:58.022+0000 7fa7c8994640 1 -- 172.21.15.77:0/453346272 >> v2:172.21.15.121:3300/0 conn(0x7fa7a8007350 msgr2=0x7fa7a8009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T01:38:58.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:58.022+0000 7fa7c8994640 1 -- 172.21.15.77:0/453346272 >> v2:172.21.15.121:3300/0 conn(0x7fa7a8007350 msgr2=0x7fa7a8009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T01:38:58.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:58.022+0000 7fa7c8994640 1 --2- 172.21.15.77:0/453346272 >> v2:172.21.15.121:3300/0 conn(0x7fa7a8007350 0x7fa7a8009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T01:38:58.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:58.022+0000 7fa7c8994640 1 --2- 172.21.15.77:0/453346272 >> v2:172.21.15.121:3300/0 conn(0x7fa7a8007350 0x7fa7a8009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T01:38:58.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:58.823+0000 7fa7c8994640 1 --2- 172.21.15.77:0/453346272 >> v2:172.21.15.121:3300/0 conn(0x7fa7a8007350 0x7fa7a8009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:38:58.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:58.824+0000 7fa7c8994640 1 -- 172.21.15.77:0/453346272 >> v2:172.21.15.121:3300/0 conn(0x7fa7a8007350 msgr2=0x7fa7a8009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T01:38:58.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:58.824+0000 7fa7c8994640 1 -- 172.21.15.77:0/453346272 >> v2:172.21.15.121:3300/0 conn(0x7fa7a8007350 msgr2=0x7fa7a8009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T01:38:58.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:58.824+0000 7fa7c8994640 1 --2- 172.21.15.77:0/453346272 >> v2:172.21.15.121:3300/0 conn(0x7fa7a8007350 0x7fa7a8009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T01:38:58.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:58.824+0000 7fa7c8994640 1 --2- 172.21.15.77:0/453346272 >> v2:172.21.15.121:3300/0 conn(0x7fa7a8007350 0x7fa7a8009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T01:38:59.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.595+0000 7fa7bbfff640 1 -- 172.21.15.77:0/453346272 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 205693604 0 0) 0x7fa7c4156070 con 0x7fa7a80036e0 2024-04-25T01:38:59.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.595+0000 7fa7bbfff640 1 -- 172.21.15.77:0/453346272 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7b0003520 con 0x7fa7a80036e0 2024-04-25T01:38:59.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.595+0000 7fa7bbfff640 1 -- 172.21.15.77:0/453346272 <== mon.1 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2641858578 0 0) 0x7fa7b0003520 con 0x7fa7a80036e0 2024-04-25T01:38:59.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.595+0000 7fa7bbfff640 1 -- 172.21.15.77:0/453346272 >> v2:172.21.15.121:3300/0 conn(0x7fa7a8007350 msgr2=0x7fa7a8009810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T01:38:59.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.595+0000 7fa7bbfff640 1 --2- 172.21.15.77:0/453346272 >> v2:172.21.15.121:3300/0 conn(0x7fa7a8007350 0x7fa7a8009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:38:59.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.595+0000 7fa7bbfff640 1 -- 172.21.15.77:0/453346272 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7a800af70 con 0x7fa7a80036e0 2024-04-25T01:38:59.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.595+0000 7fa7bbfff640 1 -- 172.21.15.77:0/453346272 <== mon.1 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7fa7c00016f0 con 0x7fa7a80036e0 2024-04-25T01:38:59.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.595+0000 7fa7bbfff640 1 -- 172.21.15.77:0/453346272 >> v1:172.21.15.121:6789/0 conn(0x7fa7a80036e0 legacy=0x7fa7a8005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:38:59.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.595+0000 7fa7c9996640 1 -- 172.21.15.77:0/453346272 reap_dead start 2024-04-25T01:38:59.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.595+0000 7fa7bbfff640 1 --2- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7b0003a00 0x7fa7b0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:38:59.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.595+0000 7fa7bbfff640 1 --2- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7b0004800 0x7fa7b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:38:59.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.595+0000 7fa7bbfff640 1 --2- 172.21.15.77:0/453346272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7b00053c0 0x7fa7b000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:38:59.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.595+0000 7fa7bbfff640 1 -- 172.21.15.77:0/453346272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c406b7c0 con 0x7fa7b00053c0 2024-04-25T01:38:59.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.595+0000 7fa7bbfff640 1 -- 172.21.15.77:0/453346272 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b000c280 con 0x7fa7b0003a00 2024-04-25T01:38:59.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.595+0000 7fa7bbfff640 1 -- 172.21.15.77:0/453346272 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fa7b000c480 con 0x7fa7b0004800 2024-04-25T01:38:59.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.596+0000 7fa7c8994640 1 --2- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7b0004800 0x7fa7b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:38:59.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.596+0000 7fa7c9996640 1 --2- 172.21.15.77:0/453346272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7b00053c0 0x7fa7b000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:38:59.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.596+0000 7fa7c9195640 1 --2- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7b0003a00 0x7fa7b0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:38:59.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.596+0000 7fa7c9996640 1 -- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7b0004800 msgr2=0x7fa7b0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:38:59.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.596+0000 7fa7c9996640 1 --2- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7b0004800 0x7fa7b0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:38:59.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.596+0000 7fa7c9996640 1 -- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7b0003a00 msgr2=0x7fa7b0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:38:59.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.596+0000 7fa7c9996640 1 --2- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7b0003a00 0x7fa7b0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:38:59.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.596+0000 7fa7c9996640 1 -- 172.21.15.77:0/453346272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b0003520 con 0x7fa7b00053c0 2024-04-25T01:38:59.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.597+0000 7fa7c9996640 1 --2- 172.21.15.77:0/453346272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7b00053c0 0x7fa7b000b9c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40c60a0 tx=0x7fa7b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5167aa4a141c717d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:38:59.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.597+0000 7fa7bbfff640 1 -- 172.21.15.77:0/453346272 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc031070 con 0x7fa7b00053c0 2024-04-25T01:38:59.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.597+0000 7fa7bbfff640 1 -- 172.21.15.77:0/453346272 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7bc02b800 con 0x7fa7b00053c0 2024-04-25T01:38:59.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.597+0000 7fa7bbfff640 1 -- 172.21.15.77:0/453346272 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc003dd0 con 0x7fa7b00053c0 2024-04-25T01:38:59.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.598+0000 7fa7cb3f9640 1 -- 172.21.15.77:0/453346272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7b00053c0 msgr2=0x7fa7b000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:38:59.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.598+0000 7fa7cb3f9640 1 --2- 172.21.15.77:0/453346272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7b00053c0 0x7fa7b000b9c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40c60a0 tx=0x7fa7b0005830 comp rx=0 tx=0).stop 2024-04-25T01:38:59.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.598+0000 7fa7cb3f9640 1 -- 172.21.15.77:0/453346272 shutdown_connections 2024-04-25T01:38:59.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.598+0000 7fa7cb3f9640 1 --2- 172.21.15.77:0/453346272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7b00053c0 0x7fa7b000b9c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:38:59.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.598+0000 7fa7cb3f9640 1 --2- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7b0004800 0x7fa7b0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:38:59.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.598+0000 7fa7cb3f9640 1 --2- 172.21.15.77:0/453346272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7b0003a00 0x7fa7b0003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:38:59.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.598+0000 7fa7cb3f9640 1 -- 172.21.15.77:0/453346272 >> 172.21.15.77:0/453346272 conn(0x7fa7c40674d0 msgr2=0x7fa7c40aa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:38:59.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.598+0000 7fa7cb3f9640 1 -- 172.21.15.77:0/453346272 shutdown_connections 2024-04-25T01:38:59.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.598+0000 7fa7cb3f9640 1 -- 172.21.15.77:0/453346272 wait complete. 2024-04-25T01:38:59.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.600+0000 7fa7cb3f9640 1 Processor -- start 2024-04-25T01:38:59.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.600+0000 7fa7cb3f9640 1 -- start start 2024-04-25T01:38:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.600+0000 7fa7cb3f9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7b0003a00 0x7fa7c40ac210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:38:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.601+0000 7fa7cb3f9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7b0004800 0x7fa7c414df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:38:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.601+0000 7fa7cb3f9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7b00053c0 0x7fa7c4159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:38:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.601+0000 7fa7cb3f9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c40c19f0 con 0x7fa7b0003a00 2024-04-25T01:38:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.601+0000 7fa7cb3f9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c406bc40 con 0x7fa7b0004800 2024-04-25T01:38:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.601+0000 7fa7cb3f9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fa7c406ef00 con 0x7fa7b00053c0 2024-04-25T01:38:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.601+0000 7fa7c9195640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7b0003a00 0x7fa7c40ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:38:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.601+0000 7fa7c8994640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7b0004800 0x7fa7c414df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:38:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.601+0000 7fa7c9195640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7b0003a00 0x7fa7c40ac210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49436/0 (socket says 172.21.15.77:49436) 2024-04-25T01:38:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.601+0000 7fa7c9195640 1 -- 172.21.15.77:0/1403726748 learned_addr learned my addr 172.21.15.77:0/1403726748 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:38:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.601+0000 7fa7c9996640 1 --2- 172.21.15.77:0/1403726748 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7b00053c0 0x7fa7c4159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:38:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.601+0000 7fa7c9195640 1 -- 172.21.15.77:0/1403726748 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7b00053c0 msgr2=0x7fa7c4159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:38:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.601+0000 7fa7c9195640 1 --2- 172.21.15.77:0/1403726748 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7b00053c0 0x7fa7c4159930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:38:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.601+0000 7fa7c9195640 1 -- 172.21.15.77:0/1403726748 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7b0004800 msgr2=0x7fa7c414df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:38:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.601+0000 7fa7c9195640 1 --2- 172.21.15.77:0/1403726748 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7b0004800 0x7fa7c414df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:38:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.601+0000 7fa7c9195640 1 -- 172.21.15.77:0/1403726748 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c4157730 con 0x7fa7b0003a00 2024-04-25T01:38:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.601+0000 7fa7c9195640 1 --2- 172.21.15.77:0/1403726748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7b0003a00 0x7fa7c40ac210 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0007740 tx=0x7fa7c0004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:38:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.602+0000 7fa7b9ffb640 1 -- 172.21.15.77:0/1403726748 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0004e00 con 0x7fa7b0003a00 2024-04-25T01:38:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.602+0000 7fa7b9ffb640 1 -- 172.21.15.77:0/1403726748 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7c0018070 con 0x7fa7b0003a00 2024-04-25T01:38:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.602+0000 7fa7cb3f9640 1 -- 172.21.15.77:0/1403726748 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7c4157e90 con 0x7fa7b0003a00 2024-04-25T01:38:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.602+0000 7fa7b9ffb640 1 -- 172.21.15.77:0/1403726748 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c000fb80 con 0x7fa7b0003a00 2024-04-25T01:38:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.603+0000 7fa7b9ffb640 1 -- 172.21.15.77:0/1403726748 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa7c000fd20 con 0x7fa7b0003a00 2024-04-25T01:38:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.603+0000 7fa7cb3f9640 1 -- 172.21.15.77:0/1403726748 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7c40adaf0 con 0x7fa7b0003a00 2024-04-25T01:38:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.603+0000 7fa7b9ffb640 1 -- 172.21.15.77:0/1403726748 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa7c0013760 con 0x7fa7b0003a00 2024-04-25T01:38:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.604+0000 7fa7cb3f9640 1 -- 172.21.15.77:0/1403726748 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7c404f500 con 0x7fa7b0003a00 2024-04-25T01:38:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.606+0000 7fa7b9ffb640 1 -- 172.21.15.77:0/1403726748 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fa7c0023020 con 0x7fa7b0003a00 2024-04-25T01:38:59.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.675+0000 7fa7cb3f9640 1 -- 172.21.15.77:0/1403726748 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fa7c40abe30 con 0x7fa7b0003a00 2024-04-25T01:38:59.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.678+0000 7fa7b9ffb640 1 -- 172.21.15.77:0/1403726748 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fa7c00139b0 con 0x7fa7b0003a00 2024-04-25T01:38:59.660 INFO:teuthology.orchestra.run.smithi077.stderr:adjusted tunables profile to default 2024-04-25T01:38:59.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.679+0000 7fa7cb3f9640 1 -- 172.21.15.77:0/1403726748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7b0003a00 msgr2=0x7fa7c40ac210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:38:59.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.679+0000 7fa7cb3f9640 1 --2- 172.21.15.77:0/1403726748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7b0003a00 0x7fa7c40ac210 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0007740 tx=0x7fa7c0004bb0 comp rx=0 tx=0).stop 2024-04-25T01:38:59.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.679+0000 7fa7cb3f9640 1 -- 172.21.15.77:0/1403726748 shutdown_connections 2024-04-25T01:38:59.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.679+0000 7fa7cb3f9640 1 --2- 172.21.15.77:0/1403726748 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7b00053c0 0x7fa7c4159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:38:59.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.679+0000 7fa7cb3f9640 1 --2- 172.21.15.77:0/1403726748 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7b0004800 0x7fa7c414df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:38:59.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.679+0000 7fa7cb3f9640 1 --2- 172.21.15.77:0/1403726748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7b0003a00 0x7fa7c40ac210 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:38:59.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.679+0000 7fa7cb3f9640 1 -- 172.21.15.77:0/1403726748 >> 172.21.15.77:0/1403726748 conn(0x7fa7c40674d0 msgr2=0x7fa7c40aa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:38:59.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.679+0000 7fa7cb3f9640 1 -- 172.21.15.77:0/1403726748 shutdown_connections 2024-04-25T01:38:59.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:38:59.679+0000 7fa7cb3f9640 1 -- 172.21.15.77:0/1403726748 wait complete. 2024-04-25T01:38:59.672 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T01:38:59.672 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T01:38:59.672 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:38:59.672 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T01:38:59.690 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-25T01:38:59.709+0000 7fd6dadce040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T01:38:59.696 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:38:59.696 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T01:38:59.697 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T01:38:59.715+0000 7f86b720e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T01:38:59.719 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:38:59.719 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T01:38:59.782 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:38:59.782 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T01:38:59.833 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-25T01:38:59.853+0000 7fd6dadce040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T01:38:59.845 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-25T01:38:59.846 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T01:38:59.848 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T01:38:59.867+0000 7f86b720e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T01:38:59.870 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-25T01:38:59.870 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T01:38:59.889 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-25T01:38:59.908+0000 7fd6dadce040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T01:38:59.903 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T01:38:59.922+0000 7f86b720e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T01:38:59.912 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-25T01:38:59.912 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-25T01:38:59.975 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-25T01:38:59.976 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-25T01:39:00.039 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b 0 2024-04-25T01:39:00.129 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-25T01:39:00.148+0000 7fd6dadce040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T01:39:00.148 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T01:39:00.166+0000 7f86b720e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T01:39:00.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.194+0000 7f2092f84640 1 Processor -- start 2024-04-25T01:39:00.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.194+0000 7f2092f84640 1 -- start start 2024-04-25T01:39:00.175 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-25T01:39:00.195+0000 7fd6dadce040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T01:39:00.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.195+0000 7f2092f84640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f208c150430 0x7f208c153810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:00.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.195+0000 7f2092f84640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f208c0c3050 0x7f208c0ab670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:00.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.195+0000 7f2092f84640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f208c06ef70 con 0x7f208c1541b0 2024-04-25T01:39:00.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.195+0000 7f2092f84640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f208c06ed20 con 0x7f208c0c3050 2024-04-25T01:39:00.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.195+0000 7f2092f84640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f208c153380 con 0x7f208c150430 2024-04-25T01:39:00.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.195+0000 7f2091521640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f208c1541b0 0x7f208c0c8550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:53264/0 (socket says 172.21.15.121:53264) 2024-04-25T01:39:00.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.195+0000 7f2091521640 1 -- 172.21.15.121:0/1062360642 learned_addr learned my addr 172.21.15.121:0/1062360642 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-04-25T01:39:00.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.195+0000 7f2090d20640 1 --2- 172.21.15.121:0/1062360642 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f208c150430 0x7f208c153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:00.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.195+0000 7f208bfff640 1 --2- 172.21.15.121:0/1062360642 >> v2:172.21.15.77:3300/0 conn(0x7f208c0c3050 0x7f208c0ab670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:00.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.195+0000 7f208b7fe640 1 -- 172.21.15.121:0/1062360642 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 801380163 0 0) 0x7f208c06ef70 con 0x7f208c1541b0 2024-04-25T01:39:00.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.195+0000 7f208b7fe640 1 -- 172.21.15.121:0/1062360642 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f207c003520 con 0x7f208c1541b0 2024-04-25T01:39:00.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.195+0000 7f2090d20640 1 -- 172.21.15.121:0/1062360642 >> v2:172.21.15.77:3300/0 conn(0x7f208c0c3050 msgr2=0x7f208c0ab670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:00.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.195+0000 7f2090d20640 1 --2- 172.21.15.121:0/1062360642 >> v2:172.21.15.77:3300/0 conn(0x7f208c0c3050 0x7f208c0ab670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.195+0000 7f2090d20640 1 -- 172.21.15.121:0/1062360642 >> v1:172.21.15.121:6789/0 conn(0x7f208c1541b0 legacy=0x7f208c0c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:00.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.195+0000 7f2090d20640 1 -- 172.21.15.121:0/1062360642 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f208c06f250 con 0x7f208c150430 2024-04-25T01:39:00.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.196+0000 7f2090d20640 1 --2- 172.21.15.121:0/1062360642 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f208c150430 0x7f208c153810 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f20800097a0 tx=0x7f208002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3a2123d5c3183ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:00.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.196+0000 7f208b7fe640 1 -- 172.21.15.121:0/1062360642 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2080037070 con 0x7f208c150430 2024-04-25T01:39:00.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.196+0000 7f208b7fe640 1 -- 172.21.15.121:0/1062360642 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f208002ae50 con 0x7f208c150430 2024-04-25T01:39:00.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.196+0000 7f208b7fe640 1 -- 172.21.15.121:0/1062360642 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2080032660 con 0x7f208c150430 2024-04-25T01:39:00.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.197+0000 7f2092f84640 1 -- 172.21.15.121:0/1062360642 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f208c150430 msgr2=0x7f208c153810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:00.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.197+0000 7f2092f84640 1 --2- 172.21.15.121:0/1062360642 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f208c150430 0x7f208c153810 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f20800097a0 tx=0x7f208002a100 comp rx=0 tx=0).stop 2024-04-25T01:39:00.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.197+0000 7f2092f84640 1 -- 172.21.15.121:0/1062360642 shutdown_connections 2024-04-25T01:39:00.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.197+0000 7f2092f84640 1 --2- 172.21.15.121:0/1062360642 >> v2:172.21.15.77:3300/0 conn(0x7f208c0c3050 0x7f208c0ab670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.197+0000 7f2092f84640 1 --2- 172.21.15.121:0/1062360642 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f208c150430 0x7f208c153810 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.197+0000 7f2092f84640 1 -- 172.21.15.121:0/1062360642 >> 172.21.15.121:0/1062360642 conn(0x7f208c0674d0 msgr2=0x7f208c0aa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:00.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.197+0000 7f2092f84640 1 -- 172.21.15.121:0/1062360642 shutdown_connections 2024-04-25T01:39:00.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.197+0000 7f2092f84640 1 -- 172.21.15.121:0/1062360642 wait complete. 2024-04-25T01:39:00.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.198+0000 7f2092f84640 1 Processor -- start 2024-04-25T01:39:00.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.198+0000 7f2092f84640 1 -- start start 2024-04-25T01:39:00.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.199+0000 7f2092f84640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f208c0c3050 0x7f208c14c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:00.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.199+0000 7f2092f84640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f208c150430 0x7f208c1df6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:00.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.199+0000 7f2092f84640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f208c1541b0 0x7f208c1dfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:00.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.199+0000 7f2092f84640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f208c152cc0 con 0x7f208c1541b0 2024-04-25T01:39:00.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.199+0000 7f2092f84640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f208c0abbb0 con 0x7f208c0c3050 2024-04-25T01:39:00.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.199+0000 7f2092f84640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f208c0c8c60 con 0x7f208c150430 2024-04-25T01:39:00.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.199+0000 7f208bfff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f208c150430 0x7f208c1df6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:00.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.199+0000 7f2090d20640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f208c0c3050 0x7f208c14c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:00.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.199+0000 7f208bfff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f208c150430 0x7f208c1df6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.121:59910/0 (socket says 172.21.15.121:59910) 2024-04-25T01:39:00.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.199+0000 7f208bfff640 1 -- 172.21.15.121:0/3547858640 learned_addr learned my addr 172.21.15.121:0/3547858640 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-04-25T01:39:00.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.199+0000 7f2091521640 1 --2- 172.21.15.121:0/3547858640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f208c1541b0 0x7f208c1dfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:00.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.199+0000 7f2090d20640 1 -- 172.21.15.121:0/3547858640 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f208c150430 msgr2=0x7f208c1df6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:00.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.199+0000 7f2090d20640 1 --2- 172.21.15.121:0/3547858640 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f208c150430 0x7f208c1df6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.199+0000 7f2090d20640 1 -- 172.21.15.121:0/3547858640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f208c1541b0 msgr2=0x7f208c1dfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:00.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.199+0000 7f2090d20640 1 --2- 172.21.15.121:0/3547858640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f208c1541b0 0x7f208c1dfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.199+0000 7f2090d20640 1 -- 172.21.15.121:0/3547858640 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f208c1ebe20 con 0x7f208c0c3050 2024-04-25T01:39:00.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.199+0000 7f208bfff640 1 --2- 172.21.15.121:0/3547858640 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f208c150430 0x7f208c1df6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:00.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.199+0000 7f2090d20640 1 --2- 172.21.15.121:0/3547858640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f208c0c3050 0x7f208c14c5a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2080031000 tx=0x7f20800046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:00.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.200+0000 7f20897fa640 1 -- 172.21.15.121:0/3547858640 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2080041070 con 0x7f208c0c3050 2024-04-25T01:39:00.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.200+0000 7f20897fa640 1 -- 172.21.15.121:0/3547858640 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f208003c460 con 0x7f208c0c3050 2024-04-25T01:39:00.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.200+0000 7f2092f84640 1 -- 172.21.15.121:0/3547858640 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f208c1ec100 con 0x7f208c0c3050 2024-04-25T01:39:00.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.200+0000 7f20897fa640 1 -- 172.21.15.121:0/3547858640 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2080037040 con 0x7f208c0c3050 2024-04-25T01:39:00.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.200+0000 7f2092f84640 1 -- 172.21.15.121:0/3547858640 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f208c1ec6c0 con 0x7f208c0c3050 2024-04-25T01:39:00.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.200+0000 7f20897fa640 1 -- 172.21.15.121:0/3547858640 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f208003a070 con 0x7f208c0c3050 2024-04-25T01:39:00.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.200+0000 7f20897fa640 1 -- 172.21.15.121:0/3547858640 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f2080045680 con 0x7f208c0c3050 2024-04-25T01:39:00.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.201+0000 7f2092f84640 1 -- 172.21.15.121:0/3547858640 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f208c1ecaa0 con 0x7f208c0c3050 2024-04-25T01:39:00.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.203+0000 7f20897fa640 1 -- 172.21.15.121:0/3547858640 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f208c1ecaa0 con 0x7f208c0c3050 2024-04-25T01:39:00.193 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T01:39:00.212+0000 7f86b720e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T01:39:00.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.275+0000 7f2092f84640 1 -- 172.21.15.121:0/3547858640 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b", "id": 0} v 0) -- 0x7f208c04f500 con 0x7f208c0c3050 2024-04-25T01:39:00.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.278+0000 7f20897fa640 1 -- 172.21.15.121:0/3547858640 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f20800458d0 con 0x7f208c0c3050 2024-04-25T01:39:00.259 INFO:teuthology.orchestra.run.smithi121.stdout:0 2024-04-25T01:39:00.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.279+0000 7f2092f84640 1 -- 172.21.15.121:0/3547858640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f208c0c3050 msgr2=0x7f208c14c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:00.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.279+0000 7f2092f84640 1 --2- 172.21.15.121:0/3547858640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f208c0c3050 0x7f208c14c5a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2080031000 tx=0x7f20800046c0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.279+0000 7f2092f84640 1 -- 172.21.15.121:0/3547858640 shutdown_connections 2024-04-25T01:39:00.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.279+0000 7f2092f84640 1 --2- 172.21.15.121:0/3547858640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f208c1541b0 0x7f208c1dfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.279+0000 7f2092f84640 1 --2- 172.21.15.121:0/3547858640 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f208c150430 0x7f208c1df6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.279+0000 7f2092f84640 1 --2- 172.21.15.121:0/3547858640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f208c0c3050 0x7f208c14c5a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.279+0000 7f2092f84640 1 -- 172.21.15.121:0/3547858640 >> 172.21.15.121:0/3547858640 conn(0x7f208c0674d0 msgr2=0x7f208c0ad2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:00.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.279+0000 7f2092f84640 1 -- 172.21.15.121:0/3547858640 shutdown_connections 2024-04-25T01:39:00.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.279+0000 7f2092f84640 1 -- 172.21.15.121:0/3547858640 wait complete. 2024-04-25T01:39:00.270 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 6875d6d8-0333-44a3-b953-d26a412bbd71 1 2024-04-25T01:39:00.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.385+0000 7eff7f8a5640 1 Processor -- start 2024-04-25T01:39:00.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.386+0000 7eff7f8a5640 1 -- start start 2024-04-25T01:39:00.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.386+0000 7eff7f8a5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7eff7814e360 0x7eff78157410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:00.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.386+0000 7eff7f8a5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff780c6e90 con 0x7eff78157950 2024-04-25T01:39:00.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.386+0000 7eff7f8a5640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff78154030 con 0x7eff78154b10 2024-04-25T01:39:00.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.386+0000 7eff7f8a5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7eff78154680 con 0x7eff7814e360 2024-04-25T01:39:00.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.387+0000 7eff7de42640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7eff78154b10 0x7eff7815e7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:53274/0 (socket says 172.21.15.121:53274) 2024-04-25T01:39:00.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.387+0000 7eff7de42640 1 -- 172.21.15.121:0/3680361275 learned_addr learned my addr 172.21.15.121:0/3680361275 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-04-25T01:39:00.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.387+0000 7eff7d641640 1 --2- 172.21.15.121:0/3680361275 >> v2:172.21.15.77:3300/0 conn(0x7eff7814e360 0x7eff78157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:00.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.387+0000 7eff6ffff640 1 -- 172.21.15.121:0/3680361275 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3685548274 0 0) 0x7eff78154030 con 0x7eff78154b10 2024-04-25T01:39:00.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.387+0000 7eff6ffff640 1 -- 172.21.15.121:0/3680361275 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff64003520 con 0x7eff78154b10 2024-04-25T01:39:00.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.387+0000 7eff7d641640 1 -- 172.21.15.121:0/3680361275 >> v1:172.21.15.121:6789/0 conn(0x7eff78154b10 legacy=0x7eff7815e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:00.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.387+0000 7eff7d641640 1 -- 172.21.15.121:0/3680361275 >> v1:172.21.15.77:6789/0 conn(0x7eff78157950 legacy=0x7eff780c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:00.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.387+0000 7eff7d641640 1 -- 172.21.15.121:0/3680361275 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff78154310 con 0x7eff7814e360 2024-04-25T01:39:00.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.387+0000 7eff6ffff640 1 -- 172.21.15.121:0/3680361275 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 255220947 0 0) 0x7eff780c6e90 con 0x7eff78157950 2024-04-25T01:39:00.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.388+0000 7eff7d641640 1 --2- 172.21.15.121:0/3680361275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff7814e360 0x7eff78157410 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7eff740097a0 tx=0x7eff7402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=671297ba4f05bbbc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:00.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.388+0000 7eff6ffff640 1 -- 172.21.15.121:0/3680361275 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff74037070 con 0x7eff7814e360 2024-04-25T01:39:00.370 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.388+0000 7eff6ffff640 1 -- 172.21.15.121:0/3680361275 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff74032440 con 0x7eff7814e360 2024-04-25T01:39:00.370 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.388+0000 7eff6ffff640 1 -- 172.21.15.121:0/3680361275 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff74032810 con 0x7eff7814e360 2024-04-25T01:39:00.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.388+0000 7eff7f8a5640 1 -- 172.21.15.121:0/3680361275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff7814e360 msgr2=0x7eff78157410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:00.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.388+0000 7eff7f8a5640 1 --2- 172.21.15.121:0/3680361275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff7814e360 0x7eff78157410 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7eff740097a0 tx=0x7eff7402a1a0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.388+0000 7eff7f8a5640 1 -- 172.21.15.121:0/3680361275 shutdown_connections 2024-04-25T01:39:00.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.388+0000 7eff7f8a5640 1 --2- 172.21.15.121:0/3680361275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff7814e360 0x7eff78157410 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.388+0000 7eff7f8a5640 1 -- 172.21.15.121:0/3680361275 >> 172.21.15.121:0/3680361275 conn(0x7eff7806b2f0 msgr2=0x7eff780aa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:00.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.389+0000 7eff7f8a5640 1 -- 172.21.15.121:0/3680361275 shutdown_connections 2024-04-25T01:39:00.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.389+0000 7eff7f8a5640 1 -- 172.21.15.121:0/3680361275 wait complete. 2024-04-25T01:39:00.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.390+0000 7eff7f8a5640 1 Processor -- start 2024-04-25T01:39:00.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.390+0000 7eff7f8a5640 1 -- start start 2024-04-25T01:39:00.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.390+0000 7eff7f8a5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff7814e360 0x7eff781562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:00.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.390+0000 7eff7f8a5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff78154b10 0x7eff7813fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:00.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.390+0000 7eff7f8a5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7eff78157950 0x7eff78140170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:00.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.390+0000 7eff7f8a5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7eff780c6c30 con 0x7eff7814e360 2024-04-25T01:39:00.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.390+0000 7eff7f8a5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7eff780c6ab0 con 0x7eff78154b10 2024-04-25T01:39:00.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.390+0000 7eff7f8a5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7eff780c5d00 con 0x7eff78157950 2024-04-25T01:39:00.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.390+0000 7eff7ce40640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff78154b10 0x7eff7813fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:00.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.390+0000 7eff7d641640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff7814e360 0x7eff781562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:00.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.390+0000 7eff7ce40640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff78154b10 0x7eff7813fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36116/0 (socket says 172.21.15.121:36116) 2024-04-25T01:39:00.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.390+0000 7eff7ce40640 1 -- 172.21.15.121:0/899814834 learned_addr learned my addr 172.21.15.121:0/899814834 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-04-25T01:39:00.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.390+0000 7eff7de42640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7eff78157950 0x7eff78140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:00.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.391+0000 7eff7d641640 1 -- 172.21.15.121:0/899814834 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7eff78157950 msgr2=0x7eff78140170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:00.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.391+0000 7eff7d641640 1 --2- 172.21.15.121:0/899814834 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7eff78157950 0x7eff78140170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.391+0000 7eff7d641640 1 -- 172.21.15.121:0/899814834 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff78154b10 msgr2=0x7eff7813fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:00.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.391+0000 7eff7d641640 1 --2- 172.21.15.121:0/899814834 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff78154b10 0x7eff7813fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.391+0000 7eff7d641640 1 -- 172.21.15.121:0/899814834 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff781406b0 con 0x7eff7814e360 2024-04-25T01:39:00.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.391+0000 7eff7ce40640 1 --2- 172.21.15.121:0/899814834 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff78154b10 0x7eff7813fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:00.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.391+0000 7eff7de42640 1 --2- 172.21.15.121:0/899814834 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7eff78157950 0x7eff78140170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:00.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.391+0000 7eff7d641640 1 --2- 172.21.15.121:0/899814834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff7814e360 0x7eff781562a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7eff74031000 tx=0x7eff740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:00.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.391+0000 7eff6dffb640 1 -- 172.21.15.121:0/899814834 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff74037040 con 0x7eff7814e360 2024-04-25T01:39:00.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.391+0000 7eff6dffb640 1 -- 172.21.15.121:0/899814834 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff74004230 con 0x7eff7814e360 2024-04-25T01:39:00.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.391+0000 7eff7f8a5640 1 -- 172.21.15.121:0/899814834 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff781eced0 con 0x7eff7814e360 2024-04-25T01:39:00.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.391+0000 7eff6dffb640 1 -- 172.21.15.121:0/899814834 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7403c670 con 0x7eff7814e360 2024-04-25T01:39:00.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.391+0000 7eff7f8a5640 1 -- 172.21.15.121:0/899814834 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff781ed490 con 0x7eff7814e360 2024-04-25T01:39:00.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.391+0000 7eff6dffb640 1 -- 172.21.15.121:0/899814834 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7eff7403a070 con 0x7eff7814e360 2024-04-25T01:39:00.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.391+0000 7eff6dffb640 1 -- 172.21.15.121:0/899814834 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7eff74003a60 con 0x7eff7814e360 2024-04-25T01:39:00.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.392+0000 7eff7f8a5640 1 -- 172.21.15.121:0/899814834 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff7804f500 con 0x7eff7814e360 2024-04-25T01:39:00.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.394+0000 7eff6dffb640 1 -- 172.21.15.121:0/899814834 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7eff74041020 con 0x7eff7814e360 2024-04-25T01:39:00.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.464+0000 7eff7f8a5640 1 -- 172.21.15.121:0/899814834 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6875d6d8-0333-44a3-b953-d26a412bbd71", "id": 1} v 0) -- 0x7eff78073410 con 0x7eff7814e360 2024-04-25T01:39:00.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.466+0000 7eff6dffb640 1 -- 172.21.15.121:0/899814834 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6875d6d8-0333-44a3-b953-d26a412bbd71", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7eff74003cb0 con 0x7eff7814e360 2024-04-25T01:39:00.447 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-04-25T01:39:00.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.467+0000 7eff7f8a5640 1 -- 172.21.15.121:0/899814834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff7814e360 msgr2=0x7eff781562a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:00.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.467+0000 7eff7f8a5640 1 --2- 172.21.15.121:0/899814834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff7814e360 0x7eff781562a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7eff74031000 tx=0x7eff740046c0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.467+0000 7eff7f8a5640 1 -- 172.21.15.121:0/899814834 shutdown_connections 2024-04-25T01:39:00.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.467+0000 7eff7f8a5640 1 --2- 172.21.15.121:0/899814834 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7eff78157950 0x7eff78140170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.467+0000 7eff7f8a5640 1 --2- 172.21.15.121:0/899814834 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff78154b10 0x7eff7813fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.467+0000 7eff7f8a5640 1 --2- 172.21.15.121:0/899814834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff7814e360 0x7eff781562a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.467+0000 7eff7f8a5640 1 -- 172.21.15.121:0/899814834 >> 172.21.15.121:0/899814834 conn(0x7eff7806b2f0 msgr2=0x7eff780aa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:00.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.467+0000 7eff7f8a5640 1 -- 172.21.15.121:0/899814834 shutdown_connections 2024-04-25T01:39:00.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.467+0000 7eff7f8a5640 1 -- 172.21.15.121:0/899814834 wait complete. 2024-04-25T01:39:00.458 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5 2 2024-04-25T01:39:00.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.575+0000 7fb36d638640 1 Processor -- start 2024-04-25T01:39:00.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.575+0000 7fb36d638640 1 -- start start 2024-04-25T01:39:00.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.576+0000 7fb36d638640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3680c3050 0x7fb368153810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:00.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.576+0000 7fb36d638640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb3681541b0 0x7fb3680c8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:00.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.576+0000 7fb36d638640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb36806ef70 con 0x7fb368150430 2024-04-25T01:39:00.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.576+0000 7fb36d638640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb36806ed20 con 0x7fb3681541b0 2024-04-25T01:39:00.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.576+0000 7fb36d638640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb368153380 con 0x7fb3680c3050 2024-04-25T01:39:00.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.576+0000 7fb3667fc640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3680c3050 0x7fb368153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:00.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.576+0000 7fb3667fc640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3680c3050 0x7fb368153810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.121:59936/0 (socket says 172.21.15.121:59936) 2024-04-25T01:39:00.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.576+0000 7fb3667fc640 1 -- 172.21.15.121:0/2011857165 learned_addr learned my addr 172.21.15.121:0/2011857165 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-04-25T01:39:00.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.576+0000 7fb3677fe640 1 --2- 172.21.15.121:0/2011857165 >> v2:172.21.15.77:3300/0 conn(0x7fb3681541b0 0x7fb3680c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:00.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.577+0000 7fb3667fc640 1 -- 172.21.15.121:0/2011857165 >> v2:172.21.15.77:3300/0 conn(0x7fb3681541b0 msgr2=0x7fb3680c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:00.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.577+0000 7fb3667fc640 1 --2- 172.21.15.121:0/2011857165 >> v2:172.21.15.77:3300/0 conn(0x7fb3681541b0 0x7fb3680c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.577+0000 7fb3667fc640 1 -- 172.21.15.121:0/2011857165 >> v1:172.21.15.77:6789/0 conn(0x7fb368150430 legacy=0x7fb3680ab670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:00.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.577+0000 7fb3667fc640 1 -- 172.21.15.121:0/2011857165 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb36806f250 con 0x7fb3680c3050 2024-04-25T01:39:00.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.577+0000 7fb3667fc640 1 --2- 172.21.15.121:0/2011857165 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3680c3050 0x7fb368153810 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb35800bb10 tx=0x7fb35802c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42e742b4adfcf0e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:00.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.577+0000 7fb365ffb640 1 -- 172.21.15.121:0/2011857165 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb358032790 con 0x7fb3680c3050 2024-04-25T01:39:00.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.578+0000 7fb365ffb640 1 -- 172.21.15.121:0/2011857165 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb358038070 con 0x7fb3680c3050 2024-04-25T01:39:00.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.578+0000 7fb365ffb640 1 -- 172.21.15.121:0/2011857165 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb358032b50 con 0x7fb3680c3050 2024-04-25T01:39:00.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.578+0000 7fb36d638640 1 -- 172.21.15.121:0/2011857165 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3680c3050 msgr2=0x7fb368153810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:00.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.578+0000 7fb36d638640 1 --2- 172.21.15.121:0/2011857165 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3680c3050 0x7fb368153810 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb35800bb10 tx=0x7fb35802c890 comp rx=0 tx=0).stop 2024-04-25T01:39:00.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.578+0000 7fb36d638640 1 -- 172.21.15.121:0/2011857165 shutdown_connections 2024-04-25T01:39:00.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.578+0000 7fb36d638640 1 --2- 172.21.15.121:0/2011857165 >> v2:172.21.15.77:3300/0 conn(0x7fb3681541b0 0x7fb3680c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.578+0000 7fb36d638640 1 --2- 172.21.15.121:0/2011857165 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3680c3050 0x7fb368153810 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.578+0000 7fb36d638640 1 -- 172.21.15.121:0/2011857165 >> 172.21.15.121:0/2011857165 conn(0x7fb3680674d0 msgr2=0x7fb3680aa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:00.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.578+0000 7fb36d638640 1 -- 172.21.15.121:0/2011857165 shutdown_connections 2024-04-25T01:39:00.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.578+0000 7fb36d638640 1 -- 172.21.15.121:0/2011857165 wait complete. 2024-04-25T01:39:00.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.579+0000 7fb36d638640 1 Processor -- start 2024-04-25T01:39:00.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.580+0000 7fb36d638640 1 -- start start 2024-04-25T01:39:00.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.580+0000 7fb36d638640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3680c3050 0x7fb3680c1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:00.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.580+0000 7fb36d638640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb368150430 0x7fb3681493e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:00.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.580+0000 7fb36d638640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3681541b0 0x7fb368149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:00.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.580+0000 7fb36d638640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb368154660 con 0x7fb368150430 2024-04-25T01:39:00.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.580+0000 7fb36d638640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb368152cc0 con 0x7fb3681541b0 2024-04-25T01:39:00.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.580+0000 7fb36d638640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb3681547e0 con 0x7fb3680c3050 2024-04-25T01:39:00.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.580+0000 7fb366ffd640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3680c3050 0x7fb3680c1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:00.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.580+0000 7fb366ffd640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3680c3050 0x7fb3680c1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.121:59950/0 (socket says 172.21.15.121:59950) 2024-04-25T01:39:00.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.580+0000 7fb366ffd640 1 -- 172.21.15.121:0/3847725087 learned_addr learned my addr 172.21.15.121:0/3847725087 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-04-25T01:39:00.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.580+0000 7fb3677fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3681541b0 0x7fb368149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:00.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.580+0000 7fb3667fc640 1 --2- 172.21.15.121:0/3847725087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb368150430 0x7fb3681493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:00.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.581+0000 7fb3677fe640 1 -- 172.21.15.121:0/3847725087 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3680c3050 msgr2=0x7fb3680c1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:00.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.581+0000 7fb3677fe640 1 --2- 172.21.15.121:0/3847725087 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3680c3050 0x7fb3680c1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.581+0000 7fb3677fe640 1 -- 172.21.15.121:0/3847725087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb368150430 msgr2=0x7fb3681493e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:00.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.581+0000 7fb3677fe640 1 --2- 172.21.15.121:0/3847725087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb368150430 0x7fb3681493e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.581+0000 7fb3677fe640 1 -- 172.21.15.121:0/3847725087 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3680c2200 con 0x7fb3681541b0 2024-04-25T01:39:00.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.581+0000 7fb3667fc640 1 --2- 172.21.15.121:0/3847725087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb368150430 0x7fb3681493e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:00.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.581+0000 7fb3677fe640 1 --2- 172.21.15.121:0/3847725087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3681541b0 0x7fb368149920 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb36000eba0 tx=0x7fb36000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:00.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.581+0000 7fb34f7fe640 1 -- 172.21.15.121:0/3847725087 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb360018020 con 0x7fb3681541b0 2024-04-25T01:39:00.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.581+0000 7fb34f7fe640 1 -- 172.21.15.121:0/3847725087 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb36000cd20 con 0x7fb3681541b0 2024-04-25T01:39:00.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.581+0000 7fb36d638640 1 -- 172.21.15.121:0/3847725087 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb368072930 con 0x7fb3681541b0 2024-04-25T01:39:00.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.581+0000 7fb34f7fe640 1 -- 172.21.15.121:0/3847725087 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3600146c0 con 0x7fb3681541b0 2024-04-25T01:39:00.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.581+0000 7fb36d638640 1 -- 172.21.15.121:0/3847725087 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3681dee30 con 0x7fb3681541b0 2024-04-25T01:39:00.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.581+0000 7fb34f7fe640 1 -- 172.21.15.121:0/3847725087 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb360005d10 con 0x7fb3681541b0 2024-04-25T01:39:00.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.581+0000 7fb34f7fe640 1 -- 172.21.15.121:0/3847725087 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fb36001dd50 con 0x7fb3681541b0 2024-04-25T01:39:00.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.582+0000 7fb36d638640 1 -- 172.21.15.121:0/3847725087 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb36804f500 con 0x7fb3681541b0 2024-04-25T01:39:00.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.584+0000 7fb34f7fe640 1 -- 172.21.15.121:0/3847725087 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fb360022030 con 0x7fb3681541b0 2024-04-25T01:39:00.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.657+0000 7fb36d638640 1 -- 172.21.15.121:0/3847725087 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd new", "uuid": "32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5", "id": 2} v 0) -- 0x7fb36806eb00 con 0x7fb3681541b0 2024-04-25T01:39:00.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.662+0000 7fb34f7fe640 1 -- 172.21.15.121:0/3847725087 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fb360010040 con 0x7fb3681541b0 2024-04-25T01:39:00.642 INFO:teuthology.orchestra.run.smithi121.stdout:2 2024-04-25T01:39:00.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.662+0000 7fb36d638640 1 -- 172.21.15.121:0/3847725087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3681541b0 msgr2=0x7fb368149920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:00.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.662+0000 7fb36d638640 1 --2- 172.21.15.121:0/3847725087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3681541b0 0x7fb368149920 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb36000eba0 tx=0x7fb36000c490 comp rx=0 tx=0).stop 2024-04-25T01:39:00.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.663+0000 7fb36d638640 1 -- 172.21.15.121:0/3847725087 shutdown_connections 2024-04-25T01:39:00.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.663+0000 7fb36d638640 1 --2- 172.21.15.121:0/3847725087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb368150430 0x7fb3681493e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.663+0000 7fb36d638640 1 --2- 172.21.15.121:0/3847725087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3681541b0 0x7fb368149920 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.663+0000 7fb36d638640 1 --2- 172.21.15.121:0/3847725087 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3680c3050 0x7fb3680c1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.663+0000 7fb36d638640 1 -- 172.21.15.121:0/3847725087 >> 172.21.15.121:0/3847725087 conn(0x7fb3680674d0 msgr2=0x7fb3680aa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:00.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.663+0000 7fb36d638640 1 -- 172.21.15.121:0/3847725087 shutdown_connections 2024-04-25T01:39:00.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.663+0000 7fb36d638640 1 -- 172.21.15.121:0/3847725087 wait complete. 2024-04-25T01:39:00.654 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6 3 2024-04-25T01:39:00.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.777+0000 7f56bc8a5640 1 Processor -- start 2024-04-25T01:39:00.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.777+0000 7f56bc8a5640 1 -- start start 2024-04-25T01:39:00.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.778+0000 7f56bc8a5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f56b8153530 0x7f56b80c6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:00.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.778+0000 7f56bc8a5640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f56b80bef50 0x7f56b81595f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:00.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.778+0000 7f56bc8a5640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56b806d110 con 0x7f56b80c97c0 2024-04-25T01:39:00.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.778+0000 7f56bc8a5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f56b8153910 con 0x7f56b8153530 2024-04-25T01:39:00.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.778+0000 7f56bc8a5640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f56b8156980 con 0x7f56b80bef50 2024-04-25T01:39:00.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.778+0000 7f56b5d9b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f56b80bef50 0x7f56b81595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:00.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.778+0000 7f56b5d9b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f56b80bef50 0x7f56b81595f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36122/0 (socket says 172.21.15.121:36122) 2024-04-25T01:39:00.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.778+0000 7f56b5d9b640 1 -- 172.21.15.121:0/4029347320 learned_addr learned my addr 172.21.15.121:0/4029347320 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-04-25T01:39:00.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.778+0000 7f56b659c640 1 --2- 172.21.15.121:0/4029347320 >> v2:172.21.15.77:3300/0 conn(0x7f56b8153530 0x7f56b80c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:00.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.779+0000 7f56b5d9b640 1 -- 172.21.15.121:0/4029347320 >> v2:172.21.15.77:3300/0 conn(0x7f56b8153530 msgr2=0x7f56b80c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:00.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.779+0000 7f56b5d9b640 1 --2- 172.21.15.121:0/4029347320 >> v2:172.21.15.77:3300/0 conn(0x7f56b8153530 0x7f56b80c6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.779+0000 7f56b5d9b640 1 -- 172.21.15.121:0/4029347320 >> v1:172.21.15.121:6789/0 conn(0x7f56b80c97c0 legacy=0x7f56b8159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:00.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.779+0000 7f56b5d9b640 1 -- 172.21.15.121:0/4029347320 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b8156c60 con 0x7f56b80bef50 2024-04-25T01:39:00.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.779+0000 7f56b5d9b640 1 --2- 172.21.15.121:0/4029347320 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56b80bef50 0x7f56b81595f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f56b80c9370 tx=0x7f56ac02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40c26a4fb49ab281 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:00.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.779+0000 7f56b559a640 1 -- 172.21.15.121:0/4029347320 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac004030 con 0x7f56b80bef50 2024-04-25T01:39:00.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.780+0000 7f56b559a640 1 -- 172.21.15.121:0/4029347320 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56ac0041d0 con 0x7f56b80bef50 2024-04-25T01:39:00.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.780+0000 7f56b559a640 1 -- 172.21.15.121:0/4029347320 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac003610 con 0x7f56b80bef50 2024-04-25T01:39:00.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.780+0000 7f56bc8a5640 1 -- 172.21.15.121:0/4029347320 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56b80bef50 msgr2=0x7f56b81595f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:00.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.780+0000 7f56bc8a5640 1 --2- 172.21.15.121:0/4029347320 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56b80bef50 0x7f56b81595f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f56b80c9370 tx=0x7f56ac02a1c0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.780+0000 7f56bc8a5640 1 -- 172.21.15.121:0/4029347320 shutdown_connections 2024-04-25T01:39:00.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.780+0000 7f56bc8a5640 1 --2- 172.21.15.121:0/4029347320 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56b80bef50 0x7f56b81595f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.780+0000 7f56bc8a5640 1 --2- 172.21.15.121:0/4029347320 >> v2:172.21.15.77:3300/0 conn(0x7f56b8153530 0x7f56b80c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.780+0000 7f56bc8a5640 1 -- 172.21.15.121:0/4029347320 >> 172.21.15.121:0/4029347320 conn(0x7f56b80672c0 msgr2=0x7f56b80676d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:00.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.780+0000 7f56bc8a5640 1 -- 172.21.15.121:0/4029347320 shutdown_connections 2024-04-25T01:39:00.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.780+0000 7f56bc8a5640 1 -- 172.21.15.121:0/4029347320 wait complete. 2024-04-25T01:39:00.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.782+0000 7f56bc8a5640 1 Processor -- start 2024-04-25T01:39:00.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.782+0000 7f56bc8a5640 1 -- start start 2024-04-25T01:39:00.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.782+0000 7f56bc8a5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56b80bef50 0x7f56b80abdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:00.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.782+0000 7f56bc8a5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b80c97c0 0x7f56b814bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:00.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.782+0000 7f56bc8a5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f56b8153530 0x7f56b814c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:00.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.782+0000 7f56bc8a5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f56b815a240 con 0x7f56b80c97c0 2024-04-25T01:39:00.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.782+0000 7f56bc8a5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f56b80cc250 con 0x7f56b80bef50 2024-04-25T01:39:00.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.782+0000 7f56bc8a5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f56b80c6780 con 0x7f56b8153530 2024-04-25T01:39:00.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.782+0000 7f56b659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56b80bef50 0x7f56b80abdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:00.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.782+0000 7f56b6d9d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f56b8153530 0x7f56b814c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:00.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.782+0000 7f56b659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56b80bef50 0x7f56b80abdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36130/0 (socket says 172.21.15.121:36130) 2024-04-25T01:39:00.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.782+0000 7f56b659c640 1 -- 172.21.15.121:0/256535904 learned_addr learned my addr 172.21.15.121:0/256535904 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-04-25T01:39:00.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.782+0000 7f56b5d9b640 1 --2- 172.21.15.121:0/256535904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b80c97c0 0x7f56b814bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:00.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.783+0000 7f56b6d9d640 1 -- 172.21.15.121:0/256535904 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56b80bef50 msgr2=0x7f56b80abdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:00.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.783+0000 7f56b6d9d640 1 --2- 172.21.15.121:0/256535904 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56b80bef50 0x7f56b80abdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.783+0000 7f56b6d9d640 1 -- 172.21.15.121:0/256535904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b80c97c0 msgr2=0x7f56b814bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:00.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.783+0000 7f56b6d9d640 1 --2- 172.21.15.121:0/256535904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b80c97c0 0x7f56b814bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.783+0000 7f56b6d9d640 1 -- 172.21.15.121:0/256535904 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b8152cd0 con 0x7f56b8153530 2024-04-25T01:39:00.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.783+0000 7f56b659c640 1 --2- 172.21.15.121:0/256535904 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56b80bef50 0x7f56b80abdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:00.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.783+0000 7f56b5d9b640 1 --2- 172.21.15.121:0/256535904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b80c97c0 0x7f56b814bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:00.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.783+0000 7f56b6d9d640 1 --2- 172.21.15.121:0/256535904 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f56b8153530 0x7f56b814c0f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f56a800c6c0 tx=0x7f56a800cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:00.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.783+0000 7f56a6ffd640 1 -- 172.21.15.121:0/256535904 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a8003b70 con 0x7f56b8153530 2024-04-25T01:39:00.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.783+0000 7f56a6ffd640 1 -- 172.21.15.121:0/256535904 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56a8003d10 con 0x7f56b8153530 2024-04-25T01:39:00.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.783+0000 7f56a6ffd640 1 -- 172.21.15.121:0/256535904 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a80052f0 con 0x7f56b8153530 2024-04-25T01:39:00.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.783+0000 7f56bc8a5640 1 -- 172.21.15.121:0/256535904 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56b81523a0 con 0x7f56b8153530 2024-04-25T01:39:00.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.783+0000 7f56bc8a5640 1 -- 172.21.15.121:0/256535904 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f56b8152960 con 0x7f56b8153530 2024-04-25T01:39:00.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.783+0000 7f56a6ffd640 1 -- 172.21.15.121:0/256535904 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f56a8005490 con 0x7f56b8153530 2024-04-25T01:39:00.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.783+0000 7f56a6ffd640 1 -- 172.21.15.121:0/256535904 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f56a8012900 con 0x7f56b8153530 2024-04-25T01:39:00.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.784+0000 7f56bc8a5640 1 -- 172.21.15.121:0/256535904 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56b804f500 con 0x7f56b8153530 2024-04-25T01:39:00.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.786+0000 7f56a6ffd640 1 -- 172.21.15.121:0/256535904 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f56a8012be0 con 0x7f56b8153530 2024-04-25T01:39:00.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.880+0000 7f56bc8a5640 1 -- 172.21.15.121:0/256535904 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6", "id": 3} v 0) -- 0x7f56b80c91d0 con 0x7f56b8153530 2024-04-25T01:39:00.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.885+0000 7f56a6ffd640 1 -- 172.21.15.121:0/256535904 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f56a8012470 con 0x7f56b8153530 2024-04-25T01:39:00.866 INFO:teuthology.orchestra.run.smithi121.stdout:3 2024-04-25T01:39:00.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.886+0000 7f56bc8a5640 1 -- 172.21.15.121:0/256535904 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f56b8153530 msgr2=0x7f56b814c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:00.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.886+0000 7f56bc8a5640 1 --2- 172.21.15.121:0/256535904 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f56b8153530 0x7f56b814c0f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f56a800c6c0 tx=0x7f56a800cb80 comp rx=0 tx=0).stop 2024-04-25T01:39:00.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.886+0000 7f56bc8a5640 1 -- 172.21.15.121:0/256535904 shutdown_connections 2024-04-25T01:39:00.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.886+0000 7f56bc8a5640 1 --2- 172.21.15.121:0/256535904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b80c97c0 0x7f56b814bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.886+0000 7f56bc8a5640 1 --2- 172.21.15.121:0/256535904 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f56b8153530 0x7f56b814c0f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.886+0000 7f56bc8a5640 1 --2- 172.21.15.121:0/256535904 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56b80bef50 0x7f56b80abdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.886+0000 7f56bc8a5640 1 -- 172.21.15.121:0/256535904 >> 172.21.15.121:0/256535904 conn(0x7f56b80672c0 msgr2=0x7f56b80ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:00.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.886+0000 7f56bc8a5640 1 -- 172.21.15.121:0/256535904 shutdown_connections 2024-04-25T01:39:00.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.886+0000 7f56bc8a5640 1 -- 172.21.15.121:0/256535904 wait complete. 2024-04-25T01:39:00.878 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new edab5c68-4240-461d-8dd9-ccabe9ab07b9 4 2024-04-25T01:39:00.900 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T01:39:00.919+0000 7f86b720e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T01:39:00.963 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-25T01:39:00.982+0000 7fd6dadce040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T01:39:00.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.994+0000 7f296e48c640 1 Processor -- start 2024-04-25T01:39:00.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.994+0000 7f296e48c640 1 -- start start 2024-04-25T01:39:00.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.994+0000 7f296e48c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2968150150 0x7f296806e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:00.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.994+0000 7f296e48c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f296806bbd0 0x7f29680c8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:00.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.994+0000 7f296e48c640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2968150530 con 0x7f29680c8a90 2024-04-25T01:39:00.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.994+0000 7f296e48c640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f2968157010 con 0x7f296806bbd0 2024-04-25T01:39:00.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.994+0000 7f296e48c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f296806ede0 con 0x7f2968150150 2024-04-25T01:39:00.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.995+0000 7f2967fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2968150150 0x7f296806e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:00.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.994+0000 7f29677fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f296806bbd0 0x7f29680c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:00.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.995+0000 7f29677fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f296806bbd0 0x7f29680c8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36140/0 (socket says 172.21.15.121:36140) 2024-04-25T01:39:00.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.995+0000 7f2967fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2968150150 0x7f296806e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.121:59970/0 (socket says 172.21.15.121:59970) 2024-04-25T01:39:00.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.995+0000 7f29677fe640 1 -- 172.21.15.121:0/4094254715 learned_addr learned my addr 172.21.15.121:0/4094254715 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-04-25T01:39:00.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.995+0000 7f29677fe640 1 -- 172.21.15.121:0/4094254715 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2968150150 msgr2=0x7f296806e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:00.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.995+0000 7f29677fe640 1 --2- 172.21.15.121:0/4094254715 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2968150150 0x7f296806e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.995+0000 7f29677fe640 1 -- 172.21.15.121:0/4094254715 >> v1:172.21.15.121:6789/0 conn(0x7f29680c8a90 legacy=0x7f2968159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:00.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.995+0000 7f29677fe640 1 -- 172.21.15.121:0/4094254715 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2968156250 con 0x7f296806bbd0 2024-04-25T01:39:00.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.995+0000 7f2967fff640 1 --2- 172.21.15.121:0/4094254715 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2968150150 0x7f296806e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:00.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.995+0000 7f29677fe640 1 --2- 172.21.15.121:0/4094254715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f296806bbd0 0x7f29680c8550 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f295c009870 tx=0x7f295c02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e536432786105d2b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:00.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.996+0000 7f2966ffd640 1 -- 172.21.15.121:0/4094254715 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295c037070 con 0x7f296806bbd0 2024-04-25T01:39:00.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.996+0000 7f2966ffd640 1 -- 172.21.15.121:0/4094254715 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f295c032440 con 0x7f296806bbd0 2024-04-25T01:39:00.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.996+0000 7f2966ffd640 1 -- 172.21.15.121:0/4094254715 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295c032810 con 0x7f296806bbd0 2024-04-25T01:39:00.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.996+0000 7f296e48c640 1 -- 172.21.15.121:0/4094254715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f296806bbd0 msgr2=0x7f29680c8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:00.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.996+0000 7f296e48c640 1 --2- 172.21.15.121:0/4094254715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f296806bbd0 0x7f29680c8550 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f295c009870 tx=0x7f295c02a130 comp rx=0 tx=0).stop 2024-04-25T01:39:00.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.996+0000 7f296e48c640 1 -- 172.21.15.121:0/4094254715 shutdown_connections 2024-04-25T01:39:00.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.996+0000 7f296e48c640 1 --2- 172.21.15.121:0/4094254715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f296806bbd0 0x7f29680c8550 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.996+0000 7f296e48c640 1 --2- 172.21.15.121:0/4094254715 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2968150150 0x7f296806e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.996+0000 7f296e48c640 1 -- 172.21.15.121:0/4094254715 >> 172.21.15.121:0/4094254715 conn(0x7f29680674d0 msgr2=0x7f29680aa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:00.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.996+0000 7f296e48c640 1 -- 172.21.15.121:0/4094254715 shutdown_connections 2024-04-25T01:39:00.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.996+0000 7f296e48c640 1 -- 172.21.15.121:0/4094254715 wait complete. 2024-04-25T01:39:00.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.997+0000 7f296e48c640 1 Processor -- start 2024-04-25T01:39:00.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.998+0000 7f296e48c640 1 -- start start 2024-04-25T01:39:00.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.998+0000 7f296e48c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f296806bbd0 0x7f2968150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:00.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.998+0000 7f296e48c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f29680c8a90 0x7f2968153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:00.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.998+0000 7f296e48c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2968150150 0x7f29681535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:00.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.998+0000 7f296e48c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2968156af0 con 0x7f296806bbd0 2024-04-25T01:39:00.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.998+0000 7f296e48c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2968156810 con 0x7f2968150150 2024-04-25T01:39:00.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.998+0000 7f296e48c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f2968159d40 con 0x7f29680c8a90 2024-04-25T01:39:00.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.998+0000 7f29677fe640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f29680c8a90 0x7f2968153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:00.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.998+0000 7f296ca29640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2968150150 0x7f29681535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:00.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.998+0000 7f29677fe640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f29680c8a90 0x7f2968153090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.121:59980/0 (socket says 172.21.15.121:59980) 2024-04-25T01:39:00.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.998+0000 7f29677fe640 1 -- 172.21.15.121:0/2214627656 learned_addr learned my addr 172.21.15.121:0/2214627656 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-04-25T01:39:00.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.998+0000 7f296ca29640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2968150150 0x7f29681535d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36142/0 (socket says 172.21.15.121:36142) 2024-04-25T01:39:00.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.998+0000 7f2967fff640 1 --2- 172.21.15.121:0/2214627656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f296806bbd0 0x7f2968150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:00.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.999+0000 7f296ca29640 1 -- 172.21.15.121:0/2214627656 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f29680c8a90 msgr2=0x7f2968153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:00.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.999+0000 7f296ca29640 1 --2- 172.21.15.121:0/2214627656 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f29680c8a90 0x7f2968153090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.999+0000 7f296ca29640 1 -- 172.21.15.121:0/2214627656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f296806bbd0 msgr2=0x7f2968150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:00.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.999+0000 7f296ca29640 1 --2- 172.21.15.121:0/2214627656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f296806bbd0 0x7f2968150c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:00.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.999+0000 7f296ca29640 1 -- 172.21.15.121:0/2214627656 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29680ad450 con 0x7f2968150150 2024-04-25T01:39:00.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.999+0000 7f29677fe640 1 --2- 172.21.15.121:0/2214627656 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f29680c8a90 0x7f2968153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:00.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.999+0000 7f296ca29640 1 --2- 172.21.15.121:0/2214627656 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2968150150 0x7f29681535d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f296000c690 tx=0x7f296000cb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:00.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.999+0000 7f2964ff9640 1 -- 172.21.15.121:0/2214627656 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2960003b70 con 0x7f2968150150 2024-04-25T01:39:00.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.999+0000 7f2964ff9640 1 -- 172.21.15.121:0/2214627656 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2960003d10 con 0x7f2968150150 2024-04-25T01:39:00.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.999+0000 7f2964ff9640 1 -- 172.21.15.121:0/2214627656 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2960005310 con 0x7f2968150150 2024-04-25T01:39:00.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.999+0000 7f296e48c640 1 -- 172.21.15.121:0/2214627656 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29680ad730 con 0x7f2968150150 2024-04-25T01:39:00.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.999+0000 7f296e48c640 1 -- 172.21.15.121:0/2214627656 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2968152840 con 0x7f2968150150 2024-04-25T01:39:00.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.999+0000 7f2964ff9640 1 -- 172.21.15.121:0/2214627656 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f29600054b0 con 0x7f2968150150 2024-04-25T01:39:00.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:00.999+0000 7f2964ff9640 1 -- 172.21.15.121:0/2214627656 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f29600057a0 con 0x7f2968150150 2024-04-25T01:39:00.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.000+0000 7f296e48c640 1 -- 172.21.15.121:0/2214627656 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f296804f500 con 0x7f2968150150 2024-04-25T01:39:00.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.002+0000 7f2964ff9640 1 -- 172.21.15.121:0/2214627656 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f296000a640 con 0x7f2968150150 2024-04-25T01:39:00.986 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T01:39:01.004+0000 7f86b720e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T01:39:01.027 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T01:39:01.046+0000 7f86b720e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T01:39:01.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.074+0000 7f296e48c640 1 -- 172.21.15.121:0/2214627656 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd new", "uuid": "edab5c68-4240-461d-8dd9-ccabe9ab07b9", "id": 4} v 0) -- 0x7f29680c2da0 con 0x7f2968150150 2024-04-25T01:39:01.055 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-25T01:39:01.074+0000 7fd6dadce040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T01:39:01.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.077+0000 7f2964ff9640 1 -- 172.21.15.121:0/2214627656 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "edab5c68-4240-461d-8dd9-ccabe9ab07b9", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f296000a820 con 0x7f2968150150 2024-04-25T01:39:01.058 INFO:teuthology.orchestra.run.smithi121.stdout:4 2024-04-25T01:39:01.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.078+0000 7f296e48c640 1 -- 172.21.15.121:0/2214627656 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2968150150 msgr2=0x7f29681535d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:01.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.078+0000 7f296e48c640 1 --2- 172.21.15.121:0/2214627656 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2968150150 0x7f29681535d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f296000c690 tx=0x7f296000cb50 comp rx=0 tx=0).stop 2024-04-25T01:39:01.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.078+0000 7f296e48c640 1 -- 172.21.15.121:0/2214627656 shutdown_connections 2024-04-25T01:39:01.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.078+0000 7f296e48c640 1 --2- 172.21.15.121:0/2214627656 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2968150150 0x7f29681535d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.078+0000 7f296e48c640 1 --2- 172.21.15.121:0/2214627656 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f29680c8a90 0x7f2968153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.078+0000 7f296e48c640 1 --2- 172.21.15.121:0/2214627656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f296806bbd0 0x7f2968150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.078+0000 7f296e48c640 1 -- 172.21.15.121:0/2214627656 >> 172.21.15.121:0/2214627656 conn(0x7f29680674d0 msgr2=0x7f296814e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:01.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.078+0000 7f296e48c640 1 -- 172.21.15.121:0/2214627656 shutdown_connections 2024-04-25T01:39:01.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.078+0000 7f296e48c640 1 -- 172.21.15.121:0/2214627656 wait complete. 2024-04-25T01:39:01.070 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 6eb36566-eb7d-4601-a24a-59f721295c2e 5 2024-04-25T01:39:01.101 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-25T01:39:01.121+0000 7fd6dadce040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T01:39:01.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.186+0000 7fc51334c640 1 Processor -- start 2024-04-25T01:39:01.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.186+0000 7fc51334c640 1 -- start start 2024-04-25T01:39:01.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.186+0000 7fc51334c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc50c0c3050 0x7fc50c153810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:01.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.186+0000 7fc51334c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc50c06ef70 con 0x7fc50c1541b0 2024-04-25T01:39:01.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.186+0000 7fc51334c640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc50c06f250 con 0x7fc50c150430 2024-04-25T01:39:01.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.187+0000 7fc51334c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc50c06ed20 con 0x7fc50c0c3050 2024-04-25T01:39:01.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.187+0000 7fc5108e7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc50c0c3050 0x7fc50c153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:01.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.187+0000 7fc5110e8640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fc50c150430 0x7fc50c0ab670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:53294/0 (socket says 172.21.15.121:53294) 2024-04-25T01:39:01.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.187+0000 7fc5110e8640 1 -- 172.21.15.121:0/2499535508 learned_addr learned my addr 172.21.15.121:0/2499535508 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-04-25T01:39:01.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.187+0000 7fc503fff640 1 -- 172.21.15.121:0/2499535508 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3080859983 0 0) 0x7fc50c06f250 con 0x7fc50c150430 2024-04-25T01:39:01.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.187+0000 7fc503fff640 1 -- 172.21.15.121:0/2499535508 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4f8003520 con 0x7fc50c150430 2024-04-25T01:39:01.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.187+0000 7fc5108e7640 1 -- 172.21.15.121:0/2499535508 >> v1:172.21.15.121:6789/0 conn(0x7fc50c150430 legacy=0x7fc50c0ab670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:01.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.187+0000 7fc5108e7640 1 -- 172.21.15.121:0/2499535508 >> v1:172.21.15.77:6789/0 conn(0x7fc50c1541b0 legacy=0x7fc50c0c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:01.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.187+0000 7fc5108e7640 1 -- 172.21.15.121:0/2499535508 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50c153010 con 0x7fc50c0c3050 2024-04-25T01:39:01.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.188+0000 7fc5108e7640 1 --2- 172.21.15.121:0/2499535508 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc50c0c3050 0x7fc50c153810 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc0097d0 tx=0x7fc4fc02c290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83f205e0fcfa28ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:01.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.188+0000 7fc503fff640 1 -- 172.21.15.121:0/2499535508 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc039070 con 0x7fc50c0c3050 2024-04-25T01:39:01.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.188+0000 7fc503fff640 1 -- 172.21.15.121:0/2499535508 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4fc034440 con 0x7fc50c0c3050 2024-04-25T01:39:01.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.188+0000 7fc503fff640 1 -- 172.21.15.121:0/2499535508 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc034810 con 0x7fc50c0c3050 2024-04-25T01:39:01.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.188+0000 7fc51334c640 1 -- 172.21.15.121:0/2499535508 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc50c0c3050 msgr2=0x7fc50c153810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:01.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.188+0000 7fc51334c640 1 --2- 172.21.15.121:0/2499535508 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc50c0c3050 0x7fc50c153810 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc0097d0 tx=0x7fc4fc02c290 comp rx=0 tx=0).stop 2024-04-25T01:39:01.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.188+0000 7fc51334c640 1 -- 172.21.15.121:0/2499535508 shutdown_connections 2024-04-25T01:39:01.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.188+0000 7fc51334c640 1 --2- 172.21.15.121:0/2499535508 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc50c0c3050 0x7fc50c153810 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.188+0000 7fc51334c640 1 -- 172.21.15.121:0/2499535508 >> 172.21.15.121:0/2499535508 conn(0x7fc50c0674d0 msgr2=0x7fc50c0aa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:01.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.189+0000 7fc51334c640 1 -- 172.21.15.121:0/2499535508 shutdown_connections 2024-04-25T01:39:01.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.189+0000 7fc51334c640 1 -- 172.21.15.121:0/2499535508 wait complete. 2024-04-25T01:39:01.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.190+0000 7fc51334c640 1 Processor -- start 2024-04-25T01:39:01.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.190+0000 7fc51334c640 1 -- start start 2024-04-25T01:39:01.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.190+0000 7fc51334c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc50c0c3050 0x7fc50c14dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:01.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.190+0000 7fc51334c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc50c150430 0x7fc50c0c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:01.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.190+0000 7fc51334c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc50c1541b0 0x7fc50c142f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:01.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.190+0000 7fc51334c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c0c8c60 con 0x7fc50c1541b0 2024-04-25T01:39:01.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.190+0000 7fc51334c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c153380 con 0x7fc50c0c3050 2024-04-25T01:39:01.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.190+0000 7fc51334c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc50c0c8de0 con 0x7fc50c150430 2024-04-25T01:39:01.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.190+0000 7fc5110e8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc50c0c3050 0x7fc50c14dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:01.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.190+0000 7fc5108e7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc50c150430 0x7fc50c0c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:01.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.190+0000 7fc5110e8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc50c0c3050 0x7fc50c14dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36154/0 (socket says 172.21.15.121:36154) 2024-04-25T01:39:01.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.190+0000 7fc5110e8640 1 -- 172.21.15.121:0/3329337076 learned_addr learned my addr 172.21.15.121:0/3329337076 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-04-25T01:39:01.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.190+0000 7fc5118e9640 1 --2- 172.21.15.121:0/3329337076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc50c1541b0 0x7fc50c142f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:01.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.191+0000 7fc5108e7640 1 -- 172.21.15.121:0/3329337076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc50c0c3050 msgr2=0x7fc50c14dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:01.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.191+0000 7fc5108e7640 1 --2- 172.21.15.121:0/3329337076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc50c0c3050 0x7fc50c14dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.191+0000 7fc5108e7640 1 -- 172.21.15.121:0/3329337076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc50c1541b0 msgr2=0x7fc50c142f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:01.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.191+0000 7fc5108e7640 1 --2- 172.21.15.121:0/3329337076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc50c1541b0 0x7fc50c142f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.191+0000 7fc5108e7640 1 -- 172.21.15.121:0/3329337076 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50c0c6550 con 0x7fc50c150430 2024-04-25T01:39:01.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.191+0000 7fc5108e7640 1 --2- 172.21.15.121:0/3329337076 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc50c150430 0x7fc50c0c36c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0c90c0 tx=0x7fc4fc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:01.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.191+0000 7fc501ffb640 1 -- 172.21.15.121:0/3329337076 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc039070 con 0x7fc50c150430 2024-04-25T01:39:01.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.191+0000 7fc501ffb640 1 -- 172.21.15.121:0/3329337076 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4fc004240 con 0x7fc50c150430 2024-04-25T01:39:01.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.191+0000 7fc501ffb640 1 -- 172.21.15.121:0/3329337076 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc003610 con 0x7fc50c150430 2024-04-25T01:39:01.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.191+0000 7fc51334c640 1 -- 172.21.15.121:0/3329337076 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc50c0c6830 con 0x7fc50c150430 2024-04-25T01:39:01.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.191+0000 7fc51334c640 1 -- 172.21.15.121:0/3329337076 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc50c0c3c00 con 0x7fc50c150430 2024-04-25T01:39:01.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.191+0000 7fc501ffb640 1 -- 172.21.15.121:0/3329337076 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc4fc046060 con 0x7fc50c150430 2024-04-25T01:39:01.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.191+0000 7fc501ffb640 1 -- 172.21.15.121:0/3329337076 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fc4fc03f480 con 0x7fc50c150430 2024-04-25T01:39:01.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.192+0000 7fc51334c640 1 -- 172.21.15.121:0/3329337076 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc50c04f500 con 0x7fc50c150430 2024-04-25T01:39:01.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.194+0000 7fc501ffb640 1 -- 172.21.15.121:0/3329337076 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fc4fc05edd0 con 0x7fc50c150430 2024-04-25T01:39:01.194 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T01:39:01.212+0000 7f86b720e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T01:39:01.241 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T01:39:01.259+0000 7f86b720e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T01:39:01.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.267+0000 7fc51334c640 1 -- 172.21.15.121:0/3329337076 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6eb36566-eb7d-4601-a24a-59f721295c2e", "id": 5} v 0) -- 0x7fc50c0c5ea0 con 0x7fc50c150430 2024-04-25T01:39:01.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.271+0000 7fc501ffb640 1 -- 172.21.15.121:0/3329337076 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6eb36566-eb7d-4601-a24a-59f721295c2e", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fc4fc04d070 con 0x7fc50c150430 2024-04-25T01:39:01.251 INFO:teuthology.orchestra.run.smithi121.stdout:5 2024-04-25T01:39:01.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.272+0000 7fc51334c640 1 -- 172.21.15.121:0/3329337076 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc50c150430 msgr2=0x7fc50c0c36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:01.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.272+0000 7fc51334c640 1 --2- 172.21.15.121:0/3329337076 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc50c150430 0x7fc50c0c36c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0c90c0 tx=0x7fc4fc0046c0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.272+0000 7fc51334c640 1 -- 172.21.15.121:0/3329337076 shutdown_connections 2024-04-25T01:39:01.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.272+0000 7fc51334c640 1 --2- 172.21.15.121:0/3329337076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc50c1541b0 0x7fc50c142f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.272+0000 7fc51334c640 1 --2- 172.21.15.121:0/3329337076 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc50c150430 0x7fc50c0c36c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.272+0000 7fc51334c640 1 --2- 172.21.15.121:0/3329337076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc50c0c3050 0x7fc50c14dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.272+0000 7fc51334c640 1 -- 172.21.15.121:0/3329337076 >> 172.21.15.121:0/3329337076 conn(0x7fc50c0674d0 msgr2=0x7fc50c152480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:01.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.272+0000 7fc51334c640 1 -- 172.21.15.121:0/3329337076 shutdown_connections 2024-04-25T01:39:01.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.272+0000 7fc51334c640 1 -- 172.21.15.121:0/3329337076 wait complete. 2024-04-25T01:39:01.263 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e 6 2024-04-25T01:39:01.277 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-25T01:39:01.295+0000 7fd6dadce040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T01:39:01.293 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T01:39:01.311+0000 7f86b720e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T01:39:01.332 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-25T01:39:01.351+0000 7fd6dadce040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T01:39:01.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.393+0000 7f542f44d640 1 Processor -- start 2024-04-25T01:39:01.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.393+0000 7f542f44d640 1 -- start start 2024-04-25T01:39:01.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.394+0000 7f542f44d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5428150430 0x7f5428153810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:01.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.394+0000 7f542f44d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f54281541b0 0x7f54280c8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:01.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.394+0000 7f542f44d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f542806ef70 con 0x7f54280c3050 2024-04-25T01:39:01.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.394+0000 7f542f44d640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f542806ed20 con 0x7f54281541b0 2024-04-25T01:39:01.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.394+0000 7f542f44d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f5428153380 con 0x7f5428150430 2024-04-25T01:39:01.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.394+0000 7f542d1e9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5428150430 0x7f5428153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:01.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.394+0000 7f542d9ea640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f54281541b0 0x7f54280c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:01.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.394+0000 7f542d1e9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5428150430 0x7f5428153810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.121:60004/0 (socket says 172.21.15.121:60004) 2024-04-25T01:39:01.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.394+0000 7f542d1e9640 1 -- 172.21.15.121:0/1394876554 learned_addr learned my addr 172.21.15.121:0/1394876554 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-04-25T01:39:01.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.394+0000 7f542d1e9640 1 -- 172.21.15.121:0/1394876554 >> v2:172.21.15.121:3300/0 conn(0x7f54281541b0 msgr2=0x7f54280c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:01.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.394+0000 7f542d1e9640 1 --2- 172.21.15.121:0/1394876554 >> v2:172.21.15.121:3300/0 conn(0x7f54281541b0 0x7f54280c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.394+0000 7f542d1e9640 1 -- 172.21.15.121:0/1394876554 >> v1:172.21.15.77:6789/0 conn(0x7f54280c3050 legacy=0x7f54280ab670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:01.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.394+0000 7f542d1e9640 1 -- 172.21.15.121:0/1394876554 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f542806f250 con 0x7f5428150430 2024-04-25T01:39:01.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.394+0000 7f542d9ea640 1 --2- 172.21.15.121:0/1394876554 >> v2:172.21.15.121:3300/0 conn(0x7f54281541b0 0x7f54280c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:01.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.395+0000 7f542d1e9640 1 --2- 172.21.15.121:0/1394876554 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5428150430 0x7f5428153810 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5424009870 tx=0x7f542402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e48f5bd56d724726 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:01.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.395+0000 7f541ffff640 1 -- 172.21.15.121:0/1394876554 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5424037070 con 0x7f5428150430 2024-04-25T01:39:01.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.395+0000 7f541ffff640 1 -- 172.21.15.121:0/1394876554 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5424032440 con 0x7f5428150430 2024-04-25T01:39:01.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.395+0000 7f541ffff640 1 -- 172.21.15.121:0/1394876554 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5424032810 con 0x7f5428150430 2024-04-25T01:39:01.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.395+0000 7f542f44d640 1 -- 172.21.15.121:0/1394876554 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5428150430 msgr2=0x7f5428153810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:01.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.395+0000 7f542f44d640 1 --2- 172.21.15.121:0/1394876554 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5428150430 0x7f5428153810 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5424009870 tx=0x7f542402a1c0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.396+0000 7f542f44d640 1 -- 172.21.15.121:0/1394876554 shutdown_connections 2024-04-25T01:39:01.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.396+0000 7f542f44d640 1 --2- 172.21.15.121:0/1394876554 >> v2:172.21.15.121:3300/0 conn(0x7f54281541b0 0x7f54280c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.396+0000 7f542f44d640 1 --2- 172.21.15.121:0/1394876554 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5428150430 0x7f5428153810 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.396+0000 7f542f44d640 1 -- 172.21.15.121:0/1394876554 >> 172.21.15.121:0/1394876554 conn(0x7f54280674d0 msgr2=0x7f54280aa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:01.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.396+0000 7f542f44d640 1 -- 172.21.15.121:0/1394876554 shutdown_connections 2024-04-25T01:39:01.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.396+0000 7f542f44d640 1 -- 172.21.15.121:0/1394876554 wait complete. 2024-04-25T01:39:01.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.397+0000 7f542f44d640 1 Processor -- start 2024-04-25T01:39:01.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.397+0000 7f542f44d640 1 -- start start 2024-04-25T01:39:01.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.397+0000 7f542f44d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54280c3050 0x7f54280c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:01.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.397+0000 7f542f44d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5428150430 0x7f5428071c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:01.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.397+0000 7f542f44d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f54281541b0 0x7f54281eeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:01.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.397+0000 7f542f44d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5428154660 con 0x7f54280c3050 2024-04-25T01:39:01.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.397+0000 7f542f44d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5428152cc0 con 0x7f5428150430 2024-04-25T01:39:01.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.397+0000 7f542f44d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f54281547e0 con 0x7f54281541b0 2024-04-25T01:39:01.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.397+0000 7f542c9e8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5428150430 0x7f5428071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:01.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.397+0000 7f542d9ea640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f54281541b0 0x7f54281eeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:01.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.398+0000 7f542d9ea640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f54281541b0 0x7f54281eeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.121:60006/0 (socket says 172.21.15.121:60006) 2024-04-25T01:39:01.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.398+0000 7f542c9e8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5428150430 0x7f5428071c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36182/0 (socket says 172.21.15.121:36182) 2024-04-25T01:39:01.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.398+0000 7f542d9ea640 1 -- 172.21.15.121:0/540870263 learned_addr learned my addr 172.21.15.121:0/540870263 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-04-25T01:39:01.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.398+0000 7f542d1e9640 1 --2- 172.21.15.121:0/540870263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54280c3050 0x7f54280c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:01.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.398+0000 7f542c9e8640 1 -- 172.21.15.121:0/540870263 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f54281541b0 msgr2=0x7f54281eeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:01.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.398+0000 7f542c9e8640 1 --2- 172.21.15.121:0/540870263 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f54281541b0 0x7f54281eeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.398+0000 7f542c9e8640 1 -- 172.21.15.121:0/540870263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54280c3050 msgr2=0x7f54280c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:01.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.398+0000 7f542c9e8640 1 --2- 172.21.15.121:0/540870263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54280c3050 0x7f54280c6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.398+0000 7f542c9e8640 1 -- 172.21.15.121:0/540870263 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54281efb40 con 0x7f5428150430 2024-04-25T01:39:01.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.398+0000 7f542d9ea640 1 --2- 172.21.15.121:0/540870263 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f54281541b0 0x7f54281eeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:01.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.398+0000 7f542c9e8640 1 --2- 172.21.15.121:0/540870263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5428150430 0x7f5428071c70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f541800c340 tx=0x7f541800c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:01.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.398+0000 7f541dffb640 1 -- 172.21.15.121:0/540870263 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54180052d0 con 0x7f5428150430 2024-04-25T01:39:01.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.398+0000 7f541dffb640 1 -- 172.21.15.121:0/540870263 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5418005490 con 0x7f5428150430 2024-04-25T01:39:01.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.398+0000 7f542f44d640 1 -- 172.21.15.121:0/540870263 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5428072c00 con 0x7f5428150430 2024-04-25T01:39:01.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.398+0000 7f541dffb640 1 -- 172.21.15.121:0/540870263 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5418007260 con 0x7f5428150430 2024-04-25T01:39:01.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.398+0000 7f542f44d640 1 -- 172.21.15.121:0/540870263 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54280c8150 con 0x7f5428150430 2024-04-25T01:39:01.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.398+0000 7f541dffb640 1 -- 172.21.15.121:0/540870263 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5418007400 con 0x7f5428150430 2024-04-25T01:39:01.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.398+0000 7f541dffb640 1 -- 172.21.15.121:0/540870263 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f54180035f0 con 0x7f5428150430 2024-04-25T01:39:01.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.400+0000 7f542f44d640 1 -- 172.21.15.121:0/540870263 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5428072fe0 con 0x7f5428150430 2024-04-25T01:39:01.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.401+0000 7f541dffb640 1 -- 172.21.15.121:0/540870263 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f5428072fe0 con 0x7f5428150430 2024-04-25T01:39:01.393 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-25T01:39:01.413+0000 7fd6dadce040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T01:39:01.405 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T01:39:01.424+0000 7f86b720e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T01:39:01.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.488+0000 7f542f44d640 1 -- 172.21.15.121:0/540870263 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e", "id": 6} v 0) -- 0x7f542804f500 con 0x7f5428150430 2024-04-25T01:39:01.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.494+0000 7f541dffb640 1 -- 172.21.15.121:0/540870263 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f5418003b50 con 0x7f5428150430 2024-04-25T01:39:01.475 INFO:teuthology.orchestra.run.smithi121.stdout:6 2024-04-25T01:39:01.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.495+0000 7f542f44d640 1 -- 172.21.15.121:0/540870263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5428150430 msgr2=0x7f5428071c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:01.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.495+0000 7f542f44d640 1 --2- 172.21.15.121:0/540870263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5428150430 0x7f5428071c70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f541800c340 tx=0x7f541800c800 comp rx=0 tx=0).stop 2024-04-25T01:39:01.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.495+0000 7f542f44d640 1 -- 172.21.15.121:0/540870263 shutdown_connections 2024-04-25T01:39:01.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.495+0000 7f542f44d640 1 --2- 172.21.15.121:0/540870263 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f54281541b0 0x7f54281eeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.495+0000 7f542f44d640 1 --2- 172.21.15.121:0/540870263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5428150430 0x7f5428071c70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.495+0000 7f542f44d640 1 --2- 172.21.15.121:0/540870263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54280c3050 0x7f54280c6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.495+0000 7f542f44d640 1 -- 172.21.15.121:0/540870263 >> 172.21.15.121:0/540870263 conn(0x7f54280674d0 msgr2=0x7f5428152320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:01.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.495+0000 7f542f44d640 1 -- 172.21.15.121:0/540870263 shutdown_connections 2024-04-25T01:39:01.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.495+0000 7f542f44d640 1 -- 172.21.15.121:0/540870263 wait complete. 2024-04-25T01:39:01.486 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 15a060af-3466-410b-84d5-08f95afba2a5 7 2024-04-25T01:39:01.521 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-25T01:39:01.540+0000 7fd6dadce040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T01:39:01.584 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.603+0000 7fbc2d912640 1 Processor -- start 2024-04-25T01:39:01.584 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.603+0000 7fbc2d912640 1 -- start start 2024-04-25T01:39:01.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.604+0000 7fbc2d912640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbc28159810 0x7fbc280c73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:01.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.604+0000 7fbc2d912640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc280c5b20 0x7fbc28159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:01.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.604+0000 7fbc2d912640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc2815a130 con 0x7fbc280a6c20 2024-04-25T01:39:01.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.604+0000 7fbc2d912640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fbc280c1900 con 0x7fbc28159810 2024-04-25T01:39:01.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.604+0000 7fbc2d912640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fbc280c7920 con 0x7fbc280c5b20 2024-04-25T01:39:01.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.604+0000 7fbc267fc640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc280c5b20 0x7fbc28159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:01.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.604+0000 7fbc267fc640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc280c5b20 0x7fbc28159bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.121:60010/0 (socket says 172.21.15.121:60010) 2024-04-25T01:39:01.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.604+0000 7fbc267fc640 1 -- 172.21.15.121:0/2042339406 learned_addr learned my addr 172.21.15.121:0/2042339406 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-04-25T01:39:01.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.604+0000 7fbc26ffd640 1 --2- 172.21.15.121:0/2042339406 >> v2:172.21.15.77:3300/0 conn(0x7fbc28159810 0x7fbc280c73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:01.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.604+0000 7fbc267fc640 1 -- 172.21.15.121:0/2042339406 >> v2:172.21.15.77:3300/0 conn(0x7fbc28159810 msgr2=0x7fbc280c73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:01.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.604+0000 7fbc267fc640 1 --2- 172.21.15.121:0/2042339406 >> v2:172.21.15.77:3300/0 conn(0x7fbc28159810 0x7fbc280c73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.604+0000 7fbc267fc640 1 -- 172.21.15.121:0/2042339406 >> v1:172.21.15.77:6789/0 conn(0x7fbc280a6c20 legacy=0x7fbc280a70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:01.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.604+0000 7fbc267fc640 1 -- 172.21.15.121:0/2042339406 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc2806eef0 con 0x7fbc280c5b20 2024-04-25T01:39:01.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.605+0000 7fbc267fc640 1 --2- 172.21.15.121:0/2042339406 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc280c5b20 0x7fbc28159bf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbc18009870 tx=0x7fbc1802a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a0b23bc9a842321 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:01.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.605+0000 7fbc25ffb640 1 -- 172.21.15.121:0/2042339406 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc18037070 con 0x7fbc280c5b20 2024-04-25T01:39:01.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.605+0000 7fbc25ffb640 1 -- 172.21.15.121:0/2042339406 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc1802ae50 con 0x7fbc280c5b20 2024-04-25T01:39:01.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.605+0000 7fbc25ffb640 1 -- 172.21.15.121:0/2042339406 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc18032860 con 0x7fbc280c5b20 2024-04-25T01:39:01.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.606+0000 7fbc2d912640 1 -- 172.21.15.121:0/2042339406 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc280c5b20 msgr2=0x7fbc28159bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:01.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.606+0000 7fbc2d912640 1 --2- 172.21.15.121:0/2042339406 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc280c5b20 0x7fbc28159bf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbc18009870 tx=0x7fbc1802a300 comp rx=0 tx=0).stop 2024-04-25T01:39:01.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.606+0000 7fbc2d912640 1 -- 172.21.15.121:0/2042339406 shutdown_connections 2024-04-25T01:39:01.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.606+0000 7fbc2d912640 1 --2- 172.21.15.121:0/2042339406 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc280c5b20 0x7fbc28159bf0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.606+0000 7fbc2d912640 1 --2- 172.21.15.121:0/2042339406 >> v2:172.21.15.77:3300/0 conn(0x7fbc28159810 0x7fbc280c73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.606+0000 7fbc2d912640 1 -- 172.21.15.121:0/2042339406 >> 172.21.15.121:0/2042339406 conn(0x7fbc280a9870 msgr2=0x7fbc280a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:01.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.606+0000 7fbc2d912640 1 -- 172.21.15.121:0/2042339406 shutdown_connections 2024-04-25T01:39:01.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.606+0000 7fbc2d912640 1 -- 172.21.15.121:0/2042339406 wait complete. 2024-04-25T01:39:01.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.607+0000 7fbc2d912640 1 Processor -- start 2024-04-25T01:39:01.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.607+0000 7fbc2d912640 1 -- start start 2024-04-25T01:39:01.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.608+0000 7fbc2d912640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc280a6c20 0x7fbc281ebe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:01.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.608+0000 7fbc2d912640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc280c5b20 0x7fbc28158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:01.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.608+0000 7fbc2d912640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc28159810 0x7fbc28150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:01.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.608+0000 7fbc2d912640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2815a6a0 con 0x7fbc280a6c20 2024-04-25T01:39:01.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.608+0000 7fbc2d912640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2806f190 con 0x7fbc28159810 2024-04-25T01:39:01.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.608+0000 7fbc2d912640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fbc280c1d90 con 0x7fbc280c5b20 2024-04-25T01:39:01.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.608+0000 7fbc267fc640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc280c5b20 0x7fbc28158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:01.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.608+0000 7fbc267fc640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc280c5b20 0x7fbc28158b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.121:60012/0 (socket says 172.21.15.121:60012) 2024-04-25T01:39:01.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.608+0000 7fbc267fc640 1 -- 172.21.15.121:0/431906426 learned_addr learned my addr 172.21.15.121:0/431906426 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-04-25T01:39:01.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.608+0000 7fbc277fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc28159810 0x7fbc28150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:01.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.608+0000 7fbc26ffd640 1 --2- 172.21.15.121:0/431906426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc280a6c20 0x7fbc281ebe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:01.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.608+0000 7fbc26ffd640 1 -- 172.21.15.121:0/431906426 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc280c5b20 msgr2=0x7fbc28158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:01.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.608+0000 7fbc26ffd640 1 --2- 172.21.15.121:0/431906426 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc280c5b20 0x7fbc28158b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.608+0000 7fbc26ffd640 1 -- 172.21.15.121:0/431906426 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc28159810 msgr2=0x7fbc28150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:01.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.608+0000 7fbc26ffd640 1 --2- 172.21.15.121:0/431906426 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc28159810 0x7fbc28150070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.608+0000 7fbc26ffd640 1 -- 172.21.15.121:0/431906426 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc28152f10 con 0x7fbc280a6c20 2024-04-25T01:39:01.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.608+0000 7fbc26ffd640 1 --2- 172.21.15.121:0/431906426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc280a6c20 0x7fbc281ebe10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbc1000e850 tx=0x7fbc1000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:01.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.608+0000 7fbc1ffff640 1 -- 172.21.15.121:0/431906426 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc10017070 con 0x7fbc280a6c20 2024-04-25T01:39:01.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.608+0000 7fbc1ffff640 1 -- 172.21.15.121:0/431906426 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc1000c940 con 0x7fbc280a6c20 2024-04-25T01:39:01.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.608+0000 7fbc2d912640 1 -- 172.21.15.121:0/431906426 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc28154220 con 0x7fbc280a6c20 2024-04-25T01:39:01.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.608+0000 7fbc1ffff640 1 -- 172.21.15.121:0/431906426 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1000cd10 con 0x7fbc280a6c20 2024-04-25T01:39:01.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.608+0000 7fbc2d912640 1 -- 172.21.15.121:0/431906426 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc280a7250 con 0x7fbc280a6c20 2024-04-25T01:39:01.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.609+0000 7fbc1ffff640 1 -- 172.21.15.121:0/431906426 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbc1001a070 con 0x7fbc280a6c20 2024-04-25T01:39:01.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.609+0000 7fbc1ffff640 1 -- 172.21.15.121:0/431906426 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fbc1001cab0 con 0x7fbc280a6c20 2024-04-25T01:39:01.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.609+0000 7fbc2d912640 1 -- 172.21.15.121:0/431906426 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc2804f500 con 0x7fbc280a6c20 2024-04-25T01:39:01.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.611+0000 7fbc1ffff640 1 -- 172.21.15.121:0/431906426 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fbc1001c4b0 con 0x7fbc280a6c20 2024-04-25T01:39:01.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.684+0000 7fbc2d912640 1 -- 172.21.15.121:0/431906426 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd new", "uuid": "15a060af-3466-410b-84d5-08f95afba2a5", "id": 7} v 0) -- 0x7fbc2806e4a0 con 0x7fbc280a6c20 2024-04-25T01:39:01.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.686+0000 7fbc1ffff640 1 -- 172.21.15.121:0/431906426 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "15a060af-3466-410b-84d5-08f95afba2a5", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fbc1001c7c0 con 0x7fbc280a6c20 2024-04-25T01:39:01.667 INFO:teuthology.orchestra.run.smithi121.stdout:7 2024-04-25T01:39:01.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.687+0000 7fbc2d912640 1 -- 172.21.15.121:0/431906426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc280a6c20 msgr2=0x7fbc281ebe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:01.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.687+0000 7fbc2d912640 1 --2- 172.21.15.121:0/431906426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc280a6c20 0x7fbc281ebe10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbc1000e850 tx=0x7fbc1000ed10 comp rx=0 tx=0).stop 2024-04-25T01:39:01.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.687+0000 7fbc2d912640 1 -- 172.21.15.121:0/431906426 shutdown_connections 2024-04-25T01:39:01.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.687+0000 7fbc2d912640 1 --2- 172.21.15.121:0/431906426 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc28159810 0x7fbc28150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.687+0000 7fbc2d912640 1 --2- 172.21.15.121:0/431906426 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc280c5b20 0x7fbc28158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.687+0000 7fbc2d912640 1 --2- 172.21.15.121:0/431906426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc280a6c20 0x7fbc281ebe10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.687+0000 7fbc2d912640 1 -- 172.21.15.121:0/431906426 >> 172.21.15.121:0/431906426 conn(0x7fbc280a9870 msgr2=0x7fbc28072f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:01.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.687+0000 7fbc2d912640 1 -- 172.21.15.121:0/431906426 shutdown_connections 2024-04-25T01:39:01.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:01.687+0000 7fbc2d912640 1 -- 172.21.15.121:0/431906426 wait complete. 2024-04-25T01:39:01.678 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T01:39:01.678 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T01:39:01.680 INFO:tasks.ceph.osd.0:Started 2024-04-25T01:39:01.680 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T01:39:01.680 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T01:39:01.684 INFO:tasks.ceph.osd.1:Started 2024-04-25T01:39:01.685 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T01:39:01.685 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T01:39:01.687 INFO:tasks.ceph.osd.2:Started 2024-04-25T01:39:01.687 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T01:39:01.687 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T01:39:01.689 INFO:tasks.ceph.osd.3:Started 2024-04-25T01:39:01.689 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T01:39:01.689 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-25T01:39:01.721 INFO:tasks.ceph.osd.4:Started 2024-04-25T01:39:01.721 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T01:39:01.721 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-25T01:39:01.723 INFO:tasks.ceph.osd.5:Started 2024-04-25T01:39:01.723 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-25T01:39:01.723 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-25T01:39:01.725 INFO:tasks.ceph.osd.6:Started 2024-04-25T01:39:01.726 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-25T01:39:01.726 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-25T01:39:01.728 INFO:tasks.ceph.osd.7:Started 2024-04-25T01:39:01.728 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T01:39:01.810 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T01:39:01.828+0000 7f86b720e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T01:39:01.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.859+0000 7f0b36d9e640 1 Processor -- start 2024-04-25T01:39:01.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.860+0000 7f0b36d9e640 1 -- start start 2024-04-25T01:39:01.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.860+0000 7f0b36d9e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0b30156db0 0x7f0b300c9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:01.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.860+0000 7f0b36d9e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0b300cb2c0 0x7f0b300ab080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:01.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.860+0000 7f0b35d9c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0b301538a0 0x7f0b300c60d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:47172/0 (socket says 172.21.15.77:47172) 2024-04-25T01:39:01.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.860+0000 7f0b36d9e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b300c68b0 con 0x7f0b301538a0 2024-04-25T01:39:01.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.860+0000 7f0b36d9e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f0b301562d0 con 0x7f0b300cb2c0 2024-04-25T01:39:01.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.860+0000 7f0b36d9e640 1 -- 172.21.15.77:0/3362976843 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f0b301565b0 con 0x7f0b30156db0 2024-04-25T01:39:01.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.860+0000 7f0b35d9c640 1 -- 172.21.15.77:0/3362976843 learned_addr learned my addr 172.21.15.77:0/3362976843 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:01.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.860+0000 7f0b3659d640 1 --2- 172.21.15.77:0/3362976843 >> v2:172.21.15.77:3300/0 conn(0x7f0b300cb2c0 0x7f0b300ab080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:01.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.861+0000 7f0b3559b640 1 --2- 172.21.15.77:0/3362976843 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0b30156db0 0x7f0b300c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:01.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.861+0000 7f0b3659d640 1 -- 172.21.15.77:0/3362976843 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0b30156db0 msgr2=0x7f0b300c9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:01.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.861+0000 7f0b3659d640 1 --2- 172.21.15.77:0/3362976843 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0b30156db0 0x7f0b300c9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.861+0000 7f0b3659d640 1 -- 172.21.15.77:0/3362976843 >> v1:172.21.15.77:6789/0 conn(0x7f0b301538a0 legacy=0x7f0b300c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:01.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.861+0000 7f0b3659d640 1 -- 172.21.15.77:0/3362976843 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b30156890 con 0x7f0b300cb2c0 2024-04-25T01:39:01.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.861+0000 7f0b3659d640 1 --2- 172.21.15.77:0/3362976843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b300cb2c0 0x7f0b300ab080 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009d90 tx=0x7f0b2802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554df5038ceafb9c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:01.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.862+0000 7f0b34d9a640 1 -- 172.21.15.77:0/3362976843 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b28007740 con 0x7f0b300cb2c0 2024-04-25T01:39:01.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.862+0000 7f0b34d9a640 1 -- 172.21.15.77:0/3362976843 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b280078e0 con 0x7f0b300cb2c0 2024-04-25T01:39:01.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.862+0000 7f0b34d9a640 1 -- 172.21.15.77:0/3362976843 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b28007cf0 con 0x7f0b300cb2c0 2024-04-25T01:39:01.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.862+0000 7f0b36d9e640 1 -- 172.21.15.77:0/3362976843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b300cb2c0 msgr2=0x7f0b300ab080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:01.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.862+0000 7f0b36d9e640 1 --2- 172.21.15.77:0/3362976843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b300cb2c0 0x7f0b300ab080 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009d90 tx=0x7f0b2802a5f0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.862+0000 7f0b36d9e640 1 -- 172.21.15.77:0/3362976843 shutdown_connections 2024-04-25T01:39:01.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.862+0000 7f0b36d9e640 1 --2- 172.21.15.77:0/3362976843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b300cb2c0 0x7f0b300ab080 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.862+0000 7f0b36d9e640 1 --2- 172.21.15.77:0/3362976843 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0b30156db0 0x7f0b300c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.862+0000 7f0b36d9e640 1 -- 172.21.15.77:0/3362976843 >> 172.21.15.77:0/3362976843 conn(0x7f0b300cb750 msgr2=0x7f0b300cbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:01.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.862+0000 7f0b36d9e640 1 -- 172.21.15.77:0/3362976843 shutdown_connections 2024-04-25T01:39:01.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.862+0000 7f0b36d9e640 1 -- 172.21.15.77:0/3362976843 wait complete. 2024-04-25T01:39:01.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.864+0000 7f0b36d9e640 1 Processor -- start 2024-04-25T01:39:01.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.864+0000 7f0b36d9e640 1 -- start start 2024-04-25T01:39:01.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.864+0000 7f0b36d9e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b300cb2c0 0x7f0b30158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:01.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.864+0000 7f0b36d9e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0b301538a0 0x7f0b300c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:01.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.864+0000 7f0b36d9e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b30156db0 0x7f0b30149be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:01.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.864+0000 7f0b36d9e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0b300ab5c0 con 0x7f0b30156db0 2024-04-25T01:39:01.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.864+0000 7f0b36d9e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0b300c9fc0 con 0x7f0b300cb2c0 2024-04-25T01:39:01.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.864+0000 7f0b36d9e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f0b300ab740 con 0x7f0b301538a0 2024-04-25T01:39:01.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.864+0000 7f0b3659d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b30156db0 0x7f0b30149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:01.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.864+0000 7f0b3659d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b30156db0 0x7f0b30149be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49486/0 (socket says 172.21.15.77:49486) 2024-04-25T01:39:01.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.864+0000 7f0b3659d640 1 -- 172.21.15.77:0/3603031167 learned_addr learned my addr 172.21.15.77:0/3603031167 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:01.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.865+0000 7f0b3559b640 1 --2- 172.21.15.77:0/3603031167 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0b301538a0 0x7f0b300c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:01.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.865+0000 7f0b35d9c640 1 --2- 172.21.15.77:0/3603031167 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b300cb2c0 0x7f0b30158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:01.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.865+0000 7f0b3659d640 1 -- 172.21.15.77:0/3603031167 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0b301538a0 msgr2=0x7f0b300c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:01.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.865+0000 7f0b3659d640 1 --2- 172.21.15.77:0/3603031167 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0b301538a0 0x7f0b300c53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.865+0000 7f0b3659d640 1 -- 172.21.15.77:0/3603031167 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b300cb2c0 msgr2=0x7f0b30158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:01.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.865+0000 7f0b3659d640 1 --2- 172.21.15.77:0/3603031167 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b300cb2c0 0x7f0b30158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.865+0000 7f0b3659d640 1 -- 172.21.15.77:0/3603031167 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b300c4070 con 0x7f0b30156db0 2024-04-25T01:39:01.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.865+0000 7f0b3659d640 1 --2- 172.21.15.77:0/3603031167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b30156db0 0x7f0b30149be0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009d90 tx=0x7f0b28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:01.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.865+0000 7f0b267fc640 1 -- 172.21.15.77:0/3603031167 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b2803f070 con 0x7f0b30156db0 2024-04-25T01:39:01.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.865+0000 7f0b267fc640 1 -- 172.21.15.77:0/3603031167 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b28031bc0 con 0x7f0b30156db0 2024-04-25T01:39:01.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.865+0000 7f0b36d9e640 1 -- 172.21.15.77:0/3603031167 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b300c2820 con 0x7f0b30156db0 2024-04-25T01:39:01.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.865+0000 7f0b267fc640 1 -- 172.21.15.77:0/3603031167 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b28009450 con 0x7f0b30156db0 2024-04-25T01:39:01.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.865+0000 7f0b36d9e640 1 -- 172.21.15.77:0/3603031167 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b301f03a0 con 0x7f0b30156db0 2024-04-25T01:39:01.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.865+0000 7f0b267fc640 1 -- 172.21.15.77:0/3603031167 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0b28044460 con 0x7f0b30156db0 2024-04-25T01:39:01.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.865+0000 7f0b267fc640 1 -- 172.21.15.77:0/3603031167 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f0b2804e3f0 con 0x7f0b30156db0 2024-04-25T01:39:01.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.866+0000 7f0b13fff640 1 -- 172.21.15.77:0/3603031167 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b0c005290 con 0x7f0b30156db0 2024-04-25T01:39:01.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.868+0000 7f0b267fc640 1 -- 172.21.15.77:0/3603031167 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f0b28053080 con 0x7f0b30156db0 2024-04-25T01:39:01.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.928+0000 7f0b13fff640 1 -- 172.21.15.77:0/3603031167 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0b0c005850 con 0x7f0b30156db0 2024-04-25T01:39:01.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.929+0000 7f0b267fc640 1 -- 172.21.15.77:0/3603031167 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f0b28007840 con 0x7f0b30156db0 2024-04-25T01:39:01.911 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:01.911 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":10,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:39:01.685420+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:39:01.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.930+0000 7f0b13fff640 1 -- 172.21.15.77:0/3603031167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b30156db0 msgr2=0x7f0b30149be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:01.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.930+0000 7f0b13fff640 1 --2- 172.21.15.77:0/3603031167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b30156db0 0x7f0b30149be0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009d90 tx=0x7f0b28004a40 comp rx=0 tx=0).stop 2024-04-25T01:39:01.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.930+0000 7f0b13fff640 1 -- 172.21.15.77:0/3603031167 shutdown_connections 2024-04-25T01:39:01.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.930+0000 7f0b13fff640 1 --2- 172.21.15.77:0/3603031167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b30156db0 0x7f0b30149be0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.930+0000 7f0b13fff640 1 --2- 172.21.15.77:0/3603031167 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0b301538a0 0x7f0b300c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.930+0000 7f0b13fff640 1 --2- 172.21.15.77:0/3603031167 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b300cb2c0 0x7f0b30158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:01.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.930+0000 7f0b13fff640 1 -- 172.21.15.77:0/3603031167 >> 172.21.15.77:0/3603031167 conn(0x7f0b300cb750 msgr2=0x7f0b300ac350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:01.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.930+0000 7f0b13fff640 1 -- 172.21.15.77:0/3603031167 shutdown_connections 2024-04-25T01:39:01.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:01.930+0000 7f0b13fff640 1 -- 172.21.15.77:0/3603031167 wait complete. 2024-04-25T01:39:01.922 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T01:39:01.922 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T01:39:01.932 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-25T01:39:01.951+0000 7fd6dadce040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T01:39:02.075 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T01:39:02.093+0000 7f86b720e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T01:39:02.127 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T01:39:02.146+0000 7f86b720e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T01:39:02.188 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-25T01:39:02.207+0000 7fd6dadce040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T01:39:02.239 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-25T01:39:02.258+0000 7fd6dadce040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T01:39:02.241 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T01:39:02.260+0000 7f86b720e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T01:39:02.290 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-25T01:39:02.308+0000 7f40d1bdc640 -1 Falling back to public interface 2024-04-25T01:39:02.298 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-25T01:39:02.316+0000 7f8364663640 -1 Falling back to public interface 2024-04-25T01:39:02.298 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-25T01:39:02.316+0000 7f306f825640 -1 Falling back to public interface 2024-04-25T01:39:02.298 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-25T01:39:02.317+0000 7f44bae9b640 -1 Falling back to public interface 2024-04-25T01:39:02.300 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-25T01:39:02.319+0000 7f8363612640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6826/0: (98) Address already in use 2024-04-25T01:39:02.319 INFO:tasks.ceph.osd.4.smithi121.stderr:2024-04-25T01:39:02.338+0000 7fb0afb2a640 -1 Falling back to public interface 2024-04-25T01:39:02.319 INFO:tasks.ceph.osd.5.smithi121.stderr:2024-04-25T01:39:02.339+0000 7fcf038dd640 -1 Falling back to public interface 2024-04-25T01:39:02.340 INFO:tasks.ceph.osd.7.smithi121.stderr:2024-04-25T01:39:02.359+0000 7febdb011640 -1 Falling back to public interface 2024-04-25T01:39:02.340 INFO:tasks.ceph.osd.6.smithi121.stderr:2024-04-25T01:39:02.360+0000 7fc176bcb640 -1 Falling back to public interface 2024-04-25T01:39:02.362 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-25T01:39:02.382+0000 7fd6dadce040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T01:39:02.520 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T01:39:02.538+0000 7f86b720e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T01:39:02.568 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T01:39:02.586+0000 7f86b720e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T01:39:02.643 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-25T01:39:02.662+0000 7fd6dadce040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T01:39:02.689 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-25T01:39:02.709+0000 7fd6dadce040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T01:39:02.725 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T01:39:02.744+0000 7f86b720e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T01:39:02.729 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T01:39:02.819 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.837+0000 7ff2f575a640 1 Processor -- start 2024-04-25T01:39:02.819 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.838+0000 7ff2f575a640 1 -- start start 2024-04-25T01:39:02.821 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.838+0000 7ff2f575a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff2f006c3a0 0x7ff2f00aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:02.821 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.838+0000 7ff2f575a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2f0152de0 con 0x7ff2f0066ff0 2024-04-25T01:39:02.821 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.838+0000 7ff2f575a640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2f00ab2b0 con 0x7ff2f0153980 2024-04-25T01:39:02.821 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.838+0000 7ff2f575a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff2f00ad3f0 con 0x7ff2f006c3a0 2024-04-25T01:39:02.821 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.838+0000 7ff2eeffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff2f006c3a0 0x7ff2f00aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:02.821 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.838+0000 7ff2eeffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff2f006c3a0 0x7ff2f00aceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49496/0 (socket says 172.21.15.77:49496) 2024-04-25T01:39:02.821 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.838+0000 7ff2eeffd640 1 -- 172.21.15.77:0/238189481 learned_addr learned my addr 172.21.15.77:0/238189481 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:02.822 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.838+0000 7ff2e7fff640 1 --1- 172.21.15.77:0/238189481 >> v1:172.21.15.77:6789/0 conn(0x7ff2f0066ff0 0x7ff2f0153270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:47186/0 (socket says 172.21.15.77:47186) 2024-04-25T01:39:02.822 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.839+0000 7ff2eeffd640 1 -- 172.21.15.77:0/238189481 >> v1:172.21.15.121:6789/0 conn(0x7ff2f0153980 legacy=0x7ff2f00c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:02.822 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.839+0000 7ff2eeffd640 1 -- 172.21.15.77:0/238189481 >> v1:172.21.15.77:6789/0 conn(0x7ff2f0066ff0 legacy=0x7ff2f0153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:02.822 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.839+0000 7ff2eeffd640 1 -- 172.21.15.77:0/238189481 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f00ab590 con 0x7ff2f006c3a0 2024-04-25T01:39:02.822 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.839+0000 7ff2eeffd640 1 --2- 172.21.15.77:0/238189481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2f006c3a0 0x7ff2f00aceb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009870 tx=0x7ff2e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd83c08db3c651b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:02.822 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.839+0000 7ff2ee7fc640 1 -- 172.21.15.77:0/238189481 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0037070 con 0x7ff2f006c3a0 2024-04-25T01:39:02.822 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.840+0000 7ff2ee7fc640 1 -- 172.21.15.77:0/238189481 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2e0032440 con 0x7ff2f006c3a0 2024-04-25T01:39:02.822 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.840+0000 7ff2ee7fc640 1 -- 172.21.15.77:0/238189481 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0032810 con 0x7ff2f006c3a0 2024-04-25T01:39:02.825 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.840+0000 7ff2f575a640 1 -- 172.21.15.77:0/238189481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2f006c3a0 msgr2=0x7ff2f00aceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:02.825 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.840+0000 7ff2f575a640 1 --2- 172.21.15.77:0/238189481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2f006c3a0 0x7ff2f00aceb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009870 tx=0x7ff2e002a270 comp rx=0 tx=0).stop 2024-04-25T01:39:02.825 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.840+0000 7ff2f575a640 1 -- 172.21.15.77:0/238189481 shutdown_connections 2024-04-25T01:39:02.825 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.840+0000 7ff2f575a640 1 --2- 172.21.15.77:0/238189481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2f006c3a0 0x7ff2f00aceb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:02.825 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.840+0000 7ff2f575a640 1 -- 172.21.15.77:0/238189481 >> 172.21.15.77:0/238189481 conn(0x7ff2f00c4bd0 msgr2=0x7ff2f00c4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:02.825 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.840+0000 7ff2f575a640 1 -- 172.21.15.77:0/238189481 shutdown_connections 2024-04-25T01:39:02.825 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.840+0000 7ff2f575a640 1 -- 172.21.15.77:0/238189481 wait complete. 2024-04-25T01:39:02.826 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.841+0000 7ff2f575a640 1 Processor -- start 2024-04-25T01:39:02.826 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.841+0000 7ff2f575a640 1 -- start start 2024-04-25T01:39:02.826 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.842+0000 7ff2f575a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2f0066ff0 0x7ff2f01ec4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:02.826 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.842+0000 7ff2f575a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2f006c3a0 0x7ff2f014af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:02.826 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.842+0000 7ff2f575a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2f0153980 0x7ff2f01e8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:02.826 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.842+0000 7ff2f575a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f00ab870 con 0x7ff2f0153980 2024-04-25T01:39:02.826 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.842+0000 7ff2f575a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f00ad640 con 0x7ff2f0066ff0 2024-04-25T01:39:02.826 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.842+0000 7ff2f575a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f00ab9f0 con 0x7ff2f006c3a0 2024-04-25T01:39:02.826 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.842+0000 7ff2ef7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2f0153980 0x7ff2f01e8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:02.826 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.842+0000 7ff2ef7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2f0153980 0x7ff2f01e8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49500/0 (socket says 172.21.15.77:49500) 2024-04-25T01:39:02.826 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.842+0000 7ff2eeffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2f0066ff0 0x7ff2f01ec4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:02.826 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.842+0000 7ff2ef7fe640 1 -- 172.21.15.77:0/2132011495 learned_addr learned my addr 172.21.15.77:0/2132011495 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:02.826 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.842+0000 7ff2e7fff640 1 --2- 172.21.15.77:0/2132011495 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2f006c3a0 0x7ff2f014af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:02.826 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.842+0000 7ff2ef7fe640 1 -- 172.21.15.77:0/2132011495 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2f006c3a0 msgr2=0x7ff2f014af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:02.827 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.842+0000 7ff2ef7fe640 1 --2- 172.21.15.77:0/2132011495 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2f006c3a0 0x7ff2f014af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:02.827 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.842+0000 7ff2ef7fe640 1 -- 172.21.15.77:0/2132011495 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2f0066ff0 msgr2=0x7ff2f01ec4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:02.827 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.842+0000 7ff2ef7fe640 1 --2- 172.21.15.77:0/2132011495 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2f0066ff0 0x7ff2f01ec4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:02.827 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.842+0000 7ff2ef7fe640 1 -- 172.21.15.77:0/2132011495 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f0072d10 con 0x7ff2f0153980 2024-04-25T01:39:02.827 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.843+0000 7ff2ef7fe640 1 --2- 172.21.15.77:0/2132011495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2f0153980 0x7ff2f01e8ba0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800e980 tx=0x7ff2e800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:02.827 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.843+0000 7ff2e77fe640 1 -- 172.21.15.77:0/2132011495 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8001f50 con 0x7ff2f0153980 2024-04-25T01:39:02.827 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.843+0000 7ff2e77fe640 1 -- 172.21.15.77:0/2132011495 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2e8003970 con 0x7ff2f0153980 2024-04-25T01:39:02.827 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.843+0000 7ff2f575a640 1 -- 172.21.15.77:0/2132011495 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f0072750 con 0x7ff2f0153980 2024-04-25T01:39:02.827 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.843+0000 7ff2e77fe640 1 -- 172.21.15.77:0/2132011495 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8003d60 con 0x7ff2f0153980 2024-04-25T01:39:02.827 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.843+0000 7ff2f575a640 1 -- 172.21.15.77:0/2132011495 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f01e8680 con 0x7ff2f0153980 2024-04-25T01:39:02.827 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.843+0000 7ff2e77fe640 1 -- 172.21.15.77:0/2132011495 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff2e80050d0 con 0x7ff2f0153980 2024-04-25T01:39:02.827 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.843+0000 7ff2e77fe640 1 -- 172.21.15.77:0/2132011495 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7ff2e801aac0 con 0x7ff2f0153980 2024-04-25T01:39:02.827 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.844+0000 7ff2f575a640 1 -- 172.21.15.77:0/2132011495 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2f01e8880 con 0x7ff2f0153980 2024-04-25T01:39:02.828 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.846+0000 7ff2e77fe640 1 -- 172.21.15.77:0/2132011495 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7ff2f01e8880 con 0x7ff2f0153980 2024-04-25T01:39:02.845 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-25T01:39:02.864+0000 7fd6dadce040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T01:39:02.869 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T01:39:02.888+0000 7f86b720e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T01:39:02.890 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.908+0000 7ff2f575a640 1 -- 172.21.15.77:0/2132011495 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2f0150dc0 con 0x7ff2f0153980 2024-04-25T01:39:02.890 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.909+0000 7ff2e77fe640 1 -- 172.21.15.77:0/2132011495 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7ff2e8016020 con 0x7ff2f0153980 2024-04-25T01:39:02.891 INFO:teuthology.misc.health.smithi077.stdout: 2024-04-25T01:39:02.891 INFO:teuthology.misc.health.smithi077.stdout:{"epoch":10,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:39:01.685420+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:39:02.892 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.910+0000 7ff2f575a640 1 -- 172.21.15.77:0/2132011495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2f0153980 msgr2=0x7ff2f01e8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:02.892 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.910+0000 7ff2f575a640 1 --2- 172.21.15.77:0/2132011495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2f0153980 0x7ff2f01e8ba0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800e980 tx=0x7ff2e800ee40 comp rx=0 tx=0).stop 2024-04-25T01:39:02.892 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.910+0000 7ff2f575a640 1 -- 172.21.15.77:0/2132011495 shutdown_connections 2024-04-25T01:39:02.892 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.910+0000 7ff2f575a640 1 --2- 172.21.15.77:0/2132011495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2f0153980 0x7ff2f01e8ba0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:02.892 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.910+0000 7ff2f575a640 1 --2- 172.21.15.77:0/2132011495 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2f006c3a0 0x7ff2f014af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:02.892 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.910+0000 7ff2f575a640 1 --2- 172.21.15.77:0/2132011495 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2f0066ff0 0x7ff2f01ec4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:02.892 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.910+0000 7ff2f575a640 1 -- 172.21.15.77:0/2132011495 >> 172.21.15.77:0/2132011495 conn(0x7ff2f00c4bd0 msgr2=0x7ff2f0151450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:02.892 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.910+0000 7ff2f575a640 1 -- 172.21.15.77:0/2132011495 shutdown_connections 2024-04-25T01:39:02.892 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:02.910+0000 7ff2f575a640 1 -- 172.21.15.77:0/2132011495 wait complete. 2024-04-25T01:39:02.900 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T01:39:02.921 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T01:39:02.940+0000 7f86b720e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T01:39:02.981 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-25T01:39:03.000+0000 7fd6dadce040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T01:39:02.990 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T01:39:03.009+0000 7f86b720e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T01:39:03.030 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-25T01:39:03.049+0000 7fd6dadce040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T01:39:03.034 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T01:39:03.053+0000 7f86b720e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T01:39:03.098 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-25T01:39:03.117+0000 7fd6dadce040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T01:39:03.144 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-25T01:39:03.163+0000 7fd6dadce040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T01:39:03.508 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T01:39:03.527+0000 7f86b720e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T01:39:03.619 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-25T01:39:03.638+0000 7fd6dadce040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T01:39:03.622 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T01:39:03.641+0000 7f86b720e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T01:39:03.740 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-04-25T01:39:03.759+0000 7fd6dadce040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T01:39:04.636 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T01:39:04.654+0000 7f86579c1640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T01:39:04.636 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-25T01:39:04.654+0000 7f86579c1640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T01:39:05.770 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-25T01:39:05.788+0000 7f306f825640 -1 osd.2 0 log_to_monitors true 2024-04-25T01:39:05.778 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-25T01:39:05.796+0000 7f40d1bdc640 -1 osd.1 0 log_to_monitors true 2024-04-25T01:39:05.793 INFO:tasks.ceph.osd.4.smithi121.stderr:2024-04-25T01:39:05.813+0000 7fb0afb2a640 -1 osd.4 0 log_to_monitors true 2024-04-25T01:39:05.813 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-25T01:39:05.832+0000 7f44bae9b640 -1 osd.3 0 log_to_monitors true 2024-04-25T01:39:05.834 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-25T01:39:05.853+0000 7f8364663640 -1 osd.0 0 log_to_monitors true 2024-04-25T01:39:05.871 INFO:tasks.ceph.osd.6.smithi121.stderr:2024-04-25T01:39:05.890+0000 7fc176bcb640 -1 osd.6 0 log_to_monitors true 2024-04-25T01:39:05.872 INFO:tasks.ceph.osd.7.smithi121.stderr:2024-04-25T01:39:05.891+0000 7febdb011640 -1 osd.7 0 log_to_monitors true 2024-04-25T01:39:05.878 INFO:tasks.ceph.osd.5.smithi121.stderr:2024-04-25T01:39:05.897+0000 7fcf038dd640 -1 osd.5 0 log_to_monitors true 2024-04-25T01:39:09.701 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-25T01:39:09.719+0000 7f835fdd6640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T01:39:09.702 INFO:tasks.ceph.osd.5.smithi121.stderr:2024-04-25T01:39:09.720+0000 7fceff050640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T01:39:09.707 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T01:39:09.711 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-25T01:39:09.727+0000 7f44b660e640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T01:39:09.712 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-25T01:39:09.730+0000 7f8358408640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T01:39:09.716 INFO:tasks.ceph.osd.5.smithi121.stderr:2024-04-25T01:39:09.735+0000 7fcef7682640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T01:39:09.718 INFO:tasks.ceph.osd.7.smithi121.stderr:2024-04-25T01:39:09.737+0000 7febd6175640 -1 osd.7 0 waiting for initial osdmap 2024-04-25T01:39:09.719 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-25T01:39:09.738+0000 7f306c27c640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T01:39:09.721 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-25T01:39:09.740+0000 7f44aec40640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T01:39:09.735 INFO:tasks.ceph.osd.7.smithi121.stderr:2024-04-25T01:39:09.754+0000 7febce7a7640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T01:39:09.743 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-25T01:39:09.761+0000 7f40ceb87640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T01:39:09.743 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-25T01:39:09.762+0000 7f3063076640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T01:39:09.756 INFO:tasks.ceph.osd.4.smithi121.stderr:2024-04-25T01:39:09.774+0000 7fb0ab29d640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T01:39:09.756 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-25T01:39:09.775+0000 7f40c5981640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T01:39:09.765 INFO:tasks.ceph.osd.6.smithi121.stderr:2024-04-25T01:39:09.784+0000 7fc173b76640 -1 osd.6 0 waiting for initial osdmap 2024-04-25T01:39:09.769 INFO:tasks.ceph.osd.4.smithi121.stderr:2024-04-25T01:39:09.788+0000 7fb0a38cf640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T01:39:09.775 INFO:tasks.ceph.osd.6.smithi121.stderr:2024-04-25T01:39:09.794+0000 7fc16a970640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T01:39:09.803 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.822+0000 7f7cd1ae1640 1 Processor -- start 2024-04-25T01:39:09.804 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.822+0000 7f7cd1ae1640 1 -- start start 2024-04-25T01:39:09.805 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.822+0000 7f7cd1ae1640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ccc0c6220 0x7f7ccc0c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:09.805 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.822+0000 7f7cd1ae1640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7ccc06d210 0x7f7ccc0c6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:09.805 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.822+0000 7f7cd1ae1640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ccc0cbfc0 con 0x7f7ccc159f50 2024-04-25T01:39:09.805 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.822+0000 7f7cd1ae1640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f7ccc0cbd90 con 0x7f7ccc06d210 2024-04-25T01:39:09.805 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.822+0000 7f7cd1ae1640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f7ccc0c91c0 con 0x7f7ccc0c6220 2024-04-25T01:39:09.805 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.823+0000 7f7ccaffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7ccc06d210 0x7f7ccc0c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:09.805 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.823+0000 7f7ccb7fe640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ccc0c6220 0x7f7ccc0c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:09.806 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.823+0000 7f7ccbfff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f7ccc159f50 0x7f7ccc0c8ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.77:40496/0 (socket says 172.21.15.77:40496) 2024-04-25T01:39:09.806 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.823+0000 7f7ccaffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7ccc06d210 0x7f7ccc0c6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:48890/0 (socket says 172.21.15.77:48890) 2024-04-25T01:39:09.806 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.823+0000 7f7ccbfff640 1 -- 172.21.15.77:0/3249683832 learned_addr learned my addr 172.21.15.77:0/3249683832 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:09.806 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.823+0000 7f7ccb7fe640 1 -- 172.21.15.77:0/3249683832 >> v2:172.21.15.121:3300/0 conn(0x7f7ccc06d210 msgr2=0x7f7ccc0c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:09.806 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.823+0000 7f7ccb7fe640 1 --2- 172.21.15.77:0/3249683832 >> v2:172.21.15.121:3300/0 conn(0x7f7ccc06d210 0x7f7ccc0c6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:09.806 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.823+0000 7f7cca7fc640 1 -- 172.21.15.77:0/3249683832 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 350087310 0 0) 0x7f7ccc0cbfc0 con 0x7f7ccc159f50 2024-04-25T01:39:09.806 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.823+0000 7f7ccb7fe640 1 -- 172.21.15.77:0/3249683832 >> v1:172.21.15.121:6789/0 conn(0x7f7ccc159f50 legacy=0x7f7ccc0c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:09.806 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.823+0000 7f7ccb7fe640 1 -- 172.21.15.77:0/3249683832 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ccc0cc2a0 con 0x7f7ccc0c6220 2024-04-25T01:39:09.808 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.824+0000 7f7ccb7fe640 1 --2- 172.21.15.77:0/3249683832 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ccc0c6220 0x7f7ccc0c97a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc0097a0 tx=0x7f7cbc02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8737937d068bef60 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:09.808 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.824+0000 7f7cca7fc640 1 -- 172.21.15.77:0/3249683832 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc037070 con 0x7f7ccc0c6220 2024-04-25T01:39:09.808 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.824+0000 7f7cca7fc640 1 -- 172.21.15.77:0/3249683832 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cbc02ae50 con 0x7f7ccc0c6220 2024-04-25T01:39:09.808 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.824+0000 7f7cca7fc640 1 -- 172.21.15.77:0/3249683832 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc032660 con 0x7f7ccc0c6220 2024-04-25T01:39:09.808 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.824+0000 7f7cd1ae1640 1 -- 172.21.15.77:0/3249683832 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ccc0c6220 msgr2=0x7f7ccc0c97a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:09.808 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.824+0000 7f7cd1ae1640 1 --2- 172.21.15.77:0/3249683832 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ccc0c6220 0x7f7ccc0c97a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc0097a0 tx=0x7f7cbc02a100 comp rx=0 tx=0).stop 2024-04-25T01:39:09.808 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.824+0000 7f7cd1ae1640 1 -- 172.21.15.77:0/3249683832 shutdown_connections 2024-04-25T01:39:09.808 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.824+0000 7f7cd1ae1640 1 --2- 172.21.15.77:0/3249683832 >> v2:172.21.15.121:3300/0 conn(0x7f7ccc06d210 0x7f7ccc0c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:09.808 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.824+0000 7f7cd1ae1640 1 --2- 172.21.15.77:0/3249683832 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ccc0c6220 0x7f7ccc0c97a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:09.808 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.824+0000 7f7cd1ae1640 1 -- 172.21.15.77:0/3249683832 >> 172.21.15.77:0/3249683832 conn(0x7f7ccc067410 msgr2=0x7f7ccc067820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:09.808 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.825+0000 7f7cd1ae1640 1 -- 172.21.15.77:0/3249683832 shutdown_connections 2024-04-25T01:39:09.809 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.825+0000 7f7cd1ae1640 1 -- 172.21.15.77:0/3249683832 wait complete. 2024-04-25T01:39:09.809 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.826+0000 7f7cd1ae1640 1 Processor -- start 2024-04-25T01:39:09.809 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.826+0000 7f7cd1ae1640 1 -- start start 2024-04-25T01:39:09.811 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.826+0000 7f7cd1ae1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ccc06d210 0x7f7ccc0ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:09.811 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.826+0000 7f7cd1ae1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ccc0c6220 0x7f7ccc0c4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:09.812 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.826+0000 7f7cd1ae1640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ccc159f50 0x7f7ccc0c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:09.812 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.826+0000 7f7cd1ae1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7ccc0c8590 con 0x7f7ccc0c6220 2024-04-25T01:39:09.812 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.826+0000 7f7cd1ae1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7ccc0c82b0 con 0x7f7ccc06d210 2024-04-25T01:39:09.812 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.826+0000 7f7cd1ae1640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f7ccc15a360 con 0x7f7ccc159f50 2024-04-25T01:39:09.812 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.826+0000 7f7ccaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ccc0c6220 0x7f7ccc0c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:09.812 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.827+0000 7f7ccaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ccc0c6220 0x7f7ccc0c4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37586/0 (socket says 172.21.15.77:37586) 2024-04-25T01:39:09.812 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.827+0000 7f7ccaffd640 1 -- 172.21.15.77:0/3481313617 learned_addr learned my addr 172.21.15.77:0/3481313617 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:09.812 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.827+0000 7f7ccb7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ccc06d210 0x7f7ccc0ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:09.812 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.827+0000 7f7ccbfff640 1 --2- 172.21.15.77:0/3481313617 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ccc159f50 0x7f7ccc0c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:09.812 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.827+0000 7f7ccb7fe640 1 -- 172.21.15.77:0/3481313617 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ccc159f50 msgr2=0x7f7ccc0c4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:09.812 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.827+0000 7f7ccb7fe640 1 --2- 172.21.15.77:0/3481313617 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ccc159f50 0x7f7ccc0c4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:09.812 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.827+0000 7f7ccb7fe640 1 -- 172.21.15.77:0/3481313617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ccc0c6220 msgr2=0x7f7ccc0c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:09.812 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.827+0000 7f7ccb7fe640 1 --2- 172.21.15.77:0/3481313617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ccc0c6220 0x7f7ccc0c4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:09.812 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.827+0000 7f7ccb7fe640 1 -- 172.21.15.77:0/3481313617 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ccc156ce0 con 0x7f7ccc06d210 2024-04-25T01:39:09.813 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.827+0000 7f7ccaffd640 1 --2- 172.21.15.77:0/3481313617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ccc0c6220 0x7f7ccc0c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:09.813 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.827+0000 7f7ccbfff640 1 --2- 172.21.15.77:0/3481313617 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ccc159f50 0x7f7ccc0c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:09.813 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.827+0000 7f7ccb7fe640 1 --2- 172.21.15.77:0/3481313617 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ccc06d210 0x7f7ccc0ad7c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc031000 tx=0x7f7cbc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:09.813 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.827+0000 7f7cb3fff640 1 -- 172.21.15.77:0/3481313617 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc041030 con 0x7f7ccc06d210 2024-04-25T01:39:09.813 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.827+0000 7f7cb3fff640 1 -- 172.21.15.77:0/3481313617 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cbc02ac50 con 0x7f7ccc06d210 2024-04-25T01:39:09.813 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.827+0000 7f7cd1ae1640 1 -- 172.21.15.77:0/3481313617 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ccc1eb680 con 0x7f7ccc06d210 2024-04-25T01:39:09.813 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.827+0000 7f7cb3fff640 1 -- 172.21.15.77:0/3481313617 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc037040 con 0x7f7ccc06d210 2024-04-25T01:39:09.813 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.827+0000 7f7cd1ae1640 1 -- 172.21.15.77:0/3481313617 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ccc1ebc40 con 0x7f7ccc06d210 2024-04-25T01:39:09.813 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.828+0000 7f7cd1ae1640 1 -- 172.21.15.77:0/3481313617 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ccc068e10 con 0x7f7ccc06d210 2024-04-25T01:39:09.813 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.829+0000 7f7cb3fff640 1 -- 172.21.15.77:0/3481313617 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7f7cbc044070 con 0x7f7ccc06d210 2024-04-25T01:39:09.813 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.829+0000 7f7cb3fff640 1 --2- 172.21.15.77:0/3481313617 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7cb806bda0 0x7f7cb806e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:09.813 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.829+0000 7f7ccaffd640 1 --2- 172.21.15.77:0/3481313617 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7cb806bda0 0x7f7cb806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:09.813 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.829+0000 7f7cb3fff640 1 -- 172.21.15.77:0/3481313617 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f7cbc0aa380 con 0x7f7ccc06d210 2024-04-25T01:39:09.813 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.829+0000 7f7ccaffd640 1 --2- 172.21.15.77:0/3481313617 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7cb806bda0 0x7f7cb806e260 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc150b10 tx=0x7f7cc0009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:09.817 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:09.834+0000 7f7cb3fff640 1 -- 172.21.15.77:0/3481313617 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7cbc032e20 con 0x7f7ccc06d210 2024-04-25T01:39:09.989 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:10.007+0000 7f7cd1ae1640 1 -- 172.21.15.77:0/3481313617 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ccc06cff0 con 0x7f7ccc06d210 2024-04-25T01:39:09.990 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:10.008+0000 7f7cb3fff640 1 -- 172.21.15.77:0/3481313617 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f7cbc02ae20 con 0x7f7ccc06d210 2024-04-25T01:39:09.990 INFO:teuthology.misc.health.smithi077.stdout: 2024-04-25T01:39:09.990 INFO:teuthology.misc.health.smithi077.stdout:{"epoch":12,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:39:07.655459+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:39:09.992 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:10.010+0000 7f7cd1ae1640 1 -- 172.21.15.77:0/3481313617 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7cb806bda0 msgr2=0x7f7cb806e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:09.992 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:10.010+0000 7f7cd1ae1640 1 --2- 172.21.15.77:0/3481313617 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7cb806bda0 0x7f7cb806e260 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc150b10 tx=0x7f7cc0009190 comp rx=0 tx=0).stop 2024-04-25T01:39:09.992 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:10.010+0000 7f7cd1ae1640 1 -- 172.21.15.77:0/3481313617 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ccc06d210 msgr2=0x7f7ccc0ad7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:09.992 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:10.010+0000 7f7cd1ae1640 1 --2- 172.21.15.77:0/3481313617 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ccc06d210 0x7f7ccc0ad7c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc031000 tx=0x7f7cbc0046c0 comp rx=0 tx=0).stop 2024-04-25T01:39:09.993 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:10.010+0000 7f7cd1ae1640 1 -- 172.21.15.77:0/3481313617 shutdown_connections 2024-04-25T01:39:09.993 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:10.010+0000 7f7cd1ae1640 1 --2- 172.21.15.77:0/3481313617 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7cb806bda0 0x7f7cb806e260 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:09.993 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:10.010+0000 7f7cd1ae1640 1 --2- 172.21.15.77:0/3481313617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ccc0c6220 0x7f7ccc0c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:09.993 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:10.010+0000 7f7cd1ae1640 1 --2- 172.21.15.77:0/3481313617 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ccc159f50 0x7f7ccc0c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:09.993 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:10.010+0000 7f7cd1ae1640 1 --2- 172.21.15.77:0/3481313617 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ccc06d210 0x7f7ccc0ad7c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:09.993 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:10.010+0000 7f7cd1ae1640 1 -- 172.21.15.77:0/3481313617 >> 172.21.15.77:0/3481313617 conn(0x7f7ccc067410 msgr2=0x7f7ccc158eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:09.993 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:10.010+0000 7f7cd1ae1640 1 -- 172.21.15.77:0/3481313617 shutdown_connections 2024-04-25T01:39:09.993 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:10.010+0000 7f7cd1ae1640 1 -- 172.21.15.77:0/3481313617 wait complete. 2024-04-25T01:39:10.002 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T01:39:16.809 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T01:39:16.909 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.927+0000 7f5cfb615640 1 Processor -- start 2024-04-25T01:39:16.909 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.927+0000 7f5cfb615640 1 -- start start 2024-04-25T01:39:16.910 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.928+0000 7f5cfb615640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5cf40a92b0 0x7f5cf40c3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:16.911 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.928+0000 7f5cfb615640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cf40c45d0 con 0x7f5cf40c5e00 2024-04-25T01:39:16.911 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.928+0000 7f5cfb615640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cf4156b70 con 0x7f5cf41536d0 2024-04-25T01:39:16.911 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.928+0000 7f5cfb615640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f5cf40c4380 con 0x7f5cf40a92b0 2024-04-25T01:39:16.911 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.928+0000 7f5cf8bb0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5cf40a92b0 0x7f5cf40c3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:16.911 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.928+0000 7f5cf8bb0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5cf40a92b0 0x7f5cf40c3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37626/0 (socket says 172.21.15.77:37626) 2024-04-25T01:39:16.911 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.928+0000 7f5cf8bb0640 1 -- 172.21.15.77:0/615445375 learned_addr learned my addr 172.21.15.77:0/615445375 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:16.911 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.928+0000 7f5cf9bb2640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f5cf40c5e00 0x7f5cf40727b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36464/0 (socket says 172.21.15.77:36464) 2024-04-25T01:39:16.911 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.928+0000 7f5cf8bb0640 1 -- 172.21.15.77:0/615445375 >> v1:172.21.15.121:6789/0 conn(0x7f5cf41536d0 legacy=0x7f5cf40c2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:16.911 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.928+0000 7f5cf8bb0640 1 -- 172.21.15.77:0/615445375 >> v1:172.21.15.77:6789/0 conn(0x7f5cf40c5e00 legacy=0x7f5cf40727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:16.911 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.928+0000 7f5cf8bb0640 1 -- 172.21.15.77:0/615445375 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf40c48b0 con 0x7f5cf40a92b0 2024-04-25T01:39:16.911 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.928+0000 7f5cebfff640 1 -- 172.21.15.77:0/615445375 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1235072202 0 0) 0x7f5cf40c45d0 con 0x7f5cf40c5e00 2024-04-25T01:39:16.913 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.929+0000 7f5cf8bb0640 1 --2- 172.21.15.77:0/615445375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5cf40a92b0 0x7f5cf40c3700 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4009870 tx=0x7f5ce402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11f12a1e98441c5f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:16.913 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.929+0000 7f5cebfff640 1 -- 172.21.15.77:0/615445375 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4037070 con 0x7f5cf40a92b0 2024-04-25T01:39:16.913 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.929+0000 7f5cebfff640 1 -- 172.21.15.77:0/615445375 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ce4032440 con 0x7f5cf40a92b0 2024-04-25T01:39:16.913 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.929+0000 7f5cebfff640 1 -- 172.21.15.77:0/615445375 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4032810 con 0x7f5cf40a92b0 2024-04-25T01:39:16.913 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.930+0000 7f5cfb615640 1 -- 172.21.15.77:0/615445375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5cf40a92b0 msgr2=0x7f5cf40c3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:16.913 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.930+0000 7f5cfb615640 1 --2- 172.21.15.77:0/615445375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5cf40a92b0 0x7f5cf40c3700 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4009870 tx=0x7f5ce402a270 comp rx=0 tx=0).stop 2024-04-25T01:39:16.913 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.930+0000 7f5cfb615640 1 -- 172.21.15.77:0/615445375 shutdown_connections 2024-04-25T01:39:16.913 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.930+0000 7f5cfb615640 1 --2- 172.21.15.77:0/615445375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5cf40a92b0 0x7f5cf40c3700 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:16.913 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.930+0000 7f5cfb615640 1 -- 172.21.15.77:0/615445375 >> 172.21.15.77:0/615445375 conn(0x7f5cf40ab730 msgr2=0x7f5cf40abb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:16.913 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.930+0000 7f5cfb615640 1 -- 172.21.15.77:0/615445375 shutdown_connections 2024-04-25T01:39:16.914 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.930+0000 7f5cfb615640 1 -- 172.21.15.77:0/615445375 wait complete. 2024-04-25T01:39:16.914 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.931+0000 7f5cfb615640 1 Processor -- start 2024-04-25T01:39:16.914 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.931+0000 7f5cfb615640 1 -- start start 2024-04-25T01:39:16.916 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.932+0000 7f5cfb615640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5cf40c5e00 0x7f5cf4151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:16.916 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.932+0000 7f5cfb615640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5cf41536d0 0x7f5cf406fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:16.916 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.932+0000 7f5cfb615640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5cf4152480 0x7f5cf406ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:16.916 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.932+0000 7f5cfb615640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf4072ec0 con 0x7f5cf40c5e00 2024-04-25T01:39:16.916 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.932+0000 7f5cfb615640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf4156ee0 con 0x7f5cf4152480 2024-04-25T01:39:16.916 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.932+0000 7f5cfb615640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f5cf4073040 con 0x7f5cf41536d0 2024-04-25T01:39:16.917 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.932+0000 7f5cf93b1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5cf40c5e00 0x7f5cf4151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:16.917 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.932+0000 7f5cf93b1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5cf40c5e00 0x7f5cf4151f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37642/0 (socket says 172.21.15.77:37642) 2024-04-25T01:39:16.917 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.932+0000 7f5cf93b1640 1 -- 172.21.15.77:0/626729228 learned_addr learned my addr 172.21.15.77:0/626729228 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:16.917 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.932+0000 7f5cf8bb0640 1 --2- 172.21.15.77:0/626729228 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5cf41536d0 0x7f5cf406fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:16.917 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.932+0000 7f5cf9bb2640 1 --2- 172.21.15.77:0/626729228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5cf4152480 0x7f5cf406ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:16.917 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.932+0000 7f5cf93b1640 1 -- 172.21.15.77:0/626729228 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5cf41536d0 msgr2=0x7f5cf406fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:16.917 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.932+0000 7f5cf93b1640 1 --2- 172.21.15.77:0/626729228 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5cf41536d0 0x7f5cf406fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:16.917 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.932+0000 7f5cf93b1640 1 -- 172.21.15.77:0/626729228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5cf4152480 msgr2=0x7f5cf406ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:16.917 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.932+0000 7f5cf93b1640 1 --2- 172.21.15.77:0/626729228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5cf4152480 0x7f5cf406ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:16.917 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.932+0000 7f5cf93b1640 1 -- 172.21.15.77:0/626729228 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf4070710 con 0x7f5cf40c5e00 2024-04-25T01:39:16.917 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.932+0000 7f5cf8bb0640 1 --2- 172.21.15.77:0/626729228 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5cf41536d0 0x7f5cf406fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:16.917 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.932+0000 7f5cf9bb2640 1 --2- 172.21.15.77:0/626729228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5cf4152480 0x7f5cf406ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:16.917 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.932+0000 7f5cf93b1640 1 --2- 172.21.15.77:0/626729228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5cf40c5e00 0x7f5cf4151f40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000c430 tx=0x7f5cf000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:16.918 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.932+0000 7f5ce9ffb640 1 -- 172.21.15.77:0/626729228 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0017070 con 0x7f5cf40c5e00 2024-04-25T01:39:16.918 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.932+0000 7f5ce9ffb640 1 -- 172.21.15.77:0/626729228 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf00052d0 con 0x7f5cf40c5e00 2024-04-25T01:39:16.918 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.932+0000 7f5cfb615640 1 -- 172.21.15.77:0/626729228 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cf41ebdc0 con 0x7f5cf40c5e00 2024-04-25T01:39:16.918 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.932+0000 7f5ce9ffb640 1 -- 172.21.15.77:0/626729228 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0003830 con 0x7f5cf40c5e00 2024-04-25T01:39:16.918 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.933+0000 7f5cfb615640 1 -- 172.21.15.77:0/626729228 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cf41ec360 con 0x7f5cf40c5e00 2024-04-25T01:39:16.918 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.933+0000 7f5cfb615640 1 -- 172.21.15.77:0/626729228 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cf4068e10 con 0x7f5cf40c5e00 2024-04-25T01:39:16.918 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.934+0000 7f5ce9ffb640 1 -- 172.21.15.77:0/626729228 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5cf001a070 con 0x7f5cf40c5e00 2024-04-25T01:39:16.918 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.934+0000 7f5ce9ffb640 1 --2- 172.21.15.77:0/626729228 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5cd806be60 0x7f5cd806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:16.918 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.934+0000 7f5ce9ffb640 1 -- 172.21.15.77:0/626729228 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f5cf0089df0 con 0x7f5cf40c5e00 2024-04-25T01:39:16.918 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.934+0000 7f5cf8bb0640 1 --2- 172.21.15.77:0/626729228 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5cd806be60 0x7f5cd806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:16.919 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.935+0000 7f5cf8bb0640 1 --2- 172.21.15.77:0/626729228 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5cd806be60 0x7f5cd806e320 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4034000 tx=0x7f5ce402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:16.921 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:16.939+0000 7f5ce9ffb640 1 -- 172.21.15.77:0/626729228 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5cf0058b80 con 0x7f5cf40c5e00 2024-04-25T01:39:17.098 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:17.116+0000 7f5cfb615640 1 -- 172.21.15.77:0/626729228 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5cf4068880 con 0x7f5cf40c5e00 2024-04-25T01:39:17.099 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:17.117+0000 7f5ce9ffb640 1 -- 172.21.15.77:0/626729228 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12872 (secure 0 0 0) 0x7f5cf0058480 con 0x7f5cf40c5e00 2024-04-25T01:39:17.099 INFO:teuthology.misc.health.smithi077.stdout: 2024-04-25T01:39:17.099 INFO:teuthology.misc.health.smithi077.stdout:{"epoch":16,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:39:13.776753+0000","last_up_change":"2024-04-25T01:39:10.729600+0000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T01:39:11.681151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6811","nonce":3366980158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6817","nonce":3366980158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6828","nonce":3366980158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6825","nonce":3366980158}]},"public_addr":"172.21.15.77:6811/3366980158","cluster_addr":"172.21.15.77:6817/3366980158","heartbeat_back_addr":"172.21.15.77:6828/3366980158","heartbeat_front_addr":"172.21.15.77:6825/3366980158","state":["exists","up"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6801","nonce":3971619298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6803","nonce":3971619298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6807","nonce":3971619298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6805","nonce":3971619298}]},"public_addr":"172.21.15.77:6801/3971619298","cluster_addr":"172.21.15.77:6803/3971619298","heartbeat_back_addr":"172.21.15.77:6807/3971619298","heartbeat_front_addr":"172.21.15.77:6805/3971619298","state":["exists","up"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6810","nonce":4103452689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6813","nonce":4103452689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6823","nonce":4103452689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6818","nonce":4103452689}]},"public_addr":"172.21.15.77:6810/4103452689","cluster_addr":"172.21.15.77:6813/4103452689","heartbeat_back_addr":"172.21.15.77:6823/4103452689","heartbeat_front_addr":"172.21.15.77:6818/4103452689","state":["exists","up"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6819","nonce":217398906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6824","nonce":217398906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6831","nonce":217398906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6829","nonce":217398906}]},"public_addr":"172.21.15.77:6819/217398906","cluster_addr":"172.21.15.77:6824/217398906","heartbeat_back_addr":"172.21.15.77:6831/217398906","heartbeat_front_addr":"172.21.15.77:6829/217398906","state":["exists","up"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6801","nonce":2565483070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6803","nonce":2565483070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6810","nonce":2565483070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6806","nonce":2565483070}]},"public_addr":"172.21.15.121:6801/2565483070","cluster_addr":"172.21.15.121:6803/2565483070","heartbeat_back_addr":"172.21.15.121:6810/2565483070","heartbeat_front_addr":"172.21.15.121:6806/2565483070","state":["exists","up"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6807","nonce":2785294752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6809","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6811","nonce":2785294752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6815","nonce":2785294752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6813","nonce":2785294752}]},"public_addr":"172.21.15.121:6807/2785294752","cluster_addr":"172.21.15.121:6811/2785294752","heartbeat_back_addr":"172.21.15.121:6815/2785294752","heartbeat_front_addr":"172.21.15.121:6813/2785294752","state":["exists","up"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6820","nonce":523906818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6824","nonce":523906818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6831","nonce":523906818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6828","nonce":523906818}]},"public_addr":"172.21.15.121:6820/523906818","cluster_addr":"172.21.15.121:6824/523906818","heartbeat_back_addr":"172.21.15.121:6831/523906818","heartbeat_front_addr":"172.21.15.121:6828/523906818","state":["exists","up"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6817","nonce":1683602459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6819","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6821","nonce":1683602459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6829","nonce":1683602459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6823","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6825","nonce":1683602459}]},"public_addr":"172.21.15.121:6817/1683602459","cluster_addr":"172.21.15.121:6821/1683602459","heartbeat_back_addr":"172.21.15.121:6829/1683602459","heartbeat_front_addr":"172.21.15.121:6825/1683602459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.839443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.818842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.776243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.793085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.822396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.907311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.918374+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.848430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:39:17.101 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:17.119+0000 7f5cfb615640 1 -- 172.21.15.77:0/626729228 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5cd806be60 msgr2=0x7f5cd806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:17.102 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:17.119+0000 7f5cfb615640 1 --2- 172.21.15.77:0/626729228 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5cd806be60 0x7f5cd806e320 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4034000 tx=0x7f5ce402e000 comp rx=0 tx=0).stop 2024-04-25T01:39:17.102 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:17.119+0000 7f5cfb615640 1 -- 172.21.15.77:0/626729228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5cf40c5e00 msgr2=0x7f5cf4151f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:17.102 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:17.119+0000 7f5cfb615640 1 --2- 172.21.15.77:0/626729228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5cf40c5e00 0x7f5cf4151f40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000c430 tx=0x7f5cf000c8f0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.102 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:17.119+0000 7f5cfb615640 1 -- 172.21.15.77:0/626729228 shutdown_connections 2024-04-25T01:39:17.102 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:17.119+0000 7f5cfb615640 1 --2- 172.21.15.77:0/626729228 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5cd806be60 0x7f5cd806e320 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.102 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:17.119+0000 7f5cfb615640 1 --2- 172.21.15.77:0/626729228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5cf4152480 0x7f5cf406ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.102 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:17.119+0000 7f5cfb615640 1 --2- 172.21.15.77:0/626729228 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5cf41536d0 0x7f5cf406fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.102 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:17.119+0000 7f5cfb615640 1 --2- 172.21.15.77:0/626729228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5cf40c5e00 0x7f5cf4151f40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.102 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:17.119+0000 7f5cfb615640 1 -- 172.21.15.77:0/626729228 >> 172.21.15.77:0/626729228 conn(0x7f5cf40ab730 msgr2=0x7f5cf40c2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:17.102 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:17.119+0000 7f5cfb615640 1 -- 172.21.15.77:0/626729228 shutdown_connections 2024-04-25T01:39:17.102 INFO:teuthology.misc.health.smithi077.stderr:2024-04-25T01:39:17.119+0000 7f5cfb615640 1 -- 172.21.15.77:0/626729228 wait complete. 2024-04-25T01:39:17.111 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-25T01:39:17.111 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T01:39:17.111 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T01:39:17.111 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T01:39:17.114 INFO:tasks.ceph.mds.a:Started 2024-04-25T01:39:17.114 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T01:39:17.114 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T01:39:17.116 INFO:tasks.ceph.mds.c:Started 2024-04-25T01:39:17.116 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T01:39:17.116 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T01:39:17.119 INFO:tasks.ceph.mds.b:Started 2024-04-25T01:39:17.120 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T01:39:17.120 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T01:39:17.123 INFO:tasks.ceph.mds.d:Started 2024-04-25T01:39:17.123 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T01:39:17.123 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T01:39:17.185 INFO:tasks.ceph.mds.a.smithi077.stdout:starting mds.a at 2024-04-25T01:39:17.187 INFO:tasks.ceph.mds.c.smithi077.stdout:starting mds.c at 2024-04-25T01:39:17.202 INFO:tasks.ceph.mds.b.smithi121.stdout:starting mds.b at 2024-04-25T01:39:17.202 INFO:tasks.ceph.mds.d.smithi121.stdout:starting mds.d at 2024-04-25T01:39:17.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.244+0000 7f290295a640 1 Processor -- start 2024-04-25T01:39:17.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.244+0000 7f290295a640 1 -- start start 2024-04-25T01:39:17.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.244+0000 7f290295a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f28fc1569a0 0x7f28fc071c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:17.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.244+0000 7f290295a640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f28fc0721d0 0x7f28fc1608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:17.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.244+0000 7f290295a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28fc14cea0 con 0x7f28fc14cac0 2024-04-25T01:39:17.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.244+0000 7f290295a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f28fc071800 con 0x7f28fc1569a0 2024-04-25T01:39:17.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.244+0000 7f290295a640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f28fc073330 con 0x7f28fc0721d0 2024-04-25T01:39:17.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.245+0000 7f28fbfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f28fc14cac0 0x7f28fc0c74a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36480/0 (socket says 172.21.15.77:36480) 2024-04-25T01:39:17.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.245+0000 7f28fb7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f28fc1569a0 0x7f28fc071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:17.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.245+0000 7f28fbfff640 1 -- 172.21.15.77:0/2529136670 learned_addr learned my addr 172.21.15.77:0/2529136670 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:17.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.245+0000 7f2900ef7640 1 --2- 172.21.15.77:0/2529136670 >> v2:172.21.15.121:3300/0 conn(0x7f28fc0721d0 0x7f28fc1608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:17.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.245+0000 7f28fb7fe640 1 -- 172.21.15.77:0/2529136670 >> v2:172.21.15.121:3300/0 conn(0x7f28fc0721d0 msgr2=0x7f28fc1608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:17.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.245+0000 7f28fb7fe640 1 --2- 172.21.15.77:0/2529136670 >> v2:172.21.15.121:3300/0 conn(0x7f28fc0721d0 0x7f28fc1608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.245+0000 7f28faffd640 1 -- 172.21.15.77:0/2529136670 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2006313494 0 0) 0x7f28fc14cea0 con 0x7f28fc14cac0 2024-04-25T01:39:17.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.245+0000 7f28fb7fe640 1 -- 172.21.15.77:0/2529136670 >> v1:172.21.15.77:6789/0 conn(0x7f28fc14cac0 legacy=0x7f28fc0c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:17.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.245+0000 7f28fb7fe640 1 -- 172.21.15.77:0/2529136670 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28fc072600 con 0x7f28fc1569a0 2024-04-25T01:39:17.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.245+0000 7f28fb7fe640 1 --2- 172.21.15.77:0/2529136670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28fc1569a0 0x7f28fc071c90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f28fc1505c0 tx=0x7f28f002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3372005db524ed3e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:17.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.246+0000 7f28faffd640 1 -- 172.21.15.77:0/2529136670 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f0037070 con 0x7f28fc1569a0 2024-04-25T01:39:17.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.246+0000 7f28faffd640 1 -- 172.21.15.77:0/2529136670 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f0032440 con 0x7f28fc1569a0 2024-04-25T01:39:17.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.246+0000 7f28faffd640 1 -- 172.21.15.77:0/2529136670 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f0032810 con 0x7f28fc1569a0 2024-04-25T01:39:17.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.246+0000 7f290295a640 1 -- 172.21.15.77:0/2529136670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28fc1569a0 msgr2=0x7f28fc071c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:17.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.246+0000 7f290295a640 1 --2- 172.21.15.77:0/2529136670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28fc1569a0 0x7f28fc071c90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f28fc1505c0 tx=0x7f28f002a1a0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.246+0000 7f290295a640 1 -- 172.21.15.77:0/2529136670 shutdown_connections 2024-04-25T01:39:17.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.246+0000 7f290295a640 1 --2- 172.21.15.77:0/2529136670 >> v2:172.21.15.121:3300/0 conn(0x7f28fc0721d0 0x7f28fc1608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.246+0000 7f290295a640 1 --2- 172.21.15.77:0/2529136670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28fc1569a0 0x7f28fc071c90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.246+0000 7f290295a640 1 -- 172.21.15.77:0/2529136670 >> 172.21.15.77:0/2529136670 conn(0x7f28fc0c8590 msgr2=0x7f28fc0c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:17.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.246+0000 7f290295a640 1 -- 172.21.15.77:0/2529136670 shutdown_connections 2024-04-25T01:39:17.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.246+0000 7f290295a640 1 -- 172.21.15.77:0/2529136670 wait complete. 2024-04-25T01:39:17.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.247+0000 7f290295a640 1 Processor -- start 2024-04-25T01:39:17.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.247+0000 7f290295a640 1 -- start start 2024-04-25T01:39:17.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.248+0000 7f290295a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28fc0721d0 0x7f28fc159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:17.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.248+0000 7f290295a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28fc14cac0 0x7f28fc148cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:17.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.248+0000 7f290295a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f28fc1569a0 0x7f28fc1edcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:17.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.248+0000 7f290295a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f28fc073050 con 0x7f28fc14cac0 2024-04-25T01:39:17.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.248+0000 7f290295a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f28fc072d70 con 0x7f28fc0721d0 2024-04-25T01:39:17.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.248+0000 7f290295a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f28fc0c4570 con 0x7f28fc1569a0 2024-04-25T01:39:17.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.248+0000 7f28fb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28fc14cac0 0x7f28fc148cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:17.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.248+0000 7f28fb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28fc14cac0 0x7f28fc148cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37670/0 (socket says 172.21.15.77:37670) 2024-04-25T01:39:17.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.248+0000 7f28fb7fe640 1 -- 172.21.15.77:0/3934509852 learned_addr learned my addr 172.21.15.77:0/3934509852 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:17.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.248+0000 7f2900ef7640 1 --2- 172.21.15.77:0/3934509852 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f28fc1569a0 0x7f28fc1edcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:17.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.248+0000 7f28fbfff640 1 --2- 172.21.15.77:0/3934509852 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28fc0721d0 0x7f28fc159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:17.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.248+0000 7f28fb7fe640 1 -- 172.21.15.77:0/3934509852 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f28fc1569a0 msgr2=0x7f28fc1edcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:17.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.248+0000 7f28fb7fe640 1 --2- 172.21.15.77:0/3934509852 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f28fc1569a0 0x7f28fc1edcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.248+0000 7f28fb7fe640 1 -- 172.21.15.77:0/3934509852 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28fc0721d0 msgr2=0x7f28fc159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:17.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.248+0000 7f28fb7fe640 1 --2- 172.21.15.77:0/3934509852 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28fc0721d0 0x7f28fc159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.248+0000 7f28fb7fe640 1 -- 172.21.15.77:0/3934509852 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28fc158a50 con 0x7f28fc14cac0 2024-04-25T01:39:17.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.248+0000 7f2900ef7640 1 --2- 172.21.15.77:0/3934509852 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f28fc1569a0 0x7f28fc1edcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:17.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.249+0000 7f28fb7fe640 1 --2- 172.21.15.77:0/3934509852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28fc14cac0 0x7f28fc148cd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f28f0009890 tx=0x7f28f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:17.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.249+0000 7f28f8ff9640 1 -- 172.21.15.77:0/3934509852 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f0037040 con 0x7f28fc14cac0 2024-04-25T01:39:17.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.249+0000 7f28f8ff9640 1 -- 172.21.15.77:0/3934509852 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f0042070 con 0x7f28fc14cac0 2024-04-25T01:39:17.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.249+0000 7f290295a640 1 -- 172.21.15.77:0/3934509852 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28fc157600 con 0x7f28fc14cac0 2024-04-25T01:39:17.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.249+0000 7f28f8ff9640 1 -- 172.21.15.77:0/3934509852 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f0030a50 con 0x7f28fc14cac0 2024-04-25T01:39:17.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.249+0000 7f290295a640 1 -- 172.21.15.77:0/3934509852 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28fc0ae470 con 0x7f28fc14cac0 2024-04-25T01:39:17.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.250+0000 7f290295a640 1 -- 172.21.15.77:0/3934509852 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28fc1577d0 con 0x7f28fc14cac0 2024-04-25T01:39:17.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.250+0000 7f28f8ff9640 1 -- 172.21.15.77:0/3934509852 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f28f0030bf0 con 0x7f28fc14cac0 2024-04-25T01:39:17.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.250+0000 7f28f8ff9640 1 --2- 172.21.15.77:0/3934509852 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f28e806be30 0x7f28e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:17.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.251+0000 7f28f8ff9640 1 -- 172.21.15.77:0/3934509852 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f28f00ab560 con 0x7f28fc14cac0 2024-04-25T01:39:17.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.251+0000 7f28fbfff640 1 --2- 172.21.15.77:0/3934509852 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f28e806be30 0x7f28e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:17.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.251+0000 7f28fbfff640 1 --2- 172.21.15.77:0/3934509852 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f28e806be30 0x7f28e806e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f28ec000f60 tx=0x7f28ec007b50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:17.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.255+0000 7f28f8ff9640 1 -- 172.21.15.77:0/3934509852 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f28fc1577d0 con 0x7f28fc14cac0 2024-04-25T01:39:17.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.428+0000 7f290295a640 1 -- 172.21.15.77:0/3934509852 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f28fc0adf80 con 0x7f28fc14cac0 2024-04-25T01:39:17.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.429+0000 7f28f8ff9640 1 -- 172.21.15.77:0/3934509852 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12872 (secure 0 0 0) 0x7f28f0045360 con 0x7f28fc14cac0 2024-04-25T01:39:17.411 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:17.411 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":16,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:39:13.776753+0000","last_up_change":"2024-04-25T01:39:10.729600+0000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T01:39:11.681151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6811","nonce":3366980158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6817","nonce":3366980158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6828","nonce":3366980158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6825","nonce":3366980158}]},"public_addr":"172.21.15.77:6811/3366980158","cluster_addr":"172.21.15.77:6817/3366980158","heartbeat_back_addr":"172.21.15.77:6828/3366980158","heartbeat_front_addr":"172.21.15.77:6825/3366980158","state":["exists","up"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6801","nonce":3971619298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6803","nonce":3971619298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6807","nonce":3971619298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6805","nonce":3971619298}]},"public_addr":"172.21.15.77:6801/3971619298","cluster_addr":"172.21.15.77:6803/3971619298","heartbeat_back_addr":"172.21.15.77:6807/3971619298","heartbeat_front_addr":"172.21.15.77:6805/3971619298","state":["exists","up"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6810","nonce":4103452689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6813","nonce":4103452689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6823","nonce":4103452689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6818","nonce":4103452689}]},"public_addr":"172.21.15.77:6810/4103452689","cluster_addr":"172.21.15.77:6813/4103452689","heartbeat_back_addr":"172.21.15.77:6823/4103452689","heartbeat_front_addr":"172.21.15.77:6818/4103452689","state":["exists","up"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6819","nonce":217398906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6824","nonce":217398906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6831","nonce":217398906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6829","nonce":217398906}]},"public_addr":"172.21.15.77:6819/217398906","cluster_addr":"172.21.15.77:6824/217398906","heartbeat_back_addr":"172.21.15.77:6831/217398906","heartbeat_front_addr":"172.21.15.77:6829/217398906","state":["exists","up"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6801","nonce":2565483070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6803","nonce":2565483070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6810","nonce":2565483070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6806","nonce":2565483070}]},"public_addr":"172.21.15.121:6801/2565483070","cluster_addr":"172.21.15.121:6803/2565483070","heartbeat_back_addr":"172.21.15.121:6810/2565483070","heartbeat_front_addr":"172.21.15.121:6806/2565483070","state":["exists","up"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6807","nonce":2785294752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6809","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6811","nonce":2785294752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6815","nonce":2785294752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6813","nonce":2785294752}]},"public_addr":"172.21.15.121:6807/2785294752","cluster_addr":"172.21.15.121:6811/2785294752","heartbeat_back_addr":"172.21.15.121:6815/2785294752","heartbeat_front_addr":"172.21.15.121:6813/2785294752","state":["exists","up"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6820","nonce":523906818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6824","nonce":523906818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6831","nonce":523906818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6828","nonce":523906818}]},"public_addr":"172.21.15.121:6820/523906818","cluster_addr":"172.21.15.121:6824/523906818","heartbeat_back_addr":"172.21.15.121:6831/523906818","heartbeat_front_addr":"172.21.15.121:6828/523906818","state":["exists","up"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6817","nonce":1683602459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6819","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6821","nonce":1683602459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6829","nonce":1683602459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6823","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6825","nonce":1683602459}]},"public_addr":"172.21.15.121:6817/1683602459","cluster_addr":"172.21.15.121:6821/1683602459","heartbeat_back_addr":"172.21.15.121:6829/1683602459","heartbeat_front_addr":"172.21.15.121:6825/1683602459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.839443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.818842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.776243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.793085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.822396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.907311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.918374+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.848430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:39:17.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.430+0000 7f290295a640 1 -- 172.21.15.77:0/3934509852 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f28e806be30 msgr2=0x7f28e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:17.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.430+0000 7f290295a640 1 --2- 172.21.15.77:0/3934509852 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f28e806be30 0x7f28e806e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f28ec000f60 tx=0x7f28ec007b50 comp rx=0 tx=0).stop 2024-04-25T01:39:17.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.430+0000 7f290295a640 1 -- 172.21.15.77:0/3934509852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28fc14cac0 msgr2=0x7f28fc148cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:17.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.430+0000 7f290295a640 1 --2- 172.21.15.77:0/3934509852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28fc14cac0 0x7f28fc148cd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f28f0009890 tx=0x7f28f00046c0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.430+0000 7f290295a640 1 -- 172.21.15.77:0/3934509852 shutdown_connections 2024-04-25T01:39:17.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.430+0000 7f290295a640 1 --2- 172.21.15.77:0/3934509852 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f28e806be30 0x7f28e806e2f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.430+0000 7f290295a640 1 --2- 172.21.15.77:0/3934509852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28fc14cac0 0x7f28fc148cd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.430+0000 7f290295a640 1 --2- 172.21.15.77:0/3934509852 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f28fc1569a0 0x7f28fc1edcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.430+0000 7f290295a640 1 --2- 172.21.15.77:0/3934509852 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28fc0721d0 0x7f28fc159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.430+0000 7f290295a640 1 -- 172.21.15.77:0/3934509852 >> 172.21.15.77:0/3934509852 conn(0x7f28fc0c8590 msgr2=0x7f28fc153f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:17.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.431+0000 7f290295a640 1 -- 172.21.15.77:0/3934509852 shutdown_connections 2024-04-25T01:39:17.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.431+0000 7f290295a640 1 -- 172.21.15.77:0/3934509852 wait complete. 2024-04-25T01:39:17.423 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T01:39:11.681151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T01:39:17.424 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T01:39:17.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.541+0000 7fa860542640 1 Processor -- start 2024-04-25T01:39:17.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.541+0000 7fa860542640 1 -- start start 2024-04-25T01:39:17.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.542+0000 7fa860542640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa8580c9640 0x7fa8580c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:17.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.542+0000 7fa860542640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa8580c37b0 0x7fa858155f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:17.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.542+0000 7fa860542640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8580c66a0 con 0x7fa858159e20 2024-04-25T01:39:17.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.542+0000 7fa860542640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa8581564d0 con 0x7fa8580c9640 2024-04-25T01:39:17.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.542+0000 7fa860542640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fa858159990 con 0x7fa8580c37b0 2024-04-25T01:39:17.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.542+0000 7fa85e2de640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa8580c9640 0x7fa8580c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:17.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.542+0000 7fa85e2de640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa8580c9640 0x7fa8580c9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55948/0 (socket says 172.21.15.77:55948) 2024-04-25T01:39:17.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.542+0000 7fa85e2de640 1 -- 172.21.15.77:0/3019839197 learned_addr learned my addr 172.21.15.77:0/3019839197 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:17.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.542+0000 7fa85dadd640 1 --2- 172.21.15.77:0/3019839197 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa8580c37b0 0x7fa858155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:17.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.542+0000 7fa85e2de640 1 -- 172.21.15.77:0/3019839197 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa8580c37b0 msgr2=0x7fa858155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:17.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.542+0000 7fa85e2de640 1 --2- 172.21.15.77:0/3019839197 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa8580c37b0 0x7fa858155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.543+0000 7fa85e2de640 1 -- 172.21.15.77:0/3019839197 >> v1:172.21.15.121:6789/0 conn(0x7fa858159e20 legacy=0x7fa8580ab3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:17.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.543+0000 7fa85e2de640 1 -- 172.21.15.77:0/3019839197 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa85806f770 con 0x7fa8580c9640 2024-04-25T01:39:17.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.543+0000 7fa85e2de640 1 --2- 172.21.15.77:0/3019839197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8580c9640 0x7fa8580c9a20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa854009e50 tx=0x7fa85402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841622d5823ba53f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:17.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.543+0000 7fa85d2dc640 1 -- 172.21.15.77:0/3019839197 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa854036070 con 0x7fa8580c9640 2024-04-25T01:39:17.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.543+0000 7fa85d2dc640 1 -- 172.21.15.77:0/3019839197 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa854031600 con 0x7fa8580c9640 2024-04-25T01:39:17.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.543+0000 7fa85d2dc640 1 -- 172.21.15.77:0/3019839197 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8540319d0 con 0x7fa8580c9640 2024-04-25T01:39:17.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.544+0000 7fa860542640 1 -- 172.21.15.77:0/3019839197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8580c9640 msgr2=0x7fa8580c9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:17.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.544+0000 7fa860542640 1 --2- 172.21.15.77:0/3019839197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8580c9640 0x7fa8580c9a20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa854009e50 tx=0x7fa85402a680 comp rx=0 tx=0).stop 2024-04-25T01:39:17.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.544+0000 7fa860542640 1 -- 172.21.15.77:0/3019839197 shutdown_connections 2024-04-25T01:39:17.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.544+0000 7fa860542640 1 --2- 172.21.15.77:0/3019839197 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa8580c37b0 0x7fa858155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.544+0000 7fa860542640 1 --2- 172.21.15.77:0/3019839197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8580c9640 0x7fa8580c9a20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.544+0000 7fa860542640 1 -- 172.21.15.77:0/3019839197 >> 172.21.15.77:0/3019839197 conn(0x7fa85806b2f0 msgr2=0x7fa8580aa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:17.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.544+0000 7fa860542640 1 -- 172.21.15.77:0/3019839197 shutdown_connections 2024-04-25T01:39:17.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.544+0000 7fa860542640 1 -- 172.21.15.77:0/3019839197 wait complete. 2024-04-25T01:39:17.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.545+0000 7fa860542640 1 Processor -- start 2024-04-25T01:39:17.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.545+0000 7fa860542640 1 -- start start 2024-04-25T01:39:17.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.546+0000 7fa860542640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8580c37b0 0x7fa8580c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:17.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.546+0000 7fa860542640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8580c9640 0x7fa8580c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:17.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.546+0000 7fa860542640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa858159e20 0x7fa85806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:17.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.546+0000 7fa860542640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa858159620 con 0x7fa8580c37b0 2024-04-25T01:39:17.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.546+0000 7fa860542640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa85806f490 con 0x7fa8580c9640 2024-04-25T01:39:17.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.546+0000 7fa860542640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fa858073220 con 0x7fa858159e20 2024-04-25T01:39:17.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.546+0000 7fa85e2de640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8580c37b0 0x7fa8580c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:17.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.546+0000 7fa85e2de640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8580c37b0 0x7fa8580c7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55962/0 (socket says 172.21.15.77:55962) 2024-04-25T01:39:17.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.546+0000 7fa85e2de640 1 -- 172.21.15.77:0/2393836265 learned_addr learned my addr 172.21.15.77:0/2393836265 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:17.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.546+0000 7fa85e2de640 1 -- 172.21.15.77:0/2393836265 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa858159e20 msgr2=0x7fa85806d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:17.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.546+0000 7fa85e2de640 1 --2- 172.21.15.77:0/2393836265 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa858159e20 0x7fa85806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.546+0000 7fa85e2de640 1 -- 172.21.15.77:0/2393836265 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8580c9640 msgr2=0x7fa8580c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:17.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.546+0000 7fa85e2de640 1 --2- 172.21.15.77:0/2393836265 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8580c9640 0x7fa8580c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.546+0000 7fa85e2de640 1 -- 172.21.15.77:0/2393836265 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8580c6270 con 0x7fa8580c37b0 2024-04-25T01:39:17.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.546+0000 7fa85e2de640 1 --2- 172.21.15.77:0/2393836265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8580c37b0 0x7fa8580c7f90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa854034040 tx=0x7fa854004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:17.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.546+0000 7fa84effd640 1 -- 172.21.15.77:0/2393836265 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85403f020 con 0x7fa8580c37b0 2024-04-25T01:39:17.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.546+0000 7fa84effd640 1 -- 172.21.15.77:0/2393836265 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa854037040 con 0x7fa8580c37b0 2024-04-25T01:39:17.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.546+0000 7fa860542640 1 -- 172.21.15.77:0/2393836265 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa858153cd0 con 0x7fa8580c37b0 2024-04-25T01:39:17.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.546+0000 7fa84effd640 1 -- 172.21.15.77:0/2393836265 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa854036070 con 0x7fa8580c37b0 2024-04-25T01:39:17.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.546+0000 7fa860542640 1 -- 172.21.15.77:0/2393836265 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8580c42e0 con 0x7fa8580c37b0 2024-04-25T01:39:17.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.547+0000 7fa860542640 1 -- 172.21.15.77:0/2393836265 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8581541f0 con 0x7fa8580c37b0 2024-04-25T01:39:17.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.548+0000 7fa84effd640 1 -- 172.21.15.77:0/2393836265 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa854042020 con 0x7fa8580c37b0 2024-04-25T01:39:17.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.548+0000 7fa84effd640 1 --2- 172.21.15.77:0/2393836265 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa83c06be30 0x7fa83c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:17.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.548+0000 7fa84effd640 1 -- 172.21.15.77:0/2393836265 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fa8540ab060 con 0x7fa8580c37b0 2024-04-25T01:39:17.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.548+0000 7fa85dadd640 1 --2- 172.21.15.77:0/2393836265 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa83c06be30 0x7fa83c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:17.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.549+0000 7fa85dadd640 1 --2- 172.21.15.77:0/2393836265 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa83c06be30 0x7fa83c06e2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa8580c5ce0 tx=0x7fa848008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:17.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.553+0000 7fa84effd640 1 -- 172.21.15.77:0/2393836265 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa8581541f0 con 0x7fa8580c37b0 2024-04-25T01:39:17.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.726+0000 7fa860542640 1 -- 172.21.15.77:0/2393836265 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa85804f500 con 0x7fa8580c37b0 2024-04-25T01:39:17.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.726+0000 7fa84effd640 1 -- 172.21.15.77:0/2393836265 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7fa854049030 con 0x7fa8580c37b0 2024-04-25T01:39:17.708 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-25T01:39:17.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.728+0000 7fa860542640 1 -- 172.21.15.77:0/2393836265 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa83c06be30 msgr2=0x7fa83c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:17.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.728+0000 7fa860542640 1 --2- 172.21.15.77:0/2393836265 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa83c06be30 0x7fa83c06e2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa8580c5ce0 tx=0x7fa848008040 comp rx=0 tx=0).stop 2024-04-25T01:39:17.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.728+0000 7fa860542640 1 -- 172.21.15.77:0/2393836265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8580c37b0 msgr2=0x7fa8580c7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:17.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.728+0000 7fa860542640 1 --2- 172.21.15.77:0/2393836265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8580c37b0 0x7fa8580c7f90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa854034040 tx=0x7fa854004a40 comp rx=0 tx=0).stop 2024-04-25T01:39:17.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.728+0000 7fa860542640 1 -- 172.21.15.77:0/2393836265 shutdown_connections 2024-04-25T01:39:17.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.728+0000 7fa860542640 1 --2- 172.21.15.77:0/2393836265 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa83c06be30 0x7fa83c06e2f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.728+0000 7fa860542640 1 --2- 172.21.15.77:0/2393836265 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa858159e20 0x7fa85806d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.728+0000 7fa860542640 1 --2- 172.21.15.77:0/2393836265 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8580c9640 0x7fa8580c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.728+0000 7fa860542640 1 --2- 172.21.15.77:0/2393836265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8580c37b0 0x7fa8580c7f90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.728+0000 7fa860542640 1 -- 172.21.15.77:0/2393836265 >> 172.21.15.77:0/2393836265 conn(0x7fa85806b2f0 msgr2=0x7fa85806f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:17.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.728+0000 7fa860542640 1 -- 172.21.15.77:0/2393836265 shutdown_connections 2024-04-25T01:39:17.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.728+0000 7fa860542640 1 -- 172.21.15.77:0/2393836265 wait complete. 2024-04-25T01:39:17.721 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:39:17.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.836+0000 7f01d563f640 1 Processor -- start 2024-04-25T01:39:17.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.836+0000 7f01d563f640 1 -- start start 2024-04-25T01:39:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.836+0000 7f01d563f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f01d0150090 0x7f01d0156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.836+0000 7f01d563f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f01d006c280 0x7f01d00c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.836+0000 7f01d563f640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01d00c89c0 con 0x7f01d00c8200 2024-04-25T01:39:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.836+0000 7f01d563f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f01d006b830 con 0x7f01d006c280 2024-04-25T01:39:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.836+0000 7f01d563f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f01d00c8ca0 con 0x7f01d0150090 2024-04-25T01:39:17.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.836+0000 7f01cf7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f01d006c280 0x7f01d00c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:17.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.836+0000 7f01cf7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f01d006c280 0x7f01d00c6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55978/0 (socket says 172.21.15.77:55978) 2024-04-25T01:39:17.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.836+0000 7f01cf7fe640 1 -- 172.21.15.77:0/4218230315 learned_addr learned my addr 172.21.15.77:0/4218230315 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:17.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.837+0000 7f01ceffd640 1 --2- 172.21.15.77:0/4218230315 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f01d0150090 0x7f01d0156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:17.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.837+0000 7f01cf7fe640 1 -- 172.21.15.77:0/4218230315 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f01d0150090 msgr2=0x7f01d0156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:17.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.837+0000 7f01cf7fe640 1 --2- 172.21.15.77:0/4218230315 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f01d0150090 0x7f01d0156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.837+0000 7f01cf7fe640 1 -- 172.21.15.77:0/4218230315 >> v1:172.21.15.121:6789/0 conn(0x7f01d00c8200 legacy=0x7f01d00c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:17.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.837+0000 7f01cf7fe640 1 -- 172.21.15.77:0/4218230315 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01d006ba80 con 0x7f01d006c280 2024-04-25T01:39:17.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.837+0000 7f01cf7fe640 1 --2- 172.21.15.77:0/4218230315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d006c280 0x7f01d00c6320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009870 tx=0x7f01c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e096ce921766f77 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:17.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.837+0000 7f01cdffb640 1 -- 172.21.15.77:0/4218230315 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c0037070 con 0x7f01d006c280 2024-04-25T01:39:17.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.838+0000 7f01cdffb640 1 -- 172.21.15.77:0/4218230315 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01c0032440 con 0x7f01d006c280 2024-04-25T01:39:17.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.838+0000 7f01cdffb640 1 -- 172.21.15.77:0/4218230315 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c0032810 con 0x7f01d006c280 2024-04-25T01:39:17.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.838+0000 7f01d563f640 1 -- 172.21.15.77:0/4218230315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d006c280 msgr2=0x7f01d00c6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:17.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.838+0000 7f01d563f640 1 --2- 172.21.15.77:0/4218230315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d006c280 0x7f01d00c6320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009870 tx=0x7f01c002a270 comp rx=0 tx=0).stop 2024-04-25T01:39:17.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.838+0000 7f01d563f640 1 -- 172.21.15.77:0/4218230315 shutdown_connections 2024-04-25T01:39:17.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.838+0000 7f01d563f640 1 --2- 172.21.15.77:0/4218230315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d006c280 0x7f01d00c6320 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.838+0000 7f01d563f640 1 --2- 172.21.15.77:0/4218230315 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f01d0150090 0x7f01d0156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.838+0000 7f01d563f640 1 -- 172.21.15.77:0/4218230315 >> 172.21.15.77:0/4218230315 conn(0x7f01d00ad4d0 msgr2=0x7f01d00ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:17.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.838+0000 7f01d563f640 1 -- 172.21.15.77:0/4218230315 shutdown_connections 2024-04-25T01:39:17.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.838+0000 7f01d563f640 1 -- 172.21.15.77:0/4218230315 wait complete. 2024-04-25T01:39:17.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.839+0000 7f01d563f640 1 Processor -- start 2024-04-25T01:39:17.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.839+0000 7f01d563f640 1 -- start start 2024-04-25T01:39:17.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.840+0000 7f01d563f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d006c280 0x7f01d0159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:17.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.840+0000 7f01d563f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01d00c8200 0x7f01d0147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:17.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.840+0000 7f01d563f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f01d0150090 0x7f01d0147c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:17.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.840+0000 7f01d563f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f01d006c6f0 con 0x7f01d006c280 2024-04-25T01:39:17.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.840+0000 7f01d563f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f01d00c8680 con 0x7f01d00c8200 2024-04-25T01:39:17.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.840+0000 7f01d563f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f01d006c870 con 0x7f01d0150090 2024-04-25T01:39:17.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.840+0000 7f01ceffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d006c280 0x7f01d0159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:17.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.840+0000 7f01ceffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d006c280 0x7f01d0159db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55984/0 (socket says 172.21.15.77:55984) 2024-04-25T01:39:17.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.840+0000 7f01ceffd640 1 -- 172.21.15.77:0/2606162371 learned_addr learned my addr 172.21.15.77:0/2606162371 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:17.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.840+0000 7f01cf7fe640 1 --2- 172.21.15.77:0/2606162371 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f01d0150090 0x7f01d0147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:17.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.840+0000 7f01ce7fc640 1 --2- 172.21.15.77:0/2606162371 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01d00c8200 0x7f01d0147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:17.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.840+0000 7f01ceffd640 1 -- 172.21.15.77:0/2606162371 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f01d0150090 msgr2=0x7f01d0147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:17.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.840+0000 7f01ceffd640 1 --2- 172.21.15.77:0/2606162371 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f01d0150090 0x7f01d0147c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.840+0000 7f01ceffd640 1 -- 172.21.15.77:0/2606162371 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01d00c8200 msgr2=0x7f01d0147720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:17.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.840+0000 7f01ceffd640 1 --2- 172.21.15.77:0/2606162371 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01d00c8200 0x7f01d0147720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.840+0000 7f01ceffd640 1 -- 172.21.15.77:0/2606162371 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01d01ec360 con 0x7f01d006c280 2024-04-25T01:39:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.840+0000 7f01ce7fc640 1 --2- 172.21.15.77:0/2606162371 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01d00c8200 0x7f01d0147720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.840+0000 7f01ceffd640 1 --2- 172.21.15.77:0/2606162371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d006c280 0x7f01d0159db0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f01c8007e40 tx=0x7f01c800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.841+0000 7f01b77fe640 1 -- 172.21.15.77:0/2606162371 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c8014620 con 0x7f01d006c280 2024-04-25T01:39:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.841+0000 7f01b77fe640 1 -- 172.21.15.77:0/2606162371 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01c8019070 con 0x7f01d006c280 2024-04-25T01:39:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.841+0000 7f01d563f640 1 -- 172.21.15.77:0/2606162371 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01d01ec640 con 0x7f01d006c280 2024-04-25T01:39:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.841+0000 7f01b77fe640 1 -- 172.21.15.77:0/2606162371 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c8014a00 con 0x7f01d006c280 2024-04-25T01:39:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.841+0000 7f01d563f640 1 -- 172.21.15.77:0/2606162371 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01d01ecc00 con 0x7f01d006c280 2024-04-25T01:39:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.842+0000 7f01d563f640 1 -- 172.21.15.77:0/2606162371 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01d004f500 con 0x7f01d006c280 2024-04-25T01:39:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.842+0000 7f01b77fe640 1 -- 172.21.15.77:0/2606162371 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f01c8014ba0 con 0x7f01d006c280 2024-04-25T01:39:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.842+0000 7f01b77fe640 1 --2- 172.21.15.77:0/2606162371 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f01bc06be60 0x7f01bc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.842+0000 7f01b77fe640 1 -- 172.21.15.77:0/2606162371 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f01c808b230 con 0x7f01d006c280 2024-04-25T01:39:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.843+0000 7f01ce7fc640 1 --2- 172.21.15.77:0/2606162371 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f01bc06be60 0x7f01bc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:17.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.843+0000 7f01ce7fc640 1 --2- 172.21.15.77:0/2606162371 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f01bc06be60 0x7f01bc06e320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f01d00acdf0 tx=0x7f01c4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:17.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:17.847+0000 7f01b77fe640 1 -- 172.21.15.77:0/2606162371 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f01c8059fc0 con 0x7f01d006c280 2024-04-25T01:39:18.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:18.058+0000 7f01d563f640 1 -- 172.21.15.77:0/2606162371 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01d00c9260 con 0x7f01d006c280 2024-04-25T01:39:18.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:18.059+0000 7f01b77fe640 1 -- 172.21.15.77:0/2606162371 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f01c80598c0 con 0x7f01d006c280 2024-04-25T01:39:18.041 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:18.041 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T01:39:18.042 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 2 2024-04-25T01:39:18.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:18.061+0000 7f01d563f640 1 -- 172.21.15.77:0/2606162371 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f01bc06be60 msgr2=0x7f01bc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:18.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:18.061+0000 7f01d563f640 1 --2- 172.21.15.77:0/2606162371 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f01bc06be60 0x7f01bc06e320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f01d00acdf0 tx=0x7f01c4009040 comp rx=0 tx=0).stop 2024-04-25T01:39:18.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:18.061+0000 7f01d563f640 1 -- 172.21.15.77:0/2606162371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d006c280 msgr2=0x7f01d0159db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:18.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:18.061+0000 7f01d563f640 1 --2- 172.21.15.77:0/2606162371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d006c280 0x7f01d0159db0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f01c8007e40 tx=0x7f01c800e4b0 comp rx=0 tx=0).stop 2024-04-25T01:39:18.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:18.061+0000 7f01d563f640 1 -- 172.21.15.77:0/2606162371 shutdown_connections 2024-04-25T01:39:18.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:18.061+0000 7f01d563f640 1 --2- 172.21.15.77:0/2606162371 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f01bc06be60 0x7f01bc06e320 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:18.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:18.061+0000 7f01d563f640 1 --2- 172.21.15.77:0/2606162371 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f01d0150090 0x7f01d0147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:18.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:18.061+0000 7f01d563f640 1 --2- 172.21.15.77:0/2606162371 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01d00c8200 0x7f01d0147720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:18.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:18.061+0000 7f01d563f640 1 --2- 172.21.15.77:0/2606162371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d006c280 0x7f01d0159db0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:18.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:18.061+0000 7f01d563f640 1 -- 172.21.15.77:0/2606162371 >> 172.21.15.77:0/2606162371 conn(0x7f01d00ad4d0 msgr2=0x7f01d00c6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:18.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:18.061+0000 7f01d563f640 1 -- 172.21.15.77:0/2606162371 shutdown_connections 2024-04-25T01:39:18.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:18.061+0000 7f01d563f640 1 -- 172.21.15.77:0/2606162371 wait complete. 2024-04-25T01:39:19.030 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:39:19.033 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:39:20.055 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:39:20.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.181+0000 7fd4f46a5640 1 Processor -- start 2024-04-25T01:39:20.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.181+0000 7fd4f46a5640 1 -- start start 2024-04-25T01:39:20.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.182+0000 7fd4f46a5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd4ec156c80 0x7fd4ec0c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:20.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.182+0000 7fd4f46a5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd4ec06c280 0x7fd4ec0c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:20.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.182+0000 7fd4f46a5640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4ec157130 con 0x7fd4ec150090 2024-04-25T01:39:20.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.182+0000 7fd4f46a5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd4ec06b830 con 0x7fd4ec06c280 2024-04-25T01:39:20.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.182+0000 7fd4f46a5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd4ec0c9de0 con 0x7fd4ec156c80 2024-04-25T01:39:20.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.182+0000 7fd4f2c42640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd4ec06c280 0x7fd4ec0c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:20.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.182+0000 7fd4f2c42640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd4ec06c280 0x7fd4ec0c6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55990/0 (socket says 172.21.15.77:55990) 2024-04-25T01:39:20.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.182+0000 7fd4f2c42640 1 -- 172.21.15.77:0/2610597451 learned_addr learned my addr 172.21.15.77:0/2610597451 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:20.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.183+0000 7fd4f1c40640 1 --2- 172.21.15.77:0/2610597451 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd4ec156c80 0x7fd4ec0c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:20.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.183+0000 7fd4f2c42640 1 -- 172.21.15.77:0/2610597451 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd4ec156c80 msgr2=0x7fd4ec0c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:20.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.183+0000 7fd4f2c42640 1 --2- 172.21.15.77:0/2610597451 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd4ec156c80 0x7fd4ec0c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:20.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.183+0000 7fd4f2c42640 1 -- 172.21.15.77:0/2610597451 >> v1:172.21.15.121:6789/0 conn(0x7fd4ec150090 legacy=0x7fd4ec0c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:20.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.183+0000 7fd4f2c42640 1 -- 172.21.15.77:0/2610597451 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4ec0c89c0 con 0x7fd4ec06c280 2024-04-25T01:39:20.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.183+0000 7fd4f2c42640 1 --2- 172.21.15.77:0/2610597451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4ec06c280 0x7fd4ec0c6320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4009870 tx=0x7fd4e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66fad6c0209c141 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:20.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.183+0000 7fd4f143f640 1 -- 172.21.15.77:0/2610597451 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4037070 con 0x7fd4ec06c280 2024-04-25T01:39:20.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.184+0000 7fd4f143f640 1 -- 172.21.15.77:0/2610597451 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e4032440 con 0x7fd4ec06c280 2024-04-25T01:39:20.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.184+0000 7fd4f143f640 1 -- 172.21.15.77:0/2610597451 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4032810 con 0x7fd4ec06c280 2024-04-25T01:39:20.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.184+0000 7fd4f46a5640 1 -- 172.21.15.77:0/2610597451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4ec06c280 msgr2=0x7fd4ec0c6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:20.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.184+0000 7fd4f46a5640 1 --2- 172.21.15.77:0/2610597451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4ec06c280 0x7fd4ec0c6320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4009870 tx=0x7fd4e402a270 comp rx=0 tx=0).stop 2024-04-25T01:39:20.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.184+0000 7fd4f46a5640 1 -- 172.21.15.77:0/2610597451 shutdown_connections 2024-04-25T01:39:20.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.184+0000 7fd4f46a5640 1 --2- 172.21.15.77:0/2610597451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4ec06c280 0x7fd4ec0c6320 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:20.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.184+0000 7fd4f46a5640 1 --2- 172.21.15.77:0/2610597451 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd4ec156c80 0x7fd4ec0c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:20.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.184+0000 7fd4f46a5640 1 -- 172.21.15.77:0/2610597451 >> 172.21.15.77:0/2610597451 conn(0x7fd4ec0ad4d0 msgr2=0x7fd4ec0ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:20.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.184+0000 7fd4f46a5640 1 -- 172.21.15.77:0/2610597451 shutdown_connections 2024-04-25T01:39:20.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.184+0000 7fd4f46a5640 1 -- 172.21.15.77:0/2610597451 wait complete. 2024-04-25T01:39:20.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.185+0000 7fd4f46a5640 1 Processor -- start 2024-04-25T01:39:20.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.185+0000 7fd4f46a5640 1 -- start start 2024-04-25T01:39:20.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.186+0000 7fd4f46a5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd4ec06c280 0x7fd4ec1ef6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:20.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.186+0000 7fd4f46a5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4ec150090 0x7fd4ec0c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:20.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.186+0000 7fd4f46a5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4ec156c80 0x7fd4ec0c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:20.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.186+0000 7fd4f46a5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ec06bd60 con 0x7fd4ec150090 2024-04-25T01:39:20.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.186+0000 7fd4f46a5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ec06ba80 con 0x7fd4ec156c80 2024-04-25T01:39:20.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.186+0000 7fd4f46a5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd4ec06c6d0 con 0x7fd4ec06c280 2024-04-25T01:39:20.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.186+0000 7fd4f1c40640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4ec150090 0x7fd4ec0c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:20.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.186+0000 7fd4f1c40640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4ec150090 0x7fd4ec0c4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56000/0 (socket says 172.21.15.77:56000) 2024-04-25T01:39:20.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.186+0000 7fd4f1c40640 1 -- 172.21.15.77:0/2652464733 learned_addr learned my addr 172.21.15.77:0/2652464733 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:20.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.186+0000 7fd4f2c42640 1 --2- 172.21.15.77:0/2652464733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4ec156c80 0x7fd4ec0c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:20.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.186+0000 7fd4f2441640 1 --2- 172.21.15.77:0/2652464733 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd4ec06c280 0x7fd4ec1ef6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:20.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.186+0000 7fd4f1c40640 1 -- 172.21.15.77:0/2652464733 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd4ec06c280 msgr2=0x7fd4ec1ef6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:20.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.186+0000 7fd4f1c40640 1 --2- 172.21.15.77:0/2652464733 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd4ec06c280 0x7fd4ec1ef6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:20.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.186+0000 7fd4f1c40640 1 -- 172.21.15.77:0/2652464733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4ec156c80 msgr2=0x7fd4ec0c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:20.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.186+0000 7fd4f1c40640 1 --2- 172.21.15.77:0/2652464733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4ec156c80 0x7fd4ec0c4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:20.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.186+0000 7fd4f1c40640 1 -- 172.21.15.77:0/2652464733 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4ec1ec590 con 0x7fd4ec150090 2024-04-25T01:39:20.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.186+0000 7fd4f2c42640 1 --2- 172.21.15.77:0/2652464733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4ec156c80 0x7fd4ec0c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:20.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.186+0000 7fd4f2441640 1 --2- 172.21.15.77:0/2652464733 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd4ec06c280 0x7fd4ec1ef6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:20.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.186+0000 7fd4f1c40640 1 --2- 172.21.15.77:0/2652464733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4ec150090 0x7fd4ec0c4720 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00d5f0 tx=0x7fd4dc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:20.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.187+0000 7fd4e2ffd640 1 -- 172.21.15.77:0/2652464733 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc0125f0 con 0x7fd4ec150090 2024-04-25T01:39:20.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.187+0000 7fd4e2ffd640 1 -- 172.21.15.77:0/2652464733 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4dc019070 con 0x7fd4ec150090 2024-04-25T01:39:20.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.187+0000 7fd4f46a5640 1 -- 172.21.15.77:0/2652464733 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4ec1ec800 con 0x7fd4ec150090 2024-04-25T01:39:20.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.187+0000 7fd4e2ffd640 1 -- 172.21.15.77:0/2652464733 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc0129d0 con 0x7fd4ec150090 2024-04-25T01:39:20.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.187+0000 7fd4f46a5640 1 -- 172.21.15.77:0/2652464733 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4ec0c2a70 con 0x7fd4ec150090 2024-04-25T01:39:20.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.188+0000 7fd4f46a5640 1 -- 172.21.15.77:0/2652464733 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4ec04f500 con 0x7fd4ec150090 2024-04-25T01:39:20.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.188+0000 7fd4e2ffd640 1 -- 172.21.15.77:0/2652464733 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd4dc012b70 con 0x7fd4ec150090 2024-04-25T01:39:20.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.188+0000 7fd4e2ffd640 1 --2- 172.21.15.77:0/2652464733 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd4d006be30 0x7fd4d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:20.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.189+0000 7fd4e2ffd640 1 -- 172.21.15.77:0/2652464733 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fd4dc08aea0 con 0x7fd4ec150090 2024-04-25T01:39:20.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.189+0000 7fd4f2441640 1 --2- 172.21.15.77:0/2652464733 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd4d006be30 0x7fd4d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:20.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.189+0000 7fd4f2441640 1 --2- 172.21.15.77:0/2652464733 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd4d006be30 0x7fd4d006e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8001d70 tx=0x7fd4e8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:20.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.193+0000 7fd4e2ffd640 1 -- 172.21.15.77:0/2652464733 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd4dc059c30 con 0x7fd4ec150090 2024-04-25T01:39:20.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.402+0000 7fd4f46a5640 1 -- 172.21.15.77:0/2652464733 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4ec06cec0 con 0x7fd4ec150090 2024-04-25T01:39:20.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.402+0000 7fd4e2ffd640 1 -- 172.21.15.77:0/2652464733 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3870 (secure 0 0 0) 0x7fd4dc059530 con 0x7fd4ec150090 2024-04-25T01:39:20.385 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:20.385 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3454203695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3454203695},{"type":"v1","addr":"172.21.15.77:6837","nonce":3454203695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-25T01:39:20.385 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 3 2024-04-25T01:39:20.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.404+0000 7fd4f46a5640 1 -- 172.21.15.77:0/2652464733 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd4d006be30 msgr2=0x7fd4d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:20.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.404+0000 7fd4f46a5640 1 --2- 172.21.15.77:0/2652464733 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd4d006be30 0x7fd4d006e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8001d70 tx=0x7fd4e8009040 comp rx=0 tx=0).stop 2024-04-25T01:39:20.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.404+0000 7fd4f46a5640 1 -- 172.21.15.77:0/2652464733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4ec150090 msgr2=0x7fd4ec0c4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:20.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.404+0000 7fd4f46a5640 1 --2- 172.21.15.77:0/2652464733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4ec150090 0x7fd4ec0c4720 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00d5f0 tx=0x7fd4dc00dab0 comp rx=0 tx=0).stop 2024-04-25T01:39:20.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.404+0000 7fd4f46a5640 1 -- 172.21.15.77:0/2652464733 shutdown_connections 2024-04-25T01:39:20.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.404+0000 7fd4f46a5640 1 --2- 172.21.15.77:0/2652464733 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd4d006be30 0x7fd4d006e2f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:20.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.404+0000 7fd4f46a5640 1 --2- 172.21.15.77:0/2652464733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4ec150090 0x7fd4ec0c4720 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:20.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.404+0000 7fd4f46a5640 1 --2- 172.21.15.77:0/2652464733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4ec156c80 0x7fd4ec0c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:20.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.404+0000 7fd4f46a5640 1 --2- 172.21.15.77:0/2652464733 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd4ec06c280 0x7fd4ec1ef6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:20.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.404+0000 7fd4f46a5640 1 -- 172.21.15.77:0/2652464733 >> 172.21.15.77:0/2652464733 conn(0x7fd4ec0ad4d0 msgr2=0x7fd4ec1549f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:20.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.404+0000 7fd4f46a5640 1 -- 172.21.15.77:0/2652464733 shutdown_connections 2024-04-25T01:39:20.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.404+0000 7fd4f46a5640 1 -- 172.21.15.77:0/2652464733 wait complete. 2024-04-25T01:39:20.397 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T01:39:20.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.512+0000 7f12abb22640 1 Processor -- start 2024-04-25T01:39:20.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.512+0000 7f12abb22640 1 -- start start 2024-04-25T01:39:20.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.513+0000 7f12abb22640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f12a40c2810 0x7f12a40c3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:20.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.513+0000 7f12abb22640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a40c2c60 con 0x7f12a40c44c0 2024-04-25T01:39:20.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.513+0000 7f12abb22640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a4156340 con 0x7f12a4150170 2024-04-25T01:39:20.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.513+0000 7f12abb22640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f12a4156f50 con 0x7f12a40c2810 2024-04-25T01:39:20.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.513+0000 7f12a90bd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f12a40c44c0 0x7f12a40c3270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57928/0 (socket says 172.21.15.77:57928) 2024-04-25T01:39:20.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.513+0000 7f12a90bd640 1 -- 172.21.15.77:0/2198353528 learned_addr learned my addr 172.21.15.77:0/2198353528 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:20.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.513+0000 7f12aa0bf640 1 --2- 172.21.15.77:0/2198353528 >> v2:172.21.15.121:3300/0 conn(0x7f12a40c2810 0x7f12a40c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:20.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.513+0000 7f12a88bc640 1 -- 172.21.15.77:0/2198353528 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1126618086 0 0) 0x7f12a40c2c60 con 0x7f12a40c44c0 2024-04-25T01:39:20.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.513+0000 7f12a88bc640 1 -- 172.21.15.77:0/2198353528 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1290003520 con 0x7f12a40c44c0 2024-04-25T01:39:20.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.514+0000 7f12aa0bf640 1 -- 172.21.15.77:0/2198353528 >> v1:172.21.15.121:6789/0 conn(0x7f12a4150170 legacy=0x7f12a40c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:20.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.514+0000 7f12aa0bf640 1 -- 172.21.15.77:0/2198353528 >> v1:172.21.15.77:6789/0 conn(0x7f12a40c44c0 legacy=0x7f12a40c3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:20.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.514+0000 7f12a88bc640 1 -- 172.21.15.77:0/2198353528 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2996913045 0 0) 0x7f1290003520 con 0x7f12a40c44c0 2024-04-25T01:39:20.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.514+0000 7f12aa0bf640 1 -- 172.21.15.77:0/2198353528 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a4156620 con 0x7f12a40c2810 2024-04-25T01:39:20.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.514+0000 7f12aa0bf640 1 --2- 172.21.15.77:0/2198353528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12a40c2810 0x7f12a40c3980 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f129c009d90 tx=0x7f129c02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d685652e455cccf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:20.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.514+0000 7f12a88bc640 1 -- 172.21.15.77:0/2198353528 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1294001670 con 0x7f12a40c2810 2024-04-25T01:39:20.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.515+0000 7f12a88bc640 1 -- 172.21.15.77:0/2198353528 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f129c007540 con 0x7f12a40c2810 2024-04-25T01:39:20.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.515+0000 7f12a88bc640 1 -- 172.21.15.77:0/2198353528 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c0078f0 con 0x7f12a40c2810 2024-04-25T01:39:20.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.515+0000 7f12abb22640 1 -- 172.21.15.77:0/2198353528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12a40c2810 msgr2=0x7f12a40c3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:20.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.515+0000 7f12abb22640 1 --2- 172.21.15.77:0/2198353528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12a40c2810 0x7f12a40c3980 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f129c009d90 tx=0x7f129c02a5f0 comp rx=0 tx=0).stop 2024-04-25T01:39:20.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.515+0000 7f12abb22640 1 -- 172.21.15.77:0/2198353528 shutdown_connections 2024-04-25T01:39:20.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.515+0000 7f12abb22640 1 --2- 172.21.15.77:0/2198353528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12a40c2810 0x7f12a40c3980 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:20.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.515+0000 7f12abb22640 1 -- 172.21.15.77:0/2198353528 >> 172.21.15.77:0/2198353528 conn(0x7f12a40c8590 msgr2=0x7f12a40c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:20.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.515+0000 7f12abb22640 1 -- 172.21.15.77:0/2198353528 shutdown_connections 2024-04-25T01:39:20.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.515+0000 7f12abb22640 1 -- 172.21.15.77:0/2198353528 wait complete. 2024-04-25T01:39:20.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.516+0000 7f12abb22640 1 Processor -- start 2024-04-25T01:39:20.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.516+0000 7f12abb22640 1 -- start start 2024-04-25T01:39:20.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.517+0000 7f12abb22640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a40c2810 0x7f12a414f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:20.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.517+0000 7f12abb22640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f12a40c44c0 0x7f12a41ebdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:20.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.517+0000 7f12abb22640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12a4150170 0x7f12a41ec330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:20.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.517+0000 7f12abb22640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f12a40c3ec0 con 0x7f12a40c2810 2024-04-25T01:39:20.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.517+0000 7f12abb22640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f12a4156be0 con 0x7f12a4150170 2024-04-25T01:39:20.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.517+0000 7f12abb22640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f12a4155ff0 con 0x7f12a40c44c0 2024-04-25T01:39:20.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.517+0000 7f12a98be640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a40c2810 0x7f12a414f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:20.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.517+0000 7f12a98be640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a40c2810 0x7f12a414f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56002/0 (socket says 172.21.15.77:56002) 2024-04-25T01:39:20.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.517+0000 7f12a98be640 1 -- 172.21.15.77:0/2659626588 learned_addr learned my addr 172.21.15.77:0/2659626588 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:20.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.517+0000 7f12a90bd640 1 --2- 172.21.15.77:0/2659626588 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f12a40c44c0 0x7f12a41ebdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:20.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.517+0000 7f12aa0bf640 1 --2- 172.21.15.77:0/2659626588 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12a4150170 0x7f12a41ec330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:20.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.517+0000 7f12a98be640 1 -- 172.21.15.77:0/2659626588 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f12a40c44c0 msgr2=0x7f12a41ebdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:20.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.517+0000 7f12a98be640 1 --2- 172.21.15.77:0/2659626588 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f12a40c44c0 0x7f12a41ebdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:20.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.517+0000 7f12a98be640 1 -- 172.21.15.77:0/2659626588 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12a4150170 msgr2=0x7f12a41ec330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:20.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.517+0000 7f12a98be640 1 --2- 172.21.15.77:0/2659626588 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12a4150170 0x7f12a41ec330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:20.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.517+0000 7f12a98be640 1 -- 172.21.15.77:0/2659626588 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a4154ab0 con 0x7f12a40c2810 2024-04-25T01:39:20.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.517+0000 7f12a98be640 1 --2- 172.21.15.77:0/2659626588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a40c2810 0x7f12a414f1f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f12a000c480 tx=0x7f12a000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:20.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.517+0000 7f129a7fc640 1 -- 172.21.15.77:0/2659626588 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a00052d0 con 0x7f12a40c2810 2024-04-25T01:39:20.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.517+0000 7f129a7fc640 1 -- 172.21.15.77:0/2659626588 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12a0005470 con 0x7f12a40c2810 2024-04-25T01:39:20.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.517+0000 7f12abb22640 1 -- 172.21.15.77:0/2659626588 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12a4159e60 con 0x7f12a40c2810 2024-04-25T01:39:20.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.517+0000 7f129a7fc640 1 -- 172.21.15.77:0/2659626588 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a0012870 con 0x7f12a40c2810 2024-04-25T01:39:20.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.518+0000 7f12abb22640 1 -- 172.21.15.77:0/2659626588 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12a415a100 con 0x7f12a40c2810 2024-04-25T01:39:20.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.518+0000 7f12abb22640 1 -- 172.21.15.77:0/2659626588 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12a404f500 con 0x7f12a40c2810 2024-04-25T01:39:20.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.519+0000 7f129a7fc640 1 -- 172.21.15.77:0/2659626588 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f12a0012a10 con 0x7f12a40c2810 2024-04-25T01:39:20.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.519+0000 7f129a7fc640 1 --2- 172.21.15.77:0/2659626588 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f128806be30 0x7f128806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:20.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.519+0000 7f129a7fc640 1 -- 172.21.15.77:0/2659626588 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f12a008a730 con 0x7f12a40c2810 2024-04-25T01:39:20.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.519+0000 7f12a90bd640 1 --2- 172.21.15.77:0/2659626588 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f128806be30 0x7f128806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:20.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.520+0000 7f12a90bd640 1 --2- 172.21.15.77:0/2659626588 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f128806be30 0x7f128806e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f12a4149dc0 tx=0x7f1294009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:20.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.524+0000 7f129a7fc640 1 -- 172.21.15.77:0/2659626588 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f12a00594c0 con 0x7f12a40c2810 2024-04-25T01:39:20.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.698+0000 7f12abb22640 1 -- 172.21.15.77:0/2659626588 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12a40c3ca0 con 0x7f12a40c2810 2024-04-25T01:39:20.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.699+0000 7f129a7fc640 1 -- 172.21.15.77:0/2659626588 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12872 (secure 0 0 0) 0x7f12a0058dc0 con 0x7f12a40c2810 2024-04-25T01:39:20.681 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:20.681 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":16,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:39:13.776753+0000","last_up_change":"2024-04-25T01:39:10.729600+0000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T01:39:11.681151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6811","nonce":3366980158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6817","nonce":3366980158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6828","nonce":3366980158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6825","nonce":3366980158}]},"public_addr":"172.21.15.77:6811/3366980158","cluster_addr":"172.21.15.77:6817/3366980158","heartbeat_back_addr":"172.21.15.77:6828/3366980158","heartbeat_front_addr":"172.21.15.77:6825/3366980158","state":["exists","up"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6801","nonce":3971619298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6803","nonce":3971619298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6807","nonce":3971619298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6805","nonce":3971619298}]},"public_addr":"172.21.15.77:6801/3971619298","cluster_addr":"172.21.15.77:6803/3971619298","heartbeat_back_addr":"172.21.15.77:6807/3971619298","heartbeat_front_addr":"172.21.15.77:6805/3971619298","state":["exists","up"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6810","nonce":4103452689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6813","nonce":4103452689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6823","nonce":4103452689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6818","nonce":4103452689}]},"public_addr":"172.21.15.77:6810/4103452689","cluster_addr":"172.21.15.77:6813/4103452689","heartbeat_back_addr":"172.21.15.77:6823/4103452689","heartbeat_front_addr":"172.21.15.77:6818/4103452689","state":["exists","up"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6819","nonce":217398906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6824","nonce":217398906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6831","nonce":217398906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6829","nonce":217398906}]},"public_addr":"172.21.15.77:6819/217398906","cluster_addr":"172.21.15.77:6824/217398906","heartbeat_back_addr":"172.21.15.77:6831/217398906","heartbeat_front_addr":"172.21.15.77:6829/217398906","state":["exists","up"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6801","nonce":2565483070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6803","nonce":2565483070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6810","nonce":2565483070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6806","nonce":2565483070}]},"public_addr":"172.21.15.121:6801/2565483070","cluster_addr":"172.21.15.121:6803/2565483070","heartbeat_back_addr":"172.21.15.121:6810/2565483070","heartbeat_front_addr":"172.21.15.121:6806/2565483070","state":["exists","up"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6807","nonce":2785294752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6809","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6811","nonce":2785294752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6815","nonce":2785294752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6813","nonce":2785294752}]},"public_addr":"172.21.15.121:6807/2785294752","cluster_addr":"172.21.15.121:6811/2785294752","heartbeat_back_addr":"172.21.15.121:6815/2785294752","heartbeat_front_addr":"172.21.15.121:6813/2785294752","state":["exists","up"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6820","nonce":523906818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6824","nonce":523906818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6831","nonce":523906818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6828","nonce":523906818}]},"public_addr":"172.21.15.121:6820/523906818","cluster_addr":"172.21.15.121:6824/523906818","heartbeat_back_addr":"172.21.15.121:6831/523906818","heartbeat_front_addr":"172.21.15.121:6828/523906818","state":["exists","up"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6817","nonce":1683602459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6819","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6821","nonce":1683602459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6829","nonce":1683602459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6823","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6825","nonce":1683602459}]},"public_addr":"172.21.15.121:6817/1683602459","cluster_addr":"172.21.15.121:6821/1683602459","heartbeat_back_addr":"172.21.15.121:6829/1683602459","heartbeat_front_addr":"172.21.15.121:6825/1683602459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.839443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.818842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.776243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.793085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.822396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.907311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.918374+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.848430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:39:20.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.701+0000 7f12abb22640 1 -- 172.21.15.77:0/2659626588 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f128806be30 msgr2=0x7f128806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:20.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.701+0000 7f12abb22640 1 --2- 172.21.15.77:0/2659626588 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f128806be30 0x7f128806e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f12a4149dc0 tx=0x7f1294009040 comp rx=0 tx=0).stop 2024-04-25T01:39:20.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.701+0000 7f12abb22640 1 -- 172.21.15.77:0/2659626588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a40c2810 msgr2=0x7f12a414f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:20.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.701+0000 7f12abb22640 1 --2- 172.21.15.77:0/2659626588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a40c2810 0x7f12a414f1f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f12a000c480 tx=0x7f12a000c940 comp rx=0 tx=0).stop 2024-04-25T01:39:20.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.701+0000 7f12abb22640 1 -- 172.21.15.77:0/2659626588 shutdown_connections 2024-04-25T01:39:20.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.701+0000 7f12abb22640 1 --2- 172.21.15.77:0/2659626588 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f128806be30 0x7f128806e2f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:20.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.701+0000 7f12abb22640 1 --2- 172.21.15.77:0/2659626588 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12a4150170 0x7f12a41ec330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:20.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.701+0000 7f12abb22640 1 --2- 172.21.15.77:0/2659626588 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f12a40c44c0 0x7f12a41ebdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:20.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.701+0000 7f12abb22640 1 --2- 172.21.15.77:0/2659626588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a40c2810 0x7f12a414f1f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:20.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.701+0000 7f12abb22640 1 -- 172.21.15.77:0/2659626588 >> 172.21.15.77:0/2659626588 conn(0x7f12a40c8590 msgr2=0x7f12a414c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:20.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.701+0000 7f12abb22640 1 -- 172.21.15.77:0/2659626588 shutdown_connections 2024-04-25T01:39:20.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.701+0000 7f12abb22640 1 -- 172.21.15.77:0/2659626588 wait complete. 2024-04-25T01:39:20.694 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T01:39:11.681151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T01:39:20.694 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T01:39:20.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.812+0000 7f2035142640 1 Processor -- start 2024-04-25T01:39:20.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.812+0000 7f2035142640 1 -- start start 2024-04-25T01:39:20.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.812+0000 7f2035142640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f203006b380 0x7f203006e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:20.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.812+0000 7f2035142640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f203006bd50 0x7f20300c2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:20.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.812+0000 7f2035142640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2030155fc0 0x7f203006f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:20.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.812+0000 7f2035142640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f2030156ef0 con 0x7f203006b380 2024-04-25T01:39:20.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.812+0000 7f2035142640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f203006ed30 con 0x7f203006bd50 2024-04-25T01:39:20.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.812+0000 7f2035142640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f2030156930 con 0x7f2030155fc0 2024-04-25T01:39:20.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.812+0000 7f202ed9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f203006b380 0x7f203006e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:20.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.812+0000 7f202ed9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f203006b380 0x7f203006e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56004/0 (socket says 172.21.15.77:56004) 2024-04-25T01:39:20.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.812+0000 7f202ed9d640 1 -- 172.21.15.77:0/3578066953 learned_addr learned my addr 172.21.15.77:0/3578066953 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:20.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.813+0000 7f202f59e640 1 --2- 172.21.15.77:0/3578066953 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2030155fc0 0x7f203006f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:20.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.813+0000 7f202e59c640 1 --2- 172.21.15.77:0/3578066953 >> v2:172.21.15.121:3300/0 conn(0x7f203006bd50 0x7f20300c2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:20.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.813+0000 7f202ed9d640 1 -- 172.21.15.77:0/3578066953 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2030155fc0 msgr2=0x7f203006f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:20.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.813+0000 7f202ed9d640 1 --2- 172.21.15.77:0/3578066953 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2030155fc0 0x7f203006f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:20.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.813+0000 7f202ed9d640 1 -- 172.21.15.77:0/3578066953 >> v2:172.21.15.121:3300/0 conn(0x7f203006bd50 msgr2=0x7f20300c2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:20.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.813+0000 7f202ed9d640 1 --2- 172.21.15.77:0/3578066953 >> v2:172.21.15.121:3300/0 conn(0x7f203006bd50 0x7f20300c2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:20.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.813+0000 7f202ed9d640 1 -- 172.21.15.77:0/3578066953 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2030156c10 con 0x7f203006b380 2024-04-25T01:39:20.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.813+0000 7f202e59c640 1 --2- 172.21.15.77:0/3578066953 >> v2:172.21.15.121:3300/0 conn(0x7f203006bd50 0x7f20300c2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:20.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.813+0000 7f202f59e640 1 --2- 172.21.15.77:0/3578066953 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2030155fc0 0x7f203006f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:20.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.813+0000 7f202ed9d640 1 --2- 172.21.15.77:0/3578066953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f203006b380 0x7f203006e7f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f20300c4a50 tx=0x7f202802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48bde61ab3a5645f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:20.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.814+0000 7f202dd9b640 1 -- 172.21.15.77:0/3578066953 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2028037070 con 0x7f203006b380 2024-04-25T01:39:20.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.814+0000 7f202dd9b640 1 -- 172.21.15.77:0/3578066953 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2028032440 con 0x7f203006b380 2024-04-25T01:39:20.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.814+0000 7f202dd9b640 1 -- 172.21.15.77:0/3578066953 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2028032810 con 0x7f203006b380 2024-04-25T01:39:20.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.814+0000 7f2035142640 1 -- 172.21.15.77:0/3578066953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f203006b380 msgr2=0x7f203006e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:20.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.814+0000 7f2035142640 1 --2- 172.21.15.77:0/3578066953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f203006b380 0x7f203006e7f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f20300c4a50 tx=0x7f202802a140 comp rx=0 tx=0).stop 2024-04-25T01:39:20.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.814+0000 7f2035142640 1 -- 172.21.15.77:0/3578066953 shutdown_connections 2024-04-25T01:39:20.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.814+0000 7f2035142640 1 --2- 172.21.15.77:0/3578066953 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2030155fc0 0x7f203006f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:20.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.814+0000 7f2035142640 1 --2- 172.21.15.77:0/3578066953 >> v2:172.21.15.121:3300/0 conn(0x7f203006bd50 0x7f20300c2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:20.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.814+0000 7f2035142640 1 --2- 172.21.15.77:0/3578066953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f203006b380 0x7f203006e7f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:20.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.814+0000 7f2035142640 1 -- 172.21.15.77:0/3578066953 >> 172.21.15.77:0/3578066953 conn(0x7f20300c8630 msgr2=0x7f20300c8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:20.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.814+0000 7f2035142640 1 -- 172.21.15.77:0/3578066953 shutdown_connections 2024-04-25T01:39:20.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.814+0000 7f2035142640 1 -- 172.21.15.77:0/3578066953 wait complete. 2024-04-25T01:39:20.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.815+0000 7f2035142640 1 Processor -- start 2024-04-25T01:39:20.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.815+0000 7f2035142640 1 -- start start 2024-04-25T01:39:20.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.816+0000 7f2035142640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f203006b380 0x7f20301ebd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:20.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.816+0000 7f2035142640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f203006bd50 0x7f20301539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:20.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.816+0000 7f2035142640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2030155fc0 0x7f20301ee6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:20.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.816+0000 7f2035142640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f20300c28d0 con 0x7f2030155fc0 2024-04-25T01:39:20.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.816+0000 7f2035142640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f20300c1e70 con 0x7f203006b380 2024-04-25T01:39:20.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.816+0000 7f2035142640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f203006b760 con 0x7f203006bd50 2024-04-25T01:39:20.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.816+0000 7f202f59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2030155fc0 0x7f20301ee6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:20.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.816+0000 7f202f59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2030155fc0 0x7f20301ee6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56006/0 (socket says 172.21.15.77:56006) 2024-04-25T01:39:20.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.816+0000 7f202f59e640 1 -- 172.21.15.77:0/3795206320 learned_addr learned my addr 172.21.15.77:0/3795206320 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:20.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.816+0000 7f202e59c640 1 --2- 172.21.15.77:0/3795206320 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f203006bd50 0x7f20301539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:20.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.816+0000 7f202ed9d640 1 --2- 172.21.15.77:0/3795206320 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f203006b380 0x7f20301ebd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:20.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.816+0000 7f202f59e640 1 -- 172.21.15.77:0/3795206320 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f203006bd50 msgr2=0x7f20301539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:20.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.816+0000 7f202f59e640 1 --2- 172.21.15.77:0/3795206320 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f203006bd50 0x7f20301539c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:20.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.817+0000 7f202f59e640 1 -- 172.21.15.77:0/3795206320 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f203006b380 msgr2=0x7f20301ebd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:20.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.817+0000 7f202f59e640 1 --2- 172.21.15.77:0/3795206320 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f203006b380 0x7f20301ebd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:20.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.817+0000 7f202f59e640 1 -- 172.21.15.77:0/3795206320 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2030154500 con 0x7f2030155fc0 2024-04-25T01:39:20.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.817+0000 7f202f59e640 1 --2- 172.21.15.77:0/3795206320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2030155fc0 0x7f20301ee6d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f202000cd80 tx=0x7f202000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:20.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.817+0000 7f20177fe640 1 -- 172.21.15.77:0/3795206320 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202000f680 con 0x7f2030155fc0 2024-04-25T01:39:20.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.817+0000 7f20177fe640 1 -- 172.21.15.77:0/3795206320 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f202000f840 con 0x7f2030155fc0 2024-04-25T01:39:20.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.817+0000 7f2035142640 1 -- 172.21.15.77:0/3795206320 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20301eb240 con 0x7f2030155fc0 2024-04-25T01:39:20.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.817+0000 7f20177fe640 1 -- 172.21.15.77:0/3795206320 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202000fc30 con 0x7f2030155fc0 2024-04-25T01:39:20.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.817+0000 7f2035142640 1 -- 172.21.15.77:0/3795206320 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20301eb800 con 0x7f2030155fc0 2024-04-25T01:39:20.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.818+0000 7f2035142640 1 -- 172.21.15.77:0/3795206320 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f203004f500 con 0x7f2030155fc0 2024-04-25T01:39:20.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.818+0000 7f20177fe640 1 -- 172.21.15.77:0/3795206320 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f20200213f0 con 0x7f2030155fc0 2024-04-25T01:39:20.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.819+0000 7f20177fe640 1 --2- 172.21.15.77:0/3795206320 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f201c06be30 0x7f201c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:20.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.819+0000 7f20177fe640 1 -- 172.21.15.77:0/3795206320 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f202008b720 con 0x7f2030155fc0 2024-04-25T01:39:20.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.819+0000 7f202ed9d640 1 --2- 172.21.15.77:0/3795206320 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f201c06be30 0x7f201c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:20.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.819+0000 7f202ed9d640 1 --2- 172.21.15.77:0/3795206320 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f201c06be30 0x7f201c06e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2028034000 tx=0x7f202802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:20.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.823+0000 7f20177fe640 1 -- 172.21.15.77:0/3795206320 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2020014030 con 0x7f2030155fc0 2024-04-25T01:39:20.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.996+0000 7f2035142640 1 -- 172.21.15.77:0/3795206320 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f20301eb9d0 con 0x7f2030155fc0 2024-04-25T01:39:20.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.996+0000 7f20177fe640 1 -- 172.21.15.77:0/3795206320 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f2020059e60 con 0x7f2030155fc0 2024-04-25T01:39:20.979 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-25T01:39:20.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.998+0000 7f2035142640 1 -- 172.21.15.77:0/3795206320 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f201c06be30 msgr2=0x7f201c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:20.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.998+0000 7f2035142640 1 --2- 172.21.15.77:0/3795206320 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f201c06be30 0x7f201c06e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2028034000 tx=0x7f202802e000 comp rx=0 tx=0).stop 2024-04-25T01:39:20.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.998+0000 7f2035142640 1 -- 172.21.15.77:0/3795206320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2030155fc0 msgr2=0x7f20301ee6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:20.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.998+0000 7f2035142640 1 --2- 172.21.15.77:0/3795206320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2030155fc0 0x7f20301ee6d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f202000cd80 tx=0x7f202000a650 comp rx=0 tx=0).stop 2024-04-25T01:39:20.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.998+0000 7f2035142640 1 -- 172.21.15.77:0/3795206320 shutdown_connections 2024-04-25T01:39:20.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.998+0000 7f2035142640 1 --2- 172.21.15.77:0/3795206320 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f201c06be30 0x7f201c06e2f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:20.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.998+0000 7f2035142640 1 --2- 172.21.15.77:0/3795206320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2030155fc0 0x7f20301ee6d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:20.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.998+0000 7f2035142640 1 --2- 172.21.15.77:0/3795206320 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f203006bd50 0x7f20301539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:20.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.998+0000 7f2035142640 1 --2- 172.21.15.77:0/3795206320 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f203006b380 0x7f20301ebd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:20.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.998+0000 7f2035142640 1 -- 172.21.15.77:0/3795206320 >> 172.21.15.77:0/3795206320 conn(0x7f20300c8630 msgr2=0x7f203006f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:20.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.998+0000 7f2035142640 1 -- 172.21.15.77:0/3795206320 shutdown_connections 2024-04-25T01:39:20.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:20.998+0000 7f2035142640 1 -- 172.21.15.77:0/3795206320 wait complete. 2024-04-25T01:39:20.991 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T01:39:21.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.105+0000 7fc3ff1a9640 1 Processor -- start 2024-04-25T01:39:21.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.105+0000 7fc3ff1a9640 1 -- start start 2024-04-25T01:39:21.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.106+0000 7fc3ff1a9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc3f80c6b70 0x7fc3f8157450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:21.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.106+0000 7fc3ff1a9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3f8157de0 con 0x7fc3f8157990 2024-04-25T01:39:21.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.106+0000 7fc3ff1a9640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3f8070170 con 0x7fc3f8151390 2024-04-25T01:39:21.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.106+0000 7fc3ff1a9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc3f81541f0 con 0x7fc3f80c6b70 2024-04-25T01:39:21.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.106+0000 7fc3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc3f80c6b70 0x7fc3f8157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:21.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.106+0000 7fc3fd746640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc3f8157990 0x7fc3f815e7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57932/0 (socket says 172.21.15.77:57932) 2024-04-25T01:39:21.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.106+0000 7fc3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc3f80c6b70 0x7fc3f8157450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56018/0 (socket says 172.21.15.77:56018) 2024-04-25T01:39:21.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.106+0000 7fc3fd746640 1 -- 172.21.15.77:0/2241661438 learned_addr learned my addr 172.21.15.77:0/2241661438 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:21.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.106+0000 7fc3f7fff640 1 -- 172.21.15.77:0/2241661438 >> v1:172.21.15.121:6789/0 conn(0x7fc3f8151390 legacy=0x7fc3f80ab380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:21.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.106+0000 7fc3f7fff640 1 -- 172.21.15.77:0/2241661438 >> v1:172.21.15.77:6789/0 conn(0x7fc3f8157990 legacy=0x7fc3f815e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:21.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.106+0000 7fc3f77fe640 1 -- 172.21.15.77:0/2241661438 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3952196217 0 0) 0x7fc3f8157de0 con 0x7fc3f8157990 2024-04-25T01:39:21.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.106+0000 7fc3f7fff640 1 -- 172.21.15.77:0/2241661438 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3f81544d0 con 0x7fc3f80c6b70 2024-04-25T01:39:21.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.107+0000 7fc3f7fff640 1 --2- 172.21.15.77:0/2241661438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3f80c6b70 0x7fc3f8157450 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0097a0 tx=0x7fc3ec02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8bbe55f6ccc07f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:21.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.107+0000 7fc3f77fe640 1 -- 172.21.15.77:0/2241661438 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec037070 con 0x7fc3f80c6b70 2024-04-25T01:39:21.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.107+0000 7fc3f77fe640 1 -- 172.21.15.77:0/2241661438 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3ec02ae50 con 0x7fc3f80c6b70 2024-04-25T01:39:21.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.107+0000 7fc3f77fe640 1 -- 172.21.15.77:0/2241661438 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec032660 con 0x7fc3f80c6b70 2024-04-25T01:39:21.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.108+0000 7fc3ff1a9640 1 -- 172.21.15.77:0/2241661438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3f80c6b70 msgr2=0x7fc3f8157450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:21.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.108+0000 7fc3ff1a9640 1 --2- 172.21.15.77:0/2241661438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3f80c6b70 0x7fc3f8157450 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0097a0 tx=0x7fc3ec02a140 comp rx=0 tx=0).stop 2024-04-25T01:39:21.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.108+0000 7fc3ff1a9640 1 -- 172.21.15.77:0/2241661438 shutdown_connections 2024-04-25T01:39:21.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.108+0000 7fc3ff1a9640 1 --2- 172.21.15.77:0/2241661438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3f80c6b70 0x7fc3f8157450 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:21.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.108+0000 7fc3ff1a9640 1 -- 172.21.15.77:0/2241661438 >> 172.21.15.77:0/2241661438 conn(0x7fc3f806b530 msgr2=0x7fc3f80aa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:21.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.108+0000 7fc3ff1a9640 1 -- 172.21.15.77:0/2241661438 shutdown_connections 2024-04-25T01:39:21.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.108+0000 7fc3ff1a9640 1 -- 172.21.15.77:0/2241661438 wait complete. 2024-04-25T01:39:21.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.109+0000 7fc3ff1a9640 1 Processor -- start 2024-04-25T01:39:21.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.109+0000 7fc3ff1a9640 1 -- start start 2024-04-25T01:39:21.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.110+0000 7fc3ff1a9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3f80c6b70 0x7fc3f814fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:21.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.110+0000 7fc3ff1a9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3f8151390 0x7fc3f80acad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:21.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.110+0000 7fc3ff1a9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc3f8157990 0x7fc3f80ad010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:21.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.110+0000 7fc3ff1a9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f806f290 con 0x7fc3f8151390 2024-04-25T01:39:21.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.110+0000 7fc3ff1a9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f8153ec0 con 0x7fc3f80c6b70 2024-04-25T01:39:21.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.110+0000 7fc3ff1a9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc3f80aba90 con 0x7fc3f8157990 2024-04-25T01:39:21.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.110+0000 7fc3f7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3f8151390 0x7fc3f80acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:21.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.110+0000 7fc3f7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3f8151390 0x7fc3f80acad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56032/0 (socket says 172.21.15.77:56032) 2024-04-25T01:39:21.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.110+0000 7fc3f7fff640 1 -- 172.21.15.77:0/3818422790 learned_addr learned my addr 172.21.15.77:0/3818422790 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:21.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.110+0000 7fc3fd746640 1 --2- 172.21.15.77:0/3818422790 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc3f8157990 0x7fc3f80ad010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:21.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.110+0000 7fc3fcf45640 1 --2- 172.21.15.77:0/3818422790 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3f80c6b70 0x7fc3f814fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:21.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.110+0000 7fc3f7fff640 1 -- 172.21.15.77:0/3818422790 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc3f8157990 msgr2=0x7fc3f80ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:21.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.110+0000 7fc3f7fff640 1 --2- 172.21.15.77:0/3818422790 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc3f8157990 0x7fc3f80ad010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:21.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.110+0000 7fc3f7fff640 1 -- 172.21.15.77:0/3818422790 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3f80c6b70 msgr2=0x7fc3f814fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:21.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.110+0000 7fc3f7fff640 1 --2- 172.21.15.77:0/3818422790 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3f80c6b70 0x7fc3f814fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:21.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.110+0000 7fc3f7fff640 1 -- 172.21.15.77:0/3818422790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3f8155250 con 0x7fc3f8151390 2024-04-25T01:39:21.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.110+0000 7fc3f7fff640 1 --2- 172.21.15.77:0/3818422790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3f8151390 0x7fc3f80acad0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0097a0 tx=0x7fc3ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:21.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.110+0000 7fc3f57fa640 1 -- 172.21.15.77:0/3818422790 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec042070 con 0x7fc3f8151390 2024-04-25T01:39:21.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.110+0000 7fc3f57fa640 1 -- 172.21.15.77:0/3818422790 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3ec03e670 con 0x7fc3f8151390 2024-04-25T01:39:21.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.110+0000 7fc3ff1a9640 1 -- 172.21.15.77:0/3818422790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3f8155530 con 0x7fc3f8151390 2024-04-25T01:39:21.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.110+0000 7fc3f57fa640 1 -- 172.21.15.77:0/3818422790 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec037040 con 0x7fc3f8151390 2024-04-25T01:39:21.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.110+0000 7fc3ff1a9640 1 -- 172.21.15.77:0/3818422790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3f8155af0 con 0x7fc3f8151390 2024-04-25T01:39:21.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.111+0000 7fc3ff1a9640 1 -- 172.21.15.77:0/3818422790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3f80688e0 con 0x7fc3f8151390 2024-04-25T01:39:21.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.112+0000 7fc3f57fa640 1 -- 172.21.15.77:0/3818422790 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc3ec045070 con 0x7fc3f8151390 2024-04-25T01:39:21.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.112+0000 7fc3f57fa640 1 --2- 172.21.15.77:0/3818422790 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc3e406be30 0x7fc3e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:21.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.112+0000 7fc3f57fa640 1 -- 172.21.15.77:0/3818422790 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fc3ec0ab0f0 con 0x7fc3f8151390 2024-04-25T01:39:21.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.112+0000 7fc3fcf45640 1 --2- 172.21.15.77:0/3818422790 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc3e406be30 0x7fc3e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:21.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.113+0000 7fc3fcf45640 1 --2- 172.21.15.77:0/3818422790 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc3e406be30 0x7fc3e406e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8004ea0 tx=0x7fc3e8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:21.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.117+0000 7fc3f57fa640 1 -- 172.21.15.77:0/3818422790 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc3ec079fa0 con 0x7fc3f8151390 2024-04-25T01:39:21.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.291+0000 7fc3ff1a9640 1 -- 172.21.15.77:0/3818422790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc3f804f500 con 0x7fc3f8151390 2024-04-25T01:39:21.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.291+0000 7fc3f57fa640 1 -- 172.21.15.77:0/3818422790 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7fc3ec0798a0 con 0x7fc3f8151390 2024-04-25T01:39:21.273 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:21.274 INFO:teuthology.orchestra.run.smithi077.stdout:[ 2024-04-25T01:39:21.274 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-25T01:39:21.274 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 1, 2024-04-25T01:39:21.274 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": ".mgr" 2024-04-25T01:39:21.274 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-25T01:39:21.274 INFO:teuthology.orchestra.run.smithi077.stdout:] 2024-04-25T01:39:21.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.293+0000 7fc3ff1a9640 1 -- 172.21.15.77:0/3818422790 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc3e406be30 msgr2=0x7fc3e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:21.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.293+0000 7fc3ff1a9640 1 --2- 172.21.15.77:0/3818422790 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc3e406be30 0x7fc3e406e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8004ea0 tx=0x7fc3e8009040 comp rx=0 tx=0).stop 2024-04-25T01:39:21.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.293+0000 7fc3ff1a9640 1 -- 172.21.15.77:0/3818422790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3f8151390 msgr2=0x7fc3f80acad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:21.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.293+0000 7fc3ff1a9640 1 --2- 172.21.15.77:0/3818422790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3f8151390 0x7fc3f80acad0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0097a0 tx=0x7fc3ec0046c0 comp rx=0 tx=0).stop 2024-04-25T01:39:21.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.293+0000 7fc3ff1a9640 1 -- 172.21.15.77:0/3818422790 shutdown_connections 2024-04-25T01:39:21.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.293+0000 7fc3ff1a9640 1 --2- 172.21.15.77:0/3818422790 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc3e406be30 0x7fc3e406e2f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:21.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.293+0000 7fc3ff1a9640 1 --2- 172.21.15.77:0/3818422790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3f8151390 0x7fc3f80acad0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:21.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.293+0000 7fc3ff1a9640 1 --2- 172.21.15.77:0/3818422790 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc3f8157990 0x7fc3f80ad010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:21.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.293+0000 7fc3ff1a9640 1 --2- 172.21.15.77:0/3818422790 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3f80c6b70 0x7fc3f814fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:21.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.293+0000 7fc3ff1a9640 1 -- 172.21.15.77:0/3818422790 >> 172.21.15.77:0/3818422790 conn(0x7fc3f806b530 msgr2=0x7fc3f80675f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:21.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.293+0000 7fc3ff1a9640 1 -- 172.21.15.77:0/3818422790 shutdown_connections 2024-04-25T01:39:21.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.293+0000 7fc3ff1a9640 1 -- 172.21.15.77:0/3818422790 wait complete. 2024-04-25T01:39:21.287 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'a' 2024-04-25T01:39:21.287 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create a_metadata --pg_num_min 64 2024-04-25T01:39:21.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.405+0000 7fc27bf89640 1 Processor -- start 2024-04-25T01:39:21.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.405+0000 7fc27bf89640 1 -- start start 2024-04-25T01:39:21.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.406+0000 7fc27bf89640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc2740c6230 0x7fc274161a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:21.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.406+0000 7fc27bf89640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2740cafd0 con 0x7fc2740c7f40 2024-04-25T01:39:21.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.406+0000 7fc27bf89640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2740c6ea0 con 0x7fc2740cabf0 2024-04-25T01:39:21.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.406+0000 7fc27bf89640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc2740c7180 con 0x7fc2740c6230 2024-04-25T01:39:21.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.406+0000 7fc279524640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc2740c7f40 0x7fc2740c97b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57938/0 (socket says 172.21.15.77:57938) 2024-04-25T01:39:21.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.406+0000 7fc279524640 1 -- 172.21.15.77:0/2071352375 learned_addr learned my addr 172.21.15.77:0/2071352375 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:21.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.406+0000 7fc27a526640 1 --2- 172.21.15.77:0/2071352375 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc2740c6230 0x7fc274161a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:21.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.406+0000 7fc278d23640 1 -- 172.21.15.77:0/2071352375 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 862559968 0 0) 0x7fc2740cafd0 con 0x7fc2740c7f40 2024-04-25T01:39:21.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.406+0000 7fc278d23640 1 -- 172.21.15.77:0/2071352375 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc260003520 con 0x7fc2740c7f40 2024-04-25T01:39:21.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.406+0000 7fc278d23640 1 -- 172.21.15.77:0/2071352375 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4240991892 0 0) 0x7fc2740c6ea0 con 0x7fc2740cabf0 2024-04-25T01:39:21.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.406+0000 7fc278d23640 1 -- 172.21.15.77:0/2071352375 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2740cafd0 con 0x7fc2740cabf0 2024-04-25T01:39:21.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.406+0000 7fc278d23640 1 -- 172.21.15.77:0/2071352375 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2231901906 0 0) 0x7fc260003520 con 0x7fc2740c7f40 2024-04-25T01:39:21.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.406+0000 7fc278d23640 1 -- 172.21.15.77:0/2071352375 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc2740c6230 msgr2=0x7fc274161a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:21.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.406+0000 7fc278d23640 1 --2- 172.21.15.77:0/2071352375 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc2740c6230 0x7fc274161a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:21.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.406+0000 7fc278d23640 1 -- 172.21.15.77:0/2071352375 >> v1:172.21.15.121:6789/0 conn(0x7fc2740cabf0 legacy=0x7fc27406b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:21.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.406+0000 7fc278d23640 1 -- 172.21.15.77:0/2071352375 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2740c7460 con 0x7fc2740c7f40 2024-04-25T01:39:21.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.406+0000 7fc278d23640 1 -- 172.21.15.77:0/2071352375 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7fc2640015f0 con 0x7fc2740c7f40 2024-04-25T01:39:21.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.406+0000 7fc278d23640 1 -- 172.21.15.77:0/2071352375 >> v1:172.21.15.77:6789/0 conn(0x7fc2740c7f40 legacy=0x7fc2740c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:21.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.406+0000 7fc278d23640 1 --2- 172.21.15.77:0/2071352375 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc2740c6230 0x7fc260003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:21.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.406+0000 7fc278d23640 1 --2- 172.21.15.77:0/2071352375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc260004190 0x7fc260004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:21.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.406+0000 7fc278d23640 1 --2- 172.21.15.77:0/2071352375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc260004d40 0x7fc2600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:21.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.406+0000 7fc278d23640 1 -- 172.21.15.77:0/2071352375 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc2740c7180 con 0x7fc260004d40 2024-04-25T01:39:21.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.406+0000 7fc278d23640 1 -- 172.21.15.77:0/2071352375 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc26000bc00 con 0x7fc260004190 2024-04-25T01:39:21.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.406+0000 7fc278d23640 1 -- 172.21.15.77:0/2071352375 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc26000be00 con 0x7fc2740c6230 2024-04-25T01:39:21.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.406+0000 7fc27a526640 1 --2- 172.21.15.77:0/2071352375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc260004d40 0x7fc2600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:21.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.406+0000 7fc279524640 1 --2- 172.21.15.77:0/2071352375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc260004190 0x7fc260004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:21.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.406+0000 7fc279d25640 1 --2- 172.21.15.77:0/2071352375 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc2740c6230 0x7fc260003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:21.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.407+0000 7fc27a526640 1 -- 172.21.15.77:0/2071352375 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc2740c6230 msgr2=0x7fc260003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:21.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.407+0000 7fc27a526640 1 --2- 172.21.15.77:0/2071352375 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc2740c6230 0x7fc260003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:21.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.407+0000 7fc27a526640 1 -- 172.21.15.77:0/2071352375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc260004190 msgr2=0x7fc260004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:21.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.407+0000 7fc27a526640 1 --2- 172.21.15.77:0/2071352375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc260004190 0x7fc260004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:21.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.407+0000 7fc27a526640 1 -- 172.21.15.77:0/2071352375 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc260003520 con 0x7fc260004d40 2024-04-25T01:39:21.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.407+0000 7fc27a526640 1 --2- 172.21.15.77:0/2071352375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc260004d40 0x7fc2600051c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc26c009f90 tx=0x7fc260005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e97deab8ed9c959 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:21.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.407+0000 7fc278d23640 1 -- 172.21.15.77:0/2071352375 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26c009c10 con 0x7fc260004d40 2024-04-25T01:39:21.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.407+0000 7fc278d23640 1 -- 172.21.15.77:0/2071352375 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc26c036070 con 0x7fc260004d40 2024-04-25T01:39:21.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.407+0000 7fc278d23640 1 -- 172.21.15.77:0/2071352375 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26c031850 con 0x7fc260004d40 2024-04-25T01:39:21.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.408+0000 7fc27bf89640 1 -- 172.21.15.77:0/2071352375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc260004d40 msgr2=0x7fc2600051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:21.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.408+0000 7fc27bf89640 1 --2- 172.21.15.77:0/2071352375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc260004d40 0x7fc2600051c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc26c009f90 tx=0x7fc260005830 comp rx=0 tx=0).stop 2024-04-25T01:39:21.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.408+0000 7fc27a526640 1 -- 172.21.15.77:0/2071352375 reap_dead start 2024-04-25T01:39:21.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.408+0000 7fc27bf89640 1 -- 172.21.15.77:0/2071352375 shutdown_connections 2024-04-25T01:39:21.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.408+0000 7fc27bf89640 1 -- 172.21.15.77:0/2071352375 >> 172.21.15.77:0/2071352375 conn(0x7fc2740cb8b0 msgr2=0x7fc2740cbcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:21.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.408+0000 7fc27bf89640 1 -- 172.21.15.77:0/2071352375 shutdown_connections 2024-04-25T01:39:21.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.408+0000 7fc27bf89640 1 -- 172.21.15.77:0/2071352375 wait complete. 2024-04-25T01:39:21.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.409+0000 7fc27bf89640 1 Processor -- start 2024-04-25T01:39:21.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.409+0000 7fc27bf89640 1 -- start start 2024-04-25T01:39:21.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.410+0000 7fc27bf89640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc260004d40 0x7fc2741ec850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:21.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.410+0000 7fc27bf89640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc27414b820 0x7fc274151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:21.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.410+0000 7fc27bf89640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc2741ef9b0 0x7fc2741efe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:21.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.410+0000 7fc27bf89640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc27406b9a0 con 0x7fc260004d40 2024-04-25T01:39:21.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.410+0000 7fc27bf89640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc27406b820 con 0x7fc27414b820 2024-04-25T01:39:21.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.410+0000 7fc27bf89640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc27406bc00 con 0x7fc2741ef9b0 2024-04-25T01:39:21.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.410+0000 7fc279d25640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc260004d40 0x7fc2741ec850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:21.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.410+0000 7fc279d25640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc260004d40 0x7fc2741ec850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56048/0 (socket says 172.21.15.77:56048) 2024-04-25T01:39:21.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.410+0000 7fc279d25640 1 -- 172.21.15.77:0/3059104037 learned_addr learned my addr 172.21.15.77:0/3059104037 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:21.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.410+0000 7fc27a526640 1 --2- 172.21.15.77:0/3059104037 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc2741ef9b0 0x7fc2741efe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:21.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.410+0000 7fc279524640 1 --2- 172.21.15.77:0/3059104037 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc27414b820 0x7fc274151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:21.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.410+0000 7fc279d25640 1 -- 172.21.15.77:0/3059104037 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc2741ef9b0 msgr2=0x7fc2741efe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:21.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.410+0000 7fc279d25640 1 --2- 172.21.15.77:0/3059104037 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc2741ef9b0 0x7fc2741efe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:21.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.410+0000 7fc279d25640 1 -- 172.21.15.77:0/3059104037 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc27414b820 msgr2=0x7fc274151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:21.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.410+0000 7fc279d25640 1 --2- 172.21.15.77:0/3059104037 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc27414b820 0x7fc274151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:21.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.410+0000 7fc279d25640 1 -- 172.21.15.77:0/3059104037 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2740b0750 con 0x7fc260004d40 2024-04-25T01:39:21.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.410+0000 7fc279d25640 1 --2- 172.21.15.77:0/3059104037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc260004d40 0x7fc2741ec850 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc27000f7a0 tx=0x7fc27000fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:21.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.410+0000 7fc26a7fc640 1 -- 172.21.15.77:0/3059104037 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc27001a070 con 0x7fc260004d40 2024-04-25T01:39:21.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.410+0000 7fc26a7fc640 1 -- 172.21.15.77:0/3059104037 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc270005320 con 0x7fc260004d40 2024-04-25T01:39:21.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.410+0000 7fc26a7fc640 1 -- 172.21.15.77:0/3059104037 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc270007270 con 0x7fc260004d40 2024-04-25T01:39:21.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.410+0000 7fc27bf89640 1 -- 172.21.15.77:0/3059104037 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2740b0a30 con 0x7fc260004d40 2024-04-25T01:39:21.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.410+0000 7fc27bf89640 1 -- 172.21.15.77:0/3059104037 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2741ef490 con 0x7fc260004d40 2024-04-25T01:39:21.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.411+0000 7fc27bf89640 1 -- 172.21.15.77:0/3059104037 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc274075d10 con 0x7fc260004d40 2024-04-25T01:39:21.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.412+0000 7fc26a7fc640 1 -- 172.21.15.77:0/3059104037 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc27001d070 con 0x7fc260004d40 2024-04-25T01:39:21.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.412+0000 7fc26a7fc640 1 --2- 172.21.15.77:0/3059104037 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc25806be30 0x7fc25806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:21.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.412+0000 7fc26a7fc640 1 -- 172.21.15.77:0/3059104037 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fc27008a2f0 con 0x7fc260004d40 2024-04-25T01:39:21.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.412+0000 7fc279524640 1 --2- 172.21.15.77:0/3059104037 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc25806be30 0x7fc25806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:21.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.413+0000 7fc279524640 1 --2- 172.21.15.77:0/3059104037 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc25806be30 0x7fc25806e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc274154a30 tx=0x7fc264009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:21.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.416+0000 7fc26a7fc640 1 -- 172.21.15.77:0/3059104037 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc270059080 con 0x7fc260004d40 2024-04-25T01:39:21.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:21.588+0000 7fc27bf89640 1 -- 172.21.15.77:0/3059104037 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "a_metadata", "pg_num_min": 64} v 0) -- 0x7fc2741ef660 con 0x7fc260004d40 2024-04-25T01:39:22.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.349+0000 7fc26a7fc640 1 -- 172.21.15.77:0/3059104037 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "a_metadata", "pg_num_min": 64}]=0 pool 'a_metadata' created v17) ==== 128+0+0 (secure 0 0 0) 0x7fc270058980 con 0x7fc260004d40 2024-04-25T01:39:22.332 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'a_metadata' created 2024-04-25T01:39:22.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.352+0000 7fc27bf89640 1 -- 172.21.15.77:0/3059104037 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc25806be30 msgr2=0x7fc25806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:22.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.352+0000 7fc27bf89640 1 --2- 172.21.15.77:0/3059104037 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc25806be30 0x7fc25806e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc274154a30 tx=0x7fc264009040 comp rx=0 tx=0).stop 2024-04-25T01:39:22.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.352+0000 7fc27bf89640 1 -- 172.21.15.77:0/3059104037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc260004d40 msgr2=0x7fc2741ec850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:22.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.352+0000 7fc27bf89640 1 --2- 172.21.15.77:0/3059104037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc260004d40 0x7fc2741ec850 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc27000f7a0 tx=0x7fc27000fc60 comp rx=0 tx=0).stop 2024-04-25T01:39:22.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.352+0000 7fc27bf89640 1 -- 172.21.15.77:0/3059104037 shutdown_connections 2024-04-25T01:39:22.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.352+0000 7fc27bf89640 1 --2- 172.21.15.77:0/3059104037 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc25806be30 0x7fc25806e2f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:22.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.352+0000 7fc27bf89640 1 --2- 172.21.15.77:0/3059104037 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc2741ef9b0 0x7fc2741efe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:22.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.352+0000 7fc27bf89640 1 --2- 172.21.15.77:0/3059104037 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc27414b820 0x7fc274151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:22.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.352+0000 7fc27bf89640 1 --2- 172.21.15.77:0/3059104037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc260004d40 0x7fc2741ec850 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:22.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.352+0000 7fc27bf89640 1 -- 172.21.15.77:0/3059104037 >> 172.21.15.77:0/3059104037 conn(0x7fc2740cb8b0 msgr2=0x7fc274154220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:22.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.352+0000 7fc27bf89640 1 -- 172.21.15.77:0/3059104037 shutdown_connections 2024-04-25T01:39:22.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.352+0000 7fc27bf89640 1 -- 172.21.15.77:0/3059104037 wait complete. 2024-04-25T01:39:22.350 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create a_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T01:39:22.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.475+0000 7f3f245d5640 1 Processor -- start 2024-04-25T01:39:22.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.475+0000 7f3f245d5640 1 -- start start 2024-04-25T01:39:22.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.476+0000 7f3f245d5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3f1c153530 0x7f3f1c0c6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:22.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.476+0000 7f3f245d5640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3f1c0bef50 0x7f3f1c1595f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:22.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.476+0000 7f3f245d5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3f1c0c97c0 0x7f3f1c159b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:22.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.476+0000 7f3f245d5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f3f1c06d110 con 0x7f3f1c0c97c0 2024-04-25T01:39:22.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.476+0000 7f3f245d5640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f3f1c153910 con 0x7f3f1c0bef50 2024-04-25T01:39:22.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.476+0000 7f3f245d5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f3f1c156980 con 0x7f3f1c153530 2024-04-25T01:39:22.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.476+0000 7f3f22b72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3f1c0c97c0 0x7f3f1c159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:22.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.476+0000 7f3f22b72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3f1c0c97c0 0x7f3f1c159b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56058/0 (socket says 172.21.15.77:56058) 2024-04-25T01:39:22.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.476+0000 7f3f22b72640 1 -- 172.21.15.77:0/1638996348 learned_addr learned my addr 172.21.15.77:0/1638996348 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:22.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.477+0000 7f3f21b70640 1 --2- 172.21.15.77:0/1638996348 >> v2:172.21.15.121:3300/0 conn(0x7f3f1c0bef50 0x7f3f1c1595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:22.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.477+0000 7f3f22371640 1 --2- 172.21.15.77:0/1638996348 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3f1c153530 0x7f3f1c0c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:22.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.477+0000 7f3f22b72640 1 -- 172.21.15.77:0/1638996348 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3f1c153530 msgr2=0x7f3f1c0c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:22.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.477+0000 7f3f22b72640 1 --2- 172.21.15.77:0/1638996348 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3f1c153530 0x7f3f1c0c6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:22.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.477+0000 7f3f22b72640 1 -- 172.21.15.77:0/1638996348 >> v2:172.21.15.121:3300/0 conn(0x7f3f1c0bef50 msgr2=0x7f3f1c1595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:22.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.477+0000 7f3f22b72640 1 --2- 172.21.15.77:0/1638996348 >> v2:172.21.15.121:3300/0 conn(0x7f3f1c0bef50 0x7f3f1c1595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:22.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.477+0000 7f3f22b72640 1 -- 172.21.15.77:0/1638996348 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1c156c60 con 0x7f3f1c0c97c0 2024-04-25T01:39:22.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.477+0000 7f3f22371640 1 --2- 172.21.15.77:0/1638996348 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3f1c153530 0x7f3f1c0c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:22.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.477+0000 7f3f21b70640 1 --2- 172.21.15.77:0/1638996348 >> v2:172.21.15.121:3300/0 conn(0x7f3f1c0bef50 0x7f3f1c1595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:22.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.477+0000 7f3f22b72640 1 --2- 172.21.15.77:0/1638996348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f1c0c97c0 0x7f3f1c159b30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0cc920 tx=0x7f3f1402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f1690a6488bc7a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:22.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.477+0000 7f3f2136f640 1 -- 172.21.15.77:0/1638996348 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f14037070 con 0x7f3f1c0c97c0 2024-04-25T01:39:22.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.477+0000 7f3f2136f640 1 -- 172.21.15.77:0/1638996348 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f14032440 con 0x7f3f1c0c97c0 2024-04-25T01:39:22.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.477+0000 7f3f2136f640 1 -- 172.21.15.77:0/1638996348 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f14032810 con 0x7f3f1c0c97c0 2024-04-25T01:39:22.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.478+0000 7f3f245d5640 1 -- 172.21.15.77:0/1638996348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f1c0c97c0 msgr2=0x7f3f1c159b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:22.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.478+0000 7f3f245d5640 1 --2- 172.21.15.77:0/1638996348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f1c0c97c0 0x7f3f1c159b30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0cc920 tx=0x7f3f1402a140 comp rx=0 tx=0).stop 2024-04-25T01:39:22.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.478+0000 7f3f245d5640 1 -- 172.21.15.77:0/1638996348 shutdown_connections 2024-04-25T01:39:22.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.478+0000 7f3f245d5640 1 --2- 172.21.15.77:0/1638996348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f1c0c97c0 0x7f3f1c159b30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:22.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.478+0000 7f3f245d5640 1 --2- 172.21.15.77:0/1638996348 >> v2:172.21.15.121:3300/0 conn(0x7f3f1c0bef50 0x7f3f1c1595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:22.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.478+0000 7f3f245d5640 1 --2- 172.21.15.77:0/1638996348 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3f1c153530 0x7f3f1c0c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:22.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.478+0000 7f3f245d5640 1 -- 172.21.15.77:0/1638996348 >> 172.21.15.77:0/1638996348 conn(0x7f3f1c0672c0 msgr2=0x7f3f1c0676d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:22.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.478+0000 7f3f245d5640 1 -- 172.21.15.77:0/1638996348 shutdown_connections 2024-04-25T01:39:22.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.478+0000 7f3f245d5640 1 -- 172.21.15.77:0/1638996348 wait complete. 2024-04-25T01:39:22.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.479+0000 7f3f245d5640 1 Processor -- start 2024-04-25T01:39:22.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.479+0000 7f3f245d5640 1 -- start start 2024-04-25T01:39:22.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.480+0000 7f3f245d5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3f1c0bef50 0x7f3f1c1eee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:22.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.480+0000 7f3f245d5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f1c0c97c0 0x7f3f1c0ac790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:22.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.480+0000 7f3f245d5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f1c153530 0x7f3f1c1e1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:22.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.480+0000 7f3f245d5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1c15a070 con 0x7f3f1c153530 2024-04-25T01:39:22.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.480+0000 7f3f245d5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1c0cc250 con 0x7f3f1c0c97c0 2024-04-25T01:39:22.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.480+0000 7f3f245d5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f3f1c15a1f0 con 0x7f3f1c0bef50 2024-04-25T01:39:22.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.480+0000 7f3f22b72640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f1c153530 0x7f3f1c1e1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:22.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.480+0000 7f3f22b72640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f1c153530 0x7f3f1c1e1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56064/0 (socket says 172.21.15.77:56064) 2024-04-25T01:39:22.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.480+0000 7f3f22b72640 1 -- 172.21.15.77:0/2353238693 learned_addr learned my addr 172.21.15.77:0/2353238693 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:22.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.480+0000 7f3f21b70640 1 --2- 172.21.15.77:0/2353238693 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f1c0c97c0 0x7f3f1c0ac790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:22.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.480+0000 7f3f22371640 1 --2- 172.21.15.77:0/2353238693 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3f1c0bef50 0x7f3f1c1eee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:22.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.480+0000 7f3f22b72640 1 -- 172.21.15.77:0/2353238693 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3f1c0bef50 msgr2=0x7f3f1c1eee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:22.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.480+0000 7f3f22b72640 1 --2- 172.21.15.77:0/2353238693 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3f1c0bef50 0x7f3f1c1eee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:22.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.480+0000 7f3f22b72640 1 -- 172.21.15.77:0/2353238693 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f1c0c97c0 msgr2=0x7f3f1c0ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:22.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.480+0000 7f3f22b72640 1 --2- 172.21.15.77:0/2353238693 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f1c0c97c0 0x7f3f1c0ac790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:22.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.480+0000 7f3f22b72640 1 -- 172.21.15.77:0/2353238693 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1c1e0d40 con 0x7f3f1c153530 2024-04-25T01:39:22.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.480+0000 7f3f21b70640 1 --2- 172.21.15.77:0/2353238693 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f1c0c97c0 0x7f3f1c0ac790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:22.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.480+0000 7f3f22b72640 1 --2- 172.21.15.77:0/2353238693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f1c153530 0x7f3f1c1e1500 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3f140090b0 tx=0x7f3f140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:22.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.480+0000 7f3f12ffd640 1 -- 172.21.15.77:0/2353238693 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f14037040 con 0x7f3f1c153530 2024-04-25T01:39:22.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.480+0000 7f3f12ffd640 1 -- 172.21.15.77:0/2353238693 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f14042070 con 0x7f3f1c153530 2024-04-25T01:39:22.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.480+0000 7f3f245d5640 1 -- 172.21.15.77:0/2353238693 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f1c14c710 con 0x7f3f1c153530 2024-04-25T01:39:22.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.481+0000 7f3f12ffd640 1 -- 172.21.15.77:0/2353238693 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f14030bd0 con 0x7f3f1c153530 2024-04-25T01:39:22.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.481+0000 7f3f245d5640 1 -- 172.21.15.77:0/2353238693 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f1c0accd0 con 0x7f3f1c153530 2024-04-25T01:39:22.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.482+0000 7f3f245d5640 1 -- 172.21.15.77:0/2353238693 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f1c04f500 con 0x7f3f1c153530 2024-04-25T01:39:22.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.482+0000 7f3f12ffd640 1 -- 172.21.15.77:0/2353238693 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3f14047460 con 0x7f3f1c153530 2024-04-25T01:39:22.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.482+0000 7f3f12ffd640 1 --2- 172.21.15.77:0/2353238693 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3f0006be60 0x7f3f0006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:22.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.482+0000 7f3f12ffd640 1 -- 172.21.15.77:0/2353238693 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5222+0+0 (secure 0 0 0) 0x7f3f140ab8b0 con 0x7f3f1c153530 2024-04-25T01:39:22.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.482+0000 7f3f22371640 1 --2- 172.21.15.77:0/2353238693 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3f0006be60 0x7f3f0006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:22.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.483+0000 7f3f22371640 1 --2- 172.21.15.77:0/2353238693 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3f0006be60 0x7f3f0006e320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0cb730 tx=0x7f3f180084f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:22.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.487+0000 7f3f12ffd640 1 -- 172.21.15.77:0/2353238693 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3f1407a430 con 0x7f3f1c153530 2024-04-25T01:39:22.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:22.659+0000 7f3f245d5640 1 -- 172.21.15.77:0/2353238693 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "a_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f3f1c06cac0 con 0x7f3f1c153530 2024-04-25T01:39:23.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.351+0000 7f3f12ffd640 1 -- 172.21.15.77:0/2353238693 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "a_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'a_data' created v18) ==== 160+0+0 (secure 0 0 0) 0x7f3f14079d30 con 0x7f3f1c153530 2024-04-25T01:39:23.334 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'a_data' created 2024-04-25T01:39:23.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.354+0000 7f3f245d5640 1 -- 172.21.15.77:0/2353238693 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3f0006be60 msgr2=0x7f3f0006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:23.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.354+0000 7f3f245d5640 1 --2- 172.21.15.77:0/2353238693 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3f0006be60 0x7f3f0006e320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0cb730 tx=0x7f3f180084f0 comp rx=0 tx=0).stop 2024-04-25T01:39:23.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.354+0000 7f3f245d5640 1 -- 172.21.15.77:0/2353238693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f1c153530 msgr2=0x7f3f1c1e1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:23.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.354+0000 7f3f245d5640 1 --2- 172.21.15.77:0/2353238693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f1c153530 0x7f3f1c1e1500 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3f140090b0 tx=0x7f3f140046c0 comp rx=0 tx=0).stop 2024-04-25T01:39:23.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.354+0000 7f3f245d5640 1 -- 172.21.15.77:0/2353238693 shutdown_connections 2024-04-25T01:39:23.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.354+0000 7f3f245d5640 1 --2- 172.21.15.77:0/2353238693 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3f0006be60 0x7f3f0006e320 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:23.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.354+0000 7f3f245d5640 1 --2- 172.21.15.77:0/2353238693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f1c153530 0x7f3f1c1e1500 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:23.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.354+0000 7f3f245d5640 1 --2- 172.21.15.77:0/2353238693 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f1c0c97c0 0x7f3f1c0ac790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:23.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.354+0000 7f3f245d5640 1 --2- 172.21.15.77:0/2353238693 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3f1c0bef50 0x7f3f1c1eee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:23.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.354+0000 7f3f245d5640 1 -- 172.21.15.77:0/2353238693 >> 172.21.15.77:0/2353238693 conn(0x7f3f1c0672c0 msgr2=0x7f3f1c0cabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:23.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.354+0000 7f3f245d5640 1 -- 172.21.15.77:0/2353238693 shutdown_connections 2024-04-25T01:39:23.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.354+0000 7f3f245d5640 1 -- 172.21.15.77:0/2353238693 wait complete. 2024-04-25T01:39:23.357 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new a a_metadata a_data 2024-04-25T01:39:23.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.476+0000 7f6042ca5640 1 Processor -- start 2024-04-25T01:39:23.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.476+0000 7f6042ca5640 1 -- start start 2024-04-25T01:39:23.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.477+0000 7f6042ca5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f603c0c4280 0x7f603c1538f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:23.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.477+0000 7f6042ca5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f603c0c4cb0 0x7f603c153e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:23.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.477+0000 7f6042ca5640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f603c0c7040 con 0x7f603c073450 2024-04-25T01:39:23.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.477+0000 7f6042ca5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f603c0c1cd0 con 0x7f603c0c4280 2024-04-25T01:39:23.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.477+0000 7f6042ca5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f603c0ac010 con 0x7f603c0c4cb0 2024-04-25T01:39:23.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.477+0000 7f6040a41640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f603c0c4280 0x7f603c1538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:23.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.477+0000 7f6040a41640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f603c0c4280 0x7f603c1538f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56072/0 (socket says 172.21.15.77:56072) 2024-04-25T01:39:23.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.477+0000 7f6040a41640 1 -- 172.21.15.77:0/3214100120 learned_addr learned my addr 172.21.15.77:0/3214100120 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:23.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.477+0000 7f6040a41640 1 -- 172.21.15.77:0/3214100120 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f603c0c4cb0 msgr2=0x7f603c153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:23.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.477+0000 7f6041242640 1 --2- 172.21.15.77:0/3214100120 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f603c0c4cb0 0x7f603c153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:23.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.477+0000 7f6040a41640 1 --2- 172.21.15.77:0/3214100120 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f603c0c4cb0 0x7f603c153e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:23.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.477+0000 7f6040a41640 1 -- 172.21.15.77:0/3214100120 >> v1:172.21.15.121:6789/0 conn(0x7f603c073450 legacy=0x7f603c0c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:23.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.477+0000 7f6040a41640 1 -- 172.21.15.77:0/3214100120 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f603c0ac2f0 con 0x7f603c0c4280 2024-04-25T01:39:23.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.478+0000 7f6040a41640 1 --2- 172.21.15.77:0/3214100120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f603c0c4280 0x7f603c1538f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6038009870 tx=0x7f603802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eccdc0d9bd2d53c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:23.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.478+0000 7f60337fe640 1 -- 172.21.15.77:0/3214100120 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6038037070 con 0x7f603c0c4280 2024-04-25T01:39:23.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.478+0000 7f60337fe640 1 -- 172.21.15.77:0/3214100120 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6038032440 con 0x7f603c0c4280 2024-04-25T01:39:23.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.478+0000 7f60337fe640 1 -- 172.21.15.77:0/3214100120 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6038032810 con 0x7f603c0c4280 2024-04-25T01:39:23.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.478+0000 7f6042ca5640 1 -- 172.21.15.77:0/3214100120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f603c0c4280 msgr2=0x7f603c1538f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:23.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.478+0000 7f6042ca5640 1 --2- 172.21.15.77:0/3214100120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f603c0c4280 0x7f603c1538f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6038009870 tx=0x7f603802a180 comp rx=0 tx=0).stop 2024-04-25T01:39:23.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.478+0000 7f6042ca5640 1 -- 172.21.15.77:0/3214100120 shutdown_connections 2024-04-25T01:39:23.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.478+0000 7f6042ca5640 1 --2- 172.21.15.77:0/3214100120 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f603c0c4cb0 0x7f603c153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:23.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.478+0000 7f6042ca5640 1 --2- 172.21.15.77:0/3214100120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f603c0c4280 0x7f603c1538f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:23.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.478+0000 7f6042ca5640 1 -- 172.21.15.77:0/3214100120 >> 172.21.15.77:0/3214100120 conn(0x7f603c0c7580 msgr2=0x7f603c0c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:23.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.479+0000 7f6042ca5640 1 -- 172.21.15.77:0/3214100120 shutdown_connections 2024-04-25T01:39:23.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.479+0000 7f6042ca5640 1 -- 172.21.15.77:0/3214100120 wait complete. 2024-04-25T01:39:23.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.480+0000 7f6042ca5640 1 Processor -- start 2024-04-25T01:39:23.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.480+0000 7f6042ca5640 1 -- start start 2024-04-25T01:39:23.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.480+0000 7f6042ca5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f603c073450 0x7f603c144700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:23.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.480+0000 7f6042ca5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f603c0c4280 0x7f603c144c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:23.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.480+0000 7f6042ca5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f603c0c4cb0 0x7f603c1eb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:23.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.480+0000 7f6042ca5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f603c0c1a90 con 0x7f603c0c4cb0 2024-04-25T01:39:23.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.480+0000 7f6042ca5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f603c0c1910 con 0x7f603c0c4280 2024-04-25T01:39:23.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.480+0000 7f6042ca5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f603c0c4660 con 0x7f603c073450 2024-04-25T01:39:23.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.480+0000 7f6041242640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f603c0c4cb0 0x7f603c1eb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:23.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.481+0000 7f6041242640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f603c0c4cb0 0x7f603c1eb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56082/0 (socket says 172.21.15.77:56082) 2024-04-25T01:39:23.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.481+0000 7f6041242640 1 -- 172.21.15.77:0/2662407835 learned_addr learned my addr 172.21.15.77:0/2662407835 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:23.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.481+0000 7f6040a41640 1 --2- 172.21.15.77:0/2662407835 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f603c073450 0x7f603c144700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:23.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.481+0000 7f6033fff640 1 --2- 172.21.15.77:0/2662407835 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f603c0c4280 0x7f603c144c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:23.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.481+0000 7f6041242640 1 -- 172.21.15.77:0/2662407835 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f603c073450 msgr2=0x7f603c144700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:23.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.481+0000 7f6041242640 1 --2- 172.21.15.77:0/2662407835 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f603c073450 0x7f603c144700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:23.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.481+0000 7f6041242640 1 -- 172.21.15.77:0/2662407835 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f603c0c4280 msgr2=0x7f603c144c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:23.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.481+0000 7f6041242640 1 --2- 172.21.15.77:0/2662407835 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f603c0c4280 0x7f603c144c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:23.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.481+0000 7f6041242640 1 -- 172.21.15.77:0/2662407835 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f603c145180 con 0x7f603c0c4cb0 2024-04-25T01:39:23.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.481+0000 7f6033fff640 1 --2- 172.21.15.77:0/2662407835 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f603c0c4280 0x7f603c144c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:23.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.481+0000 7f6041242640 1 --2- 172.21.15.77:0/2662407835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f603c0c4cb0 0x7f603c1eb160 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f603400cc60 tx=0x7f603400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:23.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.481+0000 7f60317fa640 1 -- 172.21.15.77:0/2662407835 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6034003990 con 0x7f603c0c4cb0 2024-04-25T01:39:23.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.481+0000 7f60317fa640 1 -- 172.21.15.77:0/2662407835 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6034003b30 con 0x7f603c0c4cb0 2024-04-25T01:39:23.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.481+0000 7f6042ca5640 1 -- 172.21.15.77:0/2662407835 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f603c154920 con 0x7f603c0c4cb0 2024-04-25T01:39:23.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.481+0000 7f60317fa640 1 -- 172.21.15.77:0/2662407835 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6034004020 con 0x7f603c0c4cb0 2024-04-25T01:39:23.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.481+0000 7f6042ca5640 1 -- 172.21.15.77:0/2662407835 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f603c156ff0 con 0x7f603c0c4cb0 2024-04-25T01:39:23.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.482+0000 7f6042ca5640 1 -- 172.21.15.77:0/2662407835 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f603c04f500 con 0x7f603c0c4cb0 2024-04-25T01:39:23.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.483+0000 7f60317fa640 1 -- 172.21.15.77:0/2662407835 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f60340041c0 con 0x7f603c0c4cb0 2024-04-25T01:39:23.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.483+0000 7f60317fa640 1 --2- 172.21.15.77:0/2662407835 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f602806be30 0x7f602806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:23.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.483+0000 7f6040a41640 1 --2- 172.21.15.77:0/2662407835 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f602806be30 0x7f602806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:23.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.483+0000 7f60317fa640 1 -- 172.21.15.77:0/2662407835 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5599+0+0 (secure 0 0 0) 0x7f603408b2e0 con 0x7f603c0c4cb0 2024-04-25T01:39:23.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.484+0000 7f6040a41640 1 --2- 172.21.15.77:0/2662407835 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f602806be30 0x7f602806e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6038034000 tx=0x7f603802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:23.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.488+0000 7f60317fa640 1 -- 172.21.15.77:0/2662407835 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6034014030 con 0x7f603c0c4cb0 2024-04-25T01:39:23.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:23.700+0000 7f6042ca5640 1 -- 172.21.15.77:0/2662407835 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "a", "metadata": "a_metadata", "data": "a_data"} v 0) -- 0x7f603c0c6bf0 con 0x7f603c0c4cb0 2024-04-25T01:39:24.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.375+0000 7f60317fa640 1 -- 172.21.15.77:0/2662407835 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "a", "metadata": "a_metadata", "data": "a_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 157+0+0 (secure 0 0 0) 0x7f6034059d10 con 0x7f603c0c4cb0 2024-04-25T01:39:24.358 INFO:teuthology.orchestra.run.smithi077.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T01:39:24.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.379+0000 7f6042ca5640 1 -- 172.21.15.77:0/2662407835 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f602806be30 msgr2=0x7f602806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:24.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.379+0000 7f6042ca5640 1 --2- 172.21.15.77:0/2662407835 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f602806be30 0x7f602806e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6038034000 tx=0x7f603802e000 comp rx=0 tx=0).stop 2024-04-25T01:39:24.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.379+0000 7f6042ca5640 1 -- 172.21.15.77:0/2662407835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f603c0c4cb0 msgr2=0x7f603c1eb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:24.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.379+0000 7f6042ca5640 1 --2- 172.21.15.77:0/2662407835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f603c0c4cb0 0x7f603c1eb160 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f603400cc60 tx=0x7f603400a5c0 comp rx=0 tx=0).stop 2024-04-25T01:39:24.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.379+0000 7f6042ca5640 1 -- 172.21.15.77:0/2662407835 shutdown_connections 2024-04-25T01:39:24.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.379+0000 7f6042ca5640 1 --2- 172.21.15.77:0/2662407835 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f602806be30 0x7f602806e2f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:24.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.379+0000 7f6042ca5640 1 --2- 172.21.15.77:0/2662407835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f603c0c4cb0 0x7f603c1eb160 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:24.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.379+0000 7f6042ca5640 1 --2- 172.21.15.77:0/2662407835 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f603c0c4280 0x7f603c144c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:24.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.379+0000 7f6042ca5640 1 --2- 172.21.15.77:0/2662407835 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f603c073450 0x7f603c144700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:24.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.379+0000 7f6042ca5640 1 -- 172.21.15.77:0/2662407835 >> 172.21.15.77:0/2662407835 conn(0x7f603c0c7580 msgr2=0x7f603c0c7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:24.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.379+0000 7f6042ca5640 1 -- 172.21.15.77:0/2662407835 shutdown_connections 2024-04-25T01:39:24.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.379+0000 7f6042ca5640 1 -- 172.21.15.77:0/2662407835 wait complete. 2024-04-25T01:39:24.384 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T01:39:24.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.500+0000 7f3484f70640 1 Processor -- start 2024-04-25T01:39:24.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.500+0000 7f3484f70640 1 -- start start 2024-04-25T01:39:24.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.500+0000 7f3484f70640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3480150320 0x7f3480156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:24.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.500+0000 7f3484f70640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f348006d0a0 0x7f348006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:24.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.500+0000 7f3484f70640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3480154380 0x7f34801547e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:24.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.501+0000 7f3484f70640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f3480153be0 con 0x7f348006d0a0 2024-04-25T01:39:24.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.501+0000 7f3484f70640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f3480157100 con 0x7f3480154380 2024-04-25T01:39:24.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.501+0000 7f3484f70640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f3480152fd0 con 0x7f3480150320 2024-04-25T01:39:24.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.501+0000 7f3477fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f348006d0a0 0x7f348006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:24.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.501+0000 7f3477fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f348006d0a0 0x7f348006d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56090/0 (socket says 172.21.15.77:56090) 2024-04-25T01:39:24.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.501+0000 7f3477fff640 1 -- 172.21.15.77:0/953922720 learned_addr learned my addr 172.21.15.77:0/953922720 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:24.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.501+0000 7f347e59c640 1 --2- 172.21.15.77:0/953922720 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3480150320 0x7f3480156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:24.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.501+0000 7f347ed9d640 1 --2- 172.21.15.77:0/953922720 >> v2:172.21.15.121:3300/0 conn(0x7f3480154380 0x7f34801547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:24.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.501+0000 7f3477fff640 1 -- 172.21.15.77:0/953922720 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3480150320 msgr2=0x7f3480156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:24.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.501+0000 7f3477fff640 1 --2- 172.21.15.77:0/953922720 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3480150320 0x7f3480156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:24.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.501+0000 7f3477fff640 1 -- 172.21.15.77:0/953922720 >> v2:172.21.15.121:3300/0 conn(0x7f3480154380 msgr2=0x7f34801547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:24.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.501+0000 7f3477fff640 1 --2- 172.21.15.77:0/953922720 >> v2:172.21.15.121:3300/0 conn(0x7f3480154380 0x7f34801547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:24.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.501+0000 7f3477fff640 1 -- 172.21.15.77:0/953922720 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34801532b0 con 0x7f348006d0a0 2024-04-25T01:39:24.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.501+0000 7f347e59c640 1 --2- 172.21.15.77:0/953922720 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3480150320 0x7f3480156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:24.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.501+0000 7f347ed9d640 1 --2- 172.21.15.77:0/953922720 >> v2:172.21.15.121:3300/0 conn(0x7f3480154380 0x7f34801547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:24.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.502+0000 7f3477fff640 1 --2- 172.21.15.77:0/953922720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f348006d0a0 0x7f348006d4e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f34800c3600 tx=0x7f346802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa3c4f2c91f5642c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:24.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.502+0000 7f347dd9b640 1 -- 172.21.15.77:0/953922720 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3468037070 con 0x7f348006d0a0 2024-04-25T01:39:24.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.502+0000 7f347dd9b640 1 -- 172.21.15.77:0/953922720 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3468032440 con 0x7f348006d0a0 2024-04-25T01:39:24.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.502+0000 7f347dd9b640 1 -- 172.21.15.77:0/953922720 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3468032810 con 0x7f348006d0a0 2024-04-25T01:39:24.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.502+0000 7f3484f70640 1 -- 172.21.15.77:0/953922720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f348006d0a0 msgr2=0x7f348006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:24.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.502+0000 7f3484f70640 1 --2- 172.21.15.77:0/953922720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f348006d0a0 0x7f348006d4e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f34800c3600 tx=0x7f346802a140 comp rx=0 tx=0).stop 2024-04-25T01:39:24.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.502+0000 7f3484f70640 1 -- 172.21.15.77:0/953922720 shutdown_connections 2024-04-25T01:39:24.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.502+0000 7f3484f70640 1 --2- 172.21.15.77:0/953922720 >> v2:172.21.15.121:3300/0 conn(0x7f3480154380 0x7f34801547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:24.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.502+0000 7f3484f70640 1 --2- 172.21.15.77:0/953922720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f348006d0a0 0x7f348006d4e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:24.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.502+0000 7f3484f70640 1 --2- 172.21.15.77:0/953922720 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3480150320 0x7f3480156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:24.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.502+0000 7f3484f70640 1 -- 172.21.15.77:0/953922720 >> 172.21.15.77:0/953922720 conn(0x7f34800c3f80 msgr2=0x7f34800c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:24.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.502+0000 7f3484f70640 1 -- 172.21.15.77:0/953922720 shutdown_connections 2024-04-25T01:39:24.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.502+0000 7f3484f70640 1 -- 172.21.15.77:0/953922720 wait complete. 2024-04-25T01:39:24.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.504+0000 7f3484f70640 1 Processor -- start 2024-04-25T01:39:24.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.504+0000 7f3484f70640 1 -- start start 2024-04-25T01:39:24.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.504+0000 7f3484f70640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f348006d0a0 0x7f34800c0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:24.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.504+0000 7f3484f70640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3480150320 0x7f34801ebb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:24.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.504+0000 7f3484f70640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3480154380 0x7f34801ec070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:24.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.504+0000 7f3484f70640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3480152bf0 con 0x7f3480150320 2024-04-25T01:39:24.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.504+0000 7f3484f70640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3480153870 con 0x7f3480154380 2024-04-25T01:39:24.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.504+0000 7f3484f70640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f3480152d70 con 0x7f348006d0a0 2024-04-25T01:39:24.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.504+0000 7f3477fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3480150320 0x7f34801ebb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:24.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.504+0000 7f3477fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3480150320 0x7f34801ebb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56096/0 (socket says 172.21.15.77:56096) 2024-04-25T01:39:24.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.505+0000 7f3477fff640 1 -- 172.21.15.77:0/3615400018 learned_addr learned my addr 172.21.15.77:0/3615400018 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:24.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.505+0000 7f347ed9d640 1 --2- 172.21.15.77:0/3615400018 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3480154380 0x7f34801ec070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:24.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.505+0000 7f347e59c640 1 --2- 172.21.15.77:0/3615400018 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f348006d0a0 0x7f34800c0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:24.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.505+0000 7f3477fff640 1 -- 172.21.15.77:0/3615400018 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f348006d0a0 msgr2=0x7f34800c0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:24.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.505+0000 7f3477fff640 1 --2- 172.21.15.77:0/3615400018 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f348006d0a0 0x7f34800c0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:24.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.505+0000 7f3477fff640 1 -- 172.21.15.77:0/3615400018 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3480154380 msgr2=0x7f34801ec070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:24.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.505+0000 7f3477fff640 1 --2- 172.21.15.77:0/3615400018 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3480154380 0x7f34801ec070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:24.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.505+0000 7f3477fff640 1 -- 172.21.15.77:0/3615400018 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3480155e90 con 0x7f3480150320 2024-04-25T01:39:24.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.505+0000 7f3477fff640 1 --2- 172.21.15.77:0/3615400018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3480150320 0x7f34801ebb30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3468000c00 tx=0x7f34680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:24.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.505+0000 7f3476ffd640 1 -- 172.21.15.77:0/3615400018 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3468041020 con 0x7f3480150320 2024-04-25T01:39:24.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.505+0000 7f3476ffd640 1 -- 172.21.15.77:0/3615400018 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34680306c0 con 0x7f3480150320 2024-04-25T01:39:24.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.505+0000 7f3484f70640 1 -- 172.21.15.77:0/3615400018 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34801efae0 con 0x7f3480150320 2024-04-25T01:39:24.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.505+0000 7f3476ffd640 1 -- 172.21.15.77:0/3615400018 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3468037040 con 0x7f3480150320 2024-04-25T01:39:24.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.505+0000 7f3484f70640 1 -- 172.21.15.77:0/3615400018 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34801de590 con 0x7f3480150320 2024-04-25T01:39:24.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.506+0000 7f3484f70640 1 -- 172.21.15.77:0/3615400018 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f348004f500 con 0x7f3480150320 2024-04-25T01:39:24.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.507+0000 7f3476ffd640 1 -- 172.21.15.77:0/3615400018 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3468044020 con 0x7f3480150320 2024-04-25T01:39:24.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.507+0000 7f3476ffd640 1 --2- 172.21.15.77:0/3615400018 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f346006be60 0x7f346006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:24.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.507+0000 7f3476ffd640 1 -- 172.21.15.77:0/3615400018 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5689+0+0 (secure 0 0 0) 0x7f34680ab440 con 0x7f3480150320 2024-04-25T01:39:24.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.507+0000 7f347e59c640 1 --2- 172.21.15.77:0/3615400018 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f346006be60 0x7f346006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:24.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.507+0000 7f347e59c640 1 --2- 172.21.15.77:0/3615400018 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f346006be60 0x7f346006e320 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f348014a670 tx=0x7f3470008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:24.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.511+0000 7f3476ffd640 1 -- 172.21.15.77:0/3615400018 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f346804b030 con 0x7f3480150320 2024-04-25T01:39:24.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.686+0000 7f3484f70640 1 -- 172.21.15.77:0/3615400018 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3480073750 con 0x7f3480150320 2024-04-25T01:39:24.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.687+0000 7f3476ffd640 1 -- 172.21.15.77:0/3615400018 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16586 (secure 0 0 0) 0x7f3468079840 con 0x7f3480150320 2024-04-25T01:39:24.670 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:24.671 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":19,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:39:23.701670+0000","last_up_change":"2024-04-25T01:39:10.729600+0000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T01:39:11.681151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T01:39:21.606752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T01:39:22.677664+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6811","nonce":3366980158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6817","nonce":3366980158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6828","nonce":3366980158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6825","nonce":3366980158}]},"public_addr":"172.21.15.77:6811/3366980158","cluster_addr":"172.21.15.77:6817/3366980158","heartbeat_back_addr":"172.21.15.77:6828/3366980158","heartbeat_front_addr":"172.21.15.77:6825/3366980158","state":["exists","up"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6801","nonce":3971619298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6803","nonce":3971619298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6807","nonce":3971619298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6805","nonce":3971619298}]},"public_addr":"172.21.15.77:6801/3971619298","cluster_addr":"172.21.15.77:6803/3971619298","heartbeat_back_addr":"172.21.15.77:6807/3971619298","heartbeat_front_addr":"172.21.15.77:6805/3971619298","state":["exists","up"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6810","nonce":4103452689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6813","nonce":4103452689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6823","nonce":4103452689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6818","nonce":4103452689}]},"public_addr":"172.21.15.77:6810/4103452689","cluster_addr":"172.21.15.77:6813/4103452689","heartbeat_back_addr":"172.21.15.77:6823/4103452689","heartbeat_front_addr":"172.21.15.77:6818/4103452689","state":["exists","up"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6819","nonce":217398906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6824","nonce":217398906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6831","nonce":217398906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6829","nonce":217398906}]},"public_addr":"172.21.15.77:6819/217398906","cluster_addr":"172.21.15.77:6824/217398906","heartbeat_back_addr":"172.21.15.77:6831/217398906","heartbeat_front_addr":"172.21.15.77:6829/217398906","state":["exists","up"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6801","nonce":2565483070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6803","nonce":2565483070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6810","nonce":2565483070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6806","nonce":2565483070}]},"public_addr":"172.21.15.121:6801/2565483070","cluster_addr":"172.21.15.121:6803/2565483070","heartbeat_back_addr":"172.21.15.121:6810/2565483070","heartbeat_front_addr":"172.21.15.121:6806/2565483070","state":["exists","up"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6807","nonce":2785294752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6809","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6811","nonce":2785294752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6815","nonce":2785294752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6813","nonce":2785294752}]},"public_addr":"172.21.15.121:6807/2785294752","cluster_addr":"172.21.15.121:6811/2785294752","heartbeat_back_addr":"172.21.15.121:6815/2785294752","heartbeat_front_addr":"172.21.15.121:6813/2785294752","state":["exists","up"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6820","nonce":523906818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6824","nonce":523906818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6831","nonce":523906818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6828","nonce":523906818}]},"public_addr":"172.21.15.121:6820/523906818","cluster_addr":"172.21.15.121:6824/523906818","heartbeat_back_addr":"172.21.15.121:6831/523906818","heartbeat_front_addr":"172.21.15.121:6828/523906818","state":["exists","up"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6817","nonce":1683602459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6819","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6821","nonce":1683602459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6829","nonce":1683602459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6823","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6825","nonce":1683602459}]},"public_addr":"172.21.15.121:6817/1683602459","cluster_addr":"172.21.15.121:6821/1683602459","heartbeat_back_addr":"172.21.15.121:6829/1683602459","heartbeat_front_addr":"172.21.15.121:6825/1683602459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.839443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.818842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.776243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.793085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.822396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.907311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.918374+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.848430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:39:24.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.689+0000 7f3484f70640 1 -- 172.21.15.77:0/3615400018 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f346006be60 msgr2=0x7f346006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:24.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.689+0000 7f3484f70640 1 --2- 172.21.15.77:0/3615400018 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f346006be60 0x7f346006e320 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f348014a670 tx=0x7f3470008040 comp rx=0 tx=0).stop 2024-04-25T01:39:24.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.689+0000 7f3484f70640 1 -- 172.21.15.77:0/3615400018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3480150320 msgr2=0x7f34801ebb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:24.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.689+0000 7f3484f70640 1 --2- 172.21.15.77:0/3615400018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3480150320 0x7f34801ebb30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3468000c00 tx=0x7f34680046c0 comp rx=0 tx=0).stop 2024-04-25T01:39:24.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.689+0000 7f3484f70640 1 -- 172.21.15.77:0/3615400018 shutdown_connections 2024-04-25T01:39:24.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.689+0000 7f3484f70640 1 --2- 172.21.15.77:0/3615400018 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f346006be60 0x7f346006e320 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:24.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.689+0000 7f3484f70640 1 --2- 172.21.15.77:0/3615400018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3480150320 0x7f34801ebb30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:24.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.689+0000 7f3484f70640 1 --2- 172.21.15.77:0/3615400018 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3480154380 0x7f34801ec070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:24.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.689+0000 7f3484f70640 1 --2- 172.21.15.77:0/3615400018 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f348006d0a0 0x7f34800c0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:24.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.689+0000 7f3484f70640 1 -- 172.21.15.77:0/3615400018 >> 172.21.15.77:0/3615400018 conn(0x7f34800c3f80 msgr2=0x7f348014e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:24.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.689+0000 7f3484f70640 1 -- 172.21.15.77:0/3615400018 shutdown_connections 2024-04-25T01:39:24.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.689+0000 7f3484f70640 1 -- 172.21.15.77:0/3615400018 wait complete. 2024-04-25T01:39:24.683 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T01:39:24.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.796+0000 7f8e8ec31640 1 Processor -- start 2024-04-25T01:39:24.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.796+0000 7f8e8ec31640 1 -- start start 2024-04-25T01:39:24.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.797+0000 7f8e8ec31640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8e88150090 0x7f8e88156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:24.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.797+0000 7f8e8ec31640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e880c89c0 con 0x7f8e8806c280 2024-04-25T01:39:24.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.797+0000 7f8e8ec31640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e880c8ca0 con 0x7f8e880c8200 2024-04-25T01:39:24.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.797+0000 7f8e8ec31640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f8e8806b830 con 0x7f8e88150090 2024-04-25T01:39:24.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.797+0000 7f8e8c9cd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8e88150090 0x7f8e88156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:24.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.797+0000 7f8e8c9cd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8e88150090 0x7f8e88156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56108/0 (socket says 172.21.15.77:56108) 2024-04-25T01:39:24.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.797+0000 7f8e8d1ce640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8e8806c280 0x7f8e880c6320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57950/0 (socket says 172.21.15.77:57950) 2024-04-25T01:39:24.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.797+0000 7f8e8c9cd640 1 -- 172.21.15.77:0/647308267 learned_addr learned my addr 172.21.15.77:0/647308267 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:24.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.798+0000 7f8e8c9cd640 1 -- 172.21.15.77:0/647308267 >> v1:172.21.15.121:6789/0 conn(0x7f8e880c8200 legacy=0x7f8e880c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:24.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.798+0000 7f8e8c9cd640 1 -- 172.21.15.77:0/647308267 >> v1:172.21.15.77:6789/0 conn(0x7f8e8806c280 legacy=0x7f8e880c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:24.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.798+0000 7f8e8c9cd640 1 -- 172.21.15.77:0/647308267 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e8806ba80 con 0x7f8e88150090 2024-04-25T01:39:24.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.798+0000 7f8e877fe640 1 -- 172.21.15.77:0/647308267 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2197510535 0 0) 0x7f8e880c89c0 con 0x7f8e8806c280 2024-04-25T01:39:24.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.798+0000 7f8e8c9cd640 1 --2- 172.21.15.77:0/647308267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e88150090 0x7f8e88156c80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8e78009870 tx=0x7f8e7802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd8df7fa90f2413f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:24.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.798+0000 7f8e877fe640 1 -- 172.21.15.77:0/647308267 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e78037070 con 0x7f8e88150090 2024-04-25T01:39:24.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.798+0000 7f8e877fe640 1 -- 172.21.15.77:0/647308267 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e7802ae50 con 0x7f8e88150090 2024-04-25T01:39:24.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.798+0000 7f8e877fe640 1 -- 172.21.15.77:0/647308267 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e78032860 con 0x7f8e88150090 2024-04-25T01:39:24.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.799+0000 7f8e8ec31640 1 -- 172.21.15.77:0/647308267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e88150090 msgr2=0x7f8e88156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:24.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.799+0000 7f8e8ec31640 1 --2- 172.21.15.77:0/647308267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e88150090 0x7f8e88156c80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8e78009870 tx=0x7f8e7802a300 comp rx=0 tx=0).stop 2024-04-25T01:39:24.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.799+0000 7f8e8ec31640 1 -- 172.21.15.77:0/647308267 shutdown_connections 2024-04-25T01:39:24.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.799+0000 7f8e8ec31640 1 --2- 172.21.15.77:0/647308267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e88150090 0x7f8e88156c80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:24.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.799+0000 7f8e8ec31640 1 -- 172.21.15.77:0/647308267 >> 172.21.15.77:0/647308267 conn(0x7f8e880ad4d0 msgr2=0x7f8e880ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:24.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.799+0000 7f8e8ec31640 1 -- 172.21.15.77:0/647308267 shutdown_connections 2024-04-25T01:39:24.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.799+0000 7f8e8ec31640 1 -- 172.21.15.77:0/647308267 wait complete. 2024-04-25T01:39:24.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.800+0000 7f8e8ec31640 1 Processor -- start 2024-04-25T01:39:24.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.800+0000 7f8e8ec31640 1 -- start start 2024-04-25T01:39:24.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.801+0000 7f8e8ec31640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e8806c280 0x7f8e88155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:24.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.801+0000 7f8e8ec31640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8e880c8200 0x7f8e881ebdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:24.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.801+0000 7f8e8ec31640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e88150090 0x7f8e881ec300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:24.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.801+0000 7f8e8ec31640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8e880c6a30 con 0x7f8e8806c280 2024-04-25T01:39:24.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.801+0000 7f8e8ec31640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8e880c86b0 con 0x7f8e88150090 2024-04-25T01:39:24.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.801+0000 7f8e8ec31640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f8e880c6bb0 con 0x7f8e880c8200 2024-04-25T01:39:24.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.801+0000 7f8e8c9cd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e8806c280 0x7f8e88155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:24.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.801+0000 7f8e8c9cd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e8806c280 0x7f8e88155640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56122/0 (socket says 172.21.15.77:56122) 2024-04-25T01:39:24.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.801+0000 7f8e8c9cd640 1 -- 172.21.15.77:0/2358182615 learned_addr learned my addr 172.21.15.77:0/2358182615 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:24.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.801+0000 7f8e8d1ce640 1 --2- 172.21.15.77:0/2358182615 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e88150090 0x7f8e881ec300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:24.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.801+0000 7f8e87fff640 1 --2- 172.21.15.77:0/2358182615 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8e880c8200 0x7f8e881ebdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:24.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.801+0000 7f8e8c9cd640 1 -- 172.21.15.77:0/2358182615 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8e880c8200 msgr2=0x7f8e881ebdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:24.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.801+0000 7f8e8c9cd640 1 --2- 172.21.15.77:0/2358182615 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8e880c8200 0x7f8e881ebdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:24.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.801+0000 7f8e8c9cd640 1 -- 172.21.15.77:0/2358182615 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e88150090 msgr2=0x7f8e881ec300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:24.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.801+0000 7f8e8c9cd640 1 --2- 172.21.15.77:0/2358182615 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e88150090 0x7f8e881ec300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:24.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.801+0000 7f8e8c9cd640 1 -- 172.21.15.77:0/2358182615 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e88159890 con 0x7f8e8806c280 2024-04-25T01:39:24.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.801+0000 7f8e87fff640 1 --2- 172.21.15.77:0/2358182615 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8e880c8200 0x7f8e881ebdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:24.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.801+0000 7f8e8c9cd640 1 --2- 172.21.15.77:0/2358182615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e8806c280 0x7f8e88155640 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8e78009870 tx=0x7f8e780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:24.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.802+0000 7f8e857fa640 1 -- 172.21.15.77:0/2358182615 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e78041070 con 0x7f8e8806c280 2024-04-25T01:39:24.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.802+0000 7f8e857fa640 1 -- 172.21.15.77:0/2358182615 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e7803c870 con 0x7f8e8806c280 2024-04-25T01:39:24.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.802+0000 7f8e8ec31640 1 -- 172.21.15.77:0/2358182615 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e88151fe0 con 0x7f8e8806c280 2024-04-25T01:39:24.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.802+0000 7f8e857fa640 1 -- 172.21.15.77:0/2358182615 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e78037040 con 0x7f8e8806c280 2024-04-25T01:39:24.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.802+0000 7f8e8ec31640 1 -- 172.21.15.77:0/2358182615 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e880af090 con 0x7f8e8806c280 2024-04-25T01:39:24.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.803+0000 7f8e8ec31640 1 -- 172.21.15.77:0/2358182615 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e8804f500 con 0x7f8e8806c280 2024-04-25T01:39:24.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.803+0000 7f8e857fa640 1 -- 172.21.15.77:0/2358182615 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8e78044070 con 0x7f8e8806c280 2024-04-25T01:39:24.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.803+0000 7f8e857fa640 1 --2- 172.21.15.77:0/2358182615 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f8e7406be30 0x7f8e7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:24.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.803+0000 7f8e857fa640 1 -- 172.21.15.77:0/2358182615 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5689+0+0 (secure 0 0 0) 0x7f8e780aba40 con 0x7f8e8806c280 2024-04-25T01:39:24.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.803+0000 7f8e87fff640 1 --2- 172.21.15.77:0/2358182615 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f8e7406be30 0x7f8e7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:24.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.804+0000 7f8e87fff640 1 --2- 172.21.15.77:0/2358182615 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f8e7406be30 0x7f8e7406e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8e880aeaa0 tx=0x7f8e7c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:24.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.808+0000 7f8e857fa640 1 -- 172.21.15.77:0/2358182615 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8e88159890 con 0x7f8e8806c280 2024-04-25T01:39:24.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.981+0000 7f8e8ec31640 1 -- 172.21.15.77:0/2358182615 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e880b18a0 con 0x7f8e8806c280 2024-04-25T01:39:24.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.982+0000 7f8e857fa640 1 -- 172.21.15.77:0/2358182615 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16586 (secure 0 0 0) 0x7f8e7807a520 con 0x7f8e8806c280 2024-04-25T01:39:24.965 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:24.965 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":19,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:39:23.701670+0000","last_up_change":"2024-04-25T01:39:10.729600+0000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T01:39:11.681151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T01:39:21.606752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T01:39:22.677664+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6811","nonce":3366980158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6817","nonce":3366980158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6828","nonce":3366980158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6825","nonce":3366980158}]},"public_addr":"172.21.15.77:6811/3366980158","cluster_addr":"172.21.15.77:6817/3366980158","heartbeat_back_addr":"172.21.15.77:6828/3366980158","heartbeat_front_addr":"172.21.15.77:6825/3366980158","state":["exists","up"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6801","nonce":3971619298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6803","nonce":3971619298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6807","nonce":3971619298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6805","nonce":3971619298}]},"public_addr":"172.21.15.77:6801/3971619298","cluster_addr":"172.21.15.77:6803/3971619298","heartbeat_back_addr":"172.21.15.77:6807/3971619298","heartbeat_front_addr":"172.21.15.77:6805/3971619298","state":["exists","up"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6810","nonce":4103452689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6813","nonce":4103452689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6823","nonce":4103452689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6818","nonce":4103452689}]},"public_addr":"172.21.15.77:6810/4103452689","cluster_addr":"172.21.15.77:6813/4103452689","heartbeat_back_addr":"172.21.15.77:6823/4103452689","heartbeat_front_addr":"172.21.15.77:6818/4103452689","state":["exists","up"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6819","nonce":217398906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6824","nonce":217398906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6831","nonce":217398906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6829","nonce":217398906}]},"public_addr":"172.21.15.77:6819/217398906","cluster_addr":"172.21.15.77:6824/217398906","heartbeat_back_addr":"172.21.15.77:6831/217398906","heartbeat_front_addr":"172.21.15.77:6829/217398906","state":["exists","up"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6801","nonce":2565483070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6803","nonce":2565483070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6810","nonce":2565483070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6806","nonce":2565483070}]},"public_addr":"172.21.15.121:6801/2565483070","cluster_addr":"172.21.15.121:6803/2565483070","heartbeat_back_addr":"172.21.15.121:6810/2565483070","heartbeat_front_addr":"172.21.15.121:6806/2565483070","state":["exists","up"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6807","nonce":2785294752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6809","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6811","nonce":2785294752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6815","nonce":2785294752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6813","nonce":2785294752}]},"public_addr":"172.21.15.121:6807/2785294752","cluster_addr":"172.21.15.121:6811/2785294752","heartbeat_back_addr":"172.21.15.121:6815/2785294752","heartbeat_front_addr":"172.21.15.121:6813/2785294752","state":["exists","up"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6820","nonce":523906818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6824","nonce":523906818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6831","nonce":523906818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6828","nonce":523906818}]},"public_addr":"172.21.15.121:6820/523906818","cluster_addr":"172.21.15.121:6824/523906818","heartbeat_back_addr":"172.21.15.121:6831/523906818","heartbeat_front_addr":"172.21.15.121:6828/523906818","state":["exists","up"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6817","nonce":1683602459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6819","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6821","nonce":1683602459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6829","nonce":1683602459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6823","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6825","nonce":1683602459}]},"public_addr":"172.21.15.121:6817/1683602459","cluster_addr":"172.21.15.121:6821/1683602459","heartbeat_back_addr":"172.21.15.121:6829/1683602459","heartbeat_front_addr":"172.21.15.121:6825/1683602459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.839443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.818842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.776243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.793085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.822396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.907311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.918374+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.848430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:39:24.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.984+0000 7f8e8ec31640 1 -- 172.21.15.77:0/2358182615 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f8e7406be30 msgr2=0x7f8e7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:24.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.984+0000 7f8e8ec31640 1 --2- 172.21.15.77:0/2358182615 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f8e7406be30 0x7f8e7406e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8e880aeaa0 tx=0x7f8e7c009040 comp rx=0 tx=0).stop 2024-04-25T01:39:24.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.984+0000 7f8e8ec31640 1 -- 172.21.15.77:0/2358182615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e8806c280 msgr2=0x7f8e88155640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:24.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.984+0000 7f8e8ec31640 1 --2- 172.21.15.77:0/2358182615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e8806c280 0x7f8e88155640 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8e78009870 tx=0x7f8e780046c0 comp rx=0 tx=0).stop 2024-04-25T01:39:24.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.985+0000 7f8e8ec31640 1 -- 172.21.15.77:0/2358182615 shutdown_connections 2024-04-25T01:39:24.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.985+0000 7f8e8ec31640 1 --2- 172.21.15.77:0/2358182615 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f8e7406be30 0x7f8e7406e2f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:24.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.985+0000 7f8e8ec31640 1 --2- 172.21.15.77:0/2358182615 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e88150090 0x7f8e881ec300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:24.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.985+0000 7f8e8ec31640 1 --2- 172.21.15.77:0/2358182615 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8e880c8200 0x7f8e881ebdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:24.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.985+0000 7f8e8ec31640 1 --2- 172.21.15.77:0/2358182615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e8806c280 0x7f8e88155640 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:24.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.985+0000 7f8e8ec31640 1 -- 172.21.15.77:0/2358182615 >> 172.21.15.77:0/2358182615 conn(0x7f8e880ad4d0 msgr2=0x7f8e88074850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:24.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.985+0000 7f8e8ec31640 1 -- 172.21.15.77:0/2358182615 shutdown_connections 2024-04-25T01:39:24.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:24.985+0000 7f8e8ec31640 1 -- 172.21.15.77:0/2358182615 wait complete. 2024-04-25T01:39:24.978 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a standby_count_wanted 0 2024-04-25T01:39:25.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.095+0000 7f516bfff640 1 Processor -- start 2024-04-25T01:39:25.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.095+0000 7f516bfff640 1 -- start start 2024-04-25T01:39:25.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.096+0000 7f516bfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f516c14cff0 0x7f516c0c2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:25.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.096+0000 7f516bfff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f516c0c3310 0x7f516c071690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:25.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.096+0000 7f516bfff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f516c06dc90 con 0x7f516c0aa9a0 2024-04-25T01:39:25.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.096+0000 7f516bfff640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f516c06d800 con 0x7f516c14cff0 2024-04-25T01:39:25.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.096+0000 7f516bfff640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f516c06ced0 con 0x7f516c0c3310 2024-04-25T01:39:25.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.096+0000 7f516b7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f516c0aa9a0 0x7f516c071bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57952/0 (socket says 172.21.15.77:57952) 2024-04-25T01:39:25.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.096+0000 7f516b7fe640 1 -- 172.21.15.77:0/1328470461 learned_addr learned my addr 172.21.15.77:0/1328470461 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:25.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.096+0000 7f516a7fc640 1 --2- 172.21.15.77:0/1328470461 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f516c0c3310 0x7f516c071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:25.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.096+0000 7f516affd640 1 --2- 172.21.15.77:0/1328470461 >> v2:172.21.15.121:3300/0 conn(0x7f516c14cff0 0x7f516c0c2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:25.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.096+0000 7f5169ffb640 1 -- 172.21.15.77:0/1328470461 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1236876643 0 0) 0x7f516c06dc90 con 0x7f516c0aa9a0 2024-04-25T01:39:25.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.096+0000 7f5169ffb640 1 -- 172.21.15.77:0/1328470461 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5154003520 con 0x7f516c0aa9a0 2024-04-25T01:39:25.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.096+0000 7f5169ffb640 1 -- 172.21.15.77:0/1328470461 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 264812876 0 0) 0x7f5154003520 con 0x7f516c0aa9a0 2024-04-25T01:39:25.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.096+0000 7f5169ffb640 1 -- 172.21.15.77:0/1328470461 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f516c0c3310 msgr2=0x7f516c071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:25.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.096+0000 7f5169ffb640 1 --2- 172.21.15.77:0/1328470461 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f516c0c3310 0x7f516c071690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:25.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.096+0000 7f5169ffb640 1 -- 172.21.15.77:0/1328470461 >> v2:172.21.15.121:3300/0 conn(0x7f516c14cff0 msgr2=0x7f516c0c2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:25.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.096+0000 7f5169ffb640 1 --2- 172.21.15.77:0/1328470461 >> v2:172.21.15.121:3300/0 conn(0x7f516c14cff0 0x7f516c0c2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:25.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.096+0000 7f5169ffb640 1 -- 172.21.15.77:0/1328470461 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f516c06d1b0 con 0x7f516c0aa9a0 2024-04-25T01:39:25.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.096+0000 7f5169ffb640 1 -- 172.21.15.77:0/1328470461 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7f5164001670 con 0x7f516c0aa9a0 2024-04-25T01:39:25.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.096+0000 7f516affd640 1 --2- 172.21.15.77:0/1328470461 >> v2:172.21.15.121:3300/0 conn(0x7f516c14cff0 0x7f516c0c2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:25.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.097+0000 7f5169ffb640 1 -- 172.21.15.77:0/1328470461 >> v1:172.21.15.77:6789/0 conn(0x7f516c0aa9a0 legacy=0x7f516c071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:25.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.097+0000 7f5169ffb640 1 --2- 172.21.15.77:0/1328470461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51540039b0 0x7f5154003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:25.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.097+0000 7f5169ffb640 1 --2- 172.21.15.77:0/1328470461 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f516c0c3310 0x7f5154004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:25.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.097+0000 7f5169ffb640 1 --2- 172.21.15.77:0/1328470461 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5154004d40 0x7f51540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:25.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.097+0000 7f5169ffb640 1 -- 172.21.15.77:0/1328470461 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f516c06d800 con 0x7f51540039b0 2024-04-25T01:39:25.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.097+0000 7f5169ffb640 1 -- 172.21.15.77:0/1328470461 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f516c06ced0 con 0x7f5154004d40 2024-04-25T01:39:25.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.097+0000 7f5169ffb640 1 -- 172.21.15.77:0/1328470461 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f515400b9c0 con 0x7f516c0c3310 2024-04-25T01:39:25.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.097+0000 7f516affd640 1 --2- 172.21.15.77:0/1328470461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51540039b0 0x7f5154003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:25.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.097+0000 7f516b7fe640 1 --2- 172.21.15.77:0/1328470461 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5154004d40 0x7f51540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:25.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.097+0000 7f516a7fc640 1 --2- 172.21.15.77:0/1328470461 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f516c0c3310 0x7f5154004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:25.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.097+0000 7f516affd640 1 -- 172.21.15.77:0/1328470461 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f516c0c3310 msgr2=0x7f5154004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:25.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.097+0000 7f516affd640 1 --2- 172.21.15.77:0/1328470461 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f516c0c3310 0x7f5154004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:25.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.097+0000 7f516affd640 1 -- 172.21.15.77:0/1328470461 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5154004d40 msgr2=0x7f51540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:25.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.097+0000 7f516affd640 1 --2- 172.21.15.77:0/1328470461 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5154004d40 0x7f51540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:25.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.097+0000 7f516affd640 1 -- 172.21.15.77:0/1328470461 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5154003520 con 0x7f51540039b0 2024-04-25T01:39:25.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.098+0000 7f516affd640 1 --2- 172.21.15.77:0/1328470461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51540039b0 0x7f5154003dd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f515c00e350 tx=0x7f5154005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbec6d5b4e51437f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:25.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.098+0000 7f5169ffb640 1 -- 172.21.15.77:0/1328470461 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f515c009de0 con 0x7f51540039b0 2024-04-25T01:39:25.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.098+0000 7f5169ffb640 1 -- 172.21.15.77:0/1328470461 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f515c02e660 con 0x7f51540039b0 2024-04-25T01:39:25.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.098+0000 7f5169ffb640 1 -- 172.21.15.77:0/1328470461 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f515c02ea10 con 0x7f51540039b0 2024-04-25T01:39:25.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.098+0000 7f516bfff640 1 -- 172.21.15.77:0/1328470461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51540039b0 msgr2=0x7f5154003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:25.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.098+0000 7f516bfff640 1 --2- 172.21.15.77:0/1328470461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51540039b0 0x7f5154003dd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f515c00e350 tx=0x7f5154005830 comp rx=0 tx=0).stop 2024-04-25T01:39:25.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.098+0000 7f516b7fe640 1 -- 172.21.15.77:0/1328470461 reap_dead start 2024-04-25T01:39:25.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.098+0000 7f516bfff640 1 -- 172.21.15.77:0/1328470461 shutdown_connections 2024-04-25T01:39:25.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.098+0000 7f516bfff640 1 -- 172.21.15.77:0/1328470461 >> 172.21.15.77:0/1328470461 conn(0x7f516c06ba90 msgr2=0x7f516c0c72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:25.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.098+0000 7f516bfff640 1 -- 172.21.15.77:0/1328470461 shutdown_connections 2024-04-25T01:39:25.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.098+0000 7f516bfff640 1 -- 172.21.15.77:0/1328470461 wait complete. 2024-04-25T01:39:25.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.100+0000 7f516bfff640 1 Processor -- start 2024-04-25T01:39:25.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.100+0000 7f516bfff640 1 -- start start 2024-04-25T01:39:25.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.100+0000 7f516bfff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f51540039b0 0x7f516c1edd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:25.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.100+0000 7f516bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f516c1551e0 0x7f516c0c1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:25.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.100+0000 7f516bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f516c14dec0 0x7f516c155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:25.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.100+0000 7f516bfff640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f516c0701c0 con 0x7f516c1551e0 2024-04-25T01:39:25.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.100+0000 7f516bfff640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f516c070040 con 0x7f516c14dec0 2024-04-25T01:39:25.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.100+0000 7f516bfff640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f516c1538f0 con 0x7f51540039b0 2024-04-25T01:39:25.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.100+0000 7f516a7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f516c1551e0 0x7f516c0c1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:25.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.100+0000 7f516a7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f516c1551e0 0x7f516c0c1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56136/0 (socket says 172.21.15.77:56136) 2024-04-25T01:39:25.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.100+0000 7f516a7fc640 1 -- 172.21.15.77:0/2479132655 learned_addr learned my addr 172.21.15.77:0/2479132655 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:25.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.101+0000 7f516b7fe640 1 --2- 172.21.15.77:0/2479132655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f516c14dec0 0x7f516c155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:25.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.101+0000 7f516affd640 1 --2- 172.21.15.77:0/2479132655 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f51540039b0 0x7f516c1edd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:25.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.101+0000 7f516a7fc640 1 -- 172.21.15.77:0/2479132655 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f51540039b0 msgr2=0x7f516c1edd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:25.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.101+0000 7f516a7fc640 1 --2- 172.21.15.77:0/2479132655 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f51540039b0 0x7f516c1edd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:25.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.101+0000 7f516a7fc640 1 -- 172.21.15.77:0/2479132655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f516c14dec0 msgr2=0x7f516c155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:25.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.101+0000 7f516a7fc640 1 --2- 172.21.15.77:0/2479132655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f516c14dec0 0x7f516c155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:25.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.101+0000 7f516a7fc640 1 -- 172.21.15.77:0/2479132655 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f516c14e480 con 0x7f516c1551e0 2024-04-25T01:39:25.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.101+0000 7f516a7fc640 1 --2- 172.21.15.77:0/2479132655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f516c1551e0 0x7f516c0c1f30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f51600119d0 tx=0x7f5160011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:25.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.101+0000 7f51537fe640 1 -- 172.21.15.77:0/2479132655 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f516000faf0 con 0x7f516c1551e0 2024-04-25T01:39:25.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.101+0000 7f51537fe640 1 -- 172.21.15.77:0/2479132655 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f516000fc90 con 0x7f516c1551e0 2024-04-25T01:39:25.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.101+0000 7f51537fe640 1 -- 172.21.15.77:0/2479132655 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5160014440 con 0x7f516c1551e0 2024-04-25T01:39:25.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.101+0000 7f516bfff640 1 -- 172.21.15.77:0/2479132655 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f516c14e760 con 0x7f516c1551e0 2024-04-25T01:39:25.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.101+0000 7f516bfff640 1 -- 172.21.15.77:0/2479132655 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f516c1ed540 con 0x7f516c1551e0 2024-04-25T01:39:25.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.102+0000 7f516bfff640 1 -- 172.21.15.77:0/2479132655 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f516c075d10 con 0x7f516c1551e0 2024-04-25T01:39:25.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.102+0000 7f51537fe640 1 -- 172.21.15.77:0/2479132655 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5160012040 con 0x7f516c1551e0 2024-04-25T01:39:25.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.103+0000 7f51537fe640 1 --2- 172.21.15.77:0/2479132655 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f515806be30 0x7f515806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:25.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.103+0000 7f516affd640 1 --2- 172.21.15.77:0/2479132655 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f515806be30 0x7f515806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:25.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.103+0000 7f51537fe640 1 -- 172.21.15.77:0/2479132655 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5689+0+0 (secure 0 0 0) 0x7f516008b410 con 0x7f516c1551e0 2024-04-25T01:39:25.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.103+0000 7f516affd640 1 --2- 172.21.15.77:0/2479132655 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f515806be30 0x7f515806e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f515c035000 tx=0x7f515c02f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:25.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.107+0000 7f51537fe640 1 -- 172.21.15.77:0/2479132655 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5160019030 con 0x7f516c1551e0 2024-04-25T01:39:25.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.319+0000 7f516bfff640 1 -- 172.21.15.77:0/2479132655 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f516c0aa780 con 0x7f516c1551e0 2024-04-25T01:39:25.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.378+0000 7f51537fe640 1 -- 172.21.15.77:0/2479132655 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 113+0+0 (secure 0 0 0) 0x7f51600596f0 con 0x7f516c1551e0 2024-04-25T01:39:25.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.380+0000 7f516bfff640 1 -- 172.21.15.77:0/2479132655 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f515806be30 msgr2=0x7f515806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:25.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.380+0000 7f516bfff640 1 --2- 172.21.15.77:0/2479132655 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f515806be30 0x7f515806e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f515c035000 tx=0x7f515c02f000 comp rx=0 tx=0).stop 2024-04-25T01:39:25.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.380+0000 7f516bfff640 1 -- 172.21.15.77:0/2479132655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f516c1551e0 msgr2=0x7f516c0c1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:25.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.380+0000 7f516bfff640 1 --2- 172.21.15.77:0/2479132655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f516c1551e0 0x7f516c0c1f30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f51600119d0 tx=0x7f5160011e90 comp rx=0 tx=0).stop 2024-04-25T01:39:25.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.380+0000 7f516bfff640 1 -- 172.21.15.77:0/2479132655 shutdown_connections 2024-04-25T01:39:25.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.380+0000 7f516bfff640 1 --2- 172.21.15.77:0/2479132655 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f515806be30 0x7f515806e2f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:25.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.380+0000 7f516bfff640 1 --2- 172.21.15.77:0/2479132655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f516c1551e0 0x7f516c0c1f30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:25.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.380+0000 7f516bfff640 1 --2- 172.21.15.77:0/2479132655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f516c14dec0 0x7f516c155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:25.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.380+0000 7f516bfff640 1 --2- 172.21.15.77:0/2479132655 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f51540039b0 0x7f516c1edd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:25.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.380+0000 7f516bfff640 1 -- 172.21.15.77:0/2479132655 >> 172.21.15.77:0/2479132655 conn(0x7f516c06ba90 msgr2=0x7f516c0c72a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:25.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.380+0000 7f516bfff640 1 -- 172.21.15.77:0/2479132655 shutdown_connections 2024-04-25T01:39:25.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.380+0000 7f516bfff640 1 -- 172.21.15.77:0/2479132655 wait complete. 2024-04-25T01:39:25.374 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-04-25T01:39:25.374 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a allow_standby_replay false 2024-04-25T01:39:25.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.494+0000 7fd00c361640 1 Processor -- start 2024-04-25T01:39:25.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.494+0000 7fd00c361640 1 -- start start 2024-04-25T01:39:25.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.495+0000 7fd00c361640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd00406d470 0x7fd00406d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:25.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.495+0000 7fd00c361640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd0040c4d10 0x7fd0040c2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:25.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.495+0000 7fd00c361640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0040acf70 con 0x7fd0040c6c50 2024-04-25T01:39:25.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.495+0000 7fd00c361640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd0040acd20 con 0x7fd0040c4d10 2024-04-25T01:39:25.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.495+0000 7fd00c361640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd004153120 con 0x7fd00406d470 2024-04-25T01:39:25.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.495+0000 7fd00a8fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd0040c4d10 0x7fd0040c2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:25.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.495+0000 7fd0098fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd0040c6c50 0x7fd0040abf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57960/0 (socket says 172.21.15.77:57960) 2024-04-25T01:39:25.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.495+0000 7fd00a8fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd0040c4d10 0x7fd0040c2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56152/0 (socket says 172.21.15.77:56152) 2024-04-25T01:39:25.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.495+0000 7fd0098fc640 1 -- 172.21.15.77:0/4288715647 learned_addr learned my addr 172.21.15.77:0/4288715647 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:25.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.495+0000 7fd00a0fd640 1 --2- 172.21.15.77:0/4288715647 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd00406d470 0x7fd00406d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:25.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.495+0000 7fd00a8fe640 1 -- 172.21.15.77:0/4288715647 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd00406d470 msgr2=0x7fd00406d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:25.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.495+0000 7fd00a8fe640 1 --2- 172.21.15.77:0/4288715647 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd00406d470 0x7fd00406d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:25.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.495+0000 7fd00a8fe640 1 -- 172.21.15.77:0/4288715647 >> v1:172.21.15.77:6789/0 conn(0x7fd0040c6c50 legacy=0x7fd0040abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:25.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.495+0000 7fd0090fb640 1 -- 172.21.15.77:0/4288715647 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1031526705 0 0) 0x7fd0040acf70 con 0x7fd0040c6c50 2024-04-25T01:39:25.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.495+0000 7fd00a8fe640 1 -- 172.21.15.77:0/4288715647 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd004153400 con 0x7fd0040c4d10 2024-04-25T01:39:25.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.495+0000 7fd00a0fd640 1 --2- 172.21.15.77:0/4288715647 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd00406d470 0x7fd00406d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:25.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.496+0000 7fd00a8fe640 1 --2- 172.21.15.77:0/4288715647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0040c4d10 0x7fd0040c2340 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcffc009d90 tx=0x7fcffc02a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c78485c47ce6ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:25.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.496+0000 7fd0090fb640 1 -- 172.21.15.77:0/4288715647 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcffc007740 con 0x7fd0040c4d10 2024-04-25T01:39:25.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.496+0000 7fd0090fb640 1 -- 172.21.15.77:0/4288715647 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcffc0078e0 con 0x7fd0040c4d10 2024-04-25T01:39:25.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.496+0000 7fd0090fb640 1 -- 172.21.15.77:0/4288715647 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcffc007cb0 con 0x7fd0040c4d10 2024-04-25T01:39:25.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.496+0000 7fd00c361640 1 -- 172.21.15.77:0/4288715647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0040c4d10 msgr2=0x7fd0040c2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:25.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.496+0000 7fd00c361640 1 --2- 172.21.15.77:0/4288715647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0040c4d10 0x7fd0040c2340 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcffc009d90 tx=0x7fcffc02a530 comp rx=0 tx=0).stop 2024-04-25T01:39:25.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.496+0000 7fd00c361640 1 -- 172.21.15.77:0/4288715647 shutdown_connections 2024-04-25T01:39:25.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.496+0000 7fd00c361640 1 --2- 172.21.15.77:0/4288715647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0040c4d10 0x7fd0040c2340 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:25.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.496+0000 7fd00c361640 1 --2- 172.21.15.77:0/4288715647 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd00406d470 0x7fd00406d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:25.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.496+0000 7fd00c361640 1 -- 172.21.15.77:0/4288715647 >> 172.21.15.77:0/4288715647 conn(0x7fd0040c7580 msgr2=0x7fd0040c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:25.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.496+0000 7fd00c361640 1 -- 172.21.15.77:0/4288715647 shutdown_connections 2024-04-25T01:39:25.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.497+0000 7fd00c361640 1 -- 172.21.15.77:0/4288715647 wait complete. 2024-04-25T01:39:25.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.498+0000 7fd00c361640 1 Processor -- start 2024-04-25T01:39:25.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.498+0000 7fd00c361640 1 -- start start 2024-04-25T01:39:25.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.498+0000 7fd00c361640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd00406d470 0x7fd00414ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:25.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.498+0000 7fd00c361640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0040c4d10 0x7fd0040c0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:25.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.498+0000 7fd00c361640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd0040c6c50 0x7fd0040c0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:25.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.498+0000 7fd00c361640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd0040ac820 con 0x7fd00406d470 2024-04-25T01:39:25.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.498+0000 7fd00c361640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd0040ac6a0 con 0x7fd0040c4d10 2024-04-25T01:39:25.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.498+0000 7fd00c361640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd0040c2880 con 0x7fd0040c6c50 2024-04-25T01:39:25.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.498+0000 7fd00a0fd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd00406d470 0x7fd00414ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:25.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.498+0000 7fd00a0fd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd00406d470 0x7fd00414ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56156/0 (socket says 172.21.15.77:56156) 2024-04-25T01:39:25.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.498+0000 7fd00a0fd640 1 -- 172.21.15.77:0/4219973169 learned_addr learned my addr 172.21.15.77:0/4219973169 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:25.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.498+0000 7fd0098fc640 1 --2- 172.21.15.77:0/4219973169 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0040c4d10 0x7fd0040c0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:25.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.498+0000 7fd00a8fe640 1 --2- 172.21.15.77:0/4219973169 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd0040c6c50 0x7fd0040c0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:25.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.498+0000 7fd00a0fd640 1 -- 172.21.15.77:0/4219973169 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd0040c6c50 msgr2=0x7fd0040c0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:25.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.498+0000 7fd00a0fd640 1 --2- 172.21.15.77:0/4219973169 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd0040c6c50 0x7fd0040c0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:25.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.499+0000 7fd00a0fd640 1 -- 172.21.15.77:0/4219973169 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0040c4d10 msgr2=0x7fd0040c0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:25.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.499+0000 7fd00a0fd640 1 --2- 172.21.15.77:0/4219973169 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0040c4d10 0x7fd0040c0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:25.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.499+0000 7fd00a0fd640 1 -- 172.21.15.77:0/4219973169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0040c1510 con 0x7fd00406d470 2024-04-25T01:39:25.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.499+0000 7fd00a0fd640 1 --2- 172.21.15.77:0/4219973169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd00406d470 0x7fd00414ef20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd00000e810 tx=0x7fd00000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:25.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.499+0000 7fcffaffd640 1 -- 172.21.15.77:0/4219973169 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00000f040 con 0x7fd00406d470 2024-04-25T01:39:25.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.499+0000 7fcffaffd640 1 -- 172.21.15.77:0/4219973169 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd000004030 con 0x7fd00406d470 2024-04-25T01:39:25.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.499+0000 7fcffaffd640 1 -- 172.21.15.77:0/4219973169 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd000004400 con 0x7fd00406d470 2024-04-25T01:39:25.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.499+0000 7fd00c361640 1 -- 172.21.15.77:0/4219973169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0041e9490 con 0x7fd00406d470 2024-04-25T01:39:25.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.499+0000 7fd00c361640 1 -- 172.21.15.77:0/4219973169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0041e9a50 con 0x7fd00406d470 2024-04-25T01:39:25.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.500+0000 7fd00c361640 1 -- 172.21.15.77:0/4219973169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd00404f500 con 0x7fd00406d470 2024-04-25T01:39:25.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.500+0000 7fcffaffd640 1 -- 172.21.15.77:0/4219973169 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd00000c6d0 con 0x7fd00406d470 2024-04-25T01:39:25.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.501+0000 7fcffaffd640 1 --2- 172.21.15.77:0/4219973169 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fcfe806be60 0x7fcfe806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:25.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.501+0000 7fcffaffd640 1 -- 172.21.15.77:0/4219973169 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7fd00008abb0 con 0x7fd00406d470 2024-04-25T01:39:25.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.501+0000 7fd0098fc640 1 --2- 172.21.15.77:0/4219973169 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fcfe806be60 0x7fcfe806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:25.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.501+0000 7fd0098fc640 1 --2- 172.21.15.77:0/4219973169 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fcfe806be60 0x7fcfe806e320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd004152850 tx=0x7fcff4007c00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:25.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.506+0000 7fcffaffd640 1 -- 172.21.15.77:0/4219973169 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd0040c1510 con 0x7fd00406d470 2024-04-25T01:39:25.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:25.715+0000 7fd00c361640 1 -- 172.21.15.77:0/4219973169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd0040c1c60 con 0x7fd00406d470 2024-04-25T01:39:26.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.384+0000 7fcffaffd640 1 -- 172.21.15.77:0/4219973169 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 117+0+0 (secure 0 0 0) 0x7fd000017020 con 0x7fd00406d470 2024-04-25T01:39:26.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.386+0000 7fd00c361640 1 -- 172.21.15.77:0/4219973169 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fcfe806be60 msgr2=0x7fcfe806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:26.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.386+0000 7fd00c361640 1 --2- 172.21.15.77:0/4219973169 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fcfe806be60 0x7fcfe806e320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd004152850 tx=0x7fcff4007c00 comp rx=0 tx=0).stop 2024-04-25T01:39:26.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.386+0000 7fd00c361640 1 -- 172.21.15.77:0/4219973169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd00406d470 msgr2=0x7fd00414ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:26.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.386+0000 7fd00c361640 1 --2- 172.21.15.77:0/4219973169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd00406d470 0x7fd00414ef20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd00000e810 tx=0x7fd00000ecd0 comp rx=0 tx=0).stop 2024-04-25T01:39:26.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.386+0000 7fd00c361640 1 -- 172.21.15.77:0/4219973169 shutdown_connections 2024-04-25T01:39:26.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.386+0000 7fd00c361640 1 --2- 172.21.15.77:0/4219973169 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fcfe806be60 0x7fcfe806e320 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:26.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.386+0000 7fd00c361640 1 --2- 172.21.15.77:0/4219973169 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd0040c6c50 0x7fd0040c0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:26.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.386+0000 7fd00c361640 1 --2- 172.21.15.77:0/4219973169 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0040c4d10 0x7fd0040c0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:26.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.386+0000 7fd00c361640 1 --2- 172.21.15.77:0/4219973169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd00406d470 0x7fd00414ef20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:26.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.386+0000 7fd00c361640 1 -- 172.21.15.77:0/4219973169 >> 172.21.15.77:0/4219973169 conn(0x7fd0040c7580 msgr2=0x7fd00414fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:26.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.386+0000 7fd00c361640 1 -- 172.21.15.77:0/4219973169 shutdown_connections 2024-04-25T01:39:26.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.386+0000 7fd00c361640 1 -- 172.21.15.77:0/4219973169 wait complete. 2024-04-25T01:39:26.379 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a session_timeout 300 2024-04-25T01:39:26.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.499+0000 7fbcea691640 1 Processor -- start 2024-04-25T01:39:26.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.499+0000 7fbcea691640 1 -- start start 2024-04-25T01:39:26.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.499+0000 7fbcea691640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbce40c4280 0x7fbce41538f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:26.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.499+0000 7fbcea691640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbce40c4cb0 0x7fbce4153e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:26.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.499+0000 7fbcea691640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbce40c7040 con 0x7fbce4073450 2024-04-25T01:39:26.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.499+0000 7fbcea691640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fbce40c1cd0 con 0x7fbce40c4cb0 2024-04-25T01:39:26.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.499+0000 7fbcea691640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fbce40ac010 con 0x7fbce40c4280 2024-04-25T01:39:26.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.500+0000 7fbce8c2e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbce40c4cb0 0x7fbce4153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:26.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.500+0000 7fbce3fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbce40c4280 0x7fbce41538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:26.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.500+0000 7fbce37fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fbce4073450 0x7fbce40c5480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.77:60262/0 (socket says 172.21.15.77:60262) 2024-04-25T01:39:26.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.500+0000 7fbce37fe640 1 -- 172.21.15.77:0/1029480265 learned_addr learned my addr 172.21.15.77:0/1029480265 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:26.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.500+0000 7fbce2ffd640 1 -- 172.21.15.77:0/1029480265 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 378828857 0 0) 0x7fbce40c7040 con 0x7fbce4073450 2024-04-25T01:39:26.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.500+0000 7fbce2ffd640 1 -- 172.21.15.77:0/1029480265 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbccc003520 con 0x7fbce4073450 2024-04-25T01:39:26.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.500+0000 7fbce8c2e640 1 -- 172.21.15.77:0/1029480265 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbce40c4280 msgr2=0x7fbce41538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:26.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.500+0000 7fbce8c2e640 1 --2- 172.21.15.77:0/1029480265 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbce40c4280 0x7fbce41538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:26.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.500+0000 7fbce8c2e640 1 -- 172.21.15.77:0/1029480265 >> v1:172.21.15.121:6789/0 conn(0x7fbce4073450 legacy=0x7fbce40c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:26.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.500+0000 7fbce8c2e640 1 -- 172.21.15.77:0/1029480265 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce40ac2f0 con 0x7fbce40c4cb0 2024-04-25T01:39:26.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.500+0000 7fbce3fff640 1 --2- 172.21.15.77:0/1029480265 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbce40c4280 0x7fbce41538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:26.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.501+0000 7fbce8c2e640 1 --2- 172.21.15.77:0/1029480265 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbce40c4cb0 0x7fbce4153e30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc009d90 tx=0x7fbcdc02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8600b7271a1b0e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:26.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.501+0000 7fbce2ffd640 1 -- 172.21.15.77:0/1029480265 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc007740 con 0x7fbce40c4cb0 2024-04-25T01:39:26.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.501+0000 7fbce2ffd640 1 -- 172.21.15.77:0/1029480265 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcdc0078e0 con 0x7fbce40c4cb0 2024-04-25T01:39:26.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.501+0000 7fbce2ffd640 1 -- 172.21.15.77:0/1029480265 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc007c90 con 0x7fbce40c4cb0 2024-04-25T01:39:26.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.501+0000 7fbcea691640 1 -- 172.21.15.77:0/1029480265 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbce40c4cb0 msgr2=0x7fbce4153e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:26.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.501+0000 7fbcea691640 1 --2- 172.21.15.77:0/1029480265 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbce40c4cb0 0x7fbce4153e30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc009d90 tx=0x7fbcdc02a660 comp rx=0 tx=0).stop 2024-04-25T01:39:26.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.501+0000 7fbcea691640 1 -- 172.21.15.77:0/1029480265 shutdown_connections 2024-04-25T01:39:26.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.501+0000 7fbcea691640 1 --2- 172.21.15.77:0/1029480265 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbce40c4cb0 0x7fbce4153e30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:26.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.501+0000 7fbcea691640 1 --2- 172.21.15.77:0/1029480265 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbce40c4280 0x7fbce41538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:26.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.501+0000 7fbcea691640 1 -- 172.21.15.77:0/1029480265 >> 172.21.15.77:0/1029480265 conn(0x7fbce40c7580 msgr2=0x7fbce40c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:26.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.501+0000 7fbcea691640 1 -- 172.21.15.77:0/1029480265 shutdown_connections 2024-04-25T01:39:26.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.501+0000 7fbcea691640 1 -- 172.21.15.77:0/1029480265 wait complete. 2024-04-25T01:39:26.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.503+0000 7fbcea691640 1 Processor -- start 2024-04-25T01:39:26.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.503+0000 7fbcea691640 1 -- start start 2024-04-25T01:39:26.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.503+0000 7fbcea691640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbce4073450 0x7fbce4147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:26.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.503+0000 7fbcea691640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbce40c4280 0x7fbce40c09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:26.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.503+0000 7fbcea691640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbce40c4cb0 0x7fbce41eee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:26.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.503+0000 7fbcea691640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbce40c1a90 con 0x7fbce4073450 2024-04-25T01:39:26.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.503+0000 7fbcea691640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbce40c1910 con 0x7fbce40c4cb0 2024-04-25T01:39:26.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.503+0000 7fbcea691640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fbce40c4660 con 0x7fbce40c4280 2024-04-25T01:39:26.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.503+0000 7fbce3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbce4073450 0x7fbce4147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:26.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.504+0000 7fbce3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbce4073450 0x7fbce4147ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56160/0 (socket says 172.21.15.77:56160) 2024-04-25T01:39:26.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.504+0000 7fbce3fff640 1 -- 172.21.15.77:0/1659360547 learned_addr learned my addr 172.21.15.77:0/1659360547 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:26.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.504+0000 7fbce8c2e640 1 --2- 172.21.15.77:0/1659360547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbce40c4cb0 0x7fbce41eee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:26.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.504+0000 7fbce37fe640 1 --2- 172.21.15.77:0/1659360547 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbce40c4280 0x7fbce40c09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:26.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.504+0000 7fbce3fff640 1 -- 172.21.15.77:0/1659360547 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbce40c4280 msgr2=0x7fbce40c09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:26.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.504+0000 7fbce3fff640 1 --2- 172.21.15.77:0/1659360547 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbce40c4280 0x7fbce40c09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:26.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.504+0000 7fbce3fff640 1 -- 172.21.15.77:0/1659360547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbce40c4cb0 msgr2=0x7fbce41eee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:26.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.504+0000 7fbce3fff640 1 --2- 172.21.15.77:0/1659360547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbce40c4cb0 0x7fbce41eee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:26.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.504+0000 7fbce3fff640 1 -- 172.21.15.77:0/1659360547 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce4151cd0 con 0x7fbce4073450 2024-04-25T01:39:26.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.504+0000 7fbce3fff640 1 --2- 172.21.15.77:0/1659360547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbce4073450 0x7fbce4147ff0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400ebe0 tx=0x7fbcd400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:26.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.504+0000 7fbce0ff9640 1 -- 172.21.15.77:0/1659360547 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4017070 con 0x7fbce4073450 2024-04-25T01:39:26.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.504+0000 7fbce0ff9640 1 -- 172.21.15.77:0/1659360547 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcd400cc30 con 0x7fbce4073450 2024-04-25T01:39:26.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.504+0000 7fbcea691640 1 -- 172.21.15.77:0/1659360547 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbce41519f0 con 0x7fbce4073450 2024-04-25T01:39:26.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.504+0000 7fbce0ff9640 1 -- 172.21.15.77:0/1659360547 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4013470 con 0x7fbce4073450 2024-04-25T01:39:26.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.504+0000 7fbcea691640 1 -- 172.21.15.77:0/1659360547 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbce41ebc80 con 0x7fbce4073450 2024-04-25T01:39:26.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.505+0000 7fbcea691640 1 -- 172.21.15.77:0/1659360547 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbce404f500 con 0x7fbce4073450 2024-04-25T01:39:26.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.506+0000 7fbce0ff9640 1 -- 172.21.15.77:0/1659360547 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbcd401a070 con 0x7fbce4073450 2024-04-25T01:39:26.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.506+0000 7fbce0ff9640 1 --2- 172.21.15.77:0/1659360547 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbcd006be30 0x7fbcd006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:26.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.506+0000 7fbce0ff9640 1 -- 172.21.15.77:0/1659360547 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7fbcd408acf0 con 0x7fbce4073450 2024-04-25T01:39:26.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.506+0000 7fbce37fe640 1 --2- 172.21.15.77:0/1659360547 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbcd006be30 0x7fbcd006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:26.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.506+0000 7fbce37fe640 1 --2- 172.21.15.77:0/1659360547 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbcd006be30 0x7fbcd006e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbce414e5a0 tx=0x7fbcd8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:26.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.510+0000 7fbce0ff9640 1 -- 172.21.15.77:0/1659360547 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbcd408f070 con 0x7fbce4073450 2024-04-25T01:39:26.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:26.722+0000 7fbcea691640 1 -- 172.21.15.77:0/1659360547 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "session_timeout", "val": "300"} v 0) -- 0x7fbce4070cc0 con 0x7fbce4073450 2024-04-25T01:39:27.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.388+0000 7fbce0ff9640 1 -- 172.21.15.77:0/1659360547 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "session_timeout", "val": "300"}]=0 v7) ==== 110+0+0 (secure 0 0 0) 0x7fbcd4059070 con 0x7fbce4073450 2024-04-25T01:39:27.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.390+0000 7fbcea691640 1 -- 172.21.15.77:0/1659360547 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbcd006be30 msgr2=0x7fbcd006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:27.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.390+0000 7fbcea691640 1 --2- 172.21.15.77:0/1659360547 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbcd006be30 0x7fbcd006e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbce414e5a0 tx=0x7fbcd8009040 comp rx=0 tx=0).stop 2024-04-25T01:39:27.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.390+0000 7fbcea691640 1 -- 172.21.15.77:0/1659360547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbce4073450 msgr2=0x7fbce4147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:27.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.390+0000 7fbcea691640 1 --2- 172.21.15.77:0/1659360547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbce4073450 0x7fbce4147ff0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400ebe0 tx=0x7fbcd400c520 comp rx=0 tx=0).stop 2024-04-25T01:39:27.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.390+0000 7fbcea691640 1 -- 172.21.15.77:0/1659360547 shutdown_connections 2024-04-25T01:39:27.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.390+0000 7fbcea691640 1 --2- 172.21.15.77:0/1659360547 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbcd006be30 0x7fbcd006e2f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:27.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.390+0000 7fbcea691640 1 --2- 172.21.15.77:0/1659360547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbce40c4cb0 0x7fbce41eee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:27.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.390+0000 7fbcea691640 1 --2- 172.21.15.77:0/1659360547 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbce40c4280 0x7fbce40c09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:27.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.390+0000 7fbcea691640 1 --2- 172.21.15.77:0/1659360547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbce4073450 0x7fbce4147ff0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:27.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.390+0000 7fbcea691640 1 -- 172.21.15.77:0/1659360547 >> 172.21.15.77:0/1659360547 conn(0x7fbce40c7580 msgr2=0x7fbce40ab460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:27.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.391+0000 7fbcea691640 1 -- 172.21.15.77:0/1659360547 shutdown_connections 2024-04-25T01:39:27.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.391+0000 7fbcea691640 1 -- 172.21.15.77:0/1659360547 wait complete. 2024-04-25T01:39:27.384 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'a' 2024-04-25T01:39:27.384 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:39:27.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.502+0000 7f34bd3dc640 1 Processor -- start 2024-04-25T01:39:27.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.502+0000 7f34bd3dc640 1 -- start start 2024-04-25T01:39:27.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.503+0000 7f34bd3dc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f34b815a190 0x7f34b80c36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:27.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.503+0000 7f34bd3dc640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f34b80c2eb0 0x7f34b806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:27.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.503+0000 7f34bd3dc640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b8159620 con 0x7f34b80701e0 2024-04-25T01:39:27.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.503+0000 7f34bd3dc640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f34b80c3be0 con 0x7f34b815a190 2024-04-25T01:39:27.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.503+0000 7f34bd3dc640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f34b8072460 con 0x7f34b80c2eb0 2024-04-25T01:39:27.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.503+0000 7f34b6ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f34b815a190 0x7f34b80c36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:27.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.503+0000 7f34b77fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f34b80701e0 0x7f34b8156460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36918/0 (socket says 172.21.15.77:36918) 2024-04-25T01:39:27.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.503+0000 7f34b6ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f34b815a190 0x7f34b80c36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58340/0 (socket says 172.21.15.77:58340) 2024-04-25T01:39:27.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.503+0000 7f34b77fe640 1 -- 172.21.15.77:0/408907440 learned_addr learned my addr 172.21.15.77:0/408907440 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:27.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.503+0000 7f34b67fc640 1 --2- 172.21.15.77:0/408907440 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f34b80c2eb0 0x7f34b806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:27.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.503+0000 7f34b6ffd640 1 -- 172.21.15.77:0/408907440 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f34b80c2eb0 msgr2=0x7f34b806fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:27.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.503+0000 7f34b6ffd640 1 --2- 172.21.15.77:0/408907440 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f34b80c2eb0 0x7f34b806fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:27.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.503+0000 7f34b6ffd640 1 -- 172.21.15.77:0/408907440 >> v1:172.21.15.77:6789/0 conn(0x7f34b80701e0 legacy=0x7f34b8156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:27.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.503+0000 7f34b6ffd640 1 -- 172.21.15.77:0/408907440 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b8072740 con 0x7f34b815a190 2024-04-25T01:39:27.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.503+0000 7f34b5ffb640 1 -- 172.21.15.77:0/408907440 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4218469277 0 0) 0x7f34b8159620 con 0x7f34b80701e0 2024-04-25T01:39:27.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.504+0000 7f34b6ffd640 1 --2- 172.21.15.77:0/408907440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34b815a190 0x7f34b80c36a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f34a8009d90 tx=0x7f34a802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c36052ebc449d378 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:27.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.504+0000 7f34b5ffb640 1 -- 172.21.15.77:0/408907440 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a8031600 con 0x7f34b815a190 2024-04-25T01:39:27.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.504+0000 7f34b5ffb640 1 -- 172.21.15.77:0/408907440 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34a80317a0 con 0x7f34b815a190 2024-04-25T01:39:27.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.504+0000 7f34b5ffb640 1 -- 172.21.15.77:0/408907440 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a8031b70 con 0x7f34b815a190 2024-04-25T01:39:27.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.504+0000 7f34bd3dc640 1 -- 172.21.15.77:0/408907440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34b815a190 msgr2=0x7f34b80c36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:27.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.504+0000 7f34bd3dc640 1 --2- 172.21.15.77:0/408907440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34b815a190 0x7f34b80c36a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f34a8009d90 tx=0x7f34a802a5d0 comp rx=0 tx=0).stop 2024-04-25T01:39:27.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.504+0000 7f34bd3dc640 1 -- 172.21.15.77:0/408907440 shutdown_connections 2024-04-25T01:39:27.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.504+0000 7f34bd3dc640 1 --2- 172.21.15.77:0/408907440 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f34b80c2eb0 0x7f34b806fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:27.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.504+0000 7f34bd3dc640 1 --2- 172.21.15.77:0/408907440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34b815a190 0x7f34b80c36a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:27.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.504+0000 7f34bd3dc640 1 -- 172.21.15.77:0/408907440 >> 172.21.15.77:0/408907440 conn(0x7f34b80aa8f0 msgr2=0x7f34b8066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:27.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.505+0000 7f34bd3dc640 1 -- 172.21.15.77:0/408907440 shutdown_connections 2024-04-25T01:39:27.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.505+0000 7f34bd3dc640 1 -- 172.21.15.77:0/408907440 wait complete. 2024-04-25T01:39:27.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.506+0000 7f34bd3dc640 1 Processor -- start 2024-04-25T01:39:27.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.506+0000 7f34bd3dc640 1 -- start start 2024-04-25T01:39:27.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.506+0000 7f34bd3dc640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f34b80701e0 0x7f34b81eff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:27.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.506+0000 7f34bd3dc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34b80c2eb0 0x7f34b8158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:27.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.506+0000 7f34bd3dc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34b815a190 0x7f34b81ebea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:27.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.506+0000 7f34bd3dc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f34b8156b70 con 0x7f34b80c2eb0 2024-04-25T01:39:27.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.506+0000 7f34bd3dc640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f34b8072d00 con 0x7f34b815a190 2024-04-25T01:39:27.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.506+0000 7f34bd3dc640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f34b8156cf0 con 0x7f34b80701e0 2024-04-25T01:39:27.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.506+0000 7f34b67fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34b80c2eb0 0x7f34b8158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:27.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.506+0000 7f34b67fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34b80c2eb0 0x7f34b8158b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58342/0 (socket says 172.21.15.77:58342) 2024-04-25T01:39:27.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.506+0000 7f34b67fc640 1 -- 172.21.15.77:0/2418661509 learned_addr learned my addr 172.21.15.77:0/2418661509 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:27.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.507+0000 7f34b6ffd640 1 --2- 172.21.15.77:0/2418661509 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f34b80701e0 0x7f34b81eff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:27.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.507+0000 7f34b67fc640 1 -- 172.21.15.77:0/2418661509 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f34b80701e0 msgr2=0x7f34b81eff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:27.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.507+0000 7f34b67fc640 1 --2- 172.21.15.77:0/2418661509 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f34b80701e0 0x7f34b81eff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:27.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.507+0000 7f34b67fc640 1 -- 172.21.15.77:0/2418661509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34b815a190 msgr2=0x7f34b81ebea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:27.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.507+0000 7f34b77fe640 1 --2- 172.21.15.77:0/2418661509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34b815a190 0x7f34b81ebea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:27.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.507+0000 7f34b67fc640 1 --2- 172.21.15.77:0/2418661509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34b815a190 0x7f34b81ebea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:27.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.507+0000 7f34b67fc640 1 -- 172.21.15.77:0/2418661509 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b814ff80 con 0x7f34b80c2eb0 2024-04-25T01:39:27.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.507+0000 7f34b6ffd640 1 --2- 172.21.15.77:0/2418661509 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f34b80701e0 0x7f34b81eff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:27.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.507+0000 7f34b77fe640 1 --2- 172.21.15.77:0/2418661509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34b815a190 0x7f34b81ebea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:27.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.507+0000 7f34b67fc640 1 --2- 172.21.15.77:0/2418661509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34b80c2eb0 0x7f34b8158b30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f34ac00d800 tx=0x7f34ac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:27.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.507+0000 7f349f7fe640 1 -- 172.21.15.77:0/2418661509 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ac00b660 con 0x7f34b80c2eb0 2024-04-25T01:39:27.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.507+0000 7f349f7fe640 1 -- 172.21.15.77:0/2418661509 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34ac019070 con 0x7f34b80c2eb0 2024-04-25T01:39:27.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.507+0000 7f34bd3dc640 1 -- 172.21.15.77:0/2418661509 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34b8150260 con 0x7f34b80c2eb0 2024-04-25T01:39:27.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.507+0000 7f349f7fe640 1 -- 172.21.15.77:0/2418661509 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ac00ba20 con 0x7f34b80c2eb0 2024-04-25T01:39:27.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.507+0000 7f34bd3dc640 1 -- 172.21.15.77:0/2418661509 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34b81ef790 con 0x7f34b80c2eb0 2024-04-25T01:39:27.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.508+0000 7f34bd3dc640 1 -- 172.21.15.77:0/2418661509 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34b804f500 con 0x7f34b80c2eb0 2024-04-25T01:39:27.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.508+0000 7f349f7fe640 1 -- 172.21.15.77:0/2418661509 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f34ac00bbc0 con 0x7f34b80c2eb0 2024-04-25T01:39:27.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.509+0000 7f349f7fe640 1 --2- 172.21.15.77:0/2418661509 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f34a406be30 0x7f34a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:27.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.509+0000 7f349f7fe640 1 -- 172.21.15.77:0/2418661509 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7f34ac08b250 con 0x7f34b80c2eb0 2024-04-25T01:39:27.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.509+0000 7f34b6ffd640 1 --2- 172.21.15.77:0/2418661509 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f34a406be30 0x7f34a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:27.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.509+0000 7f34b6ffd640 1 --2- 172.21.15.77:0/2418661509 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f34a406be30 0x7f34a406e2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f34a8034000 tx=0x7f34a8033040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:27.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.513+0000 7f349f7fe640 1 -- 172.21.15.77:0/2418661509 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f34ac01c360 con 0x7f34b80c2eb0 2024-04-25T01:39:27.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.724+0000 7f34bd3dc640 1 -- 172.21.15.77:0/2418661509 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f34b80c2c90 con 0x7f34b80c2eb0 2024-04-25T01:39:27.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.724+0000 7f349f7fe640 1 -- 172.21.15.77:0/2418661509 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5177 (secure 0 0 0) 0x7f34ac059ca0 con 0x7f34b80c2eb0 2024-04-25T01:39:27.706 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:27.706 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3454203695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3454203695},{"type":"v1","addr":"172.21.15.77:6837","nonce":3454203695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-04-25T01:39:27.706 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 7 2024-04-25T01:39:27.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.726+0000 7f34bd3dc640 1 -- 172.21.15.77:0/2418661509 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f34a406be30 msgr2=0x7f34a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:27.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.726+0000 7f34bd3dc640 1 --2- 172.21.15.77:0/2418661509 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f34a406be30 0x7f34a406e2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f34a8034000 tx=0x7f34a8033040 comp rx=0 tx=0).stop 2024-04-25T01:39:27.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.726+0000 7f34bd3dc640 1 -- 172.21.15.77:0/2418661509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34b80c2eb0 msgr2=0x7f34b8158b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:27.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.726+0000 7f34bd3dc640 1 --2- 172.21.15.77:0/2418661509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34b80c2eb0 0x7f34b8158b30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f34ac00d800 tx=0x7f34ac00dcc0 comp rx=0 tx=0).stop 2024-04-25T01:39:27.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.726+0000 7f34bd3dc640 1 -- 172.21.15.77:0/2418661509 shutdown_connections 2024-04-25T01:39:27.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.726+0000 7f34bd3dc640 1 --2- 172.21.15.77:0/2418661509 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f34a406be30 0x7f34a406e2f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:27.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.726+0000 7f34bd3dc640 1 --2- 172.21.15.77:0/2418661509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34b80c2eb0 0x7f34b8158b30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:27.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.726+0000 7f34bd3dc640 1 --2- 172.21.15.77:0/2418661509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34b815a190 0x7f34b81ebea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:27.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.726+0000 7f34bd3dc640 1 --2- 172.21.15.77:0/2418661509 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f34b80701e0 0x7f34b81eff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:27.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.726+0000 7f34bd3dc640 1 -- 172.21.15.77:0/2418661509 >> 172.21.15.77:0/2418661509 conn(0x7f34b80aa8f0 msgr2=0x7f34b81553c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:27.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.726+0000 7f34bd3dc640 1 -- 172.21.15.77:0/2418661509 shutdown_connections 2024-04-25T01:39:27.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.726+0000 7f34bd3dc640 1 -- 172.21.15.77:0/2418661509 wait complete. 2024-04-25T01:39:27.719 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T01:39:27.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.832+0000 7f044c15a640 1 Processor -- start 2024-04-25T01:39:27.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.833+0000 7f044c15a640 1 -- start start 2024-04-25T01:39:27.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.833+0000 7f044c15a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f04440ad3a0 0x7f0444155a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:27.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.833+0000 7f044c15a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04440c2cb0 con 0x7f04440c38d0 2024-04-25T01:39:27.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.833+0000 7f044c15a640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0444152f80 con 0x7f044414fdd0 2024-04-25T01:39:27.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.833+0000 7f044c15a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f044406d8b0 con 0x7f04440ad3a0 2024-04-25T01:39:27.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.834+0000 7f04496f5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f04440ad3a0 0x7f0444155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:27.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.834+0000 7f04496f5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f04440ad3a0 0x7f0444155a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58346/0 (socket says 172.21.15.77:58346) 2024-04-25T01:39:27.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.834+0000 7f04496f5640 1 -- 172.21.15.77:0/1612902454 learned_addr learned my addr 172.21.15.77:0/1612902454 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:27.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.834+0000 7f04496f5640 1 -- 172.21.15.77:0/1612902454 >> v1:172.21.15.121:6789/0 conn(0x7f044414fdd0 legacy=0x7f044406da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:27.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.834+0000 7f04496f5640 1 -- 172.21.15.77:0/1612902454 >> v1:172.21.15.77:6789/0 conn(0x7f04440c38d0 legacy=0x7f044406d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:27.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.834+0000 7f04496f5640 1 -- 172.21.15.77:0/1612902454 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0444153260 con 0x7f04440ad3a0 2024-04-25T01:39:27.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.834+0000 7f04496f5640 1 --2- 172.21.15.77:0/1612902454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04440ad3a0 0x7f0444155a60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0434009870 tx=0x7f043402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb6c370d8d77a66f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:27.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.835+0000 7f0448ef4640 1 -- 172.21.15.77:0/1612902454 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0434037070 con 0x7f04440ad3a0 2024-04-25T01:39:27.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.835+0000 7f0448ef4640 1 -- 172.21.15.77:0/1612902454 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0434032440 con 0x7f04440ad3a0 2024-04-25T01:39:27.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.835+0000 7f0448ef4640 1 -- 172.21.15.77:0/1612902454 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0434032810 con 0x7f04440ad3a0 2024-04-25T01:39:27.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.835+0000 7f044c15a640 1 -- 172.21.15.77:0/1612902454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04440ad3a0 msgr2=0x7f0444155a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:27.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.835+0000 7f044c15a640 1 --2- 172.21.15.77:0/1612902454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04440ad3a0 0x7f0444155a60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0434009870 tx=0x7f043402a210 comp rx=0 tx=0).stop 2024-04-25T01:39:27.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.835+0000 7f044c15a640 1 -- 172.21.15.77:0/1612902454 shutdown_connections 2024-04-25T01:39:27.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.835+0000 7f044c15a640 1 --2- 172.21.15.77:0/1612902454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04440ad3a0 0x7f0444155a60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:27.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.835+0000 7f044c15a640 1 -- 172.21.15.77:0/1612902454 >> 172.21.15.77:0/1612902454 conn(0x7f04440c3f80 msgr2=0x7f04440c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:27.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.835+0000 7f044c15a640 1 -- 172.21.15.77:0/1612902454 shutdown_connections 2024-04-25T01:39:27.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.835+0000 7f044c15a640 1 -- 172.21.15.77:0/1612902454 wait complete. 2024-04-25T01:39:27.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.836+0000 7f044c15a640 1 Processor -- start 2024-04-25T01:39:27.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.836+0000 7f044c15a640 1 -- start start 2024-04-25T01:39:27.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.837+0000 7f044c15a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04440ad3a0 0x7f04441487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:27.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.837+0000 7f044c15a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04440c38d0 0x7f0444159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:27.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.837+0000 7f044c15a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f044414fdd0 0x7f0444149200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:27.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.837+0000 7f044c15a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f044406e140 con 0x7f04440ad3a0 2024-04-25T01:39:27.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.837+0000 7f044c15a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f04440c30e0 con 0x7f04440c38d0 2024-04-25T01:39:27.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.837+0000 7f044c15a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f044406e2c0 con 0x7f044414fdd0 2024-04-25T01:39:27.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.837+0000 7f0449ef6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04440ad3a0 0x7f04441487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:27.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.837+0000 7f0449ef6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04440ad3a0 0x7f04441487e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58358/0 (socket says 172.21.15.77:58358) 2024-04-25T01:39:27.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.837+0000 7f0449ef6640 1 -- 172.21.15.77:0/1815386581 learned_addr learned my addr 172.21.15.77:0/1815386581 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:27.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.837+0000 7f04496f5640 1 --2- 172.21.15.77:0/1815386581 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04440c38d0 0x7f0444159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:27.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.837+0000 7f044a6f7640 1 --2- 172.21.15.77:0/1815386581 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f044414fdd0 0x7f0444149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:27.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.837+0000 7f0449ef6640 1 -- 172.21.15.77:0/1815386581 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f044414fdd0 msgr2=0x7f0444149200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:27.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.837+0000 7f0449ef6640 1 --2- 172.21.15.77:0/1815386581 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f044414fdd0 0x7f0444149200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:27.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.837+0000 7f0449ef6640 1 -- 172.21.15.77:0/1815386581 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04440c38d0 msgr2=0x7f0444159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:27.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.837+0000 7f0449ef6640 1 --2- 172.21.15.77:0/1815386581 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04440c38d0 0x7f0444159700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:27.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.837+0000 7f0449ef6640 1 -- 172.21.15.77:0/1815386581 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04441ea240 con 0x7f04440ad3a0 2024-04-25T01:39:27.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.838+0000 7f0449ef6640 1 --2- 172.21.15.77:0/1815386581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04440ad3a0 0x7f04441487e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f043c00b3f0 tx=0x7f043c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:27.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.838+0000 7f043a7fc640 1 -- 172.21.15.77:0/1815386581 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c015020 con 0x7f04440ad3a0 2024-04-25T01:39:27.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.838+0000 7f043a7fc640 1 -- 172.21.15.77:0/1815386581 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f043c011830 con 0x7f04440ad3a0 2024-04-25T01:39:27.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.838+0000 7f043a7fc640 1 -- 172.21.15.77:0/1815386581 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c011c20 con 0x7f04440ad3a0 2024-04-25T01:39:27.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.838+0000 7f044c15a640 1 -- 172.21.15.77:0/1815386581 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0444157a50 con 0x7f04440ad3a0 2024-04-25T01:39:27.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.838+0000 7f044c15a640 1 -- 172.21.15.77:0/1815386581 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0444158010 con 0x7f04440ad3a0 2024-04-25T01:39:27.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.839+0000 7f044c15a640 1 -- 172.21.15.77:0/1815386581 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f044414f980 con 0x7f04440ad3a0 2024-04-25T01:39:27.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.839+0000 7f043a7fc640 1 -- 172.21.15.77:0/1815386581 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f043c018020 con 0x7f04440ad3a0 2024-04-25T01:39:27.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.839+0000 7f043a7fc640 1 --2- 172.21.15.77:0/1815386581 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f042806be30 0x7f042806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:27.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.840+0000 7f043a7fc640 1 -- 172.21.15.77:0/1815386581 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7f043c08aa70 con 0x7f04440ad3a0 2024-04-25T01:39:27.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.840+0000 7f04496f5640 1 --2- 172.21.15.77:0/1815386581 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f042806be30 0x7f042806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:27.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.840+0000 7f04496f5640 1 --2- 172.21.15.77:0/1815386581 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f042806be30 0x7f042806e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0434034000 tx=0x7f043402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:27.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:27.844+0000 7f043a7fc640 1 -- 172.21.15.77:0/1815386581 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f044414f980 con 0x7f04440ad3a0 2024-04-25T01:39:27.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.018+0000 7f044c15a640 1 -- 172.21.15.77:0/1815386581 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0444152ab0 con 0x7f04440ad3a0 2024-04-25T01:39:28.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.019+0000 7f043a7fc640 1 -- 172.21.15.77:0/1815386581 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16573 (secure 0 0 0) 0x7f0444152ab0 con 0x7f04440ad3a0 2024-04-25T01:39:28.001 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:28.001 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:39:25.366039+0000","last_up_change":"2024-04-25T01:39:10.729600+0000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T01:39:11.681151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T01:39:21.606752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T01:39:22.677664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6811","nonce":3366980158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6817","nonce":3366980158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6828","nonce":3366980158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6825","nonce":3366980158}]},"public_addr":"172.21.15.77:6811/3366980158","cluster_addr":"172.21.15.77:6817/3366980158","heartbeat_back_addr":"172.21.15.77:6828/3366980158","heartbeat_front_addr":"172.21.15.77:6825/3366980158","state":["exists","up"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6801","nonce":3971619298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6803","nonce":3971619298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6807","nonce":3971619298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6805","nonce":3971619298}]},"public_addr":"172.21.15.77:6801/3971619298","cluster_addr":"172.21.15.77:6803/3971619298","heartbeat_back_addr":"172.21.15.77:6807/3971619298","heartbeat_front_addr":"172.21.15.77:6805/3971619298","state":["exists","up"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6810","nonce":4103452689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6813","nonce":4103452689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6823","nonce":4103452689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6818","nonce":4103452689}]},"public_addr":"172.21.15.77:6810/4103452689","cluster_addr":"172.21.15.77:6813/4103452689","heartbeat_back_addr":"172.21.15.77:6823/4103452689","heartbeat_front_addr":"172.21.15.77:6818/4103452689","state":["exists","up"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6819","nonce":217398906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6824","nonce":217398906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6831","nonce":217398906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6829","nonce":217398906}]},"public_addr":"172.21.15.77:6819/217398906","cluster_addr":"172.21.15.77:6824/217398906","heartbeat_back_addr":"172.21.15.77:6831/217398906","heartbeat_front_addr":"172.21.15.77:6829/217398906","state":["exists","up"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6801","nonce":2565483070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6803","nonce":2565483070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6810","nonce":2565483070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6806","nonce":2565483070}]},"public_addr":"172.21.15.121:6801/2565483070","cluster_addr":"172.21.15.121:6803/2565483070","heartbeat_back_addr":"172.21.15.121:6810/2565483070","heartbeat_front_addr":"172.21.15.121:6806/2565483070","state":["exists","up"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6807","nonce":2785294752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6809","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6811","nonce":2785294752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6815","nonce":2785294752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6813","nonce":2785294752}]},"public_addr":"172.21.15.121:6807/2785294752","cluster_addr":"172.21.15.121:6811/2785294752","heartbeat_back_addr":"172.21.15.121:6815/2785294752","heartbeat_front_addr":"172.21.15.121:6813/2785294752","state":["exists","up"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6820","nonce":523906818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6824","nonce":523906818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6831","nonce":523906818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6828","nonce":523906818}]},"public_addr":"172.21.15.121:6820/523906818","cluster_addr":"172.21.15.121:6824/523906818","heartbeat_back_addr":"172.21.15.121:6831/523906818","heartbeat_front_addr":"172.21.15.121:6828/523906818","state":["exists","up"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6817","nonce":1683602459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6819","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6821","nonce":1683602459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6829","nonce":1683602459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6823","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6825","nonce":1683602459}]},"public_addr":"172.21.15.121:6817/1683602459","cluster_addr":"172.21.15.121:6821/1683602459","heartbeat_back_addr":"172.21.15.121:6829/1683602459","heartbeat_front_addr":"172.21.15.121:6825/1683602459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.839443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.818842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.776243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.793085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.822396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.907311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.918374+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.848430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:39:28.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.021+0000 7f044c15a640 1 -- 172.21.15.77:0/1815386581 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f042806be30 msgr2=0x7f042806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:28.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.021+0000 7f044c15a640 1 --2- 172.21.15.77:0/1815386581 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f042806be30 0x7f042806e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0434034000 tx=0x7f043402e000 comp rx=0 tx=0).stop 2024-04-25T01:39:28.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.021+0000 7f044c15a640 1 -- 172.21.15.77:0/1815386581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04440ad3a0 msgr2=0x7f04441487e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:28.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.021+0000 7f044c15a640 1 --2- 172.21.15.77:0/1815386581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04440ad3a0 0x7f04441487e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f043c00b3f0 tx=0x7f043c00b8b0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.021+0000 7f044c15a640 1 -- 172.21.15.77:0/1815386581 shutdown_connections 2024-04-25T01:39:28.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.021+0000 7f044c15a640 1 --2- 172.21.15.77:0/1815386581 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f042806be30 0x7f042806e2f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.021+0000 7f044c15a640 1 --2- 172.21.15.77:0/1815386581 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f044414fdd0 0x7f0444149200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.021+0000 7f044c15a640 1 --2- 172.21.15.77:0/1815386581 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04440c38d0 0x7f0444159700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.021+0000 7f044c15a640 1 --2- 172.21.15.77:0/1815386581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04440ad3a0 0x7f04441487e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.021+0000 7f044c15a640 1 -- 172.21.15.77:0/1815386581 >> 172.21.15.77:0/1815386581 conn(0x7f04440c3f80 msgr2=0x7f044406da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:28.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.021+0000 7f044c15a640 1 -- 172.21.15.77:0/1815386581 shutdown_connections 2024-04-25T01:39:28.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.021+0000 7f044c15a640 1 -- 172.21.15.77:0/1815386581 wait complete. 2024-04-25T01:39:28.015 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T01:39:28.015 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T01:39:28.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.130+0000 7f2475cb3640 1 Processor -- start 2024-04-25T01:39:28.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.130+0000 7f2475cb3640 1 -- start start 2024-04-25T01:39:28.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.131+0000 7f2475cb3640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f24700c3af0 0x7f2470070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:28.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.131+0000 7f2475cb3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f24700adb60 0x7f2470156b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:28.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.131+0000 7f2475cb3640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2470157080 con 0x7f24701596b0 2024-04-25T01:39:28.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.131+0000 7f2475cb3640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f247006c870 con 0x7f24700c3af0 2024-04-25T01:39:28.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.131+0000 7f2475cb3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f2470072c30 con 0x7f24700adb60 2024-04-25T01:39:28.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.131+0000 7f246effd640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f24700adb60 0x7f2470156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:28.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.131+0000 7f246f7fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f24700c3af0 0x7f2470070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:28.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.132+0000 7f246effd640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f24700adb60 0x7f2470156b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.77:42584/0 (socket says 172.21.15.77:42584) 2024-04-25T01:39:28.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.132+0000 7f246effd640 1 -- 172.21.15.77:0/1732958240 learned_addr learned my addr 172.21.15.77:0/1732958240 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:28.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.132+0000 7f246effd640 1 -- 172.21.15.77:0/1732958240 >> v2:172.21.15.121:3300/0 conn(0x7f24700c3af0 msgr2=0x7f2470070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:28.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.132+0000 7f246effd640 1 --2- 172.21.15.77:0/1732958240 >> v2:172.21.15.121:3300/0 conn(0x7f24700c3af0 0x7f2470070e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.132+0000 7f246effd640 1 -- 172.21.15.77:0/1732958240 >> v1:172.21.15.121:6789/0 conn(0x7f24701596b0 legacy=0x7f247014c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:28.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.132+0000 7f246effd640 1 -- 172.21.15.77:0/1732958240 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2470072f10 con 0x7f24700adb60 2024-04-25T01:39:28.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.133+0000 7f246effd640 1 --2- 172.21.15.77:0/1732958240 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f24700adb60 0x7f2470156b40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2458009870 tx=0x7f245802a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a706ad0132783dce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:28.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.133+0000 7f246e7fc640 1 -- 172.21.15.77:0/1732958240 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2458037070 con 0x7f24700adb60 2024-04-25T01:39:28.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.133+0000 7f246e7fc640 1 -- 172.21.15.77:0/1732958240 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2458032440 con 0x7f24700adb60 2024-04-25T01:39:28.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.133+0000 7f246e7fc640 1 -- 172.21.15.77:0/1732958240 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2458032810 con 0x7f24700adb60 2024-04-25T01:39:28.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.133+0000 7f2475cb3640 1 -- 172.21.15.77:0/1732958240 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f24700adb60 msgr2=0x7f2470156b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:28.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.133+0000 7f2475cb3640 1 --2- 172.21.15.77:0/1732958240 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f24700adb60 0x7f2470156b40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2458009870 tx=0x7f245802a130 comp rx=0 tx=0).stop 2024-04-25T01:39:28.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.133+0000 7f2475cb3640 1 -- 172.21.15.77:0/1732958240 shutdown_connections 2024-04-25T01:39:28.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.133+0000 7f2475cb3640 1 --2- 172.21.15.77:0/1732958240 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f24700adb60 0x7f2470156b40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.133+0000 7f2475cb3640 1 --2- 172.21.15.77:0/1732958240 >> v2:172.21.15.121:3300/0 conn(0x7f24700c3af0 0x7f2470070e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.133+0000 7f2475cb3640 1 -- 172.21.15.77:0/1732958240 >> 172.21.15.77:0/1732958240 conn(0x7f24700c4970 msgr2=0x7f24700c4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:28.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.133+0000 7f2475cb3640 1 -- 172.21.15.77:0/1732958240 shutdown_connections 2024-04-25T01:39:28.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.133+0000 7f2475cb3640 1 -- 172.21.15.77:0/1732958240 wait complete. 2024-04-25T01:39:28.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.134+0000 7f2475cb3640 1 Processor -- start 2024-04-25T01:39:28.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.135+0000 7f2475cb3640 1 -- start start 2024-04-25T01:39:28.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.135+0000 7f2475cb3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24700adb60 0x7f24700acee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:28.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.135+0000 7f2475cb3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f24700c3af0 0x7f24701454c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:28.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.135+0000 7f2475cb3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24701596b0 0x7f24700abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:28.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.135+0000 7f2475cb3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f247006cf20 con 0x7f24700adb60 2024-04-25T01:39:28.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.135+0000 7f2475cb3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f247006cda0 con 0x7f24701596b0 2024-04-25T01:39:28.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.135+0000 7f2475cb3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f247014ceb0 con 0x7f24700c3af0 2024-04-25T01:39:28.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.135+0000 7f246f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24700adb60 0x7f24700acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:28.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.135+0000 7f246f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24700adb60 0x7f24700acee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58374/0 (socket says 172.21.15.77:58374) 2024-04-25T01:39:28.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.135+0000 7f246f7fe640 1 -- 172.21.15.77:0/1042151959 learned_addr learned my addr 172.21.15.77:0/1042151959 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:28.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.135+0000 7f246effd640 1 --2- 172.21.15.77:0/1042151959 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f24700c3af0 0x7f24701454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:28.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.135+0000 7f246ffff640 1 --2- 172.21.15.77:0/1042151959 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24701596b0 0x7f24700abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:28.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.136+0000 7f246f7fe640 1 -- 172.21.15.77:0/1042151959 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f24700c3af0 msgr2=0x7f24701454c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:28.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.136+0000 7f246f7fe640 1 --2- 172.21.15.77:0/1042151959 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f24700c3af0 0x7f24701454c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.136+0000 7f246f7fe640 1 -- 172.21.15.77:0/1042151959 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24701596b0 msgr2=0x7f24700abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:28.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.136+0000 7f246f7fe640 1 --2- 172.21.15.77:0/1042151959 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24701596b0 0x7f24700abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.136+0000 7f246f7fe640 1 -- 172.21.15.77:0/1042151959 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24700ad420 con 0x7f24700adb60 2024-04-25T01:39:28.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.136+0000 7f246f7fe640 1 --2- 172.21.15.77:0/1042151959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24700adb60 0x7f24700acee0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f246000efc0 tx=0x7f246000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:28.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.136+0000 7f2467fff640 1 -- 172.21.15.77:0/1042151959 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2460018020 con 0x7f24700adb60 2024-04-25T01:39:28.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.136+0000 7f2467fff640 1 -- 172.21.15.77:0/1042151959 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2460014480 con 0x7f24700adb60 2024-04-25T01:39:28.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.136+0000 7f2467fff640 1 -- 172.21.15.77:0/1042151959 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2460014850 con 0x7f24700adb60 2024-04-25T01:39:28.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.136+0000 7f2475cb3640 1 -- 172.21.15.77:0/1042151959 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2470155c00 con 0x7f24700adb60 2024-04-25T01:39:28.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.136+0000 7f2475cb3640 1 -- 172.21.15.77:0/1042151959 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24700ab7d0 con 0x7f24700adb60 2024-04-25T01:39:28.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.137+0000 7f2475cb3640 1 -- 172.21.15.77:0/1042151959 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f247004f500 con 0x7f24700adb60 2024-04-25T01:39:28.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.137+0000 7f2467fff640 1 -- 172.21.15.77:0/1042151959 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2460005d10 con 0x7f24700adb60 2024-04-25T01:39:28.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.138+0000 7f2467fff640 1 --2- 172.21.15.77:0/1042151959 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f245006be30 0x7f245006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:28.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.138+0000 7f246effd640 1 --2- 172.21.15.77:0/1042151959 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f245006be30 0x7f245006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:28.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.138+0000 7f2467fff640 1 -- 172.21.15.77:0/1042151959 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7f246008bb70 con 0x7f24700adb60 2024-04-25T01:39:28.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.138+0000 7f246effd640 1 --2- 172.21.15.77:0/1042151959 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f245006be30 0x7f245006e2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2458034000 tx=0x7f245802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:28.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.142+0000 7f2467fff640 1 -- 172.21.15.77:0/1042151959 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2460022030 con 0x7f24700adb60 2024-04-25T01:39:28.200 INFO:tasks.ceph.mds.d.smithi121.stderr:2024-04-25T01:39:28.217+0000 7f78e26bc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T01:39:28.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.313+0000 7f2475cb3640 1 -- 172.21.15.77:0/1042151959 --> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2470155ee0 con 0x7f245006be30 2024-04-25T01:39:28.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.319+0000 7f2467fff640 1 -- 172.21.15.77:0/1042151959 <== mgr.4098 v2:172.21.15.77:6832/4208232183 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251941 (secure 0 0 0) 0x7f2470155ee0 con 0x7f245006be30 2024-04-25T01:39:28.304 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:28.305 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-25T01:39:28.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.322+0000 7f2475cb3640 1 -- 172.21.15.77:0/1042151959 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f245006be30 msgr2=0x7f245006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:28.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.322+0000 7f2475cb3640 1 --2- 172.21.15.77:0/1042151959 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f245006be30 0x7f245006e2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2458034000 tx=0x7f245802e000 comp rx=0 tx=0).stop 2024-04-25T01:39:28.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.322+0000 7f2475cb3640 1 -- 172.21.15.77:0/1042151959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24700adb60 msgr2=0x7f24700acee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:28.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.322+0000 7f2475cb3640 1 --2- 172.21.15.77:0/1042151959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24700adb60 0x7f24700acee0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f246000efc0 tx=0x7f246000c490 comp rx=0 tx=0).stop 2024-04-25T01:39:28.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.322+0000 7f2475cb3640 1 -- 172.21.15.77:0/1042151959 shutdown_connections 2024-04-25T01:39:28.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.322+0000 7f2475cb3640 1 --2- 172.21.15.77:0/1042151959 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f245006be30 0x7f245006e2f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.322+0000 7f2475cb3640 1 --2- 172.21.15.77:0/1042151959 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24701596b0 0x7f24700abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.322+0000 7f2475cb3640 1 --2- 172.21.15.77:0/1042151959 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f24700c3af0 0x7f24701454c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.322+0000 7f2475cb3640 1 --2- 172.21.15.77:0/1042151959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24700adb60 0x7f24700acee0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.322+0000 7f2475cb3640 1 -- 172.21.15.77:0/1042151959 >> 172.21.15.77:0/1042151959 conn(0x7f24700c4970 msgr2=0x7f24700c4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:28.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.322+0000 7f2475cb3640 1 -- 172.21.15.77:0/1042151959 shutdown_connections 2024-04-25T01:39:28.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.322+0000 7f2475cb3640 1 -- 172.21.15.77:0/1042151959 wait complete. 2024-04-25T01:39:28.314 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-25T01:39:27.651670+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218956,"kb_used_data":2776,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755764,"statfs":{"total":773094113280,"available":772869902336,"internally_reserved":0,"allocated":2842624,"data_stored":1727288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.298746"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.398012+0000","last_change":"2024-04-25T01:39:24.396231+0000","last_active":"2024-04-25T01:39:26.398012+0000","last_peered":"2024-04-25T01:39:26.398012+0000","last_clean":"2024-04-25T01:39:26.398012+0000","last_became_active":"2024-04-25T01:39:24.395958+0000","last_became_peered":"2024-04-25T01:39:24.395958+0000","last_unstale":"2024-04-25T01:39:26.398012+0000","last_undegraded":"2024-04-25T01:39:26.398012+0000","last_fullsized":"2024-04-25T01:39:26.398012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:54.898765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.369673+0000","last_change":"2024-04-25T01:39:24.386803+0000","last_active":"2024-04-25T01:39:25.369673+0000","last_peered":"2024-04-25T01:39:25.369673+0000","last_clean":"2024-04-25T01:39:25.369673+0000","last_became_active":"2024-04-25T01:39:24.386531+0000","last_became_peered":"2024-04-25T01:39:24.386531+0000","last_unstale":"2024-04-25T01:39:25.369673+0000","last_undegraded":"2024-04-25T01:39:25.369673+0000","last_fullsized":"2024-04-25T01:39:25.369673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:19.160345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.358310+0000","last_change":"2024-04-25T01:39:24.386909+0000","last_active":"2024-04-25T01:39:26.358310+0000","last_peered":"2024-04-25T01:39:26.358310+0000","last_clean":"2024-04-25T01:39:26.358310+0000","last_became_active":"2024-04-25T01:39:24.386568+0000","last_became_peered":"2024-04-25T01:39:24.386568+0000","last_unstale":"2024-04-25T01:39:26.358310+0000","last_undegraded":"2024-04-25T01:39:26.358310+0000","last_fullsized":"2024-04-25T01:39:26.358310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:29.904064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.302985+0000","last_change":"2024-04-25T01:39:24.398726+0000","last_active":"2024-04-25T01:39:26.302985+0000","last_peered":"2024-04-25T01:39:26.302985+0000","last_clean":"2024-04-25T01:39:26.302985+0000","last_became_active":"2024-04-25T01:39:24.398449+0000","last_became_peered":"2024-04-25T01:39:24.398449+0000","last_unstale":"2024-04-25T01:39:26.302985+0000","last_undegraded":"2024-04-25T01:39:26.302985+0000","last_fullsized":"2024-04-25T01:39:26.302985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:41:38.230939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397515+0000","last_change":"2024-04-25T01:39:24.380318+0000","last_active":"2024-04-25T01:39:26.397515+0000","last_peered":"2024-04-25T01:39:26.397515+0000","last_clean":"2024-04-25T01:39:26.397515+0000","last_became_active":"2024-04-25T01:39:24.379573+0000","last_became_peered":"2024-04-25T01:39:24.379573+0000","last_unstale":"2024-04-25T01:39:26.397515+0000","last_undegraded":"2024-04-25T01:39:26.397515+0000","last_fullsized":"2024-04-25T01:39:26.397515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:12.089917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.302832+0000","last_change":"2024-04-25T01:39:24.399950+0000","last_active":"2024-04-25T01:39:26.302832+0000","last_peered":"2024-04-25T01:39:26.302832+0000","last_clean":"2024-04-25T01:39:26.302832+0000","last_became_active":"2024-04-25T01:39:24.399701+0000","last_became_peered":"2024-04-25T01:39:24.399701+0000","last_unstale":"2024-04-25T01:39:26.302832+0000","last_undegraded":"2024-04-25T01:39:26.302832+0000","last_fullsized":"2024-04-25T01:39:26.302832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:49.618370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397431+0000","last_change":"2024-04-25T01:39:24.387941+0000","last_active":"2024-04-25T01:39:26.397431+0000","last_peered":"2024-04-25T01:39:26.397431+0000","last_clean":"2024-04-25T01:39:26.397431+0000","last_became_active":"2024-04-25T01:39:24.387674+0000","last_became_peered":"2024-04-25T01:39:24.387674+0000","last_unstale":"2024-04-25T01:39:26.397431+0000","last_undegraded":"2024-04-25T01:39:26.397431+0000","last_fullsized":"2024-04-25T01:39:26.397431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:05.676143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.238589+0000","last_change":"2024-04-25T01:39:24.401765+0000","last_active":"2024-04-25T01:39:26.238589+0000","last_peered":"2024-04-25T01:39:26.238589+0000","last_clean":"2024-04-25T01:39:26.238589+0000","last_became_active":"2024-04-25T01:39:24.400509+0000","last_became_peered":"2024-04-25T01:39:24.400509+0000","last_unstale":"2024-04-25T01:39:26.238589+0000","last_undegraded":"2024-04-25T01:39:26.238589+0000","last_fullsized":"2024-04-25T01:39:26.238589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:25.031622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.398051+0000","last_change":"2024-04-25T01:39:24.393362+0000","last_active":"2024-04-25T01:39:26.398051+0000","last_peered":"2024-04-25T01:39:26.398051+0000","last_clean":"2024-04-25T01:39:26.398051+0000","last_became_active":"2024-04-25T01:39:24.392836+0000","last_became_peered":"2024-04-25T01:39:24.392836+0000","last_unstale":"2024-04-25T01:39:26.398051+0000","last_undegraded":"2024-04-25T01:39:26.398051+0000","last_fullsized":"2024-04-25T01:39:26.398051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:58.871777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.388778+0000","last_change":"2024-04-25T01:39:24.406158+0000","last_active":"2024-04-25T01:39:25.388778+0000","last_peered":"2024-04-25T01:39:25.388778+0000","last_clean":"2024-04-25T01:39:25.388778+0000","last_became_active":"2024-04-25T01:39:24.405876+0000","last_became_peered":"2024-04-25T01:39:24.405876+0000","last_unstale":"2024-04-25T01:39:25.388778+0000","last_undegraded":"2024-04-25T01:39:25.388778+0000","last_fullsized":"2024-04-25T01:39:25.388778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:18:19.895651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.388709+0000","last_change":"2024-04-25T01:39:24.404047+0000","last_active":"2024-04-25T01:39:25.388709+0000","last_peered":"2024-04-25T01:39:25.388709+0000","last_clean":"2024-04-25T01:39:25.388709+0000","last_became_active":"2024-04-25T01:39:24.403700+0000","last_became_peered":"2024-04-25T01:39:24.403700+0000","last_unstale":"2024-04-25T01:39:25.388709+0000","last_undegraded":"2024-04-25T01:39:25.388709+0000","last_fullsized":"2024-04-25T01:39:25.388709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:53.123061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T01:39:24.398554+0000","last_change":"2024-04-25T01:39:24.396300+0000","last_active":"2024-04-25T01:39:24.398554+0000","last_peered":"2024-04-25T01:39:24.398554+0000","last_clean":"2024-04-25T01:39:24.398554+0000","last_became_active":"2024-04-25T01:39:24.396023+0000","last_became_peered":"2024-04-25T01:39:24.396023+0000","last_unstale":"2024-04-25T01:39:24.398554+0000","last_undegraded":"2024-04-25T01:39:24.398554+0000","last_fullsized":"2024-04-25T01:39:24.398554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:51.368646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.238969+0000","last_change":"2024-04-25T01:39:24.392021+0000","last_active":"2024-04-25T01:39:26.238969+0000","last_peered":"2024-04-25T01:39:26.238969+0000","last_clean":"2024-04-25T01:39:26.238969+0000","last_became_active":"2024-04-25T01:39:24.391352+0000","last_became_peered":"2024-04-25T01:39:24.391352+0000","last_unstale":"2024-04-25T01:39:26.238969+0000","last_undegraded":"2024-04-25T01:39:26.238969+0000","last_fullsized":"2024-04-25T01:39:26.238969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:44.434749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.358158+0000","last_change":"2024-04-25T01:39:24.389556+0000","last_active":"2024-04-25T01:39:26.358158+0000","last_peered":"2024-04-25T01:39:26.358158+0000","last_clean":"2024-04-25T01:39:26.358158+0000","last_became_active":"2024-04-25T01:39:24.389254+0000","last_became_peered":"2024-04-25T01:39:24.389254+0000","last_unstale":"2024-04-25T01:39:26.358158+0000","last_undegraded":"2024-04-25T01:39:26.358158+0000","last_fullsized":"2024-04-25T01:39:26.358158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:56.208172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.369376+0000","last_change":"2024-04-25T01:39:24.388943+0000","last_active":"2024-04-25T01:39:25.369376+0000","last_peered":"2024-04-25T01:39:25.369376+0000","last_clean":"2024-04-25T01:39:25.369376+0000","last_became_active":"2024-04-25T01:39:24.388690+0000","last_became_peered":"2024-04-25T01:39:24.388690+0000","last_unstale":"2024-04-25T01:39:25.369376+0000","last_undegraded":"2024-04-25T01:39:25.369376+0000","last_fullsized":"2024-04-25T01:39:25.369376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:42:18.260701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.302900+0000","last_change":"2024-04-25T01:39:24.399270+0000","last_active":"2024-04-25T01:39:26.302900+0000","last_peered":"2024-04-25T01:39:26.302900+0000","last_clean":"2024-04-25T01:39:26.302900+0000","last_became_active":"2024-04-25T01:39:24.399011+0000","last_became_peered":"2024-04-25T01:39:24.399011+0000","last_unstale":"2024-04-25T01:39:26.302900+0000","last_undegraded":"2024-04-25T01:39:26.302900+0000","last_fullsized":"2024-04-25T01:39:26.302900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:00.987674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.303416+0000","last_change":"2024-04-25T01:39:24.391312+0000","last_active":"2024-04-25T01:39:26.303416+0000","last_peered":"2024-04-25T01:39:26.303416+0000","last_clean":"2024-04-25T01:39:26.303416+0000","last_became_active":"2024-04-25T01:39:24.390978+0000","last_became_peered":"2024-04-25T01:39:24.390978+0000","last_unstale":"2024-04-25T01:39:26.303416+0000","last_undegraded":"2024-04-25T01:39:26.303416+0000","last_fullsized":"2024-04-25T01:39:26.303416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:38:25.637031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.370433+0000","last_change":"2024-04-25T01:39:24.395125+0000","last_active":"2024-04-25T01:39:25.370433+0000","last_peered":"2024-04-25T01:39:25.370433+0000","last_clean":"2024-04-25T01:39:25.370433+0000","last_became_active":"2024-04-25T01:39:24.392605+0000","last_became_peered":"2024-04-25T01:39:24.392605+0000","last_unstale":"2024-04-25T01:39:25.370433+0000","last_undegraded":"2024-04-25T01:39:25.370433+0000","last_fullsized":"2024-04-25T01:39:25.370433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:53.333616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397873+0000","last_change":"2024-04-25T01:39:24.380199+0000","last_active":"2024-04-25T01:39:26.397873+0000","last_peered":"2024-04-25T01:39:26.397873+0000","last_clean":"2024-04-25T01:39:26.397873+0000","last_became_active":"2024-04-25T01:39:24.379591+0000","last_became_peered":"2024-04-25T01:39:24.379591+0000","last_unstale":"2024-04-25T01:39:26.397873+0000","last_undegraded":"2024-04-25T01:39:26.397873+0000","last_fullsized":"2024-04-25T01:39:26.397873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:54.534683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.388599+0000","last_change":"2024-04-25T01:39:24.395109+0000","last_active":"2024-04-25T01:39:25.388599+0000","last_peered":"2024-04-25T01:39:25.388599+0000","last_clean":"2024-04-25T01:39:25.388599+0000","last_became_active":"2024-04-25T01:39:24.394784+0000","last_became_peered":"2024-04-25T01:39:24.394784+0000","last_unstale":"2024-04-25T01:39:25.388599+0000","last_undegraded":"2024-04-25T01:39:25.388599+0000","last_fullsized":"2024-04-25T01:39:25.388599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:44:09.102603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.358341+0000","last_change":"2024-04-25T01:39:24.388891+0000","last_active":"2024-04-25T01:39:26.358341+0000","last_peered":"2024-04-25T01:39:26.358341+0000","last_clean":"2024-04-25T01:39:26.358341+0000","last_became_active":"2024-04-25T01:39:24.388619+0000","last_became_peered":"2024-04-25T01:39:24.388619+0000","last_unstale":"2024-04-25T01:39:26.358341+0000","last_undegraded":"2024-04-25T01:39:26.358341+0000","last_fullsized":"2024-04-25T01:39:26.358341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:05.176386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.302978+0000","last_change":"2024-04-25T01:39:24.390884+0000","last_active":"2024-04-25T01:39:26.302978+0000","last_peered":"2024-04-25T01:39:26.302978+0000","last_clean":"2024-04-25T01:39:26.302978+0000","last_became_active":"2024-04-25T01:39:24.390591+0000","last_became_peered":"2024-04-25T01:39:24.390591+0000","last_unstale":"2024-04-25T01:39:26.302978+0000","last_undegraded":"2024-04-25T01:39:26.302978+0000","last_fullsized":"2024-04-25T01:39:26.302978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:51.274363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.238851+0000","last_change":"2024-04-25T01:39:24.389039+0000","last_active":"2024-04-25T01:39:26.238851+0000","last_peered":"2024-04-25T01:39:26.238851+0000","last_clean":"2024-04-25T01:39:26.238851+0000","last_became_active":"2024-04-25T01:39:24.388793+0000","last_became_peered":"2024-04-25T01:39:24.388793+0000","last_unstale":"2024-04-25T01:39:26.238851+0000","last_undegraded":"2024-04-25T01:39:26.238851+0000","last_fullsized":"2024-04-25T01:39:26.238851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:13.093550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.302926+0000","last_change":"2024-04-25T01:39:24.387093+0000","last_active":"2024-04-25T01:39:26.302926+0000","last_peered":"2024-04-25T01:39:26.302926+0000","last_clean":"2024-04-25T01:39:26.302926+0000","last_became_active":"2024-04-25T01:39:24.386809+0000","last_became_peered":"2024-04-25T01:39:24.386809+0000","last_unstale":"2024-04-25T01:39:26.302926+0000","last_undegraded":"2024-04-25T01:39:26.302926+0000","last_fullsized":"2024-04-25T01:39:26.302926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:46:05.313828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.238893+0000","last_change":"2024-04-25T01:39:24.390352+0000","last_active":"2024-04-25T01:39:26.238893+0000","last_peered":"2024-04-25T01:39:26.238893+0000","last_clean":"2024-04-25T01:39:26.238893+0000","last_became_active":"2024-04-25T01:39:24.389809+0000","last_became_peered":"2024-04-25T01:39:24.389809+0000","last_unstale":"2024-04-25T01:39:26.238893+0000","last_undegraded":"2024-04-25T01:39:26.238893+0000","last_fullsized":"2024-04-25T01:39:26.238893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:22:44.221898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.388789+0000","last_change":"2024-04-25T01:39:24.398614+0000","last_active":"2024-04-25T01:39:25.388789+0000","last_peered":"2024-04-25T01:39:25.388789+0000","last_clean":"2024-04-25T01:39:25.388789+0000","last_became_active":"2024-04-25T01:39:24.398299+0000","last_became_peered":"2024-04-25T01:39:24.398299+0000","last_unstale":"2024-04-25T01:39:25.388789+0000","last_undegraded":"2024-04-25T01:39:25.388789+0000","last_fullsized":"2024-04-25T01:39:25.388789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:54:51.191225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.369543+0000","last_change":"2024-04-25T01:39:24.374082+0000","last_active":"2024-04-25T01:39:25.369543+0000","last_peered":"2024-04-25T01:39:25.369543+0000","last_clean":"2024-04-25T01:39:25.369543+0000","last_became_active":"2024-04-25T01:39:24.373731+0000","last_became_peered":"2024-04-25T01:39:24.373731+0000","last_unstale":"2024-04-25T01:39:25.369543+0000","last_undegraded":"2024-04-25T01:39:25.369543+0000","last_fullsized":"2024-04-25T01:39:25.369543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:45.817483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.239054+0000","last_change":"2024-04-25T01:39:24.389645+0000","last_active":"2024-04-25T01:39:26.239054+0000","last_peered":"2024-04-25T01:39:26.239054+0000","last_clean":"2024-04-25T01:39:26.239054+0000","last_became_active":"2024-04-25T01:39:24.389375+0000","last_became_peered":"2024-04-25T01:39:24.389375+0000","last_unstale":"2024-04-25T01:39:26.239054+0000","last_undegraded":"2024-04-25T01:39:26.239054+0000","last_fullsized":"2024-04-25T01:39:26.239054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:13:12.753893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.358439+0000","last_change":"2024-04-25T01:39:24.390631+0000","last_active":"2024-04-25T01:39:26.358439+0000","last_peered":"2024-04-25T01:39:26.358439+0000","last_clean":"2024-04-25T01:39:26.358439+0000","last_became_active":"2024-04-25T01:39:24.390363+0000","last_became_peered":"2024-04-25T01:39:24.390363+0000","last_unstale":"2024-04-25T01:39:26.358439+0000","last_undegraded":"2024-04-25T01:39:26.358439+0000","last_fullsized":"2024-04-25T01:39:26.358439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:48.830416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.303283+0000","last_change":"2024-04-25T01:39:24.399738+0000","last_active":"2024-04-25T01:39:26.303283+0000","last_peered":"2024-04-25T01:39:26.303283+0000","last_clean":"2024-04-25T01:39:26.303283+0000","last_became_active":"2024-04-25T01:39:24.399499+0000","last_became_peered":"2024-04-25T01:39:24.399499+0000","last_unstale":"2024-04-25T01:39:26.303283+0000","last_undegraded":"2024-04-25T01:39:26.303283+0000","last_fullsized":"2024-04-25T01:39:26.303283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:58.646669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.370293+0000","last_change":"2024-04-25T01:39:24.390981+0000","last_active":"2024-04-25T01:39:25.370293+0000","last_peered":"2024-04-25T01:39:25.370293+0000","last_clean":"2024-04-25T01:39:25.370293+0000","last_became_active":"2024-04-25T01:39:24.390716+0000","last_became_peered":"2024-04-25T01:39:24.390716+0000","last_unstale":"2024-04-25T01:39:25.370293+0000","last_undegraded":"2024-04-25T01:39:25.370293+0000","last_fullsized":"2024-04-25T01:39:25.370293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:08.458504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.388482+0000","last_change":"2024-04-25T01:39:24.395618+0000","last_active":"2024-04-25T01:39:25.388482+0000","last_peered":"2024-04-25T01:39:25.388482+0000","last_clean":"2024-04-25T01:39:25.388482+0000","last_became_active":"2024-04-25T01:39:24.394816+0000","last_became_peered":"2024-04-25T01:39:24.394816+0000","last_unstale":"2024-04-25T01:39:25.388482+0000","last_undegraded":"2024-04-25T01:39:25.388482+0000","last_fullsized":"2024-04-25T01:39:25.388482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:01.025135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T01:39:24.397577+0000","last_change":"2024-04-25T01:39:24.388083+0000","last_active":"2024-04-25T01:39:24.397577+0000","last_peered":"2024-04-25T01:39:24.397577+0000","last_clean":"2024-04-25T01:39:24.397577+0000","last_became_active":"2024-04-25T01:39:24.387789+0000","last_became_peered":"2024-04-25T01:39:24.387789+0000","last_unstale":"2024-04-25T01:39:24.397577+0000","last_undegraded":"2024-04-25T01:39:24.397577+0000","last_fullsized":"2024-04-25T01:39:24.397577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:59:57.402340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.239028+0000","last_change":"2024-04-25T01:39:23.371716+0000","last_active":"2024-04-25T01:39:26.239028+0000","last_peered":"2024-04-25T01:39:26.239028+0000","last_clean":"2024-04-25T01:39:26.239028+0000","last_became_active":"2024-04-25T01:39:23.371475+0000","last_became_peered":"2024-04-25T01:39:23.371475+0000","last_unstale":"2024-04-25T01:39:26.239028+0000","last_undegraded":"2024-04-25T01:39:26.239028+0000","last_fullsized":"2024-04-25T01:39:26.239028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:10.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.358538+0000","last_change":"2024-04-25T01:39:24.388095+0000","last_active":"2024-04-25T01:39:26.358538+0000","last_peered":"2024-04-25T01:39:26.358538+0000","last_clean":"2024-04-25T01:39:26.358538+0000","last_became_active":"2024-04-25T01:39:24.387797+0000","last_became_peered":"2024-04-25T01:39:24.387797+0000","last_unstale":"2024-04-25T01:39:26.358538+0000","last_undegraded":"2024-04-25T01:39:26.358538+0000","last_fullsized":"2024-04-25T01:39:26.358538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:43:16.385957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.388457+0000","last_change":"2024-04-25T01:39:23.372975+0000","last_active":"2024-04-25T01:39:25.388457+0000","last_peered":"2024-04-25T01:39:25.388457+0000","last_clean":"2024-04-25T01:39:25.388457+0000","last_became_active":"2024-04-25T01:39:23.372688+0000","last_became_peered":"2024-04-25T01:39:23.372688+0000","last_unstale":"2024-04-25T01:39:25.388457+0000","last_undegraded":"2024-04-25T01:39:25.388457+0000","last_fullsized":"2024-04-25T01:39:25.388457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:42:57.195844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.238686+0000","last_change":"2024-04-25T01:39:23.377487+0000","last_active":"2024-04-25T01:39:26.238686+0000","last_peered":"2024-04-25T01:39:26.238686+0000","last_clean":"2024-04-25T01:39:26.238686+0000","last_became_active":"2024-04-25T01:39:23.377181+0000","last_became_peered":"2024-04-25T01:39:23.377181+0000","last_unstale":"2024-04-25T01:39:26.238686+0000","last_undegraded":"2024-04-25T01:39:26.238686+0000","last_fullsized":"2024-04-25T01:39:26.238686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:17.434141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.238661+0000","last_change":"2024-04-25T01:39:24.387708+0000","last_active":"2024-04-25T01:39:26.238661+0000","last_peered":"2024-04-25T01:39:26.238661+0000","last_clean":"2024-04-25T01:39:26.238661+0000","last_became_active":"2024-04-25T01:39:24.387433+0000","last_became_peered":"2024-04-25T01:39:24.387433+0000","last_unstale":"2024-04-25T01:39:26.238661+0000","last_undegraded":"2024-04-25T01:39:26.238661+0000","last_fullsized":"2024-04-25T01:39:26.238661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:34.312066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.303066+0000","last_change":"2024-04-25T01:39:23.369998+0000","last_active":"2024-04-25T01:39:26.303066+0000","last_peered":"2024-04-25T01:39:26.303066+0000","last_clean":"2024-04-25T01:39:26.303066+0000","last_became_active":"2024-04-25T01:39:23.369710+0000","last_became_peered":"2024-04-25T01:39:23.369710+0000","last_unstale":"2024-04-25T01:39:26.303066+0000","last_undegraded":"2024-04-25T01:39:26.303066+0000","last_fullsized":"2024-04-25T01:39:26.303066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:32:34.329452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.369342+0000","last_change":"2024-04-25T01:39:24.375457+0000","last_active":"2024-04-25T01:39:25.369342+0000","last_peered":"2024-04-25T01:39:25.369342+0000","last_clean":"2024-04-25T01:39:25.369342+0000","last_became_active":"2024-04-25T01:39:24.375178+0000","last_became_peered":"2024-04-25T01:39:24.375178+0000","last_unstale":"2024-04-25T01:39:25.369342+0000","last_undegraded":"2024-04-25T01:39:25.369342+0000","last_fullsized":"2024-04-25T01:39:25.369342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:58:15.640882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.388698+0000","last_change":"2024-04-25T01:39:23.377236+0000","last_active":"2024-04-25T01:39:25.388698+0000","last_peered":"2024-04-25T01:39:25.388698+0000","last_clean":"2024-04-25T01:39:25.388698+0000","last_became_active":"2024-04-25T01:39:23.376727+0000","last_became_peered":"2024-04-25T01:39:23.376727+0000","last_unstale":"2024-04-25T01:39:25.388698+0000","last_undegraded":"2024-04-25T01:39:25.388698+0000","last_fullsized":"2024-04-25T01:39:25.388698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:08.103707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.303209+0000","last_change":"2024-04-25T01:39:24.392642+0000","last_active":"2024-04-25T01:39:26.303209+0000","last_peered":"2024-04-25T01:39:26.303209+0000","last_clean":"2024-04-25T01:39:26.303209+0000","last_became_active":"2024-04-25T01:39:24.391605+0000","last_became_peered":"2024-04-25T01:39:24.391605+0000","last_unstale":"2024-04-25T01:39:26.303209+0000","last_undegraded":"2024-04-25T01:39:26.303209+0000","last_fullsized":"2024-04-25T01:39:26.303209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:01:23.217074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.303157+0000","last_change":"2024-04-25T01:39:23.378968+0000","last_active":"2024-04-25T01:39:26.303157+0000","last_peered":"2024-04-25T01:39:26.303157+0000","last_clean":"2024-04-25T01:39:26.303157+0000","last_became_active":"2024-04-25T01:39:23.378635+0000","last_became_peered":"2024-04-25T01:39:23.378635+0000","last_unstale":"2024-04-25T01:39:26.303157+0000","last_undegraded":"2024-04-25T01:39:26.303157+0000","last_fullsized":"2024-04-25T01:39:26.303157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:39.780544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.358448+0000","last_change":"2024-04-25T01:39:24.403875+0000","last_active":"2024-04-25T01:39:26.358448+0000","last_peered":"2024-04-25T01:39:26.358448+0000","last_clean":"2024-04-25T01:39:26.358448+0000","last_became_active":"2024-04-25T01:39:24.403591+0000","last_became_peered":"2024-04-25T01:39:24.403591+0000","last_unstale":"2024-04-25T01:39:26.358448+0000","last_undegraded":"2024-04-25T01:39:26.358448+0000","last_fullsized":"2024-04-25T01:39:26.358448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:45.276173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.369532+0000","last_change":"2024-04-25T01:39:23.369043+0000","last_active":"2024-04-25T01:39:25.369532+0000","last_peered":"2024-04-25T01:39:25.369532+0000","last_clean":"2024-04-25T01:39:25.369532+0000","last_became_active":"2024-04-25T01:39:23.368778+0000","last_became_peered":"2024-04-25T01:39:23.368778+0000","last_unstale":"2024-04-25T01:39:25.369532+0000","last_undegraded":"2024-04-25T01:39:25.369532+0000","last_fullsized":"2024-04-25T01:39:25.369532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:59.501724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T01:39:24.398534+0000","last_change":"2024-04-25T01:39:24.391245+0000","last_active":"2024-04-25T01:39:24.398534+0000","last_peered":"2024-04-25T01:39:24.398534+0000","last_clean":"2024-04-25T01:39:24.398534+0000","last_became_active":"2024-04-25T01:39:24.390941+0000","last_became_peered":"2024-04-25T01:39:24.390941+0000","last_unstale":"2024-04-25T01:39:24.398534+0000","last_undegraded":"2024-04-25T01:39:24.398534+0000","last_fullsized":"2024-04-25T01:39:24.398534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:25.663630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.388577+0000","last_change":"2024-04-25T01:39:23.373295+0000","last_active":"2024-04-25T01:39:25.388577+0000","last_peered":"2024-04-25T01:39:25.388577+0000","last_clean":"2024-04-25T01:39:25.388577+0000","last_became_active":"2024-04-25T01:39:23.372984+0000","last_became_peered":"2024-04-25T01:39:23.372984+0000","last_unstale":"2024-04-25T01:39:25.388577+0000","last_undegraded":"2024-04-25T01:39:25.388577+0000","last_fullsized":"2024-04-25T01:39:25.388577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:10.854190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397751+0000","last_change":"2024-04-25T01:39:24.380617+0000","last_active":"2024-04-25T01:39:26.397751+0000","last_peered":"2024-04-25T01:39:26.397751+0000","last_clean":"2024-04-25T01:39:26.397751+0000","last_became_active":"2024-04-25T01:39:24.380330+0000","last_became_peered":"2024-04-25T01:39:24.380330+0000","last_unstale":"2024-04-25T01:39:26.397751+0000","last_undegraded":"2024-04-25T01:39:26.397751+0000","last_fullsized":"2024-04-25T01:39:26.397751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:24.010569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.358516+0000","last_change":"2024-04-25T01:39:23.372903+0000","last_active":"2024-04-25T01:39:26.358516+0000","last_peered":"2024-04-25T01:39:26.358516+0000","last_clean":"2024-04-25T01:39:26.358516+0000","last_became_active":"2024-04-25T01:39:23.372617+0000","last_became_peered":"2024-04-25T01:39:23.372617+0000","last_unstale":"2024-04-25T01:39:26.358516+0000","last_undegraded":"2024-04-25T01:39:26.358516+0000","last_fullsized":"2024-04-25T01:39:26.358516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:54:58.506432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.358303+0000","last_change":"2024-04-25T01:39:24.388852+0000","last_active":"2024-04-25T01:39:26.358303+0000","last_peered":"2024-04-25T01:39:26.358303+0000","last_clean":"2024-04-25T01:39:26.358303+0000","last_became_active":"2024-04-25T01:39:24.388594+0000","last_became_peered":"2024-04-25T01:39:24.388594+0000","last_unstale":"2024-04-25T01:39:26.358303+0000","last_undegraded":"2024-04-25T01:39:26.358303+0000","last_fullsized":"2024-04-25T01:39:26.358303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:46:49.718182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.303329+0000","last_change":"2024-04-25T01:39:23.369440+0000","last_active":"2024-04-25T01:39:26.303329+0000","last_peered":"2024-04-25T01:39:26.303329+0000","last_clean":"2024-04-25T01:39:26.303329+0000","last_became_active":"2024-04-25T01:39:23.369151+0000","last_became_peered":"2024-04-25T01:39:23.369151+0000","last_unstale":"2024-04-25T01:39:26.303329+0000","last_undegraded":"2024-04-25T01:39:26.303329+0000","last_fullsized":"2024-04-25T01:39:26.303329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:31:46.921287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397671+0000","last_change":"2024-04-25T01:39:24.390114+0000","last_active":"2024-04-25T01:39:26.397671+0000","last_peered":"2024-04-25T01:39:26.397671+0000","last_clean":"2024-04-25T01:39:26.397671+0000","last_became_active":"2024-04-25T01:39:24.389841+0000","last_became_peered":"2024-04-25T01:39:24.389841+0000","last_unstale":"2024-04-25T01:39:26.397671+0000","last_undegraded":"2024-04-25T01:39:26.397671+0000","last_fullsized":"2024-04-25T01:39:26.397671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:34.950624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.388434+0000","last_change":"2024-04-25T01:39:23.372939+0000","last_active":"2024-04-25T01:39:25.388434+0000","last_peered":"2024-04-25T01:39:25.388434+0000","last_clean":"2024-04-25T01:39:25.388434+0000","last_became_active":"2024-04-25T01:39:23.372648+0000","last_became_peered":"2024-04-25T01:39:23.372648+0000","last_unstale":"2024-04-25T01:39:25.388434+0000","last_undegraded":"2024-04-25T01:39:25.388434+0000","last_fullsized":"2024-04-25T01:39:25.388434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:02:13.283096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.388482+0000","last_change":"2024-04-25T01:39:24.394248+0000","last_active":"2024-04-25T01:39:25.388482+0000","last_peered":"2024-04-25T01:39:25.388482+0000","last_clean":"2024-04-25T01:39:25.388482+0000","last_became_active":"2024-04-25T01:39:24.393958+0000","last_became_peered":"2024-04-25T01:39:24.393958+0000","last_unstale":"2024-04-25T01:39:25.388482+0000","last_undegraded":"2024-04-25T01:39:25.388482+0000","last_fullsized":"2024-04-25T01:39:25.388482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:35.087577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.370219+0000","last_change":"2024-04-25T01:39:23.373599+0000","last_active":"2024-04-25T01:39:25.370219+0000","last_peered":"2024-04-25T01:39:25.370219+0000","last_clean":"2024-04-25T01:39:25.370219+0000","last_became_active":"2024-04-25T01:39:23.373281+0000","last_became_peered":"2024-04-25T01:39:23.373281+0000","last_unstale":"2024-04-25T01:39:25.370219+0000","last_undegraded":"2024-04-25T01:39:25.370219+0000","last_fullsized":"2024-04-25T01:39:25.370219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:40.850925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397519+0000","last_change":"2024-04-25T01:39:24.389946+0000","last_active":"2024-04-25T01:39:26.397519+0000","last_peered":"2024-04-25T01:39:26.397519+0000","last_clean":"2024-04-25T01:39:26.397519+0000","last_became_active":"2024-04-25T01:39:24.389656+0000","last_became_peered":"2024-04-25T01:39:24.389656+0000","last_unstale":"2024-04-25T01:39:26.397519+0000","last_undegraded":"2024-04-25T01:39:26.397519+0000","last_fullsized":"2024-04-25T01:39:26.397519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:55.943639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T01:39:24.398465+0000","last_change":"2024-04-25T01:39:23.367322+0000","last_active":"2024-04-25T01:39:24.398465+0000","last_peered":"2024-04-25T01:39:24.398465+0000","last_clean":"2024-04-25T01:39:24.398465+0000","last_became_active":"2024-04-25T01:39:23.367054+0000","last_became_peered":"2024-04-25T01:39:23.367054+0000","last_unstale":"2024-04-25T01:39:24.398465+0000","last_undegraded":"2024-04-25T01:39:24.398465+0000","last_fullsized":"2024-04-25T01:39:24.398465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:10.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397884+0000","last_change":"2024-04-25T01:39:24.391240+0000","last_active":"2024-04-25T01:39:26.397884+0000","last_peered":"2024-04-25T01:39:26.397884+0000","last_clean":"2024-04-25T01:39:26.397884+0000","last_became_active":"2024-04-25T01:39:24.390948+0000","last_became_peered":"2024-04-25T01:39:24.390948+0000","last_unstale":"2024-04-25T01:39:26.397884+0000","last_undegraded":"2024-04-25T01:39:26.397884+0000","last_fullsized":"2024-04-25T01:39:26.397884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:41:30.579190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.370373+0000","last_change":"2024-04-25T01:39:23.369872+0000","last_active":"2024-04-25T01:39:25.370373+0000","last_peered":"2024-04-25T01:39:25.370373+0000","last_clean":"2024-04-25T01:39:25.370373+0000","last_became_active":"2024-04-25T01:39:23.369314+0000","last_became_peered":"2024-04-25T01:39:23.369314+0000","last_unstale":"2024-04-25T01:39:25.370373+0000","last_undegraded":"2024-04-25T01:39:25.370373+0000","last_fullsized":"2024-04-25T01:39:25.370373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:14.571148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.398130+0000","last_change":"2024-04-25T01:39:24.392170+0000","last_active":"2024-04-25T01:39:26.398130+0000","last_peered":"2024-04-25T01:39:26.398130+0000","last_clean":"2024-04-25T01:39:26.398130+0000","last_became_active":"2024-04-25T01:39:24.391811+0000","last_became_peered":"2024-04-25T01:39:24.391811+0000","last_unstale":"2024-04-25T01:39:26.398130+0000","last_undegraded":"2024-04-25T01:39:26.398130+0000","last_fullsized":"2024-04-25T01:39:26.398130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:32.859676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.369634+0000","last_change":"2024-04-25T01:39:23.370690+0000","last_active":"2024-04-25T01:39:25.369634+0000","last_peered":"2024-04-25T01:39:25.369634+0000","last_clean":"2024-04-25T01:39:25.369634+0000","last_became_active":"2024-04-25T01:39:23.370391+0000","last_became_peered":"2024-04-25T01:39:23.370391+0000","last_unstale":"2024-04-25T01:39:25.369634+0000","last_undegraded":"2024-04-25T01:39:25.369634+0000","last_fullsized":"2024-04-25T01:39:25.369634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:29.647636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.303157+0000","last_change":"2024-04-25T01:39:24.394286+0000","last_active":"2024-04-25T01:39:26.303157+0000","last_peered":"2024-04-25T01:39:26.303157+0000","last_clean":"2024-04-25T01:39:26.303157+0000","last_became_active":"2024-04-25T01:39:24.393558+0000","last_became_peered":"2024-04-25T01:39:24.393558+0000","last_unstale":"2024-04-25T01:39:26.303157+0000","last_undegraded":"2024-04-25T01:39:26.303157+0000","last_fullsized":"2024-04-25T01:39:26.303157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:59.100947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.370302+0000","last_change":"2024-04-25T01:39:23.368352+0000","last_active":"2024-04-25T01:39:25.370302+0000","last_peered":"2024-04-25T01:39:25.370302+0000","last_clean":"2024-04-25T01:39:25.370302+0000","last_became_active":"2024-04-25T01:39:23.368075+0000","last_became_peered":"2024-04-25T01:39:23.368075+0000","last_unstale":"2024-04-25T01:39:25.370302+0000","last_undegraded":"2024-04-25T01:39:25.370302+0000","last_fullsized":"2024-04-25T01:39:25.370302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:11.300091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397687+0000","last_change":"2024-04-25T01:39:24.394350+0000","last_active":"2024-04-25T01:39:26.397687+0000","last_peered":"2024-04-25T01:39:26.397687+0000","last_clean":"2024-04-25T01:39:26.397687+0000","last_became_active":"2024-04-25T01:39:24.393235+0000","last_became_peered":"2024-04-25T01:39:24.393235+0000","last_unstale":"2024-04-25T01:39:26.397687+0000","last_undegraded":"2024-04-25T01:39:26.397687+0000","last_fullsized":"2024-04-25T01:39:26.397687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:00:48.588700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397327+0000","last_change":"2024-04-25T01:39:12.918495+0000","last_active":"2024-04-25T01:39:26.397327+0000","last_peered":"2024-04-25T01:39:26.397327+0000","last_clean":"2024-04-25T01:39:26.397327+0000","last_became_active":"2024-04-25T01:39:12.917330+0000","last_became_peered":"2024-04-25T01:39:12.917330+0000","last_unstale":"2024-04-25T01:39:26.397327+0000","last_undegraded":"2024-04-25T01:39:26.397327+0000","last_fullsized":"2024-04-25T01:39:26.397327+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:11.731178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:11.731178+0000","last_clean_scrub_stamp":"2024-04-25T01:39:11.731178+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:26:14.153244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.302850+0000","last_change":"2024-04-25T01:39:23.367826+0000","last_active":"2024-04-25T01:39:26.302850+0000","last_peered":"2024-04-25T01:39:26.302850+0000","last_clean":"2024-04-25T01:39:26.302850+0000","last_became_active":"2024-04-25T01:39:23.367520+0000","last_became_peered":"2024-04-25T01:39:23.367520+0000","last_unstale":"2024-04-25T01:39:26.302850+0000","last_undegraded":"2024-04-25T01:39:26.302850+0000","last_fullsized":"2024-04-25T01:39:26.302850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:05.997166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.238835+0000","last_change":"2024-04-25T01:39:24.401208+0000","last_active":"2024-04-25T01:39:26.238835+0000","last_peered":"2024-04-25T01:39:26.238835+0000","last_clean":"2024-04-25T01:39:26.238835+0000","last_became_active":"2024-04-25T01:39:24.400502+0000","last_became_peered":"2024-04-25T01:39:24.400502+0000","last_unstale":"2024-04-25T01:39:26.238835+0000","last_undegraded":"2024-04-25T01:39:26.238835+0000","last_fullsized":"2024-04-25T01:39:26.238835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:55:09.076617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397257+0000","last_change":"2024-04-25T01:39:23.379767+0000","last_active":"2024-04-25T01:39:26.397257+0000","last_peered":"2024-04-25T01:39:26.397257+0000","last_clean":"2024-04-25T01:39:26.397257+0000","last_became_active":"2024-04-25T01:39:23.379294+0000","last_became_peered":"2024-04-25T01:39:23.379294+0000","last_unstale":"2024-04-25T01:39:26.397257+0000","last_undegraded":"2024-04-25T01:39:26.397257+0000","last_fullsized":"2024-04-25T01:39:26.397257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:36:37.823796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.358155+0000","last_change":"2024-04-25T01:39:24.391366+0000","last_active":"2024-04-25T01:39:26.358155+0000","last_peered":"2024-04-25T01:39:26.358155+0000","last_clean":"2024-04-25T01:39:26.358155+0000","last_became_active":"2024-04-25T01:39:24.391093+0000","last_became_peered":"2024-04-25T01:39:24.391093+0000","last_unstale":"2024-04-25T01:39:26.358155+0000","last_undegraded":"2024-04-25T01:39:26.358155+0000","last_fullsized":"2024-04-25T01:39:26.358155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:10.906935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.370384+0000","last_change":"2024-04-25T01:39:23.371019+0000","last_active":"2024-04-25T01:39:25.370384+0000","last_peered":"2024-04-25T01:39:25.370384+0000","last_clean":"2024-04-25T01:39:25.370384+0000","last_became_active":"2024-04-25T01:39:23.370727+0000","last_became_peered":"2024-04-25T01:39:23.370727+0000","last_unstale":"2024-04-25T01:39:25.370384+0000","last_undegraded":"2024-04-25T01:39:25.370384+0000","last_fullsized":"2024-04-25T01:39:25.370384+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:10.714475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.369392+0000","last_change":"2024-04-25T01:39:24.377438+0000","last_active":"2024-04-25T01:39:25.369392+0000","last_peered":"2024-04-25T01:39:25.369392+0000","last_clean":"2024-04-25T01:39:25.369392+0000","last_became_active":"2024-04-25T01:39:24.377146+0000","last_became_peered":"2024-04-25T01:39:24.377146+0000","last_unstale":"2024-04-25T01:39:25.369392+0000","last_undegraded":"2024-04-25T01:39:25.369392+0000","last_fullsized":"2024-04-25T01:39:25.369392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:54:17.698561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.303417+0000","last_change":"2024-04-25T01:39:23.375729+0000","last_active":"2024-04-25T01:39:26.303417+0000","last_peered":"2024-04-25T01:39:26.303417+0000","last_clean":"2024-04-25T01:39:26.303417+0000","last_became_active":"2024-04-25T01:39:23.375488+0000","last_became_peered":"2024-04-25T01:39:23.375488+0000","last_unstale":"2024-04-25T01:39:26.303417+0000","last_undegraded":"2024-04-25T01:39:26.303417+0000","last_fullsized":"2024-04-25T01:39:26.303417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:00.039083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T01:39:24.397536+0000","last_change":"2024-04-25T01:39:24.389203+0000","last_active":"2024-04-25T01:39:24.397536+0000","last_peered":"2024-04-25T01:39:24.397536+0000","last_clean":"2024-04-25T01:39:24.397536+0000","last_became_active":"2024-04-25T01:39:24.388306+0000","last_became_peered":"2024-04-25T01:39:24.388306+0000","last_unstale":"2024-04-25T01:39:24.397536+0000","last_undegraded":"2024-04-25T01:39:24.397536+0000","last_fullsized":"2024-04-25T01:39:24.397536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:42:22.454935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.369622+0000","last_change":"2024-04-25T01:39:23.368562+0000","last_active":"2024-04-25T01:39:25.369622+0000","last_peered":"2024-04-25T01:39:25.369622+0000","last_clean":"2024-04-25T01:39:25.369622+0000","last_became_active":"2024-04-25T01:39:23.368272+0000","last_became_peered":"2024-04-25T01:39:23.368272+0000","last_unstale":"2024-04-25T01:39:25.369622+0000","last_undegraded":"2024-04-25T01:39:25.369622+0000","last_fullsized":"2024-04-25T01:39:25.369622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:15.464993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.303444+0000","last_change":"2024-04-25T01:39:24.390844+0000","last_active":"2024-04-25T01:39:26.303444+0000","last_peered":"2024-04-25T01:39:26.303444+0000","last_clean":"2024-04-25T01:39:26.303444+0000","last_became_active":"2024-04-25T01:39:24.390543+0000","last_became_peered":"2024-04-25T01:39:24.390543+0000","last_unstale":"2024-04-25T01:39:26.303444+0000","last_undegraded":"2024-04-25T01:39:26.303444+0000","last_fullsized":"2024-04-25T01:39:26.303444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:01:03.804058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397955+0000","last_change":"2024-04-25T01:39:23.378190+0000","last_active":"2024-04-25T01:39:26.397955+0000","last_peered":"2024-04-25T01:39:26.397955+0000","last_clean":"2024-04-25T01:39:26.397955+0000","last_became_active":"2024-04-25T01:39:23.377677+0000","last_became_peered":"2024-04-25T01:39:23.377677+0000","last_unstale":"2024-04-25T01:39:26.397955+0000","last_undegraded":"2024-04-25T01:39:26.397955+0000","last_fullsized":"2024-04-25T01:39:26.397955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:09.516058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.369529+0000","last_change":"2024-04-25T01:39:24.376933+0000","last_active":"2024-04-25T01:39:25.369529+0000","last_peered":"2024-04-25T01:39:25.369529+0000","last_clean":"2024-04-25T01:39:25.369529+0000","last_became_active":"2024-04-25T01:39:24.376612+0000","last_became_peered":"2024-04-25T01:39:24.376612+0000","last_unstale":"2024-04-25T01:39:25.369529+0000","last_undegraded":"2024-04-25T01:39:25.369529+0000","last_fullsized":"2024-04-25T01:39:25.369529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:56:55.534200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.388085+0000","last_change":"2024-04-25T01:39:23.377687+0000","last_active":"2024-04-25T01:39:25.388085+0000","last_peered":"2024-04-25T01:39:25.388085+0000","last_clean":"2024-04-25T01:39:25.388085+0000","last_became_active":"2024-04-25T01:39:23.377372+0000","last_became_peered":"2024-04-25T01:39:23.377372+0000","last_unstale":"2024-04-25T01:39:25.388085+0000","last_undegraded":"2024-04-25T01:39:25.388085+0000","last_fullsized":"2024-04-25T01:39:25.388085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:51.983659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.238884+0000","last_change":"2024-04-25T01:39:24.375811+0000","last_active":"2024-04-25T01:39:26.238884+0000","last_peered":"2024-04-25T01:39:26.238884+0000","last_clean":"2024-04-25T01:39:26.238884+0000","last_became_active":"2024-04-25T01:39:24.375603+0000","last_became_peered":"2024-04-25T01:39:24.375603+0000","last_unstale":"2024-04-25T01:39:26.238884+0000","last_undegraded":"2024-04-25T01:39:26.238884+0000","last_fullsized":"2024-04-25T01:39:26.238884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:10:26.247501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.388716+0000","last_change":"2024-04-25T01:39:23.379804+0000","last_active":"2024-04-25T01:39:25.388716+0000","last_peered":"2024-04-25T01:39:25.388716+0000","last_clean":"2024-04-25T01:39:25.388716+0000","last_became_active":"2024-04-25T01:39:23.379430+0000","last_became_peered":"2024-04-25T01:39:23.379430+0000","last_unstale":"2024-04-25T01:39:25.388716+0000","last_undegraded":"2024-04-25T01:39:25.388716+0000","last_fullsized":"2024-04-25T01:39:25.388716+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:42:23.254767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.358360+0000","last_change":"2024-04-25T01:39:24.393003+0000","last_active":"2024-04-25T01:39:26.358360+0000","last_peered":"2024-04-25T01:39:26.358360+0000","last_clean":"2024-04-25T01:39:26.358360+0000","last_became_active":"2024-04-25T01:39:24.392209+0000","last_became_peered":"2024-04-25T01:39:24.392209+0000","last_unstale":"2024-04-25T01:39:26.358360+0000","last_undegraded":"2024-04-25T01:39:26.358360+0000","last_fullsized":"2024-04-25T01:39:26.358360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:44:58.432859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397277+0000","last_change":"2024-04-25T01:39:23.378993+0000","last_active":"2024-04-25T01:39:26.397277+0000","last_peered":"2024-04-25T01:39:26.397277+0000","last_clean":"2024-04-25T01:39:26.397277+0000","last_became_active":"2024-04-25T01:39:23.376908+0000","last_became_peered":"2024-04-25T01:39:23.376908+0000","last_unstale":"2024-04-25T01:39:26.397277+0000","last_undegraded":"2024-04-25T01:39:26.397277+0000","last_fullsized":"2024-04-25T01:39:26.397277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:13:18.370559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T01:39:24.397677+0000","last_change":"2024-04-25T01:39:24.386969+0000","last_active":"2024-04-25T01:39:24.397677+0000","last_peered":"2024-04-25T01:39:24.397677+0000","last_clean":"2024-04-25T01:39:24.397677+0000","last_became_active":"2024-04-25T01:39:24.386376+0000","last_became_peered":"2024-04-25T01:39:24.386376+0000","last_unstale":"2024-04-25T01:39:24.397677+0000","last_undegraded":"2024-04-25T01:39:24.397677+0000","last_fullsized":"2024-04-25T01:39:24.397677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:13.392320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.369404+0000","last_change":"2024-04-25T01:39:23.377103+0000","last_active":"2024-04-25T01:39:25.369404+0000","last_peered":"2024-04-25T01:39:25.369404+0000","last_clean":"2024-04-25T01:39:25.369404+0000","last_became_active":"2024-04-25T01:39:23.376826+0000","last_became_peered":"2024-04-25T01:39:23.376826+0000","last_unstale":"2024-04-25T01:39:25.369404+0000","last_undegraded":"2024-04-25T01:39:25.369404+0000","last_fullsized":"2024-04-25T01:39:25.369404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:46.663754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.238781+0000","last_change":"2024-04-25T01:39:24.373600+0000","last_active":"2024-04-25T01:39:26.238781+0000","last_peered":"2024-04-25T01:39:26.238781+0000","last_clean":"2024-04-25T01:39:26.238781+0000","last_became_active":"2024-04-25T01:39:24.373311+0000","last_became_peered":"2024-04-25T01:39:24.373311+0000","last_unstale":"2024-04-25T01:39:26.238781+0000","last_undegraded":"2024-04-25T01:39:26.238781+0000","last_fullsized":"2024-04-25T01:39:26.238781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:46.338959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.369528+0000","last_change":"2024-04-25T01:39:23.368446+0000","last_active":"2024-04-25T01:39:25.369528+0000","last_peered":"2024-04-25T01:39:25.369528+0000","last_clean":"2024-04-25T01:39:25.369528+0000","last_became_active":"2024-04-25T01:39:23.368183+0000","last_became_peered":"2024-04-25T01:39:23.368183+0000","last_unstale":"2024-04-25T01:39:25.369528+0000","last_undegraded":"2024-04-25T01:39:25.369528+0000","last_fullsized":"2024-04-25T01:39:25.369528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:13.738756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.239054+0000","last_change":"2024-04-25T01:39:24.387100+0000","last_active":"2024-04-25T01:39:26.239054+0000","last_peered":"2024-04-25T01:39:26.239054+0000","last_clean":"2024-04-25T01:39:26.239054+0000","last_became_active":"2024-04-25T01:39:24.386782+0000","last_became_peered":"2024-04-25T01:39:24.386782+0000","last_unstale":"2024-04-25T01:39:26.239054+0000","last_undegraded":"2024-04-25T01:39:26.239054+0000","last_fullsized":"2024-04-25T01:39:26.239054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:48.789139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397769+0000","last_change":"2024-04-25T01:39:23.377717+0000","last_active":"2024-04-25T01:39:26.397769+0000","last_peered":"2024-04-25T01:39:26.397769+0000","last_clean":"2024-04-25T01:39:26.397769+0000","last_became_active":"2024-04-25T01:39:23.377291+0000","last_became_peered":"2024-04-25T01:39:23.377291+0000","last_unstale":"2024-04-25T01:39:26.397769+0000","last_undegraded":"2024-04-25T01:39:26.397769+0000","last_fullsized":"2024-04-25T01:39:26.397769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:06.402745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.388528+0000","last_change":"2024-04-25T01:39:24.398859+0000","last_active":"2024-04-25T01:39:25.388528+0000","last_peered":"2024-04-25T01:39:25.388528+0000","last_clean":"2024-04-25T01:39:25.388528+0000","last_became_active":"2024-04-25T01:39:24.398618+0000","last_became_peered":"2024-04-25T01:39:24.398618+0000","last_unstale":"2024-04-25T01:39:25.388528+0000","last_undegraded":"2024-04-25T01:39:25.388528+0000","last_fullsized":"2024-04-25T01:39:25.388528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:15.278376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.303351+0000","last_change":"2024-04-25T01:39:24.393293+0000","last_active":"2024-04-25T01:39:26.303351+0000","last_peered":"2024-04-25T01:39:26.303351+0000","last_clean":"2024-04-25T01:39:26.303351+0000","last_became_active":"2024-04-25T01:39:24.393005+0000","last_became_peered":"2024-04-25T01:39:24.393005+0000","last_unstale":"2024-04-25T01:39:26.303351+0000","last_undegraded":"2024-04-25T01:39:26.303351+0000","last_fullsized":"2024-04-25T01:39:26.303351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:32.070747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397598+0000","last_change":"2024-04-25T01:39:23.377093+0000","last_active":"2024-04-25T01:39:26.397598+0000","last_peered":"2024-04-25T01:39:26.397598+0000","last_clean":"2024-04-25T01:39:26.397598+0000","last_became_active":"2024-04-25T01:39:23.376744+0000","last_became_peered":"2024-04-25T01:39:23.376744+0000","last_unstale":"2024-04-25T01:39:26.397598+0000","last_undegraded":"2024-04-25T01:39:26.397598+0000","last_fullsized":"2024-04-25T01:39:26.397598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:43.529618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.303018+0000","last_change":"2024-04-25T01:39:24.394512+0000","last_active":"2024-04-25T01:39:26.303018+0000","last_peered":"2024-04-25T01:39:26.303018+0000","last_clean":"2024-04-25T01:39:26.303018+0000","last_became_active":"2024-04-25T01:39:24.393954+0000","last_became_peered":"2024-04-25T01:39:24.393954+0000","last_unstale":"2024-04-25T01:39:26.303018+0000","last_undegraded":"2024-04-25T01:39:26.303018+0000","last_fullsized":"2024-04-25T01:39:26.303018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:30.534400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397846+0000","last_change":"2024-04-25T01:39:23.377963+0000","last_active":"2024-04-25T01:39:26.397846+0000","last_peered":"2024-04-25T01:39:26.397846+0000","last_clean":"2024-04-25T01:39:26.397846+0000","last_became_active":"2024-04-25T01:39:23.377402+0000","last_became_peered":"2024-04-25T01:39:23.377402+0000","last_unstale":"2024-04-25T01:39:26.397846+0000","last_undegraded":"2024-04-25T01:39:26.397846+0000","last_fullsized":"2024-04-25T01:39:26.397846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:15.873450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.358353+0000","last_change":"2024-04-25T01:39:24.403873+0000","last_active":"2024-04-25T01:39:26.358353+0000","last_peered":"2024-04-25T01:39:26.358353+0000","last_clean":"2024-04-25T01:39:26.358353+0000","last_became_active":"2024-04-25T01:39:24.403623+0000","last_became_peered":"2024-04-25T01:39:24.403623+0000","last_unstale":"2024-04-25T01:39:26.358353+0000","last_undegraded":"2024-04-25T01:39:26.358353+0000","last_fullsized":"2024-04-25T01:39:26.358353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:49.360933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.238974+0000","last_change":"2024-04-25T01:39:23.369400+0000","last_active":"2024-04-25T01:39:26.238974+0000","last_peered":"2024-04-25T01:39:26.238974+0000","last_clean":"2024-04-25T01:39:26.238974+0000","last_became_active":"2024-04-25T01:39:23.368726+0000","last_became_peered":"2024-04-25T01:39:23.368726+0000","last_unstale":"2024-04-25T01:39:26.238974+0000","last_undegraded":"2024-04-25T01:39:26.238974+0000","last_fullsized":"2024-04-25T01:39:26.238974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:35:42.971179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.238990+0000","last_change":"2024-04-25T01:39:24.394317+0000","last_active":"2024-04-25T01:39:26.238990+0000","last_peered":"2024-04-25T01:39:26.238990+0000","last_clean":"2024-04-25T01:39:26.238990+0000","last_became_active":"2024-04-25T01:39:24.394032+0000","last_became_peered":"2024-04-25T01:39:24.394032+0000","last_unstale":"2024-04-25T01:39:26.238990+0000","last_undegraded":"2024-04-25T01:39:26.238990+0000","last_fullsized":"2024-04-25T01:39:26.238990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:11.795443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.358465+0000","last_change":"2024-04-25T01:39:23.377096+0000","last_active":"2024-04-25T01:39:26.358465+0000","last_peered":"2024-04-25T01:39:26.358465+0000","last_clean":"2024-04-25T01:39:26.358465+0000","last_became_active":"2024-04-25T01:39:23.376811+0000","last_became_peered":"2024-04-25T01:39:23.376811+0000","last_unstale":"2024-04-25T01:39:26.358465+0000","last_undegraded":"2024-04-25T01:39:26.358465+0000","last_fullsized":"2024-04-25T01:39:26.358465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:26.888605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":655529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":64705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":655585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T01:39:28.318 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T01:39:28.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.471+0000 7fdf2ff09640 1 Processor -- start 2024-04-25T01:39:28.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.471+0000 7fdf2ff09640 1 -- start start 2024-04-25T01:39:28.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.472+0000 7fdf2ff09640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdf280a95e0 0x7fdf280a99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:28.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.472+0000 7fdf2ff09640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdf2806e0b0 0x7fdf280c0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:28.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.472+0000 7fdf2ff09640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf2806e540 con 0x7fdf280c3f30 2024-04-25T01:39:28.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.472+0000 7fdf2ff09640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fdf28156530 con 0x7fdf2806e0b0 2024-04-25T01:39:28.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.472+0000 7fdf2ff09640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fdf28156810 con 0x7fdf280a95e0 2024-04-25T01:39:28.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.472+0000 7fdf2d4a4640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdf2806e0b0 0x7fdf280c0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:28.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.472+0000 7fdf2dca5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdf280a95e0 0x7fdf280a99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:28.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.472+0000 7fdf2d4a4640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdf2806e0b0 0x7fdf280c0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:49660/0 (socket says 172.21.15.77:49660) 2024-04-25T01:39:28.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.472+0000 7fdf2e4a6640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fdf280c3f30 0x7fdf28159770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.77:59268/0 (socket says 172.21.15.77:59268) 2024-04-25T01:39:28.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.472+0000 7fdf2d4a4640 1 -- 172.21.15.77:0/3285821570 learned_addr learned my addr 172.21.15.77:0/3285821570 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:28.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.472+0000 7fdf2d4a4640 1 -- 172.21.15.77:0/3285821570 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdf280a95e0 msgr2=0x7fdf280a99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:28.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.472+0000 7fdf2d4a4640 1 --2- 172.21.15.77:0/3285821570 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdf280a95e0 0x7fdf280a99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.472+0000 7fdf2d4a4640 1 -- 172.21.15.77:0/3285821570 >> v1:172.21.15.121:6789/0 conn(0x7fdf280c3f30 legacy=0x7fdf28159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:28.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.472+0000 7fdf2d4a4640 1 -- 172.21.15.77:0/3285821570 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf28156af0 con 0x7fdf2806e0b0 2024-04-25T01:39:28.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.473+0000 7fdf2d4a4640 1 --2- 172.21.15.77:0/3285821570 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf2806e0b0 0x7fdf280c0d10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009870 tx=0x7fdf1802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=460eea57623b909b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:28.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.473+0000 7fdf2cca3640 1 -- 172.21.15.77:0/3285821570 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf18037070 con 0x7fdf2806e0b0 2024-04-25T01:39:28.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.473+0000 7fdf2cca3640 1 -- 172.21.15.77:0/3285821570 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf18032440 con 0x7fdf2806e0b0 2024-04-25T01:39:28.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.473+0000 7fdf2cca3640 1 -- 172.21.15.77:0/3285821570 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf18032810 con 0x7fdf2806e0b0 2024-04-25T01:39:28.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.474+0000 7fdf2ff09640 1 -- 172.21.15.77:0/3285821570 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf2806e0b0 msgr2=0x7fdf280c0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:28.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.474+0000 7fdf2ff09640 1 --2- 172.21.15.77:0/3285821570 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf2806e0b0 0x7fdf280c0d10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009870 tx=0x7fdf1802a1c0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.474+0000 7fdf2ff09640 1 -- 172.21.15.77:0/3285821570 shutdown_connections 2024-04-25T01:39:28.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.474+0000 7fdf2ff09640 1 --2- 172.21.15.77:0/3285821570 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf2806e0b0 0x7fdf280c0d10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.474+0000 7fdf2ff09640 1 --2- 172.21.15.77:0/3285821570 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdf280a95e0 0x7fdf280a99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.474+0000 7fdf2ff09640 1 -- 172.21.15.77:0/3285821570 >> 172.21.15.77:0/3285821570 conn(0x7fdf280c4440 msgr2=0x7fdf280c4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:28.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.474+0000 7fdf2ff09640 1 -- 172.21.15.77:0/3285821570 shutdown_connections 2024-04-25T01:39:28.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.474+0000 7fdf2ff09640 1 -- 172.21.15.77:0/3285821570 wait complete. 2024-04-25T01:39:28.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.475+0000 7fdf2ff09640 1 Processor -- start 2024-04-25T01:39:28.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.475+0000 7fdf2ff09640 1 -- start start 2024-04-25T01:39:28.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.475+0000 7fdf2ff09640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf280a95e0 0x7fdf281451d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:28.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.475+0000 7fdf2ff09640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdf280c3f30 0x7fdf281ed620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:28.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.476+0000 7fdf2ff09640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf281483d0 0x7fdf281edb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:28.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.476+0000 7fdf2ff09640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdf28157190 con 0x7fdf281483d0 2024-04-25T01:39:28.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.476+0000 7fdf2ff09640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdf28157010 con 0x7fdf280a95e0 2024-04-25T01:39:28.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.476+0000 7fdf2ff09640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fdf28153ab0 con 0x7fdf280c3f30 2024-04-25T01:39:28.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.476+0000 7fdf2e4a6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf281483d0 0x7fdf281edb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:28.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.476+0000 7fdf2e4a6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf281483d0 0x7fdf281edb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58388/0 (socket says 172.21.15.77:58388) 2024-04-25T01:39:28.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.476+0000 7fdf2e4a6640 1 -- 172.21.15.77:0/3358727319 learned_addr learned my addr 172.21.15.77:0/3358727319 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:28.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.476+0000 7fdf2d4a4640 1 --2- 172.21.15.77:0/3358727319 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdf280c3f30 0x7fdf281ed620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:28.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.476+0000 7fdf2dca5640 1 --2- 172.21.15.77:0/3358727319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf280a95e0 0x7fdf281451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:28.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.476+0000 7fdf2e4a6640 1 -- 172.21.15.77:0/3358727319 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdf280c3f30 msgr2=0x7fdf281ed620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:28.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.476+0000 7fdf2e4a6640 1 --2- 172.21.15.77:0/3358727319 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdf280c3f30 0x7fdf281ed620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.476+0000 7fdf2e4a6640 1 -- 172.21.15.77:0/3358727319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf280a95e0 msgr2=0x7fdf281451d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:28.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.476+0000 7fdf2e4a6640 1 --2- 172.21.15.77:0/3358727319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf280a95e0 0x7fdf281451d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.476+0000 7fdf2e4a6640 1 -- 172.21.15.77:0/3358727319 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf28145710 con 0x7fdf281483d0 2024-04-25T01:39:28.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.476+0000 7fdf2dca5640 1 --2- 172.21.15.77:0/3358727319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf280a95e0 0x7fdf281451d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:28.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.476+0000 7fdf2e4a6640 1 --2- 172.21.15.77:0/3358727319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf281483d0 0x7fdf281edb60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdf2000c730 tx=0x7fdf2000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:28.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.476+0000 7fdf1e7fc640 1 -- 172.21.15.77:0/3358727319 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf20017070 con 0x7fdf281483d0 2024-04-25T01:39:28.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.476+0000 7fdf1e7fc640 1 -- 172.21.15.77:0/3358727319 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf2000ce40 con 0x7fdf281483d0 2024-04-25T01:39:28.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.476+0000 7fdf2ff09640 1 -- 172.21.15.77:0/3358727319 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf281ecfb0 con 0x7fdf281483d0 2024-04-25T01:39:28.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.476+0000 7fdf1e7fc640 1 -- 172.21.15.77:0/3358727319 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2000a840 con 0x7fdf281483d0 2024-04-25T01:39:28.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.476+0000 7fdf2ff09640 1 -- 172.21.15.77:0/3358727319 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf281589c0 con 0x7fdf281483d0 2024-04-25T01:39:28.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.477+0000 7fdf2ff09640 1 -- 172.21.15.77:0/3358727319 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf2804f500 con 0x7fdf281483d0 2024-04-25T01:39:28.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.478+0000 7fdf1e7fc640 1 -- 172.21.15.77:0/3358727319 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdf2001a070 con 0x7fdf281483d0 2024-04-25T01:39:28.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.478+0000 7fdf1e7fc640 1 --2- 172.21.15.77:0/3358727319 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fdf0c06be30 0x7fdf0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:28.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.478+0000 7fdf1e7fc640 1 -- 172.21.15.77:0/3358727319 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7fdf2008a1f0 con 0x7fdf281483d0 2024-04-25T01:39:28.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.478+0000 7fdf2dca5640 1 --2- 172.21.15.77:0/3358727319 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fdf0c06be30 0x7fdf0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:28.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.478+0000 7fdf2dca5640 1 --2- 172.21.15.77:0/3358727319 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fdf0c06be30 0x7fdf0c06e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdf24009b90 tx=0x7fdf24008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:28.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.482+0000 7fdf1e7fc640 1 -- 172.21.15.77:0/3358727319 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fdf28145710 con 0x7fdf281483d0 2024-04-25T01:39:28.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.650+0000 7fdf2ff09640 1 -- 172.21.15.77:0/3358727319 --> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdf280adc70 con 0x7fdf0c06be30 2024-04-25T01:39:28.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.656+0000 7fdf1e7fc640 1 -- 172.21.15.77:0/3358727319 <== mgr.4098 v2:172.21.15.77:6832/4208232183 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251941 (secure 0 0 0) 0x7fdf280adc70 con 0x7fdf0c06be30 2024-04-25T01:39:28.641 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:28.642 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-25T01:39:28.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.659+0000 7fdf2ff09640 1 -- 172.21.15.77:0/3358727319 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fdf0c06be30 msgr2=0x7fdf0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:28.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.659+0000 7fdf2ff09640 1 --2- 172.21.15.77:0/3358727319 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fdf0c06be30 0x7fdf0c06e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdf24009b90 tx=0x7fdf24008040 comp rx=0 tx=0).stop 2024-04-25T01:39:28.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.659+0000 7fdf2ff09640 1 -- 172.21.15.77:0/3358727319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf281483d0 msgr2=0x7fdf281edb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:28.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.659+0000 7fdf2ff09640 1 --2- 172.21.15.77:0/3358727319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf281483d0 0x7fdf281edb60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdf2000c730 tx=0x7fdf2000cbf0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.659+0000 7fdf2ff09640 1 -- 172.21.15.77:0/3358727319 shutdown_connections 2024-04-25T01:39:28.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.659+0000 7fdf2ff09640 1 --2- 172.21.15.77:0/3358727319 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fdf0c06be30 0x7fdf0c06e2f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.659+0000 7fdf2ff09640 1 --2- 172.21.15.77:0/3358727319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf281483d0 0x7fdf281edb60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.659+0000 7fdf2ff09640 1 --2- 172.21.15.77:0/3358727319 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdf280c3f30 0x7fdf281ed620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.659+0000 7fdf2ff09640 1 --2- 172.21.15.77:0/3358727319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf280a95e0 0x7fdf281451d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.659+0000 7fdf2ff09640 1 -- 172.21.15.77:0/3358727319 >> 172.21.15.77:0/3358727319 conn(0x7fdf280c4440 msgr2=0x7fdf28151d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:28.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.659+0000 7fdf2ff09640 1 -- 172.21.15.77:0/3358727319 shutdown_connections 2024-04-25T01:39:28.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.659+0000 7fdf2ff09640 1 -- 172.21.15.77:0/3358727319 wait complete. 2024-04-25T01:39:28.654 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-25T01:39:27.651670+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218956,"kb_used_data":2776,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755764,"statfs":{"total":773094113280,"available":772869902336,"internally_reserved":0,"allocated":2842624,"data_stored":1727288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.298746"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.398012+0000","last_change":"2024-04-25T01:39:24.396231+0000","last_active":"2024-04-25T01:39:26.398012+0000","last_peered":"2024-04-25T01:39:26.398012+0000","last_clean":"2024-04-25T01:39:26.398012+0000","last_became_active":"2024-04-25T01:39:24.395958+0000","last_became_peered":"2024-04-25T01:39:24.395958+0000","last_unstale":"2024-04-25T01:39:26.398012+0000","last_undegraded":"2024-04-25T01:39:26.398012+0000","last_fullsized":"2024-04-25T01:39:26.398012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:54.898765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.369673+0000","last_change":"2024-04-25T01:39:24.386803+0000","last_active":"2024-04-25T01:39:25.369673+0000","last_peered":"2024-04-25T01:39:25.369673+0000","last_clean":"2024-04-25T01:39:25.369673+0000","last_became_active":"2024-04-25T01:39:24.386531+0000","last_became_peered":"2024-04-25T01:39:24.386531+0000","last_unstale":"2024-04-25T01:39:25.369673+0000","last_undegraded":"2024-04-25T01:39:25.369673+0000","last_fullsized":"2024-04-25T01:39:25.369673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:19.160345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.358310+0000","last_change":"2024-04-25T01:39:24.386909+0000","last_active":"2024-04-25T01:39:26.358310+0000","last_peered":"2024-04-25T01:39:26.358310+0000","last_clean":"2024-04-25T01:39:26.358310+0000","last_became_active":"2024-04-25T01:39:24.386568+0000","last_became_peered":"2024-04-25T01:39:24.386568+0000","last_unstale":"2024-04-25T01:39:26.358310+0000","last_undegraded":"2024-04-25T01:39:26.358310+0000","last_fullsized":"2024-04-25T01:39:26.358310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:29.904064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.302985+0000","last_change":"2024-04-25T01:39:24.398726+0000","last_active":"2024-04-25T01:39:26.302985+0000","last_peered":"2024-04-25T01:39:26.302985+0000","last_clean":"2024-04-25T01:39:26.302985+0000","last_became_active":"2024-04-25T01:39:24.398449+0000","last_became_peered":"2024-04-25T01:39:24.398449+0000","last_unstale":"2024-04-25T01:39:26.302985+0000","last_undegraded":"2024-04-25T01:39:26.302985+0000","last_fullsized":"2024-04-25T01:39:26.302985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:41:38.230939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397515+0000","last_change":"2024-04-25T01:39:24.380318+0000","last_active":"2024-04-25T01:39:26.397515+0000","last_peered":"2024-04-25T01:39:26.397515+0000","last_clean":"2024-04-25T01:39:26.397515+0000","last_became_active":"2024-04-25T01:39:24.379573+0000","last_became_peered":"2024-04-25T01:39:24.379573+0000","last_unstale":"2024-04-25T01:39:26.397515+0000","last_undegraded":"2024-04-25T01:39:26.397515+0000","last_fullsized":"2024-04-25T01:39:26.397515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:12.089917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.302832+0000","last_change":"2024-04-25T01:39:24.399950+0000","last_active":"2024-04-25T01:39:26.302832+0000","last_peered":"2024-04-25T01:39:26.302832+0000","last_clean":"2024-04-25T01:39:26.302832+0000","last_became_active":"2024-04-25T01:39:24.399701+0000","last_became_peered":"2024-04-25T01:39:24.399701+0000","last_unstale":"2024-04-25T01:39:26.302832+0000","last_undegraded":"2024-04-25T01:39:26.302832+0000","last_fullsized":"2024-04-25T01:39:26.302832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:49.618370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397431+0000","last_change":"2024-04-25T01:39:24.387941+0000","last_active":"2024-04-25T01:39:26.397431+0000","last_peered":"2024-04-25T01:39:26.397431+0000","last_clean":"2024-04-25T01:39:26.397431+0000","last_became_active":"2024-04-25T01:39:24.387674+0000","last_became_peered":"2024-04-25T01:39:24.387674+0000","last_unstale":"2024-04-25T01:39:26.397431+0000","last_undegraded":"2024-04-25T01:39:26.397431+0000","last_fullsized":"2024-04-25T01:39:26.397431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:05.676143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.238589+0000","last_change":"2024-04-25T01:39:24.401765+0000","last_active":"2024-04-25T01:39:26.238589+0000","last_peered":"2024-04-25T01:39:26.238589+0000","last_clean":"2024-04-25T01:39:26.238589+0000","last_became_active":"2024-04-25T01:39:24.400509+0000","last_became_peered":"2024-04-25T01:39:24.400509+0000","last_unstale":"2024-04-25T01:39:26.238589+0000","last_undegraded":"2024-04-25T01:39:26.238589+0000","last_fullsized":"2024-04-25T01:39:26.238589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:25.031622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.398051+0000","last_change":"2024-04-25T01:39:24.393362+0000","last_active":"2024-04-25T01:39:26.398051+0000","last_peered":"2024-04-25T01:39:26.398051+0000","last_clean":"2024-04-25T01:39:26.398051+0000","last_became_active":"2024-04-25T01:39:24.392836+0000","last_became_peered":"2024-04-25T01:39:24.392836+0000","last_unstale":"2024-04-25T01:39:26.398051+0000","last_undegraded":"2024-04-25T01:39:26.398051+0000","last_fullsized":"2024-04-25T01:39:26.398051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:58.871777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.388778+0000","last_change":"2024-04-25T01:39:24.406158+0000","last_active":"2024-04-25T01:39:25.388778+0000","last_peered":"2024-04-25T01:39:25.388778+0000","last_clean":"2024-04-25T01:39:25.388778+0000","last_became_active":"2024-04-25T01:39:24.405876+0000","last_became_peered":"2024-04-25T01:39:24.405876+0000","last_unstale":"2024-04-25T01:39:25.388778+0000","last_undegraded":"2024-04-25T01:39:25.388778+0000","last_fullsized":"2024-04-25T01:39:25.388778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:18:19.895651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.388709+0000","last_change":"2024-04-25T01:39:24.404047+0000","last_active":"2024-04-25T01:39:25.388709+0000","last_peered":"2024-04-25T01:39:25.388709+0000","last_clean":"2024-04-25T01:39:25.388709+0000","last_became_active":"2024-04-25T01:39:24.403700+0000","last_became_peered":"2024-04-25T01:39:24.403700+0000","last_unstale":"2024-04-25T01:39:25.388709+0000","last_undegraded":"2024-04-25T01:39:25.388709+0000","last_fullsized":"2024-04-25T01:39:25.388709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:53.123061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T01:39:24.398554+0000","last_change":"2024-04-25T01:39:24.396300+0000","last_active":"2024-04-25T01:39:24.398554+0000","last_peered":"2024-04-25T01:39:24.398554+0000","last_clean":"2024-04-25T01:39:24.398554+0000","last_became_active":"2024-04-25T01:39:24.396023+0000","last_became_peered":"2024-04-25T01:39:24.396023+0000","last_unstale":"2024-04-25T01:39:24.398554+0000","last_undegraded":"2024-04-25T01:39:24.398554+0000","last_fullsized":"2024-04-25T01:39:24.398554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:51.368646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.238969+0000","last_change":"2024-04-25T01:39:24.392021+0000","last_active":"2024-04-25T01:39:26.238969+0000","last_peered":"2024-04-25T01:39:26.238969+0000","last_clean":"2024-04-25T01:39:26.238969+0000","last_became_active":"2024-04-25T01:39:24.391352+0000","last_became_peered":"2024-04-25T01:39:24.391352+0000","last_unstale":"2024-04-25T01:39:26.238969+0000","last_undegraded":"2024-04-25T01:39:26.238969+0000","last_fullsized":"2024-04-25T01:39:26.238969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:44.434749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.358158+0000","last_change":"2024-04-25T01:39:24.389556+0000","last_active":"2024-04-25T01:39:26.358158+0000","last_peered":"2024-04-25T01:39:26.358158+0000","last_clean":"2024-04-25T01:39:26.358158+0000","last_became_active":"2024-04-25T01:39:24.389254+0000","last_became_peered":"2024-04-25T01:39:24.389254+0000","last_unstale":"2024-04-25T01:39:26.358158+0000","last_undegraded":"2024-04-25T01:39:26.358158+0000","last_fullsized":"2024-04-25T01:39:26.358158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:56.208172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.369376+0000","last_change":"2024-04-25T01:39:24.388943+0000","last_active":"2024-04-25T01:39:25.369376+0000","last_peered":"2024-04-25T01:39:25.369376+0000","last_clean":"2024-04-25T01:39:25.369376+0000","last_became_active":"2024-04-25T01:39:24.388690+0000","last_became_peered":"2024-04-25T01:39:24.388690+0000","last_unstale":"2024-04-25T01:39:25.369376+0000","last_undegraded":"2024-04-25T01:39:25.369376+0000","last_fullsized":"2024-04-25T01:39:25.369376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:42:18.260701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.302900+0000","last_change":"2024-04-25T01:39:24.399270+0000","last_active":"2024-04-25T01:39:26.302900+0000","last_peered":"2024-04-25T01:39:26.302900+0000","last_clean":"2024-04-25T01:39:26.302900+0000","last_became_active":"2024-04-25T01:39:24.399011+0000","last_became_peered":"2024-04-25T01:39:24.399011+0000","last_unstale":"2024-04-25T01:39:26.302900+0000","last_undegraded":"2024-04-25T01:39:26.302900+0000","last_fullsized":"2024-04-25T01:39:26.302900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:00.987674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.303416+0000","last_change":"2024-04-25T01:39:24.391312+0000","last_active":"2024-04-25T01:39:26.303416+0000","last_peered":"2024-04-25T01:39:26.303416+0000","last_clean":"2024-04-25T01:39:26.303416+0000","last_became_active":"2024-04-25T01:39:24.390978+0000","last_became_peered":"2024-04-25T01:39:24.390978+0000","last_unstale":"2024-04-25T01:39:26.303416+0000","last_undegraded":"2024-04-25T01:39:26.303416+0000","last_fullsized":"2024-04-25T01:39:26.303416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:38:25.637031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.370433+0000","last_change":"2024-04-25T01:39:24.395125+0000","last_active":"2024-04-25T01:39:25.370433+0000","last_peered":"2024-04-25T01:39:25.370433+0000","last_clean":"2024-04-25T01:39:25.370433+0000","last_became_active":"2024-04-25T01:39:24.392605+0000","last_became_peered":"2024-04-25T01:39:24.392605+0000","last_unstale":"2024-04-25T01:39:25.370433+0000","last_undegraded":"2024-04-25T01:39:25.370433+0000","last_fullsized":"2024-04-25T01:39:25.370433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:53.333616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397873+0000","last_change":"2024-04-25T01:39:24.380199+0000","last_active":"2024-04-25T01:39:26.397873+0000","last_peered":"2024-04-25T01:39:26.397873+0000","last_clean":"2024-04-25T01:39:26.397873+0000","last_became_active":"2024-04-25T01:39:24.379591+0000","last_became_peered":"2024-04-25T01:39:24.379591+0000","last_unstale":"2024-04-25T01:39:26.397873+0000","last_undegraded":"2024-04-25T01:39:26.397873+0000","last_fullsized":"2024-04-25T01:39:26.397873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:54.534683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.388599+0000","last_change":"2024-04-25T01:39:24.395109+0000","last_active":"2024-04-25T01:39:25.388599+0000","last_peered":"2024-04-25T01:39:25.388599+0000","last_clean":"2024-04-25T01:39:25.388599+0000","last_became_active":"2024-04-25T01:39:24.394784+0000","last_became_peered":"2024-04-25T01:39:24.394784+0000","last_unstale":"2024-04-25T01:39:25.388599+0000","last_undegraded":"2024-04-25T01:39:25.388599+0000","last_fullsized":"2024-04-25T01:39:25.388599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:44:09.102603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.358341+0000","last_change":"2024-04-25T01:39:24.388891+0000","last_active":"2024-04-25T01:39:26.358341+0000","last_peered":"2024-04-25T01:39:26.358341+0000","last_clean":"2024-04-25T01:39:26.358341+0000","last_became_active":"2024-04-25T01:39:24.388619+0000","last_became_peered":"2024-04-25T01:39:24.388619+0000","last_unstale":"2024-04-25T01:39:26.358341+0000","last_undegraded":"2024-04-25T01:39:26.358341+0000","last_fullsized":"2024-04-25T01:39:26.358341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:05.176386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.302978+0000","last_change":"2024-04-25T01:39:24.390884+0000","last_active":"2024-04-25T01:39:26.302978+0000","last_peered":"2024-04-25T01:39:26.302978+0000","last_clean":"2024-04-25T01:39:26.302978+0000","last_became_active":"2024-04-25T01:39:24.390591+0000","last_became_peered":"2024-04-25T01:39:24.390591+0000","last_unstale":"2024-04-25T01:39:26.302978+0000","last_undegraded":"2024-04-25T01:39:26.302978+0000","last_fullsized":"2024-04-25T01:39:26.302978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:51.274363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.238851+0000","last_change":"2024-04-25T01:39:24.389039+0000","last_active":"2024-04-25T01:39:26.238851+0000","last_peered":"2024-04-25T01:39:26.238851+0000","last_clean":"2024-04-25T01:39:26.238851+0000","last_became_active":"2024-04-25T01:39:24.388793+0000","last_became_peered":"2024-04-25T01:39:24.388793+0000","last_unstale":"2024-04-25T01:39:26.238851+0000","last_undegraded":"2024-04-25T01:39:26.238851+0000","last_fullsized":"2024-04-25T01:39:26.238851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:13.093550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.302926+0000","last_change":"2024-04-25T01:39:24.387093+0000","last_active":"2024-04-25T01:39:26.302926+0000","last_peered":"2024-04-25T01:39:26.302926+0000","last_clean":"2024-04-25T01:39:26.302926+0000","last_became_active":"2024-04-25T01:39:24.386809+0000","last_became_peered":"2024-04-25T01:39:24.386809+0000","last_unstale":"2024-04-25T01:39:26.302926+0000","last_undegraded":"2024-04-25T01:39:26.302926+0000","last_fullsized":"2024-04-25T01:39:26.302926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:46:05.313828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.238893+0000","last_change":"2024-04-25T01:39:24.390352+0000","last_active":"2024-04-25T01:39:26.238893+0000","last_peered":"2024-04-25T01:39:26.238893+0000","last_clean":"2024-04-25T01:39:26.238893+0000","last_became_active":"2024-04-25T01:39:24.389809+0000","last_became_peered":"2024-04-25T01:39:24.389809+0000","last_unstale":"2024-04-25T01:39:26.238893+0000","last_undegraded":"2024-04-25T01:39:26.238893+0000","last_fullsized":"2024-04-25T01:39:26.238893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:22:44.221898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.388789+0000","last_change":"2024-04-25T01:39:24.398614+0000","last_active":"2024-04-25T01:39:25.388789+0000","last_peered":"2024-04-25T01:39:25.388789+0000","last_clean":"2024-04-25T01:39:25.388789+0000","last_became_active":"2024-04-25T01:39:24.398299+0000","last_became_peered":"2024-04-25T01:39:24.398299+0000","last_unstale":"2024-04-25T01:39:25.388789+0000","last_undegraded":"2024-04-25T01:39:25.388789+0000","last_fullsized":"2024-04-25T01:39:25.388789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:54:51.191225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.369543+0000","last_change":"2024-04-25T01:39:24.374082+0000","last_active":"2024-04-25T01:39:25.369543+0000","last_peered":"2024-04-25T01:39:25.369543+0000","last_clean":"2024-04-25T01:39:25.369543+0000","last_became_active":"2024-04-25T01:39:24.373731+0000","last_became_peered":"2024-04-25T01:39:24.373731+0000","last_unstale":"2024-04-25T01:39:25.369543+0000","last_undegraded":"2024-04-25T01:39:25.369543+0000","last_fullsized":"2024-04-25T01:39:25.369543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:45.817483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.239054+0000","last_change":"2024-04-25T01:39:24.389645+0000","last_active":"2024-04-25T01:39:26.239054+0000","last_peered":"2024-04-25T01:39:26.239054+0000","last_clean":"2024-04-25T01:39:26.239054+0000","last_became_active":"2024-04-25T01:39:24.389375+0000","last_became_peered":"2024-04-25T01:39:24.389375+0000","last_unstale":"2024-04-25T01:39:26.239054+0000","last_undegraded":"2024-04-25T01:39:26.239054+0000","last_fullsized":"2024-04-25T01:39:26.239054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:13:12.753893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.358439+0000","last_change":"2024-04-25T01:39:24.390631+0000","last_active":"2024-04-25T01:39:26.358439+0000","last_peered":"2024-04-25T01:39:26.358439+0000","last_clean":"2024-04-25T01:39:26.358439+0000","last_became_active":"2024-04-25T01:39:24.390363+0000","last_became_peered":"2024-04-25T01:39:24.390363+0000","last_unstale":"2024-04-25T01:39:26.358439+0000","last_undegraded":"2024-04-25T01:39:26.358439+0000","last_fullsized":"2024-04-25T01:39:26.358439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:48.830416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.303283+0000","last_change":"2024-04-25T01:39:24.399738+0000","last_active":"2024-04-25T01:39:26.303283+0000","last_peered":"2024-04-25T01:39:26.303283+0000","last_clean":"2024-04-25T01:39:26.303283+0000","last_became_active":"2024-04-25T01:39:24.399499+0000","last_became_peered":"2024-04-25T01:39:24.399499+0000","last_unstale":"2024-04-25T01:39:26.303283+0000","last_undegraded":"2024-04-25T01:39:26.303283+0000","last_fullsized":"2024-04-25T01:39:26.303283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:58.646669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.370293+0000","last_change":"2024-04-25T01:39:24.390981+0000","last_active":"2024-04-25T01:39:25.370293+0000","last_peered":"2024-04-25T01:39:25.370293+0000","last_clean":"2024-04-25T01:39:25.370293+0000","last_became_active":"2024-04-25T01:39:24.390716+0000","last_became_peered":"2024-04-25T01:39:24.390716+0000","last_unstale":"2024-04-25T01:39:25.370293+0000","last_undegraded":"2024-04-25T01:39:25.370293+0000","last_fullsized":"2024-04-25T01:39:25.370293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:08.458504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.388482+0000","last_change":"2024-04-25T01:39:24.395618+0000","last_active":"2024-04-25T01:39:25.388482+0000","last_peered":"2024-04-25T01:39:25.388482+0000","last_clean":"2024-04-25T01:39:25.388482+0000","last_became_active":"2024-04-25T01:39:24.394816+0000","last_became_peered":"2024-04-25T01:39:24.394816+0000","last_unstale":"2024-04-25T01:39:25.388482+0000","last_undegraded":"2024-04-25T01:39:25.388482+0000","last_fullsized":"2024-04-25T01:39:25.388482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:01.025135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T01:39:24.397577+0000","last_change":"2024-04-25T01:39:24.388083+0000","last_active":"2024-04-25T01:39:24.397577+0000","last_peered":"2024-04-25T01:39:24.397577+0000","last_clean":"2024-04-25T01:39:24.397577+0000","last_became_active":"2024-04-25T01:39:24.387789+0000","last_became_peered":"2024-04-25T01:39:24.387789+0000","last_unstale":"2024-04-25T01:39:24.397577+0000","last_undegraded":"2024-04-25T01:39:24.397577+0000","last_fullsized":"2024-04-25T01:39:24.397577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:59:57.402340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.239028+0000","last_change":"2024-04-25T01:39:23.371716+0000","last_active":"2024-04-25T01:39:26.239028+0000","last_peered":"2024-04-25T01:39:26.239028+0000","last_clean":"2024-04-25T01:39:26.239028+0000","last_became_active":"2024-04-25T01:39:23.371475+0000","last_became_peered":"2024-04-25T01:39:23.371475+0000","last_unstale":"2024-04-25T01:39:26.239028+0000","last_undegraded":"2024-04-25T01:39:26.239028+0000","last_fullsized":"2024-04-25T01:39:26.239028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:10.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.358538+0000","last_change":"2024-04-25T01:39:24.388095+0000","last_active":"2024-04-25T01:39:26.358538+0000","last_peered":"2024-04-25T01:39:26.358538+0000","last_clean":"2024-04-25T01:39:26.358538+0000","last_became_active":"2024-04-25T01:39:24.387797+0000","last_became_peered":"2024-04-25T01:39:24.387797+0000","last_unstale":"2024-04-25T01:39:26.358538+0000","last_undegraded":"2024-04-25T01:39:26.358538+0000","last_fullsized":"2024-04-25T01:39:26.358538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:43:16.385957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.388457+0000","last_change":"2024-04-25T01:39:23.372975+0000","last_active":"2024-04-25T01:39:25.388457+0000","last_peered":"2024-04-25T01:39:25.388457+0000","last_clean":"2024-04-25T01:39:25.388457+0000","last_became_active":"2024-04-25T01:39:23.372688+0000","last_became_peered":"2024-04-25T01:39:23.372688+0000","last_unstale":"2024-04-25T01:39:25.388457+0000","last_undegraded":"2024-04-25T01:39:25.388457+0000","last_fullsized":"2024-04-25T01:39:25.388457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:42:57.195844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.238686+0000","last_change":"2024-04-25T01:39:23.377487+0000","last_active":"2024-04-25T01:39:26.238686+0000","last_peered":"2024-04-25T01:39:26.238686+0000","last_clean":"2024-04-25T01:39:26.238686+0000","last_became_active":"2024-04-25T01:39:23.377181+0000","last_became_peered":"2024-04-25T01:39:23.377181+0000","last_unstale":"2024-04-25T01:39:26.238686+0000","last_undegraded":"2024-04-25T01:39:26.238686+0000","last_fullsized":"2024-04-25T01:39:26.238686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:17.434141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.238661+0000","last_change":"2024-04-25T01:39:24.387708+0000","last_active":"2024-04-25T01:39:26.238661+0000","last_peered":"2024-04-25T01:39:26.238661+0000","last_clean":"2024-04-25T01:39:26.238661+0000","last_became_active":"2024-04-25T01:39:24.387433+0000","last_became_peered":"2024-04-25T01:39:24.387433+0000","last_unstale":"2024-04-25T01:39:26.238661+0000","last_undegraded":"2024-04-25T01:39:26.238661+0000","last_fullsized":"2024-04-25T01:39:26.238661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:34.312066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.303066+0000","last_change":"2024-04-25T01:39:23.369998+0000","last_active":"2024-04-25T01:39:26.303066+0000","last_peered":"2024-04-25T01:39:26.303066+0000","last_clean":"2024-04-25T01:39:26.303066+0000","last_became_active":"2024-04-25T01:39:23.369710+0000","last_became_peered":"2024-04-25T01:39:23.369710+0000","last_unstale":"2024-04-25T01:39:26.303066+0000","last_undegraded":"2024-04-25T01:39:26.303066+0000","last_fullsized":"2024-04-25T01:39:26.303066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:32:34.329452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.369342+0000","last_change":"2024-04-25T01:39:24.375457+0000","last_active":"2024-04-25T01:39:25.369342+0000","last_peered":"2024-04-25T01:39:25.369342+0000","last_clean":"2024-04-25T01:39:25.369342+0000","last_became_active":"2024-04-25T01:39:24.375178+0000","last_became_peered":"2024-04-25T01:39:24.375178+0000","last_unstale":"2024-04-25T01:39:25.369342+0000","last_undegraded":"2024-04-25T01:39:25.369342+0000","last_fullsized":"2024-04-25T01:39:25.369342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:58:15.640882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.388698+0000","last_change":"2024-04-25T01:39:23.377236+0000","last_active":"2024-04-25T01:39:25.388698+0000","last_peered":"2024-04-25T01:39:25.388698+0000","last_clean":"2024-04-25T01:39:25.388698+0000","last_became_active":"2024-04-25T01:39:23.376727+0000","last_became_peered":"2024-04-25T01:39:23.376727+0000","last_unstale":"2024-04-25T01:39:25.388698+0000","last_undegraded":"2024-04-25T01:39:25.388698+0000","last_fullsized":"2024-04-25T01:39:25.388698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:08.103707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.303209+0000","last_change":"2024-04-25T01:39:24.392642+0000","last_active":"2024-04-25T01:39:26.303209+0000","last_peered":"2024-04-25T01:39:26.303209+0000","last_clean":"2024-04-25T01:39:26.303209+0000","last_became_active":"2024-04-25T01:39:24.391605+0000","last_became_peered":"2024-04-25T01:39:24.391605+0000","last_unstale":"2024-04-25T01:39:26.303209+0000","last_undegraded":"2024-04-25T01:39:26.303209+0000","last_fullsized":"2024-04-25T01:39:26.303209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:01:23.217074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.303157+0000","last_change":"2024-04-25T01:39:23.378968+0000","last_active":"2024-04-25T01:39:26.303157+0000","last_peered":"2024-04-25T01:39:26.303157+0000","last_clean":"2024-04-25T01:39:26.303157+0000","last_became_active":"2024-04-25T01:39:23.378635+0000","last_became_peered":"2024-04-25T01:39:23.378635+0000","last_unstale":"2024-04-25T01:39:26.303157+0000","last_undegraded":"2024-04-25T01:39:26.303157+0000","last_fullsized":"2024-04-25T01:39:26.303157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:39.780544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.358448+0000","last_change":"2024-04-25T01:39:24.403875+0000","last_active":"2024-04-25T01:39:26.358448+0000","last_peered":"2024-04-25T01:39:26.358448+0000","last_clean":"2024-04-25T01:39:26.358448+0000","last_became_active":"2024-04-25T01:39:24.403591+0000","last_became_peered":"2024-04-25T01:39:24.403591+0000","last_unstale":"2024-04-25T01:39:26.358448+0000","last_undegraded":"2024-04-25T01:39:26.358448+0000","last_fullsized":"2024-04-25T01:39:26.358448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:45.276173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.369532+0000","last_change":"2024-04-25T01:39:23.369043+0000","last_active":"2024-04-25T01:39:25.369532+0000","last_peered":"2024-04-25T01:39:25.369532+0000","last_clean":"2024-04-25T01:39:25.369532+0000","last_became_active":"2024-04-25T01:39:23.368778+0000","last_became_peered":"2024-04-25T01:39:23.368778+0000","last_unstale":"2024-04-25T01:39:25.369532+0000","last_undegraded":"2024-04-25T01:39:25.369532+0000","last_fullsized":"2024-04-25T01:39:25.369532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:59.501724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T01:39:24.398534+0000","last_change":"2024-04-25T01:39:24.391245+0000","last_active":"2024-04-25T01:39:24.398534+0000","last_peered":"2024-04-25T01:39:24.398534+0000","last_clean":"2024-04-25T01:39:24.398534+0000","last_became_active":"2024-04-25T01:39:24.390941+0000","last_became_peered":"2024-04-25T01:39:24.390941+0000","last_unstale":"2024-04-25T01:39:24.398534+0000","last_undegraded":"2024-04-25T01:39:24.398534+0000","last_fullsized":"2024-04-25T01:39:24.398534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:25.663630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.388577+0000","last_change":"2024-04-25T01:39:23.373295+0000","last_active":"2024-04-25T01:39:25.388577+0000","last_peered":"2024-04-25T01:39:25.388577+0000","last_clean":"2024-04-25T01:39:25.388577+0000","last_became_active":"2024-04-25T01:39:23.372984+0000","last_became_peered":"2024-04-25T01:39:23.372984+0000","last_unstale":"2024-04-25T01:39:25.388577+0000","last_undegraded":"2024-04-25T01:39:25.388577+0000","last_fullsized":"2024-04-25T01:39:25.388577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:10.854190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397751+0000","last_change":"2024-04-25T01:39:24.380617+0000","last_active":"2024-04-25T01:39:26.397751+0000","last_peered":"2024-04-25T01:39:26.397751+0000","last_clean":"2024-04-25T01:39:26.397751+0000","last_became_active":"2024-04-25T01:39:24.380330+0000","last_became_peered":"2024-04-25T01:39:24.380330+0000","last_unstale":"2024-04-25T01:39:26.397751+0000","last_undegraded":"2024-04-25T01:39:26.397751+0000","last_fullsized":"2024-04-25T01:39:26.397751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:24.010569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.358516+0000","last_change":"2024-04-25T01:39:23.372903+0000","last_active":"2024-04-25T01:39:26.358516+0000","last_peered":"2024-04-25T01:39:26.358516+0000","last_clean":"2024-04-25T01:39:26.358516+0000","last_became_active":"2024-04-25T01:39:23.372617+0000","last_became_peered":"2024-04-25T01:39:23.372617+0000","last_unstale":"2024-04-25T01:39:26.358516+0000","last_undegraded":"2024-04-25T01:39:26.358516+0000","last_fullsized":"2024-04-25T01:39:26.358516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:54:58.506432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.358303+0000","last_change":"2024-04-25T01:39:24.388852+0000","last_active":"2024-04-25T01:39:26.358303+0000","last_peered":"2024-04-25T01:39:26.358303+0000","last_clean":"2024-04-25T01:39:26.358303+0000","last_became_active":"2024-04-25T01:39:24.388594+0000","last_became_peered":"2024-04-25T01:39:24.388594+0000","last_unstale":"2024-04-25T01:39:26.358303+0000","last_undegraded":"2024-04-25T01:39:26.358303+0000","last_fullsized":"2024-04-25T01:39:26.358303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:46:49.718182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.303329+0000","last_change":"2024-04-25T01:39:23.369440+0000","last_active":"2024-04-25T01:39:26.303329+0000","last_peered":"2024-04-25T01:39:26.303329+0000","last_clean":"2024-04-25T01:39:26.303329+0000","last_became_active":"2024-04-25T01:39:23.369151+0000","last_became_peered":"2024-04-25T01:39:23.369151+0000","last_unstale":"2024-04-25T01:39:26.303329+0000","last_undegraded":"2024-04-25T01:39:26.303329+0000","last_fullsized":"2024-04-25T01:39:26.303329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:31:46.921287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397671+0000","last_change":"2024-04-25T01:39:24.390114+0000","last_active":"2024-04-25T01:39:26.397671+0000","last_peered":"2024-04-25T01:39:26.397671+0000","last_clean":"2024-04-25T01:39:26.397671+0000","last_became_active":"2024-04-25T01:39:24.389841+0000","last_became_peered":"2024-04-25T01:39:24.389841+0000","last_unstale":"2024-04-25T01:39:26.397671+0000","last_undegraded":"2024-04-25T01:39:26.397671+0000","last_fullsized":"2024-04-25T01:39:26.397671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:34.950624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.388434+0000","last_change":"2024-04-25T01:39:23.372939+0000","last_active":"2024-04-25T01:39:25.388434+0000","last_peered":"2024-04-25T01:39:25.388434+0000","last_clean":"2024-04-25T01:39:25.388434+0000","last_became_active":"2024-04-25T01:39:23.372648+0000","last_became_peered":"2024-04-25T01:39:23.372648+0000","last_unstale":"2024-04-25T01:39:25.388434+0000","last_undegraded":"2024-04-25T01:39:25.388434+0000","last_fullsized":"2024-04-25T01:39:25.388434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:02:13.283096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.388482+0000","last_change":"2024-04-25T01:39:24.394248+0000","last_active":"2024-04-25T01:39:25.388482+0000","last_peered":"2024-04-25T01:39:25.388482+0000","last_clean":"2024-04-25T01:39:25.388482+0000","last_became_active":"2024-04-25T01:39:24.393958+0000","last_became_peered":"2024-04-25T01:39:24.393958+0000","last_unstale":"2024-04-25T01:39:25.388482+0000","last_undegraded":"2024-04-25T01:39:25.388482+0000","last_fullsized":"2024-04-25T01:39:25.388482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:35.087577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.370219+0000","last_change":"2024-04-25T01:39:23.373599+0000","last_active":"2024-04-25T01:39:25.370219+0000","last_peered":"2024-04-25T01:39:25.370219+0000","last_clean":"2024-04-25T01:39:25.370219+0000","last_became_active":"2024-04-25T01:39:23.373281+0000","last_became_peered":"2024-04-25T01:39:23.373281+0000","last_unstale":"2024-04-25T01:39:25.370219+0000","last_undegraded":"2024-04-25T01:39:25.370219+0000","last_fullsized":"2024-04-25T01:39:25.370219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:40.850925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397519+0000","last_change":"2024-04-25T01:39:24.389946+0000","last_active":"2024-04-25T01:39:26.397519+0000","last_peered":"2024-04-25T01:39:26.397519+0000","last_clean":"2024-04-25T01:39:26.397519+0000","last_became_active":"2024-04-25T01:39:24.389656+0000","last_became_peered":"2024-04-25T01:39:24.389656+0000","last_unstale":"2024-04-25T01:39:26.397519+0000","last_undegraded":"2024-04-25T01:39:26.397519+0000","last_fullsized":"2024-04-25T01:39:26.397519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:55.943639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T01:39:24.398465+0000","last_change":"2024-04-25T01:39:23.367322+0000","last_active":"2024-04-25T01:39:24.398465+0000","last_peered":"2024-04-25T01:39:24.398465+0000","last_clean":"2024-04-25T01:39:24.398465+0000","last_became_active":"2024-04-25T01:39:23.367054+0000","last_became_peered":"2024-04-25T01:39:23.367054+0000","last_unstale":"2024-04-25T01:39:24.398465+0000","last_undegraded":"2024-04-25T01:39:24.398465+0000","last_fullsized":"2024-04-25T01:39:24.398465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:10.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397884+0000","last_change":"2024-04-25T01:39:24.391240+0000","last_active":"2024-04-25T01:39:26.397884+0000","last_peered":"2024-04-25T01:39:26.397884+0000","last_clean":"2024-04-25T01:39:26.397884+0000","last_became_active":"2024-04-25T01:39:24.390948+0000","last_became_peered":"2024-04-25T01:39:24.390948+0000","last_unstale":"2024-04-25T01:39:26.397884+0000","last_undegraded":"2024-04-25T01:39:26.397884+0000","last_fullsized":"2024-04-25T01:39:26.397884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:41:30.579190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.370373+0000","last_change":"2024-04-25T01:39:23.369872+0000","last_active":"2024-04-25T01:39:25.370373+0000","last_peered":"2024-04-25T01:39:25.370373+0000","last_clean":"2024-04-25T01:39:25.370373+0000","last_became_active":"2024-04-25T01:39:23.369314+0000","last_became_peered":"2024-04-25T01:39:23.369314+0000","last_unstale":"2024-04-25T01:39:25.370373+0000","last_undegraded":"2024-04-25T01:39:25.370373+0000","last_fullsized":"2024-04-25T01:39:25.370373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:14.571148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.398130+0000","last_change":"2024-04-25T01:39:24.392170+0000","last_active":"2024-04-25T01:39:26.398130+0000","last_peered":"2024-04-25T01:39:26.398130+0000","last_clean":"2024-04-25T01:39:26.398130+0000","last_became_active":"2024-04-25T01:39:24.391811+0000","last_became_peered":"2024-04-25T01:39:24.391811+0000","last_unstale":"2024-04-25T01:39:26.398130+0000","last_undegraded":"2024-04-25T01:39:26.398130+0000","last_fullsized":"2024-04-25T01:39:26.398130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:32.859676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.369634+0000","last_change":"2024-04-25T01:39:23.370690+0000","last_active":"2024-04-25T01:39:25.369634+0000","last_peered":"2024-04-25T01:39:25.369634+0000","last_clean":"2024-04-25T01:39:25.369634+0000","last_became_active":"2024-04-25T01:39:23.370391+0000","last_became_peered":"2024-04-25T01:39:23.370391+0000","last_unstale":"2024-04-25T01:39:25.369634+0000","last_undegraded":"2024-04-25T01:39:25.369634+0000","last_fullsized":"2024-04-25T01:39:25.369634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:29.647636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.303157+0000","last_change":"2024-04-25T01:39:24.394286+0000","last_active":"2024-04-25T01:39:26.303157+0000","last_peered":"2024-04-25T01:39:26.303157+0000","last_clean":"2024-04-25T01:39:26.303157+0000","last_became_active":"2024-04-25T01:39:24.393558+0000","last_became_peered":"2024-04-25T01:39:24.393558+0000","last_unstale":"2024-04-25T01:39:26.303157+0000","last_undegraded":"2024-04-25T01:39:26.303157+0000","last_fullsized":"2024-04-25T01:39:26.303157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:59.100947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.370302+0000","last_change":"2024-04-25T01:39:23.368352+0000","last_active":"2024-04-25T01:39:25.370302+0000","last_peered":"2024-04-25T01:39:25.370302+0000","last_clean":"2024-04-25T01:39:25.370302+0000","last_became_active":"2024-04-25T01:39:23.368075+0000","last_became_peered":"2024-04-25T01:39:23.368075+0000","last_unstale":"2024-04-25T01:39:25.370302+0000","last_undegraded":"2024-04-25T01:39:25.370302+0000","last_fullsized":"2024-04-25T01:39:25.370302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:11.300091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397687+0000","last_change":"2024-04-25T01:39:24.394350+0000","last_active":"2024-04-25T01:39:26.397687+0000","last_peered":"2024-04-25T01:39:26.397687+0000","last_clean":"2024-04-25T01:39:26.397687+0000","last_became_active":"2024-04-25T01:39:24.393235+0000","last_became_peered":"2024-04-25T01:39:24.393235+0000","last_unstale":"2024-04-25T01:39:26.397687+0000","last_undegraded":"2024-04-25T01:39:26.397687+0000","last_fullsized":"2024-04-25T01:39:26.397687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:00:48.588700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397327+0000","last_change":"2024-04-25T01:39:12.918495+0000","last_active":"2024-04-25T01:39:26.397327+0000","last_peered":"2024-04-25T01:39:26.397327+0000","last_clean":"2024-04-25T01:39:26.397327+0000","last_became_active":"2024-04-25T01:39:12.917330+0000","last_became_peered":"2024-04-25T01:39:12.917330+0000","last_unstale":"2024-04-25T01:39:26.397327+0000","last_undegraded":"2024-04-25T01:39:26.397327+0000","last_fullsized":"2024-04-25T01:39:26.397327+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:11.731178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:11.731178+0000","last_clean_scrub_stamp":"2024-04-25T01:39:11.731178+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:26:14.153244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.302850+0000","last_change":"2024-04-25T01:39:23.367826+0000","last_active":"2024-04-25T01:39:26.302850+0000","last_peered":"2024-04-25T01:39:26.302850+0000","last_clean":"2024-04-25T01:39:26.302850+0000","last_became_active":"2024-04-25T01:39:23.367520+0000","last_became_peered":"2024-04-25T01:39:23.367520+0000","last_unstale":"2024-04-25T01:39:26.302850+0000","last_undegraded":"2024-04-25T01:39:26.302850+0000","last_fullsized":"2024-04-25T01:39:26.302850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:05.997166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.238835+0000","last_change":"2024-04-25T01:39:24.401208+0000","last_active":"2024-04-25T01:39:26.238835+0000","last_peered":"2024-04-25T01:39:26.238835+0000","last_clean":"2024-04-25T01:39:26.238835+0000","last_became_active":"2024-04-25T01:39:24.400502+0000","last_became_peered":"2024-04-25T01:39:24.400502+0000","last_unstale":"2024-04-25T01:39:26.238835+0000","last_undegraded":"2024-04-25T01:39:26.238835+0000","last_fullsized":"2024-04-25T01:39:26.238835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:55:09.076617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397257+0000","last_change":"2024-04-25T01:39:23.379767+0000","last_active":"2024-04-25T01:39:26.397257+0000","last_peered":"2024-04-25T01:39:26.397257+0000","last_clean":"2024-04-25T01:39:26.397257+0000","last_became_active":"2024-04-25T01:39:23.379294+0000","last_became_peered":"2024-04-25T01:39:23.379294+0000","last_unstale":"2024-04-25T01:39:26.397257+0000","last_undegraded":"2024-04-25T01:39:26.397257+0000","last_fullsized":"2024-04-25T01:39:26.397257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:36:37.823796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.358155+0000","last_change":"2024-04-25T01:39:24.391366+0000","last_active":"2024-04-25T01:39:26.358155+0000","last_peered":"2024-04-25T01:39:26.358155+0000","last_clean":"2024-04-25T01:39:26.358155+0000","last_became_active":"2024-04-25T01:39:24.391093+0000","last_became_peered":"2024-04-25T01:39:24.391093+0000","last_unstale":"2024-04-25T01:39:26.358155+0000","last_undegraded":"2024-04-25T01:39:26.358155+0000","last_fullsized":"2024-04-25T01:39:26.358155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:10.906935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.370384+0000","last_change":"2024-04-25T01:39:23.371019+0000","last_active":"2024-04-25T01:39:25.370384+0000","last_peered":"2024-04-25T01:39:25.370384+0000","last_clean":"2024-04-25T01:39:25.370384+0000","last_became_active":"2024-04-25T01:39:23.370727+0000","last_became_peered":"2024-04-25T01:39:23.370727+0000","last_unstale":"2024-04-25T01:39:25.370384+0000","last_undegraded":"2024-04-25T01:39:25.370384+0000","last_fullsized":"2024-04-25T01:39:25.370384+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:10.714475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.369392+0000","last_change":"2024-04-25T01:39:24.377438+0000","last_active":"2024-04-25T01:39:25.369392+0000","last_peered":"2024-04-25T01:39:25.369392+0000","last_clean":"2024-04-25T01:39:25.369392+0000","last_became_active":"2024-04-25T01:39:24.377146+0000","last_became_peered":"2024-04-25T01:39:24.377146+0000","last_unstale":"2024-04-25T01:39:25.369392+0000","last_undegraded":"2024-04-25T01:39:25.369392+0000","last_fullsized":"2024-04-25T01:39:25.369392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:54:17.698561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.303417+0000","last_change":"2024-04-25T01:39:23.375729+0000","last_active":"2024-04-25T01:39:26.303417+0000","last_peered":"2024-04-25T01:39:26.303417+0000","last_clean":"2024-04-25T01:39:26.303417+0000","last_became_active":"2024-04-25T01:39:23.375488+0000","last_became_peered":"2024-04-25T01:39:23.375488+0000","last_unstale":"2024-04-25T01:39:26.303417+0000","last_undegraded":"2024-04-25T01:39:26.303417+0000","last_fullsized":"2024-04-25T01:39:26.303417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:00.039083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T01:39:24.397536+0000","last_change":"2024-04-25T01:39:24.389203+0000","last_active":"2024-04-25T01:39:24.397536+0000","last_peered":"2024-04-25T01:39:24.397536+0000","last_clean":"2024-04-25T01:39:24.397536+0000","last_became_active":"2024-04-25T01:39:24.388306+0000","last_became_peered":"2024-04-25T01:39:24.388306+0000","last_unstale":"2024-04-25T01:39:24.397536+0000","last_undegraded":"2024-04-25T01:39:24.397536+0000","last_fullsized":"2024-04-25T01:39:24.397536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:42:22.454935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.369622+0000","last_change":"2024-04-25T01:39:23.368562+0000","last_active":"2024-04-25T01:39:25.369622+0000","last_peered":"2024-04-25T01:39:25.369622+0000","last_clean":"2024-04-25T01:39:25.369622+0000","last_became_active":"2024-04-25T01:39:23.368272+0000","last_became_peered":"2024-04-25T01:39:23.368272+0000","last_unstale":"2024-04-25T01:39:25.369622+0000","last_undegraded":"2024-04-25T01:39:25.369622+0000","last_fullsized":"2024-04-25T01:39:25.369622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:15.464993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.303444+0000","last_change":"2024-04-25T01:39:24.390844+0000","last_active":"2024-04-25T01:39:26.303444+0000","last_peered":"2024-04-25T01:39:26.303444+0000","last_clean":"2024-04-25T01:39:26.303444+0000","last_became_active":"2024-04-25T01:39:24.390543+0000","last_became_peered":"2024-04-25T01:39:24.390543+0000","last_unstale":"2024-04-25T01:39:26.303444+0000","last_undegraded":"2024-04-25T01:39:26.303444+0000","last_fullsized":"2024-04-25T01:39:26.303444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:01:03.804058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397955+0000","last_change":"2024-04-25T01:39:23.378190+0000","last_active":"2024-04-25T01:39:26.397955+0000","last_peered":"2024-04-25T01:39:26.397955+0000","last_clean":"2024-04-25T01:39:26.397955+0000","last_became_active":"2024-04-25T01:39:23.377677+0000","last_became_peered":"2024-04-25T01:39:23.377677+0000","last_unstale":"2024-04-25T01:39:26.397955+0000","last_undegraded":"2024-04-25T01:39:26.397955+0000","last_fullsized":"2024-04-25T01:39:26.397955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:09.516058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.369529+0000","last_change":"2024-04-25T01:39:24.376933+0000","last_active":"2024-04-25T01:39:25.369529+0000","last_peered":"2024-04-25T01:39:25.369529+0000","last_clean":"2024-04-25T01:39:25.369529+0000","last_became_active":"2024-04-25T01:39:24.376612+0000","last_became_peered":"2024-04-25T01:39:24.376612+0000","last_unstale":"2024-04-25T01:39:25.369529+0000","last_undegraded":"2024-04-25T01:39:25.369529+0000","last_fullsized":"2024-04-25T01:39:25.369529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:56:55.534200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.388085+0000","last_change":"2024-04-25T01:39:23.377687+0000","last_active":"2024-04-25T01:39:25.388085+0000","last_peered":"2024-04-25T01:39:25.388085+0000","last_clean":"2024-04-25T01:39:25.388085+0000","last_became_active":"2024-04-25T01:39:23.377372+0000","last_became_peered":"2024-04-25T01:39:23.377372+0000","last_unstale":"2024-04-25T01:39:25.388085+0000","last_undegraded":"2024-04-25T01:39:25.388085+0000","last_fullsized":"2024-04-25T01:39:25.388085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:51.983659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.238884+0000","last_change":"2024-04-25T01:39:24.375811+0000","last_active":"2024-04-25T01:39:26.238884+0000","last_peered":"2024-04-25T01:39:26.238884+0000","last_clean":"2024-04-25T01:39:26.238884+0000","last_became_active":"2024-04-25T01:39:24.375603+0000","last_became_peered":"2024-04-25T01:39:24.375603+0000","last_unstale":"2024-04-25T01:39:26.238884+0000","last_undegraded":"2024-04-25T01:39:26.238884+0000","last_fullsized":"2024-04-25T01:39:26.238884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:10:26.247501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.388716+0000","last_change":"2024-04-25T01:39:23.379804+0000","last_active":"2024-04-25T01:39:25.388716+0000","last_peered":"2024-04-25T01:39:25.388716+0000","last_clean":"2024-04-25T01:39:25.388716+0000","last_became_active":"2024-04-25T01:39:23.379430+0000","last_became_peered":"2024-04-25T01:39:23.379430+0000","last_unstale":"2024-04-25T01:39:25.388716+0000","last_undegraded":"2024-04-25T01:39:25.388716+0000","last_fullsized":"2024-04-25T01:39:25.388716+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:42:23.254767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.358360+0000","last_change":"2024-04-25T01:39:24.393003+0000","last_active":"2024-04-25T01:39:26.358360+0000","last_peered":"2024-04-25T01:39:26.358360+0000","last_clean":"2024-04-25T01:39:26.358360+0000","last_became_active":"2024-04-25T01:39:24.392209+0000","last_became_peered":"2024-04-25T01:39:24.392209+0000","last_unstale":"2024-04-25T01:39:26.358360+0000","last_undegraded":"2024-04-25T01:39:26.358360+0000","last_fullsized":"2024-04-25T01:39:26.358360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:44:58.432859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397277+0000","last_change":"2024-04-25T01:39:23.378993+0000","last_active":"2024-04-25T01:39:26.397277+0000","last_peered":"2024-04-25T01:39:26.397277+0000","last_clean":"2024-04-25T01:39:26.397277+0000","last_became_active":"2024-04-25T01:39:23.376908+0000","last_became_peered":"2024-04-25T01:39:23.376908+0000","last_unstale":"2024-04-25T01:39:26.397277+0000","last_undegraded":"2024-04-25T01:39:26.397277+0000","last_fullsized":"2024-04-25T01:39:26.397277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:13:18.370559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T01:39:24.397677+0000","last_change":"2024-04-25T01:39:24.386969+0000","last_active":"2024-04-25T01:39:24.397677+0000","last_peered":"2024-04-25T01:39:24.397677+0000","last_clean":"2024-04-25T01:39:24.397677+0000","last_became_active":"2024-04-25T01:39:24.386376+0000","last_became_peered":"2024-04-25T01:39:24.386376+0000","last_unstale":"2024-04-25T01:39:24.397677+0000","last_undegraded":"2024-04-25T01:39:24.397677+0000","last_fullsized":"2024-04-25T01:39:24.397677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:13.392320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.369404+0000","last_change":"2024-04-25T01:39:23.377103+0000","last_active":"2024-04-25T01:39:25.369404+0000","last_peered":"2024-04-25T01:39:25.369404+0000","last_clean":"2024-04-25T01:39:25.369404+0000","last_became_active":"2024-04-25T01:39:23.376826+0000","last_became_peered":"2024-04-25T01:39:23.376826+0000","last_unstale":"2024-04-25T01:39:25.369404+0000","last_undegraded":"2024-04-25T01:39:25.369404+0000","last_fullsized":"2024-04-25T01:39:25.369404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:46.663754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.238781+0000","last_change":"2024-04-25T01:39:24.373600+0000","last_active":"2024-04-25T01:39:26.238781+0000","last_peered":"2024-04-25T01:39:26.238781+0000","last_clean":"2024-04-25T01:39:26.238781+0000","last_became_active":"2024-04-25T01:39:24.373311+0000","last_became_peered":"2024-04-25T01:39:24.373311+0000","last_unstale":"2024-04-25T01:39:26.238781+0000","last_undegraded":"2024-04-25T01:39:26.238781+0000","last_fullsized":"2024-04-25T01:39:26.238781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:46.338959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.369528+0000","last_change":"2024-04-25T01:39:23.368446+0000","last_active":"2024-04-25T01:39:25.369528+0000","last_peered":"2024-04-25T01:39:25.369528+0000","last_clean":"2024-04-25T01:39:25.369528+0000","last_became_active":"2024-04-25T01:39:23.368183+0000","last_became_peered":"2024-04-25T01:39:23.368183+0000","last_unstale":"2024-04-25T01:39:25.369528+0000","last_undegraded":"2024-04-25T01:39:25.369528+0000","last_fullsized":"2024-04-25T01:39:25.369528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:13.738756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.239054+0000","last_change":"2024-04-25T01:39:24.387100+0000","last_active":"2024-04-25T01:39:26.239054+0000","last_peered":"2024-04-25T01:39:26.239054+0000","last_clean":"2024-04-25T01:39:26.239054+0000","last_became_active":"2024-04-25T01:39:24.386782+0000","last_became_peered":"2024-04-25T01:39:24.386782+0000","last_unstale":"2024-04-25T01:39:26.239054+0000","last_undegraded":"2024-04-25T01:39:26.239054+0000","last_fullsized":"2024-04-25T01:39:26.239054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:48.789139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397769+0000","last_change":"2024-04-25T01:39:23.377717+0000","last_active":"2024-04-25T01:39:26.397769+0000","last_peered":"2024-04-25T01:39:26.397769+0000","last_clean":"2024-04-25T01:39:26.397769+0000","last_became_active":"2024-04-25T01:39:23.377291+0000","last_became_peered":"2024-04-25T01:39:23.377291+0000","last_unstale":"2024-04-25T01:39:26.397769+0000","last_undegraded":"2024-04-25T01:39:26.397769+0000","last_fullsized":"2024-04-25T01:39:26.397769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:06.402745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:25.388528+0000","last_change":"2024-04-25T01:39:24.398859+0000","last_active":"2024-04-25T01:39:25.388528+0000","last_peered":"2024-04-25T01:39:25.388528+0000","last_clean":"2024-04-25T01:39:25.388528+0000","last_became_active":"2024-04-25T01:39:24.398618+0000","last_became_peered":"2024-04-25T01:39:24.398618+0000","last_unstale":"2024-04-25T01:39:25.388528+0000","last_undegraded":"2024-04-25T01:39:25.388528+0000","last_fullsized":"2024-04-25T01:39:25.388528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:15.278376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.303351+0000","last_change":"2024-04-25T01:39:24.393293+0000","last_active":"2024-04-25T01:39:26.303351+0000","last_peered":"2024-04-25T01:39:26.303351+0000","last_clean":"2024-04-25T01:39:26.303351+0000","last_became_active":"2024-04-25T01:39:24.393005+0000","last_became_peered":"2024-04-25T01:39:24.393005+0000","last_unstale":"2024-04-25T01:39:26.303351+0000","last_undegraded":"2024-04-25T01:39:26.303351+0000","last_fullsized":"2024-04-25T01:39:26.303351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:32.070747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397598+0000","last_change":"2024-04-25T01:39:23.377093+0000","last_active":"2024-04-25T01:39:26.397598+0000","last_peered":"2024-04-25T01:39:26.397598+0000","last_clean":"2024-04-25T01:39:26.397598+0000","last_became_active":"2024-04-25T01:39:23.376744+0000","last_became_peered":"2024-04-25T01:39:23.376744+0000","last_unstale":"2024-04-25T01:39:26.397598+0000","last_undegraded":"2024-04-25T01:39:26.397598+0000","last_fullsized":"2024-04-25T01:39:26.397598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:43.529618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.303018+0000","last_change":"2024-04-25T01:39:24.394512+0000","last_active":"2024-04-25T01:39:26.303018+0000","last_peered":"2024-04-25T01:39:26.303018+0000","last_clean":"2024-04-25T01:39:26.303018+0000","last_became_active":"2024-04-25T01:39:24.393954+0000","last_became_peered":"2024-04-25T01:39:24.393954+0000","last_unstale":"2024-04-25T01:39:26.303018+0000","last_undegraded":"2024-04-25T01:39:26.303018+0000","last_fullsized":"2024-04-25T01:39:26.303018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:30.534400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.397846+0000","last_change":"2024-04-25T01:39:23.377963+0000","last_active":"2024-04-25T01:39:26.397846+0000","last_peered":"2024-04-25T01:39:26.397846+0000","last_clean":"2024-04-25T01:39:26.397846+0000","last_became_active":"2024-04-25T01:39:23.377402+0000","last_became_peered":"2024-04-25T01:39:23.377402+0000","last_unstale":"2024-04-25T01:39:26.397846+0000","last_undegraded":"2024-04-25T01:39:26.397846+0000","last_fullsized":"2024-04-25T01:39:26.397846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:15.873450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.358353+0000","last_change":"2024-04-25T01:39:24.403873+0000","last_active":"2024-04-25T01:39:26.358353+0000","last_peered":"2024-04-25T01:39:26.358353+0000","last_clean":"2024-04-25T01:39:26.358353+0000","last_became_active":"2024-04-25T01:39:24.403623+0000","last_became_peered":"2024-04-25T01:39:24.403623+0000","last_unstale":"2024-04-25T01:39:26.358353+0000","last_undegraded":"2024-04-25T01:39:26.358353+0000","last_fullsized":"2024-04-25T01:39:26.358353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:49.360933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.238974+0000","last_change":"2024-04-25T01:39:23.369400+0000","last_active":"2024-04-25T01:39:26.238974+0000","last_peered":"2024-04-25T01:39:26.238974+0000","last_clean":"2024-04-25T01:39:26.238974+0000","last_became_active":"2024-04-25T01:39:23.368726+0000","last_became_peered":"2024-04-25T01:39:23.368726+0000","last_unstale":"2024-04-25T01:39:26.238974+0000","last_undegraded":"2024-04-25T01:39:26.238974+0000","last_fullsized":"2024-04-25T01:39:26.238974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:35:42.971179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.238990+0000","last_change":"2024-04-25T01:39:24.394317+0000","last_active":"2024-04-25T01:39:26.238990+0000","last_peered":"2024-04-25T01:39:26.238990+0000","last_clean":"2024-04-25T01:39:26.238990+0000","last_became_active":"2024-04-25T01:39:24.394032+0000","last_became_peered":"2024-04-25T01:39:24.394032+0000","last_unstale":"2024-04-25T01:39:26.238990+0000","last_undegraded":"2024-04-25T01:39:26.238990+0000","last_fullsized":"2024-04-25T01:39:26.238990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:11.795443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T01:39:26.358465+0000","last_change":"2024-04-25T01:39:23.377096+0000","last_active":"2024-04-25T01:39:26.358465+0000","last_peered":"2024-04-25T01:39:26.358465+0000","last_clean":"2024-04-25T01:39:26.358465+0000","last_became_active":"2024-04-25T01:39:23.376811+0000","last_became_peered":"2024-04-25T01:39:23.376811+0000","last_unstale":"2024-04-25T01:39:26.358465+0000","last_undegraded":"2024-04-25T01:39:26.358465+0000","last_fullsized":"2024-04-25T01:39:26.358465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:26.888605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":655529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":64705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":655585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T01:39:28.658 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T01:39:28.658 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T01:39:28.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.808+0000 7f9df94ee640 1 Processor -- start 2024-04-25T01:39:28.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.808+0000 7f9df94ee640 1 -- start start 2024-04-25T01:39:28.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.809+0000 7f9df94ee640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9df4150090 0x7f9df4156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:28.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.809+0000 7f9df94ee640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9df406c280 0x7f9df40c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:28.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.809+0000 7f9df94ee640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9df40c89c0 con 0x7f9df40c8200 2024-04-25T01:39:28.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.809+0000 7f9df94ee640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9df406b830 con 0x7f9df4150090 2024-04-25T01:39:28.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.809+0000 7f9df94ee640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9df40c8ca0 con 0x7f9df406c280 2024-04-25T01:39:28.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.809+0000 7f9df2ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9df4150090 0x7f9df4156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:28.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.809+0000 7f9df27fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9df40c8200 0x7f9df40c98a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36934/0 (socket says 172.21.15.77:36934) 2024-04-25T01:39:28.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.809+0000 7f9df27fc640 1 -- 172.21.15.77:0/3210103620 learned_addr learned my addr 172.21.15.77:0/3210103620 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:28.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.809+0000 7f9df37fe640 1 --2- 172.21.15.77:0/3210103620 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9df406c280 0x7f9df40c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:28.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.809+0000 7f9df2ffd640 1 -- 172.21.15.77:0/3210103620 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9df406c280 msgr2=0x7f9df40c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:28.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.809+0000 7f9df2ffd640 1 --2- 172.21.15.77:0/3210103620 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9df406c280 0x7f9df40c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.809+0000 7f9df2ffd640 1 -- 172.21.15.77:0/3210103620 >> v1:172.21.15.77:6789/0 conn(0x7f9df40c8200 legacy=0x7f9df40c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:28.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.809+0000 7f9df2ffd640 1 -- 172.21.15.77:0/3210103620 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df406ba80 con 0x7f9df4150090 2024-04-25T01:39:28.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.809+0000 7f9df1ffb640 1 -- 172.21.15.77:0/3210103620 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1617760566 0 0) 0x7f9df40c89c0 con 0x7f9df40c8200 2024-04-25T01:39:28.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.810+0000 7f9df2ffd640 1 --2- 172.21.15.77:0/3210103620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9df4150090 0x7f9df4156c80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9de4009d90 tx=0x7f9de402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6540c72b6ae410d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:28.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.810+0000 7f9df1ffb640 1 -- 172.21.15.77:0/3210103620 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de4007740 con 0x7f9df4150090 2024-04-25T01:39:28.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.810+0000 7f9df1ffb640 1 -- 172.21.15.77:0/3210103620 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9de40078e0 con 0x7f9df4150090 2024-04-25T01:39:28.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.810+0000 7f9df1ffb640 1 -- 172.21.15.77:0/3210103620 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de4007cb0 con 0x7f9df4150090 2024-04-25T01:39:28.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.810+0000 7f9df94ee640 1 -- 172.21.15.77:0/3210103620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9df4150090 msgr2=0x7f9df4156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:28.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.810+0000 7f9df94ee640 1 --2- 172.21.15.77:0/3210103620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9df4150090 0x7f9df4156c80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9de4009d90 tx=0x7f9de402a660 comp rx=0 tx=0).stop 2024-04-25T01:39:28.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.810+0000 7f9df94ee640 1 -- 172.21.15.77:0/3210103620 shutdown_connections 2024-04-25T01:39:28.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.810+0000 7f9df94ee640 1 --2- 172.21.15.77:0/3210103620 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9df406c280 0x7f9df40c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.810+0000 7f9df94ee640 1 --2- 172.21.15.77:0/3210103620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9df4150090 0x7f9df4156c80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.810+0000 7f9df94ee640 1 -- 172.21.15.77:0/3210103620 >> 172.21.15.77:0/3210103620 conn(0x7f9df40ad4d0 msgr2=0x7f9df40ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:28.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.810+0000 7f9df94ee640 1 -- 172.21.15.77:0/3210103620 shutdown_connections 2024-04-25T01:39:28.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.810+0000 7f9df94ee640 1 -- 172.21.15.77:0/3210103620 wait complete. 2024-04-25T01:39:28.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.812+0000 7f9df94ee640 1 Processor -- start 2024-04-25T01:39:28.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.812+0000 7f9df94ee640 1 -- start start 2024-04-25T01:39:28.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.812+0000 7f9df94ee640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9df406c280 0x7f9df414cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:28.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.812+0000 7f9df94ee640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9df40c8200 0x7f9df40c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:28.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.812+0000 7f9df94ee640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9df4150090 0x7f9df40c2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:28.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.812+0000 7f9df94ee640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9df406c6b0 con 0x7f9df4150090 2024-04-25T01:39:28.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.812+0000 7f9df94ee640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9df40c86b0 con 0x7f9df40c8200 2024-04-25T01:39:28.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.812+0000 7f9df94ee640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9df406c830 con 0x7f9df406c280 2024-04-25T01:39:28.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.812+0000 7f9df37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9df4150090 0x7f9df40c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:28.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.812+0000 7f9df37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9df4150090 0x7f9df40c2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58402/0 (socket says 172.21.15.77:58402) 2024-04-25T01:39:28.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.812+0000 7f9df37fe640 1 -- 172.21.15.77:0/3346492198 learned_addr learned my addr 172.21.15.77:0/3346492198 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:28.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.813+0000 7f9df2ffd640 1 --2- 172.21.15.77:0/3346492198 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9df406c280 0x7f9df414cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:28.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.813+0000 7f9df27fc640 1 --2- 172.21.15.77:0/3346492198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9df40c8200 0x7f9df40c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:28.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.813+0000 7f9df37fe640 1 -- 172.21.15.77:0/3346492198 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9df406c280 msgr2=0x7f9df414cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:28.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.813+0000 7f9df37fe640 1 --2- 172.21.15.77:0/3346492198 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9df406c280 0x7f9df414cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.813+0000 7f9df37fe640 1 -- 172.21.15.77:0/3346492198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9df40c8200 msgr2=0x7f9df40c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:28.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.813+0000 7f9df37fe640 1 --2- 172.21.15.77:0/3346492198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9df40c8200 0x7f9df40c1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.813+0000 7f9df37fe640 1 -- 172.21.15.77:0/3346492198 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df41ec760 con 0x7f9df4150090 2024-04-25T01:39:28.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.813+0000 7f9df2ffd640 1 --2- 172.21.15.77:0/3346492198 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9df406c280 0x7f9df414cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:28.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.813+0000 7f9df27fc640 1 --2- 172.21.15.77:0/3346492198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9df40c8200 0x7f9df40c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:28.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.813+0000 7f9df37fe640 1 --2- 172.21.15.77:0/3346492198 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9df4150090 0x7f9df40c2180 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00d830 tx=0x7f9dec00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:28.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.813+0000 7f9ddb7fe640 1 -- 172.21.15.77:0/3346492198 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dec00b6c0 con 0x7f9df4150090 2024-04-25T01:39:28.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.813+0000 7f9ddb7fe640 1 -- 172.21.15.77:0/3346492198 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dec019070 con 0x7f9df4150090 2024-04-25T01:39:28.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.813+0000 7f9ddb7fe640 1 -- 172.21.15.77:0/3346492198 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dec00bac0 con 0x7f9df4150090 2024-04-25T01:39:28.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.813+0000 7f9df94ee640 1 -- 172.21.15.77:0/3346492198 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9df41599a0 con 0x7f9df4150090 2024-04-25T01:39:28.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.813+0000 7f9df94ee640 1 -- 172.21.15.77:0/3346492198 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9df4159c40 con 0x7f9df4150090 2024-04-25T01:39:28.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.814+0000 7f9df94ee640 1 -- 172.21.15.77:0/3346492198 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9df404f500 con 0x7f9df4150090 2024-04-25T01:39:28.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.814+0000 7f9ddb7fe640 1 -- 172.21.15.77:0/3346492198 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9dec01e460 con 0x7f9df4150090 2024-04-25T01:39:28.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.815+0000 7f9ddb7fe640 1 --2- 172.21.15.77:0/3346492198 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9de006be30 0x7f9de006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:28.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.815+0000 7f9ddb7fe640 1 -- 172.21.15.77:0/3346492198 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7f9dec08b450 con 0x7f9df4150090 2024-04-25T01:39:28.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.815+0000 7f9df2ffd640 1 --2- 172.21.15.77:0/3346492198 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9de006be30 0x7f9de006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:28.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.815+0000 7f9df2ffd640 1 --2- 172.21.15.77:0/3346492198 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9de006be30 0x7f9de006e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9de4034000 tx=0x7f9de4033040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:28.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.819+0000 7f9ddb7fe640 1 -- 172.21.15.77:0/3346492198 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9dec059ea0 con 0x7f9df4150090 2024-04-25T01:39:28.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.992+0000 7f9df94ee640 1 -- 172.21.15.77:0/3346492198 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9df41540e0 con 0x7f9df4150090 2024-04-25T01:39:28.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.993+0000 7f9ddb7fe640 1 -- 172.21.15.77:0/3346492198 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16573 (secure 0 0 0) 0x7f9dec0597a0 con 0x7f9df4150090 2024-04-25T01:39:28.976 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:28.976 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:39:25.366039+0000","last_up_change":"2024-04-25T01:39:10.729600+0000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T01:39:11.681151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T01:39:21.606752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T01:39:22.677664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6811","nonce":3366980158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6817","nonce":3366980158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6828","nonce":3366980158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6825","nonce":3366980158}]},"public_addr":"172.21.15.77:6811/3366980158","cluster_addr":"172.21.15.77:6817/3366980158","heartbeat_back_addr":"172.21.15.77:6828/3366980158","heartbeat_front_addr":"172.21.15.77:6825/3366980158","state":["exists","up"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6801","nonce":3971619298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6803","nonce":3971619298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6807","nonce":3971619298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6805","nonce":3971619298}]},"public_addr":"172.21.15.77:6801/3971619298","cluster_addr":"172.21.15.77:6803/3971619298","heartbeat_back_addr":"172.21.15.77:6807/3971619298","heartbeat_front_addr":"172.21.15.77:6805/3971619298","state":["exists","up"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6810","nonce":4103452689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6813","nonce":4103452689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6823","nonce":4103452689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6818","nonce":4103452689}]},"public_addr":"172.21.15.77:6810/4103452689","cluster_addr":"172.21.15.77:6813/4103452689","heartbeat_back_addr":"172.21.15.77:6823/4103452689","heartbeat_front_addr":"172.21.15.77:6818/4103452689","state":["exists","up"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6819","nonce":217398906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6824","nonce":217398906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6831","nonce":217398906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6829","nonce":217398906}]},"public_addr":"172.21.15.77:6819/217398906","cluster_addr":"172.21.15.77:6824/217398906","heartbeat_back_addr":"172.21.15.77:6831/217398906","heartbeat_front_addr":"172.21.15.77:6829/217398906","state":["exists","up"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6801","nonce":2565483070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6803","nonce":2565483070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6810","nonce":2565483070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6806","nonce":2565483070}]},"public_addr":"172.21.15.121:6801/2565483070","cluster_addr":"172.21.15.121:6803/2565483070","heartbeat_back_addr":"172.21.15.121:6810/2565483070","heartbeat_front_addr":"172.21.15.121:6806/2565483070","state":["exists","up"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6807","nonce":2785294752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6809","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6811","nonce":2785294752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6815","nonce":2785294752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6813","nonce":2785294752}]},"public_addr":"172.21.15.121:6807/2785294752","cluster_addr":"172.21.15.121:6811/2785294752","heartbeat_back_addr":"172.21.15.121:6815/2785294752","heartbeat_front_addr":"172.21.15.121:6813/2785294752","state":["exists","up"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6820","nonce":523906818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6824","nonce":523906818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6831","nonce":523906818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6828","nonce":523906818}]},"public_addr":"172.21.15.121:6820/523906818","cluster_addr":"172.21.15.121:6824/523906818","heartbeat_back_addr":"172.21.15.121:6831/523906818","heartbeat_front_addr":"172.21.15.121:6828/523906818","state":["exists","up"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6817","nonce":1683602459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6819","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6821","nonce":1683602459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6829","nonce":1683602459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6823","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6825","nonce":1683602459}]},"public_addr":"172.21.15.121:6817/1683602459","cluster_addr":"172.21.15.121:6821/1683602459","heartbeat_back_addr":"172.21.15.121:6829/1683602459","heartbeat_front_addr":"172.21.15.121:6825/1683602459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.839443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.818842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.776243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.793085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.822396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.907311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.918374+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.848430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:39:28.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.995+0000 7f9df94ee640 1 -- 172.21.15.77:0/3346492198 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9de006be30 msgr2=0x7f9de006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:28.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.995+0000 7f9df94ee640 1 --2- 172.21.15.77:0/3346492198 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9de006be30 0x7f9de006e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9de4034000 tx=0x7f9de4033040 comp rx=0 tx=0).stop 2024-04-25T01:39:28.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.995+0000 7f9df94ee640 1 -- 172.21.15.77:0/3346492198 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9df4150090 msgr2=0x7f9df40c2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:28.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.995+0000 7f9df94ee640 1 --2- 172.21.15.77:0/3346492198 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9df4150090 0x7f9df40c2180 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00d830 tx=0x7f9dec00dcf0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.995+0000 7f9df94ee640 1 -- 172.21.15.77:0/3346492198 shutdown_connections 2024-04-25T01:39:28.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.995+0000 7f9df94ee640 1 --2- 172.21.15.77:0/3346492198 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9de006be30 0x7f9de006e2f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.995+0000 7f9df94ee640 1 --2- 172.21.15.77:0/3346492198 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9df4150090 0x7f9df40c2180 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.995+0000 7f9df94ee640 1 --2- 172.21.15.77:0/3346492198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9df40c8200 0x7f9df40c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.995+0000 7f9df94ee640 1 --2- 172.21.15.77:0/3346492198 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9df406c280 0x7f9df414cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:28.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.995+0000 7f9df94ee640 1 -- 172.21.15.77:0/3346492198 >> 172.21.15.77:0/3346492198 conn(0x7f9df40ad4d0 msgr2=0x7f9df40746e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:28.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.995+0000 7f9df94ee640 1 -- 172.21.15.77:0/3346492198 shutdown_connections 2024-04-25T01:39:28.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:28.995+0000 7f9df94ee640 1 -- 172.21.15.77:0/3346492198 wait complete. 2024-04-25T01:39:28.989 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T01:39:11.681151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-25T01:39:21.606752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-25T01:39:22.677664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T01:39:28.989 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T01:39:29.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.106+0000 7fcace163640 1 Processor -- start 2024-04-25T01:39:29.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.106+0000 7fcace163640 1 -- start start 2024-04-25T01:39:29.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.107+0000 7fcace163640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcac80c6c50 0x7fcac80abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:29.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.107+0000 7fcace163640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcac80c4d10 0x7fcac80ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:29.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.107+0000 7fcace163640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcac80acf70 con 0x7fcac806d470 2024-04-25T01:39:29.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.107+0000 7fcace163640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fcac80acd20 con 0x7fcac80c4d10 2024-04-25T01:39:29.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.107+0000 7fcace163640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fcac8153120 con 0x7fcac80c6c50 2024-04-25T01:39:29.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.107+0000 7fcac7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcac80c4d10 0x7fcac80ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:29.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.107+0000 7fcac7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcac80c4d10 0x7fcac80ac4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58418/0 (socket says 172.21.15.77:58418) 2024-04-25T01:39:29.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.107+0000 7fcac7fff640 1 -- 172.21.15.77:0/814712229 learned_addr learned my addr 172.21.15.77:0/814712229 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:29.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.107+0000 7fcac6ffd640 1 --2- 172.21.15.77:0/814712229 >> v2:172.21.15.121:3300/0 conn(0x7fcac80c6c50 0x7fcac80abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:29.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.107+0000 7fcac7fff640 1 -- 172.21.15.77:0/814712229 >> v2:172.21.15.121:3300/0 conn(0x7fcac80c6c50 msgr2=0x7fcac80abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:29.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.107+0000 7fcac7fff640 1 --2- 172.21.15.77:0/814712229 >> v2:172.21.15.121:3300/0 conn(0x7fcac80c6c50 0x7fcac80abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.107+0000 7fcac7fff640 1 -- 172.21.15.77:0/814712229 >> v1:172.21.15.121:6789/0 conn(0x7fcac806d470 legacy=0x7fcac806d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:29.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.107+0000 7fcac7fff640 1 -- 172.21.15.77:0/814712229 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac8153400 con 0x7fcac80c4d10 2024-04-25T01:39:29.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.108+0000 7fcac7fff640 1 --2- 172.21.15.77:0/814712229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcac80c4d10 0x7fcac80ac4d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcac80c8310 tx=0x7fcac002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801b06795c2218ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:29.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.108+0000 7fcac67fc640 1 -- 172.21.15.77:0/814712229 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac0036070 con 0x7fcac80c4d10 2024-04-25T01:39:29.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.108+0000 7fcac67fc640 1 -- 172.21.15.77:0/814712229 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcac0031600 con 0x7fcac80c4d10 2024-04-25T01:39:29.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.108+0000 7fcac67fc640 1 -- 172.21.15.77:0/814712229 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac00319d0 con 0x7fcac80c4d10 2024-04-25T01:39:29.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.109+0000 7fcace163640 1 -- 172.21.15.77:0/814712229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcac80c4d10 msgr2=0x7fcac80ac4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:29.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.109+0000 7fcace163640 1 --2- 172.21.15.77:0/814712229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcac80c4d10 0x7fcac80ac4d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcac80c8310 tx=0x7fcac002a610 comp rx=0 tx=0).stop 2024-04-25T01:39:29.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.109+0000 7fcace163640 1 -- 172.21.15.77:0/814712229 shutdown_connections 2024-04-25T01:39:29.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.109+0000 7fcace163640 1 --2- 172.21.15.77:0/814712229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcac80c4d10 0x7fcac80ac4d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.109+0000 7fcace163640 1 --2- 172.21.15.77:0/814712229 >> v2:172.21.15.121:3300/0 conn(0x7fcac80c6c50 0x7fcac80abf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.109+0000 7fcace163640 1 -- 172.21.15.77:0/814712229 >> 172.21.15.77:0/814712229 conn(0x7fcac80c7580 msgr2=0x7fcac80c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:29.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.109+0000 7fcace163640 1 -- 172.21.15.77:0/814712229 shutdown_connections 2024-04-25T01:39:29.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.109+0000 7fcace163640 1 -- 172.21.15.77:0/814712229 wait complete. 2024-04-25T01:39:29.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.110+0000 7fcace163640 1 Processor -- start 2024-04-25T01:39:29.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.110+0000 7fcace163640 1 -- start start 2024-04-25T01:39:29.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.110+0000 7fcace163640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcac806d470 0x7fcac8148d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:29.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.111+0000 7fcace163640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcac80c4d10 0x7fcac81492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:29.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.111+0000 7fcace163640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcac80c6c50 0x7fcac81ed9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:29.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.111+0000 7fcace163640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcac80c4410 con 0x7fcac806d470 2024-04-25T01:39:29.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.111+0000 7fcace163640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcac80c4290 con 0x7fcac80c6c50 2024-04-25T01:39:29.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.111+0000 7fcace163640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fcac80c4590 con 0x7fcac80c4d10 2024-04-25T01:39:29.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.111+0000 7fcac77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcac806d470 0x7fcac8148d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:29.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.111+0000 7fcac77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcac806d470 0x7fcac8148d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58422/0 (socket says 172.21.15.77:58422) 2024-04-25T01:39:29.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.111+0000 7fcac77fe640 1 -- 172.21.15.77:0/3294612230 learned_addr learned my addr 172.21.15.77:0/3294612230 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:29.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.111+0000 7fcac77fe640 1 -- 172.21.15.77:0/3294612230 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcac80c4d10 msgr2=0x7fcac81492d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:29.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.111+0000 7fcac77fe640 1 --2- 172.21.15.77:0/3294612230 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcac80c4d10 0x7fcac81492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.111+0000 7fcac77fe640 1 -- 172.21.15.77:0/3294612230 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcac80c6c50 msgr2=0x7fcac81ed9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:29.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.111+0000 7fcac77fe640 1 --2- 172.21.15.77:0/3294612230 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcac80c6c50 0x7fcac81ed9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.111+0000 7fcac77fe640 1 -- 172.21.15.77:0/3294612230 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac80c18f0 con 0x7fcac806d470 2024-04-25T01:39:29.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.111+0000 7fcac77fe640 1 --2- 172.21.15.77:0/3294612230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcac806d470 0x7fcac8148d90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcab800c450 tx=0x7fcab800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:29.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.111+0000 7fcaaffff640 1 -- 172.21.15.77:0/3294612230 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab8017070 con 0x7fcac806d470 2024-04-25T01:39:29.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.111+0000 7fcaaffff640 1 -- 172.21.15.77:0/3294612230 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcab80052d0 con 0x7fcac806d470 2024-04-25T01:39:29.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.111+0000 7fcaaffff640 1 -- 172.21.15.77:0/3294612230 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab8003830 con 0x7fcac806d470 2024-04-25T01:39:29.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.111+0000 7fcace163640 1 -- 172.21.15.77:0/3294612230 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcac80c1bd0 con 0x7fcac806d470 2024-04-25T01:39:29.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.111+0000 7fcace163640 1 -- 172.21.15.77:0/3294612230 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcac8150bb0 con 0x7fcac806d470 2024-04-25T01:39:29.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.112+0000 7fcace163640 1 -- 172.21.15.77:0/3294612230 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcac80bc750 con 0x7fcac806d470 2024-04-25T01:39:29.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.113+0000 7fcaaffff640 1 -- 172.21.15.77:0/3294612230 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcab801a070 con 0x7fcac806d470 2024-04-25T01:39:29.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.113+0000 7fcaaffff640 1 --2- 172.21.15.77:0/3294612230 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fcab406be30 0x7fcab406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:29.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.113+0000 7fcaaffff640 1 -- 172.21.15.77:0/3294612230 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7fcab808a250 con 0x7fcac806d470 2024-04-25T01:39:29.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.113+0000 7fcac6ffd640 1 --2- 172.21.15.77:0/3294612230 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fcab406be30 0x7fcab406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:29.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.113+0000 7fcac6ffd640 1 --2- 172.21.15.77:0/3294612230 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fcab406be30 0x7fcab406e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcabc006fd0 tx=0x7fcabc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:29.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.117+0000 7fcaaffff640 1 -- 172.21.15.77:0/3294612230 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcab8058c10 con 0x7fcac806d470 2024-04-25T01:39:29.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.292+0000 7fcace163640 1 -- 172.21.15.77:0/3294612230 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcac804f500 con 0x7fcac806d470 2024-04-25T01:39:29.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.292+0000 7fcaaffff640 1 -- 172.21.15.77:0/3294612230 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fcab8058510 con 0x7fcac806d470 2024-04-25T01:39:29.275 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-25T01:39:29.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.294+0000 7fcace163640 1 -- 172.21.15.77:0/3294612230 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fcab406be30 msgr2=0x7fcab406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:29.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.294+0000 7fcace163640 1 --2- 172.21.15.77:0/3294612230 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fcab406be30 0x7fcab406e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcabc006fd0 tx=0x7fcabc008040 comp rx=0 tx=0).stop 2024-04-25T01:39:29.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.294+0000 7fcace163640 1 -- 172.21.15.77:0/3294612230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcac806d470 msgr2=0x7fcac8148d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:29.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.294+0000 7fcace163640 1 --2- 172.21.15.77:0/3294612230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcac806d470 0x7fcac8148d90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcab800c450 tx=0x7fcab800c910 comp rx=0 tx=0).stop 2024-04-25T01:39:29.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.294+0000 7fcace163640 1 -- 172.21.15.77:0/3294612230 shutdown_connections 2024-04-25T01:39:29.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.294+0000 7fcace163640 1 --2- 172.21.15.77:0/3294612230 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fcab406be30 0x7fcab406e2f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.294+0000 7fcace163640 1 --2- 172.21.15.77:0/3294612230 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcac80c6c50 0x7fcac81ed9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.294+0000 7fcace163640 1 --2- 172.21.15.77:0/3294612230 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcac80c4d10 0x7fcac81492d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.294+0000 7fcace163640 1 --2- 172.21.15.77:0/3294612230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcac806d470 0x7fcac8148d90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.294+0000 7fcace163640 1 -- 172.21.15.77:0/3294612230 >> 172.21.15.77:0/3294612230 conn(0x7fcac80c7580 msgr2=0x7fcac8072390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:29.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.294+0000 7fcace163640 1 -- 172.21.15.77:0/3294612230 shutdown_connections 2024-04-25T01:39:29.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.294+0000 7fcace163640 1 -- 172.21.15.77:0/3294612230 wait complete. 2024-04-25T01:39:29.288 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-25T01:39:29.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.404+0000 7fe28edb7640 1 Processor -- start 2024-04-25T01:39:29.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.404+0000 7fe28edb7640 1 -- start start 2024-04-25T01:39:29.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.405+0000 7fe28edb7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2880cbef0 0x7fe288156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:29.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.405+0000 7fe28edb7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe28815a0e0 0x7fe2880c9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:29.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.405+0000 7fe28edb7640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe28814fd20 0x7fe2881501b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:29.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.405+0000 7fe28edb7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe2880c6ca0 con 0x7fe28815a0e0 2024-04-25T01:39:29.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.405+0000 7fe28edb7640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fe2880c66e0 con 0x7fe28814fd20 2024-04-25T01:39:29.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.405+0000 7fe28edb7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe2880c69c0 con 0x7fe2880cbef0 2024-04-25T01:39:29.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.405+0000 7fe287fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe28815a0e0 0x7fe2880c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:29.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.405+0000 7fe287fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe28815a0e0 0x7fe2880c9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58438/0 (socket says 172.21.15.77:58438) 2024-04-25T01:39:29.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.405+0000 7fe287fff640 1 -- 172.21.15.77:0/795177382 learned_addr learned my addr 172.21.15.77:0/795177382 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:29.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.405+0000 7fe28d354640 1 --2- 172.21.15.77:0/795177382 >> v2:172.21.15.121:3300/0 conn(0x7fe28814fd20 0x7fe2881501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:29.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.405+0000 7fe28cb53640 1 --2- 172.21.15.77:0/795177382 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2880cbef0 0x7fe288156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:29.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.405+0000 7fe287fff640 1 -- 172.21.15.77:0/795177382 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2880cbef0 msgr2=0x7fe288156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:29.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.405+0000 7fe287fff640 1 --2- 172.21.15.77:0/795177382 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2880cbef0 0x7fe288156ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.405+0000 7fe287fff640 1 -- 172.21.15.77:0/795177382 >> v2:172.21.15.121:3300/0 conn(0x7fe28814fd20 msgr2=0x7fe2881501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:29.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.405+0000 7fe287fff640 1 --2- 172.21.15.77:0/795177382 >> v2:172.21.15.121:3300/0 conn(0x7fe28814fd20 0x7fe2881501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.405+0000 7fe287fff640 1 -- 172.21.15.77:0/795177382 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2881598e0 con 0x7fe28815a0e0 2024-04-25T01:39:29.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.406+0000 7fe28d354640 1 --2- 172.21.15.77:0/795177382 >> v2:172.21.15.121:3300/0 conn(0x7fe28814fd20 0x7fe2881501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:29.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.406+0000 7fe28cb53640 1 --2- 172.21.15.77:0/795177382 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2880cbef0 0x7fe288156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:29.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.406+0000 7fe287fff640 1 --2- 172.21.15.77:0/795177382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28815a0e0 0x7fe2880c9810 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe2880c8170 tx=0x7fe27c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29f7c051e94230a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:29.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.406+0000 7fe2877fe640 1 -- 172.21.15.77:0/795177382 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c037070 con 0x7fe28815a0e0 2024-04-25T01:39:29.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.406+0000 7fe2877fe640 1 -- 172.21.15.77:0/795177382 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe27c032440 con 0x7fe28815a0e0 2024-04-25T01:39:29.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.406+0000 7fe2877fe640 1 -- 172.21.15.77:0/795177382 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c032810 con 0x7fe28815a0e0 2024-04-25T01:39:29.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.407+0000 7fe28edb7640 1 -- 172.21.15.77:0/795177382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28815a0e0 msgr2=0x7fe2880c9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:29.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.407+0000 7fe28edb7640 1 --2- 172.21.15.77:0/795177382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28815a0e0 0x7fe2880c9810 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe2880c8170 tx=0x7fe27c02a140 comp rx=0 tx=0).stop 2024-04-25T01:39:29.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.407+0000 7fe28edb7640 1 -- 172.21.15.77:0/795177382 shutdown_connections 2024-04-25T01:39:29.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.407+0000 7fe28edb7640 1 --2- 172.21.15.77:0/795177382 >> v2:172.21.15.121:3300/0 conn(0x7fe28814fd20 0x7fe2881501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.407+0000 7fe28edb7640 1 --2- 172.21.15.77:0/795177382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28815a0e0 0x7fe2880c9810 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.407+0000 7fe28edb7640 1 --2- 172.21.15.77:0/795177382 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2880cbef0 0x7fe288156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.407+0000 7fe28edb7640 1 -- 172.21.15.77:0/795177382 >> 172.21.15.77:0/795177382 conn(0x7fe288067080 msgr2=0x7fe288067460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:29.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.407+0000 7fe28edb7640 1 -- 172.21.15.77:0/795177382 shutdown_connections 2024-04-25T01:39:29.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.407+0000 7fe28edb7640 1 -- 172.21.15.77:0/795177382 wait complete. 2024-04-25T01:39:29.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.408+0000 7fe28edb7640 1 Processor -- start 2024-04-25T01:39:29.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.408+0000 7fe28edb7640 1 -- start start 2024-04-25T01:39:29.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.409+0000 7fe28edb7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2880cbef0 0x7fe2881ec250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:29.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.409+0000 7fe28edb7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe28814fd20 0x7fe2880c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:29.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.409+0000 7fe28edb7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28815a0e0 0x7fe2881ef390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:29.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.409+0000 7fe28edb7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe28806d0d0 con 0x7fe28815a0e0 2024-04-25T01:39:29.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.409+0000 7fe28edb7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe2880c9d50 con 0x7fe28814fd20 2024-04-25T01:39:29.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.409+0000 7fe28edb7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe28815a500 con 0x7fe2880cbef0 2024-04-25T01:39:29.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.409+0000 7fe28d354640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28815a0e0 0x7fe2881ef390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:29.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.409+0000 7fe28d354640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28815a0e0 0x7fe2881ef390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58448/0 (socket says 172.21.15.77:58448) 2024-04-25T01:39:29.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.409+0000 7fe28d354640 1 -- 172.21.15.77:0/2470221257 learned_addr learned my addr 172.21.15.77:0/2470221257 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:29.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.409+0000 7fe28cb53640 1 --2- 172.21.15.77:0/2470221257 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2880cbef0 0x7fe2881ec250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:29.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.409+0000 7fe287fff640 1 --2- 172.21.15.77:0/2470221257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe28814fd20 0x7fe2880c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:29.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.409+0000 7fe28d354640 1 -- 172.21.15.77:0/2470221257 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2880cbef0 msgr2=0x7fe2881ec250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:29.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.409+0000 7fe28d354640 1 --2- 172.21.15.77:0/2470221257 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2880cbef0 0x7fe2881ec250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.409+0000 7fe28d354640 1 -- 172.21.15.77:0/2470221257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe28814fd20 msgr2=0x7fe2880c4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:29.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.409+0000 7fe28d354640 1 --2- 172.21.15.77:0/2470221257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe28814fd20 0x7fe2880c4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.409+0000 7fe28d354640 1 -- 172.21.15.77:0/2470221257 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe288155e50 con 0x7fe28815a0e0 2024-04-25T01:39:29.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.409+0000 7fe28d354640 1 --2- 172.21.15.77:0/2470221257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28815a0e0 0x7fe2881ef390 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe280007df0 tx=0x7fe28000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:29.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.409+0000 7fe2857fa640 1 -- 172.21.15.77:0/2470221257 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28001a070 con 0x7fe28815a0e0 2024-04-25T01:39:29.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.409+0000 7fe2857fa640 1 -- 172.21.15.77:0/2470221257 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe280003990 con 0x7fe28815a0e0 2024-04-25T01:39:29.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.409+0000 7fe2857fa640 1 -- 172.21.15.77:0/2470221257 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe280003d80 con 0x7fe28815a0e0 2024-04-25T01:39:29.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.409+0000 7fe28edb7640 1 -- 172.21.15.77:0/2470221257 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe288151f40 con 0x7fe28815a0e0 2024-04-25T01:39:29.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.410+0000 7fe28edb7640 1 -- 172.21.15.77:0/2470221257 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2880c5360 con 0x7fe28815a0e0 2024-04-25T01:39:29.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.411+0000 7fe28edb7640 1 -- 172.21.15.77:0/2470221257 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe28804f500 con 0x7fe28815a0e0 2024-04-25T01:39:29.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.411+0000 7fe2857fa640 1 -- 172.21.15.77:0/2470221257 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe28001d070 con 0x7fe28815a0e0 2024-04-25T01:39:29.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.411+0000 7fe2857fa640 1 --2- 172.21.15.77:0/2470221257 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe27406be30 0x7fe27406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:29.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.411+0000 7fe2857fa640 1 -- 172.21.15.77:0/2470221257 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7fe28008afa0 con 0x7fe28815a0e0 2024-04-25T01:39:29.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.411+0000 7fe28cb53640 1 --2- 172.21.15.77:0/2470221257 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe27406be30 0x7fe27406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:29.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.412+0000 7fe28cb53640 1 --2- 172.21.15.77:0/2470221257 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe27406be30 0x7fe27406e2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe2880c7bb0 tx=0x7fe278008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:29.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.416+0000 7fe2857fa640 1 -- 172.21.15.77:0/2470221257 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe280010070 con 0x7fe28815a0e0 2024-04-25T01:39:29.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.588+0000 7fe28edb7640 1 -- 172.21.15.77:0/2470221257 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7fe288067800 con 0x7fe28815a0e0 2024-04-25T01:39:29.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.588+0000 7fe2857fa640 1 -- 172.21.15.77:0/2470221257 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v20) ==== 99+0+11 (secure 0 0 0) 0x7fe2800593a0 con 0x7fe28815a0e0 2024-04-25T01:39:29.571 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T01:39:29.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.590+0000 7fe28edb7640 1 -- 172.21.15.77:0/2470221257 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe27406be30 msgr2=0x7fe27406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:29.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.590+0000 7fe28edb7640 1 --2- 172.21.15.77:0/2470221257 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe27406be30 0x7fe27406e2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe2880c7bb0 tx=0x7fe278008040 comp rx=0 tx=0).stop 2024-04-25T01:39:29.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.590+0000 7fe28edb7640 1 -- 172.21.15.77:0/2470221257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28815a0e0 msgr2=0x7fe2881ef390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:29.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.590+0000 7fe28edb7640 1 --2- 172.21.15.77:0/2470221257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28815a0e0 0x7fe2881ef390 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe280007df0 tx=0x7fe28000d4a0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.590+0000 7fe28edb7640 1 -- 172.21.15.77:0/2470221257 shutdown_connections 2024-04-25T01:39:29.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.590+0000 7fe28edb7640 1 --2- 172.21.15.77:0/2470221257 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe27406be30 0x7fe27406e2f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.590+0000 7fe28edb7640 1 --2- 172.21.15.77:0/2470221257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28815a0e0 0x7fe2881ef390 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.590+0000 7fe28edb7640 1 --2- 172.21.15.77:0/2470221257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe28814fd20 0x7fe2880c4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.590+0000 7fe28edb7640 1 --2- 172.21.15.77:0/2470221257 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2880cbef0 0x7fe2881ec250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.590+0000 7fe28edb7640 1 -- 172.21.15.77:0/2470221257 >> 172.21.15.77:0/2470221257 conn(0x7fe288067080 msgr2=0x7fe288158f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:29.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.590+0000 7fe28edb7640 1 -- 172.21.15.77:0/2470221257 shutdown_connections 2024-04-25T01:39:29.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.590+0000 7fe28edb7640 1 -- 172.21.15.77:0/2470221257 wait complete. 2024-04-25T01:39:29.583 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-25T01:39:29.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.700+0000 7fb83d4bd640 1 Processor -- start 2024-04-25T01:39:29.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.700+0000 7fb83d4bd640 1 -- start start 2024-04-25T01:39:29.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.701+0000 7fb83d4bd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb838153530 0x7fb8380c6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:29.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.701+0000 7fb83d4bd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb8380bef50 0x7fb8381595f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:29.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.701+0000 7fb83d4bd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb83806d110 con 0x7fb8380c97c0 2024-04-25T01:39:29.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.701+0000 7fb83d4bd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb838153910 con 0x7fb838153530 2024-04-25T01:39:29.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.701+0000 7fb83d4bd640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fb838156980 con 0x7fb8380bef50 2024-04-25T01:39:29.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.701+0000 7fb836ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb838153530 0x7fb8380c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:29.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.701+0000 7fb8377fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb8380c97c0 0x7fb838159b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36944/0 (socket says 172.21.15.77:36944) 2024-04-25T01:39:29.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.701+0000 7fb8377fe640 1 -- 172.21.15.77:0/893701142 learned_addr learned my addr 172.21.15.77:0/893701142 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:29.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.701+0000 7fb82ffff640 1 --2- 172.21.15.77:0/893701142 >> v2:172.21.15.121:3300/0 conn(0x7fb8380bef50 0x7fb8381595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:29.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.701+0000 7fb836ffd640 1 -- 172.21.15.77:0/893701142 >> v2:172.21.15.121:3300/0 conn(0x7fb8380bef50 msgr2=0x7fb8381595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:29.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.701+0000 7fb836ffd640 1 --2- 172.21.15.77:0/893701142 >> v2:172.21.15.121:3300/0 conn(0x7fb8380bef50 0x7fb8381595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.701+0000 7fb836ffd640 1 -- 172.21.15.77:0/893701142 >> v1:172.21.15.77:6789/0 conn(0x7fb8380c97c0 legacy=0x7fb838159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:29.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.701+0000 7fb8367fc640 1 -- 172.21.15.77:0/893701142 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2382628275 0 0) 0x7fb83806d110 con 0x7fb8380c97c0 2024-04-25T01:39:29.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.701+0000 7fb836ffd640 1 -- 172.21.15.77:0/893701142 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb838156c60 con 0x7fb838153530 2024-04-25T01:39:29.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.702+0000 7fb836ffd640 1 --2- 172.21.15.77:0/893701142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb838153530 0x7fb8380c6240 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb8380c9370 tx=0x7fb82802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b901bdeddeb47bc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:29.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.702+0000 7fb8367fc640 1 -- 172.21.15.77:0/893701142 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb828037070 con 0x7fb838153530 2024-04-25T01:39:29.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.702+0000 7fb8367fc640 1 -- 172.21.15.77:0/893701142 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb828032440 con 0x7fb838153530 2024-04-25T01:39:29.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.702+0000 7fb8367fc640 1 -- 172.21.15.77:0/893701142 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb82802ae60 con 0x7fb838153530 2024-04-25T01:39:29.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.703+0000 7fb83d4bd640 1 -- 172.21.15.77:0/893701142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb838153530 msgr2=0x7fb8380c6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:29.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.703+0000 7fb83d4bd640 1 --2- 172.21.15.77:0/893701142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb838153530 0x7fb8380c6240 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb8380c9370 tx=0x7fb82802a110 comp rx=0 tx=0).stop 2024-04-25T01:39:29.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.703+0000 7fb83d4bd640 1 -- 172.21.15.77:0/893701142 shutdown_connections 2024-04-25T01:39:29.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.703+0000 7fb83d4bd640 1 --2- 172.21.15.77:0/893701142 >> v2:172.21.15.121:3300/0 conn(0x7fb8380bef50 0x7fb8381595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.703+0000 7fb83d4bd640 1 --2- 172.21.15.77:0/893701142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb838153530 0x7fb8380c6240 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.703+0000 7fb83d4bd640 1 -- 172.21.15.77:0/893701142 >> 172.21.15.77:0/893701142 conn(0x7fb8380672c0 msgr2=0x7fb8380676d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:29.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.703+0000 7fb83d4bd640 1 -- 172.21.15.77:0/893701142 shutdown_connections 2024-04-25T01:39:29.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.703+0000 7fb83d4bd640 1 -- 172.21.15.77:0/893701142 wait complete. 2024-04-25T01:39:29.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.704+0000 7fb83d4bd640 1 Processor -- start 2024-04-25T01:39:29.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.704+0000 7fb83d4bd640 1 -- start start 2024-04-25T01:39:29.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.704+0000 7fb83d4bd640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb8380bef50 0x7fb83814ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:29.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.704+0000 7fb83d4bd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8380c97c0 0x7fb8381e06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:29.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.704+0000 7fb83d4bd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb838153530 0x7fb8381e0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:29.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.704+0000 7fb83d4bd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb83815a240 con 0x7fb8380c97c0 2024-04-25T01:39:29.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.704+0000 7fb83d4bd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb8380cc250 con 0x7fb838153530 2024-04-25T01:39:29.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.704+0000 7fb83d4bd640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb8380c6780 con 0x7fb8380bef50 2024-04-25T01:39:29.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.704+0000 7fb82ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8380c97c0 0x7fb8381e06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:29.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.704+0000 7fb82ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8380c97c0 0x7fb8381e06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58470/0 (socket says 172.21.15.77:58470) 2024-04-25T01:39:29.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.704+0000 7fb82ffff640 1 -- 172.21.15.77:0/1125517565 learned_addr learned my addr 172.21.15.77:0/1125517565 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:29.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.705+0000 7fb82ffff640 1 -- 172.21.15.77:0/1125517565 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb8380bef50 msgr2=0x7fb83814ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:29.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.705+0000 7fb82ffff640 1 --2- 172.21.15.77:0/1125517565 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb8380bef50 0x7fb83814ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.705+0000 7fb82ffff640 1 -- 172.21.15.77:0/1125517565 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb838153530 msgr2=0x7fb8381e0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:29.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.705+0000 7fb82ffff640 1 --2- 172.21.15.77:0/1125517565 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb838153530 0x7fb8381e0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.705+0000 7fb82ffff640 1 -- 172.21.15.77:0/1125517565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb838157ed0 con 0x7fb8380c97c0 2024-04-25T01:39:29.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.705+0000 7fb82ffff640 1 --2- 172.21.15.77:0/1125517565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8380c97c0 0x7fb8381e06f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb82000e930 tx=0x7fb82000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:29.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.705+0000 7fb82f7fe640 1 -- 172.21.15.77:0/1125517565 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb820017070 con 0x7fb8380c97c0 2024-04-25T01:39:29.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.705+0000 7fb82f7fe640 1 -- 172.21.15.77:0/1125517565 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb82000ca00 con 0x7fb8380c97c0 2024-04-25T01:39:29.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.705+0000 7fb83d4bd640 1 -- 172.21.15.77:0/1125517565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb838158170 con 0x7fb8380c97c0 2024-04-25T01:39:29.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.705+0000 7fb82f7fe640 1 -- 172.21.15.77:0/1125517565 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb82000cdb0 con 0x7fb8380c97c0 2024-04-25T01:39:29.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.705+0000 7fb83d4bd640 1 -- 172.21.15.77:0/1125517565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb838158a60 con 0x7fb8380c97c0 2024-04-25T01:39:29.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.706+0000 7fb83d4bd640 1 -- 172.21.15.77:0/1125517565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb838158850 con 0x7fb8380c97c0 2024-04-25T01:39:29.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.707+0000 7fb82f7fe640 1 -- 172.21.15.77:0/1125517565 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb82001a070 con 0x7fb8380c97c0 2024-04-25T01:39:29.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.707+0000 7fb82f7fe640 1 --2- 172.21.15.77:0/1125517565 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb81806be30 0x7fb81806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:29.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.707+0000 7fb836ffd640 1 --2- 172.21.15.77:0/1125517565 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb81806be30 0x7fb81806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:29.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.707+0000 7fb82f7fe640 1 -- 172.21.15.77:0/1125517565 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7fb82008b180 con 0x7fb8380c97c0 2024-04-25T01:39:29.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.707+0000 7fb836ffd640 1 --2- 172.21.15.77:0/1125517565 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb81806be30 0x7fb81806e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb828034000 tx=0x7fb82802c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:29.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.711+0000 7fb82f7fe640 1 -- 172.21.15.77:0/1125517565 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb820059c90 con 0x7fb8380c97c0 2024-04-25T01:39:29.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.884+0000 7fb83d4bd640 1 -- 172.21.15.77:0/1125517565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7fb83804f500 con 0x7fb8380c97c0 2024-04-25T01:39:29.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.884+0000 7fb82f7fe640 1 -- 172.21.15.77:0/1125517565 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v20) ==== 95+0+11 (secure 0 0 0) 0x7fb820059590 con 0x7fb8380c97c0 2024-04-25T01:39:29.867 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-25T01:39:29.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.886+0000 7fb83d4bd640 1 -- 172.21.15.77:0/1125517565 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb81806be30 msgr2=0x7fb81806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:29.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.886+0000 7fb83d4bd640 1 --2- 172.21.15.77:0/1125517565 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb81806be30 0x7fb81806e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb828034000 tx=0x7fb82802c000 comp rx=0 tx=0).stop 2024-04-25T01:39:29.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.886+0000 7fb83d4bd640 1 -- 172.21.15.77:0/1125517565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8380c97c0 msgr2=0x7fb8381e06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:29.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.886+0000 7fb83d4bd640 1 --2- 172.21.15.77:0/1125517565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8380c97c0 0x7fb8381e06f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb82000e930 tx=0x7fb82000edf0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.886+0000 7fb83d4bd640 1 -- 172.21.15.77:0/1125517565 shutdown_connections 2024-04-25T01:39:29.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.886+0000 7fb83d4bd640 1 --2- 172.21.15.77:0/1125517565 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb81806be30 0x7fb81806e2f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.886+0000 7fb83d4bd640 1 --2- 172.21.15.77:0/1125517565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8380c97c0 0x7fb8381e06f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.886+0000 7fb83d4bd640 1 --2- 172.21.15.77:0/1125517565 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb838153530 0x7fb8381e0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.886+0000 7fb83d4bd640 1 --2- 172.21.15.77:0/1125517565 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb8380bef50 0x7fb83814ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.886+0000 7fb83d4bd640 1 -- 172.21.15.77:0/1125517565 >> 172.21.15.77:0/1125517565 conn(0x7fb8380672c0 msgr2=0x7fb8380ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:29.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.886+0000 7fb83d4bd640 1 -- 172.21.15.77:0/1125517565 shutdown_connections 2024-04-25T01:39:29.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.886+0000 7fb83d4bd640 1 -- 172.21.15.77:0/1125517565 wait complete. 2024-04-25T01:39:29.882 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T01:39:29.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.996+0000 7f05b0342640 1 Processor -- start 2024-04-25T01:39:29.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.996+0000 7f05b0342640 1 -- start start 2024-04-25T01:39:29.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.997+0000 7f05b0342640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f05a8072c80 0x7f05a8156210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:29.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.997+0000 7f05b0342640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f05a80c96c0 0x7f05a80c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:29.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.997+0000 7f05b0342640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05a8153c70 con 0x7f05a8153890 2024-04-25T01:39:29.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.997+0000 7f05b0342640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f05a8072ad0 con 0x7f05a80c96c0 2024-04-25T01:39:29.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.997+0000 7f05b0342640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f05a80730e0 con 0x7f05a8072c80 2024-04-25T01:39:29.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.997+0000 7f05ae8df640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f05a80c96c0 0x7f05a80c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:29.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.997+0000 7f05ae8df640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f05a80c96c0 0x7f05a80c9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58484/0 (socket says 172.21.15.77:58484) 2024-04-25T01:39:29.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.997+0000 7f05ae8df640 1 -- 172.21.15.77:0/1625544530 learned_addr learned my addr 172.21.15.77:0/1625544530 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:29.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.998+0000 7f05ad8dd640 1 --2- 172.21.15.77:0/1625544530 >> v2:172.21.15.121:3300/0 conn(0x7f05a8072c80 0x7f05a8156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:29.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.998+0000 7f05ae8df640 1 -- 172.21.15.77:0/1625544530 >> v2:172.21.15.121:3300/0 conn(0x7f05a8072c80 msgr2=0x7f05a8156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:29.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.998+0000 7f05ae8df640 1 --2- 172.21.15.77:0/1625544530 >> v2:172.21.15.121:3300/0 conn(0x7f05a8072c80 0x7f05a8156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.998+0000 7f05ae8df640 1 -- 172.21.15.77:0/1625544530 >> v1:172.21.15.121:6789/0 conn(0x7f05a8153890 legacy=0x7f05a80723c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:29.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.998+0000 7f05ae8df640 1 -- 172.21.15.77:0/1625544530 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a80c3180 con 0x7f05a80c96c0 2024-04-25T01:39:29.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.998+0000 7f05ad8dd640 1 --2- 172.21.15.77:0/1625544530 >> v2:172.21.15.121:3300/0 conn(0x7f05a8072c80 0x7f05a8156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:29.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.998+0000 7f05ae8df640 1 --2- 172.21.15.77:0/1625544530 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05a80c96c0 0x7f05a80c9ad0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f05a80ca250 tx=0x7f05a402a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7a6dbc2b8ea1a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:29.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.998+0000 7f05ad0dc640 1 -- 172.21.15.77:0/1625544530 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a4037070 con 0x7f05a80c96c0 2024-04-25T01:39:29.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.998+0000 7f05ad0dc640 1 -- 172.21.15.77:0/1625544530 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a4032440 con 0x7f05a80c96c0 2024-04-25T01:39:29.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.998+0000 7f05ad0dc640 1 -- 172.21.15.77:0/1625544530 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a4032810 con 0x7f05a80c96c0 2024-04-25T01:39:29.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.999+0000 7f05b0342640 1 -- 172.21.15.77:0/1625544530 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05a80c96c0 msgr2=0x7f05a80c9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:29.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.999+0000 7f05b0342640 1 --2- 172.21.15.77:0/1625544530 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05a80c96c0 0x7f05a80c9ad0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f05a80ca250 tx=0x7f05a402a150 comp rx=0 tx=0).stop 2024-04-25T01:39:29.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.999+0000 7f05b0342640 1 -- 172.21.15.77:0/1625544530 shutdown_connections 2024-04-25T01:39:29.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.999+0000 7f05b0342640 1 --2- 172.21.15.77:0/1625544530 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05a80c96c0 0x7f05a80c9ad0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.999+0000 7f05b0342640 1 --2- 172.21.15.77:0/1625544530 >> v2:172.21.15.121:3300/0 conn(0x7f05a8072c80 0x7f05a8156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.999+0000 7f05b0342640 1 -- 172.21.15.77:0/1625544530 >> 172.21.15.77:0/1625544530 conn(0x7f05a80aa8f0 msgr2=0x7f05a8066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:29.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.999+0000 7f05b0342640 1 -- 172.21.15.77:0/1625544530 shutdown_connections 2024-04-25T01:39:29.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:29.999+0000 7f05b0342640 1 -- 172.21.15.77:0/1625544530 wait complete. 2024-04-25T01:39:29.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.000+0000 7f05b0342640 1 Processor -- start 2024-04-25T01:39:29.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.000+0000 7f05b0342640 1 -- start start 2024-04-25T01:39:29.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.001+0000 7f05b0342640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05a8072c80 0x7f05a81ebe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:29.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.001+0000 7f05b0342640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05a80c96c0 0x7f05a80c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:29.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.001+0000 7f05b0342640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f05a8153890 0x7f05a8151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:29.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.001+0000 7f05b0342640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f05a8070210 con 0x7f05a8072c80 2024-04-25T01:39:29.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.001+0000 7f05b0342640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f05a806ff30 con 0x7f05a80c96c0 2024-04-25T01:39:29.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.001+0000 7f05b0342640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f05a806f300 con 0x7f05a8153890 2024-04-25T01:39:29.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.001+0000 7f05ae0de640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05a8072c80 0x7f05a81ebe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:29.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.001+0000 7f05ae0de640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05a8072c80 0x7f05a81ebe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58492/0 (socket says 172.21.15.77:58492) 2024-04-25T01:39:29.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.001+0000 7f05ae0de640 1 -- 172.21.15.77:0/2193365307 learned_addr learned my addr 172.21.15.77:0/2193365307 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:29.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.001+0000 7f05ad8dd640 1 --2- 172.21.15.77:0/2193365307 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05a80c96c0 0x7f05a80c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:29.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.001+0000 7f05ae8df640 1 --2- 172.21.15.77:0/2193365307 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f05a8153890 0x7f05a8151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:29.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.001+0000 7f05ae0de640 1 -- 172.21.15.77:0/2193365307 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f05a8153890 msgr2=0x7f05a8151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:29.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.001+0000 7f05ae0de640 1 --2- 172.21.15.77:0/2193365307 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f05a8153890 0x7f05a8151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.001+0000 7f05ae0de640 1 -- 172.21.15.77:0/2193365307 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05a80c96c0 msgr2=0x7f05a80c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:29.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.001+0000 7f05ae0de640 1 --2- 172.21.15.77:0/2193365307 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05a80c96c0 0x7f05a80c82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:29.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.001+0000 7f05ae0de640 1 -- 172.21.15.77:0/2193365307 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a80c9140 con 0x7f05a8072c80 2024-04-25T01:39:29.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.001+0000 7f05ad8dd640 1 --2- 172.21.15.77:0/2193365307 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05a80c96c0 0x7f05a80c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:29.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.001+0000 7f05ae0de640 1 --2- 172.21.15.77:0/2193365307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05a8072c80 0x7f05a81ebe30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f05a000c730 tx=0x7f05a000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:29.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.001+0000 7f059effd640 1 -- 172.21.15.77:0/2193365307 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a0016020 con 0x7f05a8072c80 2024-04-25T01:39:29.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.001+0000 7f059effd640 1 -- 172.21.15.77:0/2193365307 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a0006d50 con 0x7f05a8072c80 2024-04-25T01:39:29.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.001+0000 7f05b0342640 1 -- 172.21.15.77:0/2193365307 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05a81ec530 con 0x7f05a8072c80 2024-04-25T01:39:29.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.001+0000 7f059effd640 1 -- 172.21.15.77:0/2193365307 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a0003bb0 con 0x7f05a8072c80 2024-04-25T01:39:29.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.002+0000 7f05b0342640 1 -- 172.21.15.77:0/2193365307 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05a81ecaf0 con 0x7f05a8072c80 2024-04-25T01:39:29.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.002+0000 7f05b0342640 1 -- 172.21.15.77:0/2193365307 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05a804f500 con 0x7f05a8072c80 2024-04-25T01:39:29.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.003+0000 7f059effd640 1 -- 172.21.15.77:0/2193365307 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f05a000a850 con 0x7f05a8072c80 2024-04-25T01:39:29.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.003+0000 7f059effd640 1 --2- 172.21.15.77:0/2193365307 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f058c06be60 0x7f058c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:29.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.003+0000 7f05ad8dd640 1 --2- 172.21.15.77:0/2193365307 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f058c06be60 0x7f058c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:29.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.003+0000 7f059effd640 1 -- 172.21.15.77:0/2193365307 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7f05a008a960 con 0x7f05a8072c80 2024-04-25T01:39:29.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.004+0000 7f05ad8dd640 1 --2- 172.21.15.77:0/2193365307 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f058c06be60 0x7f058c06e320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f05a8157350 tx=0x7f0598008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:29.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.008+0000 7f059effd640 1 -- 172.21.15.77:0/2193365307 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f05a0020020 con 0x7f05a8072c80 2024-04-25T01:39:30.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.183+0000 7f05b0342640 1 -- 172.21.15.77:0/2193365307 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f05a80c2d20 con 0x7f05a8072c80 2024-04-25T01:39:30.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.183+0000 7f059effd640 1 -- 172.21.15.77:0/2193365307 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) ==== 84+0+197 (secure 0 0 0) 0x7f05a8153c70 con 0x7f05a8072c80 2024-04-25T01:39:30.166 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:30.166 INFO:teuthology.orchestra.run.smithi077.stdout:[ 2024-04-25T01:39:30.166 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-25T01:39:30.166 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 1, 2024-04-25T01:39:30.167 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": ".mgr" 2024-04-25T01:39:30.167 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T01:39:30.167 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-25T01:39:30.167 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 2, 2024-04-25T01:39:30.167 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": "a_metadata" 2024-04-25T01:39:30.167 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-25T01:39:30.167 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-25T01:39:30.167 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 3, 2024-04-25T01:39:30.167 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": "a_data" 2024-04-25T01:39:30.167 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-25T01:39:30.167 INFO:teuthology.orchestra.run.smithi077.stdout:] 2024-04-25T01:39:30.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.185+0000 7f05b0342640 1 -- 172.21.15.77:0/2193365307 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f058c06be60 msgr2=0x7f058c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:30.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.185+0000 7f05b0342640 1 --2- 172.21.15.77:0/2193365307 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f058c06be60 0x7f058c06e320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f05a8157350 tx=0x7f0598008040 comp rx=0 tx=0).stop 2024-04-25T01:39:30.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.185+0000 7f05b0342640 1 -- 172.21.15.77:0/2193365307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05a8072c80 msgr2=0x7f05a81ebe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:30.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.185+0000 7f05b0342640 1 --2- 172.21.15.77:0/2193365307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05a8072c80 0x7f05a81ebe30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f05a000c730 tx=0x7f05a000cbf0 comp rx=0 tx=0).stop 2024-04-25T01:39:30.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.185+0000 7f05b0342640 1 -- 172.21.15.77:0/2193365307 shutdown_connections 2024-04-25T01:39:30.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.185+0000 7f05b0342640 1 --2- 172.21.15.77:0/2193365307 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f058c06be60 0x7f058c06e320 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:30.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.185+0000 7f05b0342640 1 --2- 172.21.15.77:0/2193365307 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f05a8153890 0x7f05a8151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:30.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.185+0000 7f05b0342640 1 --2- 172.21.15.77:0/2193365307 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05a80c96c0 0x7f05a80c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:30.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.185+0000 7f05b0342640 1 --2- 172.21.15.77:0/2193365307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05a8072c80 0x7f05a81ebe30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:30.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.185+0000 7f05b0342640 1 -- 172.21.15.77:0/2193365307 >> 172.21.15.77:0/2193365307 conn(0x7f05a80aa8f0 msgr2=0x7f05a80c4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:30.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.185+0000 7f05b0342640 1 -- 172.21.15.77:0/2193365307 shutdown_connections 2024-04-25T01:39:30.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.185+0000 7f05b0342640 1 -- 172.21.15.77:0/2193365307 wait complete. 2024-04-25T01:39:30.179 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'b' 2024-04-25T01:39:30.179 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create b_metadata --pg_num_min 64 2024-04-25T01:39:30.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.296+0000 7ff424c15640 1 Processor -- start 2024-04-25T01:39:30.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.296+0000 7ff424c15640 1 -- start start 2024-04-25T01:39:30.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.297+0000 7ff424c15640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff420153690 0x7ff420067100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:30.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.297+0000 7ff424c15640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff420070d80 0x7ff420159f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:30.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.297+0000 7ff424c15640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff42015a490 con 0x7ff420155f50 2024-04-25T01:39:30.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.297+0000 7ff424c15640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff42006cd60 con 0x7ff420070d80 2024-04-25T01:39:30.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.297+0000 7ff424c15640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff420072ba0 con 0x7ff420153690 2024-04-25T01:39:30.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.297+0000 7ff41dd9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff420070d80 0x7ff420159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:30.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.297+0000 7ff41ed9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff420155f50 0x7ff4200c3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36948/0 (socket says 172.21.15.77:36948) 2024-04-25T01:39:30.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.298+0000 7ff41ed9d640 1 -- 172.21.15.77:0/4235641350 learned_addr learned my addr 172.21.15.77:0/4235641350 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:30.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.298+0000 7ff41e59c640 1 --2- 172.21.15.77:0/4235641350 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff420153690 0x7ff420067100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:30.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.298+0000 7ff41dd9b640 1 -- 172.21.15.77:0/4235641350 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff420153690 msgr2=0x7ff420067100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:30.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.298+0000 7ff41dd9b640 1 --2- 172.21.15.77:0/4235641350 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff420153690 0x7ff420067100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:30.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.298+0000 7ff41dd9b640 1 -- 172.21.15.77:0/4235641350 >> v1:172.21.15.77:6789/0 conn(0x7ff420155f50 legacy=0x7ff4200c3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:30.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.298+0000 7ff41dd9b640 1 -- 172.21.15.77:0/4235641350 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff420072e80 con 0x7ff420070d80 2024-04-25T01:39:30.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.298+0000 7ff41d59a640 1 -- 172.21.15.77:0/4235641350 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 855158576 0 0) 0x7ff418001490 con 0x7ff420155f50 2024-04-25T01:39:30.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.298+0000 7ff41e59c640 1 --2- 172.21.15.77:0/4235641350 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff420153690 0x7ff420067100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:30.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.298+0000 7ff41dd9b640 1 --2- 172.21.15.77:0/4235641350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff420070d80 0x7ff420159f50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff4100097a0 tx=0x7ff41002a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa38bf1e3e3a6ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:30.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.299+0000 7ff41d59a640 1 -- 172.21.15.77:0/4235641350 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff410037070 con 0x7ff420070d80 2024-04-25T01:39:30.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.299+0000 7ff41d59a640 1 -- 172.21.15.77:0/4235641350 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff41002adb0 con 0x7ff420070d80 2024-04-25T01:39:30.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.299+0000 7ff41d59a640 1 -- 172.21.15.77:0/4235641350 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff410032660 con 0x7ff420070d80 2024-04-25T01:39:30.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.299+0000 7ff424c15640 1 -- 172.21.15.77:0/4235641350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff420070d80 msgr2=0x7ff420159f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:30.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.299+0000 7ff424c15640 1 --2- 172.21.15.77:0/4235641350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff420070d80 0x7ff420159f50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff4100097a0 tx=0x7ff41002a060 comp rx=0 tx=0).stop 2024-04-25T01:39:30.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.299+0000 7ff424c15640 1 -- 172.21.15.77:0/4235641350 shutdown_connections 2024-04-25T01:39:30.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.299+0000 7ff424c15640 1 --2- 172.21.15.77:0/4235641350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff420070d80 0x7ff420159f50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:30.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.299+0000 7ff424c15640 1 --2- 172.21.15.77:0/4235641350 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff420153690 0x7ff420067100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:30.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.299+0000 7ff424c15640 1 -- 172.21.15.77:0/4235641350 >> 172.21.15.77:0/4235641350 conn(0x7ff4200c4970 msgr2=0x7ff4200c4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:30.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.299+0000 7ff424c15640 1 -- 172.21.15.77:0/4235641350 shutdown_connections 2024-04-25T01:39:30.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.299+0000 7ff424c15640 1 -- 172.21.15.77:0/4235641350 wait complete. 2024-04-25T01:39:30.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.300+0000 7ff424c15640 1 Processor -- start 2024-04-25T01:39:30.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.300+0000 7ff424c15640 1 -- start start 2024-04-25T01:39:30.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.301+0000 7ff424c15640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff420070d80 0x7ff420146d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:30.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.301+0000 7ff424c15640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff420153690 0x7ff4201ed6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:30.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.301+0000 7ff424c15640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff420155f50 0x7ff420152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:30.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.301+0000 7ff424c15640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff4200c4110 con 0x7ff420070d80 2024-04-25T01:39:30.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.301+0000 7ff424c15640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff4200c3f90 con 0x7ff420153690 2024-04-25T01:39:30.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.301+0000 7ff424c15640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff4201563e0 con 0x7ff420155f50 2024-04-25T01:39:30.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.301+0000 7ff41e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff420070d80 0x7ff420146d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:30.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.301+0000 7ff41e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff420070d80 0x7ff420146d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58508/0 (socket says 172.21.15.77:58508) 2024-04-25T01:39:30.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.301+0000 7ff41e59c640 1 -- 172.21.15.77:0/4249613048 learned_addr learned my addr 172.21.15.77:0/4249613048 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:30.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.301+0000 7ff41dd9b640 1 --2- 172.21.15.77:0/4249613048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff420153690 0x7ff4201ed6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:30.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.301+0000 7ff41ed9d640 1 --2- 172.21.15.77:0/4249613048 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff420155f50 0x7ff420152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:30.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.301+0000 7ff41e59c640 1 -- 172.21.15.77:0/4249613048 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff420155f50 msgr2=0x7ff420152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:30.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.301+0000 7ff41e59c640 1 --2- 172.21.15.77:0/4249613048 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff420155f50 0x7ff420152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:30.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.301+0000 7ff41e59c640 1 -- 172.21.15.77:0/4249613048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff420153690 msgr2=0x7ff4201ed6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:30.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.301+0000 7ff41e59c640 1 --2- 172.21.15.77:0/4249613048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff420153690 0x7ff4201ed6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:30.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.301+0000 7ff41e59c640 1 -- 172.21.15.77:0/4249613048 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4201dfc30 con 0x7ff420070d80 2024-04-25T01:39:30.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.301+0000 7ff41dd9b640 1 --2- 172.21.15.77:0/4249613048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff420153690 0x7ff4201ed6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:30.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.302+0000 7ff41e59c640 1 --2- 172.21.15.77:0/4249613048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff420070d80 0x7ff420146d50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff41400c820 tx=0x7ff41400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:30.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.302+0000 7ff40effd640 1 -- 172.21.15.77:0/4249613048 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff414015070 con 0x7ff420070d80 2024-04-25T01:39:30.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.302+0000 7ff40effd640 1 -- 172.21.15.77:0/4249613048 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4140079d0 con 0x7ff420070d80 2024-04-25T01:39:30.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.302+0000 7ff424c15640 1 -- 172.21.15.77:0/4249613048 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4201df950 con 0x7ff420070d80 2024-04-25T01:39:30.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.302+0000 7ff40effd640 1 -- 172.21.15.77:0/4249613048 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff414007da0 con 0x7ff420070d80 2024-04-25T01:39:30.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.302+0000 7ff424c15640 1 -- 172.21.15.77:0/4249613048 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4201efc50 con 0x7ff420070d80 2024-04-25T01:39:30.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.303+0000 7ff424c15640 1 -- 172.21.15.77:0/4249613048 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff42004f500 con 0x7ff420070d80 2024-04-25T01:39:30.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.303+0000 7ff40effd640 1 -- 172.21.15.77:0/4249613048 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff414018070 con 0x7ff420070d80 2024-04-25T01:39:30.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.304+0000 7ff40effd640 1 --2- 172.21.15.77:0/4249613048 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff40006be60 0x7ff40006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:30.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.304+0000 7ff41dd9b640 1 --2- 172.21.15.77:0/4249613048 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff40006be60 0x7ff40006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:30.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.304+0000 7ff40effd640 1 -- 172.21.15.77:0/4249613048 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7ff41408ac50 con 0x7ff420070d80 2024-04-25T01:39:30.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.304+0000 7ff41dd9b640 1 --2- 172.21.15.77:0/4249613048 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff40006be60 0x7ff40006e320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff410034000 tx=0x7ff41002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:30.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.308+0000 7ff40effd640 1 -- 172.21.15.77:0/4249613048 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff42004f500 con 0x7ff420070d80 2024-04-25T01:39:30.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:30.483+0000 7ff424c15640 1 -- 172.21.15.77:0/4249613048 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "b_metadata", "pg_num_min": 64} v 0) -- 0x7ff4200c2f30 con 0x7ff420070d80 2024-04-25T01:39:31.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.406+0000 7ff40effd640 1 -- 172.21.15.77:0/4249613048 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "b_metadata", "pg_num_min": 64}]=0 pool 'b_metadata' created v21) ==== 128+0+0 (secure 0 0 0) 0x7ff4200c2f30 con 0x7ff420070d80 2024-04-25T01:39:31.389 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'b_metadata' created 2024-04-25T01:39:31.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.409+0000 7ff424c15640 1 -- 172.21.15.77:0/4249613048 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff40006be60 msgr2=0x7ff40006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:31.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.409+0000 7ff424c15640 1 --2- 172.21.15.77:0/4249613048 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff40006be60 0x7ff40006e320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff410034000 tx=0x7ff41002e000 comp rx=0 tx=0).stop 2024-04-25T01:39:31.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.409+0000 7ff424c15640 1 -- 172.21.15.77:0/4249613048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff420070d80 msgr2=0x7ff420146d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:31.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.409+0000 7ff424c15640 1 --2- 172.21.15.77:0/4249613048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff420070d80 0x7ff420146d50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff41400c820 tx=0x7ff41400cc20 comp rx=0 tx=0).stop 2024-04-25T01:39:31.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.409+0000 7ff424c15640 1 -- 172.21.15.77:0/4249613048 shutdown_connections 2024-04-25T01:39:31.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.409+0000 7ff424c15640 1 --2- 172.21.15.77:0/4249613048 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff40006be60 0x7ff40006e320 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:31.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.409+0000 7ff424c15640 1 --2- 172.21.15.77:0/4249613048 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff420155f50 0x7ff420152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:31.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.409+0000 7ff424c15640 1 --2- 172.21.15.77:0/4249613048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff420153690 0x7ff4201ed6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:31.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.409+0000 7ff424c15640 1 --2- 172.21.15.77:0/4249613048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff420070d80 0x7ff420146d50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:31.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.409+0000 7ff424c15640 1 -- 172.21.15.77:0/4249613048 >> 172.21.15.77:0/4249613048 conn(0x7ff4200c4970 msgr2=0x7ff420071180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:31.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.409+0000 7ff424c15640 1 -- 172.21.15.77:0/4249613048 shutdown_connections 2024-04-25T01:39:31.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.409+0000 7ff424c15640 1 -- 172.21.15.77:0/4249613048 wait complete. 2024-04-25T01:39:31.408 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create b_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T01:39:31.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.535+0000 7fb0a137e640 1 Processor -- start 2024-04-25T01:39:31.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.535+0000 7fb0a137e640 1 -- start start 2024-04-25T01:39:31.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.535+0000 7fb0a137e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb09c153530 0x7fb09c0c6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:31.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.535+0000 7fb0a137e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb09c0bef50 0x7fb09c1595f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:31.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.535+0000 7fb0a137e640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb09c06d110 con 0x7fb09c0c97c0 2024-04-25T01:39:31.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.535+0000 7fb0a137e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb09c153910 con 0x7fb09c0bef50 2024-04-25T01:39:31.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.535+0000 7fb0a137e640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fb09c156980 con 0x7fb09c153530 2024-04-25T01:39:31.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.535+0000 7fb09a7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb09c0bef50 0x7fb09c1595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:31.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.536+0000 7fb09a7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb09c0bef50 0x7fb09c1595f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58524/0 (socket says 172.21.15.77:58524) 2024-04-25T01:39:31.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.536+0000 7fb09a7fc640 1 -- 172.21.15.77:0/151850069 learned_addr learned my addr 172.21.15.77:0/151850069 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:31.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.536+0000 7fb09affd640 1 --2- 172.21.15.77:0/151850069 >> v2:172.21.15.121:3300/0 conn(0x7fb09c153530 0x7fb09c0c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:31.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.536+0000 7fb09a7fc640 1 -- 172.21.15.77:0/151850069 >> v2:172.21.15.121:3300/0 conn(0x7fb09c153530 msgr2=0x7fb09c0c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:31.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.536+0000 7fb09a7fc640 1 --2- 172.21.15.77:0/151850069 >> v2:172.21.15.121:3300/0 conn(0x7fb09c153530 0x7fb09c0c6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:31.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.536+0000 7fb09a7fc640 1 -- 172.21.15.77:0/151850069 >> v1:172.21.15.121:6789/0 conn(0x7fb09c0c97c0 legacy=0x7fb09c159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:31.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.536+0000 7fb09a7fc640 1 -- 172.21.15.77:0/151850069 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb09c156c60 con 0x7fb09c0bef50 2024-04-25T01:39:31.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.536+0000 7fb09a7fc640 1 --2- 172.21.15.77:0/151850069 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb09c0bef50 0x7fb09c1595f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0753d0 tx=0x7fb09002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4811ab3f5fbe4f61 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:31.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.537+0000 7fb099ffb640 1 -- 172.21.15.77:0/151850069 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb090004030 con 0x7fb09c0bef50 2024-04-25T01:39:31.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.537+0000 7fb099ffb640 1 -- 172.21.15.77:0/151850069 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0900041d0 con 0x7fb09c0bef50 2024-04-25T01:39:31.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.537+0000 7fb099ffb640 1 -- 172.21.15.77:0/151850069 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb090003610 con 0x7fb09c0bef50 2024-04-25T01:39:31.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.537+0000 7fb0a137e640 1 -- 172.21.15.77:0/151850069 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb09c0bef50 msgr2=0x7fb09c1595f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:31.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.537+0000 7fb0a137e640 1 --2- 172.21.15.77:0/151850069 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb09c0bef50 0x7fb09c1595f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0753d0 tx=0x7fb09002a1c0 comp rx=0 tx=0).stop 2024-04-25T01:39:31.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.537+0000 7fb0a137e640 1 -- 172.21.15.77:0/151850069 shutdown_connections 2024-04-25T01:39:31.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.537+0000 7fb0a137e640 1 --2- 172.21.15.77:0/151850069 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb09c0bef50 0x7fb09c1595f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:31.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.537+0000 7fb0a137e640 1 --2- 172.21.15.77:0/151850069 >> v2:172.21.15.121:3300/0 conn(0x7fb09c153530 0x7fb09c0c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:31.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.537+0000 7fb0a137e640 1 -- 172.21.15.77:0/151850069 >> 172.21.15.77:0/151850069 conn(0x7fb09c0672c0 msgr2=0x7fb09c0676d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:31.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.537+0000 7fb0a137e640 1 -- 172.21.15.77:0/151850069 shutdown_connections 2024-04-25T01:39:31.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.537+0000 7fb0a137e640 1 -- 172.21.15.77:0/151850069 wait complete. 2024-04-25T01:39:31.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.538+0000 7fb0a137e640 1 Processor -- start 2024-04-25T01:39:31.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.538+0000 7fb0a137e640 1 -- start start 2024-04-25T01:39:31.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.539+0000 7fb0a137e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb09c0bef50 0x7fb09c158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:31.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.539+0000 7fb0a137e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb09c0c97c0 0x7fb09c0ac540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:31.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.539+0000 7fb0a137e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb09c153530 0x7fb09c1ef200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:31.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.539+0000 7fb0a137e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb09c15a240 con 0x7fb09c0c97c0 2024-04-25T01:39:31.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.539+0000 7fb0a137e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb09c0cc250 con 0x7fb09c153530 2024-04-25T01:39:31.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.539+0000 7fb0a137e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb09c0c6780 con 0x7fb09c0bef50 2024-04-25T01:39:31.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.539+0000 7fb09a7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb09c0c97c0 0x7fb09c0ac540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:31.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.539+0000 7fb09a7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb09c0c97c0 0x7fb09c0ac540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58528/0 (socket says 172.21.15.77:58528) 2024-04-25T01:39:31.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.539+0000 7fb09a7fc640 1 -- 172.21.15.77:0/2196544578 learned_addr learned my addr 172.21.15.77:0/2196544578 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:31.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.539+0000 7fb09affd640 1 --2- 172.21.15.77:0/2196544578 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb09c0bef50 0x7fb09c158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:31.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.539+0000 7fb09b7fe640 1 --2- 172.21.15.77:0/2196544578 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb09c153530 0x7fb09c1ef200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:31.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.539+0000 7fb09a7fc640 1 -- 172.21.15.77:0/2196544578 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb09c0bef50 msgr2=0x7fb09c158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:31.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.539+0000 7fb09a7fc640 1 --2- 172.21.15.77:0/2196544578 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb09c0bef50 0x7fb09c158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:31.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.539+0000 7fb09a7fc640 1 -- 172.21.15.77:0/2196544578 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb09c153530 msgr2=0x7fb09c1ef200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:31.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.539+0000 7fb09a7fc640 1 --2- 172.21.15.77:0/2196544578 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb09c153530 0x7fb09c1ef200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:31.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.539+0000 7fb09a7fc640 1 -- 172.21.15.77:0/2196544578 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb09c1590b0 con 0x7fb09c0c97c0 2024-04-25T01:39:31.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.539+0000 7fb09affd640 1 --2- 172.21.15.77:0/2196544578 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb09c0bef50 0x7fb09c158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:31.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.539+0000 7fb09b7fe640 1 --2- 172.21.15.77:0/2196544578 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb09c153530 0x7fb09c1ef200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:31.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.540+0000 7fb09a7fc640 1 --2- 172.21.15.77:0/2196544578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb09c0c97c0 0x7fb09c0ac540 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb09002a200 tx=0x7fb0900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:31.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.540+0000 7fb0837fe640 1 -- 172.21.15.77:0/2196544578 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb090041020 con 0x7fb09c0c97c0 2024-04-25T01:39:31.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.540+0000 7fb0837fe640 1 -- 172.21.15.77:0/2196544578 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb090003c50 con 0x7fb09c0c97c0 2024-04-25T01:39:31.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.540+0000 7fb0837fe640 1 -- 172.21.15.77:0/2196544578 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb090004030 con 0x7fb09c0c97c0 2024-04-25T01:39:31.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.540+0000 7fb0a137e640 1 -- 172.21.15.77:0/2196544578 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb09c159390 con 0x7fb09c0c97c0 2024-04-25T01:39:31.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.540+0000 7fb0a137e640 1 -- 172.21.15.77:0/2196544578 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb09c1522c0 con 0x7fb09c0c97c0 2024-04-25T01:39:31.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.541+0000 7fb0a137e640 1 -- 172.21.15.77:0/2196544578 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb09c04f500 con 0x7fb09c0c97c0 2024-04-25T01:39:31.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.541+0000 7fb0837fe640 1 -- 172.21.15.77:0/2196544578 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb090044020 con 0x7fb09c0c97c0 2024-04-25T01:39:31.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.542+0000 7fb0837fe640 1 --2- 172.21.15.77:0/2196544578 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb08806be30 0x7fb08806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:31.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.542+0000 7fb0837fe640 1 -- 172.21.15.77:0/2196544578 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6054+0+0 (secure 0 0 0) 0x7fb0900abc80 con 0x7fb09c0c97c0 2024-04-25T01:39:31.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.542+0000 7fb09affd640 1 --2- 172.21.15.77:0/2196544578 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb08806be30 0x7fb08806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:31.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.542+0000 7fb09affd640 1 --2- 172.21.15.77:0/2196544578 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb08806be30 0x7fb08806e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb08c006fd0 tx=0x7fb08c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:31.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.546+0000 7fb0837fe640 1 -- 172.21.15.77:0/2196544578 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb09004b030 con 0x7fb09c0c97c0 2024-04-25T01:39:31.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:31.721+0000 7fb0a137e640 1 -- 172.21.15.77:0/2196544578 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "b_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb09c0c91d0 con 0x7fb09c0c97c0 2024-04-25T01:39:32.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.410+0000 7fb0837fe640 1 -- 172.21.15.77:0/2196544578 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "b_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'b_data' created v22) ==== 160+0+0 (secure 0 0 0) 0x7fb09007a4d0 con 0x7fb09c0c97c0 2024-04-25T01:39:32.393 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'b_data' created 2024-04-25T01:39:32.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.415+0000 7fb0a137e640 1 -- 172.21.15.77:0/2196544578 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb08806be30 msgr2=0x7fb08806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:32.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.415+0000 7fb0a137e640 1 --2- 172.21.15.77:0/2196544578 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb08806be30 0x7fb08806e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb08c006fd0 tx=0x7fb08c008040 comp rx=0 tx=0).stop 2024-04-25T01:39:32.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.415+0000 7fb0a137e640 1 -- 172.21.15.77:0/2196544578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb09c0c97c0 msgr2=0x7fb09c0ac540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:32.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.415+0000 7fb0a137e640 1 --2- 172.21.15.77:0/2196544578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb09c0c97c0 0x7fb09c0ac540 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb09002a200 tx=0x7fb0900046c0 comp rx=0 tx=0).stop 2024-04-25T01:39:32.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.415+0000 7fb0a137e640 1 -- 172.21.15.77:0/2196544578 shutdown_connections 2024-04-25T01:39:32.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.415+0000 7fb0a137e640 1 --2- 172.21.15.77:0/2196544578 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb08806be30 0x7fb08806e2f0 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb08c006fd0 tx=0x7fb08c008040 comp rx=0 tx=0).stop 2024-04-25T01:39:32.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.415+0000 7fb0a137e640 1 --2- 172.21.15.77:0/2196544578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb09c0c97c0 0x7fb09c0ac540 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:32.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.415+0000 7fb0a137e640 1 --2- 172.21.15.77:0/2196544578 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb09c153530 0x7fb09c1ef200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:32.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.415+0000 7fb0a137e640 1 --2- 172.21.15.77:0/2196544578 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb09c0bef50 0x7fb09c158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:32.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.415+0000 7fb0a137e640 1 -- 172.21.15.77:0/2196544578 >> 172.21.15.77:0/2196544578 conn(0x7fb09c0672c0 msgr2=0x7fb09c0676a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:32.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.416+0000 7fb0a137e640 1 -- 172.21.15.77:0/2196544578 shutdown_connections 2024-04-25T01:39:32.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.416+0000 7fb0a137e640 1 -- 172.21.15.77:0/2196544578 wait complete. 2024-04-25T01:39:32.420 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new b b_metadata b_data 2024-04-25T01:39:32.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.539+0000 7f08def3b640 1 Processor -- start 2024-04-25T01:39:32.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.539+0000 7f08def3b640 1 -- start start 2024-04-25T01:39:32.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.539+0000 7f08def3b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f08d8156c50 0x7f08d80c09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:32.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.539+0000 7f08def3b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08d80c4ab0 con 0x7f08d806d200 2024-04-25T01:39:32.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.539+0000 7f08def3b640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08d80c1460 con 0x7f08d806e1c0 2024-04-25T01:39:32.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.539+0000 7f08def3b640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f08d80c1740 con 0x7f08d8156c50 2024-04-25T01:39:32.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.540+0000 7f08d7fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f08d806d200 0x7f08d80c2b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36954/0 (socket says 172.21.15.77:36954) 2024-04-25T01:39:32.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.540+0000 7f08d7fff640 1 -- 172.21.15.77:0/2144475842 learned_addr learned my addr 172.21.15.77:0/2144475842 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:32.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.540+0000 7f08dccd7640 1 --2- 172.21.15.77:0/2144475842 >> v2:172.21.15.121:3300/0 conn(0x7f08d8156c50 0x7f08d80c09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:32.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.540+0000 7f08d77fe640 1 -- 172.21.15.77:0/2144475842 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2538264416 0 0) 0x7f08d80c4ab0 con 0x7f08d806d200 2024-04-25T01:39:32.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.540+0000 7f08d77fe640 1 -- 172.21.15.77:0/2144475842 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08c8003520 con 0x7f08d806d200 2024-04-25T01:39:32.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.540+0000 7f08dccd7640 1 -- 172.21.15.77:0/2144475842 >> v1:172.21.15.121:6789/0 conn(0x7f08d806e1c0 legacy=0x7f08d80c3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:32.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.540+0000 7f08dccd7640 1 -- 172.21.15.77:0/2144475842 >> v1:172.21.15.77:6789/0 conn(0x7f08d806d200 legacy=0x7f08d80c2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:32.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.540+0000 7f08dccd7640 1 -- 172.21.15.77:0/2144475842 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08d80c47d0 con 0x7f08d8156c50 2024-04-25T01:39:32.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.541+0000 7f08dccd7640 1 --2- 172.21.15.77:0/2144475842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08d8156c50 0x7f08d80c09b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f08cc0097a0 tx=0x7f08cc02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=756444dfbe3c4969 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:32.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.541+0000 7f08d77fe640 1 -- 172.21.15.77:0/2144475842 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08cc037070 con 0x7f08d8156c50 2024-04-25T01:39:32.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.541+0000 7f08d77fe640 1 -- 172.21.15.77:0/2144475842 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08cc032440 con 0x7f08d8156c50 2024-04-25T01:39:32.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.541+0000 7f08d77fe640 1 -- 172.21.15.77:0/2144475842 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08cc0327f0 con 0x7f08d8156c50 2024-04-25T01:39:32.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.541+0000 7f08def3b640 1 -- 172.21.15.77:0/2144475842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08d8156c50 msgr2=0x7f08d80c09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:32.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.541+0000 7f08def3b640 1 --2- 172.21.15.77:0/2144475842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08d8156c50 0x7f08d80c09b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f08cc0097a0 tx=0x7f08cc02a1a0 comp rx=0 tx=0).stop 2024-04-25T01:39:32.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.541+0000 7f08def3b640 1 -- 172.21.15.77:0/2144475842 shutdown_connections 2024-04-25T01:39:32.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.541+0000 7f08def3b640 1 --2- 172.21.15.77:0/2144475842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08d8156c50 0x7f08d80c09b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:32.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.541+0000 7f08def3b640 1 -- 172.21.15.77:0/2144475842 >> 172.21.15.77:0/2144475842 conn(0x7f08d80c7580 msgr2=0x7f08d80c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:32.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.542+0000 7f08def3b640 1 -- 172.21.15.77:0/2144475842 shutdown_connections 2024-04-25T01:39:32.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.542+0000 7f08def3b640 1 -- 172.21.15.77:0/2144475842 wait complete. 2024-04-25T01:39:32.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.543+0000 7f08def3b640 1 Processor -- start 2024-04-25T01:39:32.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.543+0000 7f08def3b640 1 -- start start 2024-04-25T01:39:32.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.543+0000 7f08def3b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f08d806d200 0x7f08d8071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:32.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.543+0000 7f08def3b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08d806e1c0 0x7f08d80a9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:32.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.543+0000 7f08def3b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08d8156c50 0x7f08d81ec2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:32.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.543+0000 7f08def3b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f08d80c7390 con 0x7f08d8156c50 2024-04-25T01:39:32.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.543+0000 7f08def3b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f08d80c7210 con 0x7f08d806e1c0 2024-04-25T01:39:32.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.543+0000 7f08def3b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f08d8157030 con 0x7f08d806d200 2024-04-25T01:39:32.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.543+0000 7f08dd4d8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08d8156c50 0x7f08d81ec2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:32.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.543+0000 7f08dd4d8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08d8156c50 0x7f08d81ec2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58544/0 (socket says 172.21.15.77:58544) 2024-04-25T01:39:32.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.544+0000 7f08dd4d8640 1 -- 172.21.15.77:0/2148006005 learned_addr learned my addr 172.21.15.77:0/2148006005 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:32.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.544+0000 7f08d7fff640 1 --2- 172.21.15.77:0/2148006005 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08d806e1c0 0x7f08d80a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:32.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.544+0000 7f08dccd7640 1 --2- 172.21.15.77:0/2148006005 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f08d806d200 0x7f08d8071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:32.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.544+0000 7f08dd4d8640 1 -- 172.21.15.77:0/2148006005 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f08d806d200 msgr2=0x7f08d8071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:32.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.544+0000 7f08dd4d8640 1 --2- 172.21.15.77:0/2148006005 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f08d806d200 0x7f08d8071030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:32.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.544+0000 7f08dd4d8640 1 -- 172.21.15.77:0/2148006005 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08d806e1c0 msgr2=0x7f08d80a9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:32.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.544+0000 7f08dd4d8640 1 --2- 172.21.15.77:0/2148006005 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08d806e1c0 0x7f08d80a9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:32.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.544+0000 7f08dd4d8640 1 -- 172.21.15.77:0/2148006005 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08d8070320 con 0x7f08d8156c50 2024-04-25T01:39:32.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.544+0000 7f08d7fff640 1 --2- 172.21.15.77:0/2148006005 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08d806e1c0 0x7f08d80a9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:32.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.544+0000 7f08dd4d8640 1 --2- 172.21.15.77:0/2148006005 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08d8156c50 0x7f08d81ec2c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f08d000c7d0 tx=0x7f08d000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:32.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.544+0000 7f08d57fa640 1 -- 172.21.15.77:0/2148006005 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d0003b70 con 0x7f08d8156c50 2024-04-25T01:39:32.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.544+0000 7f08d57fa640 1 -- 172.21.15.77:0/2148006005 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08d0003d30 con 0x7f08d8156c50 2024-04-25T01:39:32.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.544+0000 7f08def3b640 1 -- 172.21.15.77:0/2148006005 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08d81ebac0 con 0x7f08d8156c50 2024-04-25T01:39:32.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.544+0000 7f08d57fa640 1 -- 172.21.15.77:0/2148006005 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d000aa90 con 0x7f08d8156c50 2024-04-25T01:39:32.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.544+0000 7f08def3b640 1 -- 172.21.15.77:0/2148006005 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08d80a9b50 con 0x7f08d8156c50 2024-04-25T01:39:32.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.545+0000 7f08def3b640 1 -- 172.21.15.77:0/2148006005 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08d80c1e00 con 0x7f08d8156c50 2024-04-25T01:39:32.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.545+0000 7f08d57fa640 1 -- 172.21.15.77:0/2148006005 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f08d000ac30 con 0x7f08d8156c50 2024-04-25T01:39:32.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.546+0000 7f08d57fa640 1 --2- 172.21.15.77:0/2148006005 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f08bc06be30 0x7f08bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:32.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.546+0000 7f08dccd7640 1 --2- 172.21.15.77:0/2148006005 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f08bc06be30 0x7f08bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:32.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.546+0000 7f08d57fa640 1 -- 172.21.15.77:0/2148006005 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6431+0+0 (secure 0 0 0) 0x7f08d008b070 con 0x7f08d8156c50 2024-04-25T01:39:32.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.546+0000 7f08dccd7640 1 --2- 172.21.15.77:0/2148006005 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f08bc06be30 0x7f08bc06e2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f08cc034000 tx=0x7f08cc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:32.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.550+0000 7f08d57fa640 1 -- 172.21.15.77:0/2148006005 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f08d0059750 con 0x7f08d8156c50 2024-04-25T01:39:32.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:32.759+0000 7f08def3b640 1 -- 172.21.15.77:0/2148006005 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "b", "metadata": "b_metadata", "data": "b_data"} v 0) -- 0x7f08d804f500 con 0x7f08d8156c50 2024-04-25T01:39:33.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.412+0000 7f08d57fa640 1 -- 172.21.15.77:0/2148006005 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "b", "metadata": "b_metadata", "data": "b_data"}]=0 new fs with metadata pool 4 and data pool 5 v8) ==== 157+0+0 (secure 0 0 0) 0x7f08d0059050 con 0x7f08d8156c50 2024-04-25T01:39:33.395 INFO:teuthology.orchestra.run.smithi077.stderr:new fs with metadata pool 4 and data pool 5 2024-04-25T01:39:33.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.419+0000 7f08def3b640 1 -- 172.21.15.77:0/2148006005 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f08bc06be30 msgr2=0x7f08bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:33.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.419+0000 7f08def3b640 1 --2- 172.21.15.77:0/2148006005 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f08bc06be30 0x7f08bc06e2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f08cc034000 tx=0x7f08cc02e000 comp rx=0 tx=0).stop 2024-04-25T01:39:33.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.419+0000 7f08def3b640 1 -- 172.21.15.77:0/2148006005 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08d8156c50 msgr2=0x7f08d81ec2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:33.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.419+0000 7f08def3b640 1 --2- 172.21.15.77:0/2148006005 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08d8156c50 0x7f08d81ec2c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f08d000c7d0 tx=0x7f08d000cc90 comp rx=0 tx=0).stop 2024-04-25T01:39:33.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.421+0000 7f08def3b640 1 -- 172.21.15.77:0/2148006005 shutdown_connections 2024-04-25T01:39:33.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.421+0000 7f08def3b640 1 --2- 172.21.15.77:0/2148006005 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f08bc06be30 0x7f08bc06e2f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:33.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.421+0000 7f08def3b640 1 --2- 172.21.15.77:0/2148006005 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08d8156c50 0x7f08d81ec2c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:33.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.421+0000 7f08def3b640 1 --2- 172.21.15.77:0/2148006005 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08d806e1c0 0x7f08d80a9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:33.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.421+0000 7f08def3b640 1 --2- 172.21.15.77:0/2148006005 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f08d806d200 0x7f08d8071030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:33.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.421+0000 7f08def3b640 1 -- 172.21.15.77:0/2148006005 >> 172.21.15.77:0/2148006005 conn(0x7f08d80c7580 msgr2=0x7f08d8155e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:33.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.425+0000 7f08def3b640 1 -- 172.21.15.77:0/2148006005 shutdown_connections 2024-04-25T01:39:33.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.426+0000 7f08def3b640 1 -- 172.21.15.77:0/2148006005 wait complete. 2024-04-25T01:39:33.435 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T01:39:33.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.552+0000 7fd967bce640 1 Processor -- start 2024-04-25T01:39:33.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.552+0000 7fd967bce640 1 -- start start 2024-04-25T01:39:33.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.553+0000 7fd967bce640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd96006d0a0 0x7fd96006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:33.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.553+0000 7fd967bce640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd960154380 0x7fd960154800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:33.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.553+0000 7fd967bce640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd960153be0 con 0x7fd960150320 2024-04-25T01:39:33.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.553+0000 7fd967bce640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd960152fd0 con 0x7fd960154380 2024-04-25T01:39:33.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.553+0000 7fd967bce640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd9601532b0 con 0x7fd96006d0a0 2024-04-25T01:39:33.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.553+0000 7fd96616b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd960154380 0x7fd960154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:33.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.553+0000 7fd96616b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd960154380 0x7fd960154800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58548/0 (socket says 172.21.15.77:58548) 2024-04-25T01:39:33.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.553+0000 7fd96616b640 1 -- 172.21.15.77:0/3521829672 learned_addr learned my addr 172.21.15.77:0/3521829672 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:33.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.553+0000 7fd965169640 1 --2- 172.21.15.77:0/3521829672 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd96006d0a0 0x7fd96006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:33.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.553+0000 7fd96616b640 1 -- 172.21.15.77:0/3521829672 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd96006d0a0 msgr2=0x7fd96006d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:33.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.553+0000 7fd96616b640 1 --2- 172.21.15.77:0/3521829672 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd96006d0a0 0x7fd96006d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:33.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.553+0000 7fd96616b640 1 -- 172.21.15.77:0/3521829672 >> v1:172.21.15.121:6789/0 conn(0x7fd960150320 legacy=0x7fd960156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:33.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.553+0000 7fd96616b640 1 -- 172.21.15.77:0/3521829672 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd960153590 con 0x7fd960154380 2024-04-25T01:39:33.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.554+0000 7fd96616b640 1 --2- 172.21.15.77:0/3521829672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd960154380 0x7fd960154800 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd958009e50 tx=0x7fd95802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3e898fe879cb82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:33.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.554+0000 7fd964968640 1 -- 172.21.15.77:0/3521829672 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd958036070 con 0x7fd960154380 2024-04-25T01:39:33.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.554+0000 7fd964968640 1 -- 172.21.15.77:0/3521829672 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd958031600 con 0x7fd960154380 2024-04-25T01:39:33.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.554+0000 7fd964968640 1 -- 172.21.15.77:0/3521829672 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9580319d0 con 0x7fd960154380 2024-04-25T01:39:33.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.554+0000 7fd967bce640 1 -- 172.21.15.77:0/3521829672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd960154380 msgr2=0x7fd960154800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:33.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.554+0000 7fd967bce640 1 --2- 172.21.15.77:0/3521829672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd960154380 0x7fd960154800 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd958009e50 tx=0x7fd95802a680 comp rx=0 tx=0).stop 2024-04-25T01:39:33.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.554+0000 7fd967bce640 1 -- 172.21.15.77:0/3521829672 shutdown_connections 2024-04-25T01:39:33.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.554+0000 7fd967bce640 1 --2- 172.21.15.77:0/3521829672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd960154380 0x7fd960154800 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:33.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.554+0000 7fd967bce640 1 --2- 172.21.15.77:0/3521829672 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd96006d0a0 0x7fd96006d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:33.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.554+0000 7fd967bce640 1 -- 172.21.15.77:0/3521829672 >> 172.21.15.77:0/3521829672 conn(0x7fd9600c3f80 msgr2=0x7fd9600c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:33.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.555+0000 7fd967bce640 1 -- 172.21.15.77:0/3521829672 shutdown_connections 2024-04-25T01:39:33.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.555+0000 7fd967bce640 1 -- 172.21.15.77:0/3521829672 wait complete. 2024-04-25T01:39:33.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.556+0000 7fd967bce640 1 Processor -- start 2024-04-25T01:39:33.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.556+0000 7fd967bce640 1 -- start start 2024-04-25T01:39:33.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.556+0000 7fd967bce640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd96006d0a0 0x7fd960155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:33.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.556+0000 7fd967bce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd960150320 0x7fd9601e9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:33.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.556+0000 7fd967bce640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd960154380 0x7fd9601ea280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:33.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.556+0000 7fd967bce640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd960152d70 con 0x7fd960150320 2024-04-25T01:39:33.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.556+0000 7fd967bce640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd960152bf0 con 0x7fd96006d0a0 2024-04-25T01:39:33.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.556+0000 7fd967bce640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd9600c3100 con 0x7fd960154380 2024-04-25T01:39:33.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.556+0000 7fd965169640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd960150320 0x7fd9601e9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:33.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.556+0000 7fd965169640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd960150320 0x7fd9601e9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58564/0 (socket says 172.21.15.77:58564) 2024-04-25T01:39:33.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.556+0000 7fd965169640 1 -- 172.21.15.77:0/3636781515 learned_addr learned my addr 172.21.15.77:0/3636781515 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:33.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.557+0000 7fd96616b640 1 --2- 172.21.15.77:0/3636781515 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd960154380 0x7fd9601ea280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:33.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.557+0000 7fd96596a640 1 --2- 172.21.15.77:0/3636781515 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd96006d0a0 0x7fd960155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:33.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.557+0000 7fd965169640 1 -- 172.21.15.77:0/3636781515 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd960154380 msgr2=0x7fd9601ea280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:33.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.557+0000 7fd965169640 1 --2- 172.21.15.77:0/3636781515 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd960154380 0x7fd9601ea280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:33.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.557+0000 7fd965169640 1 -- 172.21.15.77:0/3636781515 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd96006d0a0 msgr2=0x7fd960155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:33.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.557+0000 7fd965169640 1 --2- 172.21.15.77:0/3636781515 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd96006d0a0 0x7fd960155fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:33.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.557+0000 7fd965169640 1 -- 172.21.15.77:0/3636781515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9601e9860 con 0x7fd960150320 2024-04-25T01:39:33.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.557+0000 7fd96616b640 1 --2- 172.21.15.77:0/3636781515 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd960154380 0x7fd9601ea280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:33.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.557+0000 7fd96596a640 1 --2- 172.21.15.77:0/3636781515 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd96006d0a0 0x7fd960155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:33.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.557+0000 7fd965169640 1 --2- 172.21.15.77:0/3636781515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd960150320 0x7fd9601e9d40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd95000d800 tx=0x7fd95000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:33.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.557+0000 7fd9567fc640 1 -- 172.21.15.77:0/3636781515 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd950004020 con 0x7fd960150320 2024-04-25T01:39:33.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.557+0000 7fd9567fc640 1 -- 172.21.15.77:0/3636781515 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9500041c0 con 0x7fd960150320 2024-04-25T01:39:33.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.557+0000 7fd967bce640 1 -- 172.21.15.77:0/3636781515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd960072d60 con 0x7fd960150320 2024-04-25T01:39:33.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.557+0000 7fd9567fc640 1 -- 172.21.15.77:0/3636781515 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd950004390 con 0x7fd960150320 2024-04-25T01:39:33.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.557+0000 7fd967bce640 1 -- 172.21.15.77:0/3636781515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd960073320 con 0x7fd960150320 2024-04-25T01:39:33.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.558+0000 7fd967bce640 1 -- 172.21.15.77:0/3636781515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd96004f500 con 0x7fd960150320 2024-04-25T01:39:33.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.558+0000 7fd9567fc640 1 -- 172.21.15.77:0/3636781515 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd95001b020 con 0x7fd960150320 2024-04-25T01:39:33.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.559+0000 7fd9567fc640 1 --2- 172.21.15.77:0/3636781515 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd94406be30 0x7fd94406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:33.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.559+0000 7fd9567fc640 1 -- 172.21.15.77:0/3636781515 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6521+0+0 (secure 0 0 0) 0x7fd95008af30 con 0x7fd960150320 2024-04-25T01:39:33.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.559+0000 7fd96596a640 1 --2- 172.21.15.77:0/3636781515 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd94406be30 0x7fd94406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:33.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.559+0000 7fd96596a640 1 --2- 172.21.15.77:0/3636781515 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd94406be30 0x7fd94406e2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd9600718d0 tx=0x7fd95c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:33.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.563+0000 7fd9567fc640 1 -- 172.21.15.77:0/3636781515 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd950059640 con 0x7fd960150320 2024-04-25T01:39:33.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.737+0000 7fd967bce640 1 -- 172.21.15.77:0/3636781515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd9601e9a30 con 0x7fd960150320 2024-04-25T01:39:33.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.738+0000 7fd9567fc640 1 -- 172.21.15.77:0/3636781515 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+20344 (secure 0 0 0) 0x7fd950058f40 con 0x7fd960150320 2024-04-25T01:39:33.721 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:33.722 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":23,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:39:32.760867+0000","last_up_change":"2024-04-25T01:39:10.729600+0000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T01:39:11.681151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T01:39:21.606752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T01:39:22.677664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T01:39:30.501700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T01:39:31.740717+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6811","nonce":3366980158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6817","nonce":3366980158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6828","nonce":3366980158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6825","nonce":3366980158}]},"public_addr":"172.21.15.77:6811/3366980158","cluster_addr":"172.21.15.77:6817/3366980158","heartbeat_back_addr":"172.21.15.77:6828/3366980158","heartbeat_front_addr":"172.21.15.77:6825/3366980158","state":["exists","up"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6801","nonce":3971619298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6803","nonce":3971619298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6807","nonce":3971619298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6805","nonce":3971619298}]},"public_addr":"172.21.15.77:6801/3971619298","cluster_addr":"172.21.15.77:6803/3971619298","heartbeat_back_addr":"172.21.15.77:6807/3971619298","heartbeat_front_addr":"172.21.15.77:6805/3971619298","state":["exists","up"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6810","nonce":4103452689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6813","nonce":4103452689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6823","nonce":4103452689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6818","nonce":4103452689}]},"public_addr":"172.21.15.77:6810/4103452689","cluster_addr":"172.21.15.77:6813/4103452689","heartbeat_back_addr":"172.21.15.77:6823/4103452689","heartbeat_front_addr":"172.21.15.77:6818/4103452689","state":["exists","up"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6819","nonce":217398906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6824","nonce":217398906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6831","nonce":217398906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6829","nonce":217398906}]},"public_addr":"172.21.15.77:6819/217398906","cluster_addr":"172.21.15.77:6824/217398906","heartbeat_back_addr":"172.21.15.77:6831/217398906","heartbeat_front_addr":"172.21.15.77:6829/217398906","state":["exists","up"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6801","nonce":2565483070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6803","nonce":2565483070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6810","nonce":2565483070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6806","nonce":2565483070}]},"public_addr":"172.21.15.121:6801/2565483070","cluster_addr":"172.21.15.121:6803/2565483070","heartbeat_back_addr":"172.21.15.121:6810/2565483070","heartbeat_front_addr":"172.21.15.121:6806/2565483070","state":["exists","up"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6807","nonce":2785294752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6809","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6811","nonce":2785294752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6815","nonce":2785294752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6813","nonce":2785294752}]},"public_addr":"172.21.15.121:6807/2785294752","cluster_addr":"172.21.15.121:6811/2785294752","heartbeat_back_addr":"172.21.15.121:6815/2785294752","heartbeat_front_addr":"172.21.15.121:6813/2785294752","state":["exists","up"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6820","nonce":523906818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6824","nonce":523906818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6831","nonce":523906818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6828","nonce":523906818}]},"public_addr":"172.21.15.121:6820/523906818","cluster_addr":"172.21.15.121:6824/523906818","heartbeat_back_addr":"172.21.15.121:6831/523906818","heartbeat_front_addr":"172.21.15.121:6828/523906818","state":["exists","up"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6817","nonce":1683602459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6819","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6821","nonce":1683602459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6829","nonce":1683602459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6823","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6825","nonce":1683602459}]},"public_addr":"172.21.15.121:6817/1683602459","cluster_addr":"172.21.15.121:6821/1683602459","heartbeat_back_addr":"172.21.15.121:6829/1683602459","heartbeat_front_addr":"172.21.15.121:6825/1683602459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.839443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.818842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.776243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.793085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.822396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.907311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.918374+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.848430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:39:33.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.740+0000 7fd967bce640 1 -- 172.21.15.77:0/3636781515 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd94406be30 msgr2=0x7fd94406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:33.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.740+0000 7fd967bce640 1 --2- 172.21.15.77:0/3636781515 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd94406be30 0x7fd94406e2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd9600718d0 tx=0x7fd95c009040 comp rx=0 tx=0).stop 2024-04-25T01:39:33.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.740+0000 7fd967bce640 1 -- 172.21.15.77:0/3636781515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd960150320 msgr2=0x7fd9601e9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:33.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.740+0000 7fd967bce640 1 --2- 172.21.15.77:0/3636781515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd960150320 0x7fd9601e9d40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd95000d800 tx=0x7fd95000dcc0 comp rx=0 tx=0).stop 2024-04-25T01:39:33.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.740+0000 7fd967bce640 1 -- 172.21.15.77:0/3636781515 shutdown_connections 2024-04-25T01:39:33.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.740+0000 7fd967bce640 1 --2- 172.21.15.77:0/3636781515 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd94406be30 0x7fd94406e2f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:33.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.740+0000 7fd967bce640 1 --2- 172.21.15.77:0/3636781515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd960150320 0x7fd9601e9d40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:33.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.740+0000 7fd967bce640 1 --2- 172.21.15.77:0/3636781515 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd960154380 0x7fd9601ea280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:33.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.740+0000 7fd967bce640 1 --2- 172.21.15.77:0/3636781515 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd96006d0a0 0x7fd960155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:33.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.740+0000 7fd967bce640 1 -- 172.21.15.77:0/3636781515 >> 172.21.15.77:0/3636781515 conn(0x7fd9600c3f80 msgr2=0x7fd960150a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:33.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.740+0000 7fd967bce640 1 -- 172.21.15.77:0/3636781515 shutdown_connections 2024-04-25T01:39:33.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.740+0000 7fd967bce640 1 -- 172.21.15.77:0/3636781515 wait complete. 2024-04-25T01:39:33.735 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T01:39:33.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.848+0000 7f7d066df640 1 Processor -- start 2024-04-25T01:39:33.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.848+0000 7f7d066df640 1 -- start start 2024-04-25T01:39:33.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.849+0000 7f7d066df640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d000ac840 0x7f7d000acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:33.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.849+0000 7f7d066df640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7d001558f0 0x7f7d0015e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:33.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.849+0000 7f7d066df640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d0006b480 con 0x7f7d00153cf0 2024-04-25T01:39:33.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.849+0000 7f7d066df640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f7d00155da0 con 0x7f7d001558f0 2024-04-25T01:39:33.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.849+0000 7f7d066df640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f7d00151780 con 0x7f7d000ac840 2024-04-25T01:39:33.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.849+0000 7f7d04c7c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7d001558f0 0x7f7d0015e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:33.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.849+0000 7f7cff7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7d00153cf0 0x7f7d001551e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36970/0 (socket says 172.21.15.77:36970) 2024-04-25T01:39:33.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.849+0000 7f7cff7fe640 1 -- 172.21.15.77:0/2472243499 learned_addr learned my addr 172.21.15.77:0/2472243499 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:33.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.849+0000 7f7cfffff640 1 --2- 172.21.15.77:0/2472243499 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d000ac840 0x7f7d000acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:33.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.849+0000 7f7d04c7c640 1 -- 172.21.15.77:0/2472243499 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d000ac840 msgr2=0x7f7d000acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:33.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.849+0000 7f7d04c7c640 1 --2- 172.21.15.77:0/2472243499 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d000ac840 0x7f7d000acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:33.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.849+0000 7f7d04c7c640 1 -- 172.21.15.77:0/2472243499 >> v1:172.21.15.77:6789/0 conn(0x7f7d00153cf0 legacy=0x7f7d001551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:33.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.849+0000 7f7d04c7c640 1 -- 172.21.15.77:0/2472243499 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d0006d2f0 con 0x7f7d001558f0 2024-04-25T01:39:33.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.849+0000 7f7cfeffd640 1 -- 172.21.15.77:0/2472243499 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 777174121 0 0) 0x7f7d0006b480 con 0x7f7d00153cf0 2024-04-25T01:39:33.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.850+0000 7f7d04c7c640 1 --2- 172.21.15.77:0/2472243499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d001558f0 0x7f7d0015e670 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8009d90 tx=0x7f7cf802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79cc6de35154f371 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:33.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.850+0000 7f7cfeffd640 1 -- 172.21.15.77:0/2472243499 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf8031600 con 0x7f7d001558f0 2024-04-25T01:39:33.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.850+0000 7f7cfeffd640 1 -- 172.21.15.77:0/2472243499 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cf80317a0 con 0x7f7d001558f0 2024-04-25T01:39:33.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.850+0000 7f7cfeffd640 1 -- 172.21.15.77:0/2472243499 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf8031b70 con 0x7f7d001558f0 2024-04-25T01:39:33.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.851+0000 7f7d066df640 1 -- 172.21.15.77:0/2472243499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d001558f0 msgr2=0x7f7d0015e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:33.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.851+0000 7f7d066df640 1 --2- 172.21.15.77:0/2472243499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d001558f0 0x7f7d0015e670 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8009d90 tx=0x7f7cf802a5d0 comp rx=0 tx=0).stop 2024-04-25T01:39:33.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.851+0000 7f7d066df640 1 -- 172.21.15.77:0/2472243499 shutdown_connections 2024-04-25T01:39:33.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.851+0000 7f7d066df640 1 --2- 172.21.15.77:0/2472243499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d001558f0 0x7f7d0015e670 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:33.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.851+0000 7f7d066df640 1 --2- 172.21.15.77:0/2472243499 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d000ac840 0x7f7d000acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:33.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.851+0000 7f7d066df640 1 -- 172.21.15.77:0/2472243499 >> 172.21.15.77:0/2472243499 conn(0x7f7d000c3f80 msgr2=0x7f7d000c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:33.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.851+0000 7f7d066df640 1 -- 172.21.15.77:0/2472243499 shutdown_connections 2024-04-25T01:39:33.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.851+0000 7f7d066df640 1 -- 172.21.15.77:0/2472243499 wait complete. 2024-04-25T01:39:33.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.852+0000 7f7d066df640 1 Processor -- start 2024-04-25T01:39:33.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.852+0000 7f7d066df640 1 -- start start 2024-04-25T01:39:33.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.853+0000 7f7d066df640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d000ac840 0x7f7d00072ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:33.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.853+0000 7f7d066df640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d00153cf0 0x7f7d0014a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:33.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.853+0000 7f7d066df640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d001558f0 0x7f7d000c1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:33.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.853+0000 7f7d066df640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0006dc20 con 0x7f7d00153cf0 2024-04-25T01:39:33.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.853+0000 7f7d066df640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0006d0a0 con 0x7f7d001558f0 2024-04-25T01:39:33.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.853+0000 7f7d066df640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f7d0006d8b0 con 0x7f7d000ac840 2024-04-25T01:39:33.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.853+0000 7f7cff7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d00153cf0 0x7f7d0014a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:33.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.853+0000 7f7cff7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d00153cf0 0x7f7d0014a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58578/0 (socket says 172.21.15.77:58578) 2024-04-25T01:39:33.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.853+0000 7f7cff7fe640 1 -- 172.21.15.77:0/204570722 learned_addr learned my addr 172.21.15.77:0/204570722 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:33.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.853+0000 7f7cfffff640 1 --2- 172.21.15.77:0/204570722 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d000ac840 0x7f7d00072ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:33.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.853+0000 7f7cff7fe640 1 -- 172.21.15.77:0/204570722 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d000ac840 msgr2=0x7f7d00072ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:33.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.853+0000 7f7cff7fe640 1 --2- 172.21.15.77:0/204570722 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d000ac840 0x7f7d00072ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:33.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.853+0000 7f7cff7fe640 1 -- 172.21.15.77:0/204570722 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d001558f0 msgr2=0x7f7d000c1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:33.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.853+0000 7f7cff7fe640 1 --2- 172.21.15.77:0/204570722 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d001558f0 0x7f7d000c1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:33.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.853+0000 7f7cff7fe640 1 -- 172.21.15.77:0/204570722 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d00156c50 con 0x7f7d00153cf0 2024-04-25T01:39:33.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.853+0000 7f7cff7fe640 1 --2- 172.21.15.77:0/204570722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d00153cf0 0x7f7d0014a270 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400c500 tx=0x7f7cf400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:33.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.853+0000 7f7cfcff9640 1 -- 172.21.15.77:0/204570722 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4018070 con 0x7f7d00153cf0 2024-04-25T01:39:33.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.853+0000 7f7cfcff9640 1 -- 172.21.15.77:0/204570722 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cf4007580 con 0x7f7d00153cf0 2024-04-25T01:39:33.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.853+0000 7f7cfcff9640 1 -- 172.21.15.77:0/204570722 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4004a20 con 0x7f7d00153cf0 2024-04-25T01:39:33.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.853+0000 7f7d066df640 1 -- 172.21.15.77:0/204570722 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d00072390 con 0x7f7d00153cf0 2024-04-25T01:39:33.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.853+0000 7f7d066df640 1 -- 172.21.15.77:0/204570722 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d00156450 con 0x7f7d00153cf0 2024-04-25T01:39:33.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.854+0000 7f7d066df640 1 -- 172.21.15.77:0/204570722 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d0004f500 con 0x7f7d00153cf0 2024-04-25T01:39:33.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.855+0000 7f7cfcff9640 1 -- 172.21.15.77:0/204570722 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7cf401b070 con 0x7f7d00153cf0 2024-04-25T01:39:33.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.855+0000 7f7cfcff9640 1 --2- 172.21.15.77:0/204570722 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7cec06be30 0x7f7cec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:33.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.855+0000 7f7cfffff640 1 --2- 172.21.15.77:0/204570722 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7cec06be30 0x7f7cec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:33.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.855+0000 7f7cfcff9640 1 -- 172.21.15.77:0/204570722 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6521+0+0 (secure 0 0 0) 0x7f7cf408a3d0 con 0x7f7d00153cf0 2024-04-25T01:39:33.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.856+0000 7f7cfffff640 1 --2- 172.21.15.77:0/204570722 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7cec06be30 0x7f7cec06e2f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0006fd0 tx=0x7f7cf0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:33.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:33.859+0000 7f7cfcff9640 1 -- 172.21.15.77:0/204570722 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7cf4058ae0 con 0x7f7d00153cf0 2024-04-25T01:39:34.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.034+0000 7f7d066df640 1 -- 172.21.15.77:0/204570722 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d0006b6e0 con 0x7f7d00153cf0 2024-04-25T01:39:34.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.036+0000 7f7cfcff9640 1 -- 172.21.15.77:0/204570722 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+20344 (secure 0 0 0) 0x7f7cf40583e0 con 0x7f7d00153cf0 2024-04-25T01:39:34.019 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:34.019 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":23,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:39:32.760867+0000","last_up_change":"2024-04-25T01:39:10.729600+0000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T01:39:11.681151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T01:39:21.606752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T01:39:22.677664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T01:39:30.501700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T01:39:31.740717+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6811","nonce":3366980158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6817","nonce":3366980158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6828","nonce":3366980158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6825","nonce":3366980158}]},"public_addr":"172.21.15.77:6811/3366980158","cluster_addr":"172.21.15.77:6817/3366980158","heartbeat_back_addr":"172.21.15.77:6828/3366980158","heartbeat_front_addr":"172.21.15.77:6825/3366980158","state":["exists","up"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6801","nonce":3971619298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6803","nonce":3971619298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6807","nonce":3971619298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6805","nonce":3971619298}]},"public_addr":"172.21.15.77:6801/3971619298","cluster_addr":"172.21.15.77:6803/3971619298","heartbeat_back_addr":"172.21.15.77:6807/3971619298","heartbeat_front_addr":"172.21.15.77:6805/3971619298","state":["exists","up"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6810","nonce":4103452689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6813","nonce":4103452689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6823","nonce":4103452689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6818","nonce":4103452689}]},"public_addr":"172.21.15.77:6810/4103452689","cluster_addr":"172.21.15.77:6813/4103452689","heartbeat_back_addr":"172.21.15.77:6823/4103452689","heartbeat_front_addr":"172.21.15.77:6818/4103452689","state":["exists","up"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6819","nonce":217398906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6824","nonce":217398906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6831","nonce":217398906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6829","nonce":217398906}]},"public_addr":"172.21.15.77:6819/217398906","cluster_addr":"172.21.15.77:6824/217398906","heartbeat_back_addr":"172.21.15.77:6831/217398906","heartbeat_front_addr":"172.21.15.77:6829/217398906","state":["exists","up"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6801","nonce":2565483070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6803","nonce":2565483070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6810","nonce":2565483070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6806","nonce":2565483070}]},"public_addr":"172.21.15.121:6801/2565483070","cluster_addr":"172.21.15.121:6803/2565483070","heartbeat_back_addr":"172.21.15.121:6810/2565483070","heartbeat_front_addr":"172.21.15.121:6806/2565483070","state":["exists","up"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6807","nonce":2785294752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6809","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6811","nonce":2785294752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6815","nonce":2785294752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6813","nonce":2785294752}]},"public_addr":"172.21.15.121:6807/2785294752","cluster_addr":"172.21.15.121:6811/2785294752","heartbeat_back_addr":"172.21.15.121:6815/2785294752","heartbeat_front_addr":"172.21.15.121:6813/2785294752","state":["exists","up"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6820","nonce":523906818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6824","nonce":523906818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6831","nonce":523906818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6828","nonce":523906818}]},"public_addr":"172.21.15.121:6820/523906818","cluster_addr":"172.21.15.121:6824/523906818","heartbeat_back_addr":"172.21.15.121:6831/523906818","heartbeat_front_addr":"172.21.15.121:6828/523906818","state":["exists","up"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6817","nonce":1683602459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6819","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6821","nonce":1683602459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6829","nonce":1683602459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6823","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6825","nonce":1683602459}]},"public_addr":"172.21.15.121:6817/1683602459","cluster_addr":"172.21.15.121:6821/1683602459","heartbeat_back_addr":"172.21.15.121:6829/1683602459","heartbeat_front_addr":"172.21.15.121:6825/1683602459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.839443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.818842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.776243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.793085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.822396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.907311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.918374+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.848430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:39:34.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.038+0000 7f7d066df640 1 -- 172.21.15.77:0/204570722 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7cec06be30 msgr2=0x7f7cec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:34.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.038+0000 7f7d066df640 1 --2- 172.21.15.77:0/204570722 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7cec06be30 0x7f7cec06e2f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0006fd0 tx=0x7f7cf0008040 comp rx=0 tx=0).stop 2024-04-25T01:39:34.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.038+0000 7f7d066df640 1 -- 172.21.15.77:0/204570722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d00153cf0 msgr2=0x7f7d0014a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:34.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.038+0000 7f7d066df640 1 --2- 172.21.15.77:0/204570722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d00153cf0 0x7f7d0014a270 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400c500 tx=0x7f7cf400c9c0 comp rx=0 tx=0).stop 2024-04-25T01:39:34.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.038+0000 7f7d066df640 1 -- 172.21.15.77:0/204570722 shutdown_connections 2024-04-25T01:39:34.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.038+0000 7f7d066df640 1 --2- 172.21.15.77:0/204570722 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7cec06be30 0x7f7cec06e2f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:34.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.038+0000 7f7d066df640 1 --2- 172.21.15.77:0/204570722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d00153cf0 0x7f7d0014a270 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:34.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.038+0000 7f7d066df640 1 --2- 172.21.15.77:0/204570722 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d001558f0 0x7f7d000c1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:34.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.038+0000 7f7d066df640 1 --2- 172.21.15.77:0/204570722 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d000ac840 0x7f7d00072ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:34.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.038+0000 7f7d066df640 1 -- 172.21.15.77:0/204570722 >> 172.21.15.77:0/204570722 conn(0x7f7d000c3f80 msgr2=0x7f7d000c4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:34.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.038+0000 7f7d066df640 1 -- 172.21.15.77:0/204570722 shutdown_connections 2024-04-25T01:39:34.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.038+0000 7f7d066df640 1 -- 172.21.15.77:0/204570722 wait complete. 2024-04-25T01:39:34.032 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b standby_count_wanted 0 2024-04-25T01:39:34.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.149+0000 7fed77122640 1 Processor -- start 2024-04-25T01:39:34.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.149+0000 7fed77122640 1 -- start start 2024-04-25T01:39:34.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.149+0000 7fed77122640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fed700c4d10 0x7fed700c2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:34.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.149+0000 7fed77122640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed700acf70 con 0x7fed7006d470 2024-04-25T01:39:34.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.149+0000 7fed77122640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed70153120 con 0x7fed700c6c50 2024-04-25T01:39:34.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.149+0000 7fed77122640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fed700acd20 con 0x7fed700c4d10 2024-04-25T01:39:34.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.149+0000 7fed756bf640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fed700c4d10 0x7fed700c2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:34.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.150+0000 7fed756bf640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fed700c4d10 0x7fed700c2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58586/0 (socket says 172.21.15.77:58586) 2024-04-25T01:39:34.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.149+0000 7fed74ebe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fed7006d470 0x7fed7006d850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36980/0 (socket says 172.21.15.77:36980) 2024-04-25T01:39:34.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.150+0000 7fed756bf640 1 -- 172.21.15.77:0/1443488816 learned_addr learned my addr 172.21.15.77:0/1443488816 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:34.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.150+0000 7fed756bf640 1 -- 172.21.15.77:0/1443488816 >> v1:172.21.15.121:6789/0 conn(0x7fed700c6c50 legacy=0x7fed700abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:34.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.150+0000 7fed756bf640 1 -- 172.21.15.77:0/1443488816 >> v1:172.21.15.77:6789/0 conn(0x7fed7006d470 legacy=0x7fed7006d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:34.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.150+0000 7fed6f7fe640 1 -- 172.21.15.77:0/1443488816 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3291991720 0 0) 0x7fed700acf70 con 0x7fed7006d470 2024-04-25T01:39:34.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.150+0000 7fed756bf640 1 -- 172.21.15.77:0/1443488816 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed70153400 con 0x7fed700c4d10 2024-04-25T01:39:34.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.150+0000 7fed756bf640 1 --2- 172.21.15.77:0/1443488816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed700c4d10 0x7fed700c2340 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fed60009870 tx=0x7fed6002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f73ddaf41eff9ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:34.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.150+0000 7fed6f7fe640 1 -- 172.21.15.77:0/1443488816 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed60037070 con 0x7fed700c4d10 2024-04-25T01:39:34.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.151+0000 7fed6f7fe640 1 -- 172.21.15.77:0/1443488816 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed60032440 con 0x7fed700c4d10 2024-04-25T01:39:34.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.151+0000 7fed6f7fe640 1 -- 172.21.15.77:0/1443488816 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed60032810 con 0x7fed700c4d10 2024-04-25T01:39:34.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.151+0000 7fed77122640 1 -- 172.21.15.77:0/1443488816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed700c4d10 msgr2=0x7fed700c2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:34.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.151+0000 7fed77122640 1 --2- 172.21.15.77:0/1443488816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed700c4d10 0x7fed700c2340 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fed60009870 tx=0x7fed6002a180 comp rx=0 tx=0).stop 2024-04-25T01:39:34.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.151+0000 7fed77122640 1 -- 172.21.15.77:0/1443488816 shutdown_connections 2024-04-25T01:39:34.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.151+0000 7fed77122640 1 --2- 172.21.15.77:0/1443488816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed700c4d10 0x7fed700c2340 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:34.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.151+0000 7fed77122640 1 -- 172.21.15.77:0/1443488816 >> 172.21.15.77:0/1443488816 conn(0x7fed700c7580 msgr2=0x7fed700c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:34.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.151+0000 7fed77122640 1 -- 172.21.15.77:0/1443488816 shutdown_connections 2024-04-25T01:39:34.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.151+0000 7fed77122640 1 -- 172.21.15.77:0/1443488816 wait complete. 2024-04-25T01:39:34.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.152+0000 7fed77122640 1 Processor -- start 2024-04-25T01:39:34.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.152+0000 7fed77122640 1 -- start start 2024-04-25T01:39:34.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.153+0000 7fed77122640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fed7006d470 0x7fed700c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:34.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.153+0000 7fed77122640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed700c4d10 0x7fed7014caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:34.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.153+0000 7fed77122640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed700c6c50 0x7fed701eb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:34.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.153+0000 7fed77122640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fed700c2880 con 0x7fed700c6c50 2024-04-25T01:39:34.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.153+0000 7fed77122640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fed700ac8b0 con 0x7fed700c4d10 2024-04-25T01:39:34.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.153+0000 7fed77122640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fed700c2a00 con 0x7fed7006d470 2024-04-25T01:39:34.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.153+0000 7fed756bf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed700c6c50 0x7fed701eb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:34.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.153+0000 7fed756bf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed700c6c50 0x7fed701eb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58592/0 (socket says 172.21.15.77:58592) 2024-04-25T01:39:34.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.153+0000 7fed756bf640 1 -- 172.21.15.77:0/2834963008 learned_addr learned my addr 172.21.15.77:0/2834963008 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:34.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.153+0000 7fed74ebe640 1 --2- 172.21.15.77:0/2834963008 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fed7006d470 0x7fed700c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:34.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.153+0000 7fed6ffff640 1 --2- 172.21.15.77:0/2834963008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed700c4d10 0x7fed7014caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:34.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.153+0000 7fed756bf640 1 -- 172.21.15.77:0/2834963008 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fed7006d470 msgr2=0x7fed700c55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:34.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.153+0000 7fed756bf640 1 --2- 172.21.15.77:0/2834963008 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fed7006d470 0x7fed700c55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:34.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.153+0000 7fed756bf640 1 -- 172.21.15.77:0/2834963008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed700c4d10 msgr2=0x7fed7014caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:34.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.153+0000 7fed756bf640 1 --2- 172.21.15.77:0/2834963008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed700c4d10 0x7fed7014caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:34.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.153+0000 7fed756bf640 1 -- 172.21.15.77:0/2834963008 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed7014d2f0 con 0x7fed700c6c50 2024-04-25T01:39:34.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.153+0000 7fed6ffff640 1 --2- 172.21.15.77:0/2834963008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed700c4d10 0x7fed7014caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:34.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.154+0000 7fed756bf640 1 --2- 172.21.15.77:0/2834963008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed700c6c50 0x7fed701eb4a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fed600090b0 tx=0x7fed600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:34.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.154+0000 7fed6d7fa640 1 -- 172.21.15.77:0/2834963008 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed60037040 con 0x7fed700c6c50 2024-04-25T01:39:34.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.154+0000 7fed6d7fa640 1 -- 172.21.15.77:0/2834963008 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed60004230 con 0x7fed700c6c50 2024-04-25T01:39:34.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.154+0000 7fed77122640 1 -- 172.21.15.77:0/2834963008 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed700727e0 con 0x7fed700c6c50 2024-04-25T01:39:34.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.154+0000 7fed6d7fa640 1 -- 172.21.15.77:0/2834963008 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6003c670 con 0x7fed700c6c50 2024-04-25T01:39:34.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.154+0000 7fed77122640 1 -- 172.21.15.77:0/2834963008 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed70072da0 con 0x7fed700c6c50 2024-04-25T01:39:34.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.155+0000 7fed77122640 1 -- 172.21.15.77:0/2834963008 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed7004f500 con 0x7fed700c6c50 2024-04-25T01:39:34.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.155+0000 7fed6d7fa640 1 -- 172.21.15.77:0/2834963008 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fed6003a070 con 0x7fed700c6c50 2024-04-25T01:39:34.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.155+0000 7fed6d7fa640 1 --2- 172.21.15.77:0/2834963008 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fed5006be30 0x7fed5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:34.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.156+0000 7fed6d7fa640 1 -- 172.21.15.77:0/2834963008 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6521+0+0 (secure 0 0 0) 0x7fed600ab9c0 con 0x7fed700c6c50 2024-04-25T01:39:34.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.156+0000 7fed74ebe640 1 --2- 172.21.15.77:0/2834963008 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fed5006be30 0x7fed5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:34.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.156+0000 7fed74ebe640 1 --2- 172.21.15.77:0/2834963008 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fed5006be30 0x7fed5006e2f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fed680012e0 tx=0x7fed68001700 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:34.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.160+0000 7fed6d7fa640 1 -- 172.21.15.77:0/2834963008 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fed600ade20 con 0x7fed700c6c50 2024-04-25T01:39:34.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:34.371+0000 7fed77122640 1 -- 172.21.15.77:0/2834963008 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fed700c5b30 con 0x7fed700c6c50 2024-04-25T01:39:35.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.359+0000 7fed6d7fa640 1 -- 172.21.15.77:0/2834963008 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "standby_count_wanted", "val": "0"}]=0 v10) ==== 113+0+0 (secure 0 0 0) 0x7fed60041020 con 0x7fed700c6c50 2024-04-25T01:39:35.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.361+0000 7fed77122640 1 -- 172.21.15.77:0/2834963008 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fed5006be30 msgr2=0x7fed5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:35.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.361+0000 7fed77122640 1 --2- 172.21.15.77:0/2834963008 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fed5006be30 0x7fed5006e2f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fed680012e0 tx=0x7fed68001700 comp rx=0 tx=0).stop 2024-04-25T01:39:35.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.361+0000 7fed77122640 1 -- 172.21.15.77:0/2834963008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed700c6c50 msgr2=0x7fed701eb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:35.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.361+0000 7fed77122640 1 --2- 172.21.15.77:0/2834963008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed700c6c50 0x7fed701eb4a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fed600090b0 tx=0x7fed600046c0 comp rx=0 tx=0).stop 2024-04-25T01:39:35.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.361+0000 7fed77122640 1 -- 172.21.15.77:0/2834963008 shutdown_connections 2024-04-25T01:39:35.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.361+0000 7fed77122640 1 --2- 172.21.15.77:0/2834963008 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fed5006be30 0x7fed5006e2f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:35.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.361+0000 7fed77122640 1 --2- 172.21.15.77:0/2834963008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed700c6c50 0x7fed701eb4a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:35.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.361+0000 7fed77122640 1 --2- 172.21.15.77:0/2834963008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed700c4d10 0x7fed7014caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:35.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.361+0000 7fed77122640 1 --2- 172.21.15.77:0/2834963008 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fed7006d470 0x7fed700c55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:35.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.361+0000 7fed77122640 1 -- 172.21.15.77:0/2834963008 >> 172.21.15.77:0/2834963008 conn(0x7fed700c7580 msgr2=0x7fed70151fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:35.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.362+0000 7fed77122640 1 -- 172.21.15.77:0/2834963008 shutdown_connections 2024-04-25T01:39:35.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.362+0000 7fed77122640 1 -- 172.21.15.77:0/2834963008 wait complete. 2024-04-25T01:39:35.357 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-04-25T01:39:35.358 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b allow_standby_replay false 2024-04-25T01:39:35.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.482+0000 7faf719c8640 1 Processor -- start 2024-04-25T01:39:35.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.482+0000 7faf719c8640 1 -- start start 2024-04-25T01:39:35.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.482+0000 7faf719c8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faf6c0cbef0 0x7faf6c156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:35.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.482+0000 7faf719c8640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7faf6c14fd20 0x7faf6c150150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:35.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.482+0000 7faf719c8640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf6c0c6ca0 con 0x7faf6c15a0e0 2024-04-25T01:39:35.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.482+0000 7faf719c8640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7faf6c0c66e0 con 0x7faf6c0cbef0 2024-04-25T01:39:35.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.482+0000 7faf719c8640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7faf6c0c69c0 con 0x7faf6c14fd20 2024-04-25T01:39:35.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.482+0000 7faf6affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faf6c0cbef0 0x7faf6c156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:35.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.483+0000 7faf6affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faf6c0cbef0 0x7faf6c156ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58608/0 (socket says 172.21.15.77:58608) 2024-04-25T01:39:35.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.483+0000 7faf6affd640 1 -- 172.21.15.77:0/1240287087 learned_addr learned my addr 172.21.15.77:0/1240287087 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:35.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.483+0000 7faf6affd640 1 -- 172.21.15.77:0/1240287087 >> v2:172.21.15.121:3300/0 conn(0x7faf6c14fd20 msgr2=0x7faf6c150150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:35.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.483+0000 7faf6affd640 1 --2- 172.21.15.77:0/1240287087 >> v2:172.21.15.121:3300/0 conn(0x7faf6c14fd20 0x7faf6c150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:35.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.483+0000 7faf6affd640 1 -- 172.21.15.77:0/1240287087 >> v1:172.21.15.121:6789/0 conn(0x7faf6c15a0e0 legacy=0x7faf6c0c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:35.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.483+0000 7faf6affd640 1 -- 172.21.15.77:0/1240287087 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf6c1598e0 con 0x7faf6c0cbef0 2024-04-25T01:39:35.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.483+0000 7faf6affd640 1 --2- 172.21.15.77:0/1240287087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf6c0cbef0 0x7faf6c156ba0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faf6c0c9440 tx=0x7faf5c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf403989c61691d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:35.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.483+0000 7faf69ffb640 1 -- 172.21.15.77:0/1240287087 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5c037070 con 0x7faf6c0cbef0 2024-04-25T01:39:35.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.484+0000 7faf69ffb640 1 -- 172.21.15.77:0/1240287087 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf5c032440 con 0x7faf6c0cbef0 2024-04-25T01:39:35.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.484+0000 7faf69ffb640 1 -- 172.21.15.77:0/1240287087 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5c032810 con 0x7faf6c0cbef0 2024-04-25T01:39:35.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.484+0000 7faf719c8640 1 -- 172.21.15.77:0/1240287087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf6c0cbef0 msgr2=0x7faf6c156ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:35.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.484+0000 7faf719c8640 1 --2- 172.21.15.77:0/1240287087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf6c0cbef0 0x7faf6c156ba0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faf6c0c9440 tx=0x7faf5c02a230 comp rx=0 tx=0).stop 2024-04-25T01:39:35.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.484+0000 7faf719c8640 1 -- 172.21.15.77:0/1240287087 shutdown_connections 2024-04-25T01:39:35.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.484+0000 7faf719c8640 1 --2- 172.21.15.77:0/1240287087 >> v2:172.21.15.121:3300/0 conn(0x7faf6c14fd20 0x7faf6c150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:35.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.484+0000 7faf719c8640 1 --2- 172.21.15.77:0/1240287087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf6c0cbef0 0x7faf6c156ba0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:35.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.484+0000 7faf719c8640 1 -- 172.21.15.77:0/1240287087 >> 172.21.15.77:0/1240287087 conn(0x7faf6c067080 msgr2=0x7faf6c067460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:35.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.484+0000 7faf719c8640 1 -- 172.21.15.77:0/1240287087 shutdown_connections 2024-04-25T01:39:35.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.484+0000 7faf719c8640 1 -- 172.21.15.77:0/1240287087 wait complete. 2024-04-25T01:39:35.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.485+0000 7faf719c8640 1 Processor -- start 2024-04-25T01:39:35.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.485+0000 7faf719c8640 1 -- start start 2024-04-25T01:39:35.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.486+0000 7faf719c8640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faf6c0cbef0 0x7faf6c151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:35.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.486+0000 7faf719c8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf6c14fd20 0x7faf6c1ef840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:35.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.486+0000 7faf719c8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf6c15a0e0 0x7faf6c0c5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:35.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.486+0000 7faf719c8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faf6c15a530 con 0x7faf6c15a0e0 2024-04-25T01:39:35.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.486+0000 7faf719c8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faf6c06d0d0 con 0x7faf6c14fd20 2024-04-25T01:39:35.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.486+0000 7faf719c8640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7faf6c0c6290 con 0x7faf6c0cbef0 2024-04-25T01:39:35.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.486+0000 7faf6b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf6c15a0e0 0x7faf6c0c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:35.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.486+0000 7faf6b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf6c15a0e0 0x7faf6c0c5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58624/0 (socket says 172.21.15.77:58624) 2024-04-25T01:39:35.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.486+0000 7faf6b7fe640 1 -- 172.21.15.77:0/3597713001 learned_addr learned my addr 172.21.15.77:0/3597713001 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:35.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.486+0000 7faf6affd640 1 --2- 172.21.15.77:0/3597713001 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faf6c0cbef0 0x7faf6c151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:35.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.486+0000 7faf6a7fc640 1 --2- 172.21.15.77:0/3597713001 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf6c14fd20 0x7faf6c1ef840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:35.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.486+0000 7faf6b7fe640 1 -- 172.21.15.77:0/3597713001 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faf6c0cbef0 msgr2=0x7faf6c151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:35.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.486+0000 7faf6b7fe640 1 --2- 172.21.15.77:0/3597713001 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faf6c0cbef0 0x7faf6c151400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:35.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.486+0000 7faf6b7fe640 1 -- 172.21.15.77:0/3597713001 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf6c14fd20 msgr2=0x7faf6c1ef840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:35.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.486+0000 7faf6b7fe640 1 --2- 172.21.15.77:0/3597713001 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf6c14fd20 0x7faf6c1ef840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:35.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.486+0000 7faf6b7fe640 1 -- 172.21.15.77:0/3597713001 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf6c158590 con 0x7faf6c15a0e0 2024-04-25T01:39:35.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.486+0000 7faf6affd640 1 --2- 172.21.15.77:0/3597713001 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faf6c0cbef0 0x7faf6c151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:35.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.486+0000 7faf6a7fc640 1 --2- 172.21.15.77:0/3597713001 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf6c14fd20 0x7faf6c1ef840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:35.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.487+0000 7faf6b7fe640 1 --2- 172.21.15.77:0/3597713001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf6c15a0e0 0x7faf6c0c5440 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faf6400b9a0 tx=0x7faf6400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:35.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.487+0000 7faf53fff640 1 -- 172.21.15.77:0/3597713001 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf64019070 con 0x7faf6c15a0e0 2024-04-25T01:39:35.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.487+0000 7faf53fff640 1 -- 172.21.15.77:0/3597713001 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf6400cbc0 con 0x7faf6c15a0e0 2024-04-25T01:39:35.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.487+0000 7faf719c8640 1 -- 172.21.15.77:0/3597713001 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf6c158870 con 0x7faf6c15a0e0 2024-04-25T01:39:35.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.487+0000 7faf53fff640 1 -- 172.21.15.77:0/3597713001 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf64014440 con 0x7faf6c15a0e0 2024-04-25T01:39:35.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.487+0000 7faf719c8640 1 -- 172.21.15.77:0/3597713001 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf6c158e30 con 0x7faf6c15a0e0 2024-04-25T01:39:35.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.488+0000 7faf719c8640 1 -- 172.21.15.77:0/3597713001 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf6c04f500 con 0x7faf6c15a0e0 2024-04-25T01:39:35.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.488+0000 7faf53fff640 1 -- 172.21.15.77:0/3597713001 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faf6401c070 con 0x7faf6c15a0e0 2024-04-25T01:39:35.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.489+0000 7faf53fff640 1 --2- 172.21.15.77:0/3597713001 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7faf5806be30 0x7faf5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:35.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.489+0000 7faf53fff640 1 -- 172.21.15.77:0/3597713001 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7faf6408ae50 con 0x7faf6c15a0e0 2024-04-25T01:39:35.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.489+0000 7faf6affd640 1 --2- 172.21.15.77:0/3597713001 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7faf5806be30 0x7faf5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:35.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.489+0000 7faf6affd640 1 --2- 172.21.15.77:0/3597713001 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7faf5806be30 0x7faf5806e2f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faf5c034000 tx=0x7faf5c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:35.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.493+0000 7faf53fff640 1 -- 172.21.15.77:0/3597713001 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7faf64059560 con 0x7faf6c15a0e0 2024-04-25T01:39:35.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:35.706+0000 7faf719c8640 1 -- 172.21.15.77:0/3597713001 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7faf6c0cac90 con 0x7faf6c15a0e0 2024-04-25T01:39:36.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.442+0000 7faf53fff640 1 -- 172.21.15.77:0/3597713001 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "allow_standby_replay", "val": "false"}]=0 v11) ==== 117+0+0 (secure 0 0 0) 0x7faf64058e60 con 0x7faf6c15a0e0 2024-04-25T01:39:36.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.445+0000 7faf719c8640 1 -- 172.21.15.77:0/3597713001 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7faf5806be30 msgr2=0x7faf5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:36.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.445+0000 7faf719c8640 1 --2- 172.21.15.77:0/3597713001 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7faf5806be30 0x7faf5806e2f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faf5c034000 tx=0x7faf5c02e000 comp rx=0 tx=0).stop 2024-04-25T01:39:36.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.445+0000 7faf719c8640 1 -- 172.21.15.77:0/3597713001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf6c15a0e0 msgr2=0x7faf6c0c5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:36.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.445+0000 7faf719c8640 1 --2- 172.21.15.77:0/3597713001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf6c15a0e0 0x7faf6c0c5440 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faf6400b9a0 tx=0x7faf6400be60 comp rx=0 tx=0).stop 2024-04-25T01:39:36.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.445+0000 7faf719c8640 1 -- 172.21.15.77:0/3597713001 shutdown_connections 2024-04-25T01:39:36.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.445+0000 7faf719c8640 1 --2- 172.21.15.77:0/3597713001 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7faf5806be30 0x7faf5806e2f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:36.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.445+0000 7faf719c8640 1 --2- 172.21.15.77:0/3597713001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf6c15a0e0 0x7faf6c0c5440 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:36.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.445+0000 7faf719c8640 1 --2- 172.21.15.77:0/3597713001 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf6c14fd20 0x7faf6c1ef840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:36.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.445+0000 7faf719c8640 1 --2- 172.21.15.77:0/3597713001 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faf6c0cbef0 0x7faf6c151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:36.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.445+0000 7faf719c8640 1 -- 172.21.15.77:0/3597713001 >> 172.21.15.77:0/3597713001 conn(0x7faf6c067080 msgr2=0x7faf6c067460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:36.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.445+0000 7faf719c8640 1 -- 172.21.15.77:0/3597713001 shutdown_connections 2024-04-25T01:39:36.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.445+0000 7faf719c8640 1 -- 172.21.15.77:0/3597713001 wait complete. 2024-04-25T01:39:36.441 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b session_timeout 300 2024-04-25T01:39:36.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.563+0000 7f7a5349e640 1 Processor -- start 2024-04-25T01:39:36.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.563+0000 7f7a5349e640 1 -- start start 2024-04-25T01:39:36.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.564+0000 7f7a5349e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7a4c0aca40 0x7f7a4c1511f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:36.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.564+0000 7f7a5349e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7a4c151730 0x7f7a4c06d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:36.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.564+0000 7f7a5349e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a4c151b40 con 0x7f7a4c0c4280 2024-04-25T01:39:36.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.564+0000 7f7a5349e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f7a4c1546b0 con 0x7f7a4c151730 2024-04-25T01:39:36.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.564+0000 7f7a5349e640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f7a4c154990 con 0x7f7a4c0aca40 2024-04-25T01:39:36.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.564+0000 7f7a51a3b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7a4c151730 0x7f7a4c06d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:36.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.564+0000 7f7a51a3b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7a4c151730 0x7f7a4c06d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58628/0 (socket says 172.21.15.77:58628) 2024-04-25T01:39:36.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.564+0000 7f7a5123a640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7a4c0c4280 0x7f7a4c153ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36988/0 (socket says 172.21.15.77:36988) 2024-04-25T01:39:36.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.564+0000 7f7a51a3b640 1 -- 172.21.15.77:0/3003020919 learned_addr learned my addr 172.21.15.77:0/3003020919 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:36.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.564+0000 7f7a50a39640 1 --2- 172.21.15.77:0/3003020919 >> v2:172.21.15.121:3300/0 conn(0x7f7a4c0aca40 0x7f7a4c1511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:36.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.564+0000 7f7a51a3b640 1 -- 172.21.15.77:0/3003020919 >> v2:172.21.15.121:3300/0 conn(0x7f7a4c0aca40 msgr2=0x7f7a4c1511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:36.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.564+0000 7f7a51a3b640 1 --2- 172.21.15.77:0/3003020919 >> v2:172.21.15.121:3300/0 conn(0x7f7a4c0aca40 0x7f7a4c1511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:36.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.564+0000 7f7a51a3b640 1 -- 172.21.15.77:0/3003020919 >> v1:172.21.15.77:6789/0 conn(0x7f7a4c0c4280 legacy=0x7f7a4c153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:36.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.564+0000 7f7a43fff640 1 -- 172.21.15.77:0/3003020919 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2549673815 0 0) 0x7f7a4c151b40 con 0x7f7a4c0c4280 2024-04-25T01:39:36.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.564+0000 7f7a51a3b640 1 -- 172.21.15.77:0/3003020919 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a4c154c70 con 0x7f7a4c151730 2024-04-25T01:39:36.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.565+0000 7f7a51a3b640 1 --2- 172.21.15.77:0/3003020919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a4c151730 0x7f7a4c06d8c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0c7530 tx=0x7f7a4402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792007fe675ee6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:36.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.565+0000 7f7a43fff640 1 -- 172.21.15.77:0/3003020919 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a44036070 con 0x7f7a4c151730 2024-04-25T01:39:36.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.565+0000 7f7a43fff640 1 -- 172.21.15.77:0/3003020919 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a44031600 con 0x7f7a4c151730 2024-04-25T01:39:36.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.565+0000 7f7a43fff640 1 -- 172.21.15.77:0/3003020919 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a440319d0 con 0x7f7a4c151730 2024-04-25T01:39:36.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.565+0000 7f7a5349e640 1 -- 172.21.15.77:0/3003020919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a4c151730 msgr2=0x7f7a4c06d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:36.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.565+0000 7f7a5349e640 1 --2- 172.21.15.77:0/3003020919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a4c151730 0x7f7a4c06d8c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0c7530 tx=0x7f7a4402a6a0 comp rx=0 tx=0).stop 2024-04-25T01:39:36.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.566+0000 7f7a5349e640 1 -- 172.21.15.77:0/3003020919 shutdown_connections 2024-04-25T01:39:36.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.566+0000 7f7a5349e640 1 --2- 172.21.15.77:0/3003020919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a4c151730 0x7f7a4c06d8c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:36.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.566+0000 7f7a5349e640 1 --2- 172.21.15.77:0/3003020919 >> v2:172.21.15.121:3300/0 conn(0x7f7a4c0aca40 0x7f7a4c1511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:36.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.566+0000 7f7a5349e640 1 -- 172.21.15.77:0/3003020919 >> 172.21.15.77:0/3003020919 conn(0x7f7a4c0c7580 msgr2=0x7f7a4c0c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:36.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.566+0000 7f7a5349e640 1 -- 172.21.15.77:0/3003020919 shutdown_connections 2024-04-25T01:39:36.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.566+0000 7f7a5349e640 1 -- 172.21.15.77:0/3003020919 wait complete. 2024-04-25T01:39:36.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.567+0000 7f7a5349e640 1 Processor -- start 2024-04-25T01:39:36.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.567+0000 7f7a5349e640 1 -- start start 2024-04-25T01:39:36.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.567+0000 7f7a5349e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7a4c0aca40 0x7f7a4c070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:36.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.567+0000 7f7a5349e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a4c0c4280 0x7f7a4c14a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:36.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.567+0000 7f7a5349e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a4c151730 0x7f7a4c14ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:36.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.567+0000 7f7a5349e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4c0c47e0 con 0x7f7a4c0c4280 2024-04-25T01:39:36.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.567+0000 7f7a5349e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4c0c4660 con 0x7f7a4c151730 2024-04-25T01:39:36.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.567+0000 7f7a5349e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f7a4c06de00 con 0x7f7a4c0aca40 2024-04-25T01:39:36.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.567+0000 7f7a50a39640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a4c0c4280 0x7f7a4c14a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:36.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.567+0000 7f7a50a39640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a4c0c4280 0x7f7a4c14a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58630/0 (socket says 172.21.15.77:58630) 2024-04-25T01:39:36.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.567+0000 7f7a50a39640 1 -- 172.21.15.77:0/1126009861 learned_addr learned my addr 172.21.15.77:0/1126009861 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:36.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.568+0000 7f7a5123a640 1 --2- 172.21.15.77:0/1126009861 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7a4c0aca40 0x7f7a4c070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:36.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.568+0000 7f7a51a3b640 1 --2- 172.21.15.77:0/1126009861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a4c151730 0x7f7a4c14ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:36.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.568+0000 7f7a50a39640 1 -- 172.21.15.77:0/1126009861 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7a4c0aca40 msgr2=0x7f7a4c070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:36.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.568+0000 7f7a50a39640 1 --2- 172.21.15.77:0/1126009861 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7a4c0aca40 0x7f7a4c070a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:36.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.568+0000 7f7a50a39640 1 -- 172.21.15.77:0/1126009861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a4c151730 msgr2=0x7f7a4c14ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:36.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.568+0000 7f7a50a39640 1 --2- 172.21.15.77:0/1126009861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a4c151730 0x7f7a4c14ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:36.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.568+0000 7f7a50a39640 1 -- 172.21.15.77:0/1126009861 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a4c14d6b0 con 0x7f7a4c0c4280 2024-04-25T01:39:36.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.568+0000 7f7a5123a640 1 --2- 172.21.15.77:0/1126009861 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7a4c0aca40 0x7f7a4c070a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:36.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.568+0000 7f7a51a3b640 1 --2- 172.21.15.77:0/1126009861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a4c151730 0x7f7a4c14ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:36.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.568+0000 7f7a50a39640 1 --2- 172.21.15.77:0/1126009861 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a4c0c4280 0x7f7a4c14a6f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c00d800 tx=0x7f7a3c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:36.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.568+0000 7f7a41ffb640 1 -- 172.21.15.77:0/1126009861 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c00b6c0 con 0x7f7a4c0c4280 2024-04-25T01:39:36.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.568+0000 7f7a41ffb640 1 -- 172.21.15.77:0/1126009861 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a3c019070 con 0x7f7a4c0c4280 2024-04-25T01:39:36.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.568+0000 7f7a5349e640 1 -- 172.21.15.77:0/1126009861 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a4c14d990 con 0x7f7a4c0c4280 2024-04-25T01:39:36.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.568+0000 7f7a41ffb640 1 -- 172.21.15.77:0/1126009861 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c00ba80 con 0x7f7a4c0c4280 2024-04-25T01:39:36.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.568+0000 7f7a5349e640 1 -- 172.21.15.77:0/1126009861 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a4c14df50 con 0x7f7a4c0c4280 2024-04-25T01:39:36.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.569+0000 7f7a5349e640 1 -- 172.21.15.77:0/1126009861 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a4c0c2510 con 0x7f7a4c0c4280 2024-04-25T01:39:36.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.569+0000 7f7a41ffb640 1 -- 172.21.15.77:0/1126009861 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7a3c00bc20 con 0x7f7a4c0c4280 2024-04-25T01:39:36.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.570+0000 7f7a41ffb640 1 --2- 172.21.15.77:0/1126009861 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7a3006be30 0x7f7a3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:36.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.570+0000 7f7a41ffb640 1 -- 172.21.15.77:0/1126009861 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f7a3c08b5c0 con 0x7f7a4c0c4280 2024-04-25T01:39:36.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.570+0000 7f7a5123a640 1 --2- 172.21.15.77:0/1126009861 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7a3006be30 0x7f7a3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:36.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.570+0000 7f7a5123a640 1 --2- 172.21.15.77:0/1126009861 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7a3006be30 0x7f7a3006e2f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7a48000f60 tx=0x7f7a48009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:36.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.574+0000 7f7a41ffb640 1 -- 172.21.15.77:0/1126009861 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7a4c0c2510 con 0x7f7a4c0c4280 2024-04-25T01:39:36.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:36.785+0000 7f7a5349e640 1 -- 172.21.15.77:0/1126009861 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "session_timeout", "val": "300"} v 0) -- 0x7f7a4c04f500 con 0x7f7a4c0c4280 2024-04-25T01:39:37.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.444+0000 7f7a41ffb640 1 -- 172.21.15.77:0/1126009861 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "session_timeout", "val": "300"}]=0 v12) ==== 110+0+0 (secure 0 0 0) 0x7f7a3c059cd0 con 0x7f7a4c0c4280 2024-04-25T01:39:37.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.446+0000 7f7a5349e640 1 -- 172.21.15.77:0/1126009861 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7a3006be30 msgr2=0x7f7a3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:37.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.446+0000 7f7a5349e640 1 --2- 172.21.15.77:0/1126009861 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7a3006be30 0x7f7a3006e2f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7a48000f60 tx=0x7f7a48009040 comp rx=0 tx=0).stop 2024-04-25T01:39:37.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.446+0000 7f7a5349e640 1 -- 172.21.15.77:0/1126009861 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a4c0c4280 msgr2=0x7f7a4c14a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:37.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.446+0000 7f7a5349e640 1 --2- 172.21.15.77:0/1126009861 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a4c0c4280 0x7f7a4c14a6f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c00d800 tx=0x7f7a3c00dcc0 comp rx=0 tx=0).stop 2024-04-25T01:39:37.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.446+0000 7f7a5349e640 1 -- 172.21.15.77:0/1126009861 shutdown_connections 2024-04-25T01:39:37.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.446+0000 7f7a5349e640 1 --2- 172.21.15.77:0/1126009861 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7a3006be30 0x7f7a3006e2f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:37.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.446+0000 7f7a5349e640 1 --2- 172.21.15.77:0/1126009861 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a4c0c4280 0x7f7a4c14a6f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:37.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.446+0000 7f7a5349e640 1 --2- 172.21.15.77:0/1126009861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a4c151730 0x7f7a4c14ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:37.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.446+0000 7f7a5349e640 1 --2- 172.21.15.77:0/1126009861 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7a4c0aca40 0x7f7a4c070a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:37.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.446+0000 7f7a5349e640 1 -- 172.21.15.77:0/1126009861 >> 172.21.15.77:0/1126009861 conn(0x7f7a4c0c7580 msgr2=0x7f7a4c1535c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:37.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.446+0000 7f7a5349e640 1 -- 172.21.15.77:0/1126009861 shutdown_connections 2024-04-25T01:39:37.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.446+0000 7f7a5349e640 1 -- 172.21.15.77:0/1126009861 wait complete. 2024-04-25T01:39:37.442 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'b' 2024-04-25T01:39:37.442 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:39:37.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.558+0000 7f1bec5ce640 1 Processor -- start 2024-04-25T01:39:37.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.558+0000 7f1bec5ce640 1 -- start start 2024-04-25T01:39:37.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.559+0000 7f1bec5ce640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1be4150320 0x7f1be4156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:37.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.559+0000 7f1bec5ce640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1be406d4e0 0x7f1be4154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:37.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.559+0000 7f1bec5ce640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1be4153be0 con 0x7f1be406d0a0 2024-04-25T01:39:37.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.559+0000 7f1bec5ce640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f1be4152fd0 con 0x7f1be406d4e0 2024-04-25T01:39:37.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.559+0000 7f1bec5ce640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f1be41532b0 con 0x7f1be4150320 2024-04-25T01:39:37.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.559+0000 7f1be9b69640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f1be406d0a0 0x7f1be4154380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41364/0 (socket says 172.21.15.77:41364) 2024-04-25T01:39:37.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.559+0000 7f1beab6b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1be406d4e0 0x7f1be4154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:37.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.559+0000 7f1be9b69640 1 -- 172.21.15.77:0/2307219416 learned_addr learned my addr 172.21.15.77:0/2307219416 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:37.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.559+0000 7f1beab6b640 1 -- 172.21.15.77:0/2307219416 >> v2:172.21.15.121:3300/0 conn(0x7f1be4150320 msgr2=0x7f1be4156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:37.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.559+0000 7f1beab6b640 1 --2- 172.21.15.77:0/2307219416 >> v2:172.21.15.121:3300/0 conn(0x7f1be4150320 0x7f1be4156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:37.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.559+0000 7f1beab6b640 1 -- 172.21.15.77:0/2307219416 >> v1:172.21.15.77:6789/0 conn(0x7f1be406d0a0 legacy=0x7f1be4154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:37.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.559+0000 7f1beab6b640 1 -- 172.21.15.77:0/2307219416 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be4157100 con 0x7f1be406d4e0 2024-04-25T01:39:37.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.560+0000 7f1beab6b640 1 --2- 172.21.15.77:0/2307219416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1be406d4e0 0x7f1be4154a90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1be406db60 tx=0x7f1bdc02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c6060fc85a59e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:37.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.560+0000 7f1be9368640 1 -- 172.21.15.77:0/2307219416 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc007740 con 0x7f1be406d4e0 2024-04-25T01:39:37.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.560+0000 7f1be9368640 1 -- 172.21.15.77:0/2307219416 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bdc0078e0 con 0x7f1be406d4e0 2024-04-25T01:39:37.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.560+0000 7f1be9368640 1 -- 172.21.15.77:0/2307219416 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc007cb0 con 0x7f1be406d4e0 2024-04-25T01:39:37.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.560+0000 7f1bec5ce640 1 -- 172.21.15.77:0/2307219416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1be406d4e0 msgr2=0x7f1be4154a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:37.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.560+0000 7f1bec5ce640 1 --2- 172.21.15.77:0/2307219416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1be406d4e0 0x7f1be4154a90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1be406db60 tx=0x7f1bdc02a680 comp rx=0 tx=0).stop 2024-04-25T01:39:37.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.560+0000 7f1bec5ce640 1 -- 172.21.15.77:0/2307219416 shutdown_connections 2024-04-25T01:39:37.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.560+0000 7f1bec5ce640 1 --2- 172.21.15.77:0/2307219416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1be406d4e0 0x7f1be4154a90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:37.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.560+0000 7f1bec5ce640 1 --2- 172.21.15.77:0/2307219416 >> v2:172.21.15.121:3300/0 conn(0x7f1be4150320 0x7f1be4156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:37.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.560+0000 7f1bec5ce640 1 -- 172.21.15.77:0/2307219416 >> 172.21.15.77:0/2307219416 conn(0x7f1be40c3f80 msgr2=0x7f1be40c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:37.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.560+0000 7f1bec5ce640 1 -- 172.21.15.77:0/2307219416 shutdown_connections 2024-04-25T01:39:37.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.560+0000 7f1bec5ce640 1 -- 172.21.15.77:0/2307219416 wait complete. 2024-04-25T01:39:37.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.561+0000 7f1bec5ce640 1 Processor -- start 2024-04-25T01:39:37.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.561+0000 7f1bec5ce640 1 -- start start 2024-04-25T01:39:37.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.562+0000 7f1bec5ce640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1be406d0a0 0x7f1be4070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:37.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.562+0000 7f1bec5ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1be406d4e0 0x7f1be4148e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:37.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.562+0000 7f1bec5ce640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1be4150320 0x7f1be41ed4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:37.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.562+0000 7f1bec5ce640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1be4154fd0 con 0x7f1be406d4e0 2024-04-25T01:39:37.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.562+0000 7f1bec5ce640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1be4153870 con 0x7f1be4150320 2024-04-25T01:39:37.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.562+0000 7f1bec5ce640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f1be4152bf0 con 0x7f1be406d0a0 2024-04-25T01:39:37.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.562+0000 7f1be9b69640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1be406d4e0 0x7f1be4148e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:37.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.562+0000 7f1be9b69640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1be406d4e0 0x7f1be4148e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46548/0 (socket says 172.21.15.77:46548) 2024-04-25T01:39:37.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.562+0000 7f1be9b69640 1 -- 172.21.15.77:0/1958675060 learned_addr learned my addr 172.21.15.77:0/1958675060 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:37.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.562+0000 7f1bea36a640 1 --2- 172.21.15.77:0/1958675060 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1be406d0a0 0x7f1be4070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:37.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.562+0000 7f1beab6b640 1 --2- 172.21.15.77:0/1958675060 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1be4150320 0x7f1be41ed4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:37.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.562+0000 7f1be9b69640 1 -- 172.21.15.77:0/1958675060 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1be406d0a0 msgr2=0x7f1be4070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:37.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.562+0000 7f1be9b69640 1 --2- 172.21.15.77:0/1958675060 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1be406d0a0 0x7f1be4070b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:37.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.562+0000 7f1be9b69640 1 -- 172.21.15.77:0/1958675060 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1be4150320 msgr2=0x7f1be41ed4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:37.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.562+0000 7f1be9b69640 1 --2- 172.21.15.77:0/1958675060 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1be4150320 0x7f1be41ed4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:37.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.562+0000 7f1be9b69640 1 -- 172.21.15.77:0/1958675060 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be414d7d0 con 0x7f1be406d4e0 2024-04-25T01:39:37.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.563+0000 7f1be9b69640 1 --2- 172.21.15.77:0/1958675060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1be406d4e0 0x7f1be4148e10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1bd400c440 tx=0x7f1bd400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:37.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.563+0000 7f1bdaffd640 1 -- 172.21.15.77:0/1958675060 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd4017070 con 0x7f1be406d4e0 2024-04-25T01:39:37.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.563+0000 7f1bdaffd640 1 -- 172.21.15.77:0/1958675060 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bd4005ce0 con 0x7f1be406d4e0 2024-04-25T01:39:37.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.563+0000 7f1bec5ce640 1 -- 172.21.15.77:0/1958675060 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1be4070490 con 0x7f1be406d4e0 2024-04-25T01:39:37.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.563+0000 7f1bdaffd640 1 -- 172.21.15.77:0/1958675060 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd40072f0 con 0x7f1be406d4e0 2024-04-25T01:39:37.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.563+0000 7f1bec5ce640 1 -- 172.21.15.77:0/1958675060 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1be4149350 con 0x7f1be406d4e0 2024-04-25T01:39:37.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.564+0000 7f1bec5ce640 1 -- 172.21.15.77:0/1958675060 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1be404f500 con 0x7f1be406d4e0 2024-04-25T01:39:37.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.564+0000 7f1bdaffd640 1 -- 172.21.15.77:0/1958675060 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1bd401a070 con 0x7f1be406d4e0 2024-04-25T01:39:37.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.564+0000 7f1bdaffd640 1 --2- 172.21.15.77:0/1958675060 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1bc806be30 0x7f1bc806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:37.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.565+0000 7f1bea36a640 1 --2- 172.21.15.77:0/1958675060 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1bc806be30 0x7f1bc806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:37.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.565+0000 7f1bdaffd640 1 -- 172.21.15.77:0/1958675060 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f1bd408a430 con 0x7f1be406d4e0 2024-04-25T01:39:37.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.565+0000 7f1bea36a640 1 --2- 172.21.15.77:0/1958675060 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1bc806be30 0x7f1bc806e2f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1be41dede0 tx=0x7f1be0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:37.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.569+0000 7f1bdaffd640 1 -- 172.21.15.77:0/1958675060 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1bd4058b40 con 0x7f1be406d4e0 2024-04-25T01:39:37.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.779+0000 7f1bec5ce640 1 -- 172.21.15.77:0/1958675060 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1be4156c20 con 0x7f1be406d4e0 2024-04-25T01:39:37.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.780+0000 7f1bdaffd640 1 -- 172.21.15.77:0/1958675060 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6488 (secure 0 0 0) 0x7f1bd4058440 con 0x7f1be406d4e0 2024-04-25T01:39:37.766 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:37.766 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:39:36.787357+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6837/3454203695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3454203695},{"type":"v1","addr":"172.21.15.77:6837","nonce":3454203695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-04-25T01:39:37.767 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 12 2024-04-25T01:39:37.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.782+0000 7f1bec5ce640 1 -- 172.21.15.77:0/1958675060 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1bc806be30 msgr2=0x7f1bc806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:37.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.782+0000 7f1bec5ce640 1 --2- 172.21.15.77:0/1958675060 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1bc806be30 0x7f1bc806e2f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1be41dede0 tx=0x7f1be0008040 comp rx=0 tx=0).stop 2024-04-25T01:39:37.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.782+0000 7f1bec5ce640 1 -- 172.21.15.77:0/1958675060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1be406d4e0 msgr2=0x7f1be4148e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:37.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.782+0000 7f1bec5ce640 1 --2- 172.21.15.77:0/1958675060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1be406d4e0 0x7f1be4148e10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1bd400c440 tx=0x7f1bd400c900 comp rx=0 tx=0).stop 2024-04-25T01:39:37.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.782+0000 7f1bec5ce640 1 -- 172.21.15.77:0/1958675060 shutdown_connections 2024-04-25T01:39:37.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.782+0000 7f1bec5ce640 1 --2- 172.21.15.77:0/1958675060 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1bc806be30 0x7f1bc806e2f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:37.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.782+0000 7f1bec5ce640 1 --2- 172.21.15.77:0/1958675060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1be406d4e0 0x7f1be4148e10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:37.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.782+0000 7f1bec5ce640 1 --2- 172.21.15.77:0/1958675060 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1be4150320 0x7f1be41ed4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:37.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.782+0000 7f1bec5ce640 1 --2- 172.21.15.77:0/1958675060 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1be406d0a0 0x7f1be4070b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:37.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.782+0000 7f1bec5ce640 1 -- 172.21.15.77:0/1958675060 >> 172.21.15.77:0/1958675060 conn(0x7f1be40c3f80 msgr2=0x7f1be4154380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:37.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.782+0000 7f1bec5ce640 1 -- 172.21.15.77:0/1958675060 shutdown_connections 2024-04-25T01:39:37.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.782+0000 7f1bec5ce640 1 -- 172.21.15.77:0/1958675060 wait complete. 2024-04-25T01:39:37.776 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T01:39:37.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.889+0000 7f831449e640 1 Processor -- start 2024-04-25T01:39:37.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.889+0000 7f831449e640 1 -- start start 2024-04-25T01:39:37.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.890+0000 7f831449e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f830c150090 0x7f830c156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:37.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.890+0000 7f831449e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f830c0c8200 0x7f830c0c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:37.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.890+0000 7f831449e640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f830c0c9de0 con 0x7f830c06c280 2024-04-25T01:39:37.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.890+0000 7f831449e640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f830c06b830 con 0x7f830c0c8200 2024-04-25T01:39:37.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.890+0000 7f831449e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f830c0c89c0 con 0x7f830c150090 2024-04-25T01:39:37.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.891+0000 7f831223a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f830c150090 0x7f830c156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:37.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.891+0000 7f8312a3b640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f830c06c280 0x7f830c0c6320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.77:44692/0 (socket says 172.21.15.77:44692) 2024-04-25T01:39:37.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.891+0000 7f8311a39640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f830c0c8200 0x7f830c0c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:37.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.891+0000 7f8312a3b640 1 -- 172.21.15.77:0/444778212 learned_addr learned my addr 172.21.15.77:0/444778212 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:37.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.891+0000 7f831223a640 1 -- 172.21.15.77:0/444778212 >> v2:172.21.15.121:3300/0 conn(0x7f830c0c8200 msgr2=0x7f830c0c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:37.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.891+0000 7f831223a640 1 --2- 172.21.15.77:0/444778212 >> v2:172.21.15.121:3300/0 conn(0x7f830c0c8200 0x7f830c0c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:37.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.891+0000 7f831223a640 1 -- 172.21.15.77:0/444778212 >> v1:172.21.15.121:6789/0 conn(0x7f830c06c280 legacy=0x7f830c0c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:37.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.891+0000 7f8311238640 1 -- 172.21.15.77:0/444778212 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2674972028 0 0) 0x7f830c0c9de0 con 0x7f830c06c280 2024-04-25T01:39:37.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.891+0000 7f831223a640 1 -- 172.21.15.77:0/444778212 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f830c0c8ca0 con 0x7f830c150090 2024-04-25T01:39:37.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.891+0000 7f8311a39640 1 --2- 172.21.15.77:0/444778212 >> v2:172.21.15.121:3300/0 conn(0x7f830c0c8200 0x7f830c0c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:37.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.892+0000 7f831223a640 1 --2- 172.21.15.77:0/444778212 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f830c150090 0x7f830c156c80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f82fc0097a0 tx=0x7f82fc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e593648f4913fbf5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:37.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.892+0000 7f8311238640 1 -- 172.21.15.77:0/444778212 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82fc037070 con 0x7f830c150090 2024-04-25T01:39:37.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.892+0000 7f8311238640 1 -- 172.21.15.77:0/444778212 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82fc032440 con 0x7f830c150090 2024-04-25T01:39:37.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.892+0000 7f8311238640 1 -- 172.21.15.77:0/444778212 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82fc032810 con 0x7f830c150090 2024-04-25T01:39:37.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.892+0000 7f831449e640 1 -- 172.21.15.77:0/444778212 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f830c150090 msgr2=0x7f830c156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:37.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.892+0000 7f831449e640 1 --2- 172.21.15.77:0/444778212 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f830c150090 0x7f830c156c80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f82fc0097a0 tx=0x7f82fc02a180 comp rx=0 tx=0).stop 2024-04-25T01:39:37.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.892+0000 7f831449e640 1 -- 172.21.15.77:0/444778212 shutdown_connections 2024-04-25T01:39:37.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.892+0000 7f831449e640 1 --2- 172.21.15.77:0/444778212 >> v2:172.21.15.121:3300/0 conn(0x7f830c0c8200 0x7f830c0c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:37.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.892+0000 7f831449e640 1 --2- 172.21.15.77:0/444778212 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f830c150090 0x7f830c156c80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:37.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.892+0000 7f831449e640 1 -- 172.21.15.77:0/444778212 >> 172.21.15.77:0/444778212 conn(0x7f830c0ad4d0 msgr2=0x7f830c0ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:37.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.893+0000 7f831449e640 1 -- 172.21.15.77:0/444778212 shutdown_connections 2024-04-25T01:39:37.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.893+0000 7f831449e640 1 -- 172.21.15.77:0/444778212 wait complete. 2024-04-25T01:39:37.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.894+0000 7f831449e640 1 Processor -- start 2024-04-25T01:39:37.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.894+0000 7f831449e640 1 -- start start 2024-04-25T01:39:37.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.894+0000 7f831449e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f830c06c280 0x7f830c1e8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:37.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.894+0000 7f831449e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f830c0c8200 0x7f830c159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:37.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.894+0000 7f831449e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f830c150090 0x7f830c146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:37.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.894+0000 7f831449e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f830c0c8680 con 0x7f830c150090 2024-04-25T01:39:37.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.894+0000 7f831449e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f830c06bd60 con 0x7f830c0c8200 2024-04-25T01:39:37.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.894+0000 7f831449e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f830c0c6a30 con 0x7f830c06c280 2024-04-25T01:39:37.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.894+0000 7f8312a3b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f830c150090 0x7f830c146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:37.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.894+0000 7f8312a3b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f830c150090 0x7f830c146560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46560/0 (socket says 172.21.15.77:46560) 2024-04-25T01:39:37.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.894+0000 7f8312a3b640 1 -- 172.21.15.77:0/774643762 learned_addr learned my addr 172.21.15.77:0/774643762 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:37.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.894+0000 7f8311a39640 1 --2- 172.21.15.77:0/774643762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f830c0c8200 0x7f830c159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:37.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.894+0000 7f831223a640 1 --2- 172.21.15.77:0/774643762 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f830c06c280 0x7f830c1e8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:37.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.895+0000 7f8312a3b640 1 -- 172.21.15.77:0/774643762 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f830c06c280 msgr2=0x7f830c1e8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:37.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.895+0000 7f8312a3b640 1 --2- 172.21.15.77:0/774643762 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f830c06c280 0x7f830c1e8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:37.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.895+0000 7f8312a3b640 1 -- 172.21.15.77:0/774643762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f830c0c8200 msgr2=0x7f830c159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:37.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.895+0000 7f8312a3b640 1 --2- 172.21.15.77:0/774643762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f830c0c8200 0x7f830c159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:37.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.895+0000 7f8312a3b640 1 -- 172.21.15.77:0/774643762 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f830c0c2860 con 0x7f830c150090 2024-04-25T01:39:37.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.895+0000 7f8312a3b640 1 --2- 172.21.15.77:0/774643762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f830c150090 0x7f830c146560 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f830400c7d0 tx=0x7f830400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:37.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.895+0000 7f8302ffd640 1 -- 172.21.15.77:0/774643762 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8304018070 con 0x7f830c150090 2024-04-25T01:39:37.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.895+0000 7f8302ffd640 1 -- 172.21.15.77:0/774643762 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f830400a640 con 0x7f830c150090 2024-04-25T01:39:37.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.895+0000 7f831449e640 1 -- 172.21.15.77:0/774643762 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f830c15a2e0 con 0x7f830c150090 2024-04-25T01:39:37.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.895+0000 7f8302ffd640 1 -- 172.21.15.77:0/774643762 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830400aa70 con 0x7f830c150090 2024-04-25T01:39:37.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.895+0000 7f831449e640 1 -- 172.21.15.77:0/774643762 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f830c144920 con 0x7f830c150090 2024-04-25T01:39:37.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.896+0000 7f831449e640 1 -- 172.21.15.77:0/774643762 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f830c04f500 con 0x7f830c150090 2024-04-25T01:39:37.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.896+0000 7f8302ffd640 1 -- 172.21.15.77:0/774643762 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f830401b070 con 0x7f830c150090 2024-04-25T01:39:37.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.897+0000 7f8302ffd640 1 --2- 172.21.15.77:0/774643762 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f82f006be60 0x7f82f006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:37.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.897+0000 7f831223a640 1 --2- 172.21.15.77:0/774643762 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f82f006be60 0x7f82f006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:37.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.897+0000 7f8302ffd640 1 -- 172.21.15.77:0/774643762 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f830408a650 con 0x7f830c150090 2024-04-25T01:39:37.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.897+0000 7f831223a640 1 --2- 172.21.15.77:0/774643762 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f82f006be60 0x7f82f006e320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f82fc034000 tx=0x7f82fc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:37.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:37.901+0000 7f8302ffd640 1 -- 172.21.15.77:0/774643762 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f830c15a2e0 con 0x7f830c150090 2024-04-25T01:39:38.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.078+0000 7f831449e640 1 -- 172.21.15.77:0/774643762 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f830c06cec0 con 0x7f830c150090 2024-04-25T01:39:38.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.080+0000 7f8302ffd640 1 -- 172.21.15.77:0/774643762 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20331 (secure 0 0 0) 0x7f8304058710 con 0x7f830c150090 2024-04-25T01:39:38.063 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:38.063 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:39:34.425701+0000","last_up_change":"2024-04-25T01:39:10.729600+0000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T01:39:11.681151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T01:39:21.606752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T01:39:22.677664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T01:39:30.501700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T01:39:31.740717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6811","nonce":3366980158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6817","nonce":3366980158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6828","nonce":3366980158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6825","nonce":3366980158}]},"public_addr":"172.21.15.77:6811/3366980158","cluster_addr":"172.21.15.77:6817/3366980158","heartbeat_back_addr":"172.21.15.77:6828/3366980158","heartbeat_front_addr":"172.21.15.77:6825/3366980158","state":["exists","up"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6801","nonce":3971619298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6803","nonce":3971619298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6807","nonce":3971619298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6805","nonce":3971619298}]},"public_addr":"172.21.15.77:6801/3971619298","cluster_addr":"172.21.15.77:6803/3971619298","heartbeat_back_addr":"172.21.15.77:6807/3971619298","heartbeat_front_addr":"172.21.15.77:6805/3971619298","state":["exists","up"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6810","nonce":4103452689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6813","nonce":4103452689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6823","nonce":4103452689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6818","nonce":4103452689}]},"public_addr":"172.21.15.77:6810/4103452689","cluster_addr":"172.21.15.77:6813/4103452689","heartbeat_back_addr":"172.21.15.77:6823/4103452689","heartbeat_front_addr":"172.21.15.77:6818/4103452689","state":["exists","up"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6819","nonce":217398906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6824","nonce":217398906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6831","nonce":217398906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6829","nonce":217398906}]},"public_addr":"172.21.15.77:6819/217398906","cluster_addr":"172.21.15.77:6824/217398906","heartbeat_back_addr":"172.21.15.77:6831/217398906","heartbeat_front_addr":"172.21.15.77:6829/217398906","state":["exists","up"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6801","nonce":2565483070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6803","nonce":2565483070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6810","nonce":2565483070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6806","nonce":2565483070}]},"public_addr":"172.21.15.121:6801/2565483070","cluster_addr":"172.21.15.121:6803/2565483070","heartbeat_back_addr":"172.21.15.121:6810/2565483070","heartbeat_front_addr":"172.21.15.121:6806/2565483070","state":["exists","up"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6807","nonce":2785294752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6809","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6811","nonce":2785294752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6815","nonce":2785294752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6813","nonce":2785294752}]},"public_addr":"172.21.15.121:6807/2785294752","cluster_addr":"172.21.15.121:6811/2785294752","heartbeat_back_addr":"172.21.15.121:6815/2785294752","heartbeat_front_addr":"172.21.15.121:6813/2785294752","state":["exists","up"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6820","nonce":523906818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6824","nonce":523906818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6831","nonce":523906818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6828","nonce":523906818}]},"public_addr":"172.21.15.121:6820/523906818","cluster_addr":"172.21.15.121:6824/523906818","heartbeat_back_addr":"172.21.15.121:6831/523906818","heartbeat_front_addr":"172.21.15.121:6828/523906818","state":["exists","up"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6817","nonce":1683602459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6819","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6821","nonce":1683602459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6829","nonce":1683602459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6823","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6825","nonce":1683602459}]},"public_addr":"172.21.15.121:6817/1683602459","cluster_addr":"172.21.15.121:6821/1683602459","heartbeat_back_addr":"172.21.15.121:6829/1683602459","heartbeat_front_addr":"172.21.15.121:6825/1683602459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.839443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.818842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.776243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.793085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.822396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.907311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.918374+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.848430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:39:38.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.082+0000 7f831449e640 1 -- 172.21.15.77:0/774643762 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f82f006be60 msgr2=0x7f82f006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:38.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.082+0000 7f831449e640 1 --2- 172.21.15.77:0/774643762 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f82f006be60 0x7f82f006e320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f82fc034000 tx=0x7f82fc02e000 comp rx=0 tx=0).stop 2024-04-25T01:39:38.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.082+0000 7f831449e640 1 -- 172.21.15.77:0/774643762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f830c150090 msgr2=0x7f830c146560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:38.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.082+0000 7f831449e640 1 --2- 172.21.15.77:0/774643762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f830c150090 0x7f830c146560 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f830400c7d0 tx=0x7f830400cc90 comp rx=0 tx=0).stop 2024-04-25T01:39:38.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.082+0000 7f831449e640 1 -- 172.21.15.77:0/774643762 shutdown_connections 2024-04-25T01:39:38.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.082+0000 7f831449e640 1 --2- 172.21.15.77:0/774643762 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f82f006be60 0x7f82f006e320 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.082+0000 7f831449e640 1 --2- 172.21.15.77:0/774643762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f830c150090 0x7f830c146560 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.082+0000 7f831449e640 1 --2- 172.21.15.77:0/774643762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f830c0c8200 0x7f830c159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.082+0000 7f831449e640 1 --2- 172.21.15.77:0/774643762 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f830c06c280 0x7f830c1e8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.082+0000 7f831449e640 1 -- 172.21.15.77:0/774643762 >> 172.21.15.77:0/774643762 conn(0x7f830c0ad4d0 msgr2=0x7f830c1544e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:38.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.082+0000 7f831449e640 1 -- 172.21.15.77:0/774643762 shutdown_connections 2024-04-25T01:39:38.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.082+0000 7f831449e640 1 -- 172.21.15.77:0/774643762 wait complete. 2024-04-25T01:39:38.076 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T01:39:38.076 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T01:39:38.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.190+0000 7fa6323ce640 1 Processor -- start 2024-04-25T01:39:38.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.190+0000 7fa6323ce640 1 -- start start 2024-04-25T01:39:38.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.190+0000 7fa6323ce640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa62c150090 0x7fa62c156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:38.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.190+0000 7fa6323ce640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa62c0c8200 0x7fa62c0c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:38.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.190+0000 7fa6323ce640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa62c0c9de0 con 0x7fa62c06c280 2024-04-25T01:39:38.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.190+0000 7fa6323ce640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa62c06b830 con 0x7fa62c150090 2024-04-25T01:39:38.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.190+0000 7fa6323ce640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fa62c0c89c0 con 0x7fa62c0c8200 2024-04-25T01:39:38.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.190+0000 7fa62bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa62c150090 0x7fa62c156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:38.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.190+0000 7fa63096b640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa62c06c280 0x7fa62c0c6320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41378/0 (socket says 172.21.15.77:41378) 2024-04-25T01:39:38.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.190+0000 7fa62bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa62c150090 0x7fa62c156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46566/0 (socket says 172.21.15.77:46566) 2024-04-25T01:39:38.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.190+0000 7fa63096b640 1 -- 172.21.15.77:0/3629347555 learned_addr learned my addr 172.21.15.77:0/3629347555 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:38.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.191+0000 7fa62b7fe640 1 --2- 172.21.15.77:0/3629347555 >> v2:172.21.15.121:3300/0 conn(0x7fa62c0c8200 0x7fa62c0c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:38.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.191+0000 7fa62bfff640 1 -- 172.21.15.77:0/3629347555 >> v2:172.21.15.121:3300/0 conn(0x7fa62c0c8200 msgr2=0x7fa62c0c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:38.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.191+0000 7fa62bfff640 1 --2- 172.21.15.77:0/3629347555 >> v2:172.21.15.121:3300/0 conn(0x7fa62c0c8200 0x7fa62c0c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.191+0000 7fa62bfff640 1 -- 172.21.15.77:0/3629347555 >> v1:172.21.15.77:6789/0 conn(0x7fa62c06c280 legacy=0x7fa62c0c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:38.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.191+0000 7fa62bfff640 1 -- 172.21.15.77:0/3629347555 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa62c0c8ca0 con 0x7fa62c150090 2024-04-25T01:39:38.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.191+0000 7fa62affd640 1 -- 172.21.15.77:0/3629347555 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 355438889 0 0) 0x7fa62c0c9de0 con 0x7fa62c06c280 2024-04-25T01:39:38.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.191+0000 7fa62bfff640 1 --2- 172.21.15.77:0/3629347555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa62c150090 0x7fa62c156c80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa62c06b9b0 tx=0x7fa62002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa4b4c76e1eba47 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:38.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.191+0000 7fa62affd640 1 -- 172.21.15.77:0/3629347555 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa620037070 con 0x7fa62c150090 2024-04-25T01:39:38.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.192+0000 7fa62affd640 1 -- 172.21.15.77:0/3629347555 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa620032440 con 0x7fa62c150090 2024-04-25T01:39:38.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.192+0000 7fa62affd640 1 -- 172.21.15.77:0/3629347555 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa620032810 con 0x7fa62c150090 2024-04-25T01:39:38.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.192+0000 7fa6323ce640 1 -- 172.21.15.77:0/3629347555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa62c150090 msgr2=0x7fa62c156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:38.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.192+0000 7fa6323ce640 1 --2- 172.21.15.77:0/3629347555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa62c150090 0x7fa62c156c80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa62c06b9b0 tx=0x7fa62002a1a0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.192+0000 7fa6323ce640 1 -- 172.21.15.77:0/3629347555 shutdown_connections 2024-04-25T01:39:38.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.192+0000 7fa6323ce640 1 --2- 172.21.15.77:0/3629347555 >> v2:172.21.15.121:3300/0 conn(0x7fa62c0c8200 0x7fa62c0c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.192+0000 7fa6323ce640 1 --2- 172.21.15.77:0/3629347555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa62c150090 0x7fa62c156c80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.192+0000 7fa6323ce640 1 -- 172.21.15.77:0/3629347555 >> 172.21.15.77:0/3629347555 conn(0x7fa62c0ad4d0 msgr2=0x7fa62c0ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:38.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.192+0000 7fa6323ce640 1 -- 172.21.15.77:0/3629347555 shutdown_connections 2024-04-25T01:39:38.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.192+0000 7fa6323ce640 1 -- 172.21.15.77:0/3629347555 wait complete. 2024-04-25T01:39:38.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.193+0000 7fa6323ce640 1 Processor -- start 2024-04-25T01:39:38.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.193+0000 7fa6323ce640 1 -- start start 2024-04-25T01:39:38.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.194+0000 7fa6323ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa62c06c280 0x7fa62c0c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:38.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.194+0000 7fa6323ce640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa62c0c8200 0x7fa62c159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:38.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.194+0000 7fa6323ce640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa62c150090 0x7fa62c1eb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:38.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.194+0000 7fa6323ce640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa62c0c86b0 con 0x7fa62c06c280 2024-04-25T01:39:38.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.194+0000 7fa6323ce640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa62c06bd60 con 0x7fa62c150090 2024-04-25T01:39:38.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.194+0000 7fa6323ce640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fa62c0c6a30 con 0x7fa62c0c8200 2024-04-25T01:39:38.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.194+0000 7fa62bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa62c06c280 0x7fa62c0c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:38.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.194+0000 7fa62bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa62c06c280 0x7fa62c0c58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46576/0 (socket says 172.21.15.77:46576) 2024-04-25T01:39:38.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.194+0000 7fa62bfff640 1 -- 172.21.15.77:0/734165681 learned_addr learned my addr 172.21.15.77:0/734165681 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:38.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.194+0000 7fa62b7fe640 1 --2- 172.21.15.77:0/734165681 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa62c0c8200 0x7fa62c159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:38.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.194+0000 7fa63096b640 1 --2- 172.21.15.77:0/734165681 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa62c150090 0x7fa62c1eb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:38.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.194+0000 7fa62bfff640 1 -- 172.21.15.77:0/734165681 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa62c0c8200 msgr2=0x7fa62c159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:38.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.194+0000 7fa62bfff640 1 --2- 172.21.15.77:0/734165681 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa62c0c8200 0x7fa62c159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.194+0000 7fa62bfff640 1 -- 172.21.15.77:0/734165681 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa62c150090 msgr2=0x7fa62c1eb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:38.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.194+0000 7fa62bfff640 1 --2- 172.21.15.77:0/734165681 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa62c150090 0x7fa62c1eb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.194+0000 7fa62bfff640 1 -- 172.21.15.77:0/734165681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa62c1ef4f0 con 0x7fa62c06c280 2024-04-25T01:39:38.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.194+0000 7fa62bfff640 1 --2- 172.21.15.77:0/734165681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa62c06c280 0x7fa62c0c58b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa620000c00 tx=0x7fa6200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:38.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.195+0000 7fa628ff9640 1 -- 172.21.15.77:0/734165681 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa620037040 con 0x7fa62c06c280 2024-04-25T01:39:38.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.195+0000 7fa628ff9640 1 -- 172.21.15.77:0/734165681 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa620042070 con 0x7fa62c06c280 2024-04-25T01:39:38.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.195+0000 7fa6323ce640 1 -- 172.21.15.77:0/734165681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa62c1ef790 con 0x7fa62c06c280 2024-04-25T01:39:38.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.195+0000 7fa628ff9640 1 -- 172.21.15.77:0/734165681 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa620030bd0 con 0x7fa62c06c280 2024-04-25T01:39:38.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.195+0000 7fa6323ce640 1 -- 172.21.15.77:0/734165681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa62c15a3b0 con 0x7fa62c06c280 2024-04-25T01:39:38.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.195+0000 7fa6323ce640 1 -- 172.21.15.77:0/734165681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa62c04f500 con 0x7fa62c06c280 2024-04-25T01:39:38.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.196+0000 7fa628ff9640 1 -- 172.21.15.77:0/734165681 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa620047460 con 0x7fa62c06c280 2024-04-25T01:39:38.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.196+0000 7fa628ff9640 1 --2- 172.21.15.77:0/734165681 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa61806be30 0x7fa61806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:38.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.197+0000 7fa62b7fe640 1 --2- 172.21.15.77:0/734165681 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa61806be30 0x7fa61806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:38.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.197+0000 7fa628ff9640 1 -- 172.21.15.77:0/734165681 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fa6200abcf0 con 0x7fa62c06c280 2024-04-25T01:39:38.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.197+0000 7fa62b7fe640 1 --2- 172.21.15.77:0/734165681 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa61806be30 0x7fa61806e2f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa62c1565f0 tx=0x7fa61c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:38.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.201+0000 7fa628ff9640 1 -- 172.21.15.77:0/734165681 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa6200b0070 con 0x7fa62c06c280 2024-04-25T01:39:38.199 INFO:tasks.ceph.mds.c.smithi077.stderr:2024-04-25T01:39:38.216+0000 7f87cd9ed640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T01:39:38.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.372+0000 7fa6323ce640 1 -- 172.21.15.77:0/734165681 --> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa62c1efa70 con 0x7fa61806be30 2024-04-25T01:39:38.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.383+0000 7fa628ff9640 1 -- 172.21.15.77:0/734165681 <== mgr.4098 v2:172.21.15.77:6832/4208232183 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490417 (secure 0 0 0) 0x7fa62c1efa70 con 0x7fa61806be30 2024-04-25T01:39:38.371 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:38.374 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-25T01:39:38.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.386+0000 7fa6323ce640 1 -- 172.21.15.77:0/734165681 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa61806be30 msgr2=0x7fa61806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:38.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.386+0000 7fa6323ce640 1 --2- 172.21.15.77:0/734165681 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa61806be30 0x7fa61806e2f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa62c1565f0 tx=0x7fa61c008040 comp rx=0 tx=0).stop 2024-04-25T01:39:38.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.386+0000 7fa6323ce640 1 -- 172.21.15.77:0/734165681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa62c06c280 msgr2=0x7fa62c0c58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:38.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.386+0000 7fa6323ce640 1 --2- 172.21.15.77:0/734165681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa62c06c280 0x7fa62c0c58b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa620000c00 tx=0x7fa6200046c0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.386+0000 7fa6323ce640 1 -- 172.21.15.77:0/734165681 shutdown_connections 2024-04-25T01:39:38.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.386+0000 7fa6323ce640 1 --2- 172.21.15.77:0/734165681 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa61806be30 0x7fa61806e2f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.386+0000 7fa6323ce640 1 --2- 172.21.15.77:0/734165681 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa62c150090 0x7fa62c1eb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.386+0000 7fa6323ce640 1 --2- 172.21.15.77:0/734165681 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa62c0c8200 0x7fa62c159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.386+0000 7fa6323ce640 1 --2- 172.21.15.77:0/734165681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa62c06c280 0x7fa62c0c58b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.386+0000 7fa6323ce640 1 -- 172.21.15.77:0/734165681 >> 172.21.15.77:0/734165681 conn(0x7fa62c0ad4d0 msgr2=0x7fa62c14d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:38.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.387+0000 7fa6323ce640 1 -- 172.21.15.77:0/734165681 shutdown_connections 2024-04-25T01:39:38.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.387+0000 7fa6323ce640 1 -- 172.21.15.77:0/734165681 wait complete. 2024-04-25T01:39:38.380 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-04-25T01:39:37.653338+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":249,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":341,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219460,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755260,"statfs":{"total":773094113280,"available":772869386240,"internally_reserved":0,"allocated":3350528,"data_stored":1984464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000986"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197412+0000","last_change":"2024-04-25T01:39:33.445614+0000","last_active":"2024-04-25T01:39:35.197412+0000","last_peered":"2024-04-25T01:39:35.197412+0000","last_clean":"2024-04-25T01:39:35.197412+0000","last_became_active":"2024-04-25T01:39:33.445090+0000","last_became_peered":"2024-04-25T01:39:33.445090+0000","last_unstale":"2024-04-25T01:39:35.197412+0000","last_undegraded":"2024-04-25T01:39:35.197412+0000","last_fullsized":"2024-04-25T01:39:35.197412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:50.951488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559582+0000","last_change":"2024-04-25T01:39:23.377096+0000","last_active":"2024-04-25T01:39:34.559582+0000","last_peered":"2024-04-25T01:39:34.559582+0000","last_clean":"2024-04-25T01:39:34.559582+0000","last_became_active":"2024-04-25T01:39:23.376811+0000","last_became_peered":"2024-04-25T01:39:23.376811+0000","last_unstale":"2024-04-25T01:39:34.559582+0000","last_undegraded":"2024-04-25T01:39:34.559582+0000","last_fullsized":"2024-04-25T01:39:34.559582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:26.888605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430280+0000","last_change":"2024-04-25T01:39:24.394317+0000","last_active":"2024-04-25T01:39:34.430280+0000","last_peered":"2024-04-25T01:39:34.430280+0000","last_clean":"2024-04-25T01:39:34.430280+0000","last_became_active":"2024-04-25T01:39:24.394032+0000","last_became_peered":"2024-04-25T01:39:24.394032+0000","last_unstale":"2024-04-25T01:39:34.430280+0000","last_undegraded":"2024-04-25T01:39:34.430280+0000","last_fullsized":"2024-04-25T01:39:34.430280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:11.795443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429310+0000","last_change":"2024-04-25T01:39:32.421607+0000","last_active":"2024-04-25T01:39:34.429310+0000","last_peered":"2024-04-25T01:39:34.429310+0000","last_clean":"2024-04-25T01:39:34.429310+0000","last_became_active":"2024-04-25T01:39:32.421355+0000","last_became_peered":"2024-04-25T01:39:32.421355+0000","last_unstale":"2024-04-25T01:39:34.429310+0000","last_undegraded":"2024-04-25T01:39:34.429310+0000","last_fullsized":"2024-04-25T01:39:34.429310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:12:14.019262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198433+0000","last_change":"2024-04-25T01:39:33.436651+0000","last_active":"2024-04-25T01:39:35.198433+0000","last_peered":"2024-04-25T01:39:35.198433+0000","last_clean":"2024-04-25T01:39:35.198433+0000","last_became_active":"2024-04-25T01:39:33.436370+0000","last_became_peered":"2024-04-25T01:39:33.436370+0000","last_unstale":"2024-04-25T01:39:35.198433+0000","last_undegraded":"2024-04-25T01:39:35.198433+0000","last_fullsized":"2024-04-25T01:39:35.198433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:57:10.341738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430287+0000","last_change":"2024-04-25T01:39:23.369400+0000","last_active":"2024-04-25T01:39:34.430287+0000","last_peered":"2024-04-25T01:39:34.430287+0000","last_clean":"2024-04-25T01:39:34.430287+0000","last_became_active":"2024-04-25T01:39:23.368726+0000","last_became_peered":"2024-04-25T01:39:23.368726+0000","last_unstale":"2024-04-25T01:39:34.430287+0000","last_undegraded":"2024-04-25T01:39:34.430287+0000","last_fullsized":"2024-04-25T01:39:34.430287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:35:42.971179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559440+0000","last_change":"2024-04-25T01:39:24.403873+0000","last_active":"2024-04-25T01:39:34.559440+0000","last_peered":"2024-04-25T01:39:34.559440+0000","last_clean":"2024-04-25T01:39:34.559440+0000","last_became_active":"2024-04-25T01:39:24.403623+0000","last_became_peered":"2024-04-25T01:39:24.403623+0000","last_unstale":"2024-04-25T01:39:34.559440+0000","last_undegraded":"2024-04-25T01:39:34.559440+0000","last_fullsized":"2024-04-25T01:39:34.559440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:49.360933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197343+0000","last_change":"2024-04-25T01:39:32.430985+0000","last_active":"2024-04-25T01:39:35.197343+0000","last_peered":"2024-04-25T01:39:35.197343+0000","last_clean":"2024-04-25T01:39:35.197343+0000","last_became_active":"2024-04-25T01:39:32.430617+0000","last_became_peered":"2024-04-25T01:39:32.430617+0000","last_unstale":"2024-04-25T01:39:35.197343+0000","last_undegraded":"2024-04-25T01:39:35.197343+0000","last_fullsized":"2024-04-25T01:39:35.197343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:13.938619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199408+0000","last_change":"2024-04-25T01:39:33.444043+0000","last_active":"2024-04-25T01:39:35.199408+0000","last_peered":"2024-04-25T01:39:35.199408+0000","last_clean":"2024-04-25T01:39:35.199408+0000","last_became_active":"2024-04-25T01:39:33.443737+0000","last_became_peered":"2024-04-25T01:39:33.443737+0000","last_unstale":"2024-04-25T01:39:35.199408+0000","last_undegraded":"2024-04-25T01:39:35.199408+0000","last_fullsized":"2024-04-25T01:39:35.199408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:02:50.401910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199857+0000","last_change":"2024-04-25T01:39:23.377963+0000","last_active":"2024-04-25T01:39:35.199857+0000","last_peered":"2024-04-25T01:39:35.199857+0000","last_clean":"2024-04-25T01:39:35.199857+0000","last_became_active":"2024-04-25T01:39:23.377402+0000","last_became_peered":"2024-04-25T01:39:23.377402+0000","last_unstale":"2024-04-25T01:39:35.199857+0000","last_undegraded":"2024-04-25T01:39:35.199857+0000","last_fullsized":"2024-04-25T01:39:35.199857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:15.873450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199352+0000","last_change":"2024-04-25T01:39:24.394512+0000","last_active":"2024-04-25T01:39:35.199352+0000","last_peered":"2024-04-25T01:39:35.199352+0000","last_clean":"2024-04-25T01:39:35.199352+0000","last_became_active":"2024-04-25T01:39:24.393954+0000","last_became_peered":"2024-04-25T01:39:24.393954+0000","last_unstale":"2024-04-25T01:39:35.199352+0000","last_undegraded":"2024-04-25T01:39:35.199352+0000","last_fullsized":"2024-04-25T01:39:35.199352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:30.534400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197850+0000","last_change":"2024-04-25T01:39:32.428198+0000","last_active":"2024-04-25T01:39:35.197850+0000","last_peered":"2024-04-25T01:39:35.197850+0000","last_clean":"2024-04-25T01:39:35.197850+0000","last_became_active":"2024-04-25T01:39:32.427955+0000","last_became_peered":"2024-04-25T01:39:32.427955+0000","last_unstale":"2024-04-25T01:39:35.197850+0000","last_undegraded":"2024-04-25T01:39:35.197850+0000","last_fullsized":"2024-04-25T01:39:35.197850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:07.684150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198064+0000","last_change":"2024-04-25T01:39:33.439854+0000","last_active":"2024-04-25T01:39:35.198064+0000","last_peered":"2024-04-25T01:39:35.198064+0000","last_clean":"2024-04-25T01:39:35.198064+0000","last_became_active":"2024-04-25T01:39:33.439555+0000","last_became_peered":"2024-04-25T01:39:33.439555+0000","last_unstale":"2024-04-25T01:39:35.198064+0000","last_undegraded":"2024-04-25T01:39:35.198064+0000","last_fullsized":"2024-04-25T01:39:35.198064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:50.250748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198904+0000","last_change":"2024-04-25T01:39:23.377093+0000","last_active":"2024-04-25T01:39:35.198904+0000","last_peered":"2024-04-25T01:39:35.198904+0000","last_clean":"2024-04-25T01:39:35.198904+0000","last_became_active":"2024-04-25T01:39:23.376744+0000","last_became_peered":"2024-04-25T01:39:23.376744+0000","last_unstale":"2024-04-25T01:39:35.198904+0000","last_undegraded":"2024-04-25T01:39:35.198904+0000","last_fullsized":"2024-04-25T01:39:35.198904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:43.529618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200129+0000","last_change":"2024-04-25T01:39:24.393293+0000","last_active":"2024-04-25T01:39:35.200129+0000","last_peered":"2024-04-25T01:39:35.200129+0000","last_clean":"2024-04-25T01:39:35.200129+0000","last_became_active":"2024-04-25T01:39:24.393005+0000","last_became_peered":"2024-04-25T01:39:24.393005+0000","last_unstale":"2024-04-25T01:39:35.200129+0000","last_undegraded":"2024-04-25T01:39:35.200129+0000","last_fullsized":"2024-04-25T01:39:35.200129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:32.070747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197654+0000","last_change":"2024-04-25T01:39:32.428956+0000","last_active":"2024-04-25T01:39:35.197654+0000","last_peered":"2024-04-25T01:39:35.197654+0000","last_clean":"2024-04-25T01:39:35.197654+0000","last_became_active":"2024-04-25T01:39:32.428705+0000","last_became_peered":"2024-04-25T01:39:32.428705+0000","last_unstale":"2024-04-25T01:39:35.197654+0000","last_undegraded":"2024-04-25T01:39:35.197654+0000","last_fullsized":"2024-04-25T01:39:35.197654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:06:22.998986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198197+0000","last_change":"2024-04-25T01:39:33.446571+0000","last_active":"2024-04-25T01:39:35.198197+0000","last_peered":"2024-04-25T01:39:35.198197+0000","last_clean":"2024-04-25T01:39:35.198197+0000","last_became_active":"2024-04-25T01:39:33.446234+0000","last_became_peered":"2024-04-25T01:39:33.446234+0000","last_unstale":"2024-04-25T01:39:35.198197+0000","last_undegraded":"2024-04-25T01:39:35.198197+0000","last_fullsized":"2024-04-25T01:39:35.198197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:12.742092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434733+0000","last_change":"2024-04-25T01:39:24.398859+0000","last_active":"2024-04-25T01:39:34.434733+0000","last_peered":"2024-04-25T01:39:34.434733+0000","last_clean":"2024-04-25T01:39:34.434733+0000","last_became_active":"2024-04-25T01:39:24.398618+0000","last_became_peered":"2024-04-25T01:39:24.398618+0000","last_unstale":"2024-04-25T01:39:34.434733+0000","last_undegraded":"2024-04-25T01:39:34.434733+0000","last_fullsized":"2024-04-25T01:39:34.434733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:15.278376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199208+0000","last_change":"2024-04-25T01:39:23.377717+0000","last_active":"2024-04-25T01:39:35.199208+0000","last_peered":"2024-04-25T01:39:35.199208+0000","last_clean":"2024-04-25T01:39:35.199208+0000","last_became_active":"2024-04-25T01:39:23.377291+0000","last_became_peered":"2024-04-25T01:39:23.377291+0000","last_unstale":"2024-04-25T01:39:35.199208+0000","last_undegraded":"2024-04-25T01:39:35.199208+0000","last_fullsized":"2024-04-25T01:39:35.199208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:06.402745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197947+0000","last_change":"2024-04-25T01:39:32.426840+0000","last_active":"2024-04-25T01:39:35.197947+0000","last_peered":"2024-04-25T01:39:35.197947+0000","last_clean":"2024-04-25T01:39:35.197947+0000","last_became_active":"2024-04-25T01:39:32.426529+0000","last_became_peered":"2024-04-25T01:39:32.426529+0000","last_unstale":"2024-04-25T01:39:35.197947+0000","last_undegraded":"2024-04-25T01:39:35.197947+0000","last_fullsized":"2024-04-25T01:39:35.197947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:57.097685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198092+0000","last_change":"2024-04-25T01:39:33.437767+0000","last_active":"2024-04-25T01:39:35.198092+0000","last_peered":"2024-04-25T01:39:35.198092+0000","last_clean":"2024-04-25T01:39:35.198092+0000","last_became_active":"2024-04-25T01:39:33.437483+0000","last_became_peered":"2024-04-25T01:39:33.437483+0000","last_unstale":"2024-04-25T01:39:35.198092+0000","last_undegraded":"2024-04-25T01:39:35.198092+0000","last_fullsized":"2024-04-25T01:39:35.198092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:44.321779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429750+0000","last_change":"2024-04-25T01:39:24.387100+0000","last_active":"2024-04-25T01:39:34.429750+0000","last_peered":"2024-04-25T01:39:34.429750+0000","last_clean":"2024-04-25T01:39:34.429750+0000","last_became_active":"2024-04-25T01:39:24.386782+0000","last_became_peered":"2024-04-25T01:39:24.386782+0000","last_unstale":"2024-04-25T01:39:34.429750+0000","last_undegraded":"2024-04-25T01:39:34.429750+0000","last_fullsized":"2024-04-25T01:39:34.429750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:48.789139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198800+0000","last_change":"2024-04-25T01:39:23.368446+0000","last_active":"2024-04-25T01:39:35.198800+0000","last_peered":"2024-04-25T01:39:35.198800+0000","last_clean":"2024-04-25T01:39:35.198800+0000","last_became_active":"2024-04-25T01:39:23.368183+0000","last_became_peered":"2024-04-25T01:39:23.368183+0000","last_unstale":"2024-04-25T01:39:35.198800+0000","last_undegraded":"2024-04-25T01:39:35.198800+0000","last_fullsized":"2024-04-25T01:39:35.198800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:13.738756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198383+0000","last_change":"2024-04-25T01:39:32.427589+0000","last_active":"2024-04-25T01:39:35.198383+0000","last_peered":"2024-04-25T01:39:35.198383+0000","last_clean":"2024-04-25T01:39:35.198383+0000","last_became_active":"2024-04-25T01:39:32.427328+0000","last_became_peered":"2024-04-25T01:39:32.427328+0000","last_unstale":"2024-04-25T01:39:35.198383+0000","last_undegraded":"2024-04-25T01:39:35.198383+0000","last_fullsized":"2024-04-25T01:39:35.198383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:12.328303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199145+0000","last_change":"2024-04-25T01:39:33.447634+0000","last_active":"2024-04-25T01:39:35.199145+0000","last_peered":"2024-04-25T01:39:35.199145+0000","last_clean":"2024-04-25T01:39:35.199145+0000","last_became_active":"2024-04-25T01:39:33.445908+0000","last_became_peered":"2024-04-25T01:39:33.445908+0000","last_unstale":"2024-04-25T01:39:35.199145+0000","last_undegraded":"2024-04-25T01:39:35.199145+0000","last_fullsized":"2024-04-25T01:39:35.199145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:13.586396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429559+0000","last_change":"2024-04-25T01:39:24.373600+0000","last_active":"2024-04-25T01:39:34.429559+0000","last_peered":"2024-04-25T01:39:34.429559+0000","last_clean":"2024-04-25T01:39:34.429559+0000","last_became_active":"2024-04-25T01:39:24.373311+0000","last_became_peered":"2024-04-25T01:39:24.373311+0000","last_unstale":"2024-04-25T01:39:34.429559+0000","last_undegraded":"2024-04-25T01:39:34.429559+0000","last_fullsized":"2024-04-25T01:39:34.429559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:46.338959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197953+0000","last_change":"2024-04-25T01:39:23.377103+0000","last_active":"2024-04-25T01:39:35.197953+0000","last_peered":"2024-04-25T01:39:35.197953+0000","last_clean":"2024-04-25T01:39:35.197953+0000","last_became_active":"2024-04-25T01:39:23.376826+0000","last_became_peered":"2024-04-25T01:39:23.376826+0000","last_unstale":"2024-04-25T01:39:35.197953+0000","last_undegraded":"2024-04-25T01:39:35.197953+0000","last_fullsized":"2024-04-25T01:39:35.197953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:46.663754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198643+0000","last_change":"2024-04-25T01:39:32.426839+0000","last_active":"2024-04-25T01:39:35.198643+0000","last_peered":"2024-04-25T01:39:35.198643+0000","last_clean":"2024-04-25T01:39:35.198643+0000","last_became_active":"2024-04-25T01:39:32.426545+0000","last_became_peered":"2024-04-25T01:39:32.426545+0000","last_unstale":"2024-04-25T01:39:35.198643+0000","last_undegraded":"2024-04-25T01:39:35.198643+0000","last_fullsized":"2024-04-25T01:39:35.198643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:22.161839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199023+0000","last_change":"2024-04-25T01:39:33.444616+0000","last_active":"2024-04-25T01:39:35.199023+0000","last_peered":"2024-04-25T01:39:35.199023+0000","last_clean":"2024-04-25T01:39:35.199023+0000","last_became_active":"2024-04-25T01:39:33.444350+0000","last_became_peered":"2024-04-25T01:39:33.444350+0000","last_unstale":"2024-04-25T01:39:35.199023+0000","last_undegraded":"2024-04-25T01:39:35.199023+0000","last_fullsized":"2024-04-25T01:39:35.199023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:47:15.686320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198460+0000","last_change":"2024-04-25T01:39:24.386969+0000","last_active":"2024-04-25T01:39:35.198460+0000","last_peered":"2024-04-25T01:39:35.198460+0000","last_clean":"2024-04-25T01:39:35.198460+0000","last_became_active":"2024-04-25T01:39:24.386376+0000","last_became_peered":"2024-04-25T01:39:24.386376+0000","last_unstale":"2024-04-25T01:39:35.198460+0000","last_undegraded":"2024-04-25T01:39:35.198460+0000","last_fullsized":"2024-04-25T01:39:35.198460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:13:31.585462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198150+0000","last_change":"2024-04-25T01:39:23.378993+0000","last_active":"2024-04-25T01:39:35.198150+0000","last_peered":"2024-04-25T01:39:35.198150+0000","last_clean":"2024-04-25T01:39:35.198150+0000","last_became_active":"2024-04-25T01:39:23.376908+0000","last_became_peered":"2024-04-25T01:39:23.376908+0000","last_unstale":"2024-04-25T01:39:35.198150+0000","last_undegraded":"2024-04-25T01:39:35.198150+0000","last_fullsized":"2024-04-25T01:39:35.198150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:13:18.370559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199153+0000","last_change":"2024-04-25T01:39:32.433597+0000","last_active":"2024-04-25T01:39:35.199153+0000","last_peered":"2024-04-25T01:39:35.199153+0000","last_clean":"2024-04-25T01:39:35.199153+0000","last_became_active":"2024-04-25T01:39:32.433307+0000","last_became_peered":"2024-04-25T01:39:32.433307+0000","last_unstale":"2024-04-25T01:39:35.199153+0000","last_undegraded":"2024-04-25T01:39:35.199153+0000","last_fullsized":"2024-04-25T01:39:35.199153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:20.784385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429204+0000","last_change":"2024-04-25T01:39:33.427297+0000","last_active":"2024-04-25T01:39:34.429204+0000","last_peered":"2024-04-25T01:39:34.429204+0000","last_clean":"2024-04-25T01:39:34.429204+0000","last_became_active":"2024-04-25T01:39:33.426132+0000","last_became_peered":"2024-04-25T01:39:33.426132+0000","last_unstale":"2024-04-25T01:39:34.429204+0000","last_undegraded":"2024-04-25T01:39:34.429204+0000","last_fullsized":"2024-04-25T01:39:34.429204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:04.147341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559652+0000","last_change":"2024-04-25T01:39:24.393003+0000","last_active":"2024-04-25T01:39:34.559652+0000","last_peered":"2024-04-25T01:39:34.559652+0000","last_clean":"2024-04-25T01:39:34.559652+0000","last_became_active":"2024-04-25T01:39:24.392209+0000","last_became_peered":"2024-04-25T01:39:24.392209+0000","last_unstale":"2024-04-25T01:39:34.559652+0000","last_undegraded":"2024-04-25T01:39:34.559652+0000","last_fullsized":"2024-04-25T01:39:34.559652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:44:58.432859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434880+0000","last_change":"2024-04-25T01:39:23.379804+0000","last_active":"2024-04-25T01:39:34.434880+0000","last_peered":"2024-04-25T01:39:34.434880+0000","last_clean":"2024-04-25T01:39:34.434880+0000","last_became_active":"2024-04-25T01:39:23.379430+0000","last_became_peered":"2024-04-25T01:39:23.379430+0000","last_unstale":"2024-04-25T01:39:34.434880+0000","last_undegraded":"2024-04-25T01:39:34.434880+0000","last_fullsized":"2024-04-25T01:39:34.434880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:42:23.254767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198196+0000","last_change":"2024-04-25T01:39:32.432763+0000","last_active":"2024-04-25T01:39:35.198196+0000","last_peered":"2024-04-25T01:39:35.198196+0000","last_clean":"2024-04-25T01:39:35.198196+0000","last_became_active":"2024-04-25T01:39:32.432482+0000","last_became_peered":"2024-04-25T01:39:32.432482+0000","last_unstale":"2024-04-25T01:39:35.198196+0000","last_undegraded":"2024-04-25T01:39:35.198196+0000","last_fullsized":"2024-04-25T01:39:35.198196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:04.848726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197990+0000","last_change":"2024-04-25T01:39:33.445800+0000","last_active":"2024-04-25T01:39:35.197990+0000","last_peered":"2024-04-25T01:39:35.197990+0000","last_clean":"2024-04-25T01:39:35.197990+0000","last_became_active":"2024-04-25T01:39:33.445500+0000","last_became_peered":"2024-04-25T01:39:33.445500+0000","last_unstale":"2024-04-25T01:39:35.197990+0000","last_undegraded":"2024-04-25T01:39:35.197990+0000","last_fullsized":"2024-04-25T01:39:35.197990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:06:36.800043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430196+0000","last_change":"2024-04-25T01:39:24.375811+0000","last_active":"2024-04-25T01:39:34.430196+0000","last_peered":"2024-04-25T01:39:34.430196+0000","last_clean":"2024-04-25T01:39:34.430196+0000","last_became_active":"2024-04-25T01:39:24.375603+0000","last_became_peered":"2024-04-25T01:39:24.375603+0000","last_unstale":"2024-04-25T01:39:34.430196+0000","last_undegraded":"2024-04-25T01:39:34.430196+0000","last_fullsized":"2024-04-25T01:39:34.430196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:10:26.247501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198161+0000","last_change":"2024-04-25T01:39:23.377687+0000","last_active":"2024-04-25T01:39:35.198161+0000","last_peered":"2024-04-25T01:39:35.198161+0000","last_clean":"2024-04-25T01:39:35.198161+0000","last_became_active":"2024-04-25T01:39:23.377372+0000","last_became_peered":"2024-04-25T01:39:23.377372+0000","last_unstale":"2024-04-25T01:39:35.198161+0000","last_undegraded":"2024-04-25T01:39:35.198161+0000","last_fullsized":"2024-04-25T01:39:35.198161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:51.983659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429145+0000","last_change":"2024-04-25T01:39:32.430816+0000","last_active":"2024-04-25T01:39:34.429145+0000","last_peered":"2024-04-25T01:39:34.429145+0000","last_clean":"2024-04-25T01:39:34.429145+0000","last_became_active":"2024-04-25T01:39:32.430537+0000","last_became_peered":"2024-04-25T01:39:32.430537+0000","last_unstale":"2024-04-25T01:39:34.429145+0000","last_undegraded":"2024-04-25T01:39:34.429145+0000","last_fullsized":"2024-04-25T01:39:34.429145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:58.939453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434436+0000","last_change":"2024-04-25T01:39:33.440287+0000","last_active":"2024-04-25T01:39:34.434436+0000","last_peered":"2024-04-25T01:39:34.434436+0000","last_clean":"2024-04-25T01:39:34.434436+0000","last_became_active":"2024-04-25T01:39:33.439796+0000","last_became_peered":"2024-04-25T01:39:33.439796+0000","last_unstale":"2024-04-25T01:39:34.434436+0000","last_undegraded":"2024-04-25T01:39:34.434436+0000","last_fullsized":"2024-04-25T01:39:34.434436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:08.515401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198342+0000","last_change":"2024-04-25T01:39:24.376933+0000","last_active":"2024-04-25T01:39:35.198342+0000","last_peered":"2024-04-25T01:39:35.198342+0000","last_clean":"2024-04-25T01:39:35.198342+0000","last_became_active":"2024-04-25T01:39:24.376612+0000","last_became_peered":"2024-04-25T01:39:24.376612+0000","last_unstale":"2024-04-25T01:39:35.198342+0000","last_undegraded":"2024-04-25T01:39:35.198342+0000","last_fullsized":"2024-04-25T01:39:35.198342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:56:55.534200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199969+0000","last_change":"2024-04-25T01:39:23.378190+0000","last_active":"2024-04-25T01:39:35.199969+0000","last_peered":"2024-04-25T01:39:35.199969+0000","last_clean":"2024-04-25T01:39:35.199969+0000","last_became_active":"2024-04-25T01:39:23.377677+0000","last_became_peered":"2024-04-25T01:39:23.377677+0000","last_unstale":"2024-04-25T01:39:35.199969+0000","last_undegraded":"2024-04-25T01:39:35.199969+0000","last_fullsized":"2024-04-25T01:39:35.199969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:09.516058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559452+0000","last_change":"2024-04-25T01:39:32.431542+0000","last_active":"2024-04-25T01:39:34.559452+0000","last_peered":"2024-04-25T01:39:34.559452+0000","last_clean":"2024-04-25T01:39:34.559452+0000","last_became_active":"2024-04-25T01:39:32.431253+0000","last_became_peered":"2024-04-25T01:39:32.431253+0000","last_unstale":"2024-04-25T01:39:34.559452+0000","last_undegraded":"2024-04-25T01:39:34.559452+0000","last_fullsized":"2024-04-25T01:39:34.559452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:36.723239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559765+0000","last_change":"2024-04-25T01:39:33.448529+0000","last_active":"2024-04-25T01:39:34.559765+0000","last_peered":"2024-04-25T01:39:34.559765+0000","last_clean":"2024-04-25T01:39:34.559765+0000","last_became_active":"2024-04-25T01:39:33.448266+0000","last_became_peered":"2024-04-25T01:39:33.448266+0000","last_unstale":"2024-04-25T01:39:34.559765+0000","last_undegraded":"2024-04-25T01:39:34.559765+0000","last_fullsized":"2024-04-25T01:39:34.559765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:18.788470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200112+0000","last_change":"2024-04-25T01:39:24.390844+0000","last_active":"2024-04-25T01:39:35.200112+0000","last_peered":"2024-04-25T01:39:35.200112+0000","last_clean":"2024-04-25T01:39:35.200112+0000","last_became_active":"2024-04-25T01:39:24.390543+0000","last_became_peered":"2024-04-25T01:39:24.390543+0000","last_unstale":"2024-04-25T01:39:35.200112+0000","last_undegraded":"2024-04-25T01:39:35.200112+0000","last_fullsized":"2024-04-25T01:39:35.200112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:01:03.804058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198467+0000","last_change":"2024-04-25T01:39:23.368562+0000","last_active":"2024-04-25T01:39:35.198467+0000","last_peered":"2024-04-25T01:39:35.198467+0000","last_clean":"2024-04-25T01:39:35.198467+0000","last_became_active":"2024-04-25T01:39:23.368272+0000","last_became_peered":"2024-04-25T01:39:23.368272+0000","last_unstale":"2024-04-25T01:39:35.198467+0000","last_undegraded":"2024-04-25T01:39:35.198467+0000","last_fullsized":"2024-04-25T01:39:35.198467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:15.464993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198483+0000","last_change":"2024-04-25T01:39:32.430196+0000","last_active":"2024-04-25T01:39:35.198483+0000","last_peered":"2024-04-25T01:39:35.198483+0000","last_clean":"2024-04-25T01:39:35.198483+0000","last_became_active":"2024-04-25T01:39:32.429759+0000","last_became_peered":"2024-04-25T01:39:32.429759+0000","last_unstale":"2024-04-25T01:39:35.198483+0000","last_undegraded":"2024-04-25T01:39:35.198483+0000","last_fullsized":"2024-04-25T01:39:35.198483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:58:09.299194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559415+0000","last_change":"2024-04-25T01:39:33.440935+0000","last_active":"2024-04-25T01:39:34.559415+0000","last_peered":"2024-04-25T01:39:34.559415+0000","last_clean":"2024-04-25T01:39:34.559415+0000","last_became_active":"2024-04-25T01:39:33.439344+0000","last_became_peered":"2024-04-25T01:39:33.439344+0000","last_unstale":"2024-04-25T01:39:34.559415+0000","last_undegraded":"2024-04-25T01:39:34.559415+0000","last_fullsized":"2024-04-25T01:39:34.559415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:23.928991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199059+0000","last_change":"2024-04-25T01:39:24.389203+0000","last_active":"2024-04-25T01:39:35.199059+0000","last_peered":"2024-04-25T01:39:35.199059+0000","last_clean":"2024-04-25T01:39:35.199059+0000","last_became_active":"2024-04-25T01:39:24.388306+0000","last_became_peered":"2024-04-25T01:39:24.388306+0000","last_unstale":"2024-04-25T01:39:35.199059+0000","last_undegraded":"2024-04-25T01:39:35.199059+0000","last_fullsized":"2024-04-25T01:39:35.199059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:59:33.951161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198256+0000","last_change":"2024-04-25T01:39:23.375729+0000","last_active":"2024-04-25T01:39:35.198256+0000","last_peered":"2024-04-25T01:39:35.198256+0000","last_clean":"2024-04-25T01:39:35.198256+0000","last_became_active":"2024-04-25T01:39:23.375488+0000","last_became_peered":"2024-04-25T01:39:23.375488+0000","last_unstale":"2024-04-25T01:39:35.198256+0000","last_undegraded":"2024-04-25T01:39:35.198256+0000","last_fullsized":"2024-04-25T01:39:35.198256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:00.039083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198302+0000","last_change":"2024-04-25T01:39:32.427586+0000","last_active":"2024-04-25T01:39:35.198302+0000","last_peered":"2024-04-25T01:39:35.198302+0000","last_clean":"2024-04-25T01:39:35.198302+0000","last_became_active":"2024-04-25T01:39:32.427282+0000","last_became_peered":"2024-04-25T01:39:32.427282+0000","last_unstale":"2024-04-25T01:39:35.198302+0000","last_undegraded":"2024-04-25T01:39:35.198302+0000","last_fullsized":"2024-04-25T01:39:35.198302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:35.956279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197828+0000","last_change":"2024-04-25T01:39:33.438949+0000","last_active":"2024-04-25T01:39:35.197828+0000","last_peered":"2024-04-25T01:39:35.197828+0000","last_clean":"2024-04-25T01:39:35.197828+0000","last_became_active":"2024-04-25T01:39:33.438669+0000","last_became_peered":"2024-04-25T01:39:33.438669+0000","last_unstale":"2024-04-25T01:39:35.197828+0000","last_undegraded":"2024-04-25T01:39:35.197828+0000","last_fullsized":"2024-04-25T01:39:35.197828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:07.849060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197529+0000","last_change":"2024-04-25T01:39:24.377438+0000","last_active":"2024-04-25T01:39:35.197529+0000","last_peered":"2024-04-25T01:39:35.197529+0000","last_clean":"2024-04-25T01:39:35.197529+0000","last_became_active":"2024-04-25T01:39:24.377146+0000","last_became_peered":"2024-04-25T01:39:24.377146+0000","last_unstale":"2024-04-25T01:39:35.197529+0000","last_undegraded":"2024-04-25T01:39:35.197529+0000","last_fullsized":"2024-04-25T01:39:35.197529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:54:17.698561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198084+0000","last_change":"2024-04-25T01:39:23.371019+0000","last_active":"2024-04-25T01:39:35.198084+0000","last_peered":"2024-04-25T01:39:35.198084+0000","last_clean":"2024-04-25T01:39:35.198084+0000","last_became_active":"2024-04-25T01:39:23.370727+0000","last_became_peered":"2024-04-25T01:39:23.370727+0000","last_unstale":"2024-04-25T01:39:35.198084+0000","last_undegraded":"2024-04-25T01:39:35.198084+0000","last_fullsized":"2024-04-25T01:39:35.198084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:10.714475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198753+0000","last_change":"2024-04-25T01:39:32.431610+0000","last_active":"2024-04-25T01:39:35.198753+0000","last_peered":"2024-04-25T01:39:35.198753+0000","last_clean":"2024-04-25T01:39:35.198753+0000","last_became_active":"2024-04-25T01:39:32.431335+0000","last_became_peered":"2024-04-25T01:39:32.431335+0000","last_unstale":"2024-04-25T01:39:35.198753+0000","last_undegraded":"2024-04-25T01:39:35.198753+0000","last_fullsized":"2024-04-25T01:39:35.198753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:54.882078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199183+0000","last_change":"2024-04-25T01:39:33.438896+0000","last_active":"2024-04-25T01:39:35.199183+0000","last_peered":"2024-04-25T01:39:35.199183+0000","last_clean":"2024-04-25T01:39:35.199183+0000","last_became_active":"2024-04-25T01:39:33.438622+0000","last_became_peered":"2024-04-25T01:39:33.438622+0000","last_unstale":"2024-04-25T01:39:35.199183+0000","last_undegraded":"2024-04-25T01:39:35.199183+0000","last_fullsized":"2024-04-25T01:39:35.199183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:40:47.408809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559149+0000","last_change":"2024-04-25T01:39:24.391366+0000","last_active":"2024-04-25T01:39:34.559149+0000","last_peered":"2024-04-25T01:39:34.559149+0000","last_clean":"2024-04-25T01:39:34.559149+0000","last_became_active":"2024-04-25T01:39:24.391093+0000","last_became_peered":"2024-04-25T01:39:24.391093+0000","last_unstale":"2024-04-25T01:39:34.559149+0000","last_undegraded":"2024-04-25T01:39:34.559149+0000","last_fullsized":"2024-04-25T01:39:34.559149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:10.906935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198243+0000","last_change":"2024-04-25T01:39:23.379767+0000","last_active":"2024-04-25T01:39:35.198243+0000","last_peered":"2024-04-25T01:39:35.198243+0000","last_clean":"2024-04-25T01:39:35.198243+0000","last_became_active":"2024-04-25T01:39:23.379294+0000","last_became_peered":"2024-04-25T01:39:23.379294+0000","last_unstale":"2024-04-25T01:39:35.198243+0000","last_undegraded":"2024-04-25T01:39:35.198243+0000","last_fullsized":"2024-04-25T01:39:35.198243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:36:37.823796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559671+0000","last_change":"2024-04-25T01:39:32.429452+0000","last_active":"2024-04-25T01:39:34.559671+0000","last_peered":"2024-04-25T01:39:34.559671+0000","last_clean":"2024-04-25T01:39:34.559671+0000","last_became_active":"2024-04-25T01:39:32.429189+0000","last_became_peered":"2024-04-25T01:39:32.429189+0000","last_unstale":"2024-04-25T01:39:34.559671+0000","last_undegraded":"2024-04-25T01:39:34.559671+0000","last_fullsized":"2024-04-25T01:39:34.559671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:58:02.723851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198704+0000","last_change":"2024-04-25T01:39:33.438945+0000","last_active":"2024-04-25T01:39:35.198704+0000","last_peered":"2024-04-25T01:39:35.198704+0000","last_clean":"2024-04-25T01:39:35.198704+0000","last_became_active":"2024-04-25T01:39:33.438233+0000","last_became_peered":"2024-04-25T01:39:33.438233+0000","last_unstale":"2024-04-25T01:39:35.198704+0000","last_undegraded":"2024-04-25T01:39:35.198704+0000","last_fullsized":"2024-04-25T01:39:35.198704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:50.545311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429728+0000","last_change":"2024-04-25T01:39:24.401208+0000","last_active":"2024-04-25T01:39:34.429728+0000","last_peered":"2024-04-25T01:39:34.429728+0000","last_clean":"2024-04-25T01:39:34.429728+0000","last_became_active":"2024-04-25T01:39:24.400502+0000","last_became_peered":"2024-04-25T01:39:24.400502+0000","last_unstale":"2024-04-25T01:39:34.429728+0000","last_undegraded":"2024-04-25T01:39:34.429728+0000","last_fullsized":"2024-04-25T01:39:34.429728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:55:09.076617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198391+0000","last_change":"2024-04-25T01:39:23.367826+0000","last_active":"2024-04-25T01:39:35.198391+0000","last_peered":"2024-04-25T01:39:35.198391+0000","last_clean":"2024-04-25T01:39:35.198391+0000","last_became_active":"2024-04-25T01:39:23.367520+0000","last_became_peered":"2024-04-25T01:39:23.367520+0000","last_unstale":"2024-04-25T01:39:35.198391+0000","last_undegraded":"2024-04-25T01:39:35.198391+0000","last_fullsized":"2024-04-25T01:39:35.198391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:05.997166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199929+0000","last_change":"2024-04-25T01:39:12.918495+0000","last_active":"2024-04-25T01:39:35.199929+0000","last_peered":"2024-04-25T01:39:35.199929+0000","last_clean":"2024-04-25T01:39:35.199929+0000","last_became_active":"2024-04-25T01:39:12.917330+0000","last_became_peered":"2024-04-25T01:39:12.917330+0000","last_unstale":"2024-04-25T01:39:35.199929+0000","last_undegraded":"2024-04-25T01:39:35.199929+0000","last_fullsized":"2024-04-25T01:39:35.199929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:11.731178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:11.731178+0000","last_clean_scrub_stamp":"2024-04-25T01:39:11.731178+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:26:14.153244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434088+0000","last_change":"2024-04-25T01:39:32.431797+0000","last_active":"2024-04-25T01:39:34.434088+0000","last_peered":"2024-04-25T01:39:34.434088+0000","last_clean":"2024-04-25T01:39:34.434088+0000","last_became_active":"2024-04-25T01:39:32.431523+0000","last_became_peered":"2024-04-25T01:39:32.431523+0000","last_unstale":"2024-04-25T01:39:34.434088+0000","last_undegraded":"2024-04-25T01:39:34.434088+0000","last_fullsized":"2024-04-25T01:39:34.434088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:45.752128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198056+0000","last_change":"2024-04-25T01:39:33.440488+0000","last_active":"2024-04-25T01:39:35.198056+0000","last_peered":"2024-04-25T01:39:35.198056+0000","last_clean":"2024-04-25T01:39:35.198056+0000","last_became_active":"2024-04-25T01:39:33.440161+0000","last_became_peered":"2024-04-25T01:39:33.440161+0000","last_unstale":"2024-04-25T01:39:35.198056+0000","last_undegraded":"2024-04-25T01:39:35.198056+0000","last_fullsized":"2024-04-25T01:39:35.198056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:45.542876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199802+0000","last_change":"2024-04-25T01:39:24.394350+0000","last_active":"2024-04-25T01:39:35.199802+0000","last_peered":"2024-04-25T01:39:35.199802+0000","last_clean":"2024-04-25T01:39:35.199802+0000","last_became_active":"2024-04-25T01:39:24.393235+0000","last_became_peered":"2024-04-25T01:39:24.393235+0000","last_unstale":"2024-04-25T01:39:35.199802+0000","last_undegraded":"2024-04-25T01:39:35.199802+0000","last_fullsized":"2024-04-25T01:39:35.199802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:00:48.588700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198113+0000","last_change":"2024-04-25T01:39:23.368352+0000","last_active":"2024-04-25T01:39:35.198113+0000","last_peered":"2024-04-25T01:39:35.198113+0000","last_clean":"2024-04-25T01:39:35.198113+0000","last_became_active":"2024-04-25T01:39:23.368075+0000","last_became_peered":"2024-04-25T01:39:23.368075+0000","last_unstale":"2024-04-25T01:39:35.198113+0000","last_undegraded":"2024-04-25T01:39:35.198113+0000","last_fullsized":"2024-04-25T01:39:35.198113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:11.300091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434486+0000","last_change":"2024-04-25T01:39:32.430007+0000","last_active":"2024-04-25T01:39:34.434486+0000","last_peered":"2024-04-25T01:39:34.434486+0000","last_clean":"2024-04-25T01:39:34.434486+0000","last_became_active":"2024-04-25T01:39:32.429721+0000","last_became_peered":"2024-04-25T01:39:32.429721+0000","last_unstale":"2024-04-25T01:39:34.434486+0000","last_undegraded":"2024-04-25T01:39:34.434486+0000","last_fullsized":"2024-04-25T01:39:34.434486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:47.409375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197603+0000","last_change":"2024-04-25T01:39:33.447230+0000","last_active":"2024-04-25T01:39:35.197603+0000","last_peered":"2024-04-25T01:39:35.197603+0000","last_clean":"2024-04-25T01:39:35.197603+0000","last_became_active":"2024-04-25T01:39:33.446930+0000","last_became_peered":"2024-04-25T01:39:33.446930+0000","last_unstale":"2024-04-25T01:39:35.197603+0000","last_undegraded":"2024-04-25T01:39:35.197603+0000","last_fullsized":"2024-04-25T01:39:35.197603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:51:40.920560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199534+0000","last_change":"2024-04-25T01:39:24.394286+0000","last_active":"2024-04-25T01:39:35.199534+0000","last_peered":"2024-04-25T01:39:35.199534+0000","last_clean":"2024-04-25T01:39:35.199534+0000","last_became_active":"2024-04-25T01:39:24.393558+0000","last_became_peered":"2024-04-25T01:39:24.393558+0000","last_unstale":"2024-04-25T01:39:35.199534+0000","last_undegraded":"2024-04-25T01:39:35.199534+0000","last_fullsized":"2024-04-25T01:39:35.199534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:59.100947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198699+0000","last_change":"2024-04-25T01:39:23.370690+0000","last_active":"2024-04-25T01:39:35.198699+0000","last_peered":"2024-04-25T01:39:35.198699+0000","last_clean":"2024-04-25T01:39:35.198699+0000","last_became_active":"2024-04-25T01:39:23.370391+0000","last_became_peered":"2024-04-25T01:39:23.370391+0000","last_unstale":"2024-04-25T01:39:35.198699+0000","last_undegraded":"2024-04-25T01:39:35.198699+0000","last_fullsized":"2024-04-25T01:39:35.198699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:29.647636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559440+0000","last_change":"2024-04-25T01:39:32.429412+0000","last_active":"2024-04-25T01:39:34.559440+0000","last_peered":"2024-04-25T01:39:34.559440+0000","last_clean":"2024-04-25T01:39:34.559440+0000","last_became_active":"2024-04-25T01:39:32.429143+0000","last_became_peered":"2024-04-25T01:39:32.429143+0000","last_unstale":"2024-04-25T01:39:34.559440+0000","last_undegraded":"2024-04-25T01:39:34.559440+0000","last_fullsized":"2024-04-25T01:39:34.559440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:53.637245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198532+0000","last_change":"2024-04-25T01:39:33.437128+0000","last_active":"2024-04-25T01:39:35.198532+0000","last_peered":"2024-04-25T01:39:35.198532+0000","last_clean":"2024-04-25T01:39:35.198532+0000","last_became_active":"2024-04-25T01:39:33.436861+0000","last_became_peered":"2024-04-25T01:39:33.436861+0000","last_unstale":"2024-04-25T01:39:35.198532+0000","last_undegraded":"2024-04-25T01:39:35.198532+0000","last_fullsized":"2024-04-25T01:39:35.198532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:41.746373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200378+0000","last_change":"2024-04-25T01:39:24.392170+0000","last_active":"2024-04-25T01:39:35.200378+0000","last_peered":"2024-04-25T01:39:35.200378+0000","last_clean":"2024-04-25T01:39:35.200378+0000","last_became_active":"2024-04-25T01:39:24.391811+0000","last_became_peered":"2024-04-25T01:39:24.391811+0000","last_unstale":"2024-04-25T01:39:35.200378+0000","last_undegraded":"2024-04-25T01:39:35.200378+0000","last_fullsized":"2024-04-25T01:39:35.200378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:32.859676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197996+0000","last_change":"2024-04-25T01:39:23.369872+0000","last_active":"2024-04-25T01:39:35.197996+0000","last_peered":"2024-04-25T01:39:35.197996+0000","last_clean":"2024-04-25T01:39:35.197996+0000","last_became_active":"2024-04-25T01:39:23.369314+0000","last_became_peered":"2024-04-25T01:39:23.369314+0000","last_unstale":"2024-04-25T01:39:35.197996+0000","last_undegraded":"2024-04-25T01:39:35.197996+0000","last_fullsized":"2024-04-25T01:39:35.197996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:14.571148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197245+0000","last_change":"2024-04-25T01:39:32.429664+0000","last_active":"2024-04-25T01:39:35.197245+0000","last_peered":"2024-04-25T01:39:35.197245+0000","last_clean":"2024-04-25T01:39:35.197245+0000","last_became_active":"2024-04-25T01:39:32.429358+0000","last_became_peered":"2024-04-25T01:39:32.429358+0000","last_unstale":"2024-04-25T01:39:35.197245+0000","last_undegraded":"2024-04-25T01:39:35.197245+0000","last_fullsized":"2024-04-25T01:39:35.197245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:57:10.913056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197472+0000","last_change":"2024-04-25T01:39:33.440419+0000","last_active":"2024-04-25T01:39:35.197472+0000","last_peered":"2024-04-25T01:39:35.197472+0000","last_clean":"2024-04-25T01:39:35.197472+0000","last_became_active":"2024-04-25T01:39:33.440054+0000","last_became_peered":"2024-04-25T01:39:33.440054+0000","last_unstale":"2024-04-25T01:39:35.197472+0000","last_undegraded":"2024-04-25T01:39:35.197472+0000","last_fullsized":"2024-04-25T01:39:35.197472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:42.321235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199726+0000","last_change":"2024-04-25T01:39:24.391240+0000","last_active":"2024-04-25T01:39:35.199726+0000","last_peered":"2024-04-25T01:39:35.199726+0000","last_clean":"2024-04-25T01:39:35.199726+0000","last_became_active":"2024-04-25T01:39:24.390948+0000","last_became_peered":"2024-04-25T01:39:24.390948+0000","last_unstale":"2024-04-25T01:39:35.199726+0000","last_undegraded":"2024-04-25T01:39:35.199726+0000","last_fullsized":"2024-04-25T01:39:35.199726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:41:30.579190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198161+0000","last_change":"2024-04-25T01:39:23.367322+0000","last_active":"2024-04-25T01:39:35.198161+0000","last_peered":"2024-04-25T01:39:35.198161+0000","last_clean":"2024-04-25T01:39:35.198161+0000","last_became_active":"2024-04-25T01:39:23.367054+0000","last_became_peered":"2024-04-25T01:39:23.367054+0000","last_unstale":"2024-04-25T01:39:35.198161+0000","last_undegraded":"2024-04-25T01:39:35.198161+0000","last_fullsized":"2024-04-25T01:39:35.198161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:10.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197919+0000","last_change":"2024-04-25T01:39:32.426874+0000","last_active":"2024-04-25T01:39:35.197919+0000","last_peered":"2024-04-25T01:39:35.197919+0000","last_clean":"2024-04-25T01:39:35.197919+0000","last_became_active":"2024-04-25T01:39:32.426599+0000","last_became_peered":"2024-04-25T01:39:32.426599+0000","last_unstale":"2024-04-25T01:39:35.197919+0000","last_undegraded":"2024-04-25T01:39:35.197919+0000","last_fullsized":"2024-04-25T01:39:35.197919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:27.672277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430134+0000","last_change":"2024-04-25T01:39:33.428909+0000","last_active":"2024-04-25T01:39:34.430134+0000","last_peered":"2024-04-25T01:39:34.430134+0000","last_clean":"2024-04-25T01:39:34.430134+0000","last_became_active":"2024-04-25T01:39:33.428626+0000","last_became_peered":"2024-04-25T01:39:33.428626+0000","last_unstale":"2024-04-25T01:39:34.430134+0000","last_undegraded":"2024-04-25T01:39:34.430134+0000","last_fullsized":"2024-04-25T01:39:34.430134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:21.188264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199068+0000","last_change":"2024-04-25T01:39:24.389946+0000","last_active":"2024-04-25T01:39:35.199068+0000","last_peered":"2024-04-25T01:39:35.199068+0000","last_clean":"2024-04-25T01:39:35.199068+0000","last_became_active":"2024-04-25T01:39:24.389656+0000","last_became_peered":"2024-04-25T01:39:24.389656+0000","last_unstale":"2024-04-25T01:39:35.199068+0000","last_undegraded":"2024-04-25T01:39:35.199068+0000","last_fullsized":"2024-04-25T01:39:35.199068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:55.943639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197475+0000","last_change":"2024-04-25T01:39:23.373599+0000","last_active":"2024-04-25T01:39:35.197475+0000","last_peered":"2024-04-25T01:39:35.197475+0000","last_clean":"2024-04-25T01:39:35.197475+0000","last_became_active":"2024-04-25T01:39:23.373281+0000","last_became_peered":"2024-04-25T01:39:23.373281+0000","last_unstale":"2024-04-25T01:39:35.197475+0000","last_undegraded":"2024-04-25T01:39:35.197475+0000","last_fullsized":"2024-04-25T01:39:35.197475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:40.850925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559604+0000","last_change":"2024-04-25T01:39:32.427502+0000","last_active":"2024-04-25T01:39:34.559604+0000","last_peered":"2024-04-25T01:39:34.559604+0000","last_clean":"2024-04-25T01:39:34.559604+0000","last_became_active":"2024-04-25T01:39:32.426499+0000","last_became_peered":"2024-04-25T01:39:32.426499+0000","last_unstale":"2024-04-25T01:39:34.559604+0000","last_undegraded":"2024-04-25T01:39:34.559604+0000","last_fullsized":"2024-04-25T01:39:34.559604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:26.977416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198695+0000","last_change":"2024-04-25T01:39:33.436901+0000","last_active":"2024-04-25T01:39:35.198695+0000","last_peered":"2024-04-25T01:39:35.198695+0000","last_clean":"2024-04-25T01:39:35.198695+0000","last_became_active":"2024-04-25T01:39:33.436001+0000","last_became_peered":"2024-04-25T01:39:33.436001+0000","last_unstale":"2024-04-25T01:39:35.198695+0000","last_undegraded":"2024-04-25T01:39:35.198695+0000","last_fullsized":"2024-04-25T01:39:35.198695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:34:41.678663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.433897+0000","last_change":"2024-04-25T01:39:24.394248+0000","last_active":"2024-04-25T01:39:34.433897+0000","last_peered":"2024-04-25T01:39:34.433897+0000","last_clean":"2024-04-25T01:39:34.433897+0000","last_became_active":"2024-04-25T01:39:24.393958+0000","last_became_peered":"2024-04-25T01:39:24.393958+0000","last_unstale":"2024-04-25T01:39:34.433897+0000","last_undegraded":"2024-04-25T01:39:34.433897+0000","last_fullsized":"2024-04-25T01:39:34.433897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:35.087577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434426+0000","last_change":"2024-04-25T01:39:23.372939+0000","last_active":"2024-04-25T01:39:34.434426+0000","last_peered":"2024-04-25T01:39:34.434426+0000","last_clean":"2024-04-25T01:39:34.434426+0000","last_became_active":"2024-04-25T01:39:23.372648+0000","last_became_peered":"2024-04-25T01:39:23.372648+0000","last_unstale":"2024-04-25T01:39:34.434426+0000","last_undegraded":"2024-04-25T01:39:34.434426+0000","last_fullsized":"2024-04-25T01:39:34.434426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:02:13.283096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430096+0000","last_change":"2024-04-25T01:39:32.432218+0000","last_active":"2024-04-25T01:39:34.430096+0000","last_peered":"2024-04-25T01:39:34.430096+0000","last_clean":"2024-04-25T01:39:34.430096+0000","last_became_active":"2024-04-25T01:39:32.431938+0000","last_became_peered":"2024-04-25T01:39:32.431938+0000","last_unstale":"2024-04-25T01:39:34.430096+0000","last_undegraded":"2024-04-25T01:39:34.430096+0000","last_fullsized":"2024-04-25T01:39:34.430096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:56:15.053817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199747+0000","last_change":"2024-04-25T01:39:33.441342+0000","last_active":"2024-04-25T01:39:35.199747+0000","last_peered":"2024-04-25T01:39:35.199747+0000","last_clean":"2024-04-25T01:39:35.199747+0000","last_became_active":"2024-04-25T01:39:33.441074+0000","last_became_peered":"2024-04-25T01:39:33.441074+0000","last_unstale":"2024-04-25T01:39:35.199747+0000","last_undegraded":"2024-04-25T01:39:35.199747+0000","last_fullsized":"2024-04-25T01:39:35.199747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:22:43.000112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199029+0000","last_change":"2024-04-25T01:39:24.390114+0000","last_active":"2024-04-25T01:39:35.199029+0000","last_peered":"2024-04-25T01:39:35.199029+0000","last_clean":"2024-04-25T01:39:35.199029+0000","last_became_active":"2024-04-25T01:39:24.389841+0000","last_became_peered":"2024-04-25T01:39:24.389841+0000","last_unstale":"2024-04-25T01:39:35.199029+0000","last_undegraded":"2024-04-25T01:39:35.199029+0000","last_fullsized":"2024-04-25T01:39:35.199029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:34.950624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198167+0000","last_change":"2024-04-25T01:39:23.369440+0000","last_active":"2024-04-25T01:39:35.198167+0000","last_peered":"2024-04-25T01:39:35.198167+0000","last_clean":"2024-04-25T01:39:35.198167+0000","last_became_active":"2024-04-25T01:39:23.369151+0000","last_became_peered":"2024-04-25T01:39:23.369151+0000","last_unstale":"2024-04-25T01:39:35.198167+0000","last_undegraded":"2024-04-25T01:39:35.198167+0000","last_fullsized":"2024-04-25T01:39:35.198167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:31:46.921287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"23'6","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429666+0000","last_change":"2024-04-25T01:39:32.430701+0000","last_active":"2024-04-25T01:39:34.429666+0000","last_peered":"2024-04-25T01:39:34.429666+0000","last_clean":"2024-04-25T01:39:34.429666+0000","last_became_active":"2024-04-25T01:39:32.430187+0000","last_became_peered":"2024-04-25T01:39:32.430187+0000","last_unstale":"2024-04-25T01:39:34.429666+0000","last_undegraded":"2024-04-25T01:39:34.429666+0000","last_fullsized":"2024-04-25T01:39:34.429666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:57.148375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429767+0000","last_change":"2024-04-25T01:39:33.427429+0000","last_active":"2024-04-25T01:39:34.429767+0000","last_peered":"2024-04-25T01:39:34.429767+0000","last_clean":"2024-04-25T01:39:34.429767+0000","last_became_active":"2024-04-25T01:39:33.427164+0000","last_became_peered":"2024-04-25T01:39:33.427164+0000","last_unstale":"2024-04-25T01:39:34.429767+0000","last_undegraded":"2024-04-25T01:39:34.429767+0000","last_fullsized":"2024-04-25T01:39:34.429767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:33:59.664252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559246+0000","last_change":"2024-04-25T01:39:24.388852+0000","last_active":"2024-04-25T01:39:34.559246+0000","last_peered":"2024-04-25T01:39:34.559246+0000","last_clean":"2024-04-25T01:39:34.559246+0000","last_became_active":"2024-04-25T01:39:24.388594+0000","last_became_peered":"2024-04-25T01:39:24.388594+0000","last_unstale":"2024-04-25T01:39:34.559246+0000","last_undegraded":"2024-04-25T01:39:34.559246+0000","last_fullsized":"2024-04-25T01:39:34.559246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:46:49.718182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559847+0000","last_change":"2024-04-25T01:39:23.372903+0000","last_active":"2024-04-25T01:39:34.559847+0000","last_peered":"2024-04-25T01:39:34.559847+0000","last_clean":"2024-04-25T01:39:34.559847+0000","last_became_active":"2024-04-25T01:39:23.372617+0000","last_became_peered":"2024-04-25T01:39:23.372617+0000","last_unstale":"2024-04-25T01:39:34.559847+0000","last_undegraded":"2024-04-25T01:39:34.559847+0000","last_fullsized":"2024-04-25T01:39:34.559847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:54:58.506432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199994+0000","last_change":"2024-04-25T01:39:32.430218+0000","last_active":"2024-04-25T01:39:35.199994+0000","last_peered":"2024-04-25T01:39:35.199994+0000","last_clean":"2024-04-25T01:39:35.199994+0000","last_became_active":"2024-04-25T01:39:32.429900+0000","last_became_peered":"2024-04-25T01:39:32.429900+0000","last_unstale":"2024-04-25T01:39:35.199994+0000","last_undegraded":"2024-04-25T01:39:35.199994+0000","last_fullsized":"2024-04-25T01:39:35.199994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:52.253045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429707+0000","last_change":"2024-04-25T01:39:33.440325+0000","last_active":"2024-04-25T01:39:34.429707+0000","last_peered":"2024-04-25T01:39:34.429707+0000","last_clean":"2024-04-25T01:39:34.429707+0000","last_became_active":"2024-04-25T01:39:33.439961+0000","last_became_peered":"2024-04-25T01:39:33.439961+0000","last_unstale":"2024-04-25T01:39:34.429707+0000","last_undegraded":"2024-04-25T01:39:34.429707+0000","last_fullsized":"2024-04-25T01:39:34.429707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:01.846576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199750+0000","last_change":"2024-04-25T01:39:24.380617+0000","last_active":"2024-04-25T01:39:35.199750+0000","last_peered":"2024-04-25T01:39:35.199750+0000","last_clean":"2024-04-25T01:39:35.199750+0000","last_became_active":"2024-04-25T01:39:24.380330+0000","last_became_peered":"2024-04-25T01:39:24.380330+0000","last_unstale":"2024-04-25T01:39:35.199750+0000","last_undegraded":"2024-04-25T01:39:35.199750+0000","last_fullsized":"2024-04-25T01:39:35.199750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:24.010569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434231+0000","last_change":"2024-04-25T01:39:23.373295+0000","last_active":"2024-04-25T01:39:34.434231+0000","last_peered":"2024-04-25T01:39:34.434231+0000","last_clean":"2024-04-25T01:39:34.434231+0000","last_became_active":"2024-04-25T01:39:23.372984+0000","last_became_peered":"2024-04-25T01:39:23.372984+0000","last_unstale":"2024-04-25T01:39:34.434231+0000","last_undegraded":"2024-04-25T01:39:34.434231+0000","last_fullsized":"2024-04-25T01:39:34.434231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:10.854190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198248+0000","last_change":"2024-04-25T01:39:32.433589+0000","last_active":"2024-04-25T01:39:35.198248+0000","last_peered":"2024-04-25T01:39:35.198248+0000","last_clean":"2024-04-25T01:39:35.198248+0000","last_became_active":"2024-04-25T01:39:32.433408+0000","last_became_peered":"2024-04-25T01:39:32.433408+0000","last_unstale":"2024-04-25T01:39:35.198248+0000","last_undegraded":"2024-04-25T01:39:35.198248+0000","last_fullsized":"2024-04-25T01:39:35.198248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:25.789951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198708+0000","last_change":"2024-04-25T01:39:33.433449+0000","last_active":"2024-04-25T01:39:35.198708+0000","last_peered":"2024-04-25T01:39:35.198708+0000","last_clean":"2024-04-25T01:39:35.198708+0000","last_became_active":"2024-04-25T01:39:33.432690+0000","last_became_peered":"2024-04-25T01:39:33.432690+0000","last_unstale":"2024-04-25T01:39:35.198708+0000","last_undegraded":"2024-04-25T01:39:35.198708+0000","last_fullsized":"2024-04-25T01:39:35.198708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:30.046453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198838+0000","last_change":"2024-04-25T01:39:24.391245+0000","last_active":"2024-04-25T01:39:35.198838+0000","last_peered":"2024-04-25T01:39:35.198838+0000","last_clean":"2024-04-25T01:39:35.198838+0000","last_became_active":"2024-04-25T01:39:24.390941+0000","last_became_peered":"2024-04-25T01:39:24.390941+0000","last_unstale":"2024-04-25T01:39:35.198838+0000","last_undegraded":"2024-04-25T01:39:35.198838+0000","last_fullsized":"2024-04-25T01:39:35.198838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:55.182405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198689+0000","last_change":"2024-04-25T01:39:23.369043+0000","last_active":"2024-04-25T01:39:35.198689+0000","last_peered":"2024-04-25T01:39:35.198689+0000","last_clean":"2024-04-25T01:39:35.198689+0000","last_became_active":"2024-04-25T01:39:23.368778+0000","last_became_peered":"2024-04-25T01:39:23.368778+0000","last_unstale":"2024-04-25T01:39:35.198689+0000","last_undegraded":"2024-04-25T01:39:35.198689+0000","last_fullsized":"2024-04-25T01:39:35.198689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:59.501724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198230+0000","last_change":"2024-04-25T01:39:32.431530+0000","last_active":"2024-04-25T01:39:35.198230+0000","last_peered":"2024-04-25T01:39:35.198230+0000","last_clean":"2024-04-25T01:39:35.198230+0000","last_became_active":"2024-04-25T01:39:32.431247+0000","last_became_peered":"2024-04-25T01:39:32.431247+0000","last_unstale":"2024-04-25T01:39:35.198230+0000","last_undegraded":"2024-04-25T01:39:35.198230+0000","last_fullsized":"2024-04-25T01:39:35.198230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:46:02.014508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434136+0000","last_change":"2024-04-25T01:39:33.446545+0000","last_active":"2024-04-25T01:39:34.434136+0000","last_peered":"2024-04-25T01:39:34.434136+0000","last_clean":"2024-04-25T01:39:34.434136+0000","last_became_active":"2024-04-25T01:39:33.446263+0000","last_became_peered":"2024-04-25T01:39:33.446263+0000","last_unstale":"2024-04-25T01:39:34.434136+0000","last_undegraded":"2024-04-25T01:39:34.434136+0000","last_fullsized":"2024-04-25T01:39:34.434136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:27.026460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559482+0000","last_change":"2024-04-25T01:39:24.403875+0000","last_active":"2024-04-25T01:39:34.559482+0000","last_peered":"2024-04-25T01:39:34.559482+0000","last_clean":"2024-04-25T01:39:34.559482+0000","last_became_active":"2024-04-25T01:39:24.403591+0000","last_became_peered":"2024-04-25T01:39:24.403591+0000","last_unstale":"2024-04-25T01:39:34.559482+0000","last_undegraded":"2024-04-25T01:39:34.559482+0000","last_fullsized":"2024-04-25T01:39:34.559482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:45.276173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198758+0000","last_change":"2024-04-25T01:39:23.378968+0000","last_active":"2024-04-25T01:39:35.198758+0000","last_peered":"2024-04-25T01:39:35.198758+0000","last_clean":"2024-04-25T01:39:35.198758+0000","last_became_active":"2024-04-25T01:39:23.378635+0000","last_became_peered":"2024-04-25T01:39:23.378635+0000","last_unstale":"2024-04-25T01:39:35.198758+0000","last_undegraded":"2024-04-25T01:39:35.198758+0000","last_fullsized":"2024-04-25T01:39:35.198758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:39.780544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429477+0000","last_change":"2024-04-25T01:39:32.427357+0000","last_active":"2024-04-25T01:39:34.429477+0000","last_peered":"2024-04-25T01:39:34.429477+0000","last_clean":"2024-04-25T01:39:34.429477+0000","last_became_active":"2024-04-25T01:39:32.427105+0000","last_became_peered":"2024-04-25T01:39:32.427105+0000","last_unstale":"2024-04-25T01:39:34.429477+0000","last_undegraded":"2024-04-25T01:39:34.429477+0000","last_fullsized":"2024-04-25T01:39:34.429477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:04.848726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197844+0000","last_change":"2024-04-25T01:39:33.444814+0000","last_active":"2024-04-25T01:39:35.197844+0000","last_peered":"2024-04-25T01:39:35.197844+0000","last_clean":"2024-04-25T01:39:35.197844+0000","last_became_active":"2024-04-25T01:39:33.444489+0000","last_became_peered":"2024-04-25T01:39:33.444489+0000","last_unstale":"2024-04-25T01:39:35.197844+0000","last_undegraded":"2024-04-25T01:39:35.197844+0000","last_fullsized":"2024-04-25T01:39:35.197844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:06.718940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198707+0000","last_change":"2024-04-25T01:39:24.392642+0000","last_active":"2024-04-25T01:39:35.198707+0000","last_peered":"2024-04-25T01:39:35.198707+0000","last_clean":"2024-04-25T01:39:35.198707+0000","last_became_active":"2024-04-25T01:39:24.391605+0000","last_became_peered":"2024-04-25T01:39:24.391605+0000","last_unstale":"2024-04-25T01:39:35.198707+0000","last_undegraded":"2024-04-25T01:39:35.198707+0000","last_fullsized":"2024-04-25T01:39:35.198707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:01:23.217074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434798+0000","last_change":"2024-04-25T01:39:23.377236+0000","last_active":"2024-04-25T01:39:34.434798+0000","last_peered":"2024-04-25T01:39:34.434798+0000","last_clean":"2024-04-25T01:39:34.434798+0000","last_became_active":"2024-04-25T01:39:23.376727+0000","last_became_peered":"2024-04-25T01:39:23.376727+0000","last_unstale":"2024-04-25T01:39:34.434798+0000","last_undegraded":"2024-04-25T01:39:34.434798+0000","last_fullsized":"2024-04-25T01:39:34.434798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:08.103707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429200+0000","last_change":"2024-04-25T01:39:32.424457+0000","last_active":"2024-04-25T01:39:34.429200+0000","last_peered":"2024-04-25T01:39:34.429200+0000","last_clean":"2024-04-25T01:39:34.429200+0000","last_became_active":"2024-04-25T01:39:32.424203+0000","last_became_peered":"2024-04-25T01:39:32.424203+0000","last_unstale":"2024-04-25T01:39:34.429200+0000","last_undegraded":"2024-04-25T01:39:34.429200+0000","last_fullsized":"2024-04-25T01:39:34.429200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:12:20.824070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434672+0000","last_change":"2024-04-25T01:39:33.445948+0000","last_active":"2024-04-25T01:39:34.434672+0000","last_peered":"2024-04-25T01:39:34.434672+0000","last_clean":"2024-04-25T01:39:34.434672+0000","last_became_active":"2024-04-25T01:39:33.445654+0000","last_became_peered":"2024-04-25T01:39:33.445654+0000","last_unstale":"2024-04-25T01:39:34.434672+0000","last_undegraded":"2024-04-25T01:39:34.434672+0000","last_fullsized":"2024-04-25T01:39:34.434672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:51.323909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559508+0000","last_change":"2024-04-25T01:39:32.430484+0000","last_active":"2024-04-25T01:39:34.559508+0000","last_peered":"2024-04-25T01:39:34.559508+0000","last_clean":"2024-04-25T01:39:34.559508+0000","last_became_active":"2024-04-25T01:39:32.430220+0000","last_became_peered":"2024-04-25T01:39:32.430220+0000","last_unstale":"2024-04-25T01:39:34.559508+0000","last_undegraded":"2024-04-25T01:39:34.559508+0000","last_fullsized":"2024-04-25T01:39:34.559508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:36:53.152442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197722+0000","last_change":"2024-04-25T01:39:24.375457+0000","last_active":"2024-04-25T01:39:35.197722+0000","last_peered":"2024-04-25T01:39:35.197722+0000","last_clean":"2024-04-25T01:39:35.197722+0000","last_became_active":"2024-04-25T01:39:24.375178+0000","last_became_peered":"2024-04-25T01:39:24.375178+0000","last_unstale":"2024-04-25T01:39:35.197722+0000","last_undegraded":"2024-04-25T01:39:35.197722+0000","last_fullsized":"2024-04-25T01:39:35.197722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:58:15.640882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197478+0000","last_change":"2024-04-25T01:39:23.369998+0000","last_active":"2024-04-25T01:39:35.197478+0000","last_peered":"2024-04-25T01:39:35.197478+0000","last_clean":"2024-04-25T01:39:35.197478+0000","last_became_active":"2024-04-25T01:39:23.369710+0000","last_became_peered":"2024-04-25T01:39:23.369710+0000","last_unstale":"2024-04-25T01:39:35.197478+0000","last_undegraded":"2024-04-25T01:39:35.197478+0000","last_fullsized":"2024-04-25T01:39:35.197478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:32:34.329452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559536+0000","last_change":"2024-04-25T01:39:33.447666+0000","last_active":"2024-04-25T01:39:34.559536+0000","last_peered":"2024-04-25T01:39:34.559536+0000","last_clean":"2024-04-25T01:39:34.559536+0000","last_became_active":"2024-04-25T01:39:33.447436+0000","last_became_peered":"2024-04-25T01:39:33.447436+0000","last_unstale":"2024-04-25T01:39:34.559536+0000","last_undegraded":"2024-04-25T01:39:34.559536+0000","last_fullsized":"2024-04-25T01:39:34.559536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:25:20.440422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434733+0000","last_change":"2024-04-25T01:39:32.436300+0000","last_active":"2024-04-25T01:39:34.434733+0000","last_peered":"2024-04-25T01:39:34.434733+0000","last_clean":"2024-04-25T01:39:34.434733+0000","last_became_active":"2024-04-25T01:39:32.436000+0000","last_became_peered":"2024-04-25T01:39:32.436000+0000","last_unstale":"2024-04-25T01:39:34.434733+0000","last_undegraded":"2024-04-25T01:39:34.434733+0000","last_fullsized":"2024-04-25T01:39:34.434733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:38.044992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429461+0000","last_change":"2024-04-25T01:39:24.387708+0000","last_active":"2024-04-25T01:39:34.429461+0000","last_peered":"2024-04-25T01:39:34.429461+0000","last_clean":"2024-04-25T01:39:34.429461+0000","last_became_active":"2024-04-25T01:39:24.387433+0000","last_became_peered":"2024-04-25T01:39:24.387433+0000","last_unstale":"2024-04-25T01:39:34.429461+0000","last_undegraded":"2024-04-25T01:39:34.429461+0000","last_fullsized":"2024-04-25T01:39:34.429461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:34.312066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429418+0000","last_change":"2024-04-25T01:39:23.377487+0000","last_active":"2024-04-25T01:39:34.429418+0000","last_peered":"2024-04-25T01:39:34.429418+0000","last_clean":"2024-04-25T01:39:34.429418+0000","last_became_active":"2024-04-25T01:39:23.377181+0000","last_became_peered":"2024-04-25T01:39:23.377181+0000","last_unstale":"2024-04-25T01:39:34.429418+0000","last_undegraded":"2024-04-25T01:39:34.429418+0000","last_fullsized":"2024-04-25T01:39:34.429418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:17.434141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198602+0000","last_change":"2024-04-25T01:39:33.444973+0000","last_active":"2024-04-25T01:39:35.198602+0000","last_peered":"2024-04-25T01:39:35.198602+0000","last_clean":"2024-04-25T01:39:35.198602+0000","last_became_active":"2024-04-25T01:39:33.444673+0000","last_became_peered":"2024-04-25T01:39:33.444673+0000","last_unstale":"2024-04-25T01:39:35.198602+0000","last_undegraded":"2024-04-25T01:39:35.198602+0000","last_fullsized":"2024-04-25T01:39:35.198602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:08.372714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434713+0000","last_change":"2024-04-25T01:39:23.372975+0000","last_active":"2024-04-25T01:39:34.434713+0000","last_peered":"2024-04-25T01:39:34.434713+0000","last_clean":"2024-04-25T01:39:34.434713+0000","last_became_active":"2024-04-25T01:39:23.372688+0000","last_became_peered":"2024-04-25T01:39:23.372688+0000","last_unstale":"2024-04-25T01:39:34.434713+0000","last_undegraded":"2024-04-25T01:39:34.434713+0000","last_fullsized":"2024-04-25T01:39:34.434713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:42:57.195844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559766+0000","last_change":"2024-04-25T01:39:24.388095+0000","last_active":"2024-04-25T01:39:34.559766+0000","last_peered":"2024-04-25T01:39:34.559766+0000","last_clean":"2024-04-25T01:39:34.559766+0000","last_became_active":"2024-04-25T01:39:24.387797+0000","last_became_peered":"2024-04-25T01:39:24.387797+0000","last_unstale":"2024-04-25T01:39:34.559766+0000","last_undegraded":"2024-04-25T01:39:34.559766+0000","last_fullsized":"2024-04-25T01:39:34.559766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:43:16.385957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197731+0000","last_change":"2024-04-25T01:39:32.427081+0000","last_active":"2024-04-25T01:39:35.197731+0000","last_peered":"2024-04-25T01:39:35.197731+0000","last_clean":"2024-04-25T01:39:35.197731+0000","last_became_active":"2024-04-25T01:39:32.426626+0000","last_became_peered":"2024-04-25T01:39:32.426626+0000","last_unstale":"2024-04-25T01:39:35.197731+0000","last_undegraded":"2024-04-25T01:39:35.197731+0000","last_fullsized":"2024-04-25T01:39:35.197731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:45.358400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198937+0000","last_change":"2024-04-25T01:39:33.446301+0000","last_active":"2024-04-25T01:39:35.198937+0000","last_peered":"2024-04-25T01:39:35.198937+0000","last_clean":"2024-04-25T01:39:35.198937+0000","last_became_active":"2024-04-25T01:39:33.445158+0000","last_became_peered":"2024-04-25T01:39:33.445158+0000","last_unstale":"2024-04-25T01:39:35.198937+0000","last_undegraded":"2024-04-25T01:39:35.198937+0000","last_fullsized":"2024-04-25T01:39:35.198937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:53:26.017968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429884+0000","last_change":"2024-04-25T01:39:23.371716+0000","last_active":"2024-04-25T01:39:34.429884+0000","last_peered":"2024-04-25T01:39:34.429884+0000","last_clean":"2024-04-25T01:39:34.429884+0000","last_became_active":"2024-04-25T01:39:23.371475+0000","last_became_peered":"2024-04-25T01:39:23.371475+0000","last_unstale":"2024-04-25T01:39:34.429884+0000","last_undegraded":"2024-04-25T01:39:34.429884+0000","last_fullsized":"2024-04-25T01:39:34.429884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:10.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198751+0000","last_change":"2024-04-25T01:39:24.388083+0000","last_active":"2024-04-25T01:39:35.198751+0000","last_peered":"2024-04-25T01:39:35.198751+0000","last_clean":"2024-04-25T01:39:35.198751+0000","last_became_active":"2024-04-25T01:39:24.387789+0000","last_became_peered":"2024-04-25T01:39:24.387789+0000","last_unstale":"2024-04-25T01:39:35.198751+0000","last_undegraded":"2024-04-25T01:39:35.198751+0000","last_fullsized":"2024-04-25T01:39:35.198751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:31.760631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429824+0000","last_change":"2024-04-25T01:39:32.429613+0000","last_active":"2024-04-25T01:39:34.429824+0000","last_peered":"2024-04-25T01:39:34.429824+0000","last_clean":"2024-04-25T01:39:34.429824+0000","last_became_active":"2024-04-25T01:39:32.429361+0000","last_became_peered":"2024-04-25T01:39:32.429361+0000","last_unstale":"2024-04-25T01:39:34.429824+0000","last_undegraded":"2024-04-25T01:39:34.429824+0000","last_fullsized":"2024-04-25T01:39:34.429824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:04:59.928602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430227+0000","last_change":"2024-04-25T01:39:33.426384+0000","last_active":"2024-04-25T01:39:34.430227+0000","last_peered":"2024-04-25T01:39:34.430227+0000","last_clean":"2024-04-25T01:39:34.430227+0000","last_became_active":"2024-04-25T01:39:33.426101+0000","last_became_peered":"2024-04-25T01:39:33.426101+0000","last_unstale":"2024-04-25T01:39:34.430227+0000","last_undegraded":"2024-04-25T01:39:34.430227+0000","last_fullsized":"2024-04-25T01:39:34.430227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:36.820458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.433902+0000","last_change":"2024-04-25T01:39:24.395618+0000","last_active":"2024-04-25T01:39:34.433902+0000","last_peered":"2024-04-25T01:39:34.433902+0000","last_clean":"2024-04-25T01:39:34.433902+0000","last_became_active":"2024-04-25T01:39:24.394816+0000","last_became_peered":"2024-04-25T01:39:24.394816+0000","last_unstale":"2024-04-25T01:39:34.433902+0000","last_undegraded":"2024-04-25T01:39:34.433902+0000","last_fullsized":"2024-04-25T01:39:34.433902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:01.025135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198676+0000","last_change":"2024-04-25T01:39:33.432537+0000","last_active":"2024-04-25T01:39:35.198676+0000","last_peered":"2024-04-25T01:39:35.198676+0000","last_clean":"2024-04-25T01:39:35.198676+0000","last_became_active":"2024-04-25T01:39:33.432266+0000","last_became_peered":"2024-04-25T01:39:33.432266+0000","last_unstale":"2024-04-25T01:39:35.198676+0000","last_undegraded":"2024-04-25T01:39:35.198676+0000","last_fullsized":"2024-04-25T01:39:35.198676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:31.703689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197383+0000","last_change":"2024-04-25T01:39:24.390981+0000","last_active":"2024-04-25T01:39:35.197383+0000","last_peered":"2024-04-25T01:39:35.197383+0000","last_clean":"2024-04-25T01:39:35.197383+0000","last_became_active":"2024-04-25T01:39:24.390716+0000","last_became_peered":"2024-04-25T01:39:24.390716+0000","last_unstale":"2024-04-25T01:39:35.197383+0000","last_undegraded":"2024-04-25T01:39:35.197383+0000","last_fullsized":"2024-04-25T01:39:35.197383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:08.458504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199057+0000","last_change":"2024-04-25T01:39:33.439086+0000","last_active":"2024-04-25T01:39:35.199057+0000","last_peered":"2024-04-25T01:39:35.199057+0000","last_clean":"2024-04-25T01:39:35.199057+0000","last_became_active":"2024-04-25T01:39:33.438811+0000","last_became_peered":"2024-04-25T01:39:33.438811+0000","last_unstale":"2024-04-25T01:39:35.199057+0000","last_undegraded":"2024-04-25T01:39:35.199057+0000","last_fullsized":"2024-04-25T01:39:35.199057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:49:23.604749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198076+0000","last_change":"2024-04-25T01:39:24.399738+0000","last_active":"2024-04-25T01:39:35.198076+0000","last_peered":"2024-04-25T01:39:35.198076+0000","last_clean":"2024-04-25T01:39:35.198076+0000","last_became_active":"2024-04-25T01:39:24.399499+0000","last_became_peered":"2024-04-25T01:39:24.399499+0000","last_unstale":"2024-04-25T01:39:35.198076+0000","last_undegraded":"2024-04-25T01:39:35.198076+0000","last_fullsized":"2024-04-25T01:39:35.198076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:58.646669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198407+0000","last_change":"2024-04-25T01:39:33.444074+0000","last_active":"2024-04-25T01:39:35.198407+0000","last_peered":"2024-04-25T01:39:35.198407+0000","last_clean":"2024-04-25T01:39:35.198407+0000","last_became_active":"2024-04-25T01:39:33.443796+0000","last_became_peered":"2024-04-25T01:39:33.443796+0000","last_unstale":"2024-04-25T01:39:35.198407+0000","last_undegraded":"2024-04-25T01:39:35.198407+0000","last_fullsized":"2024-04-25T01:39:35.198407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:56.379211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559685+0000","last_change":"2024-04-25T01:39:24.390631+0000","last_active":"2024-04-25T01:39:34.559685+0000","last_peered":"2024-04-25T01:39:34.559685+0000","last_clean":"2024-04-25T01:39:34.559685+0000","last_became_active":"2024-04-25T01:39:24.390363+0000","last_became_peered":"2024-04-25T01:39:24.390363+0000","last_unstale":"2024-04-25T01:39:34.559685+0000","last_undegraded":"2024-04-25T01:39:34.559685+0000","last_fullsized":"2024-04-25T01:39:34.559685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:48.830416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199245+0000","last_change":"2024-04-25T01:39:33.437787+0000","last_active":"2024-04-25T01:39:35.199245+0000","last_peered":"2024-04-25T01:39:35.199245+0000","last_clean":"2024-04-25T01:39:35.199245+0000","last_became_active":"2024-04-25T01:39:33.436131+0000","last_became_peered":"2024-04-25T01:39:33.436131+0000","last_unstale":"2024-04-25T01:39:35.199245+0000","last_undegraded":"2024-04-25T01:39:35.199245+0000","last_fullsized":"2024-04-25T01:39:35.199245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:29:13.213643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429883+0000","last_change":"2024-04-25T01:39:24.389645+0000","last_active":"2024-04-25T01:39:34.429883+0000","last_peered":"2024-04-25T01:39:34.429883+0000","last_clean":"2024-04-25T01:39:34.429883+0000","last_became_active":"2024-04-25T01:39:24.389375+0000","last_became_peered":"2024-04-25T01:39:24.389375+0000","last_unstale":"2024-04-25T01:39:34.429883+0000","last_undegraded":"2024-04-25T01:39:34.429883+0000","last_fullsized":"2024-04-25T01:39:34.429883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:13:12.753893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197777+0000","last_change":"2024-04-25T01:39:33.448177+0000","last_active":"2024-04-25T01:39:35.197777+0000","last_peered":"2024-04-25T01:39:35.197777+0000","last_clean":"2024-04-25T01:39:35.197777+0000","last_became_active":"2024-04-25T01:39:33.447588+0000","last_became_peered":"2024-04-25T01:39:33.447588+0000","last_unstale":"2024-04-25T01:39:35.197777+0000","last_undegraded":"2024-04-25T01:39:35.197777+0000","last_fullsized":"2024-04-25T01:39:35.197777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:11:20.466189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198572+0000","last_change":"2024-04-25T01:39:24.374082+0000","last_active":"2024-04-25T01:39:35.198572+0000","last_peered":"2024-04-25T01:39:35.198572+0000","last_clean":"2024-04-25T01:39:35.198572+0000","last_became_active":"2024-04-25T01:39:24.373731+0000","last_became_peered":"2024-04-25T01:39:24.373731+0000","last_unstale":"2024-04-25T01:39:35.198572+0000","last_undegraded":"2024-04-25T01:39:35.198572+0000","last_fullsized":"2024-04-25T01:39:35.198572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:45.817483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197536+0000","last_change":"2024-04-25T01:39:33.446992+0000","last_active":"2024-04-25T01:39:35.197536+0000","last_peered":"2024-04-25T01:39:35.197536+0000","last_clean":"2024-04-25T01:39:35.197536+0000","last_became_active":"2024-04-25T01:39:33.446652+0000","last_became_peered":"2024-04-25T01:39:33.446652+0000","last_unstale":"2024-04-25T01:39:35.197536+0000","last_undegraded":"2024-04-25T01:39:35.197536+0000","last_fullsized":"2024-04-25T01:39:35.197536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:43:52.959274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434529+0000","last_change":"2024-04-25T01:39:24.398614+0000","last_active":"2024-04-25T01:39:34.434529+0000","last_peered":"2024-04-25T01:39:34.434529+0000","last_clean":"2024-04-25T01:39:34.434529+0000","last_became_active":"2024-04-25T01:39:24.398299+0000","last_became_peered":"2024-04-25T01:39:24.398299+0000","last_unstale":"2024-04-25T01:39:34.434529+0000","last_undegraded":"2024-04-25T01:39:34.434529+0000","last_fullsized":"2024-04-25T01:39:34.434529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:54:51.191225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434363+0000","last_change":"2024-04-25T01:39:33.441401+0000","last_active":"2024-04-25T01:39:34.434363+0000","last_peered":"2024-04-25T01:39:34.434363+0000","last_clean":"2024-04-25T01:39:34.434363+0000","last_became_active":"2024-04-25T01:39:33.441104+0000","last_became_peered":"2024-04-25T01:39:33.441104+0000","last_unstale":"2024-04-25T01:39:34.434363+0000","last_undegraded":"2024-04-25T01:39:34.434363+0000","last_fullsized":"2024-04-25T01:39:34.434363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:51.503340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430186+0000","last_change":"2024-04-25T01:39:24.390352+0000","last_active":"2024-04-25T01:39:34.430186+0000","last_peered":"2024-04-25T01:39:34.430186+0000","last_clean":"2024-04-25T01:39:34.430186+0000","last_became_active":"2024-04-25T01:39:24.389809+0000","last_became_peered":"2024-04-25T01:39:24.389809+0000","last_unstale":"2024-04-25T01:39:34.430186+0000","last_undegraded":"2024-04-25T01:39:34.430186+0000","last_fullsized":"2024-04-25T01:39:34.430186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:22:44.221898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430089+0000","last_change":"2024-04-25T01:39:33.426710+0000","last_active":"2024-04-25T01:39:34.430089+0000","last_peered":"2024-04-25T01:39:34.430089+0000","last_clean":"2024-04-25T01:39:34.430089+0000","last_became_active":"2024-04-25T01:39:33.426056+0000","last_became_peered":"2024-04-25T01:39:33.426056+0000","last_unstale":"2024-04-25T01:39:34.430089+0000","last_undegraded":"2024-04-25T01:39:34.430089+0000","last_fullsized":"2024-04-25T01:39:34.430089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:53:41.174851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197416+0000","last_change":"2024-04-25T01:39:24.387093+0000","last_active":"2024-04-25T01:39:35.197416+0000","last_peered":"2024-04-25T01:39:35.197416+0000","last_clean":"2024-04-25T01:39:35.197416+0000","last_became_active":"2024-04-25T01:39:24.386809+0000","last_became_peered":"2024-04-25T01:39:24.386809+0000","last_unstale":"2024-04-25T01:39:35.197416+0000","last_undegraded":"2024-04-25T01:39:35.197416+0000","last_fullsized":"2024-04-25T01:39:35.197416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:46:05.313828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200264+0000","last_change":"2024-04-25T01:39:33.436499+0000","last_active":"2024-04-25T01:39:35.200264+0000","last_peered":"2024-04-25T01:39:35.200264+0000","last_clean":"2024-04-25T01:39:35.200264+0000","last_became_active":"2024-04-25T01:39:33.436017+0000","last_became_peered":"2024-04-25T01:39:33.436017+0000","last_unstale":"2024-04-25T01:39:35.200264+0000","last_undegraded":"2024-04-25T01:39:35.200264+0000","last_fullsized":"2024-04-25T01:39:35.200264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:46:09.302012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429495+0000","last_change":"2024-04-25T01:39:24.389039+0000","last_active":"2024-04-25T01:39:34.429495+0000","last_peered":"2024-04-25T01:39:34.429495+0000","last_clean":"2024-04-25T01:39:34.429495+0000","last_became_active":"2024-04-25T01:39:24.388793+0000","last_became_peered":"2024-04-25T01:39:24.388793+0000","last_unstale":"2024-04-25T01:39:34.429495+0000","last_undegraded":"2024-04-25T01:39:34.429495+0000","last_fullsized":"2024-04-25T01:39:34.429495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:13.093550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197668+0000","last_change":"2024-04-25T01:39:33.441122+0000","last_active":"2024-04-25T01:39:35.197668+0000","last_peered":"2024-04-25T01:39:35.197668+0000","last_clean":"2024-04-25T01:39:35.197668+0000","last_became_active":"2024-04-25T01:39:33.440760+0000","last_became_peered":"2024-04-25T01:39:33.440760+0000","last_unstale":"2024-04-25T01:39:35.197668+0000","last_undegraded":"2024-04-25T01:39:35.197668+0000","last_fullsized":"2024-04-25T01:39:35.197668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:30:12.603789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197981+0000","last_change":"2024-04-25T01:39:24.390884+0000","last_active":"2024-04-25T01:39:35.197981+0000","last_peered":"2024-04-25T01:39:35.197981+0000","last_clean":"2024-04-25T01:39:35.197981+0000","last_became_active":"2024-04-25T01:39:24.390591+0000","last_became_peered":"2024-04-25T01:39:24.390591+0000","last_unstale":"2024-04-25T01:39:35.197981+0000","last_undegraded":"2024-04-25T01:39:35.197981+0000","last_fullsized":"2024-04-25T01:39:35.197981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:51.274363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429740+0000","last_change":"2024-04-25T01:39:33.429482+0000","last_active":"2024-04-25T01:39:34.429740+0000","last_peered":"2024-04-25T01:39:34.429740+0000","last_clean":"2024-04-25T01:39:34.429740+0000","last_became_active":"2024-04-25T01:39:33.429158+0000","last_became_peered":"2024-04-25T01:39:33.429158+0000","last_unstale":"2024-04-25T01:39:34.429740+0000","last_undegraded":"2024-04-25T01:39:34.429740+0000","last_fullsized":"2024-04-25T01:39:34.429740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:58:07.372868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559599+0000","last_change":"2024-04-25T01:39:24.388891+0000","last_active":"2024-04-25T01:39:34.559599+0000","last_peered":"2024-04-25T01:39:34.559599+0000","last_clean":"2024-04-25T01:39:34.559599+0000","last_became_active":"2024-04-25T01:39:24.388619+0000","last_became_peered":"2024-04-25T01:39:24.388619+0000","last_unstale":"2024-04-25T01:39:34.559599+0000","last_undegraded":"2024-04-25T01:39:34.559599+0000","last_fullsized":"2024-04-25T01:39:34.559599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:05.176386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198216+0000","last_change":"2024-04-25T01:39:33.443534+0000","last_active":"2024-04-25T01:39:35.198216+0000","last_peered":"2024-04-25T01:39:35.198216+0000","last_clean":"2024-04-25T01:39:35.198216+0000","last_became_active":"2024-04-25T01:39:33.443257+0000","last_became_peered":"2024-04-25T01:39:33.443257+0000","last_unstale":"2024-04-25T01:39:35.198216+0000","last_undegraded":"2024-04-25T01:39:35.198216+0000","last_fullsized":"2024-04-25T01:39:35.198216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:44:30.154519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434181+0000","last_change":"2024-04-25T01:39:24.395109+0000","last_active":"2024-04-25T01:39:34.434181+0000","last_peered":"2024-04-25T01:39:34.434181+0000","last_clean":"2024-04-25T01:39:34.434181+0000","last_became_active":"2024-04-25T01:39:24.394784+0000","last_became_peered":"2024-04-25T01:39:24.394784+0000","last_unstale":"2024-04-25T01:39:34.434181+0000","last_undegraded":"2024-04-25T01:39:34.434181+0000","last_fullsized":"2024-04-25T01:39:34.434181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:44:09.102603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197600+0000","last_change":"2024-04-25T01:39:33.446683+0000","last_active":"2024-04-25T01:39:35.197600+0000","last_peered":"2024-04-25T01:39:35.197600+0000","last_clean":"2024-04-25T01:39:35.197600+0000","last_became_active":"2024-04-25T01:39:33.445949+0000","last_became_peered":"2024-04-25T01:39:33.445949+0000","last_unstale":"2024-04-25T01:39:35.197600+0000","last_undegraded":"2024-04-25T01:39:35.197600+0000","last_fullsized":"2024-04-25T01:39:35.197600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:28.864821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199913+0000","last_change":"2024-04-25T01:39:24.380199+0000","last_active":"2024-04-25T01:39:35.199913+0000","last_peered":"2024-04-25T01:39:35.199913+0000","last_clean":"2024-04-25T01:39:35.199913+0000","last_became_active":"2024-04-25T01:39:24.379591+0000","last_became_peered":"2024-04-25T01:39:24.379591+0000","last_unstale":"2024-04-25T01:39:35.199913+0000","last_undegraded":"2024-04-25T01:39:35.199913+0000","last_fullsized":"2024-04-25T01:39:35.199913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:54.534683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197349+0000","last_change":"2024-04-25T01:39:33.439702+0000","last_active":"2024-04-25T01:39:35.197349+0000","last_peered":"2024-04-25T01:39:35.197349+0000","last_clean":"2024-04-25T01:39:35.197349+0000","last_became_active":"2024-04-25T01:39:33.439424+0000","last_became_peered":"2024-04-25T01:39:33.439424+0000","last_unstale":"2024-04-25T01:39:35.197349+0000","last_undegraded":"2024-04-25T01:39:35.197349+0000","last_fullsized":"2024-04-25T01:39:35.197349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:31.528140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197883+0000","last_change":"2024-04-25T01:39:24.395125+0000","last_active":"2024-04-25T01:39:35.197883+0000","last_peered":"2024-04-25T01:39:35.197883+0000","last_clean":"2024-04-25T01:39:35.197883+0000","last_became_active":"2024-04-25T01:39:24.392605+0000","last_became_peered":"2024-04-25T01:39:24.392605+0000","last_unstale":"2024-04-25T01:39:35.197883+0000","last_undegraded":"2024-04-25T01:39:35.197883+0000","last_fullsized":"2024-04-25T01:39:35.197883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:53.333616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559178+0000","last_change":"2024-04-25T01:39:33.438104+0000","last_active":"2024-04-25T01:39:34.559178+0000","last_peered":"2024-04-25T01:39:34.559178+0000","last_clean":"2024-04-25T01:39:34.559178+0000","last_became_active":"2024-04-25T01:39:33.437795+0000","last_became_peered":"2024-04-25T01:39:33.437795+0000","last_unstale":"2024-04-25T01:39:34.559178+0000","last_undegraded":"2024-04-25T01:39:34.559178+0000","last_fullsized":"2024-04-25T01:39:34.559178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:32.294104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199422+0000","last_change":"2024-04-25T01:39:24.391312+0000","last_active":"2024-04-25T01:39:35.199422+0000","last_peered":"2024-04-25T01:39:35.199422+0000","last_clean":"2024-04-25T01:39:35.199422+0000","last_became_active":"2024-04-25T01:39:24.390978+0000","last_became_peered":"2024-04-25T01:39:24.390978+0000","last_unstale":"2024-04-25T01:39:35.199422+0000","last_undegraded":"2024-04-25T01:39:35.199422+0000","last_fullsized":"2024-04-25T01:39:35.199422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:38:25.637031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197875+0000","last_change":"2024-04-25T01:39:33.431262+0000","last_active":"2024-04-25T01:39:35.197875+0000","last_peered":"2024-04-25T01:39:35.197875+0000","last_clean":"2024-04-25T01:39:35.197875+0000","last_became_active":"2024-04-25T01:39:33.430982+0000","last_became_peered":"2024-04-25T01:39:33.430982+0000","last_unstale":"2024-04-25T01:39:35.197875+0000","last_undegraded":"2024-04-25T01:39:35.197875+0000","last_fullsized":"2024-04-25T01:39:35.197875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:11.821542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197372+0000","last_change":"2024-04-25T01:39:24.399270+0000","last_active":"2024-04-25T01:39:35.197372+0000","last_peered":"2024-04-25T01:39:35.197372+0000","last_clean":"2024-04-25T01:39:35.197372+0000","last_became_active":"2024-04-25T01:39:24.399011+0000","last_became_peered":"2024-04-25T01:39:24.399011+0000","last_unstale":"2024-04-25T01:39:35.197372+0000","last_undegraded":"2024-04-25T01:39:35.197372+0000","last_fullsized":"2024-04-25T01:39:35.197372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:00.987674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197770+0000","last_change":"2024-04-25T01:39:33.443939+0000","last_active":"2024-04-25T01:39:35.197770+0000","last_peered":"2024-04-25T01:39:35.197770+0000","last_clean":"2024-04-25T01:39:35.197770+0000","last_became_active":"2024-04-25T01:39:33.443608+0000","last_became_peered":"2024-04-25T01:39:33.443608+0000","last_unstale":"2024-04-25T01:39:35.197770+0000","last_undegraded":"2024-04-25T01:39:35.197770+0000","last_fullsized":"2024-04-25T01:39:35.197770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:35.561173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197831+0000","last_change":"2024-04-25T01:39:24.388943+0000","last_active":"2024-04-25T01:39:35.197831+0000","last_peered":"2024-04-25T01:39:35.197831+0000","last_clean":"2024-04-25T01:39:35.197831+0000","last_became_active":"2024-04-25T01:39:24.388690+0000","last_became_peered":"2024-04-25T01:39:24.388690+0000","last_unstale":"2024-04-25T01:39:35.197831+0000","last_undegraded":"2024-04-25T01:39:35.197831+0000","last_fullsized":"2024-04-25T01:39:35.197831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:42:18.260701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198911+0000","last_change":"2024-04-25T01:39:33.438460+0000","last_active":"2024-04-25T01:39:35.198911+0000","last_peered":"2024-04-25T01:39:35.198911+0000","last_clean":"2024-04-25T01:39:35.198911+0000","last_became_active":"2024-04-25T01:39:33.436581+0000","last_became_peered":"2024-04-25T01:39:33.436581+0000","last_unstale":"2024-04-25T01:39:35.198911+0000","last_undegraded":"2024-04-25T01:39:35.198911+0000","last_fullsized":"2024-04-25T01:39:35.198911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:03:27.382925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559241+0000","last_change":"2024-04-25T01:39:24.389556+0000","last_active":"2024-04-25T01:39:34.559241+0000","last_peered":"2024-04-25T01:39:34.559241+0000","last_clean":"2024-04-25T01:39:34.559241+0000","last_became_active":"2024-04-25T01:39:24.389254+0000","last_became_peered":"2024-04-25T01:39:24.389254+0000","last_unstale":"2024-04-25T01:39:34.559241+0000","last_undegraded":"2024-04-25T01:39:34.559241+0000","last_fullsized":"2024-04-25T01:39:34.559241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:56.208172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199719+0000","last_change":"2024-04-25T01:39:33.433893+0000","last_active":"2024-04-25T01:39:35.199719+0000","last_peered":"2024-04-25T01:39:35.199719+0000","last_clean":"2024-04-25T01:39:35.199719+0000","last_became_active":"2024-04-25T01:39:33.433577+0000","last_became_peered":"2024-04-25T01:39:33.433577+0000","last_unstale":"2024-04-25T01:39:35.199719+0000","last_undegraded":"2024-04-25T01:39:35.199719+0000","last_fullsized":"2024-04-25T01:39:35.199719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:16.371837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429725+0000","last_change":"2024-04-25T01:39:24.392021+0000","last_active":"2024-04-25T01:39:34.429725+0000","last_peered":"2024-04-25T01:39:34.429725+0000","last_clean":"2024-04-25T01:39:34.429725+0000","last_became_active":"2024-04-25T01:39:24.391352+0000","last_became_peered":"2024-04-25T01:39:24.391352+0000","last_unstale":"2024-04-25T01:39:34.429725+0000","last_undegraded":"2024-04-25T01:39:34.429725+0000","last_fullsized":"2024-04-25T01:39:34.429725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:44.434749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429972+0000","last_change":"2024-04-25T01:39:33.436641+0000","last_active":"2024-04-25T01:39:34.429972+0000","last_peered":"2024-04-25T01:39:34.429972+0000","last_clean":"2024-04-25T01:39:34.429972+0000","last_became_active":"2024-04-25T01:39:33.436389+0000","last_became_peered":"2024-04-25T01:39:33.436389+0000","last_unstale":"2024-04-25T01:39:34.429972+0000","last_undegraded":"2024-04-25T01:39:34.429972+0000","last_fullsized":"2024-04-25T01:39:34.429972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:19:51.940088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198744+0000","last_change":"2024-04-25T01:39:24.396300+0000","last_active":"2024-04-25T01:39:35.198744+0000","last_peered":"2024-04-25T01:39:35.198744+0000","last_clean":"2024-04-25T01:39:35.198744+0000","last_became_active":"2024-04-25T01:39:24.396023+0000","last_became_peered":"2024-04-25T01:39:24.396023+0000","last_unstale":"2024-04-25T01:39:35.198744+0000","last_undegraded":"2024-04-25T01:39:35.198744+0000","last_fullsized":"2024-04-25T01:39:35.198744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:21.500721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197770+0000","last_change":"2024-04-25T01:39:33.443419+0000","last_active":"2024-04-25T01:39:35.197770+0000","last_peered":"2024-04-25T01:39:35.197770+0000","last_clean":"2024-04-25T01:39:35.197770+0000","last_became_active":"2024-04-25T01:39:33.443163+0000","last_became_peered":"2024-04-25T01:39:33.443163+0000","last_unstale":"2024-04-25T01:39:35.197770+0000","last_undegraded":"2024-04-25T01:39:35.197770+0000","last_fullsized":"2024-04-25T01:39:35.197770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:22.156410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434366+0000","last_change":"2024-04-25T01:39:24.404047+0000","last_active":"2024-04-25T01:39:34.434366+0000","last_peered":"2024-04-25T01:39:34.434366+0000","last_clean":"2024-04-25T01:39:34.434366+0000","last_became_active":"2024-04-25T01:39:24.403700+0000","last_became_peered":"2024-04-25T01:39:24.403700+0000","last_unstale":"2024-04-25T01:39:34.434366+0000","last_undegraded":"2024-04-25T01:39:34.434366+0000","last_fullsized":"2024-04-25T01:39:34.434366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:53.123061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199905+0000","last_change":"2024-04-25T01:39:33.435520+0000","last_active":"2024-04-25T01:39:35.199905+0000","last_peered":"2024-04-25T01:39:35.199905+0000","last_clean":"2024-04-25T01:39:35.199905+0000","last_became_active":"2024-04-25T01:39:33.434446+0000","last_became_peered":"2024-04-25T01:39:33.434446+0000","last_unstale":"2024-04-25T01:39:35.199905+0000","last_undegraded":"2024-04-25T01:39:35.199905+0000","last_fullsized":"2024-04-25T01:39:35.199905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:59.696009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434467+0000","last_change":"2024-04-25T01:39:24.406158+0000","last_active":"2024-04-25T01:39:34.434467+0000","last_peered":"2024-04-25T01:39:34.434467+0000","last_clean":"2024-04-25T01:39:34.434467+0000","last_became_active":"2024-04-25T01:39:24.405876+0000","last_became_peered":"2024-04-25T01:39:24.405876+0000","last_unstale":"2024-04-25T01:39:34.434467+0000","last_undegraded":"2024-04-25T01:39:34.434467+0000","last_fullsized":"2024-04-25T01:39:34.434467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:18:19.895651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198497+0000","last_change":"2024-04-25T01:39:33.436479+0000","last_active":"2024-04-25T01:39:35.198497+0000","last_peered":"2024-04-25T01:39:35.198497+0000","last_clean":"2024-04-25T01:39:35.198497+0000","last_became_active":"2024-04-25T01:39:33.436193+0000","last_became_peered":"2024-04-25T01:39:33.436193+0000","last_unstale":"2024-04-25T01:39:35.198497+0000","last_undegraded":"2024-04-25T01:39:35.198497+0000","last_fullsized":"2024-04-25T01:39:35.198497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:20:03.455536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200363+0000","last_change":"2024-04-25T01:39:24.393362+0000","last_active":"2024-04-25T01:39:35.200363+0000","last_peered":"2024-04-25T01:39:35.200363+0000","last_clean":"2024-04-25T01:39:35.200363+0000","last_became_active":"2024-04-25T01:39:24.392836+0000","last_became_peered":"2024-04-25T01:39:24.392836+0000","last_unstale":"2024-04-25T01:39:35.200363+0000","last_undegraded":"2024-04-25T01:39:35.200363+0000","last_fullsized":"2024-04-25T01:39:35.200363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:58.871777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430064+0000","last_change":"2024-04-25T01:39:33.440164+0000","last_active":"2024-04-25T01:39:34.430064+0000","last_peered":"2024-04-25T01:39:34.430064+0000","last_clean":"2024-04-25T01:39:34.430064+0000","last_became_active":"2024-04-25T01:39:33.439878+0000","last_became_peered":"2024-04-25T01:39:33.439878+0000","last_unstale":"2024-04-25T01:39:34.430064+0000","last_undegraded":"2024-04-25T01:39:34.430064+0000","last_fullsized":"2024-04-25T01:39:34.430064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:44:52.817169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429296+0000","last_change":"2024-04-25T01:39:24.401765+0000","last_active":"2024-04-25T01:39:34.429296+0000","last_peered":"2024-04-25T01:39:34.429296+0000","last_clean":"2024-04-25T01:39:34.429296+0000","last_became_active":"2024-04-25T01:39:24.400509+0000","last_became_peered":"2024-04-25T01:39:24.400509+0000","last_unstale":"2024-04-25T01:39:34.429296+0000","last_undegraded":"2024-04-25T01:39:34.429296+0000","last_fullsized":"2024-04-25T01:39:34.429296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:25.031622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434669+0000","last_change":"2024-04-25T01:39:33.439353+0000","last_active":"2024-04-25T01:39:34.434669+0000","last_peered":"2024-04-25T01:39:34.434669+0000","last_clean":"2024-04-25T01:39:34.434669+0000","last_became_active":"2024-04-25T01:39:33.438915+0000","last_became_peered":"2024-04-25T01:39:33.438915+0000","last_unstale":"2024-04-25T01:39:34.434669+0000","last_undegraded":"2024-04-25T01:39:34.434669+0000","last_fullsized":"2024-04-25T01:39:34.434669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:19.180919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198881+0000","last_change":"2024-04-25T01:39:24.387941+0000","last_active":"2024-04-25T01:39:35.198881+0000","last_peered":"2024-04-25T01:39:35.198881+0000","last_clean":"2024-04-25T01:39:35.198881+0000","last_became_active":"2024-04-25T01:39:24.387674+0000","last_became_peered":"2024-04-25T01:39:24.387674+0000","last_unstale":"2024-04-25T01:39:35.198881+0000","last_undegraded":"2024-04-25T01:39:35.198881+0000","last_fullsized":"2024-04-25T01:39:35.198881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:05.676143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197803+0000","last_change":"2024-04-25T01:39:33.444917+0000","last_active":"2024-04-25T01:39:35.197803+0000","last_peered":"2024-04-25T01:39:35.197803+0000","last_clean":"2024-04-25T01:39:35.197803+0000","last_became_active":"2024-04-25T01:39:33.444636+0000","last_became_peered":"2024-04-25T01:39:33.444636+0000","last_unstale":"2024-04-25T01:39:35.197803+0000","last_undegraded":"2024-04-25T01:39:35.197803+0000","last_fullsized":"2024-04-25T01:39:35.197803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:31.531502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197880+0000","last_change":"2024-04-25T01:39:24.399950+0000","last_active":"2024-04-25T01:39:35.197880+0000","last_peered":"2024-04-25T01:39:35.197880+0000","last_clean":"2024-04-25T01:39:35.197880+0000","last_became_active":"2024-04-25T01:39:24.399701+0000","last_became_peered":"2024-04-25T01:39:24.399701+0000","last_unstale":"2024-04-25T01:39:35.197880+0000","last_undegraded":"2024-04-25T01:39:35.197880+0000","last_fullsized":"2024-04-25T01:39:35.197880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:49.618370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200035+0000","last_change":"2024-04-25T01:39:33.440936+0000","last_active":"2024-04-25T01:39:35.200035+0000","last_peered":"2024-04-25T01:39:35.200035+0000","last_clean":"2024-04-25T01:39:35.200035+0000","last_became_active":"2024-04-25T01:39:33.440679+0000","last_became_peered":"2024-04-25T01:39:33.440679+0000","last_unstale":"2024-04-25T01:39:35.200035+0000","last_undegraded":"2024-04-25T01:39:35.200035+0000","last_fullsized":"2024-04-25T01:39:35.200035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:08:53.629572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198222+0000","last_change":"2024-04-25T01:39:24.380318+0000","last_active":"2024-04-25T01:39:35.198222+0000","last_peered":"2024-04-25T01:39:35.198222+0000","last_clean":"2024-04-25T01:39:35.198222+0000","last_became_active":"2024-04-25T01:39:24.379573+0000","last_became_peered":"2024-04-25T01:39:24.379573+0000","last_unstale":"2024-04-25T01:39:35.198222+0000","last_undegraded":"2024-04-25T01:39:35.198222+0000","last_fullsized":"2024-04-25T01:39:35.198222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:12.089917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429399+0000","last_change":"2024-04-25T01:39:33.426380+0000","last_active":"2024-04-25T01:39:34.429399+0000","last_peered":"2024-04-25T01:39:34.429399+0000","last_clean":"2024-04-25T01:39:34.429399+0000","last_became_active":"2024-04-25T01:39:33.426090+0000","last_became_peered":"2024-04-25T01:39:33.426090+0000","last_unstale":"2024-04-25T01:39:34.429399+0000","last_undegraded":"2024-04-25T01:39:34.429399+0000","last_fullsized":"2024-04-25T01:39:34.429399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:34.329217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199243+0000","last_change":"2024-04-25T01:39:24.398726+0000","last_active":"2024-04-25T01:39:35.199243+0000","last_peered":"2024-04-25T01:39:35.199243+0000","last_clean":"2024-04-25T01:39:35.199243+0000","last_became_active":"2024-04-25T01:39:24.398449+0000","last_became_peered":"2024-04-25T01:39:24.398449+0000","last_unstale":"2024-04-25T01:39:35.199243+0000","last_undegraded":"2024-04-25T01:39:35.199243+0000","last_fullsized":"2024-04-25T01:39:35.199243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:41:38.230939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197750+0000","last_change":"2024-04-25T01:39:33.436488+0000","last_active":"2024-04-25T01:39:35.197750+0000","last_peered":"2024-04-25T01:39:35.197750+0000","last_clean":"2024-04-25T01:39:35.197750+0000","last_became_active":"2024-04-25T01:39:33.436224+0000","last_became_peered":"2024-04-25T01:39:33.436224+0000","last_unstale":"2024-04-25T01:39:35.197750+0000","last_undegraded":"2024-04-25T01:39:35.197750+0000","last_fullsized":"2024-04-25T01:39:35.197750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:38.227206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559398+0000","last_change":"2024-04-25T01:39:24.386909+0000","last_active":"2024-04-25T01:39:34.559398+0000","last_peered":"2024-04-25T01:39:34.559398+0000","last_clean":"2024-04-25T01:39:34.559398+0000","last_became_active":"2024-04-25T01:39:24.386568+0000","last_became_peered":"2024-04-25T01:39:24.386568+0000","last_unstale":"2024-04-25T01:39:34.559398+0000","last_undegraded":"2024-04-25T01:39:34.559398+0000","last_fullsized":"2024-04-25T01:39:34.559398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:29.904064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197979+0000","last_change":"2024-04-25T01:39:33.440753+0000","last_active":"2024-04-25T01:39:35.197979+0000","last_peered":"2024-04-25T01:39:35.197979+0000","last_clean":"2024-04-25T01:39:35.197979+0000","last_became_active":"2024-04-25T01:39:33.440480+0000","last_became_peered":"2024-04-25T01:39:33.440480+0000","last_unstale":"2024-04-25T01:39:35.197979+0000","last_undegraded":"2024-04-25T01:39:35.197979+0000","last_fullsized":"2024-04-25T01:39:35.197979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:18.113293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197980+0000","last_change":"2024-04-25T01:39:24.386803+0000","last_active":"2024-04-25T01:39:35.197980+0000","last_peered":"2024-04-25T01:39:35.197980+0000","last_clean":"2024-04-25T01:39:35.197980+0000","last_became_active":"2024-04-25T01:39:24.386531+0000","last_became_peered":"2024-04-25T01:39:24.386531+0000","last_unstale":"2024-04-25T01:39:35.197980+0000","last_undegraded":"2024-04-25T01:39:35.197980+0000","last_fullsized":"2024-04-25T01:39:35.197980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:19.160345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198690+0000","last_change":"2024-04-25T01:39:33.436433+0000","last_active":"2024-04-25T01:39:35.198690+0000","last_peered":"2024-04-25T01:39:35.198690+0000","last_clean":"2024-04-25T01:39:35.198690+0000","last_became_active":"2024-04-25T01:39:33.436134+0000","last_became_peered":"2024-04-25T01:39:33.436134+0000","last_unstale":"2024-04-25T01:39:35.198690+0000","last_undegraded":"2024-04-25T01:39:35.198690+0000","last_fullsized":"2024-04-25T01:39:35.198690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:08:30.641790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200300+0000","last_change":"2024-04-25T01:39:24.396231+0000","last_active":"2024-04-25T01:39:35.200300+0000","last_peered":"2024-04-25T01:39:35.200300+0000","last_clean":"2024-04-25T01:39:35.200300+0000","last_became_active":"2024-04-25T01:39:24.395958+0000","last_became_peered":"2024-04-25T01:39:24.395958+0000","last_unstale":"2024-04-25T01:39:35.200300+0000","last_undegraded":"2024-04-25T01:39:35.200300+0000","last_fullsized":"2024-04-25T01:39:35.200300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:54.898765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":690301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":101489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":99491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":102507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":101055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T01:39:38.388 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T01:39:38.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.535+0000 7fe2546bd640 1 Processor -- start 2024-04-25T01:39:38.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.535+0000 7fe2546bd640 1 -- start start 2024-04-25T01:39:38.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.536+0000 7fe2546bd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe24c150090 0x7fe24c156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:38.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.536+0000 7fe2546bd640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe24c0c8200 0x7fe24c0c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:38.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.536+0000 7fe2546bd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe24c0c9de0 con 0x7fe24c06c280 2024-04-25T01:39:38.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.536+0000 7fe2546bd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe24c06b830 con 0x7fe24c150090 2024-04-25T01:39:38.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.536+0000 7fe2546bd640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe24c0c89c0 con 0x7fe24c0c8200 2024-04-25T01:39:38.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.536+0000 7fe252459640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe24c150090 0x7fe24c156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:38.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.536+0000 7fe252c5a640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe24c06c280 0x7fe24c0c6320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41392/0 (socket says 172.21.15.77:41392) 2024-04-25T01:39:38.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.536+0000 7fe252c5a640 1 -- 172.21.15.77:0/3499675819 learned_addr learned my addr 172.21.15.77:0/3499675819 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:38.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.536+0000 7fe251c58640 1 --2- 172.21.15.77:0/3499675819 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe24c0c8200 0x7fe24c0c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:38.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.536+0000 7fe252459640 1 -- 172.21.15.77:0/3499675819 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe24c0c8200 msgr2=0x7fe24c0c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:38.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.536+0000 7fe252459640 1 --2- 172.21.15.77:0/3499675819 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe24c0c8200 0x7fe24c0c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.537+0000 7fe252459640 1 -- 172.21.15.77:0/3499675819 >> v1:172.21.15.77:6789/0 conn(0x7fe24c06c280 legacy=0x7fe24c0c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:38.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.537+0000 7fe252459640 1 -- 172.21.15.77:0/3499675819 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe24c0c8ca0 con 0x7fe24c150090 2024-04-25T01:39:38.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.537+0000 7fe251457640 1 -- 172.21.15.77:0/3499675819 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3144352677 0 0) 0x7fe24c0c9de0 con 0x7fe24c06c280 2024-04-25T01:39:38.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.537+0000 7fe251c58640 1 --2- 172.21.15.77:0/3499675819 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe24c0c8200 0x7fe24c0c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:38.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.537+0000 7fe252459640 1 --2- 172.21.15.77:0/3499675819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe24c150090 0x7fe24c156c80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe248009d90 tx=0x7fe24802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759fce0546a01efd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:38.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.537+0000 7fe251457640 1 -- 172.21.15.77:0/3499675819 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe248007740 con 0x7fe24c150090 2024-04-25T01:39:38.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.537+0000 7fe251457640 1 -- 172.21.15.77:0/3499675819 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2480078e0 con 0x7fe24c150090 2024-04-25T01:39:38.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.537+0000 7fe251457640 1 -- 172.21.15.77:0/3499675819 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe248007cb0 con 0x7fe24c150090 2024-04-25T01:39:38.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.538+0000 7fe2546bd640 1 -- 172.21.15.77:0/3499675819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe24c150090 msgr2=0x7fe24c156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:38.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.538+0000 7fe2546bd640 1 --2- 172.21.15.77:0/3499675819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe24c150090 0x7fe24c156c80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe248009d90 tx=0x7fe24802a660 comp rx=0 tx=0).stop 2024-04-25T01:39:38.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.538+0000 7fe2546bd640 1 -- 172.21.15.77:0/3499675819 shutdown_connections 2024-04-25T01:39:38.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.538+0000 7fe2546bd640 1 --2- 172.21.15.77:0/3499675819 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe24c0c8200 0x7fe24c0c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.538+0000 7fe2546bd640 1 --2- 172.21.15.77:0/3499675819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe24c150090 0x7fe24c156c80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.538+0000 7fe2546bd640 1 -- 172.21.15.77:0/3499675819 >> 172.21.15.77:0/3499675819 conn(0x7fe24c0ad4d0 msgr2=0x7fe24c0ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:38.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.538+0000 7fe2546bd640 1 -- 172.21.15.77:0/3499675819 shutdown_connections 2024-04-25T01:39:38.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.538+0000 7fe2546bd640 1 -- 172.21.15.77:0/3499675819 wait complete. 2024-04-25T01:39:38.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.539+0000 7fe2546bd640 1 Processor -- start 2024-04-25T01:39:38.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.539+0000 7fe2546bd640 1 -- start start 2024-04-25T01:39:38.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.540+0000 7fe2546bd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe24c06c280 0x7fe24c0c2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:38.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.540+0000 7fe2546bd640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe24c0c8200 0x7fe24c1ec5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:38.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.540+0000 7fe2546bd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe24c150090 0x7fe24c1ecae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:38.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.540+0000 7fe2546bd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe24c0c86b0 con 0x7fe24c06c280 2024-04-25T01:39:38.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.540+0000 7fe2546bd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe24c06bd60 con 0x7fe24c150090 2024-04-25T01:39:38.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.540+0000 7fe2546bd640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe24c0c6a30 con 0x7fe24c0c8200 2024-04-25T01:39:38.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.540+0000 7fe252459640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe24c06c280 0x7fe24c0c2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:38.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.540+0000 7fe252459640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe24c06c280 0x7fe24c0c2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46586/0 (socket says 172.21.15.77:46586) 2024-04-25T01:39:38.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.540+0000 7fe252459640 1 -- 172.21.15.77:0/864415772 learned_addr learned my addr 172.21.15.77:0/864415772 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:38.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.540+0000 7fe252459640 1 -- 172.21.15.77:0/864415772 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe24c0c8200 msgr2=0x7fe24c1ec5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:38.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.540+0000 7fe252459640 1 --2- 172.21.15.77:0/864415772 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe24c0c8200 0x7fe24c1ec5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.540+0000 7fe252459640 1 -- 172.21.15.77:0/864415772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe24c150090 msgr2=0x7fe24c1ecae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:38.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.540+0000 7fe252459640 1 --2- 172.21.15.77:0/864415772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe24c150090 0x7fe24c1ecae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.540+0000 7fe252459640 1 -- 172.21.15.77:0/864415772 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe24c1ec070 con 0x7fe24c06c280 2024-04-25T01:39:38.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.540+0000 7fe252459640 1 --2- 172.21.15.77:0/864415772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe24c06c280 0x7fe24c0c2ce0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe248009d90 tx=0x7fe248004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:38.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.540+0000 7fe242ffd640 1 -- 172.21.15.77:0/864415772 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe248040070 con 0x7fe24c06c280 2024-04-25T01:39:38.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.540+0000 7fe242ffd640 1 -- 172.21.15.77:0/864415772 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe248031c40 con 0x7fe24c06c280 2024-04-25T01:39:38.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.540+0000 7fe2546bd640 1 -- 172.21.15.77:0/864415772 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe24c0c4c90 con 0x7fe24c06c280 2024-04-25T01:39:38.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.540+0000 7fe242ffd640 1 -- 172.21.15.77:0/864415772 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24803c420 con 0x7fe24c06c280 2024-04-25T01:39:38.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.540+0000 7fe2546bd640 1 -- 172.21.15.77:0/864415772 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe24c0c5250 con 0x7fe24c06c280 2024-04-25T01:39:38.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.541+0000 7fe2546bd640 1 -- 172.21.15.77:0/864415772 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe24c068d20 con 0x7fe24c06c280 2024-04-25T01:39:38.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.542+0000 7fe242ffd640 1 -- 172.21.15.77:0/864415772 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe248039040 con 0x7fe24c06c280 2024-04-25T01:39:38.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.542+0000 7fe242ffd640 1 --2- 172.21.15.77:0/864415772 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe23006be30 0x7fe23006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:38.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.542+0000 7fe242ffd640 1 -- 172.21.15.77:0/864415772 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fe2480ac820 con 0x7fe24c06c280 2024-04-25T01:39:38.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.542+0000 7fe251c58640 1 --2- 172.21.15.77:0/864415772 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe23006be30 0x7fe23006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:38.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.543+0000 7fe251c58640 1 --2- 172.21.15.77:0/864415772 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe23006be30 0x7fe23006e2f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe23c006fd0 tx=0x7fe23c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:38.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.547+0000 7fe242ffd640 1 -- 172.21.15.77:0/864415772 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe24c068d20 con 0x7fe24c06c280 2024-04-25T01:39:38.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.718+0000 7fe2546bd640 1 -- 172.21.15.77:0/864415772 --> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe24c1ed020 con 0x7fe23006be30 2024-04-25T01:39:38.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.728+0000 7fe242ffd640 1 -- 172.21.15.77:0/864415772 <== mgr.4098 v2:172.21.15.77:6832/4208232183 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490417 (secure 0 0 0) 0x7fe24c1ed020 con 0x7fe23006be30 2024-04-25T01:39:38.716 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:38.720 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-25T01:39:38.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.732+0000 7fe2546bd640 1 -- 172.21.15.77:0/864415772 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe23006be30 msgr2=0x7fe23006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:38.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.732+0000 7fe2546bd640 1 --2- 172.21.15.77:0/864415772 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe23006be30 0x7fe23006e2f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe23c006fd0 tx=0x7fe23c008040 comp rx=0 tx=0).stop 2024-04-25T01:39:38.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.732+0000 7fe2546bd640 1 -- 172.21.15.77:0/864415772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe24c06c280 msgr2=0x7fe24c0c2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:38.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.732+0000 7fe2546bd640 1 --2- 172.21.15.77:0/864415772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe24c06c280 0x7fe24c0c2ce0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe248009d90 tx=0x7fe248004a40 comp rx=0 tx=0).stop 2024-04-25T01:39:38.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.732+0000 7fe2546bd640 1 -- 172.21.15.77:0/864415772 shutdown_connections 2024-04-25T01:39:38.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.732+0000 7fe2546bd640 1 --2- 172.21.15.77:0/864415772 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe23006be30 0x7fe23006e2f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.732+0000 7fe2546bd640 1 --2- 172.21.15.77:0/864415772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe24c150090 0x7fe24c1ecae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.732+0000 7fe2546bd640 1 --2- 172.21.15.77:0/864415772 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe24c0c8200 0x7fe24c1ec5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.732+0000 7fe2546bd640 1 --2- 172.21.15.77:0/864415772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe24c06c280 0x7fe24c0c2ce0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.732+0000 7fe2546bd640 1 -- 172.21.15.77:0/864415772 >> 172.21.15.77:0/864415772 conn(0x7fe24c0ad4d0 msgr2=0x7fe24c1559c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:38.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.732+0000 7fe2546bd640 1 -- 172.21.15.77:0/864415772 shutdown_connections 2024-04-25T01:39:38.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.732+0000 7fe2546bd640 1 -- 172.21.15.77:0/864415772 wait complete. 2024-04-25T01:39:38.726 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-04-25T01:39:37.653338+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":249,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":341,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219460,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755260,"statfs":{"total":773094113280,"available":772869386240,"internally_reserved":0,"allocated":3350528,"data_stored":1984464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000986"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197412+0000","last_change":"2024-04-25T01:39:33.445614+0000","last_active":"2024-04-25T01:39:35.197412+0000","last_peered":"2024-04-25T01:39:35.197412+0000","last_clean":"2024-04-25T01:39:35.197412+0000","last_became_active":"2024-04-25T01:39:33.445090+0000","last_became_peered":"2024-04-25T01:39:33.445090+0000","last_unstale":"2024-04-25T01:39:35.197412+0000","last_undegraded":"2024-04-25T01:39:35.197412+0000","last_fullsized":"2024-04-25T01:39:35.197412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:50.951488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559582+0000","last_change":"2024-04-25T01:39:23.377096+0000","last_active":"2024-04-25T01:39:34.559582+0000","last_peered":"2024-04-25T01:39:34.559582+0000","last_clean":"2024-04-25T01:39:34.559582+0000","last_became_active":"2024-04-25T01:39:23.376811+0000","last_became_peered":"2024-04-25T01:39:23.376811+0000","last_unstale":"2024-04-25T01:39:34.559582+0000","last_undegraded":"2024-04-25T01:39:34.559582+0000","last_fullsized":"2024-04-25T01:39:34.559582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:26.888605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430280+0000","last_change":"2024-04-25T01:39:24.394317+0000","last_active":"2024-04-25T01:39:34.430280+0000","last_peered":"2024-04-25T01:39:34.430280+0000","last_clean":"2024-04-25T01:39:34.430280+0000","last_became_active":"2024-04-25T01:39:24.394032+0000","last_became_peered":"2024-04-25T01:39:24.394032+0000","last_unstale":"2024-04-25T01:39:34.430280+0000","last_undegraded":"2024-04-25T01:39:34.430280+0000","last_fullsized":"2024-04-25T01:39:34.430280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:11.795443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429310+0000","last_change":"2024-04-25T01:39:32.421607+0000","last_active":"2024-04-25T01:39:34.429310+0000","last_peered":"2024-04-25T01:39:34.429310+0000","last_clean":"2024-04-25T01:39:34.429310+0000","last_became_active":"2024-04-25T01:39:32.421355+0000","last_became_peered":"2024-04-25T01:39:32.421355+0000","last_unstale":"2024-04-25T01:39:34.429310+0000","last_undegraded":"2024-04-25T01:39:34.429310+0000","last_fullsized":"2024-04-25T01:39:34.429310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:12:14.019262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198433+0000","last_change":"2024-04-25T01:39:33.436651+0000","last_active":"2024-04-25T01:39:35.198433+0000","last_peered":"2024-04-25T01:39:35.198433+0000","last_clean":"2024-04-25T01:39:35.198433+0000","last_became_active":"2024-04-25T01:39:33.436370+0000","last_became_peered":"2024-04-25T01:39:33.436370+0000","last_unstale":"2024-04-25T01:39:35.198433+0000","last_undegraded":"2024-04-25T01:39:35.198433+0000","last_fullsized":"2024-04-25T01:39:35.198433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:57:10.341738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430287+0000","last_change":"2024-04-25T01:39:23.369400+0000","last_active":"2024-04-25T01:39:34.430287+0000","last_peered":"2024-04-25T01:39:34.430287+0000","last_clean":"2024-04-25T01:39:34.430287+0000","last_became_active":"2024-04-25T01:39:23.368726+0000","last_became_peered":"2024-04-25T01:39:23.368726+0000","last_unstale":"2024-04-25T01:39:34.430287+0000","last_undegraded":"2024-04-25T01:39:34.430287+0000","last_fullsized":"2024-04-25T01:39:34.430287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:35:42.971179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559440+0000","last_change":"2024-04-25T01:39:24.403873+0000","last_active":"2024-04-25T01:39:34.559440+0000","last_peered":"2024-04-25T01:39:34.559440+0000","last_clean":"2024-04-25T01:39:34.559440+0000","last_became_active":"2024-04-25T01:39:24.403623+0000","last_became_peered":"2024-04-25T01:39:24.403623+0000","last_unstale":"2024-04-25T01:39:34.559440+0000","last_undegraded":"2024-04-25T01:39:34.559440+0000","last_fullsized":"2024-04-25T01:39:34.559440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:49.360933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197343+0000","last_change":"2024-04-25T01:39:32.430985+0000","last_active":"2024-04-25T01:39:35.197343+0000","last_peered":"2024-04-25T01:39:35.197343+0000","last_clean":"2024-04-25T01:39:35.197343+0000","last_became_active":"2024-04-25T01:39:32.430617+0000","last_became_peered":"2024-04-25T01:39:32.430617+0000","last_unstale":"2024-04-25T01:39:35.197343+0000","last_undegraded":"2024-04-25T01:39:35.197343+0000","last_fullsized":"2024-04-25T01:39:35.197343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:13.938619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199408+0000","last_change":"2024-04-25T01:39:33.444043+0000","last_active":"2024-04-25T01:39:35.199408+0000","last_peered":"2024-04-25T01:39:35.199408+0000","last_clean":"2024-04-25T01:39:35.199408+0000","last_became_active":"2024-04-25T01:39:33.443737+0000","last_became_peered":"2024-04-25T01:39:33.443737+0000","last_unstale":"2024-04-25T01:39:35.199408+0000","last_undegraded":"2024-04-25T01:39:35.199408+0000","last_fullsized":"2024-04-25T01:39:35.199408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:02:50.401910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199857+0000","last_change":"2024-04-25T01:39:23.377963+0000","last_active":"2024-04-25T01:39:35.199857+0000","last_peered":"2024-04-25T01:39:35.199857+0000","last_clean":"2024-04-25T01:39:35.199857+0000","last_became_active":"2024-04-25T01:39:23.377402+0000","last_became_peered":"2024-04-25T01:39:23.377402+0000","last_unstale":"2024-04-25T01:39:35.199857+0000","last_undegraded":"2024-04-25T01:39:35.199857+0000","last_fullsized":"2024-04-25T01:39:35.199857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:15.873450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199352+0000","last_change":"2024-04-25T01:39:24.394512+0000","last_active":"2024-04-25T01:39:35.199352+0000","last_peered":"2024-04-25T01:39:35.199352+0000","last_clean":"2024-04-25T01:39:35.199352+0000","last_became_active":"2024-04-25T01:39:24.393954+0000","last_became_peered":"2024-04-25T01:39:24.393954+0000","last_unstale":"2024-04-25T01:39:35.199352+0000","last_undegraded":"2024-04-25T01:39:35.199352+0000","last_fullsized":"2024-04-25T01:39:35.199352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:30.534400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197850+0000","last_change":"2024-04-25T01:39:32.428198+0000","last_active":"2024-04-25T01:39:35.197850+0000","last_peered":"2024-04-25T01:39:35.197850+0000","last_clean":"2024-04-25T01:39:35.197850+0000","last_became_active":"2024-04-25T01:39:32.427955+0000","last_became_peered":"2024-04-25T01:39:32.427955+0000","last_unstale":"2024-04-25T01:39:35.197850+0000","last_undegraded":"2024-04-25T01:39:35.197850+0000","last_fullsized":"2024-04-25T01:39:35.197850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:07.684150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198064+0000","last_change":"2024-04-25T01:39:33.439854+0000","last_active":"2024-04-25T01:39:35.198064+0000","last_peered":"2024-04-25T01:39:35.198064+0000","last_clean":"2024-04-25T01:39:35.198064+0000","last_became_active":"2024-04-25T01:39:33.439555+0000","last_became_peered":"2024-04-25T01:39:33.439555+0000","last_unstale":"2024-04-25T01:39:35.198064+0000","last_undegraded":"2024-04-25T01:39:35.198064+0000","last_fullsized":"2024-04-25T01:39:35.198064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:50.250748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198904+0000","last_change":"2024-04-25T01:39:23.377093+0000","last_active":"2024-04-25T01:39:35.198904+0000","last_peered":"2024-04-25T01:39:35.198904+0000","last_clean":"2024-04-25T01:39:35.198904+0000","last_became_active":"2024-04-25T01:39:23.376744+0000","last_became_peered":"2024-04-25T01:39:23.376744+0000","last_unstale":"2024-04-25T01:39:35.198904+0000","last_undegraded":"2024-04-25T01:39:35.198904+0000","last_fullsized":"2024-04-25T01:39:35.198904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:43.529618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200129+0000","last_change":"2024-04-25T01:39:24.393293+0000","last_active":"2024-04-25T01:39:35.200129+0000","last_peered":"2024-04-25T01:39:35.200129+0000","last_clean":"2024-04-25T01:39:35.200129+0000","last_became_active":"2024-04-25T01:39:24.393005+0000","last_became_peered":"2024-04-25T01:39:24.393005+0000","last_unstale":"2024-04-25T01:39:35.200129+0000","last_undegraded":"2024-04-25T01:39:35.200129+0000","last_fullsized":"2024-04-25T01:39:35.200129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:32.070747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197654+0000","last_change":"2024-04-25T01:39:32.428956+0000","last_active":"2024-04-25T01:39:35.197654+0000","last_peered":"2024-04-25T01:39:35.197654+0000","last_clean":"2024-04-25T01:39:35.197654+0000","last_became_active":"2024-04-25T01:39:32.428705+0000","last_became_peered":"2024-04-25T01:39:32.428705+0000","last_unstale":"2024-04-25T01:39:35.197654+0000","last_undegraded":"2024-04-25T01:39:35.197654+0000","last_fullsized":"2024-04-25T01:39:35.197654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:06:22.998986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198197+0000","last_change":"2024-04-25T01:39:33.446571+0000","last_active":"2024-04-25T01:39:35.198197+0000","last_peered":"2024-04-25T01:39:35.198197+0000","last_clean":"2024-04-25T01:39:35.198197+0000","last_became_active":"2024-04-25T01:39:33.446234+0000","last_became_peered":"2024-04-25T01:39:33.446234+0000","last_unstale":"2024-04-25T01:39:35.198197+0000","last_undegraded":"2024-04-25T01:39:35.198197+0000","last_fullsized":"2024-04-25T01:39:35.198197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:12.742092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434733+0000","last_change":"2024-04-25T01:39:24.398859+0000","last_active":"2024-04-25T01:39:34.434733+0000","last_peered":"2024-04-25T01:39:34.434733+0000","last_clean":"2024-04-25T01:39:34.434733+0000","last_became_active":"2024-04-25T01:39:24.398618+0000","last_became_peered":"2024-04-25T01:39:24.398618+0000","last_unstale":"2024-04-25T01:39:34.434733+0000","last_undegraded":"2024-04-25T01:39:34.434733+0000","last_fullsized":"2024-04-25T01:39:34.434733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:15.278376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199208+0000","last_change":"2024-04-25T01:39:23.377717+0000","last_active":"2024-04-25T01:39:35.199208+0000","last_peered":"2024-04-25T01:39:35.199208+0000","last_clean":"2024-04-25T01:39:35.199208+0000","last_became_active":"2024-04-25T01:39:23.377291+0000","last_became_peered":"2024-04-25T01:39:23.377291+0000","last_unstale":"2024-04-25T01:39:35.199208+0000","last_undegraded":"2024-04-25T01:39:35.199208+0000","last_fullsized":"2024-04-25T01:39:35.199208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:06.402745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197947+0000","last_change":"2024-04-25T01:39:32.426840+0000","last_active":"2024-04-25T01:39:35.197947+0000","last_peered":"2024-04-25T01:39:35.197947+0000","last_clean":"2024-04-25T01:39:35.197947+0000","last_became_active":"2024-04-25T01:39:32.426529+0000","last_became_peered":"2024-04-25T01:39:32.426529+0000","last_unstale":"2024-04-25T01:39:35.197947+0000","last_undegraded":"2024-04-25T01:39:35.197947+0000","last_fullsized":"2024-04-25T01:39:35.197947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:57.097685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198092+0000","last_change":"2024-04-25T01:39:33.437767+0000","last_active":"2024-04-25T01:39:35.198092+0000","last_peered":"2024-04-25T01:39:35.198092+0000","last_clean":"2024-04-25T01:39:35.198092+0000","last_became_active":"2024-04-25T01:39:33.437483+0000","last_became_peered":"2024-04-25T01:39:33.437483+0000","last_unstale":"2024-04-25T01:39:35.198092+0000","last_undegraded":"2024-04-25T01:39:35.198092+0000","last_fullsized":"2024-04-25T01:39:35.198092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:44.321779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429750+0000","last_change":"2024-04-25T01:39:24.387100+0000","last_active":"2024-04-25T01:39:34.429750+0000","last_peered":"2024-04-25T01:39:34.429750+0000","last_clean":"2024-04-25T01:39:34.429750+0000","last_became_active":"2024-04-25T01:39:24.386782+0000","last_became_peered":"2024-04-25T01:39:24.386782+0000","last_unstale":"2024-04-25T01:39:34.429750+0000","last_undegraded":"2024-04-25T01:39:34.429750+0000","last_fullsized":"2024-04-25T01:39:34.429750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:48.789139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198800+0000","last_change":"2024-04-25T01:39:23.368446+0000","last_active":"2024-04-25T01:39:35.198800+0000","last_peered":"2024-04-25T01:39:35.198800+0000","last_clean":"2024-04-25T01:39:35.198800+0000","last_became_active":"2024-04-25T01:39:23.368183+0000","last_became_peered":"2024-04-25T01:39:23.368183+0000","last_unstale":"2024-04-25T01:39:35.198800+0000","last_undegraded":"2024-04-25T01:39:35.198800+0000","last_fullsized":"2024-04-25T01:39:35.198800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:13.738756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198383+0000","last_change":"2024-04-25T01:39:32.427589+0000","last_active":"2024-04-25T01:39:35.198383+0000","last_peered":"2024-04-25T01:39:35.198383+0000","last_clean":"2024-04-25T01:39:35.198383+0000","last_became_active":"2024-04-25T01:39:32.427328+0000","last_became_peered":"2024-04-25T01:39:32.427328+0000","last_unstale":"2024-04-25T01:39:35.198383+0000","last_undegraded":"2024-04-25T01:39:35.198383+0000","last_fullsized":"2024-04-25T01:39:35.198383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:12.328303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199145+0000","last_change":"2024-04-25T01:39:33.447634+0000","last_active":"2024-04-25T01:39:35.199145+0000","last_peered":"2024-04-25T01:39:35.199145+0000","last_clean":"2024-04-25T01:39:35.199145+0000","last_became_active":"2024-04-25T01:39:33.445908+0000","last_became_peered":"2024-04-25T01:39:33.445908+0000","last_unstale":"2024-04-25T01:39:35.199145+0000","last_undegraded":"2024-04-25T01:39:35.199145+0000","last_fullsized":"2024-04-25T01:39:35.199145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:13.586396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429559+0000","last_change":"2024-04-25T01:39:24.373600+0000","last_active":"2024-04-25T01:39:34.429559+0000","last_peered":"2024-04-25T01:39:34.429559+0000","last_clean":"2024-04-25T01:39:34.429559+0000","last_became_active":"2024-04-25T01:39:24.373311+0000","last_became_peered":"2024-04-25T01:39:24.373311+0000","last_unstale":"2024-04-25T01:39:34.429559+0000","last_undegraded":"2024-04-25T01:39:34.429559+0000","last_fullsized":"2024-04-25T01:39:34.429559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:46.338959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197953+0000","last_change":"2024-04-25T01:39:23.377103+0000","last_active":"2024-04-25T01:39:35.197953+0000","last_peered":"2024-04-25T01:39:35.197953+0000","last_clean":"2024-04-25T01:39:35.197953+0000","last_became_active":"2024-04-25T01:39:23.376826+0000","last_became_peered":"2024-04-25T01:39:23.376826+0000","last_unstale":"2024-04-25T01:39:35.197953+0000","last_undegraded":"2024-04-25T01:39:35.197953+0000","last_fullsized":"2024-04-25T01:39:35.197953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:46.663754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198643+0000","last_change":"2024-04-25T01:39:32.426839+0000","last_active":"2024-04-25T01:39:35.198643+0000","last_peered":"2024-04-25T01:39:35.198643+0000","last_clean":"2024-04-25T01:39:35.198643+0000","last_became_active":"2024-04-25T01:39:32.426545+0000","last_became_peered":"2024-04-25T01:39:32.426545+0000","last_unstale":"2024-04-25T01:39:35.198643+0000","last_undegraded":"2024-04-25T01:39:35.198643+0000","last_fullsized":"2024-04-25T01:39:35.198643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:22.161839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199023+0000","last_change":"2024-04-25T01:39:33.444616+0000","last_active":"2024-04-25T01:39:35.199023+0000","last_peered":"2024-04-25T01:39:35.199023+0000","last_clean":"2024-04-25T01:39:35.199023+0000","last_became_active":"2024-04-25T01:39:33.444350+0000","last_became_peered":"2024-04-25T01:39:33.444350+0000","last_unstale":"2024-04-25T01:39:35.199023+0000","last_undegraded":"2024-04-25T01:39:35.199023+0000","last_fullsized":"2024-04-25T01:39:35.199023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:47:15.686320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198460+0000","last_change":"2024-04-25T01:39:24.386969+0000","last_active":"2024-04-25T01:39:35.198460+0000","last_peered":"2024-04-25T01:39:35.198460+0000","last_clean":"2024-04-25T01:39:35.198460+0000","last_became_active":"2024-04-25T01:39:24.386376+0000","last_became_peered":"2024-04-25T01:39:24.386376+0000","last_unstale":"2024-04-25T01:39:35.198460+0000","last_undegraded":"2024-04-25T01:39:35.198460+0000","last_fullsized":"2024-04-25T01:39:35.198460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:13:31.585462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198150+0000","last_change":"2024-04-25T01:39:23.378993+0000","last_active":"2024-04-25T01:39:35.198150+0000","last_peered":"2024-04-25T01:39:35.198150+0000","last_clean":"2024-04-25T01:39:35.198150+0000","last_became_active":"2024-04-25T01:39:23.376908+0000","last_became_peered":"2024-04-25T01:39:23.376908+0000","last_unstale":"2024-04-25T01:39:35.198150+0000","last_undegraded":"2024-04-25T01:39:35.198150+0000","last_fullsized":"2024-04-25T01:39:35.198150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:13:18.370559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199153+0000","last_change":"2024-04-25T01:39:32.433597+0000","last_active":"2024-04-25T01:39:35.199153+0000","last_peered":"2024-04-25T01:39:35.199153+0000","last_clean":"2024-04-25T01:39:35.199153+0000","last_became_active":"2024-04-25T01:39:32.433307+0000","last_became_peered":"2024-04-25T01:39:32.433307+0000","last_unstale":"2024-04-25T01:39:35.199153+0000","last_undegraded":"2024-04-25T01:39:35.199153+0000","last_fullsized":"2024-04-25T01:39:35.199153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:20.784385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429204+0000","last_change":"2024-04-25T01:39:33.427297+0000","last_active":"2024-04-25T01:39:34.429204+0000","last_peered":"2024-04-25T01:39:34.429204+0000","last_clean":"2024-04-25T01:39:34.429204+0000","last_became_active":"2024-04-25T01:39:33.426132+0000","last_became_peered":"2024-04-25T01:39:33.426132+0000","last_unstale":"2024-04-25T01:39:34.429204+0000","last_undegraded":"2024-04-25T01:39:34.429204+0000","last_fullsized":"2024-04-25T01:39:34.429204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:04.147341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559652+0000","last_change":"2024-04-25T01:39:24.393003+0000","last_active":"2024-04-25T01:39:34.559652+0000","last_peered":"2024-04-25T01:39:34.559652+0000","last_clean":"2024-04-25T01:39:34.559652+0000","last_became_active":"2024-04-25T01:39:24.392209+0000","last_became_peered":"2024-04-25T01:39:24.392209+0000","last_unstale":"2024-04-25T01:39:34.559652+0000","last_undegraded":"2024-04-25T01:39:34.559652+0000","last_fullsized":"2024-04-25T01:39:34.559652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:44:58.432859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434880+0000","last_change":"2024-04-25T01:39:23.379804+0000","last_active":"2024-04-25T01:39:34.434880+0000","last_peered":"2024-04-25T01:39:34.434880+0000","last_clean":"2024-04-25T01:39:34.434880+0000","last_became_active":"2024-04-25T01:39:23.379430+0000","last_became_peered":"2024-04-25T01:39:23.379430+0000","last_unstale":"2024-04-25T01:39:34.434880+0000","last_undegraded":"2024-04-25T01:39:34.434880+0000","last_fullsized":"2024-04-25T01:39:34.434880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:42:23.254767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198196+0000","last_change":"2024-04-25T01:39:32.432763+0000","last_active":"2024-04-25T01:39:35.198196+0000","last_peered":"2024-04-25T01:39:35.198196+0000","last_clean":"2024-04-25T01:39:35.198196+0000","last_became_active":"2024-04-25T01:39:32.432482+0000","last_became_peered":"2024-04-25T01:39:32.432482+0000","last_unstale":"2024-04-25T01:39:35.198196+0000","last_undegraded":"2024-04-25T01:39:35.198196+0000","last_fullsized":"2024-04-25T01:39:35.198196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:04.848726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197990+0000","last_change":"2024-04-25T01:39:33.445800+0000","last_active":"2024-04-25T01:39:35.197990+0000","last_peered":"2024-04-25T01:39:35.197990+0000","last_clean":"2024-04-25T01:39:35.197990+0000","last_became_active":"2024-04-25T01:39:33.445500+0000","last_became_peered":"2024-04-25T01:39:33.445500+0000","last_unstale":"2024-04-25T01:39:35.197990+0000","last_undegraded":"2024-04-25T01:39:35.197990+0000","last_fullsized":"2024-04-25T01:39:35.197990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:06:36.800043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430196+0000","last_change":"2024-04-25T01:39:24.375811+0000","last_active":"2024-04-25T01:39:34.430196+0000","last_peered":"2024-04-25T01:39:34.430196+0000","last_clean":"2024-04-25T01:39:34.430196+0000","last_became_active":"2024-04-25T01:39:24.375603+0000","last_became_peered":"2024-04-25T01:39:24.375603+0000","last_unstale":"2024-04-25T01:39:34.430196+0000","last_undegraded":"2024-04-25T01:39:34.430196+0000","last_fullsized":"2024-04-25T01:39:34.430196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:10:26.247501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198161+0000","last_change":"2024-04-25T01:39:23.377687+0000","last_active":"2024-04-25T01:39:35.198161+0000","last_peered":"2024-04-25T01:39:35.198161+0000","last_clean":"2024-04-25T01:39:35.198161+0000","last_became_active":"2024-04-25T01:39:23.377372+0000","last_became_peered":"2024-04-25T01:39:23.377372+0000","last_unstale":"2024-04-25T01:39:35.198161+0000","last_undegraded":"2024-04-25T01:39:35.198161+0000","last_fullsized":"2024-04-25T01:39:35.198161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:51.983659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429145+0000","last_change":"2024-04-25T01:39:32.430816+0000","last_active":"2024-04-25T01:39:34.429145+0000","last_peered":"2024-04-25T01:39:34.429145+0000","last_clean":"2024-04-25T01:39:34.429145+0000","last_became_active":"2024-04-25T01:39:32.430537+0000","last_became_peered":"2024-04-25T01:39:32.430537+0000","last_unstale":"2024-04-25T01:39:34.429145+0000","last_undegraded":"2024-04-25T01:39:34.429145+0000","last_fullsized":"2024-04-25T01:39:34.429145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:58.939453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434436+0000","last_change":"2024-04-25T01:39:33.440287+0000","last_active":"2024-04-25T01:39:34.434436+0000","last_peered":"2024-04-25T01:39:34.434436+0000","last_clean":"2024-04-25T01:39:34.434436+0000","last_became_active":"2024-04-25T01:39:33.439796+0000","last_became_peered":"2024-04-25T01:39:33.439796+0000","last_unstale":"2024-04-25T01:39:34.434436+0000","last_undegraded":"2024-04-25T01:39:34.434436+0000","last_fullsized":"2024-04-25T01:39:34.434436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:08.515401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198342+0000","last_change":"2024-04-25T01:39:24.376933+0000","last_active":"2024-04-25T01:39:35.198342+0000","last_peered":"2024-04-25T01:39:35.198342+0000","last_clean":"2024-04-25T01:39:35.198342+0000","last_became_active":"2024-04-25T01:39:24.376612+0000","last_became_peered":"2024-04-25T01:39:24.376612+0000","last_unstale":"2024-04-25T01:39:35.198342+0000","last_undegraded":"2024-04-25T01:39:35.198342+0000","last_fullsized":"2024-04-25T01:39:35.198342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:56:55.534200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199969+0000","last_change":"2024-04-25T01:39:23.378190+0000","last_active":"2024-04-25T01:39:35.199969+0000","last_peered":"2024-04-25T01:39:35.199969+0000","last_clean":"2024-04-25T01:39:35.199969+0000","last_became_active":"2024-04-25T01:39:23.377677+0000","last_became_peered":"2024-04-25T01:39:23.377677+0000","last_unstale":"2024-04-25T01:39:35.199969+0000","last_undegraded":"2024-04-25T01:39:35.199969+0000","last_fullsized":"2024-04-25T01:39:35.199969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:09.516058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559452+0000","last_change":"2024-04-25T01:39:32.431542+0000","last_active":"2024-04-25T01:39:34.559452+0000","last_peered":"2024-04-25T01:39:34.559452+0000","last_clean":"2024-04-25T01:39:34.559452+0000","last_became_active":"2024-04-25T01:39:32.431253+0000","last_became_peered":"2024-04-25T01:39:32.431253+0000","last_unstale":"2024-04-25T01:39:34.559452+0000","last_undegraded":"2024-04-25T01:39:34.559452+0000","last_fullsized":"2024-04-25T01:39:34.559452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:36.723239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559765+0000","last_change":"2024-04-25T01:39:33.448529+0000","last_active":"2024-04-25T01:39:34.559765+0000","last_peered":"2024-04-25T01:39:34.559765+0000","last_clean":"2024-04-25T01:39:34.559765+0000","last_became_active":"2024-04-25T01:39:33.448266+0000","last_became_peered":"2024-04-25T01:39:33.448266+0000","last_unstale":"2024-04-25T01:39:34.559765+0000","last_undegraded":"2024-04-25T01:39:34.559765+0000","last_fullsized":"2024-04-25T01:39:34.559765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:18.788470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200112+0000","last_change":"2024-04-25T01:39:24.390844+0000","last_active":"2024-04-25T01:39:35.200112+0000","last_peered":"2024-04-25T01:39:35.200112+0000","last_clean":"2024-04-25T01:39:35.200112+0000","last_became_active":"2024-04-25T01:39:24.390543+0000","last_became_peered":"2024-04-25T01:39:24.390543+0000","last_unstale":"2024-04-25T01:39:35.200112+0000","last_undegraded":"2024-04-25T01:39:35.200112+0000","last_fullsized":"2024-04-25T01:39:35.200112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:01:03.804058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198467+0000","last_change":"2024-04-25T01:39:23.368562+0000","last_active":"2024-04-25T01:39:35.198467+0000","last_peered":"2024-04-25T01:39:35.198467+0000","last_clean":"2024-04-25T01:39:35.198467+0000","last_became_active":"2024-04-25T01:39:23.368272+0000","last_became_peered":"2024-04-25T01:39:23.368272+0000","last_unstale":"2024-04-25T01:39:35.198467+0000","last_undegraded":"2024-04-25T01:39:35.198467+0000","last_fullsized":"2024-04-25T01:39:35.198467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:15.464993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198483+0000","last_change":"2024-04-25T01:39:32.430196+0000","last_active":"2024-04-25T01:39:35.198483+0000","last_peered":"2024-04-25T01:39:35.198483+0000","last_clean":"2024-04-25T01:39:35.198483+0000","last_became_active":"2024-04-25T01:39:32.429759+0000","last_became_peered":"2024-04-25T01:39:32.429759+0000","last_unstale":"2024-04-25T01:39:35.198483+0000","last_undegraded":"2024-04-25T01:39:35.198483+0000","last_fullsized":"2024-04-25T01:39:35.198483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:58:09.299194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559415+0000","last_change":"2024-04-25T01:39:33.440935+0000","last_active":"2024-04-25T01:39:34.559415+0000","last_peered":"2024-04-25T01:39:34.559415+0000","last_clean":"2024-04-25T01:39:34.559415+0000","last_became_active":"2024-04-25T01:39:33.439344+0000","last_became_peered":"2024-04-25T01:39:33.439344+0000","last_unstale":"2024-04-25T01:39:34.559415+0000","last_undegraded":"2024-04-25T01:39:34.559415+0000","last_fullsized":"2024-04-25T01:39:34.559415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:23.928991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199059+0000","last_change":"2024-04-25T01:39:24.389203+0000","last_active":"2024-04-25T01:39:35.199059+0000","last_peered":"2024-04-25T01:39:35.199059+0000","last_clean":"2024-04-25T01:39:35.199059+0000","last_became_active":"2024-04-25T01:39:24.388306+0000","last_became_peered":"2024-04-25T01:39:24.388306+0000","last_unstale":"2024-04-25T01:39:35.199059+0000","last_undegraded":"2024-04-25T01:39:35.199059+0000","last_fullsized":"2024-04-25T01:39:35.199059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:59:33.951161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198256+0000","last_change":"2024-04-25T01:39:23.375729+0000","last_active":"2024-04-25T01:39:35.198256+0000","last_peered":"2024-04-25T01:39:35.198256+0000","last_clean":"2024-04-25T01:39:35.198256+0000","last_became_active":"2024-04-25T01:39:23.375488+0000","last_became_peered":"2024-04-25T01:39:23.375488+0000","last_unstale":"2024-04-25T01:39:35.198256+0000","last_undegraded":"2024-04-25T01:39:35.198256+0000","last_fullsized":"2024-04-25T01:39:35.198256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:00.039083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198302+0000","last_change":"2024-04-25T01:39:32.427586+0000","last_active":"2024-04-25T01:39:35.198302+0000","last_peered":"2024-04-25T01:39:35.198302+0000","last_clean":"2024-04-25T01:39:35.198302+0000","last_became_active":"2024-04-25T01:39:32.427282+0000","last_became_peered":"2024-04-25T01:39:32.427282+0000","last_unstale":"2024-04-25T01:39:35.198302+0000","last_undegraded":"2024-04-25T01:39:35.198302+0000","last_fullsized":"2024-04-25T01:39:35.198302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:35.956279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197828+0000","last_change":"2024-04-25T01:39:33.438949+0000","last_active":"2024-04-25T01:39:35.197828+0000","last_peered":"2024-04-25T01:39:35.197828+0000","last_clean":"2024-04-25T01:39:35.197828+0000","last_became_active":"2024-04-25T01:39:33.438669+0000","last_became_peered":"2024-04-25T01:39:33.438669+0000","last_unstale":"2024-04-25T01:39:35.197828+0000","last_undegraded":"2024-04-25T01:39:35.197828+0000","last_fullsized":"2024-04-25T01:39:35.197828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:07.849060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197529+0000","last_change":"2024-04-25T01:39:24.377438+0000","last_active":"2024-04-25T01:39:35.197529+0000","last_peered":"2024-04-25T01:39:35.197529+0000","last_clean":"2024-04-25T01:39:35.197529+0000","last_became_active":"2024-04-25T01:39:24.377146+0000","last_became_peered":"2024-04-25T01:39:24.377146+0000","last_unstale":"2024-04-25T01:39:35.197529+0000","last_undegraded":"2024-04-25T01:39:35.197529+0000","last_fullsized":"2024-04-25T01:39:35.197529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:54:17.698561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198084+0000","last_change":"2024-04-25T01:39:23.371019+0000","last_active":"2024-04-25T01:39:35.198084+0000","last_peered":"2024-04-25T01:39:35.198084+0000","last_clean":"2024-04-25T01:39:35.198084+0000","last_became_active":"2024-04-25T01:39:23.370727+0000","last_became_peered":"2024-04-25T01:39:23.370727+0000","last_unstale":"2024-04-25T01:39:35.198084+0000","last_undegraded":"2024-04-25T01:39:35.198084+0000","last_fullsized":"2024-04-25T01:39:35.198084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:10.714475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198753+0000","last_change":"2024-04-25T01:39:32.431610+0000","last_active":"2024-04-25T01:39:35.198753+0000","last_peered":"2024-04-25T01:39:35.198753+0000","last_clean":"2024-04-25T01:39:35.198753+0000","last_became_active":"2024-04-25T01:39:32.431335+0000","last_became_peered":"2024-04-25T01:39:32.431335+0000","last_unstale":"2024-04-25T01:39:35.198753+0000","last_undegraded":"2024-04-25T01:39:35.198753+0000","last_fullsized":"2024-04-25T01:39:35.198753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:54.882078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199183+0000","last_change":"2024-04-25T01:39:33.438896+0000","last_active":"2024-04-25T01:39:35.199183+0000","last_peered":"2024-04-25T01:39:35.199183+0000","last_clean":"2024-04-25T01:39:35.199183+0000","last_became_active":"2024-04-25T01:39:33.438622+0000","last_became_peered":"2024-04-25T01:39:33.438622+0000","last_unstale":"2024-04-25T01:39:35.199183+0000","last_undegraded":"2024-04-25T01:39:35.199183+0000","last_fullsized":"2024-04-25T01:39:35.199183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:40:47.408809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559149+0000","last_change":"2024-04-25T01:39:24.391366+0000","last_active":"2024-04-25T01:39:34.559149+0000","last_peered":"2024-04-25T01:39:34.559149+0000","last_clean":"2024-04-25T01:39:34.559149+0000","last_became_active":"2024-04-25T01:39:24.391093+0000","last_became_peered":"2024-04-25T01:39:24.391093+0000","last_unstale":"2024-04-25T01:39:34.559149+0000","last_undegraded":"2024-04-25T01:39:34.559149+0000","last_fullsized":"2024-04-25T01:39:34.559149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:10.906935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198243+0000","last_change":"2024-04-25T01:39:23.379767+0000","last_active":"2024-04-25T01:39:35.198243+0000","last_peered":"2024-04-25T01:39:35.198243+0000","last_clean":"2024-04-25T01:39:35.198243+0000","last_became_active":"2024-04-25T01:39:23.379294+0000","last_became_peered":"2024-04-25T01:39:23.379294+0000","last_unstale":"2024-04-25T01:39:35.198243+0000","last_undegraded":"2024-04-25T01:39:35.198243+0000","last_fullsized":"2024-04-25T01:39:35.198243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:36:37.823796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559671+0000","last_change":"2024-04-25T01:39:32.429452+0000","last_active":"2024-04-25T01:39:34.559671+0000","last_peered":"2024-04-25T01:39:34.559671+0000","last_clean":"2024-04-25T01:39:34.559671+0000","last_became_active":"2024-04-25T01:39:32.429189+0000","last_became_peered":"2024-04-25T01:39:32.429189+0000","last_unstale":"2024-04-25T01:39:34.559671+0000","last_undegraded":"2024-04-25T01:39:34.559671+0000","last_fullsized":"2024-04-25T01:39:34.559671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:58:02.723851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198704+0000","last_change":"2024-04-25T01:39:33.438945+0000","last_active":"2024-04-25T01:39:35.198704+0000","last_peered":"2024-04-25T01:39:35.198704+0000","last_clean":"2024-04-25T01:39:35.198704+0000","last_became_active":"2024-04-25T01:39:33.438233+0000","last_became_peered":"2024-04-25T01:39:33.438233+0000","last_unstale":"2024-04-25T01:39:35.198704+0000","last_undegraded":"2024-04-25T01:39:35.198704+0000","last_fullsized":"2024-04-25T01:39:35.198704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:50.545311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429728+0000","last_change":"2024-04-25T01:39:24.401208+0000","last_active":"2024-04-25T01:39:34.429728+0000","last_peered":"2024-04-25T01:39:34.429728+0000","last_clean":"2024-04-25T01:39:34.429728+0000","last_became_active":"2024-04-25T01:39:24.400502+0000","last_became_peered":"2024-04-25T01:39:24.400502+0000","last_unstale":"2024-04-25T01:39:34.429728+0000","last_undegraded":"2024-04-25T01:39:34.429728+0000","last_fullsized":"2024-04-25T01:39:34.429728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:55:09.076617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198391+0000","last_change":"2024-04-25T01:39:23.367826+0000","last_active":"2024-04-25T01:39:35.198391+0000","last_peered":"2024-04-25T01:39:35.198391+0000","last_clean":"2024-04-25T01:39:35.198391+0000","last_became_active":"2024-04-25T01:39:23.367520+0000","last_became_peered":"2024-04-25T01:39:23.367520+0000","last_unstale":"2024-04-25T01:39:35.198391+0000","last_undegraded":"2024-04-25T01:39:35.198391+0000","last_fullsized":"2024-04-25T01:39:35.198391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:05.997166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199929+0000","last_change":"2024-04-25T01:39:12.918495+0000","last_active":"2024-04-25T01:39:35.199929+0000","last_peered":"2024-04-25T01:39:35.199929+0000","last_clean":"2024-04-25T01:39:35.199929+0000","last_became_active":"2024-04-25T01:39:12.917330+0000","last_became_peered":"2024-04-25T01:39:12.917330+0000","last_unstale":"2024-04-25T01:39:35.199929+0000","last_undegraded":"2024-04-25T01:39:35.199929+0000","last_fullsized":"2024-04-25T01:39:35.199929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:11.731178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:11.731178+0000","last_clean_scrub_stamp":"2024-04-25T01:39:11.731178+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:26:14.153244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434088+0000","last_change":"2024-04-25T01:39:32.431797+0000","last_active":"2024-04-25T01:39:34.434088+0000","last_peered":"2024-04-25T01:39:34.434088+0000","last_clean":"2024-04-25T01:39:34.434088+0000","last_became_active":"2024-04-25T01:39:32.431523+0000","last_became_peered":"2024-04-25T01:39:32.431523+0000","last_unstale":"2024-04-25T01:39:34.434088+0000","last_undegraded":"2024-04-25T01:39:34.434088+0000","last_fullsized":"2024-04-25T01:39:34.434088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:45.752128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198056+0000","last_change":"2024-04-25T01:39:33.440488+0000","last_active":"2024-04-25T01:39:35.198056+0000","last_peered":"2024-04-25T01:39:35.198056+0000","last_clean":"2024-04-25T01:39:35.198056+0000","last_became_active":"2024-04-25T01:39:33.440161+0000","last_became_peered":"2024-04-25T01:39:33.440161+0000","last_unstale":"2024-04-25T01:39:35.198056+0000","last_undegraded":"2024-04-25T01:39:35.198056+0000","last_fullsized":"2024-04-25T01:39:35.198056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:45.542876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199802+0000","last_change":"2024-04-25T01:39:24.394350+0000","last_active":"2024-04-25T01:39:35.199802+0000","last_peered":"2024-04-25T01:39:35.199802+0000","last_clean":"2024-04-25T01:39:35.199802+0000","last_became_active":"2024-04-25T01:39:24.393235+0000","last_became_peered":"2024-04-25T01:39:24.393235+0000","last_unstale":"2024-04-25T01:39:35.199802+0000","last_undegraded":"2024-04-25T01:39:35.199802+0000","last_fullsized":"2024-04-25T01:39:35.199802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:00:48.588700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198113+0000","last_change":"2024-04-25T01:39:23.368352+0000","last_active":"2024-04-25T01:39:35.198113+0000","last_peered":"2024-04-25T01:39:35.198113+0000","last_clean":"2024-04-25T01:39:35.198113+0000","last_became_active":"2024-04-25T01:39:23.368075+0000","last_became_peered":"2024-04-25T01:39:23.368075+0000","last_unstale":"2024-04-25T01:39:35.198113+0000","last_undegraded":"2024-04-25T01:39:35.198113+0000","last_fullsized":"2024-04-25T01:39:35.198113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:11.300091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434486+0000","last_change":"2024-04-25T01:39:32.430007+0000","last_active":"2024-04-25T01:39:34.434486+0000","last_peered":"2024-04-25T01:39:34.434486+0000","last_clean":"2024-04-25T01:39:34.434486+0000","last_became_active":"2024-04-25T01:39:32.429721+0000","last_became_peered":"2024-04-25T01:39:32.429721+0000","last_unstale":"2024-04-25T01:39:34.434486+0000","last_undegraded":"2024-04-25T01:39:34.434486+0000","last_fullsized":"2024-04-25T01:39:34.434486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:47.409375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197603+0000","last_change":"2024-04-25T01:39:33.447230+0000","last_active":"2024-04-25T01:39:35.197603+0000","last_peered":"2024-04-25T01:39:35.197603+0000","last_clean":"2024-04-25T01:39:35.197603+0000","last_became_active":"2024-04-25T01:39:33.446930+0000","last_became_peered":"2024-04-25T01:39:33.446930+0000","last_unstale":"2024-04-25T01:39:35.197603+0000","last_undegraded":"2024-04-25T01:39:35.197603+0000","last_fullsized":"2024-04-25T01:39:35.197603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:51:40.920560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199534+0000","last_change":"2024-04-25T01:39:24.394286+0000","last_active":"2024-04-25T01:39:35.199534+0000","last_peered":"2024-04-25T01:39:35.199534+0000","last_clean":"2024-04-25T01:39:35.199534+0000","last_became_active":"2024-04-25T01:39:24.393558+0000","last_became_peered":"2024-04-25T01:39:24.393558+0000","last_unstale":"2024-04-25T01:39:35.199534+0000","last_undegraded":"2024-04-25T01:39:35.199534+0000","last_fullsized":"2024-04-25T01:39:35.199534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:59.100947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198699+0000","last_change":"2024-04-25T01:39:23.370690+0000","last_active":"2024-04-25T01:39:35.198699+0000","last_peered":"2024-04-25T01:39:35.198699+0000","last_clean":"2024-04-25T01:39:35.198699+0000","last_became_active":"2024-04-25T01:39:23.370391+0000","last_became_peered":"2024-04-25T01:39:23.370391+0000","last_unstale":"2024-04-25T01:39:35.198699+0000","last_undegraded":"2024-04-25T01:39:35.198699+0000","last_fullsized":"2024-04-25T01:39:35.198699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:29.647636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559440+0000","last_change":"2024-04-25T01:39:32.429412+0000","last_active":"2024-04-25T01:39:34.559440+0000","last_peered":"2024-04-25T01:39:34.559440+0000","last_clean":"2024-04-25T01:39:34.559440+0000","last_became_active":"2024-04-25T01:39:32.429143+0000","last_became_peered":"2024-04-25T01:39:32.429143+0000","last_unstale":"2024-04-25T01:39:34.559440+0000","last_undegraded":"2024-04-25T01:39:34.559440+0000","last_fullsized":"2024-04-25T01:39:34.559440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:53.637245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198532+0000","last_change":"2024-04-25T01:39:33.437128+0000","last_active":"2024-04-25T01:39:35.198532+0000","last_peered":"2024-04-25T01:39:35.198532+0000","last_clean":"2024-04-25T01:39:35.198532+0000","last_became_active":"2024-04-25T01:39:33.436861+0000","last_became_peered":"2024-04-25T01:39:33.436861+0000","last_unstale":"2024-04-25T01:39:35.198532+0000","last_undegraded":"2024-04-25T01:39:35.198532+0000","last_fullsized":"2024-04-25T01:39:35.198532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:41.746373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200378+0000","last_change":"2024-04-25T01:39:24.392170+0000","last_active":"2024-04-25T01:39:35.200378+0000","last_peered":"2024-04-25T01:39:35.200378+0000","last_clean":"2024-04-25T01:39:35.200378+0000","last_became_active":"2024-04-25T01:39:24.391811+0000","last_became_peered":"2024-04-25T01:39:24.391811+0000","last_unstale":"2024-04-25T01:39:35.200378+0000","last_undegraded":"2024-04-25T01:39:35.200378+0000","last_fullsized":"2024-04-25T01:39:35.200378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:32.859676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197996+0000","last_change":"2024-04-25T01:39:23.369872+0000","last_active":"2024-04-25T01:39:35.197996+0000","last_peered":"2024-04-25T01:39:35.197996+0000","last_clean":"2024-04-25T01:39:35.197996+0000","last_became_active":"2024-04-25T01:39:23.369314+0000","last_became_peered":"2024-04-25T01:39:23.369314+0000","last_unstale":"2024-04-25T01:39:35.197996+0000","last_undegraded":"2024-04-25T01:39:35.197996+0000","last_fullsized":"2024-04-25T01:39:35.197996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:14.571148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197245+0000","last_change":"2024-04-25T01:39:32.429664+0000","last_active":"2024-04-25T01:39:35.197245+0000","last_peered":"2024-04-25T01:39:35.197245+0000","last_clean":"2024-04-25T01:39:35.197245+0000","last_became_active":"2024-04-25T01:39:32.429358+0000","last_became_peered":"2024-04-25T01:39:32.429358+0000","last_unstale":"2024-04-25T01:39:35.197245+0000","last_undegraded":"2024-04-25T01:39:35.197245+0000","last_fullsized":"2024-04-25T01:39:35.197245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:57:10.913056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197472+0000","last_change":"2024-04-25T01:39:33.440419+0000","last_active":"2024-04-25T01:39:35.197472+0000","last_peered":"2024-04-25T01:39:35.197472+0000","last_clean":"2024-04-25T01:39:35.197472+0000","last_became_active":"2024-04-25T01:39:33.440054+0000","last_became_peered":"2024-04-25T01:39:33.440054+0000","last_unstale":"2024-04-25T01:39:35.197472+0000","last_undegraded":"2024-04-25T01:39:35.197472+0000","last_fullsized":"2024-04-25T01:39:35.197472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:42.321235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199726+0000","last_change":"2024-04-25T01:39:24.391240+0000","last_active":"2024-04-25T01:39:35.199726+0000","last_peered":"2024-04-25T01:39:35.199726+0000","last_clean":"2024-04-25T01:39:35.199726+0000","last_became_active":"2024-04-25T01:39:24.390948+0000","last_became_peered":"2024-04-25T01:39:24.390948+0000","last_unstale":"2024-04-25T01:39:35.199726+0000","last_undegraded":"2024-04-25T01:39:35.199726+0000","last_fullsized":"2024-04-25T01:39:35.199726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:41:30.579190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198161+0000","last_change":"2024-04-25T01:39:23.367322+0000","last_active":"2024-04-25T01:39:35.198161+0000","last_peered":"2024-04-25T01:39:35.198161+0000","last_clean":"2024-04-25T01:39:35.198161+0000","last_became_active":"2024-04-25T01:39:23.367054+0000","last_became_peered":"2024-04-25T01:39:23.367054+0000","last_unstale":"2024-04-25T01:39:35.198161+0000","last_undegraded":"2024-04-25T01:39:35.198161+0000","last_fullsized":"2024-04-25T01:39:35.198161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:10.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197919+0000","last_change":"2024-04-25T01:39:32.426874+0000","last_active":"2024-04-25T01:39:35.197919+0000","last_peered":"2024-04-25T01:39:35.197919+0000","last_clean":"2024-04-25T01:39:35.197919+0000","last_became_active":"2024-04-25T01:39:32.426599+0000","last_became_peered":"2024-04-25T01:39:32.426599+0000","last_unstale":"2024-04-25T01:39:35.197919+0000","last_undegraded":"2024-04-25T01:39:35.197919+0000","last_fullsized":"2024-04-25T01:39:35.197919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:27.672277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430134+0000","last_change":"2024-04-25T01:39:33.428909+0000","last_active":"2024-04-25T01:39:34.430134+0000","last_peered":"2024-04-25T01:39:34.430134+0000","last_clean":"2024-04-25T01:39:34.430134+0000","last_became_active":"2024-04-25T01:39:33.428626+0000","last_became_peered":"2024-04-25T01:39:33.428626+0000","last_unstale":"2024-04-25T01:39:34.430134+0000","last_undegraded":"2024-04-25T01:39:34.430134+0000","last_fullsized":"2024-04-25T01:39:34.430134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:21.188264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199068+0000","last_change":"2024-04-25T01:39:24.389946+0000","last_active":"2024-04-25T01:39:35.199068+0000","last_peered":"2024-04-25T01:39:35.199068+0000","last_clean":"2024-04-25T01:39:35.199068+0000","last_became_active":"2024-04-25T01:39:24.389656+0000","last_became_peered":"2024-04-25T01:39:24.389656+0000","last_unstale":"2024-04-25T01:39:35.199068+0000","last_undegraded":"2024-04-25T01:39:35.199068+0000","last_fullsized":"2024-04-25T01:39:35.199068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:55.943639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197475+0000","last_change":"2024-04-25T01:39:23.373599+0000","last_active":"2024-04-25T01:39:35.197475+0000","last_peered":"2024-04-25T01:39:35.197475+0000","last_clean":"2024-04-25T01:39:35.197475+0000","last_became_active":"2024-04-25T01:39:23.373281+0000","last_became_peered":"2024-04-25T01:39:23.373281+0000","last_unstale":"2024-04-25T01:39:35.197475+0000","last_undegraded":"2024-04-25T01:39:35.197475+0000","last_fullsized":"2024-04-25T01:39:35.197475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:40.850925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559604+0000","last_change":"2024-04-25T01:39:32.427502+0000","last_active":"2024-04-25T01:39:34.559604+0000","last_peered":"2024-04-25T01:39:34.559604+0000","last_clean":"2024-04-25T01:39:34.559604+0000","last_became_active":"2024-04-25T01:39:32.426499+0000","last_became_peered":"2024-04-25T01:39:32.426499+0000","last_unstale":"2024-04-25T01:39:34.559604+0000","last_undegraded":"2024-04-25T01:39:34.559604+0000","last_fullsized":"2024-04-25T01:39:34.559604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:26.977416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198695+0000","last_change":"2024-04-25T01:39:33.436901+0000","last_active":"2024-04-25T01:39:35.198695+0000","last_peered":"2024-04-25T01:39:35.198695+0000","last_clean":"2024-04-25T01:39:35.198695+0000","last_became_active":"2024-04-25T01:39:33.436001+0000","last_became_peered":"2024-04-25T01:39:33.436001+0000","last_unstale":"2024-04-25T01:39:35.198695+0000","last_undegraded":"2024-04-25T01:39:35.198695+0000","last_fullsized":"2024-04-25T01:39:35.198695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:34:41.678663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.433897+0000","last_change":"2024-04-25T01:39:24.394248+0000","last_active":"2024-04-25T01:39:34.433897+0000","last_peered":"2024-04-25T01:39:34.433897+0000","last_clean":"2024-04-25T01:39:34.433897+0000","last_became_active":"2024-04-25T01:39:24.393958+0000","last_became_peered":"2024-04-25T01:39:24.393958+0000","last_unstale":"2024-04-25T01:39:34.433897+0000","last_undegraded":"2024-04-25T01:39:34.433897+0000","last_fullsized":"2024-04-25T01:39:34.433897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:35.087577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434426+0000","last_change":"2024-04-25T01:39:23.372939+0000","last_active":"2024-04-25T01:39:34.434426+0000","last_peered":"2024-04-25T01:39:34.434426+0000","last_clean":"2024-04-25T01:39:34.434426+0000","last_became_active":"2024-04-25T01:39:23.372648+0000","last_became_peered":"2024-04-25T01:39:23.372648+0000","last_unstale":"2024-04-25T01:39:34.434426+0000","last_undegraded":"2024-04-25T01:39:34.434426+0000","last_fullsized":"2024-04-25T01:39:34.434426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:02:13.283096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430096+0000","last_change":"2024-04-25T01:39:32.432218+0000","last_active":"2024-04-25T01:39:34.430096+0000","last_peered":"2024-04-25T01:39:34.430096+0000","last_clean":"2024-04-25T01:39:34.430096+0000","last_became_active":"2024-04-25T01:39:32.431938+0000","last_became_peered":"2024-04-25T01:39:32.431938+0000","last_unstale":"2024-04-25T01:39:34.430096+0000","last_undegraded":"2024-04-25T01:39:34.430096+0000","last_fullsized":"2024-04-25T01:39:34.430096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:56:15.053817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199747+0000","last_change":"2024-04-25T01:39:33.441342+0000","last_active":"2024-04-25T01:39:35.199747+0000","last_peered":"2024-04-25T01:39:35.199747+0000","last_clean":"2024-04-25T01:39:35.199747+0000","last_became_active":"2024-04-25T01:39:33.441074+0000","last_became_peered":"2024-04-25T01:39:33.441074+0000","last_unstale":"2024-04-25T01:39:35.199747+0000","last_undegraded":"2024-04-25T01:39:35.199747+0000","last_fullsized":"2024-04-25T01:39:35.199747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:22:43.000112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199029+0000","last_change":"2024-04-25T01:39:24.390114+0000","last_active":"2024-04-25T01:39:35.199029+0000","last_peered":"2024-04-25T01:39:35.199029+0000","last_clean":"2024-04-25T01:39:35.199029+0000","last_became_active":"2024-04-25T01:39:24.389841+0000","last_became_peered":"2024-04-25T01:39:24.389841+0000","last_unstale":"2024-04-25T01:39:35.199029+0000","last_undegraded":"2024-04-25T01:39:35.199029+0000","last_fullsized":"2024-04-25T01:39:35.199029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:34.950624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198167+0000","last_change":"2024-04-25T01:39:23.369440+0000","last_active":"2024-04-25T01:39:35.198167+0000","last_peered":"2024-04-25T01:39:35.198167+0000","last_clean":"2024-04-25T01:39:35.198167+0000","last_became_active":"2024-04-25T01:39:23.369151+0000","last_became_peered":"2024-04-25T01:39:23.369151+0000","last_unstale":"2024-04-25T01:39:35.198167+0000","last_undegraded":"2024-04-25T01:39:35.198167+0000","last_fullsized":"2024-04-25T01:39:35.198167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:31:46.921287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"23'6","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429666+0000","last_change":"2024-04-25T01:39:32.430701+0000","last_active":"2024-04-25T01:39:34.429666+0000","last_peered":"2024-04-25T01:39:34.429666+0000","last_clean":"2024-04-25T01:39:34.429666+0000","last_became_active":"2024-04-25T01:39:32.430187+0000","last_became_peered":"2024-04-25T01:39:32.430187+0000","last_unstale":"2024-04-25T01:39:34.429666+0000","last_undegraded":"2024-04-25T01:39:34.429666+0000","last_fullsized":"2024-04-25T01:39:34.429666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:57.148375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429767+0000","last_change":"2024-04-25T01:39:33.427429+0000","last_active":"2024-04-25T01:39:34.429767+0000","last_peered":"2024-04-25T01:39:34.429767+0000","last_clean":"2024-04-25T01:39:34.429767+0000","last_became_active":"2024-04-25T01:39:33.427164+0000","last_became_peered":"2024-04-25T01:39:33.427164+0000","last_unstale":"2024-04-25T01:39:34.429767+0000","last_undegraded":"2024-04-25T01:39:34.429767+0000","last_fullsized":"2024-04-25T01:39:34.429767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:33:59.664252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559246+0000","last_change":"2024-04-25T01:39:24.388852+0000","last_active":"2024-04-25T01:39:34.559246+0000","last_peered":"2024-04-25T01:39:34.559246+0000","last_clean":"2024-04-25T01:39:34.559246+0000","last_became_active":"2024-04-25T01:39:24.388594+0000","last_became_peered":"2024-04-25T01:39:24.388594+0000","last_unstale":"2024-04-25T01:39:34.559246+0000","last_undegraded":"2024-04-25T01:39:34.559246+0000","last_fullsized":"2024-04-25T01:39:34.559246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:46:49.718182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559847+0000","last_change":"2024-04-25T01:39:23.372903+0000","last_active":"2024-04-25T01:39:34.559847+0000","last_peered":"2024-04-25T01:39:34.559847+0000","last_clean":"2024-04-25T01:39:34.559847+0000","last_became_active":"2024-04-25T01:39:23.372617+0000","last_became_peered":"2024-04-25T01:39:23.372617+0000","last_unstale":"2024-04-25T01:39:34.559847+0000","last_undegraded":"2024-04-25T01:39:34.559847+0000","last_fullsized":"2024-04-25T01:39:34.559847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:54:58.506432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199994+0000","last_change":"2024-04-25T01:39:32.430218+0000","last_active":"2024-04-25T01:39:35.199994+0000","last_peered":"2024-04-25T01:39:35.199994+0000","last_clean":"2024-04-25T01:39:35.199994+0000","last_became_active":"2024-04-25T01:39:32.429900+0000","last_became_peered":"2024-04-25T01:39:32.429900+0000","last_unstale":"2024-04-25T01:39:35.199994+0000","last_undegraded":"2024-04-25T01:39:35.199994+0000","last_fullsized":"2024-04-25T01:39:35.199994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:52.253045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429707+0000","last_change":"2024-04-25T01:39:33.440325+0000","last_active":"2024-04-25T01:39:34.429707+0000","last_peered":"2024-04-25T01:39:34.429707+0000","last_clean":"2024-04-25T01:39:34.429707+0000","last_became_active":"2024-04-25T01:39:33.439961+0000","last_became_peered":"2024-04-25T01:39:33.439961+0000","last_unstale":"2024-04-25T01:39:34.429707+0000","last_undegraded":"2024-04-25T01:39:34.429707+0000","last_fullsized":"2024-04-25T01:39:34.429707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:01.846576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199750+0000","last_change":"2024-04-25T01:39:24.380617+0000","last_active":"2024-04-25T01:39:35.199750+0000","last_peered":"2024-04-25T01:39:35.199750+0000","last_clean":"2024-04-25T01:39:35.199750+0000","last_became_active":"2024-04-25T01:39:24.380330+0000","last_became_peered":"2024-04-25T01:39:24.380330+0000","last_unstale":"2024-04-25T01:39:35.199750+0000","last_undegraded":"2024-04-25T01:39:35.199750+0000","last_fullsized":"2024-04-25T01:39:35.199750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:24.010569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434231+0000","last_change":"2024-04-25T01:39:23.373295+0000","last_active":"2024-04-25T01:39:34.434231+0000","last_peered":"2024-04-25T01:39:34.434231+0000","last_clean":"2024-04-25T01:39:34.434231+0000","last_became_active":"2024-04-25T01:39:23.372984+0000","last_became_peered":"2024-04-25T01:39:23.372984+0000","last_unstale":"2024-04-25T01:39:34.434231+0000","last_undegraded":"2024-04-25T01:39:34.434231+0000","last_fullsized":"2024-04-25T01:39:34.434231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:10.854190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198248+0000","last_change":"2024-04-25T01:39:32.433589+0000","last_active":"2024-04-25T01:39:35.198248+0000","last_peered":"2024-04-25T01:39:35.198248+0000","last_clean":"2024-04-25T01:39:35.198248+0000","last_became_active":"2024-04-25T01:39:32.433408+0000","last_became_peered":"2024-04-25T01:39:32.433408+0000","last_unstale":"2024-04-25T01:39:35.198248+0000","last_undegraded":"2024-04-25T01:39:35.198248+0000","last_fullsized":"2024-04-25T01:39:35.198248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:25.789951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198708+0000","last_change":"2024-04-25T01:39:33.433449+0000","last_active":"2024-04-25T01:39:35.198708+0000","last_peered":"2024-04-25T01:39:35.198708+0000","last_clean":"2024-04-25T01:39:35.198708+0000","last_became_active":"2024-04-25T01:39:33.432690+0000","last_became_peered":"2024-04-25T01:39:33.432690+0000","last_unstale":"2024-04-25T01:39:35.198708+0000","last_undegraded":"2024-04-25T01:39:35.198708+0000","last_fullsized":"2024-04-25T01:39:35.198708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:30.046453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198838+0000","last_change":"2024-04-25T01:39:24.391245+0000","last_active":"2024-04-25T01:39:35.198838+0000","last_peered":"2024-04-25T01:39:35.198838+0000","last_clean":"2024-04-25T01:39:35.198838+0000","last_became_active":"2024-04-25T01:39:24.390941+0000","last_became_peered":"2024-04-25T01:39:24.390941+0000","last_unstale":"2024-04-25T01:39:35.198838+0000","last_undegraded":"2024-04-25T01:39:35.198838+0000","last_fullsized":"2024-04-25T01:39:35.198838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:55.182405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198689+0000","last_change":"2024-04-25T01:39:23.369043+0000","last_active":"2024-04-25T01:39:35.198689+0000","last_peered":"2024-04-25T01:39:35.198689+0000","last_clean":"2024-04-25T01:39:35.198689+0000","last_became_active":"2024-04-25T01:39:23.368778+0000","last_became_peered":"2024-04-25T01:39:23.368778+0000","last_unstale":"2024-04-25T01:39:35.198689+0000","last_undegraded":"2024-04-25T01:39:35.198689+0000","last_fullsized":"2024-04-25T01:39:35.198689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:59.501724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198230+0000","last_change":"2024-04-25T01:39:32.431530+0000","last_active":"2024-04-25T01:39:35.198230+0000","last_peered":"2024-04-25T01:39:35.198230+0000","last_clean":"2024-04-25T01:39:35.198230+0000","last_became_active":"2024-04-25T01:39:32.431247+0000","last_became_peered":"2024-04-25T01:39:32.431247+0000","last_unstale":"2024-04-25T01:39:35.198230+0000","last_undegraded":"2024-04-25T01:39:35.198230+0000","last_fullsized":"2024-04-25T01:39:35.198230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:46:02.014508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434136+0000","last_change":"2024-04-25T01:39:33.446545+0000","last_active":"2024-04-25T01:39:34.434136+0000","last_peered":"2024-04-25T01:39:34.434136+0000","last_clean":"2024-04-25T01:39:34.434136+0000","last_became_active":"2024-04-25T01:39:33.446263+0000","last_became_peered":"2024-04-25T01:39:33.446263+0000","last_unstale":"2024-04-25T01:39:34.434136+0000","last_undegraded":"2024-04-25T01:39:34.434136+0000","last_fullsized":"2024-04-25T01:39:34.434136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:27.026460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559482+0000","last_change":"2024-04-25T01:39:24.403875+0000","last_active":"2024-04-25T01:39:34.559482+0000","last_peered":"2024-04-25T01:39:34.559482+0000","last_clean":"2024-04-25T01:39:34.559482+0000","last_became_active":"2024-04-25T01:39:24.403591+0000","last_became_peered":"2024-04-25T01:39:24.403591+0000","last_unstale":"2024-04-25T01:39:34.559482+0000","last_undegraded":"2024-04-25T01:39:34.559482+0000","last_fullsized":"2024-04-25T01:39:34.559482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:45.276173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198758+0000","last_change":"2024-04-25T01:39:23.378968+0000","last_active":"2024-04-25T01:39:35.198758+0000","last_peered":"2024-04-25T01:39:35.198758+0000","last_clean":"2024-04-25T01:39:35.198758+0000","last_became_active":"2024-04-25T01:39:23.378635+0000","last_became_peered":"2024-04-25T01:39:23.378635+0000","last_unstale":"2024-04-25T01:39:35.198758+0000","last_undegraded":"2024-04-25T01:39:35.198758+0000","last_fullsized":"2024-04-25T01:39:35.198758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:39.780544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429477+0000","last_change":"2024-04-25T01:39:32.427357+0000","last_active":"2024-04-25T01:39:34.429477+0000","last_peered":"2024-04-25T01:39:34.429477+0000","last_clean":"2024-04-25T01:39:34.429477+0000","last_became_active":"2024-04-25T01:39:32.427105+0000","last_became_peered":"2024-04-25T01:39:32.427105+0000","last_unstale":"2024-04-25T01:39:34.429477+0000","last_undegraded":"2024-04-25T01:39:34.429477+0000","last_fullsized":"2024-04-25T01:39:34.429477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:04.848726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197844+0000","last_change":"2024-04-25T01:39:33.444814+0000","last_active":"2024-04-25T01:39:35.197844+0000","last_peered":"2024-04-25T01:39:35.197844+0000","last_clean":"2024-04-25T01:39:35.197844+0000","last_became_active":"2024-04-25T01:39:33.444489+0000","last_became_peered":"2024-04-25T01:39:33.444489+0000","last_unstale":"2024-04-25T01:39:35.197844+0000","last_undegraded":"2024-04-25T01:39:35.197844+0000","last_fullsized":"2024-04-25T01:39:35.197844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:06.718940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198707+0000","last_change":"2024-04-25T01:39:24.392642+0000","last_active":"2024-04-25T01:39:35.198707+0000","last_peered":"2024-04-25T01:39:35.198707+0000","last_clean":"2024-04-25T01:39:35.198707+0000","last_became_active":"2024-04-25T01:39:24.391605+0000","last_became_peered":"2024-04-25T01:39:24.391605+0000","last_unstale":"2024-04-25T01:39:35.198707+0000","last_undegraded":"2024-04-25T01:39:35.198707+0000","last_fullsized":"2024-04-25T01:39:35.198707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:01:23.217074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434798+0000","last_change":"2024-04-25T01:39:23.377236+0000","last_active":"2024-04-25T01:39:34.434798+0000","last_peered":"2024-04-25T01:39:34.434798+0000","last_clean":"2024-04-25T01:39:34.434798+0000","last_became_active":"2024-04-25T01:39:23.376727+0000","last_became_peered":"2024-04-25T01:39:23.376727+0000","last_unstale":"2024-04-25T01:39:34.434798+0000","last_undegraded":"2024-04-25T01:39:34.434798+0000","last_fullsized":"2024-04-25T01:39:34.434798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:08.103707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429200+0000","last_change":"2024-04-25T01:39:32.424457+0000","last_active":"2024-04-25T01:39:34.429200+0000","last_peered":"2024-04-25T01:39:34.429200+0000","last_clean":"2024-04-25T01:39:34.429200+0000","last_became_active":"2024-04-25T01:39:32.424203+0000","last_became_peered":"2024-04-25T01:39:32.424203+0000","last_unstale":"2024-04-25T01:39:34.429200+0000","last_undegraded":"2024-04-25T01:39:34.429200+0000","last_fullsized":"2024-04-25T01:39:34.429200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:12:20.824070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434672+0000","last_change":"2024-04-25T01:39:33.445948+0000","last_active":"2024-04-25T01:39:34.434672+0000","last_peered":"2024-04-25T01:39:34.434672+0000","last_clean":"2024-04-25T01:39:34.434672+0000","last_became_active":"2024-04-25T01:39:33.445654+0000","last_became_peered":"2024-04-25T01:39:33.445654+0000","last_unstale":"2024-04-25T01:39:34.434672+0000","last_undegraded":"2024-04-25T01:39:34.434672+0000","last_fullsized":"2024-04-25T01:39:34.434672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:51.323909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559508+0000","last_change":"2024-04-25T01:39:32.430484+0000","last_active":"2024-04-25T01:39:34.559508+0000","last_peered":"2024-04-25T01:39:34.559508+0000","last_clean":"2024-04-25T01:39:34.559508+0000","last_became_active":"2024-04-25T01:39:32.430220+0000","last_became_peered":"2024-04-25T01:39:32.430220+0000","last_unstale":"2024-04-25T01:39:34.559508+0000","last_undegraded":"2024-04-25T01:39:34.559508+0000","last_fullsized":"2024-04-25T01:39:34.559508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:36:53.152442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197722+0000","last_change":"2024-04-25T01:39:24.375457+0000","last_active":"2024-04-25T01:39:35.197722+0000","last_peered":"2024-04-25T01:39:35.197722+0000","last_clean":"2024-04-25T01:39:35.197722+0000","last_became_active":"2024-04-25T01:39:24.375178+0000","last_became_peered":"2024-04-25T01:39:24.375178+0000","last_unstale":"2024-04-25T01:39:35.197722+0000","last_undegraded":"2024-04-25T01:39:35.197722+0000","last_fullsized":"2024-04-25T01:39:35.197722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:58:15.640882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197478+0000","last_change":"2024-04-25T01:39:23.369998+0000","last_active":"2024-04-25T01:39:35.197478+0000","last_peered":"2024-04-25T01:39:35.197478+0000","last_clean":"2024-04-25T01:39:35.197478+0000","last_became_active":"2024-04-25T01:39:23.369710+0000","last_became_peered":"2024-04-25T01:39:23.369710+0000","last_unstale":"2024-04-25T01:39:35.197478+0000","last_undegraded":"2024-04-25T01:39:35.197478+0000","last_fullsized":"2024-04-25T01:39:35.197478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:32:34.329452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559536+0000","last_change":"2024-04-25T01:39:33.447666+0000","last_active":"2024-04-25T01:39:34.559536+0000","last_peered":"2024-04-25T01:39:34.559536+0000","last_clean":"2024-04-25T01:39:34.559536+0000","last_became_active":"2024-04-25T01:39:33.447436+0000","last_became_peered":"2024-04-25T01:39:33.447436+0000","last_unstale":"2024-04-25T01:39:34.559536+0000","last_undegraded":"2024-04-25T01:39:34.559536+0000","last_fullsized":"2024-04-25T01:39:34.559536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:25:20.440422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434733+0000","last_change":"2024-04-25T01:39:32.436300+0000","last_active":"2024-04-25T01:39:34.434733+0000","last_peered":"2024-04-25T01:39:34.434733+0000","last_clean":"2024-04-25T01:39:34.434733+0000","last_became_active":"2024-04-25T01:39:32.436000+0000","last_became_peered":"2024-04-25T01:39:32.436000+0000","last_unstale":"2024-04-25T01:39:34.434733+0000","last_undegraded":"2024-04-25T01:39:34.434733+0000","last_fullsized":"2024-04-25T01:39:34.434733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:38.044992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429461+0000","last_change":"2024-04-25T01:39:24.387708+0000","last_active":"2024-04-25T01:39:34.429461+0000","last_peered":"2024-04-25T01:39:34.429461+0000","last_clean":"2024-04-25T01:39:34.429461+0000","last_became_active":"2024-04-25T01:39:24.387433+0000","last_became_peered":"2024-04-25T01:39:24.387433+0000","last_unstale":"2024-04-25T01:39:34.429461+0000","last_undegraded":"2024-04-25T01:39:34.429461+0000","last_fullsized":"2024-04-25T01:39:34.429461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:34.312066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429418+0000","last_change":"2024-04-25T01:39:23.377487+0000","last_active":"2024-04-25T01:39:34.429418+0000","last_peered":"2024-04-25T01:39:34.429418+0000","last_clean":"2024-04-25T01:39:34.429418+0000","last_became_active":"2024-04-25T01:39:23.377181+0000","last_became_peered":"2024-04-25T01:39:23.377181+0000","last_unstale":"2024-04-25T01:39:34.429418+0000","last_undegraded":"2024-04-25T01:39:34.429418+0000","last_fullsized":"2024-04-25T01:39:34.429418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:17.434141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198602+0000","last_change":"2024-04-25T01:39:33.444973+0000","last_active":"2024-04-25T01:39:35.198602+0000","last_peered":"2024-04-25T01:39:35.198602+0000","last_clean":"2024-04-25T01:39:35.198602+0000","last_became_active":"2024-04-25T01:39:33.444673+0000","last_became_peered":"2024-04-25T01:39:33.444673+0000","last_unstale":"2024-04-25T01:39:35.198602+0000","last_undegraded":"2024-04-25T01:39:35.198602+0000","last_fullsized":"2024-04-25T01:39:35.198602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:08.372714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434713+0000","last_change":"2024-04-25T01:39:23.372975+0000","last_active":"2024-04-25T01:39:34.434713+0000","last_peered":"2024-04-25T01:39:34.434713+0000","last_clean":"2024-04-25T01:39:34.434713+0000","last_became_active":"2024-04-25T01:39:23.372688+0000","last_became_peered":"2024-04-25T01:39:23.372688+0000","last_unstale":"2024-04-25T01:39:34.434713+0000","last_undegraded":"2024-04-25T01:39:34.434713+0000","last_fullsized":"2024-04-25T01:39:34.434713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:42:57.195844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559766+0000","last_change":"2024-04-25T01:39:24.388095+0000","last_active":"2024-04-25T01:39:34.559766+0000","last_peered":"2024-04-25T01:39:34.559766+0000","last_clean":"2024-04-25T01:39:34.559766+0000","last_became_active":"2024-04-25T01:39:24.387797+0000","last_became_peered":"2024-04-25T01:39:24.387797+0000","last_unstale":"2024-04-25T01:39:34.559766+0000","last_undegraded":"2024-04-25T01:39:34.559766+0000","last_fullsized":"2024-04-25T01:39:34.559766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:43:16.385957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197731+0000","last_change":"2024-04-25T01:39:32.427081+0000","last_active":"2024-04-25T01:39:35.197731+0000","last_peered":"2024-04-25T01:39:35.197731+0000","last_clean":"2024-04-25T01:39:35.197731+0000","last_became_active":"2024-04-25T01:39:32.426626+0000","last_became_peered":"2024-04-25T01:39:32.426626+0000","last_unstale":"2024-04-25T01:39:35.197731+0000","last_undegraded":"2024-04-25T01:39:35.197731+0000","last_fullsized":"2024-04-25T01:39:35.197731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:45.358400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198937+0000","last_change":"2024-04-25T01:39:33.446301+0000","last_active":"2024-04-25T01:39:35.198937+0000","last_peered":"2024-04-25T01:39:35.198937+0000","last_clean":"2024-04-25T01:39:35.198937+0000","last_became_active":"2024-04-25T01:39:33.445158+0000","last_became_peered":"2024-04-25T01:39:33.445158+0000","last_unstale":"2024-04-25T01:39:35.198937+0000","last_undegraded":"2024-04-25T01:39:35.198937+0000","last_fullsized":"2024-04-25T01:39:35.198937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:53:26.017968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429884+0000","last_change":"2024-04-25T01:39:23.371716+0000","last_active":"2024-04-25T01:39:34.429884+0000","last_peered":"2024-04-25T01:39:34.429884+0000","last_clean":"2024-04-25T01:39:34.429884+0000","last_became_active":"2024-04-25T01:39:23.371475+0000","last_became_peered":"2024-04-25T01:39:23.371475+0000","last_unstale":"2024-04-25T01:39:34.429884+0000","last_undegraded":"2024-04-25T01:39:34.429884+0000","last_fullsized":"2024-04-25T01:39:34.429884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:10.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198751+0000","last_change":"2024-04-25T01:39:24.388083+0000","last_active":"2024-04-25T01:39:35.198751+0000","last_peered":"2024-04-25T01:39:35.198751+0000","last_clean":"2024-04-25T01:39:35.198751+0000","last_became_active":"2024-04-25T01:39:24.387789+0000","last_became_peered":"2024-04-25T01:39:24.387789+0000","last_unstale":"2024-04-25T01:39:35.198751+0000","last_undegraded":"2024-04-25T01:39:35.198751+0000","last_fullsized":"2024-04-25T01:39:35.198751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:31.760631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429824+0000","last_change":"2024-04-25T01:39:32.429613+0000","last_active":"2024-04-25T01:39:34.429824+0000","last_peered":"2024-04-25T01:39:34.429824+0000","last_clean":"2024-04-25T01:39:34.429824+0000","last_became_active":"2024-04-25T01:39:32.429361+0000","last_became_peered":"2024-04-25T01:39:32.429361+0000","last_unstale":"2024-04-25T01:39:34.429824+0000","last_undegraded":"2024-04-25T01:39:34.429824+0000","last_fullsized":"2024-04-25T01:39:34.429824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:04:59.928602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430227+0000","last_change":"2024-04-25T01:39:33.426384+0000","last_active":"2024-04-25T01:39:34.430227+0000","last_peered":"2024-04-25T01:39:34.430227+0000","last_clean":"2024-04-25T01:39:34.430227+0000","last_became_active":"2024-04-25T01:39:33.426101+0000","last_became_peered":"2024-04-25T01:39:33.426101+0000","last_unstale":"2024-04-25T01:39:34.430227+0000","last_undegraded":"2024-04-25T01:39:34.430227+0000","last_fullsized":"2024-04-25T01:39:34.430227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:36.820458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.433902+0000","last_change":"2024-04-25T01:39:24.395618+0000","last_active":"2024-04-25T01:39:34.433902+0000","last_peered":"2024-04-25T01:39:34.433902+0000","last_clean":"2024-04-25T01:39:34.433902+0000","last_became_active":"2024-04-25T01:39:24.394816+0000","last_became_peered":"2024-04-25T01:39:24.394816+0000","last_unstale":"2024-04-25T01:39:34.433902+0000","last_undegraded":"2024-04-25T01:39:34.433902+0000","last_fullsized":"2024-04-25T01:39:34.433902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:01.025135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198676+0000","last_change":"2024-04-25T01:39:33.432537+0000","last_active":"2024-04-25T01:39:35.198676+0000","last_peered":"2024-04-25T01:39:35.198676+0000","last_clean":"2024-04-25T01:39:35.198676+0000","last_became_active":"2024-04-25T01:39:33.432266+0000","last_became_peered":"2024-04-25T01:39:33.432266+0000","last_unstale":"2024-04-25T01:39:35.198676+0000","last_undegraded":"2024-04-25T01:39:35.198676+0000","last_fullsized":"2024-04-25T01:39:35.198676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:31.703689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197383+0000","last_change":"2024-04-25T01:39:24.390981+0000","last_active":"2024-04-25T01:39:35.197383+0000","last_peered":"2024-04-25T01:39:35.197383+0000","last_clean":"2024-04-25T01:39:35.197383+0000","last_became_active":"2024-04-25T01:39:24.390716+0000","last_became_peered":"2024-04-25T01:39:24.390716+0000","last_unstale":"2024-04-25T01:39:35.197383+0000","last_undegraded":"2024-04-25T01:39:35.197383+0000","last_fullsized":"2024-04-25T01:39:35.197383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:08.458504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199057+0000","last_change":"2024-04-25T01:39:33.439086+0000","last_active":"2024-04-25T01:39:35.199057+0000","last_peered":"2024-04-25T01:39:35.199057+0000","last_clean":"2024-04-25T01:39:35.199057+0000","last_became_active":"2024-04-25T01:39:33.438811+0000","last_became_peered":"2024-04-25T01:39:33.438811+0000","last_unstale":"2024-04-25T01:39:35.199057+0000","last_undegraded":"2024-04-25T01:39:35.199057+0000","last_fullsized":"2024-04-25T01:39:35.199057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:49:23.604749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198076+0000","last_change":"2024-04-25T01:39:24.399738+0000","last_active":"2024-04-25T01:39:35.198076+0000","last_peered":"2024-04-25T01:39:35.198076+0000","last_clean":"2024-04-25T01:39:35.198076+0000","last_became_active":"2024-04-25T01:39:24.399499+0000","last_became_peered":"2024-04-25T01:39:24.399499+0000","last_unstale":"2024-04-25T01:39:35.198076+0000","last_undegraded":"2024-04-25T01:39:35.198076+0000","last_fullsized":"2024-04-25T01:39:35.198076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:58.646669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198407+0000","last_change":"2024-04-25T01:39:33.444074+0000","last_active":"2024-04-25T01:39:35.198407+0000","last_peered":"2024-04-25T01:39:35.198407+0000","last_clean":"2024-04-25T01:39:35.198407+0000","last_became_active":"2024-04-25T01:39:33.443796+0000","last_became_peered":"2024-04-25T01:39:33.443796+0000","last_unstale":"2024-04-25T01:39:35.198407+0000","last_undegraded":"2024-04-25T01:39:35.198407+0000","last_fullsized":"2024-04-25T01:39:35.198407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:56.379211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559685+0000","last_change":"2024-04-25T01:39:24.390631+0000","last_active":"2024-04-25T01:39:34.559685+0000","last_peered":"2024-04-25T01:39:34.559685+0000","last_clean":"2024-04-25T01:39:34.559685+0000","last_became_active":"2024-04-25T01:39:24.390363+0000","last_became_peered":"2024-04-25T01:39:24.390363+0000","last_unstale":"2024-04-25T01:39:34.559685+0000","last_undegraded":"2024-04-25T01:39:34.559685+0000","last_fullsized":"2024-04-25T01:39:34.559685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:48.830416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199245+0000","last_change":"2024-04-25T01:39:33.437787+0000","last_active":"2024-04-25T01:39:35.199245+0000","last_peered":"2024-04-25T01:39:35.199245+0000","last_clean":"2024-04-25T01:39:35.199245+0000","last_became_active":"2024-04-25T01:39:33.436131+0000","last_became_peered":"2024-04-25T01:39:33.436131+0000","last_unstale":"2024-04-25T01:39:35.199245+0000","last_undegraded":"2024-04-25T01:39:35.199245+0000","last_fullsized":"2024-04-25T01:39:35.199245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:29:13.213643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429883+0000","last_change":"2024-04-25T01:39:24.389645+0000","last_active":"2024-04-25T01:39:34.429883+0000","last_peered":"2024-04-25T01:39:34.429883+0000","last_clean":"2024-04-25T01:39:34.429883+0000","last_became_active":"2024-04-25T01:39:24.389375+0000","last_became_peered":"2024-04-25T01:39:24.389375+0000","last_unstale":"2024-04-25T01:39:34.429883+0000","last_undegraded":"2024-04-25T01:39:34.429883+0000","last_fullsized":"2024-04-25T01:39:34.429883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:13:12.753893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197777+0000","last_change":"2024-04-25T01:39:33.448177+0000","last_active":"2024-04-25T01:39:35.197777+0000","last_peered":"2024-04-25T01:39:35.197777+0000","last_clean":"2024-04-25T01:39:35.197777+0000","last_became_active":"2024-04-25T01:39:33.447588+0000","last_became_peered":"2024-04-25T01:39:33.447588+0000","last_unstale":"2024-04-25T01:39:35.197777+0000","last_undegraded":"2024-04-25T01:39:35.197777+0000","last_fullsized":"2024-04-25T01:39:35.197777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:11:20.466189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198572+0000","last_change":"2024-04-25T01:39:24.374082+0000","last_active":"2024-04-25T01:39:35.198572+0000","last_peered":"2024-04-25T01:39:35.198572+0000","last_clean":"2024-04-25T01:39:35.198572+0000","last_became_active":"2024-04-25T01:39:24.373731+0000","last_became_peered":"2024-04-25T01:39:24.373731+0000","last_unstale":"2024-04-25T01:39:35.198572+0000","last_undegraded":"2024-04-25T01:39:35.198572+0000","last_fullsized":"2024-04-25T01:39:35.198572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:45.817483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197536+0000","last_change":"2024-04-25T01:39:33.446992+0000","last_active":"2024-04-25T01:39:35.197536+0000","last_peered":"2024-04-25T01:39:35.197536+0000","last_clean":"2024-04-25T01:39:35.197536+0000","last_became_active":"2024-04-25T01:39:33.446652+0000","last_became_peered":"2024-04-25T01:39:33.446652+0000","last_unstale":"2024-04-25T01:39:35.197536+0000","last_undegraded":"2024-04-25T01:39:35.197536+0000","last_fullsized":"2024-04-25T01:39:35.197536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:43:52.959274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434529+0000","last_change":"2024-04-25T01:39:24.398614+0000","last_active":"2024-04-25T01:39:34.434529+0000","last_peered":"2024-04-25T01:39:34.434529+0000","last_clean":"2024-04-25T01:39:34.434529+0000","last_became_active":"2024-04-25T01:39:24.398299+0000","last_became_peered":"2024-04-25T01:39:24.398299+0000","last_unstale":"2024-04-25T01:39:34.434529+0000","last_undegraded":"2024-04-25T01:39:34.434529+0000","last_fullsized":"2024-04-25T01:39:34.434529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:54:51.191225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434363+0000","last_change":"2024-04-25T01:39:33.441401+0000","last_active":"2024-04-25T01:39:34.434363+0000","last_peered":"2024-04-25T01:39:34.434363+0000","last_clean":"2024-04-25T01:39:34.434363+0000","last_became_active":"2024-04-25T01:39:33.441104+0000","last_became_peered":"2024-04-25T01:39:33.441104+0000","last_unstale":"2024-04-25T01:39:34.434363+0000","last_undegraded":"2024-04-25T01:39:34.434363+0000","last_fullsized":"2024-04-25T01:39:34.434363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:51.503340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430186+0000","last_change":"2024-04-25T01:39:24.390352+0000","last_active":"2024-04-25T01:39:34.430186+0000","last_peered":"2024-04-25T01:39:34.430186+0000","last_clean":"2024-04-25T01:39:34.430186+0000","last_became_active":"2024-04-25T01:39:24.389809+0000","last_became_peered":"2024-04-25T01:39:24.389809+0000","last_unstale":"2024-04-25T01:39:34.430186+0000","last_undegraded":"2024-04-25T01:39:34.430186+0000","last_fullsized":"2024-04-25T01:39:34.430186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:22:44.221898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430089+0000","last_change":"2024-04-25T01:39:33.426710+0000","last_active":"2024-04-25T01:39:34.430089+0000","last_peered":"2024-04-25T01:39:34.430089+0000","last_clean":"2024-04-25T01:39:34.430089+0000","last_became_active":"2024-04-25T01:39:33.426056+0000","last_became_peered":"2024-04-25T01:39:33.426056+0000","last_unstale":"2024-04-25T01:39:34.430089+0000","last_undegraded":"2024-04-25T01:39:34.430089+0000","last_fullsized":"2024-04-25T01:39:34.430089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:53:41.174851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197416+0000","last_change":"2024-04-25T01:39:24.387093+0000","last_active":"2024-04-25T01:39:35.197416+0000","last_peered":"2024-04-25T01:39:35.197416+0000","last_clean":"2024-04-25T01:39:35.197416+0000","last_became_active":"2024-04-25T01:39:24.386809+0000","last_became_peered":"2024-04-25T01:39:24.386809+0000","last_unstale":"2024-04-25T01:39:35.197416+0000","last_undegraded":"2024-04-25T01:39:35.197416+0000","last_fullsized":"2024-04-25T01:39:35.197416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:46:05.313828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200264+0000","last_change":"2024-04-25T01:39:33.436499+0000","last_active":"2024-04-25T01:39:35.200264+0000","last_peered":"2024-04-25T01:39:35.200264+0000","last_clean":"2024-04-25T01:39:35.200264+0000","last_became_active":"2024-04-25T01:39:33.436017+0000","last_became_peered":"2024-04-25T01:39:33.436017+0000","last_unstale":"2024-04-25T01:39:35.200264+0000","last_undegraded":"2024-04-25T01:39:35.200264+0000","last_fullsized":"2024-04-25T01:39:35.200264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:46:09.302012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429495+0000","last_change":"2024-04-25T01:39:24.389039+0000","last_active":"2024-04-25T01:39:34.429495+0000","last_peered":"2024-04-25T01:39:34.429495+0000","last_clean":"2024-04-25T01:39:34.429495+0000","last_became_active":"2024-04-25T01:39:24.388793+0000","last_became_peered":"2024-04-25T01:39:24.388793+0000","last_unstale":"2024-04-25T01:39:34.429495+0000","last_undegraded":"2024-04-25T01:39:34.429495+0000","last_fullsized":"2024-04-25T01:39:34.429495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:13.093550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197668+0000","last_change":"2024-04-25T01:39:33.441122+0000","last_active":"2024-04-25T01:39:35.197668+0000","last_peered":"2024-04-25T01:39:35.197668+0000","last_clean":"2024-04-25T01:39:35.197668+0000","last_became_active":"2024-04-25T01:39:33.440760+0000","last_became_peered":"2024-04-25T01:39:33.440760+0000","last_unstale":"2024-04-25T01:39:35.197668+0000","last_undegraded":"2024-04-25T01:39:35.197668+0000","last_fullsized":"2024-04-25T01:39:35.197668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:30:12.603789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197981+0000","last_change":"2024-04-25T01:39:24.390884+0000","last_active":"2024-04-25T01:39:35.197981+0000","last_peered":"2024-04-25T01:39:35.197981+0000","last_clean":"2024-04-25T01:39:35.197981+0000","last_became_active":"2024-04-25T01:39:24.390591+0000","last_became_peered":"2024-04-25T01:39:24.390591+0000","last_unstale":"2024-04-25T01:39:35.197981+0000","last_undegraded":"2024-04-25T01:39:35.197981+0000","last_fullsized":"2024-04-25T01:39:35.197981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:51.274363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429740+0000","last_change":"2024-04-25T01:39:33.429482+0000","last_active":"2024-04-25T01:39:34.429740+0000","last_peered":"2024-04-25T01:39:34.429740+0000","last_clean":"2024-04-25T01:39:34.429740+0000","last_became_active":"2024-04-25T01:39:33.429158+0000","last_became_peered":"2024-04-25T01:39:33.429158+0000","last_unstale":"2024-04-25T01:39:34.429740+0000","last_undegraded":"2024-04-25T01:39:34.429740+0000","last_fullsized":"2024-04-25T01:39:34.429740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:58:07.372868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559599+0000","last_change":"2024-04-25T01:39:24.388891+0000","last_active":"2024-04-25T01:39:34.559599+0000","last_peered":"2024-04-25T01:39:34.559599+0000","last_clean":"2024-04-25T01:39:34.559599+0000","last_became_active":"2024-04-25T01:39:24.388619+0000","last_became_peered":"2024-04-25T01:39:24.388619+0000","last_unstale":"2024-04-25T01:39:34.559599+0000","last_undegraded":"2024-04-25T01:39:34.559599+0000","last_fullsized":"2024-04-25T01:39:34.559599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:05.176386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198216+0000","last_change":"2024-04-25T01:39:33.443534+0000","last_active":"2024-04-25T01:39:35.198216+0000","last_peered":"2024-04-25T01:39:35.198216+0000","last_clean":"2024-04-25T01:39:35.198216+0000","last_became_active":"2024-04-25T01:39:33.443257+0000","last_became_peered":"2024-04-25T01:39:33.443257+0000","last_unstale":"2024-04-25T01:39:35.198216+0000","last_undegraded":"2024-04-25T01:39:35.198216+0000","last_fullsized":"2024-04-25T01:39:35.198216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:44:30.154519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434181+0000","last_change":"2024-04-25T01:39:24.395109+0000","last_active":"2024-04-25T01:39:34.434181+0000","last_peered":"2024-04-25T01:39:34.434181+0000","last_clean":"2024-04-25T01:39:34.434181+0000","last_became_active":"2024-04-25T01:39:24.394784+0000","last_became_peered":"2024-04-25T01:39:24.394784+0000","last_unstale":"2024-04-25T01:39:34.434181+0000","last_undegraded":"2024-04-25T01:39:34.434181+0000","last_fullsized":"2024-04-25T01:39:34.434181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:44:09.102603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197600+0000","last_change":"2024-04-25T01:39:33.446683+0000","last_active":"2024-04-25T01:39:35.197600+0000","last_peered":"2024-04-25T01:39:35.197600+0000","last_clean":"2024-04-25T01:39:35.197600+0000","last_became_active":"2024-04-25T01:39:33.445949+0000","last_became_peered":"2024-04-25T01:39:33.445949+0000","last_unstale":"2024-04-25T01:39:35.197600+0000","last_undegraded":"2024-04-25T01:39:35.197600+0000","last_fullsized":"2024-04-25T01:39:35.197600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:28.864821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199913+0000","last_change":"2024-04-25T01:39:24.380199+0000","last_active":"2024-04-25T01:39:35.199913+0000","last_peered":"2024-04-25T01:39:35.199913+0000","last_clean":"2024-04-25T01:39:35.199913+0000","last_became_active":"2024-04-25T01:39:24.379591+0000","last_became_peered":"2024-04-25T01:39:24.379591+0000","last_unstale":"2024-04-25T01:39:35.199913+0000","last_undegraded":"2024-04-25T01:39:35.199913+0000","last_fullsized":"2024-04-25T01:39:35.199913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:54.534683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197349+0000","last_change":"2024-04-25T01:39:33.439702+0000","last_active":"2024-04-25T01:39:35.197349+0000","last_peered":"2024-04-25T01:39:35.197349+0000","last_clean":"2024-04-25T01:39:35.197349+0000","last_became_active":"2024-04-25T01:39:33.439424+0000","last_became_peered":"2024-04-25T01:39:33.439424+0000","last_unstale":"2024-04-25T01:39:35.197349+0000","last_undegraded":"2024-04-25T01:39:35.197349+0000","last_fullsized":"2024-04-25T01:39:35.197349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:31.528140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197883+0000","last_change":"2024-04-25T01:39:24.395125+0000","last_active":"2024-04-25T01:39:35.197883+0000","last_peered":"2024-04-25T01:39:35.197883+0000","last_clean":"2024-04-25T01:39:35.197883+0000","last_became_active":"2024-04-25T01:39:24.392605+0000","last_became_peered":"2024-04-25T01:39:24.392605+0000","last_unstale":"2024-04-25T01:39:35.197883+0000","last_undegraded":"2024-04-25T01:39:35.197883+0000","last_fullsized":"2024-04-25T01:39:35.197883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:53.333616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559178+0000","last_change":"2024-04-25T01:39:33.438104+0000","last_active":"2024-04-25T01:39:34.559178+0000","last_peered":"2024-04-25T01:39:34.559178+0000","last_clean":"2024-04-25T01:39:34.559178+0000","last_became_active":"2024-04-25T01:39:33.437795+0000","last_became_peered":"2024-04-25T01:39:33.437795+0000","last_unstale":"2024-04-25T01:39:34.559178+0000","last_undegraded":"2024-04-25T01:39:34.559178+0000","last_fullsized":"2024-04-25T01:39:34.559178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:32.294104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199422+0000","last_change":"2024-04-25T01:39:24.391312+0000","last_active":"2024-04-25T01:39:35.199422+0000","last_peered":"2024-04-25T01:39:35.199422+0000","last_clean":"2024-04-25T01:39:35.199422+0000","last_became_active":"2024-04-25T01:39:24.390978+0000","last_became_peered":"2024-04-25T01:39:24.390978+0000","last_unstale":"2024-04-25T01:39:35.199422+0000","last_undegraded":"2024-04-25T01:39:35.199422+0000","last_fullsized":"2024-04-25T01:39:35.199422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:38:25.637031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197875+0000","last_change":"2024-04-25T01:39:33.431262+0000","last_active":"2024-04-25T01:39:35.197875+0000","last_peered":"2024-04-25T01:39:35.197875+0000","last_clean":"2024-04-25T01:39:35.197875+0000","last_became_active":"2024-04-25T01:39:33.430982+0000","last_became_peered":"2024-04-25T01:39:33.430982+0000","last_unstale":"2024-04-25T01:39:35.197875+0000","last_undegraded":"2024-04-25T01:39:35.197875+0000","last_fullsized":"2024-04-25T01:39:35.197875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:11.821542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197372+0000","last_change":"2024-04-25T01:39:24.399270+0000","last_active":"2024-04-25T01:39:35.197372+0000","last_peered":"2024-04-25T01:39:35.197372+0000","last_clean":"2024-04-25T01:39:35.197372+0000","last_became_active":"2024-04-25T01:39:24.399011+0000","last_became_peered":"2024-04-25T01:39:24.399011+0000","last_unstale":"2024-04-25T01:39:35.197372+0000","last_undegraded":"2024-04-25T01:39:35.197372+0000","last_fullsized":"2024-04-25T01:39:35.197372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:00.987674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197770+0000","last_change":"2024-04-25T01:39:33.443939+0000","last_active":"2024-04-25T01:39:35.197770+0000","last_peered":"2024-04-25T01:39:35.197770+0000","last_clean":"2024-04-25T01:39:35.197770+0000","last_became_active":"2024-04-25T01:39:33.443608+0000","last_became_peered":"2024-04-25T01:39:33.443608+0000","last_unstale":"2024-04-25T01:39:35.197770+0000","last_undegraded":"2024-04-25T01:39:35.197770+0000","last_fullsized":"2024-04-25T01:39:35.197770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:35.561173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197831+0000","last_change":"2024-04-25T01:39:24.388943+0000","last_active":"2024-04-25T01:39:35.197831+0000","last_peered":"2024-04-25T01:39:35.197831+0000","last_clean":"2024-04-25T01:39:35.197831+0000","last_became_active":"2024-04-25T01:39:24.388690+0000","last_became_peered":"2024-04-25T01:39:24.388690+0000","last_unstale":"2024-04-25T01:39:35.197831+0000","last_undegraded":"2024-04-25T01:39:35.197831+0000","last_fullsized":"2024-04-25T01:39:35.197831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:42:18.260701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198911+0000","last_change":"2024-04-25T01:39:33.438460+0000","last_active":"2024-04-25T01:39:35.198911+0000","last_peered":"2024-04-25T01:39:35.198911+0000","last_clean":"2024-04-25T01:39:35.198911+0000","last_became_active":"2024-04-25T01:39:33.436581+0000","last_became_peered":"2024-04-25T01:39:33.436581+0000","last_unstale":"2024-04-25T01:39:35.198911+0000","last_undegraded":"2024-04-25T01:39:35.198911+0000","last_fullsized":"2024-04-25T01:39:35.198911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:03:27.382925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559241+0000","last_change":"2024-04-25T01:39:24.389556+0000","last_active":"2024-04-25T01:39:34.559241+0000","last_peered":"2024-04-25T01:39:34.559241+0000","last_clean":"2024-04-25T01:39:34.559241+0000","last_became_active":"2024-04-25T01:39:24.389254+0000","last_became_peered":"2024-04-25T01:39:24.389254+0000","last_unstale":"2024-04-25T01:39:34.559241+0000","last_undegraded":"2024-04-25T01:39:34.559241+0000","last_fullsized":"2024-04-25T01:39:34.559241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:56.208172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199719+0000","last_change":"2024-04-25T01:39:33.433893+0000","last_active":"2024-04-25T01:39:35.199719+0000","last_peered":"2024-04-25T01:39:35.199719+0000","last_clean":"2024-04-25T01:39:35.199719+0000","last_became_active":"2024-04-25T01:39:33.433577+0000","last_became_peered":"2024-04-25T01:39:33.433577+0000","last_unstale":"2024-04-25T01:39:35.199719+0000","last_undegraded":"2024-04-25T01:39:35.199719+0000","last_fullsized":"2024-04-25T01:39:35.199719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:16.371837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429725+0000","last_change":"2024-04-25T01:39:24.392021+0000","last_active":"2024-04-25T01:39:34.429725+0000","last_peered":"2024-04-25T01:39:34.429725+0000","last_clean":"2024-04-25T01:39:34.429725+0000","last_became_active":"2024-04-25T01:39:24.391352+0000","last_became_peered":"2024-04-25T01:39:24.391352+0000","last_unstale":"2024-04-25T01:39:34.429725+0000","last_undegraded":"2024-04-25T01:39:34.429725+0000","last_fullsized":"2024-04-25T01:39:34.429725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:44.434749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429972+0000","last_change":"2024-04-25T01:39:33.436641+0000","last_active":"2024-04-25T01:39:34.429972+0000","last_peered":"2024-04-25T01:39:34.429972+0000","last_clean":"2024-04-25T01:39:34.429972+0000","last_became_active":"2024-04-25T01:39:33.436389+0000","last_became_peered":"2024-04-25T01:39:33.436389+0000","last_unstale":"2024-04-25T01:39:34.429972+0000","last_undegraded":"2024-04-25T01:39:34.429972+0000","last_fullsized":"2024-04-25T01:39:34.429972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:19:51.940088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198744+0000","last_change":"2024-04-25T01:39:24.396300+0000","last_active":"2024-04-25T01:39:35.198744+0000","last_peered":"2024-04-25T01:39:35.198744+0000","last_clean":"2024-04-25T01:39:35.198744+0000","last_became_active":"2024-04-25T01:39:24.396023+0000","last_became_peered":"2024-04-25T01:39:24.396023+0000","last_unstale":"2024-04-25T01:39:35.198744+0000","last_undegraded":"2024-04-25T01:39:35.198744+0000","last_fullsized":"2024-04-25T01:39:35.198744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:21.500721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197770+0000","last_change":"2024-04-25T01:39:33.443419+0000","last_active":"2024-04-25T01:39:35.197770+0000","last_peered":"2024-04-25T01:39:35.197770+0000","last_clean":"2024-04-25T01:39:35.197770+0000","last_became_active":"2024-04-25T01:39:33.443163+0000","last_became_peered":"2024-04-25T01:39:33.443163+0000","last_unstale":"2024-04-25T01:39:35.197770+0000","last_undegraded":"2024-04-25T01:39:35.197770+0000","last_fullsized":"2024-04-25T01:39:35.197770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:22.156410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434366+0000","last_change":"2024-04-25T01:39:24.404047+0000","last_active":"2024-04-25T01:39:34.434366+0000","last_peered":"2024-04-25T01:39:34.434366+0000","last_clean":"2024-04-25T01:39:34.434366+0000","last_became_active":"2024-04-25T01:39:24.403700+0000","last_became_peered":"2024-04-25T01:39:24.403700+0000","last_unstale":"2024-04-25T01:39:34.434366+0000","last_undegraded":"2024-04-25T01:39:34.434366+0000","last_fullsized":"2024-04-25T01:39:34.434366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:53.123061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199905+0000","last_change":"2024-04-25T01:39:33.435520+0000","last_active":"2024-04-25T01:39:35.199905+0000","last_peered":"2024-04-25T01:39:35.199905+0000","last_clean":"2024-04-25T01:39:35.199905+0000","last_became_active":"2024-04-25T01:39:33.434446+0000","last_became_peered":"2024-04-25T01:39:33.434446+0000","last_unstale":"2024-04-25T01:39:35.199905+0000","last_undegraded":"2024-04-25T01:39:35.199905+0000","last_fullsized":"2024-04-25T01:39:35.199905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:59.696009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434467+0000","last_change":"2024-04-25T01:39:24.406158+0000","last_active":"2024-04-25T01:39:34.434467+0000","last_peered":"2024-04-25T01:39:34.434467+0000","last_clean":"2024-04-25T01:39:34.434467+0000","last_became_active":"2024-04-25T01:39:24.405876+0000","last_became_peered":"2024-04-25T01:39:24.405876+0000","last_unstale":"2024-04-25T01:39:34.434467+0000","last_undegraded":"2024-04-25T01:39:34.434467+0000","last_fullsized":"2024-04-25T01:39:34.434467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:18:19.895651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198497+0000","last_change":"2024-04-25T01:39:33.436479+0000","last_active":"2024-04-25T01:39:35.198497+0000","last_peered":"2024-04-25T01:39:35.198497+0000","last_clean":"2024-04-25T01:39:35.198497+0000","last_became_active":"2024-04-25T01:39:33.436193+0000","last_became_peered":"2024-04-25T01:39:33.436193+0000","last_unstale":"2024-04-25T01:39:35.198497+0000","last_undegraded":"2024-04-25T01:39:35.198497+0000","last_fullsized":"2024-04-25T01:39:35.198497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:20:03.455536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200363+0000","last_change":"2024-04-25T01:39:24.393362+0000","last_active":"2024-04-25T01:39:35.200363+0000","last_peered":"2024-04-25T01:39:35.200363+0000","last_clean":"2024-04-25T01:39:35.200363+0000","last_became_active":"2024-04-25T01:39:24.392836+0000","last_became_peered":"2024-04-25T01:39:24.392836+0000","last_unstale":"2024-04-25T01:39:35.200363+0000","last_undegraded":"2024-04-25T01:39:35.200363+0000","last_fullsized":"2024-04-25T01:39:35.200363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:58.871777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430064+0000","last_change":"2024-04-25T01:39:33.440164+0000","last_active":"2024-04-25T01:39:34.430064+0000","last_peered":"2024-04-25T01:39:34.430064+0000","last_clean":"2024-04-25T01:39:34.430064+0000","last_became_active":"2024-04-25T01:39:33.439878+0000","last_became_peered":"2024-04-25T01:39:33.439878+0000","last_unstale":"2024-04-25T01:39:34.430064+0000","last_undegraded":"2024-04-25T01:39:34.430064+0000","last_fullsized":"2024-04-25T01:39:34.430064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:44:52.817169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429296+0000","last_change":"2024-04-25T01:39:24.401765+0000","last_active":"2024-04-25T01:39:34.429296+0000","last_peered":"2024-04-25T01:39:34.429296+0000","last_clean":"2024-04-25T01:39:34.429296+0000","last_became_active":"2024-04-25T01:39:24.400509+0000","last_became_peered":"2024-04-25T01:39:24.400509+0000","last_unstale":"2024-04-25T01:39:34.429296+0000","last_undegraded":"2024-04-25T01:39:34.429296+0000","last_fullsized":"2024-04-25T01:39:34.429296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:25.031622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434669+0000","last_change":"2024-04-25T01:39:33.439353+0000","last_active":"2024-04-25T01:39:34.434669+0000","last_peered":"2024-04-25T01:39:34.434669+0000","last_clean":"2024-04-25T01:39:34.434669+0000","last_became_active":"2024-04-25T01:39:33.438915+0000","last_became_peered":"2024-04-25T01:39:33.438915+0000","last_unstale":"2024-04-25T01:39:34.434669+0000","last_undegraded":"2024-04-25T01:39:34.434669+0000","last_fullsized":"2024-04-25T01:39:34.434669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:19.180919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198881+0000","last_change":"2024-04-25T01:39:24.387941+0000","last_active":"2024-04-25T01:39:35.198881+0000","last_peered":"2024-04-25T01:39:35.198881+0000","last_clean":"2024-04-25T01:39:35.198881+0000","last_became_active":"2024-04-25T01:39:24.387674+0000","last_became_peered":"2024-04-25T01:39:24.387674+0000","last_unstale":"2024-04-25T01:39:35.198881+0000","last_undegraded":"2024-04-25T01:39:35.198881+0000","last_fullsized":"2024-04-25T01:39:35.198881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:05.676143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197803+0000","last_change":"2024-04-25T01:39:33.444917+0000","last_active":"2024-04-25T01:39:35.197803+0000","last_peered":"2024-04-25T01:39:35.197803+0000","last_clean":"2024-04-25T01:39:35.197803+0000","last_became_active":"2024-04-25T01:39:33.444636+0000","last_became_peered":"2024-04-25T01:39:33.444636+0000","last_unstale":"2024-04-25T01:39:35.197803+0000","last_undegraded":"2024-04-25T01:39:35.197803+0000","last_fullsized":"2024-04-25T01:39:35.197803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:31.531502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197880+0000","last_change":"2024-04-25T01:39:24.399950+0000","last_active":"2024-04-25T01:39:35.197880+0000","last_peered":"2024-04-25T01:39:35.197880+0000","last_clean":"2024-04-25T01:39:35.197880+0000","last_became_active":"2024-04-25T01:39:24.399701+0000","last_became_peered":"2024-04-25T01:39:24.399701+0000","last_unstale":"2024-04-25T01:39:35.197880+0000","last_undegraded":"2024-04-25T01:39:35.197880+0000","last_fullsized":"2024-04-25T01:39:35.197880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:49.618370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200035+0000","last_change":"2024-04-25T01:39:33.440936+0000","last_active":"2024-04-25T01:39:35.200035+0000","last_peered":"2024-04-25T01:39:35.200035+0000","last_clean":"2024-04-25T01:39:35.200035+0000","last_became_active":"2024-04-25T01:39:33.440679+0000","last_became_peered":"2024-04-25T01:39:33.440679+0000","last_unstale":"2024-04-25T01:39:35.200035+0000","last_undegraded":"2024-04-25T01:39:35.200035+0000","last_fullsized":"2024-04-25T01:39:35.200035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:08:53.629572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198222+0000","last_change":"2024-04-25T01:39:24.380318+0000","last_active":"2024-04-25T01:39:35.198222+0000","last_peered":"2024-04-25T01:39:35.198222+0000","last_clean":"2024-04-25T01:39:35.198222+0000","last_became_active":"2024-04-25T01:39:24.379573+0000","last_became_peered":"2024-04-25T01:39:24.379573+0000","last_unstale":"2024-04-25T01:39:35.198222+0000","last_undegraded":"2024-04-25T01:39:35.198222+0000","last_fullsized":"2024-04-25T01:39:35.198222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:12.089917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429399+0000","last_change":"2024-04-25T01:39:33.426380+0000","last_active":"2024-04-25T01:39:34.429399+0000","last_peered":"2024-04-25T01:39:34.429399+0000","last_clean":"2024-04-25T01:39:34.429399+0000","last_became_active":"2024-04-25T01:39:33.426090+0000","last_became_peered":"2024-04-25T01:39:33.426090+0000","last_unstale":"2024-04-25T01:39:34.429399+0000","last_undegraded":"2024-04-25T01:39:34.429399+0000","last_fullsized":"2024-04-25T01:39:34.429399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:34.329217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199243+0000","last_change":"2024-04-25T01:39:24.398726+0000","last_active":"2024-04-25T01:39:35.199243+0000","last_peered":"2024-04-25T01:39:35.199243+0000","last_clean":"2024-04-25T01:39:35.199243+0000","last_became_active":"2024-04-25T01:39:24.398449+0000","last_became_peered":"2024-04-25T01:39:24.398449+0000","last_unstale":"2024-04-25T01:39:35.199243+0000","last_undegraded":"2024-04-25T01:39:35.199243+0000","last_fullsized":"2024-04-25T01:39:35.199243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:41:38.230939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197750+0000","last_change":"2024-04-25T01:39:33.436488+0000","last_active":"2024-04-25T01:39:35.197750+0000","last_peered":"2024-04-25T01:39:35.197750+0000","last_clean":"2024-04-25T01:39:35.197750+0000","last_became_active":"2024-04-25T01:39:33.436224+0000","last_became_peered":"2024-04-25T01:39:33.436224+0000","last_unstale":"2024-04-25T01:39:35.197750+0000","last_undegraded":"2024-04-25T01:39:35.197750+0000","last_fullsized":"2024-04-25T01:39:35.197750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:38.227206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559398+0000","last_change":"2024-04-25T01:39:24.386909+0000","last_active":"2024-04-25T01:39:34.559398+0000","last_peered":"2024-04-25T01:39:34.559398+0000","last_clean":"2024-04-25T01:39:34.559398+0000","last_became_active":"2024-04-25T01:39:24.386568+0000","last_became_peered":"2024-04-25T01:39:24.386568+0000","last_unstale":"2024-04-25T01:39:34.559398+0000","last_undegraded":"2024-04-25T01:39:34.559398+0000","last_fullsized":"2024-04-25T01:39:34.559398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:29.904064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197979+0000","last_change":"2024-04-25T01:39:33.440753+0000","last_active":"2024-04-25T01:39:35.197979+0000","last_peered":"2024-04-25T01:39:35.197979+0000","last_clean":"2024-04-25T01:39:35.197979+0000","last_became_active":"2024-04-25T01:39:33.440480+0000","last_became_peered":"2024-04-25T01:39:33.440480+0000","last_unstale":"2024-04-25T01:39:35.197979+0000","last_undegraded":"2024-04-25T01:39:35.197979+0000","last_fullsized":"2024-04-25T01:39:35.197979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:18.113293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197980+0000","last_change":"2024-04-25T01:39:24.386803+0000","last_active":"2024-04-25T01:39:35.197980+0000","last_peered":"2024-04-25T01:39:35.197980+0000","last_clean":"2024-04-25T01:39:35.197980+0000","last_became_active":"2024-04-25T01:39:24.386531+0000","last_became_peered":"2024-04-25T01:39:24.386531+0000","last_unstale":"2024-04-25T01:39:35.197980+0000","last_undegraded":"2024-04-25T01:39:35.197980+0000","last_fullsized":"2024-04-25T01:39:35.197980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:19.160345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198690+0000","last_change":"2024-04-25T01:39:33.436433+0000","last_active":"2024-04-25T01:39:35.198690+0000","last_peered":"2024-04-25T01:39:35.198690+0000","last_clean":"2024-04-25T01:39:35.198690+0000","last_became_active":"2024-04-25T01:39:33.436134+0000","last_became_peered":"2024-04-25T01:39:33.436134+0000","last_unstale":"2024-04-25T01:39:35.198690+0000","last_undegraded":"2024-04-25T01:39:35.198690+0000","last_fullsized":"2024-04-25T01:39:35.198690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:08:30.641790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200300+0000","last_change":"2024-04-25T01:39:24.396231+0000","last_active":"2024-04-25T01:39:35.200300+0000","last_peered":"2024-04-25T01:39:35.200300+0000","last_clean":"2024-04-25T01:39:35.200300+0000","last_became_active":"2024-04-25T01:39:24.395958+0000","last_became_peered":"2024-04-25T01:39:24.395958+0000","last_unstale":"2024-04-25T01:39:35.200300+0000","last_undegraded":"2024-04-25T01:39:35.200300+0000","last_fullsized":"2024-04-25T01:39:35.200300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:54.898765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":690301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":101489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":99491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":102507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":101055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T01:39:38.733 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T01:39:38.734 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T01:39:38.734 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T01:39:38.734 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T01:39:38.734 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T01:39:38.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.879+0000 7fc136742640 1 Processor -- start 2024-04-25T01:39:38.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.879+0000 7fc136742640 1 -- start start 2024-04-25T01:39:38.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.880+0000 7fc136742640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc1300adb60 0x7fc130070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:38.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.880+0000 7fc136742640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc130072c30 con 0x7fc1300c3af0 2024-04-25T01:39:38.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.880+0000 7fc136742640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc130072f10 con 0x7fc1301596b0 2024-04-25T01:39:38.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.880+0000 7fc136742640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fc13006c870 con 0x7fc1300adb60 2024-04-25T01:39:38.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.880+0000 7fc12ffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc1300c3af0 0x7fc130156b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41398/0 (socket says 172.21.15.77:41398) 2024-04-25T01:39:38.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.880+0000 7fc12ffff640 1 -- 172.21.15.77:0/4186975778 learned_addr learned my addr 172.21.15.77:0/4186975778 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:38.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.880+0000 7fc12f7fe640 1 --2- 172.21.15.77:0/4186975778 >> v2:172.21.15.121:3300/0 conn(0x7fc1300adb60 0x7fc130070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:38.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.880+0000 7fc12effd640 1 -- 172.21.15.77:0/4186975778 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4128123652 0 0) 0x7fc130072c30 con 0x7fc1300c3af0 2024-04-25T01:39:38.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.880+0000 7fc12effd640 1 -- 172.21.15.77:0/4186975778 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc118003520 con 0x7fc1300c3af0 2024-04-25T01:39:38.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.880+0000 7fc12effd640 1 -- 172.21.15.77:0/4186975778 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 438965535 0 0) 0x7fc118003520 con 0x7fc1300c3af0 2024-04-25T01:39:38.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.880+0000 7fc12effd640 1 -- 172.21.15.77:0/4186975778 >> v2:172.21.15.121:3300/0 conn(0x7fc1300adb60 msgr2=0x7fc130070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:38.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.880+0000 7fc12effd640 1 --2- 172.21.15.77:0/4186975778 >> v2:172.21.15.121:3300/0 conn(0x7fc1300adb60 0x7fc130070e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.880+0000 7fc12effd640 1 -- 172.21.15.77:0/4186975778 >> v1:172.21.15.121:6789/0 conn(0x7fc1301596b0 legacy=0x7fc13014c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:38.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.880+0000 7fc12effd640 1 -- 172.21.15.77:0/4186975778 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc13006cac0 con 0x7fc1300c3af0 2024-04-25T01:39:38.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.880+0000 7fc12effd640 1 -- 172.21.15.77:0/4186975778 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7fc120001670 con 0x7fc1300c3af0 2024-04-25T01:39:38.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.880+0000 7fc12effd640 1 -- 172.21.15.77:0/4186975778 >> v1:172.21.15.77:6789/0 conn(0x7fc1300c3af0 legacy=0x7fc130156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:38.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.880+0000 7fc12effd640 1 --2- 172.21.15.77:0/4186975778 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1180039b0 0x7fc118003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:38.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.880+0000 7fc12effd640 1 --2- 172.21.15.77:0/4186975778 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc118004800 0x7fc118004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:38.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.880+0000 7fc12effd640 1 --2- 172.21.15.77:0/4186975778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1180052e0 0x7fc11800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:38.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.880+0000 7fc12effd640 1 -- 172.21.15.77:0/4186975778 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc13006c870 con 0x7fc1180052e0 2024-04-25T01:39:38.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.880+0000 7fc12effd640 1 -- 172.21.15.77:0/4186975778 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc11800c1b0 con 0x7fc1180039b0 2024-04-25T01:39:38.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.880+0000 7fc12effd640 1 -- 172.21.15.77:0/4186975778 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc11800c3b0 con 0x7fc118004800 2024-04-25T01:39:38.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.880+0000 7fc134cdf640 1 --2- 172.21.15.77:0/4186975778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1180052e0 0x7fc11800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:38.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.880+0000 7fc12ffff640 1 --2- 172.21.15.77:0/4186975778 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1180039b0 0x7fc118003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:38.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.880+0000 7fc12f7fe640 1 --2- 172.21.15.77:0/4186975778 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc118004800 0x7fc118004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:38.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.881+0000 7fc134cdf640 1 -- 172.21.15.77:0/4186975778 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc118004800 msgr2=0x7fc118004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:38.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.881+0000 7fc134cdf640 1 --2- 172.21.15.77:0/4186975778 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc118004800 0x7fc118004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.881+0000 7fc134cdf640 1 -- 172.21.15.77:0/4186975778 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1180039b0 msgr2=0x7fc118003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:38.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.881+0000 7fc134cdf640 1 --2- 172.21.15.77:0/4186975778 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1180039b0 0x7fc118003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.881+0000 7fc134cdf640 1 -- 172.21.15.77:0/4186975778 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc118003520 con 0x7fc1180052e0 2024-04-25T01:39:38.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.881+0000 7fc134cdf640 1 -- 172.21.15.77:0/4186975778 reap_dead start 2024-04-25T01:39:38.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.881+0000 7fc134cdf640 1 --2- 172.21.15.77:0/4186975778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1180052e0 0x7fc11800b9c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc128001e20 tx=0x7fc118005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8038dae42c5678 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:38.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.881+0000 7fc12effd640 1 -- 172.21.15.77:0/4186975778 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128001a70 con 0x7fc1180052e0 2024-04-25T01:39:38.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.881+0000 7fc12effd640 1 -- 172.21.15.77:0/4186975778 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc12802ae40 con 0x7fc1180052e0 2024-04-25T01:39:38.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.881+0000 7fc12effd640 1 -- 172.21.15.77:0/4186975778 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128003b90 con 0x7fc1180052e0 2024-04-25T01:39:38.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.882+0000 7fc136742640 1 -- 172.21.15.77:0/4186975778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1180052e0 msgr2=0x7fc11800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:38.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.882+0000 7fc136742640 1 --2- 172.21.15.77:0/4186975778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1180052e0 0x7fc11800b9c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc128001e20 tx=0x7fc118005830 comp rx=0 tx=0).stop 2024-04-25T01:39:38.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.882+0000 7fc136742640 1 -- 172.21.15.77:0/4186975778 shutdown_connections 2024-04-25T01:39:38.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.882+0000 7fc136742640 1 --2- 172.21.15.77:0/4186975778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1180052e0 0x7fc11800b9c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.882+0000 7fc136742640 1 -- 172.21.15.77:0/4186975778 >> 172.21.15.77:0/4186975778 conn(0x7fc1300c4970 msgr2=0x7fc1300c4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:38.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.882+0000 7fc136742640 1 -- 172.21.15.77:0/4186975778 shutdown_connections 2024-04-25T01:39:38.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.882+0000 7fc136742640 1 -- 172.21.15.77:0/4186975778 wait complete. 2024-04-25T01:39:38.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.883+0000 7fc136742640 1 Processor -- start 2024-04-25T01:39:38.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.883+0000 7fc136742640 1 -- start start 2024-04-25T01:39:38.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.884+0000 7fc136742640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1180052e0 0x7fc130154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:38.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.884+0000 7fc136742640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1300aa4d0 0x7fc130147400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:38.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.884+0000 7fc136742640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc130153880 0x7fc1300abc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:38.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.884+0000 7fc136742640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc1300c4050 con 0x7fc1300aa4d0 2024-04-25T01:39:38.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.884+0000 7fc136742640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc1300c3ed0 con 0x7fc130153880 2024-04-25T01:39:38.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.884+0000 7fc136742640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc130159ae0 con 0x7fc1180052e0 2024-04-25T01:39:38.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.884+0000 7fc12f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1300aa4d0 0x7fc130147400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:38.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.884+0000 7fc12f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1300aa4d0 0x7fc130147400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46606/0 (socket says 172.21.15.77:46606) 2024-04-25T01:39:38.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.884+0000 7fc12f7fe640 1 -- 172.21.15.77:0/3155196065 learned_addr learned my addr 172.21.15.77:0/3155196065 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:38.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.884+0000 7fc134cdf640 1 --2- 172.21.15.77:0/3155196065 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc130153880 0x7fc1300abc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:38.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.884+0000 7fc12ffff640 1 --2- 172.21.15.77:0/3155196065 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1180052e0 0x7fc130154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:38.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.884+0000 7fc12f7fe640 1 -- 172.21.15.77:0/3155196065 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1180052e0 msgr2=0x7fc130154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:38.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.884+0000 7fc12f7fe640 1 --2- 172.21.15.77:0/3155196065 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1180052e0 0x7fc130154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.884+0000 7fc12f7fe640 1 -- 172.21.15.77:0/3155196065 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc130153880 msgr2=0x7fc1300abc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:38.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.884+0000 7fc12f7fe640 1 --2- 172.21.15.77:0/3155196065 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc130153880 0x7fc1300abc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:38.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.884+0000 7fc12f7fe640 1 -- 172.21.15.77:0/3155196065 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc13013e5a0 con 0x7fc1300aa4d0 2024-04-25T01:39:38.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.884+0000 7fc12ffff640 1 --2- 172.21.15.77:0/3155196065 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1180052e0 0x7fc130154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:38.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.884+0000 7fc12f7fe640 1 --2- 172.21.15.77:0/3155196065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1300aa4d0 0x7fc130147400 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc1240118e0 tx=0x7fc124011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:38.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.884+0000 7fc12cff9640 1 -- 172.21.15.77:0/3155196065 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12400faf0 con 0x7fc1300aa4d0 2024-04-25T01:39:38.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.885+0000 7fc12cff9640 1 -- 172.21.15.77:0/3155196065 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc12400fc90 con 0x7fc1300aa4d0 2024-04-25T01:39:38.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.885+0000 7fc136742640 1 -- 172.21.15.77:0/3155196065 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc130153ff0 con 0x7fc1300aa4d0 2024-04-25T01:39:38.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.885+0000 7fc12cff9640 1 -- 172.21.15.77:0/3155196065 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc124014440 con 0x7fc1300aa4d0 2024-04-25T01:39:38.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.885+0000 7fc136742640 1 -- 172.21.15.77:0/3155196065 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc130147940 con 0x7fc1300aa4d0 2024-04-25T01:39:38.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.885+0000 7fc136742640 1 -- 172.21.15.77:0/3155196065 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc13004f500 con 0x7fc1300aa4d0 2024-04-25T01:39:38.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.886+0000 7fc12cff9640 1 -- 172.21.15.77:0/3155196065 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc124012040 con 0x7fc1300aa4d0 2024-04-25T01:39:38.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.886+0000 7fc12cff9640 1 --2- 172.21.15.77:0/3155196065 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc11c06be60 0x7fc11c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:38.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.886+0000 7fc12cff9640 1 -- 172.21.15.77:0/3155196065 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fc12408b7b0 con 0x7fc1300aa4d0 2024-04-25T01:39:38.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.886+0000 7fc12ffff640 1 --2- 172.21.15.77:0/3155196065 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc11c06be60 0x7fc11c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:38.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.887+0000 7fc12ffff640 1 --2- 172.21.15.77:0/3155196065 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc11c06be60 0x7fc11c06e320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc1301481c0 tx=0x7fc120009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:38.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:38.891+0000 7fc12cff9640 1 -- 172.21.15.77:0/3155196065 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc124019030 con 0x7fc1300aa4d0 2024-04-25T01:39:39.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.107+0000 7fc136742640 1 -- 172.21.15.77:0/3155196065 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc1300671b0 con 0x7fc1300aa4d0 2024-04-25T01:39:39.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.110+0000 7fc12cff9640 1 -- 172.21.15.77:0/3155196065 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172937 (secure 0 0 0) 0x7fc124059870 con 0x7fc1300aa4d0 2024-04-25T01:39:39.096 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:39.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.113+0000 7fc136742640 1 -- 172.21.15.77:0/3155196065 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc11c06be60 msgr2=0x7fc11c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.113+0000 7fc136742640 1 --2- 172.21.15.77:0/3155196065 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc11c06be60 0x7fc11c06e320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc1301481c0 tx=0x7fc120009040 comp rx=0 tx=0).stop 2024-04-25T01:39:39.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.113+0000 7fc136742640 1 -- 172.21.15.77:0/3155196065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1300aa4d0 msgr2=0x7fc130147400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.113+0000 7fc136742640 1 --2- 172.21.15.77:0/3155196065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1300aa4d0 0x7fc130147400 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc1240118e0 tx=0x7fc124011da0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.113+0000 7fc136742640 1 -- 172.21.15.77:0/3155196065 shutdown_connections 2024-04-25T01:39:39.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.113+0000 7fc136742640 1 --2- 172.21.15.77:0/3155196065 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc11c06be60 0x7fc11c06e320 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.113+0000 7fc136742640 1 --2- 172.21.15.77:0/3155196065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1300aa4d0 0x7fc130147400 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.113+0000 7fc136742640 1 --2- 172.21.15.77:0/3155196065 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc130153880 0x7fc1300abc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.113+0000 7fc136742640 1 --2- 172.21.15.77:0/3155196065 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1180052e0 0x7fc130154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.113+0000 7fc136742640 1 -- 172.21.15.77:0/3155196065 >> 172.21.15.77:0/3155196065 conn(0x7fc1300c4970 msgr2=0x7fc130148a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:39.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.113+0000 7fc136742640 1 -- 172.21.15.77:0/3155196065 shutdown_connections 2024-04-25T01:39:39.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.113+0000 7fc136742640 1 -- 172.21.15.77:0/3155196065 wait complete. 2024-04-25T01:39:39.107 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":5,"flags":0,"active_gid":4098,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4208232183},{"type":"v1","addr":"172.21.15.77:6833","nonce":4208232183}]},"active_addr":"172.21.15.77:6833/4208232183","active_change":"2024-04-25T01:39:03.643546+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4101,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":3382941325}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":89878990}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":1591352048}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":2807260176}]}]} 2024-04-25T01:39:39.111 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T01:39:39.111 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T01:39:39.111 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T01:39:39.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.224+0000 7f84c5eda640 1 Processor -- start 2024-04-25T01:39:39.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.224+0000 7f84c5eda640 1 -- start start 2024-04-25T01:39:39.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.225+0000 7f84c5eda640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f84c0150320 0x7f84c0156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.225+0000 7f84c5eda640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f84c006d0a0 0x7f84c006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.225+0000 7f84c5eda640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84c0153be0 con 0x7f84c0154380 2024-04-25T01:39:39.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.225+0000 7f84c5eda640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f84c0152fd0 con 0x7f84c0150320 2024-04-25T01:39:39.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.225+0000 7f84c5eda640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f84c01532b0 con 0x7f84c006d0a0 2024-04-25T01:39:39.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.225+0000 7f84bf7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f84c0150320 0x7f84c0156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.225+0000 7f84bf7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f84c0150320 0x7f84c0156bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46610/0 (socket says 172.21.15.77:46610) 2024-04-25T01:39:39.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.225+0000 7f84bf7fe640 1 -- 172.21.15.77:0/3420524410 learned_addr learned my addr 172.21.15.77:0/3420524410 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:39.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.225+0000 7f84beffd640 1 --2- 172.21.15.77:0/3420524410 >> v2:172.21.15.121:3300/0 conn(0x7f84c006d0a0 0x7f84c006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.225+0000 7f84bf7fe640 1 -- 172.21.15.77:0/3420524410 >> v2:172.21.15.121:3300/0 conn(0x7f84c006d0a0 msgr2=0x7f84c006d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:39.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.225+0000 7f84bf7fe640 1 --2- 172.21.15.77:0/3420524410 >> v2:172.21.15.121:3300/0 conn(0x7f84c006d0a0 0x7f84c006d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.225+0000 7f84bf7fe640 1 -- 172.21.15.77:0/3420524410 >> v1:172.21.15.121:6789/0 conn(0x7f84c0154380 legacy=0x7f84c0154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.225+0000 7f84bf7fe640 1 -- 172.21.15.77:0/3420524410 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c0157100 con 0x7f84c0150320 2024-04-25T01:39:39.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.226+0000 7f84bf7fe640 1 --2- 172.21.15.77:0/3420524410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c0150320 0x7f84c0156bc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f84c006e450 tx=0x7f84b002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a0f51db5f525eed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.226+0000 7f84be7fc640 1 -- 172.21.15.77:0/3420524410 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b0037070 con 0x7f84c0150320 2024-04-25T01:39:39.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.226+0000 7f84be7fc640 1 -- 172.21.15.77:0/3420524410 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b0032440 con 0x7f84c0150320 2024-04-25T01:39:39.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.226+0000 7f84be7fc640 1 -- 172.21.15.77:0/3420524410 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b0032810 con 0x7f84c0150320 2024-04-25T01:39:39.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.227+0000 7f84c5eda640 1 -- 172.21.15.77:0/3420524410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c0150320 msgr2=0x7f84c0156bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.227+0000 7f84c5eda640 1 --2- 172.21.15.77:0/3420524410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c0150320 0x7f84c0156bc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f84c006e450 tx=0x7f84b002a1e0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.227+0000 7f84c5eda640 1 -- 172.21.15.77:0/3420524410 shutdown_connections 2024-04-25T01:39:39.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.227+0000 7f84c5eda640 1 --2- 172.21.15.77:0/3420524410 >> v2:172.21.15.121:3300/0 conn(0x7f84c006d0a0 0x7f84c006d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.227+0000 7f84c5eda640 1 --2- 172.21.15.77:0/3420524410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c0150320 0x7f84c0156bc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.227+0000 7f84c5eda640 1 -- 172.21.15.77:0/3420524410 >> 172.21.15.77:0/3420524410 conn(0x7f84c00c3f80 msgr2=0x7f84c00c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:39.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.227+0000 7f84c5eda640 1 -- 172.21.15.77:0/3420524410 shutdown_connections 2024-04-25T01:39:39.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.227+0000 7f84c5eda640 1 -- 172.21.15.77:0/3420524410 wait complete. 2024-04-25T01:39:39.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.228+0000 7f84c5eda640 1 Processor -- start 2024-04-25T01:39:39.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.228+0000 7f84c5eda640 1 -- start start 2024-04-25T01:39:39.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.229+0000 7f84c5eda640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c006d0a0 0x7f84c01eda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.229+0000 7f84c5eda640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84c0150320 0x7f84c013fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.229+0000 7f84c5eda640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f84c0154380 0x7f84c01e9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.229+0000 7f84c5eda640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f84c0154f40 con 0x7f84c006d0a0 2024-04-25T01:39:39.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.229+0000 7f84c5eda640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f84c0153870 con 0x7f84c0150320 2024-04-25T01:39:39.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.229+0000 7f84c5eda640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f84c0152bf0 con 0x7f84c0154380 2024-04-25T01:39:39.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.229+0000 7f84bf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c006d0a0 0x7f84c01eda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.229+0000 7f84bf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c006d0a0 0x7f84c01eda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46626/0 (socket says 172.21.15.77:46626) 2024-04-25T01:39:39.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.229+0000 7f84bf7fe640 1 -- 172.21.15.77:0/3904744475 learned_addr learned my addr 172.21.15.77:0/3904744475 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:39.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.229+0000 7f84bf7fe640 1 -- 172.21.15.77:0/3904744475 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f84c0154380 msgr2=0x7f84c01e9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.229+0000 7f84bf7fe640 1 --2- 172.21.15.77:0/3904744475 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f84c0154380 0x7f84c01e9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.229+0000 7f84bf7fe640 1 -- 172.21.15.77:0/3904744475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84c0150320 msgr2=0x7f84c013fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.229+0000 7f84bf7fe640 1 --2- 172.21.15.77:0/3904744475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84c0150320 0x7f84c013fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.229+0000 7f84bf7fe640 1 -- 172.21.15.77:0/3904744475 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c0141f80 con 0x7f84c006d0a0 2024-04-25T01:39:39.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.229+0000 7f84bf7fe640 1 --2- 172.21.15.77:0/3904744475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c006d0a0 0x7f84c01eda30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f84b002a220 tx=0x7f84b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.229+0000 7f84a7fff640 1 -- 172.21.15.77:0/3904744475 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b0037040 con 0x7f84c006d0a0 2024-04-25T01:39:39.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.229+0000 7f84a7fff640 1 -- 172.21.15.77:0/3904744475 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b0042070 con 0x7f84c006d0a0 2024-04-25T01:39:39.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.229+0000 7f84c5eda640 1 -- 172.21.15.77:0/3904744475 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c0142260 con 0x7f84c006d0a0 2024-04-25T01:39:39.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.229+0000 7f84a7fff640 1 -- 172.21.15.77:0/3904744475 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b0030880 con 0x7f84c006d0a0 2024-04-25T01:39:39.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.229+0000 7f84c5eda640 1 -- 172.21.15.77:0/3904744475 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c01ed230 con 0x7f84c006d0a0 2024-04-25T01:39:39.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.230+0000 7f84c5eda640 1 -- 172.21.15.77:0/3904744475 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84c004f500 con 0x7f84c006d0a0 2024-04-25T01:39:39.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.231+0000 7f84a7fff640 1 -- 172.21.15.77:0/3904744475 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f84b0030a20 con 0x7f84c006d0a0 2024-04-25T01:39:39.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.231+0000 7f84a7fff640 1 --2- 172.21.15.77:0/3904744475 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f84ac06be60 0x7f84ac06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.231+0000 7f84a7fff640 1 -- 172.21.15.77:0/3904744475 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f84b00ab9c0 con 0x7f84c006d0a0 2024-04-25T01:39:39.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.231+0000 7f84beffd640 1 --2- 172.21.15.77:0/3904744475 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f84ac06be60 0x7f84ac06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.232+0000 7f84beffd640 1 --2- 172.21.15.77:0/3904744475 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f84ac06be60 0x7f84ac06e320 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f84c0152b60 tx=0x7f84b4006dd0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.235+0000 7f84a7fff640 1 -- 172.21.15.77:0/3904744475 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f84b00ade20 con 0x7f84c006d0a0 2024-04-25T01:39:39.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.410+0000 7f84c5eda640 1 -- 172.21.15.77:0/3904744475 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f84c0073750 con 0x7f84c006d0a0 2024-04-25T01:39:39.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.412+0000 7f84a7fff640 1 -- 172.21.15.77:0/3904744475 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20331 (secure 0 0 0) 0x7f84b007a0d0 con 0x7f84c006d0a0 2024-04-25T01:39:39.396 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:39.396 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:39:34.425701+0000","last_up_change":"2024-04-25T01:39:10.729600+0000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T01:39:11.681151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T01:39:21.606752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T01:39:22.677664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T01:39:30.501700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T01:39:31.740717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6811","nonce":3366980158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6817","nonce":3366980158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6828","nonce":3366980158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6825","nonce":3366980158}]},"public_addr":"172.21.15.77:6811/3366980158","cluster_addr":"172.21.15.77:6817/3366980158","heartbeat_back_addr":"172.21.15.77:6828/3366980158","heartbeat_front_addr":"172.21.15.77:6825/3366980158","state":["exists","up"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6801","nonce":3971619298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6803","nonce":3971619298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6807","nonce":3971619298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6805","nonce":3971619298}]},"public_addr":"172.21.15.77:6801/3971619298","cluster_addr":"172.21.15.77:6803/3971619298","heartbeat_back_addr":"172.21.15.77:6807/3971619298","heartbeat_front_addr":"172.21.15.77:6805/3971619298","state":["exists","up"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6810","nonce":4103452689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6813","nonce":4103452689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6823","nonce":4103452689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6818","nonce":4103452689}]},"public_addr":"172.21.15.77:6810/4103452689","cluster_addr":"172.21.15.77:6813/4103452689","heartbeat_back_addr":"172.21.15.77:6823/4103452689","heartbeat_front_addr":"172.21.15.77:6818/4103452689","state":["exists","up"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6819","nonce":217398906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6824","nonce":217398906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6831","nonce":217398906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6829","nonce":217398906}]},"public_addr":"172.21.15.77:6819/217398906","cluster_addr":"172.21.15.77:6824/217398906","heartbeat_back_addr":"172.21.15.77:6831/217398906","heartbeat_front_addr":"172.21.15.77:6829/217398906","state":["exists","up"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6801","nonce":2565483070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6803","nonce":2565483070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6810","nonce":2565483070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6806","nonce":2565483070}]},"public_addr":"172.21.15.121:6801/2565483070","cluster_addr":"172.21.15.121:6803/2565483070","heartbeat_back_addr":"172.21.15.121:6810/2565483070","heartbeat_front_addr":"172.21.15.121:6806/2565483070","state":["exists","up"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6807","nonce":2785294752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6809","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6811","nonce":2785294752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6815","nonce":2785294752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6813","nonce":2785294752}]},"public_addr":"172.21.15.121:6807/2785294752","cluster_addr":"172.21.15.121:6811/2785294752","heartbeat_back_addr":"172.21.15.121:6815/2785294752","heartbeat_front_addr":"172.21.15.121:6813/2785294752","state":["exists","up"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6820","nonce":523906818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6824","nonce":523906818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6831","nonce":523906818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6828","nonce":523906818}]},"public_addr":"172.21.15.121:6820/523906818","cluster_addr":"172.21.15.121:6824/523906818","heartbeat_back_addr":"172.21.15.121:6831/523906818","heartbeat_front_addr":"172.21.15.121:6828/523906818","state":["exists","up"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6817","nonce":1683602459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6819","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6821","nonce":1683602459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6829","nonce":1683602459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6823","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6825","nonce":1683602459}]},"public_addr":"172.21.15.121:6817/1683602459","cluster_addr":"172.21.15.121:6821/1683602459","heartbeat_back_addr":"172.21.15.121:6829/1683602459","heartbeat_front_addr":"172.21.15.121:6825/1683602459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.839443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.818842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.776243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.793085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.822396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.907311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.918374+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.848430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:39:39.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.414+0000 7f84c5eda640 1 -- 172.21.15.77:0/3904744475 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f84ac06be60 msgr2=0x7f84ac06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.414+0000 7f84c5eda640 1 --2- 172.21.15.77:0/3904744475 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f84ac06be60 0x7f84ac06e320 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f84c0152b60 tx=0x7f84b4006dd0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.414+0000 7f84c5eda640 1 -- 172.21.15.77:0/3904744475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c006d0a0 msgr2=0x7f84c01eda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.414+0000 7f84c5eda640 1 --2- 172.21.15.77:0/3904744475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c006d0a0 0x7f84c01eda30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f84b002a220 tx=0x7f84b00046c0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.414+0000 7f84c5eda640 1 -- 172.21.15.77:0/3904744475 shutdown_connections 2024-04-25T01:39:39.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.414+0000 7f84c5eda640 1 --2- 172.21.15.77:0/3904744475 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f84ac06be60 0x7f84ac06e320 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.414+0000 7f84c5eda640 1 --2- 172.21.15.77:0/3904744475 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f84c0154380 0x7f84c01e9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.414+0000 7f84c5eda640 1 --2- 172.21.15.77:0/3904744475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84c0150320 0x7f84c013fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.414+0000 7f84c5eda640 1 --2- 172.21.15.77:0/3904744475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c006d0a0 0x7f84c01eda30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.414+0000 7f84c5eda640 1 -- 172.21.15.77:0/3904744475 >> 172.21.15.77:0/3904744475 conn(0x7f84c00c3f80 msgr2=0x7f84c0150700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:39.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.414+0000 7f84c5eda640 1 -- 172.21.15.77:0/3904744475 shutdown_connections 2024-04-25T01:39:39.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.414+0000 7f84c5eda640 1 -- 172.21.15.77:0/3904744475 wait complete. 2024-04-25T01:39:39.408 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T01:39:39.409 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T01:39:39.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.522+0000 7fd126bd5640 1 Processor -- start 2024-04-25T01:39:39.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.522+0000 7fd126bd5640 1 -- start start 2024-04-25T01:39:39.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.522+0000 7fd126bd5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd120156b70 0x7fd1200c36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.522+0000 7fd126bd5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd120159620 con 0x7fd12015a190 2024-04-25T01:39:39.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.522+0000 7fd126bd5640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd120072460 con 0x7fd1200c2eb0 2024-04-25T01:39:39.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.522+0000 7fd126bd5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd120156f70 con 0x7fd120156b70 2024-04-25T01:39:39.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.523+0000 7fd124971640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd12015a190 0x7fd12006fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41404/0 (socket says 172.21.15.77:41404) 2024-04-25T01:39:39.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.523+0000 7fd124971640 1 -- 172.21.15.77:0/1661012963 learned_addr learned my addr 172.21.15.77:0/1661012963 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:39.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.523+0000 7fd125172640 1 --2- 172.21.15.77:0/1661012963 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd120156b70 0x7fd1200c36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.523+0000 7fd11f7fe640 1 -- 172.21.15.77:0/1661012963 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3937204098 0 0) 0x7fd120159620 con 0x7fd12015a190 2024-04-25T01:39:39.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.523+0000 7fd11f7fe640 1 -- 172.21.15.77:0/1661012963 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd110003520 con 0x7fd12015a190 2024-04-25T01:39:39.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.523+0000 7fd11f7fe640 1 -- 172.21.15.77:0/1661012963 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1306007364 0 0) 0x7fd120072460 con 0x7fd1200c2eb0 2024-04-25T01:39:39.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.523+0000 7fd11f7fe640 1 -- 172.21.15.77:0/1661012963 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd120159620 con 0x7fd1200c2eb0 2024-04-25T01:39:39.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.523+0000 7fd11f7fe640 1 -- 172.21.15.77:0/1661012963 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3315958404 0 0) 0x7fd110003520 con 0x7fd12015a190 2024-04-25T01:39:39.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.523+0000 7fd11f7fe640 1 -- 172.21.15.77:0/1661012963 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd120156b70 msgr2=0x7fd1200c36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:39.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.523+0000 7fd11f7fe640 1 --2- 172.21.15.77:0/1661012963 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd120156b70 0x7fd1200c36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.523+0000 7fd11f7fe640 1 -- 172.21.15.77:0/1661012963 >> v1:172.21.15.121:6789/0 conn(0x7fd1200c2eb0 legacy=0x7fd120156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.523+0000 7fd11f7fe640 1 -- 172.21.15.77:0/1661012963 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd120072740 con 0x7fd12015a190 2024-04-25T01:39:39.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.523+0000 7fd11f7fe640 1 -- 172.21.15.77:0/1661012963 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7fd114001670 con 0x7fd12015a190 2024-04-25T01:39:39.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.523+0000 7fd11f7fe640 1 -- 172.21.15.77:0/1661012963 >> v1:172.21.15.77:6789/0 conn(0x7fd12015a190 legacy=0x7fd12006fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.523+0000 7fd11f7fe640 1 --2- 172.21.15.77:0/1661012963 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd110003b70 0x7fd110003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.523+0000 7fd11f7fe640 1 --2- 172.21.15.77:0/1661012963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd110004800 0x7fd110004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.523+0000 7fd11f7fe640 1 --2- 172.21.15.77:0/1661012963 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd120156b70 0x7fd1100051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.523+0000 7fd11f7fe640 1 -- 172.21.15.77:0/1661012963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd120156f70 con 0x7fd110004800 2024-04-25T01:39:39.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.523+0000 7fd11f7fe640 1 -- 172.21.15.77:0/1661012963 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd11000bb00 con 0x7fd110003b70 2024-04-25T01:39:39.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.523+0000 7fd11f7fe640 1 -- 172.21.15.77:0/1661012963 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd11000bd00 con 0x7fd120156b70 2024-04-25T01:39:39.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.523+0000 7fd11ffff640 1 --2- 172.21.15.77:0/1661012963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd110004800 0x7fd110004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.523+0000 7fd124971640 1 --2- 172.21.15.77:0/1661012963 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd110003b70 0x7fd110003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.523+0000 7fd125172640 1 --2- 172.21.15.77:0/1661012963 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd120156b70 0x7fd1100051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.524+0000 7fd11ffff640 1 -- 172.21.15.77:0/1661012963 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd120156b70 msgr2=0x7fd1100051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:39.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.524+0000 7fd11ffff640 1 --2- 172.21.15.77:0/1661012963 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd120156b70 0x7fd1100051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.524+0000 7fd11ffff640 1 -- 172.21.15.77:0/1661012963 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd110003b70 msgr2=0x7fd110003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:39.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.524+0000 7fd11ffff640 1 --2- 172.21.15.77:0/1661012963 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd110003b70 0x7fd110003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.524+0000 7fd11ffff640 1 -- 172.21.15.77:0/1661012963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd110003520 con 0x7fd110004800 2024-04-25T01:39:39.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.524+0000 7fd11ffff640 1 --2- 172.21.15.77:0/1661012963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd110004800 0x7fd110004c80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd10c0018d0 tx=0x7fd110005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a57df2e349bbc07 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.524+0000 7fd11f7fe640 1 -- 172.21.15.77:0/1661012963 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10c0014f0 con 0x7fd110004800 2024-04-25T01:39:39.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.524+0000 7fd11f7fe640 1 -- 172.21.15.77:0/1661012963 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd10c0052d0 con 0x7fd110004800 2024-04-25T01:39:39.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.524+0000 7fd11f7fe640 1 -- 172.21.15.77:0/1661012963 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10c02aca0 con 0x7fd110004800 2024-04-25T01:39:39.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.525+0000 7fd126bd5640 1 -- 172.21.15.77:0/1661012963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd110004800 msgr2=0x7fd110004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.525+0000 7fd126bd5640 1 --2- 172.21.15.77:0/1661012963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd110004800 0x7fd110004c80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd10c0018d0 tx=0x7fd110005830 comp rx=0 tx=0).stop 2024-04-25T01:39:39.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.525+0000 7fd125172640 1 -- 172.21.15.77:0/1661012963 reap_dead start 2024-04-25T01:39:39.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.525+0000 7fd126bd5640 1 -- 172.21.15.77:0/1661012963 shutdown_connections 2024-04-25T01:39:39.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.525+0000 7fd126bd5640 1 -- 172.21.15.77:0/1661012963 >> 172.21.15.77:0/1661012963 conn(0x7fd1200aa8f0 msgr2=0x7fd120066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:39.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.525+0000 7fd126bd5640 1 -- 172.21.15.77:0/1661012963 shutdown_connections 2024-04-25T01:39:39.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.525+0000 7fd126bd5640 1 -- 172.21.15.77:0/1661012963 wait complete. 2024-04-25T01:39:39.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.526+0000 7fd126bd5640 1 Processor -- start 2024-04-25T01:39:39.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.526+0000 7fd126bd5640 1 -- start start 2024-04-25T01:39:39.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.527+0000 7fd126bd5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd110004800 0x7fd1201ec3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.527+0000 7fd126bd5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd12014b390 0x7fd120154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.527+0000 7fd126bd5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd120154870 0x7fd1201e8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.527+0000 7fd126bd5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd120072d00 con 0x7fd110004800 2024-04-25T01:39:39.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.527+0000 7fd126bd5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd120072fe0 con 0x7fd120154870 2024-04-25T01:39:39.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.527+0000 7fd126bd5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd1200703b0 con 0x7fd12014b390 2024-04-25T01:39:39.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.527+0000 7fd124971640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd110004800 0x7fd1201ec3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.527+0000 7fd124971640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd110004800 0x7fd1201ec3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46640/0 (socket says 172.21.15.77:46640) 2024-04-25T01:39:39.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.527+0000 7fd124971640 1 -- 172.21.15.77:0/3267801351 learned_addr learned my addr 172.21.15.77:0/3267801351 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:39.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.527+0000 7fd11ffff640 1 --2- 172.21.15.77:0/3267801351 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd12014b390 0x7fd120154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.527+0000 7fd125172640 1 --2- 172.21.15.77:0/3267801351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd120154870 0x7fd1201e8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.527+0000 7fd124971640 1 -- 172.21.15.77:0/3267801351 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd12014b390 msgr2=0x7fd120154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.527+0000 7fd124971640 1 --2- 172.21.15.77:0/3267801351 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd12014b390 0x7fd120154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.527+0000 7fd124971640 1 -- 172.21.15.77:0/3267801351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd120154870 msgr2=0x7fd1201e8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.527+0000 7fd124971640 1 --2- 172.21.15.77:0/3267801351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd120154870 0x7fd1201e8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.527+0000 7fd124971640 1 -- 172.21.15.77:0/3267801351 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd120155400 con 0x7fd110004800 2024-04-25T01:39:39.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.527+0000 7fd124971640 1 --2- 172.21.15.77:0/3267801351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd110004800 0x7fd1201ec3a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd1140017e0 tx=0x7fd114007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.527+0000 7fd11d7fa640 1 -- 172.21.15.77:0/3267801351 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd11400f750 con 0x7fd110004800 2024-04-25T01:39:39.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.527+0000 7fd11d7fa640 1 -- 172.21.15.77:0/3267801351 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd114018070 con 0x7fd110004800 2024-04-25T01:39:39.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.527+0000 7fd126bd5640 1 -- 172.21.15.77:0/3267801351 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1201556e0 con 0x7fd110004800 2024-04-25T01:39:39.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.527+0000 7fd11d7fa640 1 -- 172.21.15.77:0/3267801351 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd11400fb50 con 0x7fd110004800 2024-04-25T01:39:39.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.528+0000 7fd126bd5640 1 -- 172.21.15.77:0/3267801351 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd120155ca0 con 0x7fd110004800 2024-04-25T01:39:39.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.528+0000 7fd126bd5640 1 -- 172.21.15.77:0/3267801351 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd12004f500 con 0x7fd110004800 2024-04-25T01:39:39.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.529+0000 7fd11d7fa640 1 -- 172.21.15.77:0/3267801351 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd11400fcf0 con 0x7fd110004800 2024-04-25T01:39:39.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.529+0000 7fd11d7fa640 1 --2- 172.21.15.77:0/3267801351 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd10406be30 0x7fd10406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.529+0000 7fd11ffff640 1 --2- 172.21.15.77:0/3267801351 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd10406be30 0x7fd10406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.529+0000 7fd11d7fa640 1 -- 172.21.15.77:0/3267801351 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fd11408b050 con 0x7fd110004800 2024-04-25T01:39:39.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.530+0000 7fd11ffff640 1 --2- 172.21.15.77:0/3267801351 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd10406be30 0x7fd10406e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd10c032000 tx=0x7fd10c009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.534+0000 7fd11d7fa640 1 -- 172.21.15.77:0/3267801351 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd114059080 con 0x7fd110004800 2024-04-25T01:39:39.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.709+0000 7fd126bd5640 1 -- 172.21.15.77:0/3267801351 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd1200c2c90 con 0x7fd110004800 2024-04-25T01:39:39.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.710+0000 7fd11d7fa640 1 -- 172.21.15.77:0/3267801351 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20331 (secure 0 0 0) 0x7fd11405d380 con 0x7fd110004800 2024-04-25T01:39:39.694 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:39.694 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:39:34.425701+0000","last_up_change":"2024-04-25T01:39:10.729600+0000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T01:39:11.681151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T01:39:21.606752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T01:39:22.677664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T01:39:30.501700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T01:39:31.740717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6811","nonce":3366980158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6817","nonce":3366980158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6828","nonce":3366980158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6825","nonce":3366980158}]},"public_addr":"172.21.15.77:6811/3366980158","cluster_addr":"172.21.15.77:6817/3366980158","heartbeat_back_addr":"172.21.15.77:6828/3366980158","heartbeat_front_addr":"172.21.15.77:6825/3366980158","state":["exists","up"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6801","nonce":3971619298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6803","nonce":3971619298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6807","nonce":3971619298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6805","nonce":3971619298}]},"public_addr":"172.21.15.77:6801/3971619298","cluster_addr":"172.21.15.77:6803/3971619298","heartbeat_back_addr":"172.21.15.77:6807/3971619298","heartbeat_front_addr":"172.21.15.77:6805/3971619298","state":["exists","up"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6810","nonce":4103452689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6813","nonce":4103452689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6823","nonce":4103452689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6818","nonce":4103452689}]},"public_addr":"172.21.15.77:6810/4103452689","cluster_addr":"172.21.15.77:6813/4103452689","heartbeat_back_addr":"172.21.15.77:6823/4103452689","heartbeat_front_addr":"172.21.15.77:6818/4103452689","state":["exists","up"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6819","nonce":217398906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6824","nonce":217398906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6831","nonce":217398906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6829","nonce":217398906}]},"public_addr":"172.21.15.77:6819/217398906","cluster_addr":"172.21.15.77:6824/217398906","heartbeat_back_addr":"172.21.15.77:6831/217398906","heartbeat_front_addr":"172.21.15.77:6829/217398906","state":["exists","up"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6801","nonce":2565483070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6803","nonce":2565483070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6810","nonce":2565483070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6806","nonce":2565483070}]},"public_addr":"172.21.15.121:6801/2565483070","cluster_addr":"172.21.15.121:6803/2565483070","heartbeat_back_addr":"172.21.15.121:6810/2565483070","heartbeat_front_addr":"172.21.15.121:6806/2565483070","state":["exists","up"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6807","nonce":2785294752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6809","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6811","nonce":2785294752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6815","nonce":2785294752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6813","nonce":2785294752}]},"public_addr":"172.21.15.121:6807/2785294752","cluster_addr":"172.21.15.121:6811/2785294752","heartbeat_back_addr":"172.21.15.121:6815/2785294752","heartbeat_front_addr":"172.21.15.121:6813/2785294752","state":["exists","up"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6820","nonce":523906818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6824","nonce":523906818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6831","nonce":523906818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6828","nonce":523906818}]},"public_addr":"172.21.15.121:6820/523906818","cluster_addr":"172.21.15.121:6824/523906818","heartbeat_back_addr":"172.21.15.121:6831/523906818","heartbeat_front_addr":"172.21.15.121:6828/523906818","state":["exists","up"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6817","nonce":1683602459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6819","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6821","nonce":1683602459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6829","nonce":1683602459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6823","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6825","nonce":1683602459}]},"public_addr":"172.21.15.121:6817/1683602459","cluster_addr":"172.21.15.121:6821/1683602459","heartbeat_back_addr":"172.21.15.121:6829/1683602459","heartbeat_front_addr":"172.21.15.121:6825/1683602459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.839443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.818842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.776243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.793085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.822396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.907311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.918374+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.848430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:39:39.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.712+0000 7fd126bd5640 1 -- 172.21.15.77:0/3267801351 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd10406be30 msgr2=0x7fd10406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.712+0000 7fd126bd5640 1 --2- 172.21.15.77:0/3267801351 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd10406be30 0x7fd10406e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd10c032000 tx=0x7fd10c009030 comp rx=0 tx=0).stop 2024-04-25T01:39:39.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.712+0000 7fd126bd5640 1 -- 172.21.15.77:0/3267801351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd110004800 msgr2=0x7fd1201ec3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.712+0000 7fd126bd5640 1 --2- 172.21.15.77:0/3267801351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd110004800 0x7fd1201ec3a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd1140017e0 tx=0x7fd114007430 comp rx=0 tx=0).stop 2024-04-25T01:39:39.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.712+0000 7fd126bd5640 1 -- 172.21.15.77:0/3267801351 shutdown_connections 2024-04-25T01:39:39.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.712+0000 7fd126bd5640 1 --2- 172.21.15.77:0/3267801351 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd10406be30 0x7fd10406e2f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.712+0000 7fd126bd5640 1 --2- 172.21.15.77:0/3267801351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd120154870 0x7fd1201e8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.712+0000 7fd126bd5640 1 --2- 172.21.15.77:0/3267801351 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd12014b390 0x7fd120154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.712+0000 7fd126bd5640 1 --2- 172.21.15.77:0/3267801351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd110004800 0x7fd1201ec3a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.712+0000 7fd126bd5640 1 -- 172.21.15.77:0/3267801351 >> 172.21.15.77:0/3267801351 conn(0x7fd1200aa8f0 msgr2=0x7fd1200c53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:39.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.712+0000 7fd126bd5640 1 -- 172.21.15.77:0/3267801351 shutdown_connections 2024-04-25T01:39:39.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.712+0000 7fd126bd5640 1 -- 172.21.15.77:0/3267801351 wait complete. 2024-04-25T01:39:39.707 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T01:39:39.707 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T01:39:39.708 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T01:39:39.709 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T01:39:39.709 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T01:39:39.709 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T01:39:39.710 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-25T01:39:39.710 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-25T01:39:39.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.890+0000 7f8415714640 1 Processor -- start 2024-04-25T01:39:39.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.890+0000 7f8415714640 1 -- start start 2024-04-25T01:39:39.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.892+0000 7f8415714640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f84100c5690 0x7f8410166290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.892+0000 7f8415714640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8410166a00 con 0x7f84100c1f80 2024-04-25T01:39:39.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.892+0000 7f8415714640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8410166ce0 con 0x7f841006e330 2024-04-25T01:39:39.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.892+0000 7f8415714640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f84101667d0 con 0x7f84100c5690 2024-04-25T01:39:39.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.892+0000 7f840effd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f84100c1f80 0x7f8410163500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41420/0 (socket says 172.21.15.77:41420) 2024-04-25T01:39:39.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.892+0000 7f840effd640 1 -- 172.21.15.77:0/2968585209 learned_addr learned my addr 172.21.15.77:0/2968585209 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:39.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.892+0000 7f840e7fc640 1 --2- 172.21.15.77:0/2968585209 >> v2:172.21.15.121:3300/0 conn(0x7f84100c5690 0x7f8410166290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.893+0000 7f840e7fc640 1 -- 172.21.15.77:0/2968585209 >> v1:172.21.15.121:6789/0 conn(0x7f841006e330 legacy=0x7f84100c4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.893+0000 7f840e7fc640 1 -- 172.21.15.77:0/2968585209 >> v1:172.21.15.77:6789/0 conn(0x7f84100c1f80 legacy=0x7f8410163500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.893+0000 7f840e7fc640 1 -- 172.21.15.77:0/2968585209 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8410166fc0 con 0x7f84100c5690 2024-04-25T01:39:39.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.893+0000 7f2fe3bc8640 1 Processor -- start 2024-04-25T01:39:39.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.893+0000 7f954e59e640 1 Processor -- start 2024-04-25T01:39:39.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.893+0000 7f954e59e640 1 -- start start 2024-04-25T01:39:39.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.893+0000 7f2fe3bc8640 1 -- start start 2024-04-25T01:39:39.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.893+0000 7f5ace0e1640 1 Processor -- start 2024-04-25T01:39:39.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.893+0000 7f5ace0e1640 1 -- start start 2024-04-25T01:39:39.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.894+0000 7ff6e359e640 1 Processor -- start 2024-04-25T01:39:39.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.894+0000 7fd63ca15640 1 Processor -- start 2024-04-25T01:39:39.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.894+0000 7f2fe3bc8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2fdc14fa20 0x7f2fdc0c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.894+0000 7fd63ca15640 1 -- start start 2024-04-25T01:39:39.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.894+0000 7f954e59e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95480c5720 0x7f954806f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.894+0000 7f840e7fc640 1 --2- 172.21.15.77:0/2968585209 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84100c5690 0x7f8410166290 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f840000ff60 tx=0x7f8400032ff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a4b1d38a9ae600 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7f2fe3bc8640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2fdc0c5ba0 0x7f2fdc152460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7f5ace0e1640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5ac806e5a0 0x7f5ac80c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7f5ace0e1640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5ac815ad40 0x7f5ac80c4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7f5ace0e1640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ac815e290 con 0x7f5ac80c1f80 2024-04-25T01:39:39.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7f5ace0e1640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f5ac815a8b0 con 0x7f5ac815ad40 2024-04-25T01:39:39.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7f5ace0e1640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f5ac815e570 con 0x7f5ac806e5a0 2024-04-25T01:39:39.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7f954e59e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f95480ae100 0x7f95481544d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7f840dffb640 1 -- 172.21.15.77:0/2968585209 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8400040070 con 0x7f84100c5690 2024-04-25T01:39:39.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7f840dffb640 1 -- 172.21.15.77:0/2968585209 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8400033d00 con 0x7f84100c5690 2024-04-25T01:39:39.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7f840dffb640 1 -- 172.21.15.77:0/2968585209 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840003b660 con 0x7f84100c5690 2024-04-25T01:39:39.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7f5ac6ffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f5ac80c1f80 0x7f5ac815da60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.77:44736/0 (socket says 172.21.15.77:44736) 2024-04-25T01:39:39.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7f5ac6ffd640 1 -- 172.21.15.77:0/2365627535 learned_addr learned my addr 172.21.15.77:0/2365627535 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:39.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7f5ac77fe640 1 --2- 172.21.15.77:0/2365627535 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5ac806e5a0 0x7f5ac80c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7f954e59e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9548072270 0x7f95480726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7f5ac7fff640 1 --2- 172.21.15.77:0/2365627535 >> v2:172.21.15.121:3300/0 conn(0x7f5ac815ad40 0x7f5ac80c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7f2fe1964640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2fdc14fa20 0x7f2fdc0c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7f2fe1964640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2fdc14fa20 0x7f2fdc0c3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46648/0 (socket says 172.21.15.77:46648) 2024-04-25T01:39:39.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.894+0000 7ff6e359e640 1 -- start start 2024-04-25T01:39:39.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7ff6e359e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff6dc0dbce0 0x7ff6dc0474a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7ff6e359e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff6dc00a8b0 0x7ff6dc00ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7f2fe1163640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2fdc0c5ba0 0x7f2fdc152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7f2fe1163640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2fdc0c5ba0 0x7f2fdc152460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.77:52112/0 (socket says 172.21.15.77:52112) 2024-04-25T01:39:39.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7f2fe1964640 1 -- 172.21.15.77:0/1015792667 learned_addr learned my addr 172.21.15.77:0/1015792667 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:39.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7f2fe3bc8640 1 -- 172.21.15.77:0/1015792667 --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fdc1559b0 con 0x7f2fdc0c80a0 2024-04-25T01:39:39.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7fb4f759e640 1 Processor -- start 2024-04-25T01:39:39.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7f5ac67fc640 1 -- 172.21.15.77:0/2365627535 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2448333435 0 0) 0x7f5ac815e290 con 0x7f5ac80c1f80 2024-04-25T01:39:39.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7f5ac67fc640 1 -- 172.21.15.77:0/2365627535 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ab0003520 con 0x7f5ac80c1f80 2024-04-25T01:39:39.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7f5ac77fe640 1 -- 172.21.15.77:0/2365627535 >> v2:172.21.15.121:3300/0 conn(0x7f5ac815ad40 msgr2=0x7f5ac80c4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:39.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7f5ac77fe640 1 --2- 172.21.15.77:0/2365627535 >> v2:172.21.15.121:3300/0 conn(0x7f5ac815ad40 0x7f5ac80c4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7f5ac77fe640 1 -- 172.21.15.77:0/2365627535 >> v1:172.21.15.121:6789/0 conn(0x7f5ac80c1f80 legacy=0x7f5ac815da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7f5ac77fe640 1 -- 172.21.15.77:0/2365627535 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac815e850 con 0x7f5ac806e5a0 2024-04-25T01:39:39.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7ff6e359e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6dc00bb50 con 0x7ff6dc0df180 2024-04-25T01:39:39.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7ff6e359e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff6dc00a420 con 0x7ff6dc00a8b0 2024-04-25T01:39:39.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7ff6e359e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff6dc048060 con 0x7ff6dc0dbce0 2024-04-25T01:39:39.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7f2fe3bc8640 1 -- 172.21.15.77:0/1015792667 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f2fdc155760 con 0x7f2fdc14fa20 2024-04-25T01:39:39.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7f2fe3bc8640 1 -- 172.21.15.77:0/1015792667 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f2fdc155c90 con 0x7f2fdc0c5ba0 2024-04-25T01:39:39.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7fd63ca15640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd63814ca60 0x7fd6380ace10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7fd63ca15640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd6380ab3f0 0x7fd6380ad350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7fd63ca15640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6380c6260 0x7fd6380c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7fd63ca15640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd638152c50 con 0x7fd6380ab3f0 2024-04-25T01:39:39.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7fd63ca15640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fd638152f30 con 0x7fd63814ca60 2024-04-25T01:39:39.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7fd63ca15640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd638153210 con 0x7fd6380c6260 2024-04-25T01:39:39.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7fd63659c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd63814ca60 0x7fd6380ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7f8415714640 1 -- 172.21.15.77:0/2968585209 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84100c5690 msgr2=0x7f8410166290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7f8415714640 1 --2- 172.21.15.77:0/2968585209 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84100c5690 0x7f8410166290 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f840000ff60 tx=0x7f8400032ff0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7fd636d9d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6380c6260 0x7fd6380c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7fd63659c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd63814ca60 0x7fd6380ace10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:52138/0 (socket says 172.21.15.77:52138) 2024-04-25T01:39:39.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7fd63659c640 1 -- 172.21.15.77:0/2935194403 learned_addr learned my addr 172.21.15.77:0/2935194403 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:39.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7fd635d9b640 1 --2- 172.21.15.77:0/2935194403 >> v2:172.21.15.77:3300/0 conn(0x7fd6380ab3f0 0x7fd6380ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7f954e59e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f95480c5b00 con 0x7f9548072270 2024-04-25T01:39:39.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7f954e59e640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f95480737c0 con 0x7f95480ae100 2024-04-25T01:39:39.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7f954e59e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f95480734e0 con 0x7f95480c5720 2024-04-25T01:39:39.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7f954cb3b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9548072270 0x7f95480726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7f954cb3b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9548072270 0x7f95480726e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46660/0 (socket says 172.21.15.77:46660) 2024-04-25T01:39:39.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7f954cb3b640 1 -- 172.21.15.77:0/2033359930 learned_addr learned my addr 172.21.15.77:0/2033359930 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:39.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7ff6e2d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff6dc00a8b0 0x7ff6dc00ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7ff6e2d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff6dc00a8b0 0x7ff6dc00ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46666/0 (socket says 172.21.15.77:46666) 2024-04-25T01:39:39.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7ff6e2d9d640 1 -- 172.21.15.77:0/3198709969 learned_addr learned my addr 172.21.15.77:0/3198709969 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:39.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7fb4f759e640 1 -- start start 2024-04-25T01:39:39.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7f95477fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f95480ae100 0x7f95481544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7fd63659c640 1 -- 172.21.15.77:0/2935194403 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6380c6260 msgr2=0x7fd6380c6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:39.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7fd63659c640 1 --2- 172.21.15.77:0/2935194403 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6380c6260 0x7fd6380c6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7ff6e259c640 1 --2- 172.21.15.77:0/3198709969 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff6dc0dbce0 0x7ff6dc0474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7fd63659c640 1 -- 172.21.15.77:0/2935194403 >> v2:172.21.15.77:3300/0 conn(0x7fd6380ab3f0 msgr2=0x7fd6380ad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:39.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.896+0000 7fd63659c640 1 --2- 172.21.15.77:0/2935194403 >> v2:172.21.15.77:3300/0 conn(0x7fd6380ab3f0 0x7fd6380ad350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.897+0000 7fd63659c640 1 -- 172.21.15.77:0/2935194403 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6381534f0 con 0x7fd63814ca60 2024-04-25T01:39:39.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.897+0000 7ff6e259c640 1 -- 172.21.15.77:0/3198709969 >> v2:172.21.15.77:3300/0 conn(0x7ff6dc00a8b0 msgr2=0x7ff6dc00ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:39.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.897+0000 7ff6e259c640 1 --2- 172.21.15.77:0/3198709969 >> v2:172.21.15.77:3300/0 conn(0x7ff6dc00a8b0 0x7ff6dc00ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.897+0000 7ff6e259c640 1 -- 172.21.15.77:0/3198709969 >> v1:172.21.15.77:6789/0 conn(0x7ff6dc0df180 legacy=0x7ff6dc006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:39.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.897+0000 7f95477fe640 1 -- 172.21.15.77:0/2033359930 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95480c5720 msgr2=0x7f954806f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:39.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.897+0000 7ff6e259c640 1 -- 172.21.15.77:0/3198709969 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6dc00a0f0 con 0x7ff6dc0dbce0 2024-04-25T01:39:39.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.897+0000 7ff6e2d9d640 1 --2- 172.21.15.77:0/3198709969 >> v2:172.21.15.77:3300/0 conn(0x7ff6dc00a8b0 0x7ff6dc00ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:39.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.897+0000 7f5ac77fe640 1 --2- 172.21.15.77:0/2365627535 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5ac806e5a0 0x7f5ac80c5b70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0097a0 tx=0x7f5abc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75cc08c575795aaa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.897+0000 7f5ac67fc640 1 -- 172.21.15.77:0/2365627535 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5abc037070 con 0x7f5ac806e5a0 2024-04-25T01:39:39.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.897+0000 7fb4f759e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb4f004bdf0 0x7fb4f00e3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.897+0000 7fb4f5d9b640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb4f004b8e0 0x7fb4f000cb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41448/0 (socket says 172.21.15.77:41448) 2024-04-25T01:39:39.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.897+0000 7fb4f5d9b640 1 -- 172.21.15.77:0/3097394082 learned_addr learned my addr 172.21.15.77:0/3097394082 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:39.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.897+0000 7fb4f759e640 1 -- 172.21.15.77:0/3097394082 --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4f00d82f0 con 0x7fb4f004b8e0 2024-04-25T01:39:39.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.897+0000 7fb4f6d9d640 1 --2- 172.21.15.77:0/3097394082 >> v2:172.21.15.77:3300/0 conn(0x7fb4f004bdf0 0x7fb4f00e3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.897+0000 7fb4f759e640 1 -- 172.21.15.77:0/3097394082 --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4f00d8590 con 0x7fb4f00d58e0 2024-04-25T01:39:39.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.897+0000 7f5ac67fc640 1 -- 172.21.15.77:0/2365627535 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5abc032440 con 0x7f5ac806e5a0 2024-04-25T01:39:39.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.895+0000 7f9547fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95480c5720 0x7f954806f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.897+0000 7f6328130640 1 Processor -- start 2024-04-25T01:39:39.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.898+0000 7f95477fe640 1 --2- 172.21.15.77:0/2033359930 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95480c5720 0x7f954806f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.898+0000 7f95477fe640 1 -- 172.21.15.77:0/2033359930 >> v2:172.21.15.77:3300/0 conn(0x7f9548072270 msgr2=0x7f95480726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:39.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.898+0000 7f95477fe640 1 --2- 172.21.15.77:0/2033359930 >> v2:172.21.15.77:3300/0 conn(0x7f9548072270 0x7f95480726e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.897+0000 7f2fe1964640 1 -- 172.21.15.77:0/1015792667 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2fdc0c5ba0 msgr2=0x7f2fdc152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:39.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.897+0000 7f2fe0962640 1 -- 172.21.15.77:0/1015792667 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2649071076 0 0) 0x7f2fdc1559b0 con 0x7f2fdc0c80a0 2024-04-25T01:39:39.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.897+0000 7f2fe1964640 1 --2- 172.21.15.77:0/1015792667 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2fdc0c5ba0 0x7f2fdc152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.897+0000 7f2fe1964640 1 -- 172.21.15.77:0/1015792667 >> v1:172.21.15.77:6789/0 conn(0x7f2fdc0c80a0 legacy=0x7f2fdc06d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.897+0000 7f2fe1964640 1 -- 172.21.15.77:0/1015792667 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fdc155f70 con 0x7f2fdc14fa20 2024-04-25T01:39:39.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.898+0000 7f2fe1964640 1 --2- 172.21.15.77:0/1015792667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fdc14fa20 0x7f2fdc0c3fe0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8009870 tx=0x7f2fd802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fe08f63e04a63ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.898+0000 7fd63659c640 1 --2- 172.21.15.77:0/2935194403 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd63814ca60 0x7fd6380ace10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd63806fc60 tx=0x7fd63002a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fd60ae01b711d3d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.898+0000 7f6328130640 1 -- start start 2024-04-25T01:39:39.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.897+0000 7fb4f759e640 1 -- 172.21.15.77:0/3097394082 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb4f0049dd0 con 0x7fb4f004bdf0 2024-04-25T01:39:39.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.898+0000 7fb4f559a640 1 -- 172.21.15.77:0/3097394082 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1680139330 0 0) 0x7fb4f00d82f0 con 0x7fb4f004b8e0 2024-04-25T01:39:39.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.898+0000 7fb4f6d9d640 1 -- 172.21.15.77:0/3097394082 >> v1:172.21.15.121:6789/0 conn(0x7fb4f00d58e0 legacy=0x7fb4f0048360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.898+0000 7fb4f6d9d640 1 -- 172.21.15.77:0/3097394082 >> v1:172.21.15.77:6789/0 conn(0x7fb4f004b8e0 legacy=0x7fb4f000cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.898+0000 7fb4f6d9d640 1 -- 172.21.15.77:0/3097394082 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f00d8870 con 0x7fb4f004bdf0 2024-04-25T01:39:39.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.898+0000 7f95477fe640 1 -- 172.21.15.77:0/2033359930 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9548153cd0 con 0x7f95480ae100 2024-04-25T01:39:39.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.898+0000 7f9547fff640 1 --2- 172.21.15.77:0/2033359930 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95480c5720 0x7f954806f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:39.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.898+0000 7f954cb3b640 1 --2- 172.21.15.77:0/2033359930 >> v2:172.21.15.77:3300/0 conn(0x7f9548072270 0x7f95480726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:39.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.898+0000 7f5ac67fc640 1 -- 172.21.15.77:0/2365627535 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5abc037070 con 0x7f5ac806e5a0 2024-04-25T01:39:39.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.898+0000 7f8415714640 1 -- 172.21.15.77:0/2968585209 shutdown_connections 2024-04-25T01:39:39.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.898+0000 7f8415714640 1 --2- 172.21.15.77:0/2968585209 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84100c5690 0x7f8410166290 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.898+0000 7f8415714640 1 -- 172.21.15.77:0/2968585209 >> 172.21.15.77:0/2968585209 conn(0x7f84100c7580 msgr2=0x7f84100c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:39.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.898+0000 7fd63559a640 1 -- 172.21.15.77:0/2935194403 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd630037070 con 0x7fd63814ca60 2024-04-25T01:39:39.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.898+0000 7f5ace0e1640 1 -- 172.21.15.77:0/2365627535 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5ac806e5a0 msgr2=0x7f5ac80c5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.898+0000 7f5ace0e1640 1 --2- 172.21.15.77:0/2365627535 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5ac806e5a0 0x7f5ac80c5b70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0097a0 tx=0x7f5abc02a180 comp rx=0 tx=0).stop 2024-04-25T01:39:39.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.898+0000 7f2fe0962640 1 -- 172.21.15.77:0/1015792667 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd8037070 con 0x7f2fdc14fa20 2024-04-25T01:39:39.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.898+0000 7fd63559a640 1 -- 172.21.15.77:0/2935194403 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd630032440 con 0x7fd63814ca60 2024-04-25T01:39:39.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.898+0000 7f2fe0962640 1 -- 172.21.15.77:0/1015792667 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd8032440 con 0x7f2fdc14fa20 2024-04-25T01:39:39.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.898+0000 7f2fe0962640 1 -- 172.21.15.77:0/1015792667 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd80327f0 con 0x7f2fdc14fa20 2024-04-25T01:39:39.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.898+0000 7f5ace0e1640 1 -- 172.21.15.77:0/2365627535 shutdown_connections 2024-04-25T01:39:39.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.898+0000 7f5ace0e1640 1 --2- 172.21.15.77:0/2365627535 >> v2:172.21.15.121:3300/0 conn(0x7f5ac815ad40 0x7f5ac80c4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.898+0000 7f5ace0e1640 1 --2- 172.21.15.77:0/2365627535 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5ac806e5a0 0x7f5ac80c5b70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.898+0000 7f5ace0e1640 1 -- 172.21.15.77:0/2365627535 >> 172.21.15.77:0/2365627535 conn(0x7f5ac80c7580 msgr2=0x7f5ac80c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:39.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7f5ace0e1640 1 -- 172.21.15.77:0/2365627535 shutdown_connections 2024-04-25T01:39:39.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.898+0000 7ff6e259c640 1 --2- 172.21.15.77:0/3198709969 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff6dc0dbce0 0x7ff6dc0474a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff6d80097a0 tx=0x7ff6d802a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ebcd2f24288dbd8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7fb4f6d9d640 1 --2- 172.21.15.77:0/3097394082 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4f004bdf0 0x7fb4f00e3b70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0049f50 tx=0x7fb4f80a67d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce7a32ba375707e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7ff6e159a640 1 -- 172.21.15.77:0/3198709969 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8037070 con 0x7ff6dc0dbce0 2024-04-25T01:39:39.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7f95477fe640 1 --2- 172.21.15.77:0/2033359930 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95480ae100 0x7f95481544d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9548073dd0 tx=0x7f953c02e400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4f86dd1500467d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7ff6e159a640 1 -- 172.21.15.77:0/3198709969 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6d802ad10 con 0x7ff6dc0dbce0 2024-04-25T01:39:39.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7ff6e159a640 1 -- 172.21.15.77:0/3198709969 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8032660 con 0x7ff6dc0dbce0 2024-04-25T01:39:39.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7fd63559a640 1 -- 172.21.15.77:0/2935194403 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd630037070 con 0x7fd63814ca60 2024-04-25T01:39:39.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7f2fe3bc8640 1 -- 172.21.15.77:0/1015792667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fdc14fa20 msgr2=0x7f2fdc0c3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7f2fe3bc8640 1 --2- 172.21.15.77:0/1015792667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fdc14fa20 0x7f2fdc0c3fe0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8009870 tx=0x7f2fd802a1e0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7f6328130640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6320070400 0x7f6320072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7f6328130640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f63200c8c60 0x7f6320154490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7f6328130640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6320157410 con 0x7f6320072390 2024-04-25T01:39:39.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7f6328130640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f6320158020 con 0x7f6320070400 2024-04-25T01:39:39.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7f6328130640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f63201576f0 con 0x7f63200c8c60 2024-04-25T01:39:39.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7f6325ecc640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f6320072390 0x7f6320153d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.77:44746/0 (socket says 172.21.15.77:44746) 2024-04-25T01:39:39.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7f6325ecc640 1 -- 172.21.15.77:0/1515366204 learned_addr learned my addr 172.21.15.77:0/1515366204 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:39.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7f63256cb640 1 --2- 172.21.15.77:0/1515366204 >> v2:172.21.15.121:3300/0 conn(0x7f6320070400 0x7f6320072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7fd63ca15640 1 -- 172.21.15.77:0/2935194403 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd63814ca60 msgr2=0x7fd6380ace10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7fd63ca15640 1 --2- 172.21.15.77:0/2935194403 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd63814ca60 0x7fd6380ace10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd63806fc60 tx=0x7fd63002a1e0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7f2fe3bc8640 1 -- 172.21.15.77:0/1015792667 shutdown_connections 2024-04-25T01:39:39.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7f2fe3bc8640 1 --2- 172.21.15.77:0/1015792667 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2fdc0c5ba0 0x7f2fdc152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7f2fe3bc8640 1 --2- 172.21.15.77:0/1015792667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fdc14fa20 0x7f2fdc0c3fe0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7f2fe3bc8640 1 -- 172.21.15.77:0/1015792667 >> 172.21.15.77:0/1015792667 conn(0x7f2fdc0c7580 msgr2=0x7f2fdc0c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:39.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7f9546ffd640 1 -- 172.21.15.77:0/2033359930 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953c03a070 con 0x7f95480ae100 2024-04-25T01:39:39.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7f9546ffd640 1 -- 172.21.15.77:0/2033359930 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f953c033710 con 0x7f95480ae100 2024-04-25T01:39:39.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7f9546ffd640 1 -- 172.21.15.77:0/2033359930 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953c033ae0 con 0x7f95480ae100 2024-04-25T01:39:39.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.900+0000 7f2fe3bc8640 1 -- 172.21.15.77:0/1015792667 shutdown_connections 2024-04-25T01:39:39.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.900+0000 7f2fe3bc8640 1 -- 172.21.15.77:0/1015792667 wait complete. 2024-04-25T01:39:39.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7fb4f559a640 1 -- 172.21.15.77:0/3097394082 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f80b3070 con 0x7fb4f004bdf0 2024-04-25T01:39:39.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7fb4f559a640 1 -- 172.21.15.77:0/3097394082 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4f806e800 con 0x7fb4f004bdf0 2024-04-25T01:39:39.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7fb4f559a640 1 -- 172.21.15.77:0/3097394082 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f806ebf0 con 0x7fb4f004bdf0 2024-04-25T01:39:39.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7f8415714640 1 -- 172.21.15.77:0/2968585209 shutdown_connections 2024-04-25T01:39:39.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.900+0000 7f8415714640 1 -- 172.21.15.77:0/2968585209 wait complete. 2024-04-25T01:39:39.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.899+0000 7f5ace0e1640 1 -- 172.21.15.77:0/2365627535 wait complete. 2024-04-25T01:39:39.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.900+0000 7f63256cb640 1 -- 172.21.15.77:0/1515366204 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f63200c8c60 msgr2=0x7f6320154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:39.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.900+0000 7f63256cb640 1 --2- 172.21.15.77:0/1515366204 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f63200c8c60 0x7f6320154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.900+0000 7f63256cb640 1 -- 172.21.15.77:0/1515366204 >> v1:172.21.15.121:6789/0 conn(0x7f6320072390 legacy=0x7f6320153d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.900+0000 7f63256cb640 1 -- 172.21.15.77:0/1515366204 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63201579d0 con 0x7f6320070400 2024-04-25T01:39:39.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.900+0000 7ff6e359e640 1 -- 172.21.15.77:0/3198709969 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff6dc0dbce0 msgr2=0x7ff6dc0474a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.900+0000 7ff6e359e640 1 --2- 172.21.15.77:0/3198709969 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff6dc0dbce0 0x7ff6dc0474a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff6d80097a0 tx=0x7ff6d802a000 comp rx=0 tx=0).stop 2024-04-25T01:39:39.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.900+0000 7fd63ca15640 1 -- 172.21.15.77:0/2935194403 shutdown_connections 2024-04-25T01:39:39.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.900+0000 7fd63ca15640 1 --2- 172.21.15.77:0/2935194403 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6380c6260 0x7fd6380c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.900+0000 7fd63ca15640 1 --2- 172.21.15.77:0/2935194403 >> v2:172.21.15.77:3300/0 conn(0x7fd6380ab3f0 0x7fd6380ad350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.900+0000 7fd63ca15640 1 --2- 172.21.15.77:0/2935194403 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd63814ca60 0x7fd6380ace10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.900+0000 7fd63ca15640 1 -- 172.21.15.77:0/2935194403 >> 172.21.15.77:0/2935194403 conn(0x7fd6380c5020 msgr2=0x7fd6380c5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:39.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.900+0000 7f954e59e640 1 -- 172.21.15.77:0/2033359930 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95480ae100 msgr2=0x7f95481544d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.900+0000 7f954e59e640 1 --2- 172.21.15.77:0/2033359930 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95480ae100 0x7f95481544d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9548073dd0 tx=0x7f953c02e400 comp rx=0 tx=0).stop 2024-04-25T01:39:39.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.900+0000 7f954e59e640 1 -- 172.21.15.77:0/2033359930 shutdown_connections 2024-04-25T01:39:39.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.900+0000 7f954e59e640 1 --2- 172.21.15.77:0/2033359930 >> v2:172.21.15.77:3300/0 conn(0x7f9548072270 0x7f95480726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.900+0000 7f954e59e640 1 --2- 172.21.15.77:0/2033359930 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95480ae100 0x7f95481544d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.900+0000 7f954e59e640 1 --2- 172.21.15.77:0/2033359930 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95480c5720 0x7f954806f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.900+0000 7f954e59e640 1 -- 172.21.15.77:0/2033359930 >> 172.21.15.77:0/2033359930 conn(0x7f95480c9530 msgr2=0x7f95480c9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:39.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.900+0000 7fb4f759e640 1 -- 172.21.15.77:0/3097394082 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4f004bdf0 msgr2=0x7fb4f00e3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.900+0000 7fb4f759e640 1 --2- 172.21.15.77:0/3097394082 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4f004bdf0 0x7fb4f00e3b70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0049f50 tx=0x7fb4f80a67d0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.900+0000 7ff6e359e640 1 -- 172.21.15.77:0/3198709969 shutdown_connections 2024-04-25T01:39:39.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.900+0000 7ff6e359e640 1 --2- 172.21.15.77:0/3198709969 >> v2:172.21.15.77:3300/0 conn(0x7ff6dc00a8b0 0x7ff6dc00ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.900+0000 7ff6e359e640 1 --2- 172.21.15.77:0/3198709969 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff6dc0dbce0 0x7ff6dc0474a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.900+0000 7ff6e359e640 1 -- 172.21.15.77:0/3198709969 >> 172.21.15.77:0/3198709969 conn(0x7ff6dc048250 msgr2=0x7ff6dc048660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:39.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.901+0000 7f63256cb640 1 --2- 172.21.15.77:0/1515366204 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6320070400 0x7f6320072770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f63100097a0 tx=0x7f631002a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9515d79445a3b2e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.901+0000 7fb4f759e640 1 -- 172.21.15.77:0/3097394082 shutdown_connections 2024-04-25T01:39:39.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.901+0000 7fb4f759e640 1 --2- 172.21.15.77:0/3097394082 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4f004bdf0 0x7fb4f00e3b70 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.901+0000 7fb4f759e640 1 -- 172.21.15.77:0/3097394082 >> 172.21.15.77:0/3097394082 conn(0x7fb4f002f5d0 msgr2=0x7fb4f002f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:39.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.901+0000 7f954e59e640 1 -- 172.21.15.77:0/2033359930 shutdown_connections 2024-04-25T01:39:39.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.901+0000 7f954e59e640 1 -- 172.21.15.77:0/2033359930 wait complete. 2024-04-25T01:39:39.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.901+0000 7ff6e359e640 1 -- 172.21.15.77:0/3198709969 shutdown_connections 2024-04-25T01:39:39.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.901+0000 7ff6e359e640 1 -- 172.21.15.77:0/3198709969 wait complete. 2024-04-25T01:39:39.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.901+0000 7fb4f759e640 1 -- 172.21.15.77:0/3097394082 shutdown_connections 2024-04-25T01:39:39.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.901+0000 7f6324eca640 1 -- 172.21.15.77:0/1515366204 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6310037070 con 0x7f6320070400 2024-04-25T01:39:39.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.901+0000 7f6324eca640 1 -- 172.21.15.77:0/1515366204 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f631002add0 con 0x7f6320070400 2024-04-25T01:39:39.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.901+0000 7f6324eca640 1 -- 172.21.15.77:0/1515366204 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6310037070 con 0x7f6320070400 2024-04-25T01:39:39.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.901+0000 7f2fe3bc8640 1 Processor -- start 2024-04-25T01:39:39.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.902+0000 7f2fe3bc8640 1 -- start start 2024-04-25T01:39:39.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.902+0000 7f8415714640 1 Processor -- start 2024-04-25T01:39:39.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.900+0000 7f5ace0e1640 1 Processor -- start 2024-04-25T01:39:39.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.901+0000 7f5ace0e1640 1 -- start start 2024-04-25T01:39:39.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.902+0000 7fb4f759e640 1 -- 172.21.15.77:0/3097394082 wait complete. 2024-04-25T01:39:39.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.902+0000 7f5ace0e1640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5ac806e5a0 0x7f5ac80a82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.902+0000 7f6328130640 1 -- 172.21.15.77:0/1515366204 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6320070400 msgr2=0x7f6320072770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.902+0000 7f6328130640 1 --2- 172.21.15.77:0/1515366204 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6320070400 0x7f6320072770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f63100097a0 tx=0x7f631002a080 comp rx=0 tx=0).stop 2024-04-25T01:39:39.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.902+0000 7f6328130640 1 -- 172.21.15.77:0/1515366204 shutdown_connections 2024-04-25T01:39:39.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.902+0000 7f5ace0e1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ac80c1f80 0x7f5ac8070b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.902+0000 7f6328130640 1 --2- 172.21.15.77:0/1515366204 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f63200c8c60 0x7f6320154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.902+0000 7f6328130640 1 --2- 172.21.15.77:0/1515366204 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6320070400 0x7f6320072770 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f63100097a0 tx=0x7f631002a080 comp rx=0 tx=0).stop 2024-04-25T01:39:39.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.902+0000 7f6328130640 1 -- 172.21.15.77:0/1515366204 >> 172.21.15.77:0/1515366204 conn(0x7f63200c60a0 msgr2=0x7f63200c6480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:39.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.902+0000 7f5ace0e1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ac815ad40 0x7f5ac8072980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.902+0000 7f5ace0e1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac806eb00 con 0x7f5ac815ad40 2024-04-25T01:39:39.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.902+0000 7f5ace0e1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac806e980 con 0x7f5ac80c1f80 2024-04-25T01:39:39.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.902+0000 7f5ace0e1640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f5ac815b1b0 con 0x7f5ac806e5a0 2024-04-25T01:39:39.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.902+0000 7f8415714640 1 -- start start 2024-04-25T01:39:39.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.902+0000 7f5ac6ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ac80c1f80 0x7f5ac8070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.902+0000 7f5ac6ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ac80c1f80 0x7f5ac8070b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:52162/0 (socket says 172.21.15.77:52162) 2024-04-25T01:39:39.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.902+0000 7f5ac6ffd640 1 -- 172.21.15.77:0/3147048605 learned_addr learned my addr 172.21.15.77:0/3147048605 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:39.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.903+0000 7ff6e359e640 1 Processor -- start 2024-04-25T01:39:39.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.902+0000 7f5ac77fe640 1 --2- 172.21.15.77:0/3147048605 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5ac806e5a0 0x7f5ac80a82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.902+0000 7f5ac7fff640 1 --2- 172.21.15.77:0/3147048605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ac815ad40 0x7f5ac8072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.902+0000 7f5ac6ffd640 1 -- 172.21.15.77:0/3147048605 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5ac806e5a0 msgr2=0x7f5ac80a82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.902+0000 7f5ac6ffd640 1 --2- 172.21.15.77:0/3147048605 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5ac806e5a0 0x7f5ac80a82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.902+0000 7f5ac6ffd640 1 -- 172.21.15.77:0/3147048605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ac815ad40 msgr2=0x7f5ac8072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.902+0000 7f5ac6ffd640 1 --2- 172.21.15.77:0/3147048605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ac815ad40 0x7f5ac8072980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.903+0000 7f954e59e640 1 Processor -- start 2024-04-25T01:39:39.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.902+0000 7f5ac6ffd640 1 -- 172.21.15.77:0/3147048605 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac8157c10 con 0x7f5ac80c1f80 2024-04-25T01:39:39.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.903+0000 7ff6e359e640 1 -- start start 2024-04-25T01:39:39.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.903+0000 7f5ac6ffd640 1 --2- 172.21.15.77:0/3147048605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ac80c1f80 0x7f5ac8070b20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5ab800c500 tx=0x7f5ab800c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.903+0000 7f8415714640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f841006e330 0x7f841020adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.903+0000 7fd63ca15640 1 -- 172.21.15.77:0/2935194403 shutdown_connections 2024-04-25T01:39:39.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.903+0000 7f954e59e640 1 -- start start 2024-04-25T01:39:39.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.903+0000 7f2fe3bc8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fdc0c5ba0 0x7f2fdc1ece60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.903+0000 7fd63ca15640 1 -- 172.21.15.77:0/2935194403 wait complete. 2024-04-25T01:39:39.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.903+0000 7f8415714640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f84100c1f80 0x7f8410070f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.903+0000 7f2fe3bc8640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2fdc0c80a0 0x7f2fdc1ed3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.903+0000 7f8415714640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84100c5690 0x7f84100703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.903+0000 7f8415714640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8410163c10 con 0x7f84100c5690 2024-04-25T01:39:39.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.903+0000 7f8415714640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f84100ad0f0 con 0x7f841006e330 2024-04-25T01:39:39.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.903+0000 7f8415714640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f84100c4950 con 0x7f84100c1f80 2024-04-25T01:39:39.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.903+0000 7f2fe1964640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fdc0c5ba0 0x7f2fdc1ece60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.903+0000 7f2fe1964640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fdc0c5ba0 0x7f2fdc1ece60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46706/0 (socket says 172.21.15.77:46706) 2024-04-25T01:39:39.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.903+0000 7f840f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84100c5690 0x7f84100703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.903+0000 7f840effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f841006e330 0x7f841020adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.903+0000 7f840f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84100c5690 0x7f84100703c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46722/0 (socket says 172.21.15.77:46722) 2024-04-25T01:39:39.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.903+0000 7f840f7fe640 1 -- 172.21.15.77:0/1618777104 learned_addr learned my addr 172.21.15.77:0/1618777104 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:39.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.903+0000 7f2fe1964640 1 -- 172.21.15.77:0/1832689577 learned_addr learned my addr 172.21.15.77:0/1832689577 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:39.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.903+0000 7f2fe1163640 1 --2- 172.21.15.77:0/1832689577 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2fdc0c80a0 0x7f2fdc1ed3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f840effd640 1 -- 172.21.15.77:0/1618777104 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f84100c1f80 msgr2=0x7f8410070f00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T01:39:39.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f840effd640 1 --2- 172.21.15.77:0/1618777104 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f84100c1f80 0x7f8410070f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f840effd640 1 -- 172.21.15.77:0/1618777104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84100c5690 msgr2=0x7f84100703c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f840effd640 1 --2- 172.21.15.77:0/1618777104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84100c5690 0x7f84100703c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7fb4f759e640 1 Processor -- start 2024-04-25T01:39:39.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f2fe3bc8640 1 --2- 172.21.15.77:0/1832689577 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2fdc14fa20 0x7f2fdc142e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f840effd640 1 -- 172.21.15.77:0/1618777104 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84100731f0 con 0x7f841006e330 2024-04-25T01:39:39.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f840f7fe640 1 --2- 172.21.15.77:0/1618777104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84100c5690 0x7f84100703c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:39.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f2fe3bc8640 1 -- 172.21.15.77:0/1832689577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2fdc0c29b0 con 0x7f2fdc0c5ba0 2024-04-25T01:39:39.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f6328130640 1 -- 172.21.15.77:0/1515366204 shutdown_connections 2024-04-25T01:39:39.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f2fe3bc8640 1 -- 172.21.15.77:0/1832689577 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2fdc156530 con 0x7f2fdc14fa20 2024-04-25T01:39:39.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f2fe2165640 1 --2- 172.21.15.77:0/1832689577 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2fdc14fa20 0x7f2fdc142e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f840effd640 1 --2- 172.21.15.77:0/1618777104 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f841006e330 0x7f841020adc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f840400c470 tx=0x7f840400c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f5aaffff640 1 -- 172.21.15.77:0/3147048605 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8017070 con 0x7f5ac80c1f80 2024-04-25T01:39:39.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f5aaffff640 1 -- 172.21.15.77:0/3147048605 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab8005ce0 con 0x7f5ac80c1f80 2024-04-25T01:39:39.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f5aaffff640 1 -- 172.21.15.77:0/3147048605 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8007310 con 0x7f5ac80c1f80 2024-04-25T01:39:39.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7ff6e359e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6dc00a8b0 0x7ff6dc177ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f954e59e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9548072270 0x7f95480c6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f2fe3bc8640 1 -- 172.21.15.77:0/1832689577 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f2fdc0c1ab0 con 0x7f2fdc0c80a0 2024-04-25T01:39:39.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7ff6e359e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff6dc0dbce0 0x7ff6dc0d4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f954e59e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95480ae100 0x7f9548152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f954e59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95480c5720 0x7f9548152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7ff6e359e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6dc0df180 0x7ff6dc0d4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7ff6e259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6dc00a8b0 0x7ff6dc177ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f9547fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9548072270 0x7f95480c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7ff6e259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6dc00a8b0 0x7ff6dc177ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:52190/0 (socket says 172.21.15.77:52190) 2024-04-25T01:39:39.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f9547fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9548072270 0x7f95480c6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.77:52190/0 (socket says 172.21.15.77:52190) 2024-04-25T01:39:39.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f95477fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95480ae100 0x7f9548152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7ff6e1d9b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff6dc0dbce0 0x7ff6dc0d4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7ff6e1d9b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff6dc0dbce0 0x7ff6dc0d4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.77:52192/0 (socket says 172.21.15.77:52192) 2024-04-25T01:39:39.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f95477fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95480ae100 0x7f9548152a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:52200/0 (socket says 172.21.15.77:52200) 2024-04-25T01:39:39.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f9547fff640 1 -- 172.21.15.77:0/1148709557 learned_addr learned my addr 172.21.15.77:0/1148709557 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:39.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f954e59e640 1 -- 172.21.15.77:0/1148709557 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9548070830 con 0x7f95480c5720 2024-04-25T01:39:39.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.905+0000 7f954e59e640 1 -- 172.21.15.77:0/1148709557 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9548154a10 con 0x7f95480ae100 2024-04-25T01:39:39.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.905+0000 7ff6e259c640 1 -- 172.21.15.77:0/956644899 learned_addr learned my addr 172.21.15.77:0/956644899 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:39.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.905+0000 7f954e59e640 1 -- 172.21.15.77:0/1148709557 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f95480709b0 con 0x7f9548072270 2024-04-25T01:39:39.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.905+0000 7ff6e359e640 1 -- 172.21.15.77:0/956644899 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc00b240 con 0x7ff6dc0df180 2024-04-25T01:39:39.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.905+0000 7ff6e359e640 1 -- 172.21.15.77:0/956644899 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc047d80 con 0x7ff6dc00a8b0 2024-04-25T01:39:39.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.905+0000 7ff6e359e640 1 -- 172.21.15.77:0/956644899 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff6dc0dc0c0 con 0x7ff6dc0dbce0 2024-04-25T01:39:39.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.905+0000 7fd63ca15640 1 Processor -- start 2024-04-25T01:39:39.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.905+0000 7f2fe1964640 1 -- 172.21.15.77:0/1832689577 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2fdc0c80a0 msgr2=0x7f2fdc1ed3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.905+0000 7f2fe1964640 1 --2- 172.21.15.77:0/1832689577 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2fdc0c80a0 0x7f2fdc1ed3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.905+0000 7f2fe1964640 1 -- 172.21.15.77:0/1832689577 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2fdc14fa20 msgr2=0x7f2fdc142e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.905+0000 7f2fe1964640 1 --2- 172.21.15.77:0/1832689577 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2fdc14fa20 0x7f2fdc142e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7fb4f759e640 1 -- start start 2024-04-25T01:39:39.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.905+0000 7fb4f759e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4f004b8e0 0x7fb4f00cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.905+0000 7fb4f759e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4f004bdf0 0x7fb4f00c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.905+0000 7f2fe1964640 1 -- 172.21.15.77:0/1832689577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fdc0ac4c0 con 0x7f2fdc0c5ba0 2024-04-25T01:39:39.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.905+0000 7fd63ca15640 1 -- start start 2024-04-25T01:39:39.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.905+0000 7fb4f759e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb4f00d58e0 0x7fb4f00c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f5ace0e1640 1 -- 172.21.15.77:0/3147048605 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac8073400 con 0x7f5ac80c1f80 2024-04-25T01:39:39.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f5ace0e1640 1 -- 172.21.15.77:0/3147048605 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac8072ec0 con 0x7f5ac80c1f80 2024-04-25T01:39:39.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.905+0000 7f6328130640 1 -- 172.21.15.77:0/1515366204 wait complete. 2024-04-25T01:39:39.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f83f77fe640 1 -- 172.21.15.77:0/1618777104 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8404017070 con 0x7f841006e330 2024-04-25T01:39:39.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f83f77fe640 1 -- 172.21.15.77:0/1618777104 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8404005ce0 con 0x7f841006e330 2024-04-25T01:39:39.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f83f77fe640 1 -- 172.21.15.77:0/1618777104 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84040072d0 con 0x7f841006e330 2024-04-25T01:39:39.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f8415714640 1 -- 172.21.15.77:0/1618777104 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8410072f10 con 0x7f841006e330 2024-04-25T01:39:39.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.904+0000 7f8415714640 1 -- 172.21.15.77:0/1618777104 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84100ac410 con 0x7f841006e330 2024-04-25T01:39:39.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.905+0000 7fb4f759e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f004b200 con 0x7fb4f004b8e0 2024-04-25T01:39:39.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.905+0000 7fb4f759e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f004c2d0 con 0x7fb4f004bdf0 2024-04-25T01:39:39.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.905+0000 7fb4f759e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb4f0048a70 con 0x7fb4f00d58e0 2024-04-25T01:39:39.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.905+0000 7fb4f6d9d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb4f00d58e0 0x7fb4f00c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.905+0000 7fb4f6d9d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb4f00d58e0 0x7fb4f00c9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.77:52202/0 (socket says 172.21.15.77:52202) 2024-04-25T01:39:39.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7f954cb3b640 1 --2- 172.21.15.77:0/1148709557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95480c5720 0x7f9548152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.905+0000 7fb4f6d9d640 1 -- 172.21.15.77:0/3685349644 learned_addr learned my addr 172.21.15.77:0/3685349644 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:39.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.905+0000 7fb4f659c640 1 --2- 172.21.15.77:0/3685349644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4f004b8e0 0x7fb4f00cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7fd63ca15640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6380ab3f0 0x7fd63814fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7f5ace0e1640 1 -- 172.21.15.77:0/3147048605 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5ac81579c0 con 0x7f5ac80c1f80 2024-04-25T01:39:39.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7fd63ca15640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6380c6260 0x7fd6381eb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7fd63ca15640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd63814ca60 0x7fd6380c4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7f2fe1964640 1 --2- 172.21.15.77:0/1832689577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fdc0c5ba0 0x7f2fdc1ece60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80090b0 tx=0x7f2fd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7fd63ca15640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd63806dc50 con 0x7fd6380ab3f0 2024-04-25T01:39:39.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7fd63ca15640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd63814ce40 con 0x7fd63814ca60 2024-04-25T01:39:39.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7fd63ca15640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd63806ddd0 con 0x7fd6380c6260 2024-04-25T01:39:39.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7fd636d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd63814ca60 0x7fd6380c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7fd636d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd63814ca60 0x7fd6380c4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:52222/0 (socket says 172.21.15.77:52222) 2024-04-25T01:39:39.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7f8415714640 1 -- 172.21.15.77:0/1618777104 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f84100ac7d0 con 0x7f841006e330 2024-04-25T01:39:39.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7f2fd27fc640 1 -- 172.21.15.77:0/1832689577 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd8037040 con 0x7f2fdc0c5ba0 2024-04-25T01:39:39.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7fd636d9d640 1 -- 172.21.15.77:0/632725884 learned_addr learned my addr 172.21.15.77:0/632725884 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:39.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7f2fd27fc640 1 -- 172.21.15.77:0/1832689577 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd8042070 con 0x7f2fdc0c5ba0 2024-04-25T01:39:39.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7f2fd27fc640 1 -- 172.21.15.77:0/1832689577 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd8032830 con 0x7f2fdc0c5ba0 2024-04-25T01:39:39.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7f9547fff640 1 -- 172.21.15.77:0/1148709557 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95480ae100 msgr2=0x7f9548152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7f9547fff640 1 --2- 172.21.15.77:0/1148709557 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95480ae100 0x7f9548152a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7f9547fff640 1 -- 172.21.15.77:0/1148709557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95480c5720 msgr2=0x7f9548152f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7f9547fff640 1 --2- 172.21.15.77:0/1148709557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95480c5720 0x7f9548152f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7f9547fff640 1 -- 172.21.15.77:0/1148709557 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95481556f0 con 0x7f9548072270 2024-04-25T01:39:39.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7f2fe3bc8640 1 -- 172.21.15.77:0/1832689577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fdc142960 con 0x7f2fdc0c5ba0 2024-04-25T01:39:39.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7f2fe3bc8640 1 -- 172.21.15.77:0/1832689577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fdc142630 con 0x7f2fdc0c5ba0 2024-04-25T01:39:39.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.907+0000 7fd63659c640 1 --2- 172.21.15.77:0/632725884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6380ab3f0 0x7fd63814fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.907+0000 7f9547fff640 1 --2- 172.21.15.77:0/1148709557 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9548072270 0x7f95480c6460 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f954000ce30 tx=0x7f954000a650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.907+0000 7f9544ff9640 1 -- 172.21.15.77:0/1148709557 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954000f890 con 0x7f9548072270 2024-04-25T01:39:39.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.907+0000 7f9544ff9640 1 -- 172.21.15.77:0/1148709557 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f954000fa30 con 0x7f9548072270 2024-04-25T01:39:39.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.907+0000 7f954e59e640 1 -- 172.21.15.77:0/1148709557 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f954814c560 con 0x7f9548072270 2024-04-25T01:39:39.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.907+0000 7f83f77fe640 1 -- 172.21.15.77:0/1618777104 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f840401a070 con 0x7f841006e330 2024-04-25T01:39:39.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.908+0000 7f2fe3bc8640 1 -- 172.21.15.77:0/1832689577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2fdc0a9100 con 0x7f2fdc0c5ba0 2024-04-25T01:39:39.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.907+0000 7f9544ff9640 1 -- 172.21.15.77:0/1148709557 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954000fe00 con 0x7f9548072270 2024-04-25T01:39:39.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.907+0000 7f954e59e640 1 -- 172.21.15.77:0/1148709557 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f954814cb20 con 0x7f9548072270 2024-04-25T01:39:39.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.907+0000 7fd636d9d640 1 -- 172.21.15.77:0/632725884 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6380c6260 msgr2=0x7fd6381eb1e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T01:39:39.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.907+0000 7fd636d9d640 1 --2- 172.21.15.77:0/632725884 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6380c6260 0x7fd6381eb1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.907+0000 7fd636d9d640 1 -- 172.21.15.77:0/632725884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6380ab3f0 msgr2=0x7fd63814fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.907+0000 7fd636d9d640 1 --2- 172.21.15.77:0/632725884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6380ab3f0 0x7fd63814fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.907+0000 7fd636d9d640 1 -- 172.21.15.77:0/632725884 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6381e7400 con 0x7fd63814ca60 2024-04-25T01:39:39.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7fb4f5d9b640 1 --2- 172.21.15.77:0/3685349644 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4f004bdf0 0x7fb4f00c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7fb4f6d9d640 1 -- 172.21.15.77:0/3685349644 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4f004bdf0 msgr2=0x7fb4f00c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7fb4f6d9d640 1 --2- 172.21.15.77:0/3685349644 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4f004bdf0 0x7fb4f00c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7fb4f6d9d640 1 -- 172.21.15.77:0/3685349644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4f004b8e0 msgr2=0x7fb4f00cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7fb4f6d9d640 1 --2- 172.21.15.77:0/3685349644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4f004b8e0 0x7fb4f00cd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7fb4f6d9d640 1 -- 172.21.15.77:0/3685349644 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f00d3bb0 con 0x7fb4f00d58e0 2024-04-25T01:39:39.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7fb4f659c640 1 --2- 172.21.15.77:0/3685349644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4f004b8e0 0x7fb4f00cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:39.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.908+0000 7fb4f6d9d640 1 --2- 172.21.15.77:0/3685349644 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb4f00d58e0 0x7fb4f00c9070 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8050770 tx=0x7fb4f8069650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.908+0000 7fd636d9d640 1 --2- 172.21.15.77:0/632725884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd63814ca60 0x7fd6380c4540 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd628009e30 tx=0x7fd62800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.908+0000 7f83f77fe640 1 --2- 172.21.15.77:0/1618777104 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f83fc06be30 0x7f83fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.908+0000 7fd626ffd640 1 -- 172.21.15.77:0/632725884 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd628020070 con 0x7fd63814ca60 2024-04-25T01:39:39.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.908+0000 7fd626ffd640 1 -- 172.21.15.77:0/632725884 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6280135c0 con 0x7fd63814ca60 2024-04-25T01:39:39.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.908+0000 7fd626ffd640 1 -- 172.21.15.77:0/632725884 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6280139b0 con 0x7fd63814ca60 2024-04-25T01:39:39.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.907+0000 7f6328130640 1 Processor -- start 2024-04-25T01:39:39.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.908+0000 7f83f77fe640 1 -- 172.21.15.77:0/1618777104 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f840408a450 con 0x7f841006e330 2024-04-25T01:39:39.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.908+0000 7f83f77fe640 1 --2- 172.21.15.77:0/1618777104 >> [v2:172.21.15.121:6818/523906818,v1:172.21.15.121:6820/523906818] conn(0x7f83fc076640 0x7f83fc078a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.908+0000 7f83f77fe640 1 -- 172.21.15.77:0/1618777104 --> [v2:172.21.15.121:6818/523906818,v1:172.21.15.121:6820/523906818] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8404014ec0 con 0x7f83fc076640 2024-04-25T01:39:39.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.908+0000 7f83f77fe640 1 -- 172.21.15.77:0/1618777104 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8404091050 con 0x7f841006e330 2024-04-25T01:39:39.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7ff6e1d9b640 1 -- 172.21.15.77:0/956644899 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6dc00a8b0 msgr2=0x7ff6dc177ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7ff6e1d9b640 1 --2- 172.21.15.77:0/956644899 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6dc00a8b0 0x7ff6dc177ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7ff6e1d9b640 1 -- 172.21.15.77:0/956644899 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6dc0df180 msgr2=0x7ff6dc0d4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7ff6e1d9b640 1 --2- 172.21.15.77:0/956644899 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6dc0df180 0x7ff6dc0d4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7ff6e1d9b640 1 -- 172.21.15.77:0/956644899 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6dc178760 con 0x7ff6dc0dbce0 2024-04-25T01:39:39.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.908+0000 7fd63ca15640 1 -- 172.21.15.77:0/632725884 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6381e76e0 con 0x7fd63814ca60 2024-04-25T01:39:39.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7ff6e1d9b640 1 --2- 172.21.15.77:0/956644899 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff6dc0dbce0 0x7ff6dc0d4850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400b410 tx=0x7ff6d400b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.906+0000 7ff6d2ffd640 1 -- 172.21.15.77:0/956644899 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4015030 con 0x7ff6dc0dbce0 2024-04-25T01:39:39.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.907+0000 7ff6d2ffd640 1 -- 172.21.15.77:0/956644899 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6d4004020 con 0x7ff6dc0dbce0 2024-04-25T01:39:39.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.907+0000 7ff6d2ffd640 1 -- 172.21.15.77:0/956644899 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4004410 con 0x7ff6dc0dbce0 2024-04-25T01:39:39.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.908+0000 7fd63ca15640 1 -- 172.21.15.77:0/632725884 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6381e7ca0 con 0x7fd63814ca60 2024-04-25T01:39:39.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.908+0000 7ff6e359e640 1 -- 172.21.15.77:0/956644899 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6dc045170 con 0x7ff6dc0dbce0 2024-04-25T01:39:39.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.908+0000 7fb4e6ffd640 1 -- 172.21.15.77:0/3685349644 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f80b3040 con 0x7fb4f00d58e0 2024-04-25T01:39:39.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.908+0000 7fb4e6ffd640 1 -- 172.21.15.77:0/3685349644 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4f80ae670 con 0x7fb4f00d58e0 2024-04-25T01:39:39.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.909+0000 7fb4e6ffd640 1 -- 172.21.15.77:0/3685349644 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f80aea20 con 0x7fb4f00d58e0 2024-04-25T01:39:39.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.909+0000 7f9544ff9640 1 -- 172.21.15.77:0/1148709557 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9540018400 con 0x7f9548072270 2024-04-25T01:39:39.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.909+0000 7f954e59e640 1 -- 172.21.15.77:0/1148709557 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9548151790 con 0x7f9548072270 2024-04-25T01:39:39.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.908+0000 7ff6e359e640 1 -- 172.21.15.77:0/956644899 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6dc042a40 con 0x7ff6dc0dbce0 2024-04-25T01:39:39.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.909+0000 7fb4f759e640 1 -- 172.21.15.77:0/3685349644 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4f00d3e50 con 0x7fb4f00d58e0 2024-04-25T01:39:39.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.910+0000 7fb4f759e640 1 -- 172.21.15.77:0/3685349644 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4f00d4e80 con 0x7fb4f00d58e0 2024-04-25T01:39:39.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.910+0000 7f9544ff9640 1 --2- 172.21.15.77:0/1148709557 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f953406bf30 0x7f953406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.908+0000 7f5aaffff640 1 -- 172.21.15.77:0/3147048605 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5ab801a070 con 0x7f5ac80c1f80 2024-04-25T01:39:39.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.908+0000 7f5aaffff640 1 --2- 172.21.15.77:0/3147048605 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5ab406be80 0x7f5ab406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.909+0000 7f5aaffff640 1 -- 172.21.15.77:0/3147048605 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f5ab80565d0 con 0x7f5ac80c1f80 2024-04-25T01:39:39.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.909+0000 7f5aaffff640 1 --2- 172.21.15.77:0/3147048605 >> [v2:172.21.15.121:6805/2785294752,v1:172.21.15.121:6807/2785294752] conn(0x7f5ab4077320 0x7f5ab40797c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.909+0000 7f5aaffff640 1 -- 172.21.15.77:0/3147048605 --> [v2:172.21.15.121:6805/2785294752,v1:172.21.15.121:6807/2785294752] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5ab4079e90 con 0x7f5ab4077320 2024-04-25T01:39:39.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.909+0000 7f5aaffff640 1 -- 172.21.15.77:0/3147048605 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5ab8054f60 con 0x7f5ac80c1f80 2024-04-25T01:39:39.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.909+0000 7f5ac77fe640 1 --2- 172.21.15.77:0/3147048605 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5ab406be80 0x7f5ab406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.909+0000 7f840f7fe640 1 --2- 172.21.15.77:0/1618777104 >> [v2:172.21.15.121:6818/523906818,v1:172.21.15.121:6820/523906818] conn(0x7f83fc076640 0x7f83fc078a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.909+0000 7f840e7fc640 1 --2- 172.21.15.77:0/1618777104 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f83fc06be30 0x7f83fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.910+0000 7ff6d0ff9640 1 -- 172.21.15.77:0/956644899 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff6dc005390 con 0x7ff6dc0dbce0 2024-04-25T01:39:39.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.910+0000 7f6328130640 1 -- start start 2024-04-25T01:39:39.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.909+0000 7f2fd27fc640 1 -- 172.21.15.77:0/1832689577 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2fd80329d0 con 0x7f2fdc0c5ba0 2024-04-25T01:39:39.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.910+0000 7f9544ff9640 1 -- 172.21.15.77:0/1148709557 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f954008bdb0 con 0x7f9548072270 2024-04-25T01:39:39.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.909+0000 7f2fd27fc640 1 --2- 172.21.15.77:0/1832689577 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2fc006be30 0x7f2fc006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.910+0000 7f2fd27fc640 1 -- 172.21.15.77:0/1832689577 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f2fd80ab9a0 con 0x7f2fdc0c5ba0 2024-04-25T01:39:39.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.910+0000 7f2fd27fc640 1 --2- 172.21.15.77:0/1832689577 >> [v2:172.21.15.77:6809/3366980158,v1:172.21.15.77:6811/3366980158] conn(0x7f2fc0076640 0x7f2fc0078a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.910+0000 7f2fd27fc640 1 -- 172.21.15.77:0/1832689577 --> [v2:172.21.15.77:6809/3366980158,v1:172.21.15.77:6811/3366980158] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2fd8034e90 con 0x7f2fc0076640 2024-04-25T01:39:39.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.910+0000 7f2fd27fc640 1 -- 172.21.15.77:0/1832689577 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2fd80b02c0 con 0x7f2fdc0c5ba0 2024-04-25T01:39:39.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.910+0000 7f2fe2165640 1 --2- 172.21.15.77:0/1832689577 >> [v2:172.21.15.77:6809/3366980158,v1:172.21.15.77:6811/3366980158] conn(0x7f2fc0076640 0x7f2fc0078a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.910+0000 7f95477fe640 1 --2- 172.21.15.77:0/1148709557 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f953406bf30 0x7f953406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.910+0000 7fd63ca15640 1 -- 172.21.15.77:0/632725884 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd638075d10 con 0x7fd63814ca60 2024-04-25T01:39:39.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.910+0000 7f2fe1163640 1 --2- 172.21.15.77:0/1832689577 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2fc006be30 0x7f2fc006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.910+0000 7f840f7fe640 1 --2- 172.21.15.77:0/1618777104 >> [v2:172.21.15.121:6818/523906818,v1:172.21.15.121:6820/523906818] conn(0x7f83fc076640 0x7f83fc078a60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.910+0000 7f840e7fc640 1 --2- 172.21.15.77:0/1618777104 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f83fc06be30 0x7f83fc06e2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f840003d000 tx=0x7f8400037000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.911+0000 7f2fe2165640 1 --2- 172.21.15.77:0/1832689577 >> [v2:172.21.15.77:6809/3366980158,v1:172.21.15.77:6811/3366980158] conn(0x7f2fc0076640 0x7f2fc0078a60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.911+0000 7f2fe1163640 1 --2- 172.21.15.77:0/1832689577 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2fc006be30 0x7f2fc006e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc1449b0 tx=0x7f2fcc009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.911+0000 7f95477fe640 1 --2- 172.21.15.77:0/1148709557 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f953406bf30 0x7f953406e3f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f953c037000 tx=0x7f953c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.911+0000 7f9544ff9640 1 --2- 172.21.15.77:0/1148709557 >> [v2:172.21.15.121:6800/2565483070,v1:172.21.15.121:6801/2565483070] conn(0x7f95340767c0 0x7f9534078be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.911+0000 7f9544ff9640 1 -- 172.21.15.77:0/1148709557 --> [v2:172.21.15.121:6800/2565483070,v1:172.21.15.121:6801/2565483070] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9540020ec0 con 0x7f95340767c0 2024-04-25T01:39:39.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.911+0000 7f9544ff9640 1 -- 172.21.15.77:0/1148709557 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f95400913a0 con 0x7f9548072270 2024-04-25T01:39:39.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.911+0000 7ff6d2ffd640 1 -- 172.21.15.77:0/956644899 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff6d4018070 con 0x7ff6dc0dbce0 2024-04-25T01:39:39.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.911+0000 7f6328130640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6320072390 0x7f63200acbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.911+0000 7f5ac7fff640 1 --2- 172.21.15.77:0/3147048605 >> [v2:172.21.15.121:6805/2785294752,v1:172.21.15.121:6807/2785294752] conn(0x7f5ab4077320 0x7f5ab40797c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.911+0000 7f5ac77fe640 1 --2- 172.21.15.77:0/3147048605 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5ab406be80 0x7f5ab406e340 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5abc034000 tx=0x7f5abc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.911+0000 7f6328130640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63200c8c60 0x7f6320152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.911+0000 7f954cb3b640 1 --2- 172.21.15.77:0/1148709557 >> [v2:172.21.15.121:6800/2565483070,v1:172.21.15.121:6801/2565483070] conn(0x7f95340767c0 0x7f9534078be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.911+0000 7fd626ffd640 1 -- 172.21.15.77:0/632725884 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd628023070 con 0x7fd63814ca60 2024-04-25T01:39:39.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.911+0000 7f6328130640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f632014da90 0x7f632014a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.911+0000 7f6328130640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f63201549d0 con 0x7f6320072390 2024-04-25T01:39:39.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.911+0000 7f6325ecc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6320072390 0x7f63200acbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.911+0000 7f6325ecc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6320072390 0x7f63200acbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46778/0 (socket says 172.21.15.77:46778) 2024-04-25T01:39:39.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.911+0000 7f6325ecc640 1 -- 172.21.15.77:0/1181263078 learned_addr learned my addr 172.21.15.77:0/1181263078 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:39.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.911+0000 7f6328130640 1 -- 172.21.15.77:0/1181263078 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6320151730 con 0x7f63200c8c60 2024-04-25T01:39:39.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.911+0000 7fb4f759e640 1 -- 172.21.15.77:0/3685349644 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb4f00c95b0 con 0x7fb4f00d58e0 2024-04-25T01:39:39.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.911+0000 7ff6d2ffd640 1 --2- 172.21.15.77:0/956644899 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff6c406be30 0x7ff6c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.911+0000 7f6328130640 1 -- 172.21.15.77:0/1181263078 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f63200c9190 con 0x7f632014da90 2024-04-25T01:39:39.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.912+0000 7f63256cb640 1 --2- 172.21.15.77:0/1181263078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63200c8c60 0x7f6320152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.912+0000 7ff6d2ffd640 1 -- 172.21.15.77:0/956644899 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7ff6d408ac40 con 0x7ff6dc0dbce0 2024-04-25T01:39:39.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.912+0000 7f63266cd640 1 --2- 172.21.15.77:0/1181263078 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f632014da90 0x7f632014a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.912+0000 7fd626ffd640 1 --2- 172.21.15.77:0/632725884 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd61806bf00 0x7fd61806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.912+0000 7f2fd27fc640 1 -- 172.21.15.77:0/1832689577 <== osd.0 v2:172.21.15.77:6809/3366980158 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2fd8034e90 con 0x7f2fc0076640 2024-04-25T01:39:39.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.912+0000 7ff6d2ffd640 1 --2- 172.21.15.77:0/956644899 >> [v2:172.21.15.121:6816/1683602459,v1:172.21.15.121:6817/1683602459] conn(0x7ff6c40766c0 0x7ff6c4078ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.912+0000 7fd626ffd640 1 -- 172.21.15.77:0/632725884 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fd62808f760 con 0x7fd63814ca60 2024-04-25T01:39:39.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.912+0000 7fb4e6ffd640 1 -- 172.21.15.77:0/3685349644 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb4f80aebc0 con 0x7fb4f00d58e0 2024-04-25T01:39:39.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.912+0000 7ff6d2ffd640 1 -- 172.21.15.77:0/956644899 --> [v2:172.21.15.121:6816/1683602459,v1:172.21.15.121:6817/1683602459] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff6c4079190 con 0x7ff6c40766c0 2024-04-25T01:39:39.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.912+0000 7ff6d2ffd640 1 -- 172.21.15.77:0/956644899 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff6d4091020 con 0x7ff6dc0dbce0 2024-04-25T01:39:39.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.912+0000 7f83f77fe640 1 -- 172.21.15.77:0/1618777104 <== osd.6 v2:172.21.15.121:6818/523906818 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8404014ec0 con 0x7f83fc076640 2024-04-25T01:39:39.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.912+0000 7ff6e259c640 1 --2- 172.21.15.77:0/956644899 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff6c406be30 0x7ff6c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.912+0000 7f5ac7fff640 1 --2- 172.21.15.77:0/3147048605 >> [v2:172.21.15.121:6805/2785294752,v1:172.21.15.121:6807/2785294752] conn(0x7f5ab4077320 0x7f5ab40797c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.912+0000 7f6325ecc640 1 -- 172.21.15.77:0/1181263078 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f632014da90 msgr2=0x7f632014a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.912+0000 7ff6e2d9d640 1 --2- 172.21.15.77:0/956644899 >> [v2:172.21.15.121:6816/1683602459,v1:172.21.15.121:6817/1683602459] conn(0x7ff6c40766c0 0x7ff6c4078ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.912+0000 7f6325ecc640 1 --2- 172.21.15.77:0/1181263078 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f632014da90 0x7f632014a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.912+0000 7f6325ecc640 1 -- 172.21.15.77:0/1181263078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63200c8c60 msgr2=0x7f6320152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.912+0000 7f6325ecc640 1 --2- 172.21.15.77:0/1181263078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63200c8c60 0x7f6320152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.912+0000 7f6325ecc640 1 -- 172.21.15.77:0/1181263078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632014cd10 con 0x7f6320072390 2024-04-25T01:39:39.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.912+0000 7fb4e6ffd640 1 --2- 172.21.15.77:0/3685349644 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb4d806be80 0x7fb4d806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.912+0000 7f63256cb640 1 --2- 172.21.15.77:0/1181263078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63200c8c60 0x7f6320152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:39.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.912+0000 7fd626ffd640 1 --2- 172.21.15.77:0/632725884 >> [v2:172.21.15.77:6800/3971619298,v1:172.21.15.77:6801/3971619298] conn(0x7fd6180767a0 0x7fd618078bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.912+0000 7f954cb3b640 1 --2- 172.21.15.77:0/1148709557 >> [v2:172.21.15.121:6800/2565483070,v1:172.21.15.121:6801/2565483070] conn(0x7f95340767c0 0x7f9534078be0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.912+0000 7fb4e6ffd640 1 -- 172.21.15.77:0/3685349644 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fb4f8130440 con 0x7fb4f00d58e0 2024-04-25T01:39:39.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.913+0000 7fb4e6ffd640 1 --2- 172.21.15.77:0/3685349644 >> [v2:172.21.15.77:6816/217398906,v1:172.21.15.77:6819/217398906] conn(0x7fb4d8076690 0x7fb4d8078ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.913+0000 7fb4e6ffd640 1 -- 172.21.15.77:0/3685349644 --> [v2:172.21.15.77:6816/217398906,v1:172.21.15.77:6819/217398906] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb4d8079160 con 0x7fb4d8076690 2024-04-25T01:39:39.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.913+0000 7fb4e6ffd640 1 -- 172.21.15.77:0/3685349644 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb4f8137050 con 0x7fb4f00d58e0 2024-04-25T01:39:39.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.913+0000 7ff6e259c640 1 --2- 172.21.15.77:0/956644899 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff6c406be30 0x7ff6c406e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff6d802a040 tx=0x7ff6d802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.912+0000 7fd63659c640 1 --2- 172.21.15.77:0/632725884 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd61806bf00 0x7fd61806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.913+0000 7fb4f659c640 1 --2- 172.21.15.77:0/3685349644 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb4d806be80 0x7fb4d806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.913+0000 7f5aaffff640 1 -- 172.21.15.77:0/3147048605 <== osd.5 v2:172.21.15.121:6805/2785294752 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5ab4079e90 con 0x7f5ab4077320 2024-04-25T01:39:39.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.912+0000 7fd626ffd640 1 -- 172.21.15.77:0/632725884 --> [v2:172.21.15.77:6800/3971619298,v1:172.21.15.77:6801/3971619298] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd618079270 con 0x7fd6180767a0 2024-04-25T01:39:39.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.913+0000 7f6325ecc640 1 --2- 172.21.15.77:0/1181263078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6320072390 0x7f63200acbc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f631c00c480 tx=0x7f631c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.912+0000 7fd626ffd640 1 -- 172.21.15.77:0/632725884 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd628096050 con 0x7fd63814ca60 2024-04-25T01:39:39.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.913+0000 7f9544ff9640 1 -- 172.21.15.77:0/1148709557 <== osd.4 v2:172.21.15.121:6800/2565483070 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9540020ec0 con 0x7f95340767c0 2024-04-25T01:39:39.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.912+0000 7fd635d9b640 1 --2- 172.21.15.77:0/632725884 >> [v2:172.21.15.77:6800/3971619298,v1:172.21.15.77:6801/3971619298] conn(0x7fd6180767a0 0x7fd618078bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.913+0000 7fd63659c640 1 --2- 172.21.15.77:0/632725884 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd61806bf00 0x7fd61806e3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd630034000 tx=0x7fd63002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.913+0000 7fb4f5d9b640 1 --2- 172.21.15.77:0/3685349644 >> [v2:172.21.15.77:6816/217398906,v1:172.21.15.77:6819/217398906] conn(0x7fb4d8076690 0x7fb4d8078ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.913+0000 7fb4f659c640 1 --2- 172.21.15.77:0/3685349644 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb4d806be80 0x7fb4d806e340 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8009410 tx=0x7fb4e80093a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.913+0000 7ff6e2d9d640 1 --2- 172.21.15.77:0/956644899 >> [v2:172.21.15.121:6816/1683602459,v1:172.21.15.121:6817/1683602459] conn(0x7ff6c40766c0 0x7ff6c4078ae0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.913+0000 7f63167fc640 1 -- 172.21.15.77:0/1181263078 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631c017070 con 0x7f6320072390 2024-04-25T01:39:39.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.913+0000 7f63167fc640 1 -- 172.21.15.77:0/1181263078 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f631c005ce0 con 0x7f6320072390 2024-04-25T01:39:39.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.913+0000 7f63167fc640 1 -- 172.21.15.77:0/1181263078 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631c0072d0 con 0x7f6320072390 2024-04-25T01:39:39.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.914+0000 7fd635d9b640 1 --2- 172.21.15.77:0/632725884 >> [v2:172.21.15.77:6800/3971619298,v1:172.21.15.77:6801/3971619298] conn(0x7fd6180767a0 0x7fd618078bc0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.914+0000 7f6328130640 1 -- 172.21.15.77:0/1181263078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f632014cfb0 con 0x7f6320072390 2024-04-25T01:39:39.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.914+0000 7f6328130640 1 -- 172.21.15.77:0/1181263078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63201533f0 con 0x7f6320072390 2024-04-25T01:39:39.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.914+0000 7fb4f5d9b640 1 --2- 172.21.15.77:0/3685349644 >> [v2:172.21.15.77:6816/217398906,v1:172.21.15.77:6819/217398906] conn(0x7fb4d8076690 0x7fb4d8078ab0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.915+0000 7f6328130640 1 -- 172.21.15.77:0/1181263078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f632004f500 con 0x7f6320072390 2024-04-25T01:39:39.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.915+0000 7ff6d2ffd640 1 -- 172.21.15.77:0/956644899 <== osd.7 v2:172.21.15.121:6816/1683602459 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff6c4079190 con 0x7ff6c40766c0 2024-04-25T01:39:39.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.915+0000 7fb4e6ffd640 1 -- 172.21.15.77:0/3685349644 <== osd.3 v2:172.21.15.77:6816/217398906 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb4d8079160 con 0x7fb4d8076690 2024-04-25T01:39:39.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.916+0000 7fd626ffd640 1 -- 172.21.15.77:0/632725884 <== osd.1 v2:172.21.15.77:6800/3971619298 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd618079270 con 0x7fd6180767a0 2024-04-25T01:39:39.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.916+0000 7f63167fc640 1 -- 172.21.15.77:0/1181263078 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f631c01a070 con 0x7f6320072390 2024-04-25T01:39:39.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.917+0000 7f63167fc640 1 --2- 172.21.15.77:0/1181263078 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f630406bf00 0x7f630406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.917+0000 7f63167fc640 1 -- 172.21.15.77:0/1181263078 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f631c08ad40 con 0x7f6320072390 2024-04-25T01:39:39.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.917+0000 7f63167fc640 1 --2- 172.21.15.77:0/1181263078 >> [v2:172.21.15.77:6808/4103452689,v1:172.21.15.77:6810/4103452689] conn(0x7f6304076790 0x7f6304078bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:39.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.917+0000 7f63167fc640 1 -- 172.21.15.77:0/1181263078 --> [v2:172.21.15.77:6808/4103452689,v1:172.21.15.77:6810/4103452689] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f631c013e50 con 0x7f6304076790 2024-04-25T01:39:39.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.917+0000 7f63167fc640 1 -- 172.21.15.77:0/1181263078 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f631c08b130 con 0x7f6320072390 2024-04-25T01:39:39.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.917+0000 7f63256cb640 1 --2- 172.21.15.77:0/1181263078 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f630406bf00 0x7f630406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.918+0000 7f63256cb640 1 --2- 172.21.15.77:0/1181263078 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f630406bf00 0x7f630406e3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6310034000 tx=0x7f631002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.918+0000 7f63266cd640 1 --2- 172.21.15.77:0/1181263078 >> [v2:172.21.15.77:6808/4103452689,v1:172.21.15.77:6810/4103452689] conn(0x7f6304076790 0x7f6304078bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:39.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.919+0000 7f63266cd640 1 --2- 172.21.15.77:0/1181263078 >> [v2:172.21.15.77:6808/4103452689,v1:172.21.15.77:6810/4103452689] conn(0x7f6304076790 0x7f6304078bb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:39.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.920+0000 7f63167fc640 1 -- 172.21.15.77:0/1181263078 <== osd.2 v2:172.21.15.77:6808/4103452689 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f631c013e50 con 0x7f6304076790 2024-04-25T01:39:39.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.942+0000 7f5ace0e1640 1 -- 172.21.15.77:0/3147048605 --> [v2:172.21.15.121:6805/2785294752,v1:172.21.15.121:6807/2785294752] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5ac8158190 con 0x7f5ab4077320 2024-04-25T01:39:39.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.943+0000 7f5aaffff640 1 -- 172.21.15.77:0/3147048605 <== osd.5 v2:172.21.15.121:6805/2785294752 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5ac8158190 con 0x7f5ab4077320 2024-04-25T01:39:39.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.944+0000 7f8415714640 1 -- 172.21.15.77:0/1618777104 --> [v2:172.21.15.121:6818/523906818,v1:172.21.15.121:6820/523906818] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f84101eef80 con 0x7f83fc076640 2024-04-25T01:39:39.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.944+0000 7f2fe3bc8640 1 -- 172.21.15.77:0/1832689577 --> [v2:172.21.15.77:6809/3366980158,v1:172.21.15.77:6811/3366980158] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2fdc04f500 con 0x7f2fc0076640 2024-04-25T01:39:39.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.944+0000 7f5aadffb640 1 -- 172.21.15.77:0/3147048605 >> [v2:172.21.15.121:6805/2785294752,v1:172.21.15.121:6807/2785294752] conn(0x7f5ab4077320 msgr2=0x7f5ab40797c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.944+0000 7f5aadffb640 1 --2- 172.21.15.77:0/3147048605 >> [v2:172.21.15.121:6805/2785294752,v1:172.21.15.121:6807/2785294752] conn(0x7f5ab4077320 0x7f5ab40797c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.944+0000 7f5aadffb640 1 -- 172.21.15.77:0/3147048605 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5ab406be80 msgr2=0x7f5ab406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.944+0000 7f5aadffb640 1 --2- 172.21.15.77:0/3147048605 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5ab406be80 0x7f5ab406e340 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5abc034000 tx=0x7f5abc02e000 comp rx=0 tx=0).stop 2024-04-25T01:39:39.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.944+0000 7f5aadffb640 1 -- 172.21.15.77:0/3147048605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ac80c1f80 msgr2=0x7f5ac8070b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.944+0000 7f5aadffb640 1 --2- 172.21.15.77:0/3147048605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ac80c1f80 0x7f5ac8070b20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5ab800c500 tx=0x7f5ab800c9c0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.944+0000 7f5ac7fff640 1 -- 172.21.15.77:0/3147048605 reap_dead start 2024-04-25T01:39:39.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.944+0000 7f83f77fe640 1 -- 172.21.15.77:0/1618777104 <== osd.6 v2:172.21.15.121:6818/523906818 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f84101eef80 con 0x7f83fc076640 2024-04-25T01:39:39.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.944+0000 7f5aadffb640 1 -- 172.21.15.77:0/3147048605 shutdown_connections 2024-04-25T01:39:39.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.944+0000 7f5aadffb640 1 -- 172.21.15.77:0/3147048605 >> 172.21.15.77:0/3147048605 conn(0x7f5ac80c7580 msgr2=0x7f5ac80c5170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:39.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.945+0000 7f2fd27fc640 1 -- 172.21.15.77:0/1832689577 <== osd.0 v2:172.21.15.77:6809/3366980158 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2fdc04f500 con 0x7f2fc0076640 2024-04-25T01:39:39.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.945+0000 7f5aadffb640 1 -- 172.21.15.77:0/3147048605 shutdown_connections 2024-04-25T01:39:39.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.945+0000 7f5aadffb640 1 -- 172.21.15.77:0/3147048605 wait complete. 2024-04-25T01:39:39.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.945+0000 7f8415714640 1 -- 172.21.15.77:0/1618777104 >> [v2:172.21.15.121:6818/523906818,v1:172.21.15.121:6820/523906818] conn(0x7f83fc076640 msgr2=0x7f83fc078a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.945+0000 7f8415714640 1 --2- 172.21.15.77:0/1618777104 >> [v2:172.21.15.121:6818/523906818,v1:172.21.15.121:6820/523906818] conn(0x7f83fc076640 0x7f83fc078a60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.945+0000 7f2fbffff640 1 -- 172.21.15.77:0/1832689577 >> [v2:172.21.15.77:6809/3366980158,v1:172.21.15.77:6811/3366980158] conn(0x7f2fc0076640 msgr2=0x7f2fc0078a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.945+0000 7f2fbffff640 1 --2- 172.21.15.77:0/1832689577 >> [v2:172.21.15.77:6809/3366980158,v1:172.21.15.77:6811/3366980158] conn(0x7f2fc0076640 0x7f2fc0078a60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.945+0000 7f2fbffff640 1 -- 172.21.15.77:0/1832689577 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2fc006be30 msgr2=0x7f2fc006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.945+0000 7f2fbffff640 1 --2- 172.21.15.77:0/1832689577 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2fc006be30 0x7f2fc006e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc1449b0 tx=0x7f2fcc009190 comp rx=0 tx=0).stop 2024-04-25T01:39:39.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.945+0000 7f2fbffff640 1 -- 172.21.15.77:0/1832689577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fdc0c5ba0 msgr2=0x7f2fdc1ece60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.945+0000 7f2fbffff640 1 --2- 172.21.15.77:0/1832689577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fdc0c5ba0 0x7f2fdc1ece60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80090b0 tx=0x7f2fd80046c0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.945+0000 7f8415714640 1 -- 172.21.15.77:0/1618777104 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f83fc06be30 msgr2=0x7f83fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.946+0000 7f8415714640 1 --2- 172.21.15.77:0/1618777104 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f83fc06be30 0x7f83fc06e2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f840003d000 tx=0x7f8400037000 comp rx=0 tx=0).stop 2024-04-25T01:39:39.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.946+0000 7f8415714640 1 -- 172.21.15.77:0/1618777104 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f841006e330 msgr2=0x7f841020adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.946+0000 7f8415714640 1 --2- 172.21.15.77:0/1618777104 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f841006e330 0x7f841020adc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f840400c470 tx=0x7f840400c930 comp rx=0 tx=0).stop 2024-04-25T01:39:39.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.946+0000 7f840f7fe640 1 -- 172.21.15.77:0/1618777104 reap_dead start 2024-04-25T01:39:39.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.946+0000 7f2fe2165640 1 -- 172.21.15.77:0/1832689577 reap_dead start 2024-04-25T01:39:39.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.946+0000 7f2fbffff640 1 -- 172.21.15.77:0/1832689577 shutdown_connections 2024-04-25T01:39:39.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.946+0000 7f2fbffff640 1 -- 172.21.15.77:0/1832689577 >> 172.21.15.77:0/1832689577 conn(0x7f2fdc0c7580 msgr2=0x7f2fdc0c6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:39.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.946+0000 7f8415714640 1 -- 172.21.15.77:0/1618777104 shutdown_connections 2024-04-25T01:39:39.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.946+0000 7f8415714640 1 -- 172.21.15.77:0/1618777104 >> 172.21.15.77:0/1618777104 conn(0x7f84100c7580 msgr2=0x7f8410164570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:39.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.946+0000 7f2fbffff640 1 -- 172.21.15.77:0/1832689577 shutdown_connections 2024-04-25T01:39:39.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.946+0000 7f954e59e640 1 -- 172.21.15.77:0/1148709557 --> [v2:172.21.15.121:6800/2565483070,v1:172.21.15.121:6801/2565483070] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9548151790 con 0x7f95340767c0 2024-04-25T01:39:39.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.946+0000 7f2fbffff640 1 -- 172.21.15.77:0/1832689577 wait complete. 2024-04-25T01:39:39.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.947+0000 7f8415714640 1 -- 172.21.15.77:0/1618777104 shutdown_connections 2024-04-25T01:39:39.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.947+0000 7f8415714640 1 -- 172.21.15.77:0/1618777104 wait complete. 2024-04-25T01:39:39.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.947+0000 7f9544ff9640 1 -- 172.21.15.77:0/1148709557 <== osd.4 v2:172.21.15.121:6800/2565483070 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9548151790 con 0x7f95340767c0 2024-04-25T01:39:39.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.947+0000 7fb4f759e640 1 -- 172.21.15.77:0/3685349644 --> [v2:172.21.15.77:6816/217398906,v1:172.21.15.77:6819/217398906] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb4f00057e0 con 0x7fb4d8076690 2024-04-25T01:39:39.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.947+0000 7f954e59e640 1 -- 172.21.15.77:0/1148709557 >> [v2:172.21.15.121:6800/2565483070,v1:172.21.15.121:6801/2565483070] conn(0x7f95340767c0 msgr2=0x7f9534078be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.948+0000 7f954e59e640 1 --2- 172.21.15.77:0/1148709557 >> [v2:172.21.15.121:6800/2565483070,v1:172.21.15.121:6801/2565483070] conn(0x7f95340767c0 0x7f9534078be0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.948+0000 7f954e59e640 1 -- 172.21.15.77:0/1148709557 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f953406bf30 msgr2=0x7f953406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.948+0000 7f954e59e640 1 --2- 172.21.15.77:0/1148709557 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f953406bf30 0x7f953406e3f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f953c037000 tx=0x7f953c008030 comp rx=0 tx=0).stop 2024-04-25T01:39:39.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.948+0000 7f954e59e640 1 -- 172.21.15.77:0/1148709557 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9548072270 msgr2=0x7f95480c6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.948+0000 7f954e59e640 1 --2- 172.21.15.77:0/1148709557 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9548072270 0x7f95480c6460 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f954000ce30 tx=0x7f954000a650 comp rx=0 tx=0).stop 2024-04-25T01:39:39.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.948+0000 7f954cb3b640 1 -- 172.21.15.77:0/1148709557 reap_dead start 2024-04-25T01:39:39.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.948+0000 7f954e59e640 1 -- 172.21.15.77:0/1148709557 shutdown_connections 2024-04-25T01:39:39.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.948+0000 7f954e59e640 1 -- 172.21.15.77:0/1148709557 >> 172.21.15.77:0/1148709557 conn(0x7f95480c9530 msgr2=0x7f95480c79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:39.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.948+0000 7fb4e6ffd640 1 -- 172.21.15.77:0/3685349644 <== osd.3 v2:172.21.15.77:6816/217398906 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb4f00057e0 con 0x7fb4d8076690 2024-04-25T01:39:39.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.949+0000 7f954e59e640 1 -- 172.21.15.77:0/1148709557 shutdown_connections 2024-04-25T01:39:39.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.949+0000 7fd63ca15640 1 -- 172.21.15.77:0/632725884 --> [v2:172.21.15.77:6800/3971619298,v1:172.21.15.77:6801/3971619298] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd63806eaf0 con 0x7fd6180767a0 2024-04-25T01:39:39.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.949+0000 7f954e59e640 1 -- 172.21.15.77:0/1148709557 wait complete. 2024-04-25T01:39:39.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.949+0000 7fb4f759e640 1 -- 172.21.15.77:0/3685349644 >> [v2:172.21.15.77:6816/217398906,v1:172.21.15.77:6819/217398906] conn(0x7fb4d8076690 msgr2=0x7fb4d8078ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.949+0000 7fb4f759e640 1 --2- 172.21.15.77:0/3685349644 >> [v2:172.21.15.77:6816/217398906,v1:172.21.15.77:6819/217398906] conn(0x7fb4d8076690 0x7fb4d8078ab0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.949+0000 7fb4f759e640 1 -- 172.21.15.77:0/3685349644 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb4d806be80 msgr2=0x7fb4d806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.949+0000 7fb4f759e640 1 --2- 172.21.15.77:0/3685349644 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb4d806be80 0x7fb4d806e340 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8009410 tx=0x7fb4e80093a0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.949+0000 7fb4f759e640 1 -- 172.21.15.77:0/3685349644 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb4f00d58e0 msgr2=0x7fb4f00c9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.949+0000 7fb4f759e640 1 --2- 172.21.15.77:0/3685349644 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb4f00d58e0 0x7fb4f00c9070 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8050770 tx=0x7fb4f8069650 comp rx=0 tx=0).stop 2024-04-25T01:39:39.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.949+0000 7fd626ffd640 1 -- 172.21.15.77:0/632725884 <== osd.1 v2:172.21.15.77:6800/3971619298 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd63806eaf0 con 0x7fd6180767a0 2024-04-25T01:39:39.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.949+0000 7fb4f6d9d640 1 -- 172.21.15.77:0/3685349644 reap_dead start 2024-04-25T01:39:39.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.950+0000 7fb4f759e640 1 -- 172.21.15.77:0/3685349644 shutdown_connections 2024-04-25T01:39:39.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.950+0000 7fb4f759e640 1 -- 172.21.15.77:0/3685349644 >> 172.21.15.77:0/3685349644 conn(0x7fb4f002f5d0 msgr2=0x7fb4f002ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:39.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.950+0000 7ff6d0ff9640 1 -- 172.21.15.77:0/956644899 --> [v2:172.21.15.121:6816/1683602459,v1:172.21.15.121:6817/1683602459] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff6dc042c40 con 0x7ff6c40766c0 2024-04-25T01:39:39.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.950+0000 7fb4f759e640 1 -- 172.21.15.77:0/3685349644 shutdown_connections 2024-04-25T01:39:39.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.950+0000 7fb4f759e640 1 -- 172.21.15.77:0/3685349644 wait complete. 2024-04-25T01:39:39.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.950+0000 7fd63ca15640 1 -- 172.21.15.77:0/632725884 >> [v2:172.21.15.77:6800/3971619298,v1:172.21.15.77:6801/3971619298] conn(0x7fd6180767a0 msgr2=0x7fd618078bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.950+0000 7fd63ca15640 1 --2- 172.21.15.77:0/632725884 >> [v2:172.21.15.77:6800/3971619298,v1:172.21.15.77:6801/3971619298] conn(0x7fd6180767a0 0x7fd618078bc0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.950+0000 7fd63ca15640 1 -- 172.21.15.77:0/632725884 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd61806bf00 msgr2=0x7fd61806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.950+0000 7fd63ca15640 1 --2- 172.21.15.77:0/632725884 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd61806bf00 0x7fd61806e3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd630034000 tx=0x7fd63002e000 comp rx=0 tx=0).stop 2024-04-25T01:39:39.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.950+0000 7fd63ca15640 1 -- 172.21.15.77:0/632725884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd63814ca60 msgr2=0x7fd6380c4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.950+0000 7fd63ca15640 1 --2- 172.21.15.77:0/632725884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd63814ca60 0x7fd6380c4540 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd628009e30 tx=0x7fd62800c490 comp rx=0 tx=0).stop 2024-04-25T01:39:39.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.950+0000 7f6328130640 1 -- 172.21.15.77:0/1181263078 --> [v2:172.21.15.77:6808/4103452689,v1:172.21.15.77:6810/4103452689] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f632014d850 con 0x7f6304076790 2024-04-25T01:39:39.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.950+0000 7fd636d9d640 1 -- 172.21.15.77:0/632725884 reap_dead start 2024-04-25T01:39:39.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.950+0000 7fd63ca15640 1 -- 172.21.15.77:0/632725884 shutdown_connections 2024-04-25T01:39:39.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.950+0000 7fd63ca15640 1 -- 172.21.15.77:0/632725884 >> 172.21.15.77:0/632725884 conn(0x7fd6380c5020 msgr2=0x7fd638151ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:39.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.951+0000 7f63167fc640 1 -- 172.21.15.77:0/1181263078 <== osd.2 v2:172.21.15.77:6808/4103452689 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f632014d850 con 0x7f6304076790 2024-04-25T01:39:39.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.951+0000 7ff6d2ffd640 1 -- 172.21.15.77:0/956644899 <== osd.7 v2:172.21.15.121:6816/1683602459 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff6dc042c40 con 0x7ff6c40766c0 2024-04-25T01:39:39.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.951+0000 7f6328130640 1 -- 172.21.15.77:0/1181263078 >> [v2:172.21.15.77:6808/4103452689,v1:172.21.15.77:6810/4103452689] conn(0x7f6304076790 msgr2=0x7f6304078bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.951+0000 7f6328130640 1 --2- 172.21.15.77:0/1181263078 >> [v2:172.21.15.77:6808/4103452689,v1:172.21.15.77:6810/4103452689] conn(0x7f6304076790 0x7f6304078bb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.952+0000 7f6328130640 1 -- 172.21.15.77:0/1181263078 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f630406bf00 msgr2=0x7f630406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.952+0000 7f6328130640 1 --2- 172.21.15.77:0/1181263078 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f630406bf00 0x7f630406e3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6310034000 tx=0x7f631002e000 comp rx=0 tx=0).stop 2024-04-25T01:39:39.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.952+0000 7f6328130640 1 -- 172.21.15.77:0/1181263078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6320072390 msgr2=0x7f63200acbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.952+0000 7f6328130640 1 --2- 172.21.15.77:0/1181263078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6320072390 0x7f63200acbc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f631c00c480 tx=0x7f631c00c940 comp rx=0 tx=0).stop 2024-04-25T01:39:39.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.952+0000 7f63266cd640 1 -- 172.21.15.77:0/1181263078 reap_dead start 2024-04-25T01:39:39.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.952+0000 7ff6e359e640 1 -- 172.21.15.77:0/956644899 >> [v2:172.21.15.121:6816/1683602459,v1:172.21.15.121:6817/1683602459] conn(0x7ff6c40766c0 msgr2=0x7ff6c4078ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.952+0000 7ff6e359e640 1 --2- 172.21.15.77:0/956644899 >> [v2:172.21.15.121:6816/1683602459,v1:172.21.15.121:6817/1683602459] conn(0x7ff6c40766c0 0x7ff6c4078ae0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.952+0000 7f6328130640 1 -- 172.21.15.77:0/1181263078 shutdown_connections 2024-04-25T01:39:39.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.952+0000 7f6328130640 1 -- 172.21.15.77:0/1181263078 >> 172.21.15.77:0/1181263078 conn(0x7f63200c60a0 msgr2=0x7f63201503e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:39.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.952+0000 7ff6e359e640 1 -- 172.21.15.77:0/956644899 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff6c406be30 msgr2=0x7ff6c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.952+0000 7ff6e359e640 1 --2- 172.21.15.77:0/956644899 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff6c406be30 0x7ff6c406e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff6d802a040 tx=0x7ff6d802e000 comp rx=0 tx=0).stop 2024-04-25T01:39:39.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.952+0000 7ff6e359e640 1 -- 172.21.15.77:0/956644899 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff6dc0dbce0 msgr2=0x7ff6dc0d4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:39.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.952+0000 7ff6e359e640 1 --2- 172.21.15.77:0/956644899 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff6dc0dbce0 0x7ff6dc0d4850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400b410 tx=0x7ff6d400b8d0 comp rx=0 tx=0).stop 2024-04-25T01:39:39.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.952+0000 7ff6e2d9d640 1 -- 172.21.15.77:0/956644899 reap_dead start 2024-04-25T01:39:39.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.952+0000 7ff6e359e640 1 -- 172.21.15.77:0/956644899 shutdown_connections 2024-04-25T01:39:39.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.952+0000 7ff6e359e640 1 -- 172.21.15.77:0/956644899 >> 172.21.15.77:0/956644899 conn(0x7ff6dc048250 msgr2=0x7ff6dc02be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:39.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.952+0000 7fd63ca15640 1 -- 172.21.15.77:0/632725884 shutdown_connections 2024-04-25T01:39:39.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.952+0000 7fd63ca15640 1 -- 172.21.15.77:0/632725884 wait complete. 2024-04-25T01:39:39.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.953+0000 7f6328130640 1 -- 172.21.15.77:0/1181263078 shutdown_connections 2024-04-25T01:39:39.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.953+0000 7f6328130640 1 -- 172.21.15.77:0/1181263078 wait complete. 2024-04-25T01:39:39.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.953+0000 7ff6e359e640 1 -- 172.21.15.77:0/956644899 shutdown_connections 2024-04-25T01:39:39.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:39.953+0000 7ff6e359e640 1 -- 172.21.15.77:0/956644899 wait complete. 2024-04-25T01:39:39.992 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2024-04-25T01:39:39.992 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T01:39:39.993 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2024-04-25T01:39:39.993 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T01:39:39.994 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2024-04-25T01:39:39.994 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T01:39:39.995 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2024-04-25T01:39:39.995 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T01:39:39.996 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2024-04-25T01:39:39.996 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T01:39:39.997 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2024-04-25T01:39:39.997 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T01:39:39.998 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2024-04-25T01:39:39.998 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T01:39:39.999 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2024-04-25T01:39:40.000 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T01:39:40.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.215+0000 7fc467dee640 1 Processor -- start 2024-04-25T01:39:40.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.215+0000 7fc467dee640 1 -- start start 2024-04-25T01:39:40.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.215+0000 7f89dad40640 1 Processor -- start 2024-04-25T01:39:40.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.216+0000 7f89dad40640 1 -- start start 2024-04-25T01:39:40.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.216+0000 7f0a9c672640 1 Processor -- start 2024-04-25T01:39:40.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.216+0000 7f0a9c672640 1 -- start start 2024-04-25T01:39:40.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.216+0000 7fc467dee640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc458048360 0x7fc4580d81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.216+0000 7fc467dee640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc45800d7d0 0x7fc458048740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.216+0000 7fc467dee640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc458009b70 con 0x7fc45804bb00 2024-04-25T01:39:40.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.216+0000 7fc467dee640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fc45800dc30 con 0x7fc45800d7d0 2024-04-25T01:39:40.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.216+0000 7fc467dee640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc45800c730 con 0x7fc458048360 2024-04-25T01:39:40.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.217+0000 7f0f539e7640 1 Processor -- start 2024-04-25T01:39:40.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.217+0000 7fc465b8a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc458048360 0x7fc4580d81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.217+0000 7fc465b8a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc458048360 0x7fc4580d81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.77:52212/0 (socket says 172.21.15.77:52212) 2024-04-25T01:39:40.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.217+0000 7fc465b8a640 1 -- 172.21.15.77:0/3793558218 learned_addr learned my addr 172.21.15.77:0/3793558218 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:40.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.217+0000 7fc465389640 1 --2- 172.21.15.77:0/3793558218 >> v2:172.21.15.121:3300/0 conn(0x7fc45800d7d0 0x7fc458048740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.217+0000 7f89dad40640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f89cc0dbce0 0x7f89cc0474a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.217+0000 7f89dad40640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89cc0df180 0x7f89cc006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.217+0000 7f7b70f10640 1 Processor -- start 2024-04-25T01:39:40.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.217+0000 7f0f539e7640 1 -- start start 2024-04-25T01:39:40.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.217+0000 7f89dad40640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89cc00bb50 con 0x7f89cc0073e0 2024-04-25T01:39:40.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.217+0000 7f89dad40640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f89cc00a420 con 0x7f89cc0dbce0 2024-04-25T01:39:40.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.217+0000 7f89dad40640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f89cc048060 con 0x7f89cc0df180 2024-04-25T01:39:40.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.217+0000 7f9d2759e640 1 Processor -- start 2024-04-25T01:39:40.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.217+0000 7f89d953d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89cc0df180 0x7f89cc006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.217+0000 7f89d953d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89cc0df180 0x7f89cc006ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.77:52222/0 (socket says 172.21.15.77:52222) 2024-04-25T01:39:40.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.217+0000 7f89d953d640 1 -- 172.21.15.77:0/2204343053 learned_addr learned my addr 172.21.15.77:0/2204343053 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:40.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.217+0000 7f89d9d3e640 1 --2- 172.21.15.77:0/2204343053 >> v2:172.21.15.77:3300/0 conn(0x7f89cc0dbce0 0x7f89cc0474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.218+0000 7f89d953d640 1 -- 172.21.15.77:0/2204343053 >> v2:172.21.15.77:3300/0 conn(0x7f89cc0dbce0 msgr2=0x7f89cc0474a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:40.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.218+0000 7f0a9c672640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0a94151310 0x7f0a940c5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.217+0000 7fc465b8a640 1 -- 172.21.15.77:0/3793558218 >> v2:172.21.15.121:3300/0 conn(0x7fc45800d7d0 msgr2=0x7fc458048740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:40.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.217+0000 7fc465b8a640 1 --2- 172.21.15.77:0/3793558218 >> v2:172.21.15.121:3300/0 conn(0x7fc45800d7d0 0x7fc458048740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.217+0000 7fc465b8a640 1 -- 172.21.15.77:0/3793558218 >> v1:172.21.15.121:6789/0 conn(0x7fc45804bb00 legacy=0x7fc4580db7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.217+0000 7fc465b8a640 1 -- 172.21.15.77:0/3793558218 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc45800ca10 con 0x7fc458048360 2024-04-25T01:39:40.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.218+0000 7f0a9c672640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a941516f0 con 0x7f0a94157250 2024-04-25T01:39:40.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.218+0000 7f0f539e7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f440474a0 0x7f0f44006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.218+0000 7f0f539e7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0f440073e0 0x7f0f4400a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.218+0000 7f0f539e7640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f4400bb50 con 0x7f0f440dbce0 2024-04-25T01:39:40.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.218+0000 7f0f539e7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f0f4400a420 con 0x7f0f440073e0 2024-04-25T01:39:40.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.218+0000 7f0f539e7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f0f44048060 con 0x7f0f440474a0 2024-04-25T01:39:40.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.218+0000 7fc465b8a640 1 --2- 172.21.15.77:0/3793558218 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc458048360 0x7fc4580d81c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc4600743e0 tx=0x7fc4600a69c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af400ab0edfe6b1e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:40.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.218+0000 7f0a9ac0f640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0a94157250 0x7f0a9406f200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41456/0 (socket says 172.21.15.77:41456) 2024-04-25T01:39:40.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.218+0000 7f0a9ac0f640 1 -- 172.21.15.77:0/4265252077 learned_addr learned my addr 172.21.15.77:0/4265252077 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:40.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.217+0000 7f7b70f10640 1 -- start start 2024-04-25T01:39:40.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.218+0000 7f7b70f10640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7b6c0c5770 0x7f7b6c06dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.218+0000 7f7b70f10640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b6c0c24c0 con 0x7f7b6c0c3cf0 2024-04-25T01:39:40.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.218+0000 7f7b70f10640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b6c15ace0 con 0x7f7b6c1578b0 2024-04-25T01:39:40.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.218+0000 7f7b70f10640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f7b6c0c5bd0 con 0x7f7b6c0c5770 2024-04-25T01:39:40.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.218+0000 7f0a9c672640 1 -- 172.21.15.77:0/4265252077 --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a940c56c0 con 0x7f0a940732a0 2024-04-25T01:39:40.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.218+0000 7f0f51f84640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0f440073e0 0x7f0f4400a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7f0a9c672640 1 -- 172.21.15.77:0/4265252077 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f0a940c5c80 con 0x7f0a94151310 2024-04-25T01:39:40.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7f0f51783640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f0f440dbce0 0x7f0f440df180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.77:44782/0 (socket says 172.21.15.77:44782) 2024-04-25T01:39:40.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7f0f51783640 1 -- 172.21.15.77:0/1440404953 learned_addr learned my addr 172.21.15.77:0/1440404953 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:40.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7fc464b88640 1 -- 172.21.15.77:0/3793558218 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4600af070 con 0x7fc458048360 2024-04-25T01:39:40.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7f0a9a40e640 1 --2- 172.21.15.77:0/4265252077 >> v2:172.21.15.77:3300/0 conn(0x7f0a94151310 0x7f0a940c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7f0f50f82640 1 --2- 172.21.15.77:0/1440404953 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f440474a0 0x7f0f44006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7f7b6a59c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f7b6c1578b0 0x7f7b6c06d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.77:44796/0 (socket says 172.21.15.77:44796) 2024-04-25T01:39:40.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7f7b6a59c640 1 -- 172.21.15.77:0/1548733269 learned_addr learned my addr 172.21.15.77:0/1548733269 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:40.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7fc464b88640 1 -- 172.21.15.77:0/3793558218 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4600ab6d0 con 0x7fc458048360 2024-04-25T01:39:40.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7fc464b88640 1 -- 172.21.15.77:0/3793558218 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4600abb60 con 0x7fc458048360 2024-04-25T01:39:40.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7f89d953d640 1 --2- 172.21.15.77:0/2204343053 >> v2:172.21.15.77:3300/0 conn(0x7f89cc0dbce0 0x7f89cc0474a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7f89d953d640 1 -- 172.21.15.77:0/2204343053 >> v1:172.21.15.77:6789/0 conn(0x7f89cc0073e0 legacy=0x7f89cc00a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7f89d953d640 1 -- 172.21.15.77:0/2204343053 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89cc00a0f0 con 0x7f89cc0df180 2024-04-25T01:39:40.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7f0f43fff640 1 -- 172.21.15.77:0/1440404953 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3211348652 0 0) 0x7f0f4400bb50 con 0x7f0f440dbce0 2024-04-25T01:39:40.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7f0f43fff640 1 -- 172.21.15.77:0/1440404953 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f38003520 con 0x7f0f440dbce0 2024-04-25T01:39:40.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.218+0000 7f9d2759e640 1 -- start start 2024-04-25T01:39:40.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7f0f50f82640 1 -- 172.21.15.77:0/1440404953 >> v2:172.21.15.77:3300/0 conn(0x7f0f440073e0 msgr2=0x7f0f4400a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:40.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7f0f51f84640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0f440073e0 0x7f0f4400a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46808/0 (socket says 172.21.15.77:46808) 2024-04-25T01:39:40.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7f0f50f82640 1 --2- 172.21.15.77:0/1440404953 >> v2:172.21.15.77:3300/0 conn(0x7f0f440073e0 0x7f0f4400a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7f0f50f82640 1 -- 172.21.15.77:0/1440404953 >> v1:172.21.15.121:6789/0 conn(0x7f0f440dbce0 legacy=0x7f0f440df180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7f0f50f82640 1 -- 172.21.15.77:0/1440404953 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4400a0f0 con 0x7f0f440474a0 2024-04-25T01:39:40.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7f0a9940c640 1 -- 172.21.15.77:0/4265252077 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 620608626 0 0) 0x7f0a940c56c0 con 0x7f0a940732a0 2024-04-25T01:39:40.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7fd977fff640 1 Processor -- start 2024-04-25T01:39:40.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7f0a9940c640 1 -- 172.21.15.77:0/4265252077 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a80003520 con 0x7f0a940732a0 2024-04-25T01:39:40.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7f9d2759e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9d28153470 0x7f9d280c6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7f9d2759e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9d280c9aa0 0x7f9d2806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7f9d2759e640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d28156090 con 0x7f9d280bed90 2024-04-25T01:39:40.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7f9d2759e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9d2806cb30 con 0x7f9d280c9aa0 2024-04-25T01:39:40.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7f9d2759e640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f9d28156370 con 0x7f9d28153470 2024-04-25T01:39:40.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7f89d9d3e640 1 --2- 172.21.15.77:0/2204343053 >> v2:172.21.15.77:3300/0 conn(0x7f89cc0dbce0 0x7f89cc0474a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:40.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.220+0000 7f9d2659c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9d28153470 0x7f9d280c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.220+0000 7f9d2659c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9d28153470 0x7f9d280c6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:52250/0 (socket says 172.21.15.77:52250) 2024-04-25T01:39:40.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.220+0000 7f9d2659c640 1 -- 172.21.15.77:0/1491533149 learned_addr learned my addr 172.21.15.77:0/1491533149 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:40.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7f0a9a40e640 1 -- 172.21.15.77:0/4265252077 >> v1:172.21.15.121:6789/0 conn(0x7f0a940732a0 legacy=0x7f0a94070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.220+0000 7f0f51f84640 1 --2- 172.21.15.77:0/1440404953 >> v2:172.21.15.77:3300/0 conn(0x7f0f440073e0 0x7f0f4400a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:40.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7f0a9a40e640 1 -- 172.21.15.77:0/4265252077 >> v1:172.21.15.77:6789/0 conn(0x7f0a94157250 legacy=0x7f0a9406f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7f0a9a40e640 1 -- 172.21.15.77:0/4265252077 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a940c59a0 con 0x7f0a94151310 2024-04-25T01:39:40.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.220+0000 7f89d953d640 1 --2- 172.21.15.77:0/2204343053 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89cc0df180 0x7f89cc006ea0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f89d4068ab0 tx=0x7f89d40a6920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be62aad705f437a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:40.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.220+0000 7f7b69d9b640 1 --2- 172.21.15.77:0/1548733269 >> v2:172.21.15.77:3300/0 conn(0x7f7b6c0c5770 0x7f7b6c06dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.220+0000 7f9d26d9d640 1 --2- 172.21.15.77:0/1491533149 >> v2:172.21.15.77:3300/0 conn(0x7f9d280c9aa0 0x7f9d2806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.220+0000 7fc467dee640 1 -- 172.21.15.77:0/3793558218 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc458048360 msgr2=0x7fc4580d81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.220+0000 7fc467dee640 1 --2- 172.21.15.77:0/3793558218 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc458048360 0x7fc4580d81c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc4600743e0 tx=0x7fc4600a69c0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.220+0000 7f89d8d3c640 1 -- 172.21.15.77:0/2204343053 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d40b0020 con 0x7f89cc0df180 2024-04-25T01:39:40.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.220+0000 7f89d8d3c640 1 -- 172.21.15.77:0/2204343053 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d40ac8e0 con 0x7f89cc0df180 2024-04-25T01:39:40.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.220+0000 7f89d8d3c640 1 -- 172.21.15.77:0/2204343053 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d40acd70 con 0x7f89cc0df180 2024-04-25T01:39:40.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.219+0000 7fd977fff640 1 -- start start 2024-04-25T01:39:40.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.220+0000 7fbad8288640 1 Processor -- start 2024-04-25T01:39:40.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.220+0000 7fbad8288640 1 -- start start 2024-04-25T01:39:40.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.220+0000 7f7b6959a640 1 -- 172.21.15.77:0/1548733269 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2919439146 0 0) 0x7f7b6c15ace0 con 0x7f7b6c1578b0 2024-04-25T01:39:40.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.220+0000 7f7b6959a640 1 -- 172.21.15.77:0/1548733269 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b54003520 con 0x7f7b6c1578b0 2024-04-25T01:39:40.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.220+0000 7f9d2659c640 1 -- 172.21.15.77:0/1491533149 >> v2:172.21.15.77:3300/0 conn(0x7f9d280c9aa0 msgr2=0x7f9d2806c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:40.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.220+0000 7f7b69d9b640 1 -- 172.21.15.77:0/1548733269 >> v1:172.21.15.121:6789/0 conn(0x7f7b6c1578b0 legacy=0x7f7b6c06d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.220+0000 7f7b69d9b640 1 -- 172.21.15.77:0/1548733269 >> v1:172.21.15.77:6789/0 conn(0x7f7b6c0c3cf0 legacy=0x7f7b6c0c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.220+0000 7f7b69d9b640 1 -- 172.21.15.77:0/1548733269 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b6c15afc0 con 0x7f7b6c0c5770 2024-04-25T01:39:40.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.220+0000 7fc467dee640 1 -- 172.21.15.77:0/3793558218 shutdown_connections 2024-04-25T01:39:40.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.220+0000 7fc467dee640 1 --2- 172.21.15.77:0/3793558218 >> v2:172.21.15.121:3300/0 conn(0x7fc45800d7d0 0x7fc458048740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.220+0000 7fc467dee640 1 --2- 172.21.15.77:0/3793558218 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc458048360 0x7fc4580d81c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.220+0000 7f9d2659c640 1 --2- 172.21.15.77:0/1491533149 >> v2:172.21.15.77:3300/0 conn(0x7f9d280c9aa0 0x7f9d2806c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.220+0000 7f9d2659c640 1 -- 172.21.15.77:0/1491533149 >> v1:172.21.15.121:6789/0 conn(0x7f9d280bed90 legacy=0x7f9d2806bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:40.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.220+0000 7fc467dee640 1 -- 172.21.15.77:0/3793558218 >> 172.21.15.77:0/3793558218 conn(0x7fc45804d9e0 msgr2=0x7fc45804ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:40.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.220+0000 7f9d2659c640 1 -- 172.21.15.77:0/1491533149 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d28156650 con 0x7f9d28153470 2024-04-25T01:39:40.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.220+0000 7f0f50f82640 1 --2- 172.21.15.77:0/1440404953 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f440474a0 0x7f0f44006ea0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0097a0 tx=0x7f0f3c02a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adb24d8ef33d57b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:40.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7f0a9a40e640 1 --2- 172.21.15.77:0/4265252077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a94151310 0x7f0a940c5050 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0a900097a0 tx=0x7f0a9002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3fe55130d110c7e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:40.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7f0a9940c640 1 -- 172.21.15.77:0/4265252077 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a90037070 con 0x7f0a94151310 2024-04-25T01:39:40.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7f0a9940c640 1 -- 172.21.15.77:0/4265252077 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a90032440 con 0x7f0a94151310 2024-04-25T01:39:40.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7f0a9940c640 1 -- 172.21.15.77:0/4265252077 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a900327f0 con 0x7f0a94151310 2024-04-25T01:39:40.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7f89dad40640 1 -- 172.21.15.77:0/2204343053 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89cc0df180 msgr2=0x7f89cc006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7f89dad40640 1 --2- 172.21.15.77:0/2204343053 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89cc0df180 0x7f89cc006ea0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f89d4068ab0 tx=0x7f89d40a6920 comp rx=0 tx=0).stop 2024-04-25T01:39:40.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7f89dad40640 1 -- 172.21.15.77:0/2204343053 shutdown_connections 2024-04-25T01:39:40.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7f89dad40640 1 --2- 172.21.15.77:0/2204343053 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89cc0df180 0x7f89cc006ea0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7f89dad40640 1 --2- 172.21.15.77:0/2204343053 >> v2:172.21.15.77:3300/0 conn(0x7f89cc0dbce0 0x7f89cc0474a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7f89dad40640 1 -- 172.21.15.77:0/2204343053 >> 172.21.15.77:0/2204343053 conn(0x7f89cc048250 msgr2=0x7f89cc048660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:40.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7fbad8288640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbac803f280 0x7fbac80dea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7fbad8288640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbac8047230 0x7fbac80e9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7fbad8288640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbac8046ff0 con 0x7fbac804ba70 2024-04-25T01:39:40.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7fbad8288640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fbac80df6d0 con 0x7fbac803f280 2024-04-25T01:39:40.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7fbad8288640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fbac8046d10 con 0x7fbac8047230 2024-04-25T01:39:40.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7fbad5823640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fbac804ba70 0x7fbac80defc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.77:44820/0 (socket says 172.21.15.77:44820) 2024-04-25T01:39:40.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7fbad5823640 1 -- 172.21.15.77:0/519931979 learned_addr learned my addr 172.21.15.77:0/519931979 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:40.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7fbad6825640 1 --2- 172.21.15.77:0/519931979 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbac8047230 0x7fbac80e9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7fbad6024640 1 --2- 172.21.15.77:0/519931979 >> v2:172.21.15.121:3300/0 conn(0x7fbac803f280 0x7fbac80dea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7f7b69d9b640 1 --2- 172.21.15.77:0/1548733269 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b6c0c5770 0x7f7b6c06dc30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7b600097a0 tx=0x7f7b6002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f984954af8bc5ac2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:40.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7f0f43fff640 1 -- 172.21.15.77:0/1440404953 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c037070 con 0x7f0f440474a0 2024-04-25T01:39:40.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7f0f43fff640 1 -- 172.21.15.77:0/1440404953 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f3c032440 con 0x7f0f440474a0 2024-04-25T01:39:40.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7fd977fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd97806cd50 0x7fd978159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7fd977fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd9780caa50 0x7fd97806d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7fd977fff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd978156860 con 0x7fd978157150 2024-04-25T01:39:40.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7fd977fff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd978159940 con 0x7fd97806cd50 2024-04-25T01:39:40.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7fd977fff640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd978156b40 con 0x7fd9780caa50 2024-04-25T01:39:40.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7fd976ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd97806cd50 0x7fd978159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7fd976ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd97806cd50 0x7fd978159dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46826/0 (socket says 172.21.15.77:46826) 2024-04-25T01:39:40.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7fd976ffd640 1 -- 172.21.15.77:0/1491752533 learned_addr learned my addr 172.21.15.77:0/1491752533 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:40.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7fd9767fc640 1 --2- 172.21.15.77:0/1491752533 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd9780caa50 0x7fd97806d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7fd976ffd640 1 -- 172.21.15.77:0/1491752533 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd9780caa50 msgr2=0x7fd97806d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:40.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7fd976ffd640 1 --2- 172.21.15.77:0/1491752533 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd9780caa50 0x7fd97806d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.221+0000 7fd975ffb640 1 -- 172.21.15.77:0/1491752533 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4222741432 0 0) 0x7fd978156860 con 0x7fd978157150 2024-04-25T01:39:40.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7fd976ffd640 1 -- 172.21.15.77:0/1491752533 >> v1:172.21.15.77:6789/0 conn(0x7fd978157150 legacy=0x7fd9780c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7fd976ffd640 1 -- 172.21.15.77:0/1491752533 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9781592f0 con 0x7fd97806cd50 2024-04-25T01:39:40.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7f89dad40640 1 -- 172.21.15.77:0/2204343053 shutdown_connections 2024-04-25T01:39:40.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7fbad5022640 1 -- 172.21.15.77:0/519931979 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2005070163 0 0) 0x7fbac8046ff0 con 0x7fbac804ba70 2024-04-25T01:39:40.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7f0f43fff640 1 -- 172.21.15.77:0/1440404953 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c02ae60 con 0x7f0f440474a0 2024-04-25T01:39:40.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7fbad5022640 1 -- 172.21.15.77:0/519931979 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbabc003520 con 0x7fbac804ba70 2024-04-25T01:39:40.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7f9d2659c640 1 --2- 172.21.15.77:0/1491533149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d28153470 0x7f9d280c6010 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9d2806d260 tx=0x7f9d1802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83cbccde62c124e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:40.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7f7b6959a640 1 -- 172.21.15.77:0/1548733269 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b60037070 con 0x7f7b6c0c5770 2024-04-25T01:39:40.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7f7b6959a640 1 -- 172.21.15.77:0/1548733269 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b60032440 con 0x7f7b6c0c5770 2024-04-25T01:39:40.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7f7b6959a640 1 -- 172.21.15.77:0/1548733269 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b60032810 con 0x7f7b6c0c5770 2024-04-25T01:39:40.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7f9d2559a640 1 -- 172.21.15.77:0/1491533149 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d18037070 con 0x7f9d28153470 2024-04-25T01:39:40.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7f0f539e7640 1 -- 172.21.15.77:0/1440404953 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f440474a0 msgr2=0x7f0f44006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7fbad6024640 1 -- 172.21.15.77:0/519931979 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbac8047230 msgr2=0x7fbac80e9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:40.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7fbad6024640 1 --2- 172.21.15.77:0/519931979 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbac8047230 0x7fbac80e9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7fbad6024640 1 -- 172.21.15.77:0/519931979 >> v1:172.21.15.121:6789/0 conn(0x7fbac804ba70 legacy=0x7fbac80defc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7fbad6024640 1 -- 172.21.15.77:0/519931979 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac804b010 con 0x7fbac803f280 2024-04-25T01:39:40.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7f0f539e7640 1 --2- 172.21.15.77:0/1440404953 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f440474a0 0x7f0f44006ea0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0097a0 tx=0x7f0f3c02a110 comp rx=0 tx=0).stop 2024-04-25T01:39:40.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7f0f539e7640 1 -- 172.21.15.77:0/1440404953 shutdown_connections 2024-04-25T01:39:40.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7f0f539e7640 1 --2- 172.21.15.77:0/1440404953 >> v2:172.21.15.77:3300/0 conn(0x7f0f440073e0 0x7f0f4400a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7f0f539e7640 1 --2- 172.21.15.77:0/1440404953 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f440474a0 0x7f0f44006ea0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7f0f539e7640 1 -- 172.21.15.77:0/1440404953 >> 172.21.15.77:0/1440404953 conn(0x7f0f44048250 msgr2=0x7f0f44048660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:40.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7f9d2559a640 1 -- 172.21.15.77:0/1491533149 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d1802ae20 con 0x7f9d28153470 2024-04-25T01:39:40.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7f9d2559a640 1 -- 172.21.15.77:0/1491533149 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d18032660 con 0x7f9d28153470 2024-04-25T01:39:40.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7f0f539e7640 1 -- 172.21.15.77:0/1440404953 shutdown_connections 2024-04-25T01:39:40.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7f0f539e7640 1 -- 172.21.15.77:0/1440404953 wait complete. 2024-04-25T01:39:40.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7f0a9c672640 1 -- 172.21.15.77:0/4265252077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a94151310 msgr2=0x7f0a940c5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7f0a9c672640 1 --2- 172.21.15.77:0/4265252077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a94151310 0x7f0a940c5050 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0a900097a0 tx=0x7f0a9002a1c0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7f0a9c672640 1 -- 172.21.15.77:0/4265252077 shutdown_connections 2024-04-25T01:39:40.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.223+0000 7f0a9c672640 1 --2- 172.21.15.77:0/4265252077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a94151310 0x7f0a940c5050 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.223+0000 7f0a9c672640 1 -- 172.21.15.77:0/4265252077 >> 172.21.15.77:0/4265252077 conn(0x7f0a94066ea0 msgr2=0x7f0a940672b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:40.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7f89dad40640 1 -- 172.21.15.77:0/2204343053 wait complete. 2024-04-25T01:39:40.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.222+0000 7fc467dee640 1 -- 172.21.15.77:0/3793558218 shutdown_connections 2024-04-25T01:39:40.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.223+0000 7fc467dee640 1 -- 172.21.15.77:0/3793558218 wait complete. 2024-04-25T01:39:40.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.223+0000 7f7b70f10640 1 -- 172.21.15.77:0/1548733269 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b6c0c5770 msgr2=0x7f7b6c06dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.223+0000 7f7b70f10640 1 --2- 172.21.15.77:0/1548733269 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b6c0c5770 0x7f7b6c06dc30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7b600097a0 tx=0x7f7b6002a230 comp rx=0 tx=0).stop 2024-04-25T01:39:40.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.223+0000 7fd976ffd640 1 --2- 172.21.15.77:0/1491752533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd97806cd50 0x7fd978159dd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd96c009870 tx=0x7fd96c02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34572139b73101c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:40.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.223+0000 7fbad6024640 1 --2- 172.21.15.77:0/519931979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbac803f280 0x7fbac80dea80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0097a0 tx=0x7fbacc02a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf1e17cbc4e3a9e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:40.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.223+0000 7f9d2759e640 1 -- 172.21.15.77:0/1491533149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d28153470 msgr2=0x7f9d280c6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.223+0000 7f9d2759e640 1 --2- 172.21.15.77:0/1491533149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d28153470 0x7f9d280c6010 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9d2806d260 tx=0x7f9d1802a110 comp rx=0 tx=0).stop 2024-04-25T01:39:40.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.223+0000 7fd975ffb640 1 -- 172.21.15.77:0/1491752533 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96c037070 con 0x7fd97806cd50 2024-04-25T01:39:40.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.223+0000 7fd975ffb640 1 -- 172.21.15.77:0/1491752533 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd96c032440 con 0x7fd97806cd50 2024-04-25T01:39:40.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.223+0000 7fd975ffb640 1 -- 172.21.15.77:0/1491752533 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96c032810 con 0x7fd97806cd50 2024-04-25T01:39:40.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.223+0000 7fbad5022640 1 -- 172.21.15.77:0/519931979 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbacc037070 con 0x7fbac803f280 2024-04-25T01:39:40.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.223+0000 7f9d2759e640 1 -- 172.21.15.77:0/1491533149 shutdown_connections 2024-04-25T01:39:40.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.223+0000 7f9d2759e640 1 --2- 172.21.15.77:0/1491533149 >> v2:172.21.15.77:3300/0 conn(0x7f9d280c9aa0 0x7f9d2806c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.223+0000 7f9d2759e640 1 --2- 172.21.15.77:0/1491533149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d28153470 0x7f9d280c6010 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.223+0000 7f9d2759e640 1 -- 172.21.15.77:0/1491533149 >> 172.21.15.77:0/1491533149 conn(0x7f9d280ad1e0 msgr2=0x7f9d280ad5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:40.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.223+0000 7fbad5022640 1 -- 172.21.15.77:0/519931979 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbacc02ad90 con 0x7fbac803f280 2024-04-25T01:39:40.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.223+0000 7fbad5022640 1 -- 172.21.15.77:0/519931979 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbacc032660 con 0x7fbac803f280 2024-04-25T01:39:40.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.223+0000 7f9d2759e640 1 -- 172.21.15.77:0/1491533149 shutdown_connections 2024-04-25T01:39:40.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.224+0000 7f89dad40640 1 Processor -- start 2024-04-25T01:39:40.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.223+0000 7f0a9c672640 1 -- 172.21.15.77:0/4265252077 shutdown_connections 2024-04-25T01:39:40.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.224+0000 7f0f539e7640 1 Processor -- start 2024-04-25T01:39:40.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.224+0000 7f0f539e7640 1 -- start start 2024-04-25T01:39:40.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.224+0000 7f0a9c672640 1 -- 172.21.15.77:0/4265252077 wait complete. 2024-04-25T01:39:40.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.224+0000 7fd977fff640 1 -- 172.21.15.77:0/1491752533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd97806cd50 msgr2=0x7fd978159dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.224+0000 7fd977fff640 1 --2- 172.21.15.77:0/1491752533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd97806cd50 0x7fd978159dd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd96c009870 tx=0x7fd96c02a130 comp rx=0 tx=0).stop 2024-04-25T01:39:40.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.224+0000 7fbad8288640 1 -- 172.21.15.77:0/519931979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbac803f280 msgr2=0x7fbac80dea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.224+0000 7fbad8288640 1 --2- 172.21.15.77:0/519931979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbac803f280 0x7fbac80dea80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0097a0 tx=0x7fbacc02a040 comp rx=0 tx=0).stop 2024-04-25T01:39:40.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.224+0000 7fd977fff640 1 -- 172.21.15.77:0/1491752533 shutdown_connections 2024-04-25T01:39:40.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.224+0000 7fd977fff640 1 --2- 172.21.15.77:0/1491752533 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd9780caa50 0x7fd97806d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.224+0000 7fd977fff640 1 --2- 172.21.15.77:0/1491752533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd97806cd50 0x7fd978159dd0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.224+0000 7fd977fff640 1 -- 172.21.15.77:0/1491752533 >> 172.21.15.77:0/1491752533 conn(0x7fd9780ad220 msgr2=0x7fd9780ad600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:40.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.224+0000 7fd977fff640 1 -- 172.21.15.77:0/1491752533 shutdown_connections 2024-04-25T01:39:40.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.224+0000 7fbad8288640 1 -- 172.21.15.77:0/519931979 shutdown_connections 2024-04-25T01:39:40.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.224+0000 7fbad8288640 1 --2- 172.21.15.77:0/519931979 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbac8047230 0x7fbac80e9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.224+0000 7fd977fff640 1 -- 172.21.15.77:0/1491752533 wait complete. 2024-04-25T01:39:40.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.224+0000 7fbad8288640 1 --2- 172.21.15.77:0/519931979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbac803f280 0x7fbac80dea80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.224+0000 7fbad8288640 1 -- 172.21.15.77:0/519931979 >> 172.21.15.77:0/519931979 conn(0x7fbac8048ac0 msgr2=0x7fbac8048ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:40.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.224+0000 7f9d2759e640 1 -- 172.21.15.77:0/1491533149 wait complete. 2024-04-25T01:39:40.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.224+0000 7f89dad40640 1 -- start start 2024-04-25T01:39:40.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.225+0000 7f0f539e7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f440073e0 0x7f0f440d9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.225+0000 7f89dad40640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89cc0073e0 0x7f89cc035a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.225+0000 7f0f539e7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f440474a0 0x7f0f440430b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.225+0000 7f0f539e7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f440dbce0 0x7f0f440d7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.225+0000 7f0f539e7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0f440dc0c0 con 0x7f0f440474a0 2024-04-25T01:39:40.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.225+0000 7f0f539e7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0f44047d80 con 0x7f0f440dbce0 2024-04-25T01:39:40.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.225+0000 7f0f539e7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f0f440dfbf0 con 0x7f0f440073e0 2024-04-25T01:39:40.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.225+0000 7f89dad40640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89cc0dbce0 0x7f89cc02c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.225+0000 7fc467dee640 1 Processor -- start 2024-04-25T01:39:40.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.225+0000 7f89dad40640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89cc0df180 0x7f89cc177ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.225+0000 7fbad8288640 1 -- 172.21.15.77:0/519931979 shutdown_connections 2024-04-25T01:39:40.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.225+0000 7f0f50f82640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f440474a0 0x7f0f440430b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.225+0000 7f89dad40640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f89cc0dc0c0 con 0x7f89cc0df180 2024-04-25T01:39:40.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.225+0000 7f89dad40640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f89cc047d80 con 0x7f89cc0dbce0 2024-04-25T01:39:40.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.225+0000 7f89dad40640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f89cc0df5c0 con 0x7f89cc0073e0 2024-04-25T01:39:40.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.225+0000 7f0f50f82640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f440474a0 0x7f0f440430b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46838/0 (socket says 172.21.15.77:46838) 2024-04-25T01:39:40.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.225+0000 7f0f50f82640 1 -- 172.21.15.77:0/577258338 learned_addr learned my addr 172.21.15.77:0/577258338 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:40.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.225+0000 7fc467dee640 1 -- start start 2024-04-25T01:39:40.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.225+0000 7f0f51f84640 1 --2- 172.21.15.77:0/577258338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f440dbce0 0x7f0f440d7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.225+0000 7f89d953d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89cc0dbce0 0x7f89cc02c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.225+0000 7f89d953d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89cc0dbce0 0x7f89cc02c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:52278/0 (socket says 172.21.15.77:52278) 2024-04-25T01:39:40.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.225+0000 7f89d953d640 1 -- 172.21.15.77:0/503359408 learned_addr learned my addr 172.21.15.77:0/503359408 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:40.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.225+0000 7f89d9d3e640 1 --2- 172.21.15.77:0/503359408 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89cc0073e0 0x7f89cc035a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.225+0000 7f89da53f640 1 --2- 172.21.15.77:0/503359408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89cc0df180 0x7f89cc177ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.225+0000 7f0f51783640 1 --2- 172.21.15.77:0/577258338 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f440073e0 0x7f0f440d9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.225+0000 7fbad8288640 1 -- 172.21.15.77:0/519931979 wait complete. 2024-04-25T01:39:40.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.226+0000 7f0a9c672640 1 Processor -- start 2024-04-25T01:39:40.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.226+0000 7f0f51f84640 1 -- 172.21.15.77:0/577258338 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f440073e0 msgr2=0x7f0f440d9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.226+0000 7f0f51f84640 1 --2- 172.21.15.77:0/577258338 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f440073e0 0x7f0f440d9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.226+0000 7f0f51f84640 1 -- 172.21.15.77:0/577258338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f440474a0 msgr2=0x7f0f440430b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.226+0000 7f0f51f84640 1 --2- 172.21.15.77:0/577258338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f440474a0 0x7f0f440430b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.226+0000 7f0f51f84640 1 -- 172.21.15.77:0/577258338 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f44175160 con 0x7f0f440dbce0 2024-04-25T01:39:40.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.226+0000 7f0a9c672640 1 -- start start 2024-04-25T01:39:40.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.225+0000 7f7b70f10640 1 -- 172.21.15.77:0/1548733269 shutdown_connections 2024-04-25T01:39:40.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.225+0000 7f7b70f10640 1 --2- 172.21.15.77:0/1548733269 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b6c0c5770 0x7f7b6c06dc30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.225+0000 7f7b70f10640 1 -- 172.21.15.77:0/1548733269 >> 172.21.15.77:0/1548733269 conn(0x7f7b6c06b110 msgr2=0x7f7b6c06b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:40.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.226+0000 7f89d953d640 1 -- 172.21.15.77:0/503359408 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89cc0073e0 msgr2=0x7f89cc035a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.226+0000 7f89d953d640 1 --2- 172.21.15.77:0/503359408 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89cc0073e0 0x7f89cc035a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.226+0000 7f0f51f84640 1 --2- 172.21.15.77:0/577258338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f440dbce0 0x7f0f440d7d40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c064ed0 tx=0x7f0f4c075b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:40.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.226+0000 7f7b70f10640 1 -- 172.21.15.77:0/1548733269 shutdown_connections 2024-04-25T01:39:40.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.226+0000 7f89d953d640 1 -- 172.21.15.77:0/503359408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89cc0df180 msgr2=0x7f89cc177ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.226+0000 7f89d953d640 1 --2- 172.21.15.77:0/503359408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89cc0df180 0x7f89cc177ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.226+0000 7f89d953d640 1 -- 172.21.15.77:0/503359408 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89cc04b180 con 0x7f89cc0dbce0 2024-04-25T01:39:40.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.226+0000 7f89d953d640 1 --2- 172.21.15.77:0/503359408 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89cc0dbce0 0x7f89cc02c590 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f89d404fa20 tx=0x7f89d40693f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:40.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7fc467dee640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc45800d7d0 0x7fc4580cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7fbad8288640 1 Processor -- start 2024-04-25T01:39:40.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7fbad8288640 1 -- start start 2024-04-25T01:39:40.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7f9d2759e640 1 Processor -- start 2024-04-25T01:39:40.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7fc467dee640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc458048360 0x7fc4580dbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7f0a9c672640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0a940732a0 0x7f0a940c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7f0a9c672640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0a94151310 0x7f0a941ea6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7f0a9c672640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a94157250 0x7f0a940ad930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7fc467dee640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc45804bb00 0x7fc4580db2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7f0f41ffb640 1 -- 172.21.15.77:0/577258338 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c068d20 con 0x7f0f440dbce0 2024-04-25T01:39:40.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7f0f539e7640 1 -- 172.21.15.77:0/577258338 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f4403f320 con 0x7f0f440dbce0 2024-04-25T01:39:40.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7f9d2759e640 1 -- start start 2024-04-25T01:39:40.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7f0a9c672640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0a94072730 con 0x7f0a94157250 2024-04-25T01:39:40.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7fd977fff640 1 Processor -- start 2024-04-25T01:39:40.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7f0a9c672640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0a94070070 con 0x7f0a94151310 2024-04-25T01:39:40.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7fc465389640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc458048360 0x7fc4580dbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7fc465389640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc458048360 0x7fc4580dbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:52306/0 (socket says 172.21.15.77:52306) 2024-04-25T01:39:40.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7fc465389640 1 -- 172.21.15.77:0/522753932 learned_addr learned my addr 172.21.15.77:0/522753932 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:40.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7f0a9c672640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f0a9406f910 con 0x7f0a940732a0 2024-04-25T01:39:40.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7fc467dee640 1 -- 172.21.15.77:0/522753932 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc45800d2b0 con 0x7fc45804bb00 2024-04-25T01:39:40.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7fc467dee640 1 -- 172.21.15.77:0/522753932 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc45800cfd0 con 0x7fc458048360 2024-04-25T01:39:40.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7fc467dee640 1 -- 172.21.15.77:0/522753932 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc45800e4d0 con 0x7fc45800d7d0 2024-04-25T01:39:40.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7f0a9ac0f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a94157250 0x7f0a940ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7f0a9ac0f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a94157250 0x7f0a940ad930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46866/0 (socket says 172.21.15.77:46866) 2024-04-25T01:39:40.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7f0a9ac0f640 1 -- 172.21.15.77:0/2577917144 learned_addr learned my addr 172.21.15.77:0/2577917144 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:40.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7f0f41ffb640 1 -- 172.21.15.77:0/577258338 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4c068ec0 con 0x7f0f440dbce0 2024-04-25T01:39:40.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7f0a99c0d640 1 --2- 172.21.15.77:0/2577917144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0a94151310 0x7f0a941ea6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7f0a9a40e640 1 --2- 172.21.15.77:0/2577917144 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0a940732a0 0x7f0a940c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7f0f539e7640 1 -- 172.21.15.77:0/577258338 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f440435f0 con 0x7f0f440dbce0 2024-04-25T01:39:40.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.227+0000 7f0f41ffb640 1 -- 172.21.15.77:0/577258338 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c073bf0 con 0x7f0f440dbce0 2024-04-25T01:39:40.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7f0a9ac0f640 1 -- 172.21.15.77:0/2577917144 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0a940732a0 msgr2=0x7f0a940c72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7fbad8288640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbac803f280 0x7fbac800b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7f0a9ac0f640 1 --2- 172.21.15.77:0/2577917144 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0a940732a0 0x7f0a940c72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7f0a9ac0f640 1 -- 172.21.15.77:0/2577917144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0a94151310 msgr2=0x7f0a941ea6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7f0a9ac0f640 1 --2- 172.21.15.77:0/2577917144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0a94151310 0x7f0a941ea6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7f0a9ac0f640 1 -- 172.21.15.77:0/2577917144 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a94152380 con 0x7f0a94157250 2024-04-25T01:39:40.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7fbad8288640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbac8047230 0x7fbac802d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7fc465389640 1 -- 172.21.15.77:0/522753932 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc45800d7d0 msgr2=0x7fc4580cfd10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T01:39:40.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7fbad8288640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbac804ba70 0x7fbac802d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7fbad8288640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbac80469c0 con 0x7fbac803f280 2024-04-25T01:39:40.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7fbad8288640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbac804b5d0 con 0x7fbac8047230 2024-04-25T01:39:40.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7fbad8288640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fbac803f660 con 0x7fbac804ba70 2024-04-25T01:39:40.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7f0a9ac0f640 1 --2- 172.21.15.77:0/2577917144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a94157250 0x7f0a940ad930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00cad0 tx=0x7f0a8c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:40.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7fc465389640 1 --2- 172.21.15.77:0/522753932 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc45800d7d0 0x7fc4580cfd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7fbad6825640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbac804ba70 0x7fbac802d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7fbad6825640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbac804ba70 0x7fbac802d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.77:52306/0 (socket says 172.21.15.77:52306) 2024-04-25T01:39:40.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7fbad6825640 1 -- 172.21.15.77:0/4199926181 learned_addr learned my addr 172.21.15.77:0/4199926181 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:40.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7fbad5823640 1 --2- 172.21.15.77:0/4199926181 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbac8047230 0x7fbac802d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7f9d2759e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d280bed90 0x7f9d280ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.226+0000 7f7b70f10640 1 -- 172.21.15.77:0/1548733269 wait complete. 2024-04-25T01:39:40.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7f7b70f10640 1 Processor -- start 2024-04-25T01:39:40.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7fc465389640 1 -- 172.21.15.77:0/522753932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc45804bb00 msgr2=0x7fc4580db2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7fc465389640 1 --2- 172.21.15.77:0/522753932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc45804bb00 0x7fc4580db2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7fc465389640 1 -- 172.21.15.77:0/522753932 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc458170370 con 0x7fc458048360 2024-04-25T01:39:40.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7fc465389640 1 --2- 172.21.15.77:0/522753932 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc458048360 0x7fc4580dbe60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc45c00d800 tx=0x7fc45c00dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:40.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7f0a8affd640 1 -- 172.21.15.77:0/2577917144 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c017070 con 0x7f0a94157250 2024-04-25T01:39:40.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7f0a8affd640 1 -- 172.21.15.77:0/2577917144 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a8c00ac30 con 0x7f0a94157250 2024-04-25T01:39:40.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7f0a8affd640 1 -- 172.21.15.77:0/2577917144 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c012620 con 0x7f0a94157250 2024-04-25T01:39:40.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7f89ca7fc640 1 -- 172.21.15.77:0/503359408 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d40b0040 con 0x7f89cc0dbce0 2024-04-25T01:39:40.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7f0a9c672640 1 -- 172.21.15.77:0/2577917144 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a941520a0 con 0x7f0a94157250 2024-04-25T01:39:40.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7f0a9c672640 1 -- 172.21.15.77:0/2577917144 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a941ea1a0 con 0x7f0a94157250 2024-04-25T01:39:40.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.229+0000 7fbad5823640 1 -- 172.21.15.77:0/4199926181 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbac804ba70 msgr2=0x7fbac802d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.229+0000 7fbad5823640 1 --2- 172.21.15.77:0/4199926181 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbac804ba70 0x7fbac802d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.229+0000 7fbad5823640 1 -- 172.21.15.77:0/4199926181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbac803f280 msgr2=0x7fbac800b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.229+0000 7fbad5823640 1 --2- 172.21.15.77:0/4199926181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbac803f280 0x7fbac800b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.229+0000 7fbad5823640 1 -- 172.21.15.77:0/4199926181 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac8174890 con 0x7fbac8047230 2024-04-25T01:39:40.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7f89ca7fc640 1 -- 172.21.15.77:0/503359408 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d40b5430 con 0x7f89cc0dbce0 2024-04-25T01:39:40.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7f89ca7fc640 1 -- 172.21.15.77:0/503359408 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d40b57e0 con 0x7f89cc0dbce0 2024-04-25T01:39:40.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.229+0000 7f89dad40640 1 -- 172.21.15.77:0/503359408 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89cc04b420 con 0x7f89cc0dbce0 2024-04-25T01:39:40.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.229+0000 7f89dad40640 1 -- 172.21.15.77:0/503359408 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89cc0d9d70 con 0x7f89cc0dbce0 2024-04-25T01:39:40.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7f7b70f10640 1 -- start start 2024-04-25T01:39:40.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7fc4567fc640 1 -- 172.21.15.77:0/522753932 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45c00b660 con 0x7fc458048360 2024-04-25T01:39:40.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7fc4567fc640 1 -- 172.21.15.77:0/522753932 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc45c019070 con 0x7fc458048360 2024-04-25T01:39:40.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.228+0000 7fc4567fc640 1 -- 172.21.15.77:0/522753932 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45c00ba20 con 0x7fc458048360 2024-04-25T01:39:40.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.229+0000 7fc467dee640 1 -- 172.21.15.77:0/522753932 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4580daac0 con 0x7fc458048360 2024-04-25T01:39:40.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.229+0000 7fc467dee640 1 -- 172.21.15.77:0/522753932 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4580dc3a0 con 0x7fc458048360 2024-04-25T01:39:40.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.230+0000 7fd977fff640 1 -- start start 2024-04-25T01:39:40.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.230+0000 7f0f539e7640 1 -- 172.21.15.77:0/577258338 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f2c005290 con 0x7f0f440dbce0 2024-04-25T01:39:40.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.230+0000 7f89dad40640 1 -- 172.21.15.77:0/503359408 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89cc005390 con 0x7f89cc0dbce0 2024-04-25T01:39:40.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.230+0000 7f0a8affd640 1 -- 172.21.15.77:0/2577917144 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0a8c01a070 con 0x7f0a94157250 2024-04-25T01:39:40.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.231+0000 7f0a9c672640 1 -- 172.21.15.77:0/2577917144 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a9404f500 con 0x7f0a94157250 2024-04-25T01:39:40.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.230+0000 7fc467dee640 1 -- 172.21.15.77:0/522753932 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4580da8b0 con 0x7fc458048360 2024-04-25T01:39:40.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.231+0000 7f9d2759e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d280c9aa0 0x7f9d280c16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.231+0000 7f9d2759e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d28153470 0x7f9d280c1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.231+0000 7f9d2759e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9d280c9710 con 0x7f9d28153470 2024-04-25T01:39:40.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.231+0000 7f9d2759e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9d280c9590 con 0x7f9d280c9aa0 2024-04-25T01:39:40.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.231+0000 7fd977fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd9780caa50 0x7fd9781f32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.231+0000 7fd977fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd978157150 0x7fd978154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.231+0000 7fd977fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd978151f70 0x7fd9781f0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.231+0000 7fd977fff640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd978150030 con 0x7fd978157150 2024-04-25T01:39:40.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.231+0000 7fd977fff640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd97806b620 con 0x7fd978151f70 2024-04-25T01:39:40.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.231+0000 7fd977fff640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd9780c58f0 con 0x7fd9780caa50 2024-04-25T01:39:40.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.231+0000 7f9d26d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d28153470 0x7f9d280c1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.231+0000 7f89ca7fc640 1 -- 172.21.15.77:0/503359408 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f89d40c8060 con 0x7f89cc0dbce0 2024-04-25T01:39:40.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.231+0000 7fbad5823640 1 --2- 172.21.15.77:0/4199926181 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbac8047230 0x7fbac802d010 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbac000c3c0 tx=0x7fbac0001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:40.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.231+0000 7fc4567fc640 1 -- 172.21.15.77:0/522753932 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc45c00bbc0 con 0x7fc458048360 2024-04-25T01:39:40.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.231+0000 7f0f41ffb640 1 -- 172.21.15.77:0/577258338 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f4c071480 con 0x7f0f440dbce0 2024-04-25T01:39:40.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.229+0000 7f7b70f10640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b6c0c3cf0 0x7f7b6c152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.229+0000 7f7b70f10640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b6c0c5770 0x7f7b6c0c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.229+0000 7f7b70f10640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b6c1578b0 0x7f7b6c0a5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.230+0000 7f7b6a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b6c0c3cf0 0x7f7b6c152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.230+0000 7f7b69d9b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b6c0c5770 0x7f7b6c0c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.230+0000 7f7b6a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b6c0c3cf0 0x7f7b6c152680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:52326/0 (socket says 172.21.15.77:52326) 2024-04-25T01:39:40.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.230+0000 7f7b69d9b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b6c0c5770 0x7f7b6c0c6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.77:52322/0 (socket says 172.21.15.77:52322) 2024-04-25T01:39:40.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.231+0000 7f0a8affd640 1 --2- 172.21.15.77:0/2577917144 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0a78070240 0x7f0a78072700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.231+0000 7f0a8affd640 1 -- 172.21.15.77:0/2577917144 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f0a8c08adf0 con 0x7f0a94157250 2024-04-25T01:39:40.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.231+0000 7f0a9a40e640 1 --2- 172.21.15.77:0/2577917144 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0a78070240 0x7f0a78072700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.231+0000 7fd9777fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd978151f70 0x7fd9781f0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.231+0000 7fd9777fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd978151f70 0x7fd9781f0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:52356/0 (socket says 172.21.15.77:52356) 2024-04-25T01:39:40.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.231+0000 7fd9777fe640 1 -- 172.21.15.77:0/3815367022 learned_addr learned my addr 172.21.15.77:0/3815367022 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:40.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.231+0000 7f0f41ffb640 1 --2- 172.21.15.77:0/577258338 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0f3006beb0 0x7f0f3006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.231+0000 7f0f51783640 1 --2- 172.21.15.77:0/577258338 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0f3006beb0 0x7f0f3006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.231+0000 7f0f41ffb640 1 -- 172.21.15.77:0/577258338 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f0f4c107730 con 0x7f0f440dbce0 2024-04-25T01:39:40.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7f89ca7fc640 1 --2- 172.21.15.77:0/503359408 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f89b806bf30 0x7f89b806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7f7b70f10640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6c0c27a0 con 0x7f7b6c1578b0 2024-04-25T01:39:40.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7f89ca7fc640 1 -- 172.21.15.77:0/503359408 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f89d41281c0 con 0x7f89cc0dbce0 2024-04-25T01:39:40.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7f7b70f10640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6c0c2270 con 0x7f7b6c0c3cf0 2024-04-25T01:39:40.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7f7b70f10640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f7b6c06e170 con 0x7f7b6c0c5770 2024-04-25T01:39:40.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7f7b6a59c640 1 -- 172.21.15.77:0/1461750678 learned_addr learned my addr 172.21.15.77:0/1461750678 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:40.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7fc4567fc640 1 --2- 172.21.15.77:0/522753932 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc44406be80 0x7fc44406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7fc4567fc640 1 -- 172.21.15.77:0/522753932 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fc45c08b5c0 con 0x7fc458048360 2024-04-25T01:39:40.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7f0f51783640 1 --2- 172.21.15.77:0/577258338 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0f3006beb0 0x7f0f3006e370 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0f48005880 tx=0x7f0f48009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:40.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7f9d2659c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d280bed90 0x7f9d280ac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7f9d25d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d280c9aa0 0x7f9d280c16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7f9d2659c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d280bed90 0x7f9d280ac2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.77:52332/0 (socket says 172.21.15.77:52332) 2024-04-25T01:39:40.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7f9d2659c640 1 -- 172.21.15.77:0/222279296 learned_addr learned my addr 172.21.15.77:0/222279296 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:40.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7f9d2759e640 1 -- 172.21.15.77:0/222279296 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9d280c6550 con 0x7f9d280bed90 2024-04-25T01:39:40.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7fd976ffd640 1 --2- 172.21.15.77:0/3815367022 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd9780caa50 0x7fd9781f32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7fc465b8a640 1 --2- 172.21.15.77:0/522753932 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc44406be80 0x7fc44406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7fd9767fc640 1 --2- 172.21.15.77:0/3815367022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd978157150 0x7fd978154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7fd9777fe640 1 -- 172.21.15.77:0/3815367022 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd9780caa50 msgr2=0x7fd9781f32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7fd9777fe640 1 --2- 172.21.15.77:0/3815367022 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd9780caa50 0x7fd9781f32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7fd9777fe640 1 -- 172.21.15.77:0/3815367022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd978157150 msgr2=0x7fd978154390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7f7b6ad9d640 1 --2- 172.21.15.77:0/1461750678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b6c1578b0 0x7f7b6c0a5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.233+0000 7f0a9a40e640 1 --2- 172.21.15.77:0/2577917144 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0a78070240 0x7f0a78072700 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0a90034000 tx=0x7f0a9002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:40.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7f89d9d3e640 1 --2- 172.21.15.77:0/503359408 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f89b806bf30 0x7f89b806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7f7b69d9b640 1 -- 172.21.15.77:0/1461750678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b6c0c3cf0 msgr2=0x7f7b6c152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7f7b69d9b640 1 --2- 172.21.15.77:0/1461750678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b6c0c3cf0 0x7f7b6c152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7f7b69d9b640 1 -- 172.21.15.77:0/1461750678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b6c1578b0 msgr2=0x7f7b6c0a5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7f7b69d9b640 1 --2- 172.21.15.77:0/1461750678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b6c1578b0 0x7f7b6c0a5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7f7b69d9b640 1 -- 172.21.15.77:0/1461750678 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b6c1f3c70 con 0x7f7b6c0c5770 2024-04-25T01:39:40.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7f7b6a59c640 1 --2- 172.21.15.77:0/1461750678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b6c0c3cf0 0x7f7b6c152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:40.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.233+0000 7f7b69d9b640 1 --2- 172.21.15.77:0/1461750678 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b6c0c5770 0x7f7b6c0c6050 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7b60031000 tx=0x7f7b600046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:40.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.233+0000 7fc465b8a640 1 --2- 172.21.15.77:0/522753932 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc44406be80 0x7fc44406e340 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc458007b30 tx=0x7fc4600ac000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:40.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.233+0000 7f9d25d9b640 1 -- 172.21.15.77:0/222279296 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d280bed90 msgr2=0x7f9d280ac2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.233+0000 7f9d25d9b640 1 --2- 172.21.15.77:0/222279296 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d280bed90 0x7f9d280ac2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.233+0000 7f9d25d9b640 1 -- 172.21.15.77:0/222279296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d28153470 msgr2=0x7f9d280c1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.233+0000 7f9d25d9b640 1 --2- 172.21.15.77:0/222279296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d28153470 0x7f9d280c1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.233+0000 7f9d25d9b640 1 -- 172.21.15.77:0/222279296 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d280ae700 con 0x7f9d280c9aa0 2024-04-25T01:39:40.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7fd9777fe640 1 --2- 172.21.15.77:0/3815367022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd978157150 0x7fd978154390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7fd9777fe640 1 -- 172.21.15.77:0/3815367022 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9781f39d0 con 0x7fd978151f70 2024-04-25T01:39:40.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7fd976ffd640 1 --2- 172.21.15.77:0/3815367022 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd9780caa50 0x7fd9781f32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:40.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.232+0000 7fd9767fc640 1 --2- 172.21.15.77:0/3815367022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd978157150 0x7fd978154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:40.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.233+0000 7fd9777fe640 1 --2- 172.21.15.77:0/3815367022 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd978151f70 0x7fd9781f0490 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd96800c4e0 tx=0x7fd96800c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:40.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.233+0000 7f7b5affd640 1 -- 172.21.15.77:0/1461750678 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b60037050 con 0x7f7b6c0c5770 2024-04-25T01:39:40.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.233+0000 7f7b5affd640 1 -- 172.21.15.77:0/1461750678 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b60038040 con 0x7f7b6c0c5770 2024-04-25T01:39:40.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.233+0000 7f7b5affd640 1 -- 172.21.15.77:0/1461750678 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6003c910 con 0x7f7b6c0c5770 2024-04-25T01:39:40.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.233+0000 7f7b70f10640 1 -- 172.21.15.77:0/1461750678 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b6c1e7560 con 0x7f7b6c0c5770 2024-04-25T01:39:40.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.233+0000 7f9d25d9b640 1 --2- 172.21.15.77:0/222279296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d280c9aa0 0x7f9d280c16d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c00c410 tx=0x7f9d1c00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:40.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.233+0000 7f7b70f10640 1 -- 172.21.15.77:0/1461750678 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b6c1e4a40 con 0x7f7b6c0c5770 2024-04-25T01:39:40.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.233+0000 7f89d9d3e640 1 --2- 172.21.15.77:0/503359408 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f89b806bf30 0x7f89b806e3f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0314f0 tx=0x7f89d0009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:40.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.234+0000 7f7b70f10640 1 -- 172.21.15.77:0/1461750678 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b6c075d10 con 0x7f7b6c0c5770 2024-04-25T01:39:40.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.234+0000 7f7b5affd640 1 -- 172.21.15.77:0/1461750678 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7b60045020 con 0x7f7b6c0c5770 2024-04-25T01:39:40.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.235+0000 7f7b5affd640 1 --2- 172.21.15.77:0/1461750678 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7b4c06beb0 0x7f7b4c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.235+0000 7f7b5affd640 1 -- 172.21.15.77:0/1461750678 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f7b600ab490 con 0x7f7b6c0c5770 2024-04-25T01:39:40.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.235+0000 7f7b6a59c640 1 --2- 172.21.15.77:0/1461750678 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7b4c06beb0 0x7f7b4c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.235+0000 7f7b6a59c640 1 --2- 172.21.15.77:0/1461750678 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7b4c06beb0 0x7f7b4c06e370 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7b64002230 tx=0x7f7b64009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:40.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.236+0000 7f0a8affd640 1 -- 172.21.15.77:0/2577917144 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0a9404f500 con 0x7f0a94157250 2024-04-25T01:39:40.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.236+0000 7f89ca7fc640 1 -- 172.21.15.77:0/503359408 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f89d40bc070 con 0x7f89cc0dbce0 2024-04-25T01:39:40.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.240+0000 7f7b5affd640 1 -- 172.21.15.77:0/1461750678 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7b6c1f3c70 con 0x7f7b6c0c5770 2024-04-25T01:39:40.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.241+0000 7f0f41ffb640 1 -- 172.21.15.77:0/577258338 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0f4c0d57d0 con 0x7f0f440dbce0 2024-04-25T01:39:40.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.245+0000 7fbac6ffd640 1 -- 172.21.15.77:0/4199926181 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac0017070 con 0x7fbac8047230 2024-04-25T01:39:40.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.245+0000 7fbac6ffd640 1 -- 172.21.15.77:0/4199926181 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac0005ce0 con 0x7fbac8047230 2024-04-25T01:39:40.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.245+0000 7fbad8288640 1 -- 172.21.15.77:0/4199926181 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbac8174b70 con 0x7fbac8047230 2024-04-25T01:39:40.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.245+0000 7fd95f7fe640 1 -- 172.21.15.77:0/3815367022 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd968005480 con 0x7fd978151f70 2024-04-25T01:39:40.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.246+0000 7fd95f7fe640 1 -- 172.21.15.77:0/3815367022 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9680035f0 con 0x7fd978151f70 2024-04-25T01:39:40.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.246+0000 7fd95f7fe640 1 -- 172.21.15.77:0/3815367022 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd968003a00 con 0x7fd978151f70 2024-04-25T01:39:40.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.246+0000 7f9d16ffd640 1 -- 172.21.15.77:0/222279296 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c017070 con 0x7f9d280c9aa0 2024-04-25T01:39:40.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.246+0000 7fd977fff640 1 -- 172.21.15.77:0/3815367022 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9781f3cb0 con 0x7fd978151f70 2024-04-25T01:39:40.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.246+0000 7f9d16ffd640 1 -- 172.21.15.77:0/222279296 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d1c005230 con 0x7f9d280c9aa0 2024-04-25T01:39:40.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.246+0000 7fbad8288640 1 -- 172.21.15.77:0/4199926181 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbac8175130 con 0x7fbac8047230 2024-04-25T01:39:40.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.247+0000 7fbac6ffd640 1 -- 172.21.15.77:0/4199926181 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac00072d0 con 0x7fbac8047230 2024-04-25T01:39:40.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.247+0000 7f9d16ffd640 1 -- 172.21.15.77:0/222279296 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c017070 con 0x7f9d280c9aa0 2024-04-25T01:39:40.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.247+0000 7f9d2759e640 1 -- 172.21.15.77:0/222279296 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d280ae9e0 con 0x7f9d280c9aa0 2024-04-25T01:39:40.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.246+0000 7fd977fff640 1 -- 172.21.15.77:0/3815367022 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9781548d0 con 0x7fd978151f70 2024-04-25T01:39:40.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.247+0000 7f9d2759e640 1 -- 172.21.15.77:0/222279296 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d280aefa0 con 0x7f9d280c9aa0 2024-04-25T01:39:40.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.247+0000 7fbad8288640 1 -- 172.21.15.77:0/4199926181 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbab8005290 con 0x7fbac8047230 2024-04-25T01:39:40.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.247+0000 7fc4567fc640 1 -- 172.21.15.77:0/522753932 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc45c01c360 con 0x7fc458048360 2024-04-25T01:39:40.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.248+0000 7fd977fff640 1 -- 172.21.15.77:0/3815367022 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9781efd60 con 0x7fd978151f70 2024-04-25T01:39:40.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.248+0000 7fd95f7fe640 1 -- 172.21.15.77:0/3815367022 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd968003ba0 con 0x7fd978151f70 2024-04-25T01:39:40.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.248+0000 7fbac6ffd640 1 -- 172.21.15.77:0/4199926181 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbac001a070 con 0x7fbac8047230 2024-04-25T01:39:40.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.249+0000 7fbac6ffd640 1 --2- 172.21.15.77:0/4199926181 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbab406bf00 0x7fbab406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.249+0000 7fd95f7fe640 1 --2- 172.21.15.77:0/3815367022 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd96406c050 0x7fd96406e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.249+0000 7fd95f7fe640 1 -- 172.21.15.77:0/3815367022 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fd968056de0 con 0x7fd978151f70 2024-04-25T01:39:40.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.249+0000 7fd976ffd640 1 --2- 172.21.15.77:0/3815367022 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd96406c050 0x7fd96406e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.250+0000 7f9d16ffd640 1 -- 172.21.15.77:0/222279296 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9d1c01a070 con 0x7f9d280c9aa0 2024-04-25T01:39:40.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.250+0000 7fbac6ffd640 1 -- 172.21.15.77:0/4199926181 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fbac008a6c0 con 0x7fbac8047230 2024-04-25T01:39:40.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.250+0000 7fd976ffd640 1 --2- 172.21.15.77:0/3815367022 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd96406c050 0x7fd96406e510 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd96c034000 tx=0x7fd96c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:40.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.250+0000 7fbad6024640 1 --2- 172.21.15.77:0/4199926181 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbab406bf00 0x7fbab406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.250+0000 7f9d14ff9640 1 -- 172.21.15.77:0/222279296 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d28075d10 con 0x7f9d280c9aa0 2024-04-25T01:39:40.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.251+0000 7f9d16ffd640 1 --2- 172.21.15.77:0/222279296 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9d0806c230 0x7f9d0806e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:40.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.251+0000 7fbad6024640 1 --2- 172.21.15.77:0/4199926181 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbab406bf00 0x7fbab406e3c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbacc034000 tx=0x7fbacc02c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:40.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.251+0000 7f9d16ffd640 1 -- 172.21.15.77:0/222279296 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f9d1c005030 con 0x7f9d280c9aa0 2024-04-25T01:39:40.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.251+0000 7f9d2659c640 1 --2- 172.21.15.77:0/222279296 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9d0806c230 0x7f9d0806e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:40.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.252+0000 7f9d2659c640 1 --2- 172.21.15.77:0/222279296 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9d0806c230 0x7f9d0806e6f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009630 tx=0x7f9d1802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:40.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.252+0000 7fbac6ffd640 1 -- 172.21.15.77:0/4199926181 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbac0058760 con 0x7fbac8047230 2024-04-25T01:39:40.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.258+0000 7fd95f7fe640 1 -- 172.21.15.77:0/3815367022 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd968059440 con 0x7fd978151f70 2024-04-25T01:39:40.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.261+0000 7f9d16ffd640 1 -- 172.21.15.77:0/222279296 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9d1c057d60 con 0x7f9d280c9aa0 2024-04-25T01:39:40.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.654+0000 7f89dad40640 1 -- 172.21.15.77:0/503359408 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f89cc00b590 con 0x7f89cc0dbce0 2024-04-25T01:39:40.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.655+0000 7f89ca7fc640 1 -- 172.21.15.77:0/503359408 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f89d40a9070 con 0x7f89cc0dbce0 2024-04-25T01:39:40.639 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2024-04-25T01:39:40.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.655+0000 7f0f539e7640 1 -- 172.21.15.77:0/577258338 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f0f2c005580 con 0x7f0f440dbce0 2024-04-25T01:39:40.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.656+0000 7f0f41ffb640 1 -- 172.21.15.77:0/577258338 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0f4c0d9ad0 con 0x7f0f440dbce0 2024-04-25T01:39:40.640 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2024-04-25T01:39:40.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.658+0000 7f89dad40640 1 -- 172.21.15.77:0/503359408 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f89b806bf30 msgr2=0x7f89b806e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.658+0000 7f89dad40640 1 --2- 172.21.15.77:0/503359408 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f89b806bf30 0x7f89b806e3f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0314f0 tx=0x7f89d0009190 comp rx=0 tx=0).stop 2024-04-25T01:39:40.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.659+0000 7f89dad40640 1 -- 172.21.15.77:0/503359408 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89cc0dbce0 msgr2=0x7f89cc02c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.659+0000 7f89dad40640 1 --2- 172.21.15.77:0/503359408 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89cc0dbce0 0x7f89cc02c590 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f89d404fa20 tx=0x7f89d40693f0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.659+0000 7f89dad40640 1 -- 172.21.15.77:0/503359408 shutdown_connections 2024-04-25T01:39:40.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.659+0000 7f89dad40640 1 --2- 172.21.15.77:0/503359408 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f89b806bf30 0x7f89b806e3f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.659+0000 7f89dad40640 1 --2- 172.21.15.77:0/503359408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89cc0df180 0x7f89cc177ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.659+0000 7f0f377fe640 1 -- 172.21.15.77:0/577258338 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0f3006beb0 msgr2=0x7f0f3006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.659+0000 7f0f377fe640 1 --2- 172.21.15.77:0/577258338 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0f3006beb0 0x7f0f3006e370 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0f48005880 tx=0x7f0f48009040 comp rx=0 tx=0).stop 2024-04-25T01:39:40.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.659+0000 7f0f377fe640 1 -- 172.21.15.77:0/577258338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f440dbce0 msgr2=0x7f0f440d7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.659+0000 7f0f377fe640 1 --2- 172.21.15.77:0/577258338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f440dbce0 0x7f0f440d7d40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c064ed0 tx=0x7f0f4c075b60 comp rx=0 tx=0).stop 2024-04-25T01:39:40.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.659+0000 7f89dad40640 1 --2- 172.21.15.77:0/503359408 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89cc0dbce0 0x7f89cc02c590 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.659+0000 7f89dad40640 1 --2- 172.21.15.77:0/503359408 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89cc0073e0 0x7f89cc035a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.659+0000 7f0f377fe640 1 -- 172.21.15.77:0/577258338 shutdown_connections 2024-04-25T01:39:40.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.659+0000 7f0f377fe640 1 --2- 172.21.15.77:0/577258338 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0f3006beb0 0x7f0f3006e370 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.659+0000 7f0f377fe640 1 --2- 172.21.15.77:0/577258338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f440474a0 0x7f0f440430b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.659+0000 7f0f377fe640 1 --2- 172.21.15.77:0/577258338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f440dbce0 0x7f0f440d7d40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.659+0000 7f0f377fe640 1 --2- 172.21.15.77:0/577258338 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f440073e0 0x7f0f440d9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.659+0000 7f0f377fe640 1 -- 172.21.15.77:0/577258338 >> 172.21.15.77:0/577258338 conn(0x7f0f44048250 msgr2=0x7f0f4402b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:40.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.659+0000 7f89dad40640 1 -- 172.21.15.77:0/503359408 >> 172.21.15.77:0/503359408 conn(0x7f89cc048250 msgr2=0x7f89cc048630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:40.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.660+0000 7f89dad40640 1 -- 172.21.15.77:0/503359408 shutdown_connections 2024-04-25T01:39:40.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.660+0000 7f89dad40640 1 -- 172.21.15.77:0/503359408 wait complete. 2024-04-25T01:39:40.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.660+0000 7f0f377fe640 1 -- 172.21.15.77:0/577258338 shutdown_connections 2024-04-25T01:39:40.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.660+0000 7f0f377fe640 1 -- 172.21.15.77:0/577258338 wait complete. 2024-04-25T01:39:40.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.661+0000 7f0a9c672640 1 -- 172.21.15.77:0/2577917144 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f0a94070c30 con 0x7f0a94157250 2024-04-25T01:39:40.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.661+0000 7f7b70f10640 1 -- 172.21.15.77:0/1461750678 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f7b6c06d9e0 con 0x7f7b6c0c5770 2024-04-25T01:39:40.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.662+0000 7f0a8affd640 1 -- 172.21.15.77:0/2577917144 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0a94070c30 con 0x7f0a94157250 2024-04-25T01:39:40.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.662+0000 7f7b5affd640 1 -- 172.21.15.77:0/1461750678 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7b60079bc0 con 0x7f7b6c0c5770 2024-04-25T01:39:40.653 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2024-04-25T01:39:40.654 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2024-04-25T01:39:40.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.665+0000 7f7b70f10640 1 -- 172.21.15.77:0/1461750678 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7b4c06beb0 msgr2=0x7f7b4c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.665+0000 7f7b70f10640 1 --2- 172.21.15.77:0/1461750678 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7b4c06beb0 0x7f7b4c06e370 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7b64002230 tx=0x7f7b64009040 comp rx=0 tx=0).stop 2024-04-25T01:39:40.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.665+0000 7f7b70f10640 1 -- 172.21.15.77:0/1461750678 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b6c0c5770 msgr2=0x7f7b6c0c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.665+0000 7f7b70f10640 1 --2- 172.21.15.77:0/1461750678 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b6c0c5770 0x7f7b6c0c6050 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7b60031000 tx=0x7f7b600046c0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.665+0000 7f7b70f10640 1 -- 172.21.15.77:0/1461750678 shutdown_connections 2024-04-25T01:39:40.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.665+0000 7f7b70f10640 1 --2- 172.21.15.77:0/1461750678 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7b4c06beb0 0x7f7b4c06e370 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.665+0000 7f7b70f10640 1 --2- 172.21.15.77:0/1461750678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b6c1578b0 0x7f7b6c0a5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.665+0000 7f7b70f10640 1 --2- 172.21.15.77:0/1461750678 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b6c0c5770 0x7f7b6c0c6050 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.665+0000 7f7b70f10640 1 --2- 172.21.15.77:0/1461750678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b6c0c3cf0 0x7f7b6c152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.665+0000 7f7b70f10640 1 -- 172.21.15.77:0/1461750678 >> 172.21.15.77:0/1461750678 conn(0x7f7b6c06b110 msgr2=0x7f7b6c06bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:40.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.666+0000 7f7b70f10640 1 -- 172.21.15.77:0/1461750678 shutdown_connections 2024-04-25T01:39:40.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.666+0000 7f7b70f10640 1 -- 172.21.15.77:0/1461750678 wait complete. 2024-04-25T01:39:40.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.666+0000 7f0a9c672640 1 -- 172.21.15.77:0/2577917144 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0a78070240 msgr2=0x7f0a78072700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.667+0000 7f0a9c672640 1 --2- 172.21.15.77:0/2577917144 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0a78070240 0x7f0a78072700 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0a90034000 tx=0x7f0a9002e000 comp rx=0 tx=0).stop 2024-04-25T01:39:40.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.667+0000 7f0a9c672640 1 -- 172.21.15.77:0/2577917144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a94157250 msgr2=0x7f0a940ad930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.667+0000 7f0a9c672640 1 --2- 172.21.15.77:0/2577917144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a94157250 0x7f0a940ad930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00cad0 tx=0x7f0a8c00cf90 comp rx=0 tx=0).stop 2024-04-25T01:39:40.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.667+0000 7f0a9c672640 1 -- 172.21.15.77:0/2577917144 shutdown_connections 2024-04-25T01:39:40.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.667+0000 7fc467dee640 1 -- 172.21.15.77:0/522753932 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fc458005390 con 0x7fc458048360 2024-04-25T01:39:40.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.667+0000 7f0a9c672640 1 --2- 172.21.15.77:0/2577917144 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0a78070240 0x7f0a78072700 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.667+0000 7f0a9c672640 1 --2- 172.21.15.77:0/2577917144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a94157250 0x7f0a940ad930 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.667+0000 7f0a9c672640 1 --2- 172.21.15.77:0/2577917144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0a94151310 0x7f0a941ea6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.668+0000 7f0a9c672640 1 --2- 172.21.15.77:0/2577917144 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0a940732a0 0x7f0a940c72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.668+0000 7f0a9c672640 1 -- 172.21.15.77:0/2577917144 >> 172.21.15.77:0/2577917144 conn(0x7f0a94066ea0 msgr2=0x7f0a9406f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:40.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.668+0000 7f0a9c672640 1 -- 172.21.15.77:0/2577917144 shutdown_connections 2024-04-25T01:39:40.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.668+0000 7f0a9c672640 1 -- 172.21.15.77:0/2577917144 wait complete. 2024-04-25T01:39:40.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.668+0000 7fc4567fc640 1 -- 172.21.15.77:0/522753932 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc45c059cb0 con 0x7fc458048360 2024-04-25T01:39:40.665 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2024-04-25T01:39:40.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.671+0000 7fd977fff640 1 -- 172.21.15.77:0/3815367022 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fd978075d10 con 0x7fd978151f70 2024-04-25T01:39:40.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.672+0000 7fc443fff640 1 -- 172.21.15.77:0/522753932 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc44406be80 msgr2=0x7fc44406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.672+0000 7fc443fff640 1 --2- 172.21.15.77:0/522753932 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc44406be80 0x7fc44406e340 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc458007b30 tx=0x7fc4600ac000 comp rx=0 tx=0).stop 2024-04-25T01:39:40.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.672+0000 7fc443fff640 1 -- 172.21.15.77:0/522753932 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc458048360 msgr2=0x7fc4580dbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.672+0000 7fc443fff640 1 --2- 172.21.15.77:0/522753932 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc458048360 0x7fc4580dbe60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc45c00d800 tx=0x7fc45c00dcc0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.672+0000 7fc443fff640 1 -- 172.21.15.77:0/522753932 shutdown_connections 2024-04-25T01:39:40.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.672+0000 7fc443fff640 1 --2- 172.21.15.77:0/522753932 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc44406be80 0x7fc44406e340 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.672+0000 7fc443fff640 1 --2- 172.21.15.77:0/522753932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc45804bb00 0x7fc4580db2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.672+0000 7fc443fff640 1 --2- 172.21.15.77:0/522753932 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc458048360 0x7fc4580dbe60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.672+0000 7fc443fff640 1 --2- 172.21.15.77:0/522753932 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc45800d7d0 0x7fc4580cfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.672+0000 7fc443fff640 1 -- 172.21.15.77:0/522753932 >> 172.21.15.77:0/522753932 conn(0x7fc45804d9e0 msgr2=0x7fc458008e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:40.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.672+0000 7fc443fff640 1 -- 172.21.15.77:0/522753932 shutdown_connections 2024-04-25T01:39:40.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.672+0000 7fc443fff640 1 -- 172.21.15.77:0/522753932 wait complete. 2024-04-25T01:39:40.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.672+0000 7fd95f7fe640 1 -- 172.21.15.77:0/3815367022 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd968058d40 con 0x7fd978151f70 2024-04-25T01:39:40.672 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2024-04-25T01:39:40.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.676+0000 7fd95d7fa640 1 -- 172.21.15.77:0/3815367022 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd96406c050 msgr2=0x7fd96406e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.676+0000 7fd95d7fa640 1 --2- 172.21.15.77:0/3815367022 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd96406c050 0x7fd96406e510 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd96c034000 tx=0x7fd96c02e000 comp rx=0 tx=0).stop 2024-04-25T01:39:40.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.676+0000 7fd95d7fa640 1 -- 172.21.15.77:0/3815367022 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd978151f70 msgr2=0x7fd9781f0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.676+0000 7fd95d7fa640 1 --2- 172.21.15.77:0/3815367022 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd978151f70 0x7fd9781f0490 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd96800c4e0 tx=0x7fd96800c9a0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.676+0000 7fd95d7fa640 1 -- 172.21.15.77:0/3815367022 shutdown_connections 2024-04-25T01:39:40.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.677+0000 7fd95d7fa640 1 --2- 172.21.15.77:0/3815367022 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd96406c050 0x7fd96406e510 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.677+0000 7fd95d7fa640 1 --2- 172.21.15.77:0/3815367022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd978157150 0x7fd978154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.677+0000 7fd95d7fa640 1 --2- 172.21.15.77:0/3815367022 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd978151f70 0x7fd9781f0490 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.677+0000 7fd95d7fa640 1 --2- 172.21.15.77:0/3815367022 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd9780caa50 0x7fd9781f32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.677+0000 7fd95d7fa640 1 -- 172.21.15.77:0/3815367022 >> 172.21.15.77:0/3815367022 conn(0x7fd9780ad220 msgr2=0x7fd9781539f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:40.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.677+0000 7fd95d7fa640 1 -- 172.21.15.77:0/3815367022 shutdown_connections 2024-04-25T01:39:40.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.677+0000 7fd95d7fa640 1 -- 172.21.15.77:0/3815367022 wait complete. 2024-04-25T01:39:40.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.677+0000 7f9d14ff9640 1 -- 172.21.15.77:0/222279296 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f9d2806d530 con 0x7f9d280c9aa0 2024-04-25T01:39:40.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.678+0000 7f9d16ffd640 1 -- 172.21.15.77:0/222279296 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9d1c05c060 con 0x7f9d280c9aa0 2024-04-25T01:39:40.676 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2024-04-25T01:39:40.678 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2024-04-25T01:39:40.678 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2024-04-25T01:39:40.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.681+0000 7f9d14ff9640 1 -- 172.21.15.77:0/222279296 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9d0806c230 msgr2=0x7f9d0806e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.681+0000 7f9d14ff9640 1 --2- 172.21.15.77:0/222279296 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9d0806c230 0x7f9d0806e6f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009630 tx=0x7f9d1802e000 comp rx=0 tx=0).stop 2024-04-25T01:39:40.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.681+0000 7f9d14ff9640 1 -- 172.21.15.77:0/222279296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d280c9aa0 msgr2=0x7f9d280c16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.681+0000 7f9d14ff9640 1 --2- 172.21.15.77:0/222279296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d280c9aa0 0x7f9d280c16d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c00c410 tx=0x7f9d1c00c8d0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.681+0000 7f9d14ff9640 1 -- 172.21.15.77:0/222279296 shutdown_connections 2024-04-25T01:39:40.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.681+0000 7f9d14ff9640 1 --2- 172.21.15.77:0/222279296 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9d0806c230 0x7f9d0806e6f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.681+0000 7f9d14ff9640 1 --2- 172.21.15.77:0/222279296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d28153470 0x7f9d280c1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.681+0000 7f9d14ff9640 1 --2- 172.21.15.77:0/222279296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d280c9aa0 0x7f9d280c16d0 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c00c410 tx=0x7f9d1c00c8d0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.681+0000 7f9d14ff9640 1 --2- 172.21.15.77:0/222279296 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d280bed90 0x7f9d280ac2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.681+0000 7f9d14ff9640 1 -- 172.21.15.77:0/222279296 >> 172.21.15.77:0/222279296 conn(0x7f9d280ad1e0 msgr2=0x7f9d281df3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:40.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.682+0000 7f9d14ff9640 1 -- 172.21.15.77:0/222279296 shutdown_connections 2024-04-25T01:39:40.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.682+0000 7f9d14ff9640 1 -- 172.21.15.77:0/222279296 wait complete. 2024-04-25T01:39:40.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.683+0000 7fbad8288640 1 -- 172.21.15.77:0/4199926181 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fbab8005850 con 0x7fbac8047230 2024-04-25T01:39:40.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.683+0000 7fbac6ffd640 1 -- 172.21.15.77:0/4199926181 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbac005ca60 con 0x7fbac8047230 2024-04-25T01:39:40.682 INFO:teuthology.orchestra.run.smithi077.stdout:55834574855 2024-04-25T01:39:40.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.687+0000 7fbad8288640 1 -- 172.21.15.77:0/4199926181 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbab406bf00 msgr2=0x7fbab406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.687+0000 7fbad8288640 1 --2- 172.21.15.77:0/4199926181 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbab406bf00 0x7fbab406e3c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbacc034000 tx=0x7fbacc02c000 comp rx=0 tx=0).stop 2024-04-25T01:39:40.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.687+0000 7fbad8288640 1 -- 172.21.15.77:0/4199926181 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbac8047230 msgr2=0x7fbac802d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:40.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.687+0000 7fbad8288640 1 --2- 172.21.15.77:0/4199926181 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbac8047230 0x7fbac802d010 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbac000c3c0 tx=0x7fbac0001e70 comp rx=0 tx=0).stop 2024-04-25T01:39:40.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.687+0000 7fbad8288640 1 -- 172.21.15.77:0/4199926181 shutdown_connections 2024-04-25T01:39:40.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.687+0000 7fbad8288640 1 --2- 172.21.15.77:0/4199926181 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbab406bf00 0x7fbab406e3c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.687+0000 7fbad8288640 1 --2- 172.21.15.77:0/4199926181 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbac804ba70 0x7fbac802d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.687+0000 7fbad8288640 1 --2- 172.21.15.77:0/4199926181 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbac8047230 0x7fbac802d010 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.687+0000 7fbad8288640 1 --2- 172.21.15.77:0/4199926181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbac803f280 0x7fbac800b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:40.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.687+0000 7fbad8288640 1 -- 172.21.15.77:0/4199926181 >> 172.21.15.77:0/4199926181 conn(0x7fbac8048ac0 msgr2=0x7fbac80d5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:40.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.3 2024-04-25T01:39:40.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.688+0000 7fbad8288640 1 -- 172.21.15.77:0/4199926181 shutdown_connections 2024-04-25T01:39:40.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:40.688+0000 7fbad8288640 1 -- 172.21.15.77:0/4199926181 wait complete. 2024-04-25T01:39:40.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2024-04-25T01:39:40.688 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2024-04-25T01:39:40.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.7 2024-04-25T01:39:40.690 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.1 2024-04-25T01:39:40.691 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.6 2024-04-25T01:39:41.679 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T01:39:41.680 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T01:39:41.685 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T01:39:41.687 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T01:39:41.688 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T01:39:41.690 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T01:39:41.691 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T01:39:41.692 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T01:39:41.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.856+0000 7f308091a640 1 Processor -- start 2024-04-25T01:39:41.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.856+0000 7f308091a640 1 -- start start 2024-04-25T01:39:41.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.858+0000 7f308091a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f307c0c23d0 0x7f307c15add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.858+0000 7f308091a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f307c0aa450 con 0x7f307c06d390 2024-04-25T01:39:41.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.858+0000 7f308091a640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f307c0c28d0 con 0x7f307c159c10 2024-04-25T01:39:41.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.858+0000 7f308091a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f307c06cf00 con 0x7f307c0c23d0 2024-04-25T01:39:41.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.858+0000 7f307a59c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f307c0c23d0 0x7f307c15add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.858+0000 7f307a59c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f307c0c23d0 0x7f307c15add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.77:52346/0 (socket says 172.21.15.77:52346) 2024-04-25T01:39:41.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.858+0000 7f307a59c640 1 -- 172.21.15.77:0/2485038848 learned_addr learned my addr 172.21.15.77:0/2485038848 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:41.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.858+0000 7f307a59c640 1 -- 172.21.15.77:0/2485038848 >> v1:172.21.15.121:6789/0 conn(0x7f307c159c10 legacy=0x7f307c0c3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:41.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.858+0000 7f307a59c640 1 -- 172.21.15.77:0/2485038848 >> v1:172.21.15.77:6789/0 conn(0x7f307c06d390 legacy=0x7f307c06d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:41.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.858+0000 7f307a59c640 1 -- 172.21.15.77:0/2485038848 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307c0c2bb0 con 0x7f307c0c23d0 2024-04-25T01:39:41.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.856+0000 7f9e51bae640 1 Processor -- start 2024-04-25T01:39:41.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.856+0000 7f9e51bae640 1 -- start start 2024-04-25T01:39:41.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.857+0000 7f9e51bae640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e4403fb00 0x7f9e440479e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.857+0000 7f9e51bae640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9e440deb90 0x7f9e440df000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.857+0000 7f9e51bae640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e44048090 con 0x7f9e44047240 2024-04-25T01:39:41.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.857+0000 7f9e51bae640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f9e44048980 con 0x7f9e440deb90 2024-04-25T01:39:41.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.857+0000 7f9e51bae640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9e44047700 con 0x7f9e4403fb00 2024-04-25T01:39:41.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.857+0000 7f9e513ad640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9e440deb90 0x7f9e440df000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.858+0000 7f9e513ad640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9e440deb90 0x7f9e440df000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:52358/0 (socket says 172.21.15.77:52358) 2024-04-25T01:39:41.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.858+0000 7f9e513ad640 1 -- 172.21.15.77:0/1276783034 learned_addr learned my addr 172.21.15.77:0/1276783034 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:41.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.859+0000 7f9e513ad640 1 -- 172.21.15.77:0/1276783034 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e4403fb00 msgr2=0x7f9e440479e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T01:39:41.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.859+0000 7f9e513ad640 1 --2- 172.21.15.77:0/1276783034 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e4403fb00 0x7f9e440479e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.859+0000 7f9e513ad640 1 -- 172.21.15.77:0/1276783034 >> v1:172.21.15.121:6789/0 conn(0x7f9e44047240 legacy=0x7f9e440dbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:41.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.859+0000 7f9e513ad640 1 -- 172.21.15.77:0/1276783034 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e44048330 con 0x7f9e440deb90 2024-04-25T01:39:41.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.860+0000 7f307a59c640 1 --2- 172.21.15.77:0/2485038848 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f307c0c23d0 0x7f307c15add0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3074009e80 tx=0x7f307402a6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7823d3310f6ee2a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:41.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.860+0000 7f9e513ad640 1 --2- 172.21.15.77:0/1276783034 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e440deb90 0x7f9e440df000 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9e40009870 tx=0x7f9e4002a160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1875a73f46983199 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:41.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.860+0000 7f3079d9b640 1 -- 172.21.15.77:0/2485038848 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3074036070 con 0x7f307c0c23d0 2024-04-25T01:39:41.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.860+0000 7f3079d9b640 1 -- 172.21.15.77:0/2485038848 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3074031600 con 0x7f307c0c23d0 2024-04-25T01:39:41.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.860+0000 7f9e4b7fe640 1 -- 172.21.15.77:0/1276783034 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e40037070 con 0x7f9e440deb90 2024-04-25T01:39:41.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.860+0000 7f9e4b7fe640 1 -- 172.21.15.77:0/1276783034 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e40032440 con 0x7f9e440deb90 2024-04-25T01:39:41.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.860+0000 7f9e4b7fe640 1 -- 172.21.15.77:0/1276783034 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e40032850 con 0x7f9e440deb90 2024-04-25T01:39:41.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.861+0000 7f308091a640 1 -- 172.21.15.77:0/2485038848 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f307c0c23d0 msgr2=0x7f307c15add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:41.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.861+0000 7f308091a640 1 --2- 172.21.15.77:0/2485038848 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f307c0c23d0 0x7f307c15add0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3074009e80 tx=0x7f307402a6a0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.861+0000 7f308091a640 1 -- 172.21.15.77:0/2485038848 shutdown_connections 2024-04-25T01:39:41.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.861+0000 7f308091a640 1 --2- 172.21.15.77:0/2485038848 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f307c0c23d0 0x7f307c15add0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.861+0000 7f308091a640 1 -- 172.21.15.77:0/2485038848 >> 172.21.15.77:0/2485038848 conn(0x7f307c06b110 msgr2=0x7f307c06b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:41.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.861+0000 7f308091a640 1 -- 172.21.15.77:0/2485038848 shutdown_connections 2024-04-25T01:39:41.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.862+0000 7f9e51bae640 1 -- 172.21.15.77:0/1276783034 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e440deb90 msgr2=0x7f9e440df000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:41.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.862+0000 7f9e51bae640 1 --2- 172.21.15.77:0/1276783034 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e440deb90 0x7f9e440df000 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9e40009870 tx=0x7f9e4002a160 comp rx=0 tx=0).stop 2024-04-25T01:39:41.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.861+0000 7f308091a640 1 -- 172.21.15.77:0/2485038848 wait complete. 2024-04-25T01:39:41.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.863+0000 7f9e51bae640 1 -- 172.21.15.77:0/1276783034 shutdown_connections 2024-04-25T01:39:41.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.863+0000 7f9e51bae640 1 --2- 172.21.15.77:0/1276783034 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e440deb90 0x7f9e440df000 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.863+0000 7f9e51bae640 1 --2- 172.21.15.77:0/1276783034 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e4403fb00 0x7f9e440479e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.863+0000 7f9e51bae640 1 -- 172.21.15.77:0/1276783034 >> 172.21.15.77:0/1276783034 conn(0x7f9e44049340 msgr2=0x7f9e44049750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:41.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.863+0000 7f308091a640 1 Processor -- start 2024-04-25T01:39:41.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.864+0000 7f308091a640 1 -- start start 2024-04-25T01:39:41.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.863+0000 7f9e51bae640 1 -- 172.21.15.77:0/1276783034 shutdown_connections 2024-04-25T01:39:41.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.863+0000 7f9e51bae640 1 -- 172.21.15.77:0/1276783034 wait complete. 2024-04-25T01:39:41.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.865+0000 7f9e51bae640 1 Processor -- start 2024-04-25T01:39:41.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.865+0000 7f308091a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f307c06d390 0x7f307c070370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.865+0000 7f308091a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f307c0c23d0 0x7f307c1fb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.865+0000 7f307a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f307c0c23d0 0x7f307c1fb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.866+0000 7f307ad9d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f307c06d390 0x7f307c070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.866+0000 7f307ad9d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f307c06d390 0x7f307c070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.77:52350/0 (socket says 172.21.15.77:52350) 2024-04-25T01:39:41.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.866+0000 7f307a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f307c0c23d0 0x7f307c1fb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46916/0 (socket says 172.21.15.77:46916) 2024-04-25T01:39:41.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.866+0000 7f307ad9d640 1 -- 172.21.15.77:0/4029929738 learned_addr learned my addr 172.21.15.77:0/4029929738 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:41.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.865+0000 7f9e51bae640 1 -- start start 2024-04-25T01:39:41.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.866+0000 7f9e51bae640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e4403fb00 0x7f9e44030310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.866+0000 7f9e51bae640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e44047240 0x7f9e4402f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.866+0000 7f9e51bae640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e440deb90 0x7f9e440caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.866+0000 7f9e51bae640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9e4404a200 con 0x7f9e440deb90 2024-04-25T01:39:41.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.866+0000 7f9e51bae640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9e4404a080 con 0x7f9e4403fb00 2024-04-25T01:39:41.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.866+0000 7f9e51bae640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9e440dc400 con 0x7f9e44047240 2024-04-25T01:39:41.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.866+0000 7f9e4bfff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e44047240 0x7f9e4402f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.866+0000 7f9e4bfff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e44047240 0x7f9e4402f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.77:52362/0 (socket says 172.21.15.77:52362) 2024-04-25T01:39:41.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.866+0000 7f9e4bfff640 1 -- 172.21.15.77:0/954861929 learned_addr learned my addr 172.21.15.77:0/954861929 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:41.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.867+0000 7f9e50bac640 1 --2- 172.21.15.77:0/954861929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e4403fb00 0x7f9e44030310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.867+0000 7f9e513ad640 1 --2- 172.21.15.77:0/954861929 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e440deb90 0x7f9e440caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.867+0000 7f9e4bfff640 1 -- 172.21.15.77:0/954861929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e4403fb00 msgr2=0x7f9e44030310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:41.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.867+0000 7f9e4bfff640 1 --2- 172.21.15.77:0/954861929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e4403fb00 0x7f9e44030310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.867+0000 7f9e4bfff640 1 -- 172.21.15.77:0/954861929 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e440deb90 msgr2=0x7f9e440caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:41.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.867+0000 7f9e4bfff640 1 --2- 172.21.15.77:0/954861929 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e440deb90 0x7f9e440caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.867+0000 7f9e4bfff640 1 -- 172.21.15.77:0/954861929 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e4402fa10 con 0x7f9e44047240 2024-04-25T01:39:41.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.866+0000 7f308091a640 1 --2- 172.21.15.77:0/4029929738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f307c159c10 0x7f307c1552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.867+0000 7f9e513ad640 1 --2- 172.21.15.77:0/954861929 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e440deb90 0x7f9e440caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:41.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.866+0000 7f308091a640 1 -- 172.21.15.77:0/4029929738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f307c159ff0 con 0x7f307c0c23d0 2024-04-25T01:39:41.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.866+0000 7f308091a640 1 -- 172.21.15.77:0/4029929738 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f307c0c3170 con 0x7f307c159c10 2024-04-25T01:39:41.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.868+0000 7f9e4bfff640 1 --2- 172.21.15.77:0/954861929 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e44047240 0x7f9e4402f4d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9e3800c400 tx=0x7f9e3800c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:41.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.866+0000 7f308091a640 1 -- 172.21.15.77:0/4029929738 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f307c0a9b60 con 0x7f307c06d390 2024-04-25T01:39:41.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.867+0000 7f307a59c640 1 -- 172.21.15.77:0/4029929738 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f307c06d390 msgr2=0x7f307c070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:41.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.867+0000 7f307a59c640 1 --2- 172.21.15.77:0/4029929738 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f307c06d390 0x7f307c070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.867+0000 7f307a59c640 1 -- 172.21.15.77:0/4029929738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f307c159c10 msgr2=0x7f307c1552c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T01:39:41.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.867+0000 7f307a59c640 1 --2- 172.21.15.77:0/4029929738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f307c159c10 0x7f307c1552c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.868+0000 7f9e497fa640 1 -- 172.21.15.77:0/954861929 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e38017070 con 0x7f9e44047240 2024-04-25T01:39:41.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.867+0000 7f307a59c640 1 -- 172.21.15.77:0/4029929738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307c1fc130 con 0x7f307c0c23d0 2024-04-25T01:39:41.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.867+0000 7f307a59c640 1 --2- 172.21.15.77:0/4029929738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f307c0c23d0 0x7f307c1fb680 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3074030000 tx=0x7f3074004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:41.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.868+0000 7f30637fe640 1 -- 172.21.15.77:0/4029929738 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3074041020 con 0x7f307c0c23d0 2024-04-25T01:39:41.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.868+0000 7f9e51bae640 1 -- 172.21.15.77:0/954861929 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e44031f60 con 0x7f9e44047240 2024-04-25T01:39:41.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.868+0000 7f9e51bae640 1 -- 172.21.15.77:0/954861929 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e440e2600 con 0x7f9e44047240 2024-04-25T01:39:41.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.869+0000 7f9e497fa640 1 -- 172.21.15.77:0/954861929 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e380052d0 con 0x7f9e44047240 2024-04-25T01:39:41.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.869+0000 7f9e497fa640 1 -- 172.21.15.77:0/954861929 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e380037f0 con 0x7f9e44047240 2024-04-25T01:39:41.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.869+0000 7f30637fe640 1 -- 172.21.15.77:0/4029929738 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f307402f730 con 0x7f307c0c23d0 2024-04-25T01:39:41.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.870+0000 7f30637fe640 1 -- 172.21.15.77:0/4029929738 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3074036040 con 0x7f307c0c23d0 2024-04-25T01:39:41.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.872+0000 7f9e497fa640 1 -- 172.21.15.77:0/954861929 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e3801a070 con 0x7f9e44047240 2024-04-25T01:39:41.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.871+0000 7f308091a640 1 -- 172.21.15.77:0/4029929738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f307c1ec210 con 0x7f307c0c23d0 2024-04-25T01:39:41.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.871+0000 7f308091a640 1 -- 172.21.15.77:0/4029929738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f307c0c53b0 con 0x7f307c0c23d0 2024-04-25T01:39:41.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.872+0000 7f9e497fa640 1 --2- 172.21.15.77:0/954861929 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9e3006bf00 0x7f9e3006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.872+0000 7f9e497fa640 1 -- 172.21.15.77:0/954861929 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f9e3808a3e0 con 0x7f9e44047240 2024-04-25T01:39:41.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.873+0000 7f9e51bae640 1 -- 172.21.15.77:0/954861929 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e2c005290 con 0x7f9e44047240 2024-04-25T01:39:41.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.874+0000 7f308091a640 1 -- 172.21.15.77:0/4029929738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f307c075d10 con 0x7f307c0c23d0 2024-04-25T01:39:41.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.874+0000 7f9e50bac640 1 --2- 172.21.15.77:0/954861929 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9e3006bf00 0x7f9e3006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.874+0000 7f30637fe640 1 -- 172.21.15.77:0/4029929738 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3074044020 con 0x7f307c0c23d0 2024-04-25T01:39:41.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.874+0000 7f9e50bac640 1 --2- 172.21.15.77:0/954861929 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9e3006bf00 0x7f9e3006e3c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c0502b0 tx=0x7f9e4c06af20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:41.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.878+0000 7f9e497fa640 1 -- 172.21.15.77:0/954861929 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9e38058480 con 0x7f9e44047240 2024-04-25T01:39:41.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.876+0000 7f30637fe640 1 --2- 172.21.15.77:0/4029929738 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f306806beb0 0x7f306806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.876+0000 7f30637fe640 1 -- 172.21.15.77:0/4029929738 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f30740ac8e0 con 0x7f307c0c23d0 2024-04-25T01:39:41.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.877+0000 7f307ad9d640 1 --2- 172.21.15.77:0/4029929738 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f306806beb0 0x7f306806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.877+0000 7f307ad9d640 1 --2- 172.21.15.77:0/4029929738 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f306806beb0 0x7f306806e370 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f306c007fd0 tx=0x7f306c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:41.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.884+0000 7f30637fe640 1 -- 172.21.15.77:0/4029929738 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f307407afd0 con 0x7f307c0c23d0 2024-04-25T01:39:41.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.908+0000 7f33efa2c640 1 Processor -- start 2024-04-25T01:39:41.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.909+0000 7f33efa2c640 1 -- start start 2024-04-25T01:39:41.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.910+0000 7f33efa2c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f33e814fa20 0x7f33e80c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.910+0000 7f33efa2c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f33e80c80a0 0x7f33e8152460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.910+0000 7f33efa2c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33e81559b0 con 0x7f33e80c5ba0 2024-04-25T01:39:41.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.910+0000 7f33efa2c640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f33e8155760 con 0x7f33e814fa20 2024-04-25T01:39:41.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.910+0000 7f33efa2c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f33e8155c90 con 0x7f33e80c80a0 2024-04-25T01:39:41.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.910+0000 7f33edfc9640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f33e80c5ba0 0x7f33e81529a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41496/0 (socket says 172.21.15.77:41496) 2024-04-25T01:39:41.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.910+0000 7f33ecfc7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f33e80c80a0 0x7f33e8152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.910+0000 7f33edfc9640 1 -- 172.21.15.77:0/1551193077 learned_addr learned my addr 172.21.15.77:0/1551193077 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:41.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.910+0000 7f33ed7c8640 1 --2- 172.21.15.77:0/1551193077 >> v2:172.21.15.121:3300/0 conn(0x7f33e814fa20 0x7f33e80c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.910+0000 7fdf43f84640 1 Processor -- start 2024-04-25T01:39:41.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.911+0000 7fdf43f84640 1 -- start start 2024-04-25T01:39:41.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.911+0000 7f33dffff640 1 -- 172.21.15.77:0/1551193077 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1410829945 0 0) 0x7f33e81559b0 con 0x7f33e80c5ba0 2024-04-25T01:39:41.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.911+0000 7f33dffff640 1 -- 172.21.15.77:0/1551193077 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33d4003520 con 0x7f33e80c5ba0 2024-04-25T01:39:41.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.911+0000 7f33ecfc7640 1 -- 172.21.15.77:0/1551193077 >> v2:172.21.15.121:3300/0 conn(0x7f33e814fa20 msgr2=0x7f33e80c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:41.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.911+0000 7f33ecfc7640 1 --2- 172.21.15.77:0/1551193077 >> v2:172.21.15.121:3300/0 conn(0x7f33e814fa20 0x7f33e80c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.911+0000 7f33ecfc7640 1 -- 172.21.15.77:0/1551193077 >> v1:172.21.15.77:6789/0 conn(0x7f33e80c5ba0 legacy=0x7f33e81529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:41.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.911+0000 7f33ecfc7640 1 -- 172.21.15.77:0/1551193077 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e8155f70 con 0x7f33e80c80a0 2024-04-25T01:39:41.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.911+0000 7f33ed7c8640 1 --2- 172.21.15.77:0/1551193077 >> v2:172.21.15.121:3300/0 conn(0x7f33e814fa20 0x7f33e80c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:41.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.912+0000 7fdf43f84640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdf34006ed0 0x7fdf34007320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.912+0000 7fdf43f84640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdf340daae0 0x7fdf340daf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.912+0000 7fdf43f84640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf340db490 con 0x7fdf340cda80 2024-04-25T01:39:41.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.912+0000 7fdf43f84640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fdf340cde60 con 0x7fdf340daae0 2024-04-25T01:39:41.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.912+0000 7fdf43f84640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fdf3404ac40 con 0x7fdf34006ed0 2024-04-25T01:39:41.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.912+0000 7fdf41d20640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fdf340cda80 0x7fdf340d79e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41502/0 (socket says 172.21.15.77:41502) 2024-04-25T01:39:41.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.912+0000 7fdf41d20640 1 -- 172.21.15.77:0/2418879812 learned_addr learned my addr 172.21.15.77:0/2418879812 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:41.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.912+0000 7fdf42521640 1 --2- 172.21.15.77:0/2418879812 >> v2:172.21.15.121:3300/0 conn(0x7fdf340daae0 0x7fdf340daf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.912+0000 7fdf4151f640 1 --2- 172.21.15.77:0/2418879812 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdf34006ed0 0x7fdf34007320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.912+0000 7f8a3ffff640 1 Processor -- start 2024-04-25T01:39:41.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.912+0000 7f8a3ffff640 1 -- start start 2024-04-25T01:39:41.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.912+0000 7fdf42521640 1 -- 172.21.15.77:0/2418879812 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdf34006ed0 msgr2=0x7fdf34007320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:41.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.912+0000 7fdf42521640 1 --2- 172.21.15.77:0/2418879812 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdf34006ed0 0x7fdf34007320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.912+0000 7fdf42521640 1 -- 172.21.15.77:0/2418879812 >> v1:172.21.15.77:6789/0 conn(0x7fdf340cda80 legacy=0x7fdf340d79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:41.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.912+0000 7fdf42521640 1 -- 172.21.15.77:0/2418879812 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf3400b6d0 con 0x7fdf340daae0 2024-04-25T01:39:41.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.913+0000 7f33ecfc7640 1 --2- 172.21.15.77:0/1551193077 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f33e80c80a0 0x7f33e8152460 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f33e40097a0 tx=0x7f33e402a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=452fa6ece232936d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:41.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.913+0000 7f33dffff640 1 -- 172.21.15.77:0/1551193077 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e4037070 con 0x7f33e80c80a0 2024-04-25T01:39:41.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.913+0000 7f33dffff640 1 -- 172.21.15.77:0/1551193077 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33e402ae40 con 0x7f33e80c80a0 2024-04-25T01:39:41.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.913+0000 7f33dffff640 1 -- 172.21.15.77:0/1551193077 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e4032640 con 0x7f33e80c80a0 2024-04-25T01:39:41.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.913+0000 7f8a3ffff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8a3803fb00 0x7f8a380479e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.913+0000 7f8a3ffff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8a38047240 0x7f8a380dbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.914+0000 7fdf42521640 1 --2- 172.21.15.77:0/2418879812 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf340daae0 0x7fdf340daf50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c00b850 tx=0x7fdf2c02a600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36b3c5abce1ee321 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:41.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.914+0000 7f8a3ffff640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a38048090 con 0x7f8a380dc230 2024-04-25T01:39:41.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.914+0000 7f8a3effd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8a3803fb00 0x7f8a380479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.914+0000 7f8a3f7fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f8a380dc230 0x7f8a380deb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.77:44834/0 (socket says 172.21.15.77:44834) 2024-04-25T01:39:41.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.914+0000 7f8a3f7fe640 1 -- 172.21.15.77:0/582587782 learned_addr learned my addr 172.21.15.77:0/582587782 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:41.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.914+0000 7fdf40d1e640 1 -- 172.21.15.77:0/2418879812 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c02f710 con 0x7fdf340daae0 2024-04-25T01:39:41.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.914+0000 7f8a3ffff640 1 -- 172.21.15.77:0/582587782 --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f8a38048980 con 0x7f8a3803fb00 2024-04-25T01:39:41.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.914+0000 7f8a3ffff640 1 -- 172.21.15.77:0/582587782 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f8a38047700 con 0x7f8a38047240 2024-04-25T01:39:41.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.914+0000 7fdf40d1e640 1 -- 172.21.15.77:0/2418879812 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf2c02f8b0 con 0x7fdf340daae0 2024-04-25T01:39:41.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.914+0000 7fdf40d1e640 1 -- 172.21.15.77:0/2418879812 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c02fc80 con 0x7fdf340daae0 2024-04-25T01:39:41.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.914+0000 7f33efa2c640 1 -- 172.21.15.77:0/1551193077 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f33e80c80a0 msgr2=0x7f33e8152460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:41.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.914+0000 7f33efa2c640 1 --2- 172.21.15.77:0/1551193077 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f33e80c80a0 0x7f33e8152460 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f33e40097a0 tx=0x7f33e402a0f0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.914+0000 7f8a3e7fc640 1 --2- 172.21.15.77:0/582587782 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8a38047240 0x7f8a380dbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.914+0000 7f8a3dffb640 1 -- 172.21.15.77:0/582587782 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1474303655 0 0) 0x7f8a38048090 con 0x7f8a380dc230 2024-04-25T01:39:41.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.914+0000 7f33efa2c640 1 -- 172.21.15.77:0/1551193077 shutdown_connections 2024-04-25T01:39:41.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.914+0000 7f33efa2c640 1 --2- 172.21.15.77:0/1551193077 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f33e80c80a0 0x7f33e8152460 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.914+0000 7f33efa2c640 1 --2- 172.21.15.77:0/1551193077 >> v2:172.21.15.121:3300/0 conn(0x7f33e814fa20 0x7f33e80c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.914+0000 7f33efa2c640 1 -- 172.21.15.77:0/1551193077 >> 172.21.15.77:0/1551193077 conn(0x7f33e80c7580 msgr2=0x7f33e80c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:41.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.914+0000 7f8a3dffb640 1 -- 172.21.15.77:0/582587782 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a28003520 con 0x7f8a380dc230 2024-04-25T01:39:41.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.914+0000 7f33efa2c640 1 -- 172.21.15.77:0/1551193077 shutdown_connections 2024-04-25T01:39:41.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.915+0000 7fdf43f84640 1 -- 172.21.15.77:0/2418879812 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf340daae0 msgr2=0x7fdf340daf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:41.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.915+0000 7fdf43f84640 1 --2- 172.21.15.77:0/2418879812 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf340daae0 0x7fdf340daf50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c00b850 tx=0x7fdf2c02a600 comp rx=0 tx=0).stop 2024-04-25T01:39:41.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.915+0000 7f33efa2c640 1 -- 172.21.15.77:0/1551193077 wait complete. 2024-04-25T01:39:41.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.915+0000 7fdf43f84640 1 -- 172.21.15.77:0/2418879812 shutdown_connections 2024-04-25T01:39:41.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.915+0000 7fdf43f84640 1 --2- 172.21.15.77:0/2418879812 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf340daae0 0x7fdf340daf50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.916+0000 7f33efa2c640 1 Processor -- start 2024-04-25T01:39:41.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.915+0000 7fdf43f84640 1 --2- 172.21.15.77:0/2418879812 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdf34006ed0 0x7fdf34007320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.915+0000 7fdf43f84640 1 -- 172.21.15.77:0/2418879812 >> 172.21.15.77:0/2418879812 conn(0x7fdf34048280 msgr2=0x7fdf34048690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:41.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.915+0000 7fdf43f84640 1 -- 172.21.15.77:0/2418879812 shutdown_connections 2024-04-25T01:39:41.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.915+0000 7fdf43f84640 1 -- 172.21.15.77:0/2418879812 wait complete. 2024-04-25T01:39:41.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.916+0000 7f33efa2c640 1 -- start start 2024-04-25T01:39:41.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.917+0000 7fdf43f84640 1 Processor -- start 2024-04-25T01:39:41.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.914+0000 7f8a3dffb640 1 -- 172.21.15.77:0/582587782 <== mon.1 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2093878989 0 0) 0x7f8a28003520 con 0x7f8a380dc230 2024-04-25T01:39:41.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.914+0000 7f8a3dffb640 1 -- 172.21.15.77:0/582587782 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8a38047240 msgr2=0x7f8a380dbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:41.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.914+0000 7f8a3dffb640 1 --2- 172.21.15.77:0/582587782 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8a38047240 0x7f8a380dbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.914+0000 7f8a3dffb640 1 -- 172.21.15.77:0/582587782 >> v2:172.21.15.121:3300/0 conn(0x7f8a3803fb00 msgr2=0x7f8a380479e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:41.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.914+0000 7f8a3dffb640 1 --2- 172.21.15.77:0/582587782 >> v2:172.21.15.121:3300/0 conn(0x7f8a3803fb00 0x7f8a380479e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.915+0000 7f8a3dffb640 1 -- 172.21.15.77:0/582587782 --> v1:172.21.15.121:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a38048330 con 0x7f8a380dc230 2024-04-25T01:39:41.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.915+0000 7f8a3dffb640 1 -- 172.21.15.77:0/582587782 <== mon.1 v1:172.21.15.121:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7f8a40075af0 con 0x7f8a380dc230 2024-04-25T01:39:41.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.915+0000 7f8a3dffb640 1 -- 172.21.15.77:0/582587782 >> v1:172.21.15.121:6789/0 conn(0x7f8a380dc230 legacy=0x7f8a380deb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:41.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.915+0000 7f8a3dffb640 1 --2- 172.21.15.77:0/582587782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a280039b0 0x7f8a28003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.915+0000 7f8a3dffb640 1 --2- 172.21.15.77:0/582587782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a28004800 0x7f8a28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.915+0000 7f8a3dffb640 1 --2- 172.21.15.77:0/582587782 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8a28005210 0x7f8a2800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.915+0000 7f8a3dffb640 1 -- 172.21.15.77:0/582587782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8a38048980 con 0x7f8a28004800 2024-04-25T01:39:41.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.915+0000 7f8a3dffb640 1 -- 172.21.15.77:0/582587782 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8a38047700 con 0x7f8a280039b0 2024-04-25T01:39:41.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.915+0000 7f8a3dffb640 1 -- 172.21.15.77:0/582587782 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f8a2801d180 con 0x7f8a28005210 2024-04-25T01:39:41.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.915+0000 7f8a3e7fc640 1 --2- 172.21.15.77:0/582587782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a28004800 0x7f8a28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.915+0000 7f8a3e7fc640 1 -- 172.21.15.77:0/582587782 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8a28005210 msgr2=0x7f8a2800b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T01:39:41.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.915+0000 7f8a3e7fc640 1 --2- 172.21.15.77:0/582587782 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8a28005210 0x7f8a2800b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.915+0000 7f8a3e7fc640 1 -- 172.21.15.77:0/582587782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a280039b0 msgr2=0x7f8a28003dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T01:39:41.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.915+0000 7f8a3e7fc640 1 --2- 172.21.15.77:0/582587782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a280039b0 0x7f8a28003dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.915+0000 7f8a3e7fc640 1 -- 172.21.15.77:0/582587782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a38048330 con 0x7f8a28004800 2024-04-25T01:39:41.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.917+0000 7f8a3e7fc640 1 --2- 172.21.15.77:0/582587782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a28004800 0x7f8a28004c80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8a3800df10 tx=0x7f8a28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb5f0dc5adbd9c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:41.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.917+0000 7f8a3dffb640 1 -- 172.21.15.77:0/582587782 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a34030070 con 0x7f8a28004800 2024-04-25T01:39:41.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.917+0000 7f8a3dffb640 1 -- 172.21.15.77:0/582587782 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a34034400 con 0x7f8a28004800 2024-04-25T01:39:41.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.917+0000 7f8a3dffb640 1 -- 172.21.15.77:0/582587782 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a34030070 con 0x7f8a28004800 2024-04-25T01:39:41.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.917+0000 7fdf43f84640 1 -- start start 2024-04-25T01:39:41.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.918+0000 7f33efa2c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e80c5ba0 0x7f33e814cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.918+0000 7f33ed7c8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e80c5ba0 0x7f33e814cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.918+0000 7f33ed7c8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e80c5ba0 0x7f33e814cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46938/0 (socket says 172.21.15.77:46938) 2024-04-25T01:39:41.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.918+0000 7f8a3ffff640 1 -- 172.21.15.77:0/582587782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a28004800 msgr2=0x7f8a28004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:41.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.918+0000 7f33ed7c8640 1 -- 172.21.15.77:0/3149228987 learned_addr learned my addr 172.21.15.77:0/3149228987 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:41.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.918+0000 7fdf43f84640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdf34006ed0 0x7fdf340d8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.918+0000 7f33efa2c640 1 --2- 172.21.15.77:0/3149228987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33e80c80a0 0x7f33e80bf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.918+0000 7fdf43f84640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf340cda80 0x7fdf34175280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.918+0000 7f8a3ffff640 1 --2- 172.21.15.77:0/582587782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a28004800 0x7f8a28004c80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8a3800df10 tx=0x7f8a28005830 comp rx=0 tx=0).stop 2024-04-25T01:39:41.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.918+0000 7f33efa2c640 1 --2- 172.21.15.77:0/3149228987 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f33e814fa20 0x7f33e80bf810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.918+0000 7fdf43f84640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf340daae0 0x7fdf340d5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.918+0000 7f33efa2c640 1 -- 172.21.15.77:0/3149228987 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f33e81530b0 con 0x7f33e80c5ba0 2024-04-25T01:39:41.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.918+0000 7f33efa2c640 1 -- 172.21.15.77:0/3149228987 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f33e8156530 con 0x7f33e80c80a0 2024-04-25T01:39:41.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.918+0000 7f8a3f7fe640 1 -- 172.21.15.77:0/582587782 reap_dead start 2024-04-25T01:39:41.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.918+0000 7f33ecfc7640 1 --2- 172.21.15.77:0/3149228987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33e80c80a0 0x7f33e80bf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.918+0000 7fdf4151f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf340cda80 0x7fdf34175280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.918+0000 7fdf4151f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf340cda80 0x7fdf34175280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46952/0 (socket says 172.21.15.77:46952) 2024-04-25T01:39:41.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.918+0000 7ff5cb0b4640 1 Processor -- start 2024-04-25T01:39:41.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.919+0000 7ff5cb0b4640 1 -- start start 2024-04-25T01:39:41.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.919+0000 7fdf4151f640 1 -- 172.21.15.77:0/780055335 learned_addr learned my addr 172.21.15.77:0/780055335 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:41.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.919+0000 7f8a3ffff640 1 -- 172.21.15.77:0/582587782 shutdown_connections 2024-04-25T01:39:41.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.919+0000 7f8a3ffff640 1 -- 172.21.15.77:0/582587782 >> 172.21.15.77:0/582587782 conn(0x7f8a38049340 msgr2=0x7f8a38049750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:41.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.919+0000 7fdf43f84640 1 -- 172.21.15.77:0/780055335 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3404b4c0 con 0x7fdf340cda80 2024-04-25T01:39:41.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.919+0000 7fdf43f84640 1 -- 172.21.15.77:0/780055335 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3404b1e0 con 0x7fdf340daae0 2024-04-25T01:39:41.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.919+0000 7fdf43f84640 1 -- 172.21.15.77:0/780055335 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fdf340da5c0 con 0x7fdf34006ed0 2024-04-25T01:39:41.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.919+0000 7f33edfc9640 1 --2- 172.21.15.77:0/3149228987 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f33e814fa20 0x7f33e80bf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.919+0000 7f8a3ffff640 1 -- 172.21.15.77:0/582587782 shutdown_connections 2024-04-25T01:39:41.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.919+0000 7f8a3ffff640 1 -- 172.21.15.77:0/582587782 wait complete. 2024-04-25T01:39:41.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.919+0000 7f33efa2c640 1 -- 172.21.15.77:0/3149228987 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f33e80c29b0 con 0x7f33e814fa20 2024-04-25T01:39:41.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.919+0000 7fdf41d20640 1 --2- 172.21.15.77:0/780055335 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdf34006ed0 0x7fdf340d8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.919+0000 7fdf4151f640 1 -- 172.21.15.77:0/780055335 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdf34006ed0 msgr2=0x7fdf340d8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:41.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.919+0000 7fdf4151f640 1 --2- 172.21.15.77:0/780055335 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdf34006ed0 0x7fdf340d8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.919+0000 7fdf4151f640 1 -- 172.21.15.77:0/780055335 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf340daae0 msgr2=0x7fdf340d5b90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T01:39:41.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.919+0000 7fdf4151f640 1 --2- 172.21.15.77:0/780055335 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf340daae0 0x7fdf340d5b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.919+0000 7fdf4151f640 1 -- 172.21.15.77:0/780055335 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf34166250 con 0x7fdf340cda80 2024-04-25T01:39:41.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.919+0000 7fdf4151f640 1 --2- 172.21.15.77:0/780055335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf340cda80 0x7fdf34175280 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdf3800bed0 tx=0x7fdf3800f480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:41.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.920+0000 7f33ed7c8640 1 -- 172.21.15.77:0/3149228987 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f33e814fa20 msgr2=0x7f33e80bf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:41.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.920+0000 7f33ed7c8640 1 --2- 172.21.15.77:0/3149228987 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f33e814fa20 0x7f33e80bf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.920+0000 7f33ed7c8640 1 -- 172.21.15.77:0/3149228987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33e80c80a0 msgr2=0x7f33e80bf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:41.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.920+0000 7f33ed7c8640 1 --2- 172.21.15.77:0/3149228987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33e80c80a0 0x7f33e80bf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.920+0000 7f33ed7c8640 1 -- 172.21.15.77:0/3149228987 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e81f4350 con 0x7f33e80c5ba0 2024-04-25T01:39:41.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.920+0000 7f33edfc9640 1 --2- 172.21.15.77:0/3149228987 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f33e814fa20 0x7f33e80bf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:41.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.920+0000 7ff5cb0b4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff5bc04a9e0 0x7ff5bc007bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.920+0000 7ff5cb0b4640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5bc047240 0x7ff5bc04adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.920+0000 7fdf327fc640 1 -- 172.21.15.77:0/780055335 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3801b070 con 0x7fdf340cda80 2024-04-25T01:39:41.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.921+0000 7f8a3ffff640 1 Processor -- start 2024-04-25T01:39:41.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.921+0000 7f8a3ffff640 1 -- start start 2024-04-25T01:39:41.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.920+0000 7f33ed7c8640 1 --2- 172.21.15.77:0/3149228987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e80c5ba0 0x7f33e814cd90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f33e000c370 tx=0x7f33e000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:41.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.920+0000 7ff5cb0b4640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5bc04a250 con 0x7ff5bc0db000 2024-04-25T01:39:41.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.920+0000 7ff5cb0b4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff5bc04ba30 con 0x7ff5bc04a9e0 2024-04-25T01:39:41.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.920+0000 7ff5cb0b4640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff5bc04c5d0 con 0x7ff5bc047240 2024-04-25T01:39:41.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.920+0000 7ff5ca8b3640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ff5bc0db000 0x7ff5bc04bec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.77:44844/0 (socket says 172.21.15.77:44844) 2024-04-25T01:39:41.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.920+0000 7ff5ca8b3640 1 -- 172.21.15.77:0/2061880161 learned_addr learned my addr 172.21.15.77:0/2061880161 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:41.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.920+0000 7ff5c98b1640 1 --2- 172.21.15.77:0/2061880161 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5bc047240 0x7ff5bc04adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.920+0000 7ff5c98b1640 1 -- 172.21.15.77:0/2061880161 >> v2:172.21.15.77:3300/0 conn(0x7ff5bc04a9e0 msgr2=0x7ff5bc007bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T01:39:41.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.920+0000 7ff5c98b1640 1 --2- 172.21.15.77:0/2061880161 >> v2:172.21.15.77:3300/0 conn(0x7ff5bc04a9e0 0x7ff5bc007bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.920+0000 7ff5c98b1640 1 -- 172.21.15.77:0/2061880161 >> v1:172.21.15.121:6789/0 conn(0x7ff5bc0db000 legacy=0x7ff5bc04bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:41.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.921+0000 7ff5c98b1640 1 -- 172.21.15.77:0/2061880161 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5bc0476d0 con 0x7ff5bc047240 2024-04-25T01:39:41.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.920+0000 7fdf43f84640 1 -- 172.21.15.77:0/780055335 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf34166530 con 0x7fdf340cda80 2024-04-25T01:39:41.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.920+0000 7fdf43f84640 1 -- 172.21.15.77:0/780055335 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf34167920 con 0x7fdf340cda80 2024-04-25T01:39:41.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.920+0000 7fdf327fc640 1 -- 172.21.15.77:0/780055335 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf3800fd90 con 0x7fdf340cda80 2024-04-25T01:39:41.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.921+0000 7fdf327fc640 1 -- 172.21.15.77:0/780055335 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3800dd70 con 0x7fdf340cda80 2024-04-25T01:39:41.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.920+0000 7f6710a7b640 1 Processor -- start 2024-04-25T01:39:41.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.920+0000 7f6710a7b640 1 -- start start 2024-04-25T01:39:41.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.921+0000 7f6710a7b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f670c163910 0x7f670c0acba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.921+0000 7f6710a7b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f670c0c5690 0x7f670c0c3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.921+0000 7f6710a7b640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f670c06ea40 con 0x7f670c0c1f80 2024-04-25T01:39:41.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.921+0000 7f6710a7b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f670c0ad0e0 con 0x7f670c0c5690 2024-04-25T01:39:41.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.921+0000 7f6710a7b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f670c162e30 con 0x7f670c163910 2024-04-25T01:39:41.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.921+0000 7f670a59c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f670c0c1f80 0x7f670c06e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.77:44860/0 (socket says 172.21.15.77:44860) 2024-04-25T01:39:41.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.922+0000 7f670a59c640 1 -- 172.21.15.77:0/1659257539 learned_addr learned my addr 172.21.15.77:0/1659257539 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:41.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.922+0000 7f6709d9b640 1 --2- 172.21.15.77:0/1659257539 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f670c163910 0x7f670c0acba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.922+0000 7f670ad9d640 1 --2- 172.21.15.77:0/1659257539 >> v2:172.21.15.77:3300/0 conn(0x7f670c0c5690 0x7f670c0c3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.922+0000 7f6709d9b640 1 -- 172.21.15.77:0/1659257539 >> v2:172.21.15.77:3300/0 conn(0x7f670c0c5690 msgr2=0x7f670c0c3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:41.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.922+0000 7f670959a640 1 -- 172.21.15.77:0/1659257539 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1869560533 0 0) 0x7f670c06ea40 con 0x7f670c0c1f80 2024-04-25T01:39:41.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.922+0000 7f33ddffb640 1 -- 172.21.15.77:0/3149228987 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e0018020 con 0x7f33e80c5ba0 2024-04-25T01:39:41.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.922+0000 7f33efa2c640 1 -- 172.21.15.77:0/3149228987 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33e81f4070 con 0x7f33e80c5ba0 2024-04-25T01:39:41.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.922+0000 7f33efa2c640 1 -- 172.21.15.77:0/3149228987 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33e80c03f0 con 0x7f33e80c5ba0 2024-04-25T01:39:41.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.922+0000 7f6709d9b640 1 --2- 172.21.15.77:0/1659257539 >> v2:172.21.15.77:3300/0 conn(0x7f670c0c5690 0x7f670c0c3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.922+0000 7f6709d9b640 1 -- 172.21.15.77:0/1659257539 >> v1:172.21.15.121:6789/0 conn(0x7f670c0c1f80 legacy=0x7f670c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:41.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.922+0000 7f6709d9b640 1 -- 172.21.15.77:0/1659257539 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f670c163110 con 0x7f670c163910 2024-04-25T01:39:41.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.923+0000 7f670ad9d640 1 --2- 172.21.15.77:0/1659257539 >> v2:172.21.15.77:3300/0 conn(0x7f670c0c5690 0x7f670c0c3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:41.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.923+0000 7ff5c98b1640 1 --2- 172.21.15.77:0/2061880161 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5bc047240 0x7ff5bc04adc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff5b40097a0 tx=0x7ff5b402a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48455e72e36376f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:41.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.923+0000 7f8a3ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a28004800 0x7f8a380ddf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.923+0000 7f8a3effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a28004800 0x7f8a380ddf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.923+0000 7f8a3effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a28004800 0x7f8a380ddf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46974/0 (socket says 172.21.15.77:46974) 2024-04-25T01:39:41.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.923+0000 7f33ddffb640 1 -- 172.21.15.77:0/3149228987 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33e0014680 con 0x7f33e80c5ba0 2024-04-25T01:39:41.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.923+0000 7f33ddffb640 1 -- 172.21.15.77:0/3149228987 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e0014a30 con 0x7f33e80c5ba0 2024-04-25T01:39:41.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.923+0000 7ff5c90b0640 1 -- 172.21.15.77:0/2061880161 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4037070 con 0x7ff5bc047240 2024-04-25T01:39:41.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.923+0000 7ff5c90b0640 1 -- 172.21.15.77:0/2061880161 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5b402ac90 con 0x7ff5bc047240 2024-04-25T01:39:41.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.923+0000 7ff5c90b0640 1 -- 172.21.15.77:0/2061880161 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4037070 con 0x7ff5bc047240 2024-04-25T01:39:41.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.923+0000 7fdf43f84640 1 -- 172.21.15.77:0/780055335 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf24005290 con 0x7fdf340cda80 2024-04-25T01:39:41.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.923+0000 7f8a3effd640 1 -- 172.21.15.77:0/4181093047 learned_addr learned my addr 172.21.15.77:0/4181093047 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:41.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.923+0000 7f8a3ffff640 1 --2- 172.21.15.77:0/4181093047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a38032000 0x7f8a380307d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.923+0000 7f8a3ffff640 1 --2- 172.21.15.77:0/4181093047 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8a380420c0 0x7f8a38030d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.923+0000 7f8a3e7fc640 1 --2- 172.21.15.77:0/4181093047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a38032000 0x7f8a380307d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.923+0000 7f8a3f7fe640 1 --2- 172.21.15.77:0/4181093047 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8a380420c0 0x7f8a38030d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.924+0000 7f8a3ffff640 1 -- 172.21.15.77:0/4181093047 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3804a200 con 0x7f8a28004800 2024-04-25T01:39:41.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.924+0000 7f8a3ffff640 1 -- 172.21.15.77:0/4181093047 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3804a080 con 0x7f8a38032000 2024-04-25T01:39:41.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.924+0000 7f8a3ffff640 1 -- 172.21.15.77:0/4181093047 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f8a3803fee0 con 0x7f8a380420c0 2024-04-25T01:39:41.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.924+0000 7ff5cb0b4640 1 -- 172.21.15.77:0/2061880161 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5bc047240 msgr2=0x7ff5bc04adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:41.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.924+0000 7ff5cb0b4640 1 --2- 172.21.15.77:0/2061880161 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5bc047240 0x7ff5bc04adc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff5b40097a0 tx=0x7ff5b402a000 comp rx=0 tx=0).stop 2024-04-25T01:39:41.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.924+0000 7ff5cb0b4640 1 -- 172.21.15.77:0/2061880161 shutdown_connections 2024-04-25T01:39:41.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.924+0000 7ff5cb0b4640 1 --2- 172.21.15.77:0/2061880161 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5bc047240 0x7ff5bc04adc0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.924+0000 7ff5cb0b4640 1 --2- 172.21.15.77:0/2061880161 >> v2:172.21.15.77:3300/0 conn(0x7ff5bc04a9e0 0x7ff5bc007bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.924+0000 7ff5cb0b4640 1 -- 172.21.15.77:0/2061880161 >> 172.21.15.77:0/2061880161 conn(0x7ff5bc049340 msgr2=0x7ff5bc049750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:41.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.924+0000 7f6709d9b640 1 --2- 172.21.15.77:0/1659257539 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f670c163910 0x7f670c0acba0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6704009d90 tx=0x7f670402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebb40481c05b55d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:41.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.924+0000 7ff5cb0b4640 1 -- 172.21.15.77:0/2061880161 shutdown_connections 2024-04-25T01:39:41.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.924+0000 7ff5cb0b4640 1 -- 172.21.15.77:0/2061880161 wait complete. 2024-04-25T01:39:41.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.924+0000 7f33efa2c640 1 -- 172.21.15.77:0/3149228987 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33c8005290 con 0x7f33e80c5ba0 2024-04-25T01:39:41.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.924+0000 7f8a3effd640 1 -- 172.21.15.77:0/4181093047 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8a380420c0 msgr2=0x7f8a38030d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:41.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.924+0000 7f8a3effd640 1 --2- 172.21.15.77:0/4181093047 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8a380420c0 0x7f8a38030d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.924+0000 7f8a3effd640 1 -- 172.21.15.77:0/4181093047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a38032000 msgr2=0x7f8a380307d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:41.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.924+0000 7f8a3effd640 1 --2- 172.21.15.77:0/4181093047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a38032000 0x7f8a380307d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.924+0000 7f8a3effd640 1 -- 172.21.15.77:0/4181093047 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a380d2910 con 0x7f8a28004800 2024-04-25T01:39:41.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.925+0000 7f8a3effd640 1 --2- 172.21.15.77:0/4181093047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a28004800 0x7f8a380ddf50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8a3000c850 tx=0x7f8a3000cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:41.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.925+0000 7f8a27fff640 1 -- 172.21.15.77:0/4181093047 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a30015070 con 0x7f8a28004800 2024-04-25T01:39:41.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.925+0000 7f8a27fff640 1 -- 172.21.15.77:0/4181093047 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a30004220 con 0x7f8a28004800 2024-04-25T01:39:41.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.925+0000 7f8a3ffff640 1 -- 172.21.15.77:0/4181093047 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a3802f770 con 0x7f8a28004800 2024-04-25T01:39:41.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.926+0000 7f8a3ffff640 1 -- 172.21.15.77:0/4181093047 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a3802fcf0 con 0x7f8a28004800 2024-04-25T01:39:41.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.926+0000 7f8a27fff640 1 -- 172.21.15.77:0/4181093047 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a30007620 con 0x7f8a28004800 2024-04-25T01:39:41.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.925+0000 7f670959a640 1 -- 172.21.15.77:0/1659257539 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6704007740 con 0x7f670c163910 2024-04-25T01:39:41.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.925+0000 7f670959a640 1 -- 172.21.15.77:0/1659257539 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67040078e0 con 0x7f670c163910 2024-04-25T01:39:41.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.926+0000 7ff5cb0b4640 1 Processor -- start 2024-04-25T01:39:41.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.925+0000 7f670959a640 1 -- 172.21.15.77:0/1659257539 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6704007cb0 con 0x7f670c163910 2024-04-25T01:39:41.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.926+0000 7f6710a7b640 1 -- 172.21.15.77:0/1659257539 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f670c163910 msgr2=0x7f670c0acba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:41.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.926+0000 7f6710a7b640 1 --2- 172.21.15.77:0/1659257539 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f670c163910 0x7f670c0acba0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6704009d90 tx=0x7f670402a660 comp rx=0 tx=0).stop 2024-04-25T01:39:41.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.926+0000 7f6710a7b640 1 -- 172.21.15.77:0/1659257539 shutdown_connections 2024-04-25T01:39:41.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.926+0000 7f6710a7b640 1 --2- 172.21.15.77:0/1659257539 >> v2:172.21.15.77:3300/0 conn(0x7f670c0c5690 0x7f670c0c3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.925+0000 7f33ddffb640 1 -- 172.21.15.77:0/3149228987 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f33e0005d10 con 0x7f33e80c5ba0 2024-04-25T01:39:41.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.926+0000 7f33ddffb640 1 --2- 172.21.15.77:0/3149228987 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f33cc06be30 0x7f33cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.926+0000 7f33ddffb640 1 -- 172.21.15.77:0/3149228987 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f33e008c050 con 0x7f33e80c5ba0 2024-04-25T01:39:41.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.926+0000 7f6710a7b640 1 --2- 172.21.15.77:0/1659257539 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f670c163910 0x7f670c0acba0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.926+0000 7f6710a7b640 1 -- 172.21.15.77:0/1659257539 >> 172.21.15.77:0/1659257539 conn(0x7f670c0c7580 msgr2=0x7f670c0c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:41.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.926+0000 7ff5cb0b4640 1 -- start start 2024-04-25T01:39:41.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.927+0000 7fdf327fc640 1 -- 172.21.15.77:0/780055335 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdf3801e070 con 0x7fdf340cda80 2024-04-25T01:39:41.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.927+0000 7f33ecfc7640 1 --2- 172.21.15.77:0/3149228987 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f33cc06be30 0x7f33cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.927+0000 7ff5cb0b4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5bc04a9e0 0x7ff5bc0d3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.927+0000 7fdf327fc640 1 --2- 172.21.15.77:0/780055335 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fdf2006bf00 0x7fdf2006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.928+0000 7ff5cb0b4640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5bc0db000 0x7ff5bc00bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.928+0000 7ff5cb0b4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5bc0d0900 0x7ff5bc0d8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.928+0000 7fdf327fc640 1 -- 172.21.15.77:0/780055335 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fdf3808a750 con 0x7fdf340cda80 2024-04-25T01:39:41.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.928+0000 7ff5cb0b4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc0db490 con 0x7ff5bc04a9e0 2024-04-25T01:39:41.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.928+0000 7ff5cb0b4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc04b6c0 con 0x7ff5bc0d0900 2024-04-25T01:39:41.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.928+0000 7ff5cb0b4640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff5bc047c90 con 0x7ff5bc0db000 2024-04-25T01:39:41.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.928+0000 7f33ecfc7640 1 --2- 172.21.15.77:0/3149228987 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f33cc06be30 0x7f33cc06e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f33e4034000 tx=0x7f33e402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:41.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.927+0000 7f8a25ffb640 1 -- 172.21.15.77:0/4181093047 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a380057e0 con 0x7f8a28004800 2024-04-25T01:39:41.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.927+0000 7fb21d3ce640 1 Processor -- start 2024-04-25T01:39:41.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.928+0000 7fb21d3ce640 1 -- start start 2024-04-25T01:39:41.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.928+0000 7fdf41d20640 1 --2- 172.21.15.77:0/780055335 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fdf2006bf00 0x7fdf2006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.926+0000 7f6710a7b640 1 -- 172.21.15.77:0/1659257539 shutdown_connections 2024-04-25T01:39:41.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.926+0000 7f6710a7b640 1 -- 172.21.15.77:0/1659257539 wait complete. 2024-04-25T01:39:41.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.928+0000 7ff5ca0b2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5bc04a9e0 0x7ff5bc0d3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.928+0000 7ff5ca8b3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5bc0d0900 0x7ff5bc0d8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.928+0000 7f6710a7b640 1 Processor -- start 2024-04-25T01:39:41.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.928+0000 7ff5c98b1640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5bc0db000 0x7ff5bc00bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.928+0000 7ff5c98b1640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5bc0db000 0x7ff5bc00bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.77:52464/0 (socket says 172.21.15.77:52464) 2024-04-25T01:39:41.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.928+0000 7ff5c98b1640 1 -- 172.21.15.77:0/2245993344 learned_addr learned my addr 172.21.15.77:0/2245993344 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:41.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.928+0000 7f6710a7b640 1 -- start start 2024-04-25T01:39:41.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7ff5ca8b3640 1 -- 172.21.15.77:0/2245993344 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5bc0db000 msgr2=0x7ff5bc00bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:41.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7ff5ca8b3640 1 --2- 172.21.15.77:0/2245993344 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5bc0db000 0x7ff5bc00bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7ff5ca8b3640 1 -- 172.21.15.77:0/2245993344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5bc04a9e0 msgr2=0x7ff5bc0d3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:41.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7ff5ca8b3640 1 --2- 172.21.15.77:0/2245993344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5bc04a9e0 0x7ff5bc0d3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7ff5ca8b3640 1 -- 172.21.15.77:0/2245993344 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5bc0d4110 con 0x7ff5bc0d0900 2024-04-25T01:39:41.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7ff5c98b1640 1 --2- 172.21.15.77:0/2245993344 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5bc0db000 0x7ff5bc00bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:41.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7fdf41d20640 1 --2- 172.21.15.77:0/780055335 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fdf2006bf00 0x7fdf2006e3c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c050ce0 tx=0x7fdf3c076b60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:41.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7ff5ca8b3640 1 --2- 172.21.15.77:0/2245993344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5bc0d0900 0x7ff5bc0d8990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4000b60 tx=0x7ff5c4073da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:41.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7f6710a7b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f670c0c1f80 0x7f670c165e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7f6710a7b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f670c0c5690 0x7f670c15e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7f6710a7b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f670c163910 0x7f670c15e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7fb21d3ce640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb21806e5a0 0x7fb2180c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7fb21d3ce640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb2180c1f80 0x7fb21815da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7fb21d3ce640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb21815e290 con 0x7fb21815ad40 2024-04-25T01:39:41.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7fb21d3ce640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fb21815a8b0 con 0x7fb2180c1f80 2024-04-25T01:39:41.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7fb21d3ce640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb21815e570 con 0x7fb21806e5a0 2024-04-25T01:39:41.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7f6710a7b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f670c0c5ae0 con 0x7f670c163910 2024-04-25T01:39:41.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7f6710a7b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f670c1670e0 con 0x7f670c0c5690 2024-04-25T01:39:41.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7f6710a7b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f670c0c5c60 con 0x7f670c0c1f80 2024-04-25T01:39:41.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7f670a59c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f670c0c1f80 0x7f670c165e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7f670a59c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f670c0c1f80 0x7f670c165e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.77:52468/0 (socket says 172.21.15.77:52468) 2024-04-25T01:39:41.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7f670a59c640 1 -- 172.21.15.77:0/1044395828 learned_addr learned my addr 172.21.15.77:0/1044395828 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:41.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7f670ad9d640 1 --2- 172.21.15.77:0/1044395828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f670c163910 0x7f670c15e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7ff5baffd640 1 -- 172.21.15.77:0/2245993344 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4073ed0 con 0x7ff5bc0d0900 2024-04-25T01:39:41.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7f6709d9b640 1 --2- 172.21.15.77:0/1044395828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f670c0c5690 0x7f670c15e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7ff5baffd640 1 -- 172.21.15.77:0/2245993344 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5c4095390 con 0x7ff5bc0d0900 2024-04-25T01:39:41.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7ff5baffd640 1 -- 172.21.15.77:0/2245993344 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c40955c0 con 0x7ff5bc0d0900 2024-04-25T01:39:41.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7ff5cb0b4640 1 -- 172.21.15.77:0/2245993344 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5bc0d2460 con 0x7ff5bc0d0900 2024-04-25T01:39:41.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.930+0000 7ff5cb0b4640 1 -- 172.21.15.77:0/2245993344 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5bc0d2a20 con 0x7ff5bc0d0900 2024-04-25T01:39:41.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.930+0000 7f670a59c640 1 -- 172.21.15.77:0/1044395828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f670c0c5690 msgr2=0x7f670c15e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:41.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.930+0000 7f670a59c640 1 --2- 172.21.15.77:0/1044395828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f670c0c5690 0x7f670c15e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.930+0000 7f670a59c640 1 -- 172.21.15.77:0/1044395828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f670c163910 msgr2=0x7f670c15e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:41.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.930+0000 7f670a59c640 1 --2- 172.21.15.77:0/1044395828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f670c163910 0x7f670c15e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.930+0000 7f670a59c640 1 -- 172.21.15.77:0/1044395828 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f670c15dbd0 con 0x7f670c0c1f80 2024-04-25T01:39:41.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7fb2167fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb2180c1f80 0x7fb21815da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7fb2167fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb2180c1f80 0x7fb21815da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:52450/0 (socket says 172.21.15.77:52450) 2024-04-25T01:39:41.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7fb2167fc640 1 -- 172.21.15.77:0/3974132418 learned_addr learned my addr 172.21.15.77:0/3974132418 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:41.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7fb216ffd640 1 --2- 172.21.15.77:0/3974132418 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb21806e5a0 0x7fb2180c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.929+0000 7fb2177fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb21815ad40 0x7fb2180c4240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41512/0 (socket says 172.21.15.77:41512) 2024-04-25T01:39:41.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.930+0000 7fb2167fc640 1 -- 172.21.15.77:0/3974132418 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb21806e5a0 msgr2=0x7fb2180c5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:41.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.930+0000 7fb2167fc640 1 --2- 172.21.15.77:0/3974132418 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb21806e5a0 0x7fb2180c5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.930+0000 7fb2167fc640 1 -- 172.21.15.77:0/3974132418 >> v1:172.21.15.77:6789/0 conn(0x7fb21815ad40 legacy=0x7fb2180c4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:41.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.930+0000 7fb2167fc640 1 -- 172.21.15.77:0/3974132418 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21815e850 con 0x7fb2180c1f80 2024-04-25T01:39:41.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.930+0000 7f670a59c640 1 --2- 172.21.15.77:0/1044395828 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f670c0c1f80 0x7f670c165e00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f66fc00c4a0 tx=0x7f66fc00c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:41.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.931+0000 7fb2167fc640 1 --2- 172.21.15.77:0/3974132418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2180c1f80 0x7fb21815da60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009870 tx=0x7fb20c02a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0e3cec334ab5698 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:41.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.931+0000 7ff5cb0b4640 1 -- 172.21.15.77:0/2245993344 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5bc0057e0 con 0x7ff5bc0d0900 2024-04-25T01:39:41.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.931+0000 7fb215ffb640 1 -- 172.21.15.77:0/3974132418 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c037070 con 0x7fb2180c1f80 2024-04-25T01:39:41.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.931+0000 7f66faffd640 1 -- 172.21.15.77:0/1044395828 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66fc018070 con 0x7f670c0c1f80 2024-04-25T01:39:41.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.931+0000 7fb215ffb640 1 -- 172.21.15.77:0/3974132418 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb20c032440 con 0x7fb2180c1f80 2024-04-25T01:39:41.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.931+0000 7f66faffd640 1 -- 172.21.15.77:0/1044395828 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66fc0074e0 con 0x7f670c0c1f80 2024-04-25T01:39:41.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.931+0000 7f66faffd640 1 -- 172.21.15.77:0/1044395828 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66fc004a20 con 0x7f670c0c1f80 2024-04-25T01:39:41.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.931+0000 7f6710a7b640 1 -- 172.21.15.77:0/1044395828 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f670c07e630 con 0x7f670c0c1f80 2024-04-25T01:39:41.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.931+0000 7f6710a7b640 1 -- 172.21.15.77:0/1044395828 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f670c07ebf0 con 0x7f670c0c1f80 2024-04-25T01:39:41.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.932+0000 7ff5baffd640 1 -- 172.21.15.77:0/2245993344 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff5c4095760 con 0x7ff5bc0d0900 2024-04-25T01:39:41.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.931+0000 7fb215ffb640 1 -- 172.21.15.77:0/3974132418 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c037070 con 0x7fb2180c1f80 2024-04-25T01:39:41.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.932+0000 7fb21d3ce640 1 -- 172.21.15.77:0/3974132418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2180c1f80 msgr2=0x7fb21815da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:41.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.932+0000 7fb21d3ce640 1 --2- 172.21.15.77:0/3974132418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2180c1f80 0x7fb21815da60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009870 tx=0x7fb20c02a210 comp rx=0 tx=0).stop 2024-04-25T01:39:41.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.932+0000 7fb21d3ce640 1 -- 172.21.15.77:0/3974132418 shutdown_connections 2024-04-25T01:39:41.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.932+0000 7fb21d3ce640 1 --2- 172.21.15.77:0/3974132418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2180c1f80 0x7fb21815da60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.932+0000 7fb21d3ce640 1 --2- 172.21.15.77:0/3974132418 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb21806e5a0 0x7fb2180c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.932+0000 7fb21d3ce640 1 -- 172.21.15.77:0/3974132418 >> 172.21.15.77:0/3974132418 conn(0x7fb2180c7580 msgr2=0x7fb2180c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:41.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.932+0000 7fb21d3ce640 1 -- 172.21.15.77:0/3974132418 shutdown_connections 2024-04-25T01:39:41.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.932+0000 7f6710a7b640 1 -- 172.21.15.77:0/1044395828 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f670c04f500 con 0x7f670c0c1f80 2024-04-25T01:39:41.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.932+0000 7ff5baffd640 1 --2- 172.21.15.77:0/2245993344 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff5a806be80 0x7ff5a806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.932+0000 7fb21d3ce640 1 -- 172.21.15.77:0/3974132418 wait complete. 2024-04-25T01:39:41.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.932+0000 7ff5baffd640 1 -- 172.21.15.77:0/2245993344 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7ff5c404fa70 con 0x7ff5bc0d0900 2024-04-25T01:39:41.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.932+0000 7ff5ca0b2640 1 --2- 172.21.15.77:0/2245993344 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff5a806be80 0x7ff5a806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.933+0000 7ff5ca0b2640 1 --2- 172.21.15.77:0/2245993344 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff5a806be80 0x7ff5a806e340 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0006fd0 tx=0x7ff5c0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:41.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.933+0000 7f33ddffb640 1 -- 172.21.15.77:0/3149228987 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f33e0022030 con 0x7f33e80c5ba0 2024-04-25T01:39:41.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.934+0000 7f66faffd640 1 -- 172.21.15.77:0/1044395828 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f66fc01b070 con 0x7f670c0c1f80 2024-04-25T01:39:41.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.934+0000 7f66faffd640 1 --2- 172.21.15.77:0/1044395828 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f66ec06be80 0x7f66ec06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.934+0000 7f66faffd640 1 -- 172.21.15.77:0/1044395828 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f66fc08abf0 con 0x7f670c0c1f80 2024-04-25T01:39:41.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.934+0000 7fb21d3ce640 1 Processor -- start 2024-04-25T01:39:41.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.934+0000 7fb21d3ce640 1 -- start start 2024-04-25T01:39:41.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.935+0000 7f8a27fff640 1 -- 172.21.15.77:0/4181093047 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a300077c0 con 0x7f8a28004800 2024-04-25T01:39:41.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.936+0000 7f8a27fff640 1 --2- 172.21.15.77:0/4181093047 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f8a2c06be80 0x7f8a2c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.936+0000 7fb21d3ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb21806e5a0 0x7fb2181f3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.935+0000 7f6709d9b640 1 --2- 172.21.15.77:0/1044395828 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f66ec06be80 0x7f66ec06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.936+0000 7fb21d3ce640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb2180c1f80 0x7fb2181f3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.936+0000 7fb21d3ce640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb21815ad40 0x7fb218153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.936+0000 7fb21d3ce640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb21806e980 con 0x7fb21806e5a0 2024-04-25T01:39:41.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.936+0000 7f8a3e7fc640 1 --2- 172.21.15.77:0/4181093047 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f8a2c06be80 0x7f8a2c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.936+0000 7fb21d3ce640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb21815a4f0 con 0x7fb21815ad40 2024-04-25T01:39:41.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.936+0000 7fb21d3ce640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb21806eb00 con 0x7fb2180c1f80 2024-04-25T01:39:41.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.936+0000 7fb216ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb21806e5a0 0x7fb2181f3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.936+0000 7f6709d9b640 1 --2- 172.21.15.77:0/1044395828 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f66ec06be80 0x7f66ec06e340 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6704034000 tx=0x7f670402f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:41.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.936+0000 7fb216ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb21806e5a0 0x7fb2181f3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47002/0 (socket says 172.21.15.77:47002) 2024-04-25T01:39:41.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.936+0000 7fb216ffd640 1 -- 172.21.15.77:0/271002094 learned_addr learned my addr 172.21.15.77:0/271002094 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:41.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.936+0000 7f8a3e7fc640 1 --2- 172.21.15.77:0/4181093047 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f8a2c06be80 0x7f8a2c06e340 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8a28004780 tx=0x7f8a34030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:41.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.937+0000 7fb216ffd640 1 -- 172.21.15.77:0/271002094 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb2180c1f80 msgr2=0x7fb2181f3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:41.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.937+0000 7fb2167fc640 1 --2- 172.21.15.77:0/271002094 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb2180c1f80 0x7fb2181f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.937+0000 7fb2177fe640 1 --2- 172.21.15.77:0/271002094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb21815ad40 0x7fb218153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.937+0000 7fb216ffd640 1 --2- 172.21.15.77:0/271002094 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb2180c1f80 0x7fb2181f3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.937+0000 7fb216ffd640 1 -- 172.21.15.77:0/271002094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb21815ad40 msgr2=0x7fb218153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:41.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.937+0000 7ff5baffd640 1 -- 172.21.15.77:0/2245993344 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff5c406d030 con 0x7ff5bc0d0900 2024-04-25T01:39:41.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.937+0000 7fb216ffd640 1 --2- 172.21.15.77:0/271002094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb21815ad40 0x7fb218153e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:41.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.937+0000 7fb216ffd640 1 -- 172.21.15.77:0/271002094 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2181f3ab0 con 0x7fb21806e5a0 2024-04-25T01:39:41.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.937+0000 7fb2167fc640 1 --2- 172.21.15.77:0/271002094 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb2180c1f80 0x7fb2181f3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:41.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.937+0000 7fb2177fe640 1 --2- 172.21.15.77:0/271002094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb21815ad40 0x7fb218153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:41.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.937+0000 7fb216ffd640 1 --2- 172.21.15.77:0/271002094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb21806e5a0 0x7fb2181f3030 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb21000efc0 tx=0x7fb21000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:41.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.938+0000 7f66faffd640 1 -- 172.21.15.77:0/1044395828 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f66fc058d90 con 0x7f670c0c1f80 2024-04-25T01:39:41.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.943+0000 7f8a27fff640 1 -- 172.21.15.77:0/4181093047 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f8a30057520 con 0x7f8a28004800 2024-04-25T01:39:41.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.943+0000 7fdf327fc640 1 -- 172.21.15.77:0/780055335 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fdf380587f0 con 0x7fdf340cda80 2024-04-25T01:39:41.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.943+0000 7fb1ff7fe640 1 -- 172.21.15.77:0/271002094 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb210018020 con 0x7fb21806e5a0 2024-04-25T01:39:41.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.943+0000 7fb21d3ce640 1 -- 172.21.15.77:0/271002094 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb218154c50 con 0x7fb21806e5a0 2024-04-25T01:39:41.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.943+0000 7fb21d3ce640 1 -- 172.21.15.77:0/271002094 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2180a7610 con 0x7fb21806e5a0 2024-04-25T01:39:41.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.945+0000 7fb1fd7fa640 1 -- 172.21.15.77:0/271002094 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1f8005290 con 0x7fb21806e5a0 2024-04-25T01:39:41.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.952+0000 7f8a27fff640 1 -- 172.21.15.77:0/4181093047 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8a380d2910 con 0x7f8a28004800 2024-04-25T01:39:41.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.952+0000 7fb1ff7fe640 1 -- 172.21.15.77:0/271002094 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb210014480 con 0x7fb21806e5a0 2024-04-25T01:39:41.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.953+0000 7fb1ff7fe640 1 -- 172.21.15.77:0/271002094 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb210014830 con 0x7fb21806e5a0 2024-04-25T01:39:41.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.958+0000 7fb1ff7fe640 1 -- 172.21.15.77:0/271002094 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb210005d10 con 0x7fb21806e5a0 2024-04-25T01:39:41.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.964+0000 7fb1ff7fe640 1 --2- 172.21.15.77:0/271002094 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb20406be30 0x7fb20406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:41.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.964+0000 7fb1ff7fe640 1 -- 172.21.15.77:0/271002094 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fb21008c380 con 0x7fb21806e5a0 2024-04-25T01:39:41.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.965+0000 7fb1ff7fe640 1 -- 172.21.15.77:0/271002094 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb210022070 con 0x7fb21806e5a0 2024-04-25T01:39:41.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.965+0000 7fb2167fc640 1 --2- 172.21.15.77:0/271002094 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb20406be30 0x7fb20406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:41.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:41.983+0000 7fb2167fc640 1 --2- 172.21.15.77:0/271002094 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb20406be30 0x7fb20406e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb20c034000 tx=0x7fb20c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:42.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.262+0000 7f9e51bae640 1 -- 172.21.15.77:0/954861929 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f9e2c005580 con 0x7f9e44047240 2024-04-25T01:39:42.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.263+0000 7f9e497fa640 1 -- 172.21.15.77:0/954861929 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9e3805c780 con 0x7f9e44047240 2024-04-25T01:39:42.246 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2024-04-25T01:39:42.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.266+0000 7f9e36ffd640 1 -- 172.21.15.77:0/954861929 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9e3006bf00 msgr2=0x7f9e3006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:42.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.266+0000 7f9e36ffd640 1 --2- 172.21.15.77:0/954861929 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9e3006bf00 0x7f9e3006e3c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c0502b0 tx=0x7f9e4c06af20 comp rx=0 tx=0).stop 2024-04-25T01:39:42.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.266+0000 7f9e36ffd640 1 -- 172.21.15.77:0/954861929 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e44047240 msgr2=0x7f9e4402f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:42.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.266+0000 7f9e36ffd640 1 --2- 172.21.15.77:0/954861929 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e44047240 0x7f9e4402f4d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9e3800c400 tx=0x7f9e3800c8c0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.267+0000 7f9e36ffd640 1 -- 172.21.15.77:0/954861929 shutdown_connections 2024-04-25T01:39:42.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.267+0000 7f9e36ffd640 1 --2- 172.21.15.77:0/954861929 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9e3006bf00 0x7f9e3006e3c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.267+0000 7f9e36ffd640 1 --2- 172.21.15.77:0/954861929 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e440deb90 0x7f9e440caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.267+0000 7f9e36ffd640 1 --2- 172.21.15.77:0/954861929 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e44047240 0x7f9e4402f4d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.267+0000 7f9e36ffd640 1 --2- 172.21.15.77:0/954861929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e4403fb00 0x7f9e44030310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.267+0000 7f9e36ffd640 1 -- 172.21.15.77:0/954861929 >> 172.21.15.77:0/954861929 conn(0x7f9e44049340 msgr2=0x7f9e440e9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:42.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.267+0000 7f9e36ffd640 1 -- 172.21.15.77:0/954861929 shutdown_connections 2024-04-25T01:39:42.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.267+0000 7f9e36ffd640 1 -- 172.21.15.77:0/954861929 wait complete. 2024-04-25T01:39:42.267 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2024-04-25T01:39:42.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.289+0000 7f308091a640 1 -- 172.21.15.77:0/4029929738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f307c0c21b0 con 0x7f307c0c23d0 2024-04-25T01:39:42.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.290+0000 7f30637fe640 1 -- 172.21.15.77:0/4029929738 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f307407a8d0 con 0x7f307c0c23d0 2024-04-25T01:39:42.273 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2024-04-25T01:39:42.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.293+0000 7f308091a640 1 -- 172.21.15.77:0/4029929738 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f306806beb0 msgr2=0x7f306806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:42.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.293+0000 7f308091a640 1 --2- 172.21.15.77:0/4029929738 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f306806beb0 0x7f306806e370 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f306c007fd0 tx=0x7f306c009040 comp rx=0 tx=0).stop 2024-04-25T01:39:42.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.293+0000 7f308091a640 1 -- 172.21.15.77:0/4029929738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f307c0c23d0 msgr2=0x7f307c1fb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:42.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.293+0000 7f308091a640 1 --2- 172.21.15.77:0/4029929738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f307c0c23d0 0x7f307c1fb680 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3074030000 tx=0x7f3074004a40 comp rx=0 tx=0).stop 2024-04-25T01:39:42.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.293+0000 7f308091a640 1 -- 172.21.15.77:0/4029929738 shutdown_connections 2024-04-25T01:39:42.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.293+0000 7f308091a640 1 --2- 172.21.15.77:0/4029929738 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f306806beb0 0x7f306806e370 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.293+0000 7f308091a640 1 --2- 172.21.15.77:0/4029929738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f307c0c23d0 0x7f307c1fb680 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.293+0000 7f308091a640 1 --2- 172.21.15.77:0/4029929738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f307c159c10 0x7f307c1552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.293+0000 7f308091a640 1 --2- 172.21.15.77:0/4029929738 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f307c06d390 0x7f307c070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.293+0000 7f308091a640 1 -- 172.21.15.77:0/4029929738 >> 172.21.15.77:0/4029929738 conn(0x7f307c06b110 msgr2=0x7f307c06b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:42.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.293+0000 7f308091a640 1 -- 172.21.15.77:0/4029929738 shutdown_connections 2024-04-25T01:39:42.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.293+0000 7f308091a640 1 -- 172.21.15.77:0/4029929738 wait complete. 2024-04-25T01:39:42.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2024-04-25T01:39:42.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.316+0000 7fdf43f84640 1 -- 172.21.15.77:0/780055335 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fdf24005580 con 0x7fdf340cda80 2024-04-25T01:39:42.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.317+0000 7fdf327fc640 1 -- 172.21.15.77:0/780055335 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdf3805caf0 con 0x7fdf340cda80 2024-04-25T01:39:42.300 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2024-04-25T01:39:42.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.319+0000 7fdf43f84640 1 -- 172.21.15.77:0/780055335 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fdf2006bf00 msgr2=0x7fdf2006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:42.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.319+0000 7fdf43f84640 1 --2- 172.21.15.77:0/780055335 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fdf2006bf00 0x7fdf2006e3c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c050ce0 tx=0x7fdf3c076b60 comp rx=0 tx=0).stop 2024-04-25T01:39:42.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.319+0000 7fdf43f84640 1 -- 172.21.15.77:0/780055335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf340cda80 msgr2=0x7fdf34175280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:42.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.319+0000 7fdf43f84640 1 --2- 172.21.15.77:0/780055335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf340cda80 0x7fdf34175280 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdf3800bed0 tx=0x7fdf3800f480 comp rx=0 tx=0).stop 2024-04-25T01:39:42.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.319+0000 7fdf43f84640 1 -- 172.21.15.77:0/780055335 shutdown_connections 2024-04-25T01:39:42.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.319+0000 7fdf43f84640 1 --2- 172.21.15.77:0/780055335 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fdf2006bf00 0x7fdf2006e3c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.319+0000 7fdf43f84640 1 --2- 172.21.15.77:0/780055335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf340cda80 0x7fdf34175280 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.319+0000 7fdf43f84640 1 --2- 172.21.15.77:0/780055335 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf340daae0 0x7fdf340d5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.319+0000 7fdf43f84640 1 --2- 172.21.15.77:0/780055335 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdf34006ed0 0x7fdf340d8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.319+0000 7fdf43f84640 1 -- 172.21.15.77:0/780055335 >> 172.21.15.77:0/780055335 conn(0x7fdf34048280 msgr2=0x7fdf3402f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:42.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.319+0000 7fdf43f84640 1 -- 172.21.15.77:0/780055335 shutdown_connections 2024-04-25T01:39:42.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.319+0000 7fdf43f84640 1 -- 172.21.15.77:0/780055335 wait complete. 2024-04-25T01:39:42.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.1 2024-04-25T01:39:42.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.338+0000 7fb1fd7fa640 1 -- 172.21.15.77:0/271002094 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb1f8005850 con 0x7fb21806e5a0 2024-04-25T01:39:42.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.338+0000 7fb1ff7fe640 1 -- 172.21.15.77:0/271002094 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb210010040 con 0x7fb21806e5a0 2024-04-25T01:39:42.321 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2024-04-25T01:39:42.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.340+0000 7fb1fd7fa640 1 -- 172.21.15.77:0/271002094 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb20406be30 msgr2=0x7fb20406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:42.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.340+0000 7fb1fd7fa640 1 --2- 172.21.15.77:0/271002094 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb20406be30 0x7fb20406e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb20c034000 tx=0x7fb20c02e000 comp rx=0 tx=0).stop 2024-04-25T01:39:42.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.340+0000 7fb1fd7fa640 1 -- 172.21.15.77:0/271002094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb21806e5a0 msgr2=0x7fb2181f3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:42.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.340+0000 7fb1fd7fa640 1 --2- 172.21.15.77:0/271002094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb21806e5a0 0x7fb2181f3030 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb21000efc0 tx=0x7fb21000c490 comp rx=0 tx=0).stop 2024-04-25T01:39:42.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.340+0000 7fb1fd7fa640 1 -- 172.21.15.77:0/271002094 shutdown_connections 2024-04-25T01:39:42.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.340+0000 7fb1fd7fa640 1 --2- 172.21.15.77:0/271002094 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb20406be30 0x7fb20406e2f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.340+0000 7fb1fd7fa640 1 --2- 172.21.15.77:0/271002094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb21815ad40 0x7fb218153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.340+0000 7fb1fd7fa640 1 --2- 172.21.15.77:0/271002094 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb2180c1f80 0x7fb2181f3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.340+0000 7fb1fd7fa640 1 --2- 172.21.15.77:0/271002094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb21806e5a0 0x7fb2181f3030 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.340+0000 7fb1fd7fa640 1 -- 172.21.15.77:0/271002094 >> 172.21.15.77:0/271002094 conn(0x7fb2180c7580 msgr2=0x7fb2180c5170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:42.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.340+0000 7fb1fd7fa640 1 -- 172.21.15.77:0/271002094 shutdown_connections 2024-04-25T01:39:42.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.340+0000 7fb1fd7fa640 1 -- 172.21.15.77:0/271002094 wait complete. 2024-04-25T01:39:42.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2024-04-25T01:39:42.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.353+0000 7f33efa2c640 1 -- 172.21.15.77:0/3149228987 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f33c8005580 con 0x7f33e80c5ba0 2024-04-25T01:39:42.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.353+0000 7f33ddffb640 1 -- 172.21.15.77:0/3149228987 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f33e0010040 con 0x7f33e80c5ba0 2024-04-25T01:39:42.336 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2024-04-25T01:39:42.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.355+0000 7f33efa2c640 1 -- 172.21.15.77:0/3149228987 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f33cc06be30 msgr2=0x7f33cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:42.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.355+0000 7f33efa2c640 1 --2- 172.21.15.77:0/3149228987 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f33cc06be30 0x7f33cc06e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f33e4034000 tx=0x7f33e402e000 comp rx=0 tx=0).stop 2024-04-25T01:39:42.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.355+0000 7f33efa2c640 1 -- 172.21.15.77:0/3149228987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e80c5ba0 msgr2=0x7f33e814cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:42.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.355+0000 7f33efa2c640 1 --2- 172.21.15.77:0/3149228987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e80c5ba0 0x7f33e814cd90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f33e000c370 tx=0x7f33e000c830 comp rx=0 tx=0).stop 2024-04-25T01:39:42.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.355+0000 7f33efa2c640 1 -- 172.21.15.77:0/3149228987 shutdown_connections 2024-04-25T01:39:42.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.355+0000 7f33efa2c640 1 --2- 172.21.15.77:0/3149228987 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f33cc06be30 0x7f33cc06e2f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.355+0000 7f33efa2c640 1 --2- 172.21.15.77:0/3149228987 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f33e814fa20 0x7f33e80bf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.355+0000 7f33efa2c640 1 --2- 172.21.15.77:0/3149228987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33e80c80a0 0x7f33e80bf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.355+0000 7f33efa2c640 1 --2- 172.21.15.77:0/3149228987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e80c5ba0 0x7f33e814cd90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.355+0000 7f33efa2c640 1 -- 172.21.15.77:0/3149228987 >> 172.21.15.77:0/3149228987 conn(0x7f33e80c7580 msgr2=0x7f33e80c7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:42.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.355+0000 7f33efa2c640 1 -- 172.21.15.77:0/3149228987 shutdown_connections 2024-04-25T01:39:42.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.355+0000 7f33efa2c640 1 -- 172.21.15.77:0/3149228987 wait complete. 2024-04-25T01:39:42.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.359+0000 7ff5cb0b4640 1 -- 172.21.15.77:0/2245993344 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ff5bc02c180 con 0x7ff5bc0d0900 2024-04-25T01:39:42.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.360+0000 7f6710a7b640 1 -- 172.21.15.77:0/1044395828 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f670c0c6e00 con 0x7f670c0c1f80 2024-04-25T01:39:42.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.360+0000 7ff5baffd640 1 -- 172.21.15.77:0/2245993344 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff5c40d5510 con 0x7ff5bc0d0900 2024-04-25T01:39:42.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.360+0000 7f66faffd640 1 -- 172.21.15.77:0/1044395828 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f66fc05d090 con 0x7f670c0c1f80 2024-04-25T01:39:42.344 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2024-04-25T01:39:42.344 INFO:teuthology.orchestra.run.smithi077.stdout:55834574855 2024-04-25T01:39:42.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.362+0000 7f6710a7b640 1 -- 172.21.15.77:0/1044395828 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f66ec06be80 msgr2=0x7f66ec06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:42.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.362+0000 7f6710a7b640 1 --2- 172.21.15.77:0/1044395828 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f66ec06be80 0x7f66ec06e340 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6704034000 tx=0x7f670402f000 comp rx=0 tx=0).stop 2024-04-25T01:39:42.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.362+0000 7f6710a7b640 1 -- 172.21.15.77:0/1044395828 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f670c0c1f80 msgr2=0x7f670c165e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:42.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.362+0000 7f6710a7b640 1 --2- 172.21.15.77:0/1044395828 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f670c0c1f80 0x7f670c165e00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f66fc00c4a0 tx=0x7f66fc00c960 comp rx=0 tx=0).stop 2024-04-25T01:39:42.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.362+0000 7f6710a7b640 1 -- 172.21.15.77:0/1044395828 shutdown_connections 2024-04-25T01:39:42.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.362+0000 7f6710a7b640 1 --2- 172.21.15.77:0/1044395828 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f66ec06be80 0x7f66ec06e340 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.362+0000 7f6710a7b640 1 --2- 172.21.15.77:0/1044395828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f670c163910 0x7f670c15e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.362+0000 7f6710a7b640 1 --2- 172.21.15.77:0/1044395828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f670c0c5690 0x7f670c15e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.362+0000 7f6710a7b640 1 --2- 172.21.15.77:0/1044395828 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f670c0c1f80 0x7f670c165e00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.362+0000 7f6710a7b640 1 -- 172.21.15.77:0/1044395828 >> 172.21.15.77:0/1044395828 conn(0x7f670c0c7580 msgr2=0x7f670c081600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:42.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.362+0000 7f6710a7b640 1 -- 172.21.15.77:0/1044395828 shutdown_connections 2024-04-25T01:39:42.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.362+0000 7f6710a7b640 1 -- 172.21.15.77:0/1044395828 wait complete. 2024-04-25T01:39:42.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.363+0000 7ff5cb0b4640 1 -- 172.21.15.77:0/2245993344 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff5a806be80 msgr2=0x7ff5a806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:42.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.363+0000 7ff5cb0b4640 1 --2- 172.21.15.77:0/2245993344 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff5a806be80 0x7ff5a806e340 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0006fd0 tx=0x7ff5c0008040 comp rx=0 tx=0).stop 2024-04-25T01:39:42.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.363+0000 7ff5cb0b4640 1 -- 172.21.15.77:0/2245993344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5bc0d0900 msgr2=0x7ff5bc0d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:42.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.363+0000 7ff5cb0b4640 1 --2- 172.21.15.77:0/2245993344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5bc0d0900 0x7ff5bc0d8990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4000b60 tx=0x7ff5c4073da0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.363+0000 7ff5cb0b4640 1 -- 172.21.15.77:0/2245993344 shutdown_connections 2024-04-25T01:39:42.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.363+0000 7ff5cb0b4640 1 --2- 172.21.15.77:0/2245993344 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff5a806be80 0x7ff5a806e340 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.363+0000 7ff5cb0b4640 1 --2- 172.21.15.77:0/2245993344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5bc0d0900 0x7ff5bc0d8990 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.363+0000 7ff5cb0b4640 1 --2- 172.21.15.77:0/2245993344 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5bc0db000 0x7ff5bc00bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.363+0000 7ff5cb0b4640 1 --2- 172.21.15.77:0/2245993344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5bc04a9e0 0x7ff5bc0d3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.363+0000 7ff5cb0b4640 1 -- 172.21.15.77:0/2245993344 >> 172.21.15.77:0/2245993344 conn(0x7ff5bc049340 msgr2=0x7ff5bc0cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:42.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.363+0000 7ff5cb0b4640 1 -- 172.21.15.77:0/2245993344 shutdown_connections 2024-04-25T01:39:42.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.363+0000 7ff5cb0b4640 1 -- 172.21.15.77:0/2245993344 wait complete. 2024-04-25T01:39:42.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.366+0000 7f8a25ffb640 1 -- 172.21.15.77:0/4181093047 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8a3804bcf0 con 0x7f8a28004800 2024-04-25T01:39:42.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.366+0000 7f8a27fff640 1 -- 172.21.15.77:0/4181093047 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8a30059480 con 0x7f8a28004800 2024-04-25T01:39:42.350 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2024-04-25T01:39:42.351 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2024-04-25T01:39:42.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.368+0000 7f8a25ffb640 1 -- 172.21.15.77:0/4181093047 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f8a2c06be80 msgr2=0x7f8a2c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:42.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.368+0000 7f8a25ffb640 1 --2- 172.21.15.77:0/4181093047 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f8a2c06be80 0x7f8a2c06e340 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8a28004780 tx=0x7f8a34030000 comp rx=0 tx=0).stop 2024-04-25T01:39:42.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.368+0000 7f8a25ffb640 1 -- 172.21.15.77:0/4181093047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a28004800 msgr2=0x7f8a380ddf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:42.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.368+0000 7f8a25ffb640 1 --2- 172.21.15.77:0/4181093047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a28004800 0x7f8a380ddf50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8a3000c850 tx=0x7f8a3000cd10 comp rx=0 tx=0).stop 2024-04-25T01:39:42.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.368+0000 7f8a25ffb640 1 -- 172.21.15.77:0/4181093047 shutdown_connections 2024-04-25T01:39:42.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.368+0000 7f8a25ffb640 1 --2- 172.21.15.77:0/4181093047 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f8a2c06be80 0x7f8a2c06e340 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.368+0000 7f8a25ffb640 1 --2- 172.21.15.77:0/4181093047 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8a380420c0 0x7f8a38030d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.368+0000 7f8a25ffb640 1 --2- 172.21.15.77:0/4181093047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a38032000 0x7f8a380307d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.368+0000 7f8a25ffb640 1 --2- 172.21.15.77:0/4181093047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a28004800 0x7f8a380ddf50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:42.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.368+0000 7f8a25ffb640 1 -- 172.21.15.77:0/4181093047 >> 172.21.15.77:0/4181093047 conn(0x7f8a38049340 msgr2=0x7f8a380d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:42.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.369+0000 7f8a25ffb640 1 -- 172.21.15.77:0/4181093047 shutdown_connections 2024-04-25T01:39:42.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:42.369+0000 7f8a25ffb640 1 -- 172.21.15.77:0/4181093047 wait complete. 2024-04-25T01:39:42.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.6 2024-04-25T01:39:42.363 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.7 2024-04-25T01:39:42.363 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.3 2024-04-25T01:39:43.268 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T01:39:43.293 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T01:39:43.314 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T01:39:43.335 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T01:39:43.352 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T01:39:43.363 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T01:39:43.363 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T01:39:43.365 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T01:39:43.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.410+0000 7fe172a53640 1 Processor -- start 2024-04-25T01:39:43.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.410+0000 7fe172a53640 1 -- start start 2024-04-25T01:39:43.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.411+0000 7fe172a53640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe16c154b10 0x7fe16c0c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.411+0000 7fe172a53640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe16c0c9b60 0x7fe16c15e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.411+0000 7fe172a53640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe16c0c6e90 con 0x7fe16c14e360 2024-04-25T01:39:43.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.411+0000 7fe172a53640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fe16c154680 con 0x7fe16c154b10 2024-04-25T01:39:43.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.411+0000 7fe172a53640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe16c154030 con 0x7fe16c0c9b60 2024-04-25T01:39:43.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.411+0000 7fe16bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe16c14e360 0x7fe16c157410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41524/0 (socket says 172.21.15.77:41524) 2024-04-25T01:39:43.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.411+0000 7fe16bfff640 1 -- 172.21.15.77:0/3786025609 learned_addr learned my addr 172.21.15.77:0/3786025609 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:43.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.412+0000 7fe16b7fe640 1 --2- 172.21.15.77:0/3786025609 >> v2:172.21.15.121:3300/0 conn(0x7fe16c154b10 0x7fe16c0c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.412+0000 7fe170ff0640 1 --2- 172.21.15.77:0/3786025609 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe16c0c9b60 0x7fe16c15e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.412+0000 7fe170ff0640 1 -- 172.21.15.77:0/3786025609 >> v2:172.21.15.121:3300/0 conn(0x7fe16c154b10 msgr2=0x7fe16c0c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:43.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.412+0000 7fe170ff0640 1 --2- 172.21.15.77:0/3786025609 >> v2:172.21.15.121:3300/0 conn(0x7fe16c154b10 0x7fe16c0c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.412+0000 7fe170ff0640 1 -- 172.21.15.77:0/3786025609 >> v1:172.21.15.77:6789/0 conn(0x7fe16c14e360 legacy=0x7fe16c157410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.412+0000 7fe170ff0640 1 -- 172.21.15.77:0/3786025609 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe16c154310 con 0x7fe16c0c9b60 2024-04-25T01:39:43.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.413+0000 7fe170ff0640 1 --2- 172.21.15.77:0/3786025609 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe16c0c9b60 0x7fe16c15e7a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe164009d90 tx=0x7fe16402a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da69904aa75d8735 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:43.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.413+0000 7fe16affd640 1 -- 172.21.15.77:0/3786025609 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe164007740 con 0x7fe16c0c9b60 2024-04-25T01:39:43.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.414+0000 7fe16affd640 1 -- 172.21.15.77:0/3786025609 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1640078e0 con 0x7fe16c0c9b60 2024-04-25T01:39:43.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.414+0000 7fe16affd640 1 -- 172.21.15.77:0/3786025609 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe164007cf0 con 0x7fe16c0c9b60 2024-04-25T01:39:43.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.415+0000 7fe172a53640 1 -- 172.21.15.77:0/3786025609 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe16c0c9b60 msgr2=0x7fe16c15e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.415+0000 7fe172a53640 1 --2- 172.21.15.77:0/3786025609 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe16c0c9b60 0x7fe16c15e7a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe164009d90 tx=0x7fe16402a5f0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.415+0000 7fe172a53640 1 -- 172.21.15.77:0/3786025609 shutdown_connections 2024-04-25T01:39:43.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.415+0000 7fe172a53640 1 --2- 172.21.15.77:0/3786025609 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe16c0c9b60 0x7fe16c15e7a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.415+0000 7fe172a53640 1 --2- 172.21.15.77:0/3786025609 >> v2:172.21.15.121:3300/0 conn(0x7fe16c154b10 0x7fe16c0c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.415+0000 7fe172a53640 1 -- 172.21.15.77:0/3786025609 >> 172.21.15.77:0/3786025609 conn(0x7fe16c06b2f0 msgr2=0x7fe16c0aa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:43.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.415+0000 7fe172a53640 1 -- 172.21.15.77:0/3786025609 shutdown_connections 2024-04-25T01:39:43.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.415+0000 7fe172a53640 1 -- 172.21.15.77:0/3786025609 wait complete. 2024-04-25T01:39:43.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.417+0000 7fe172a53640 1 Processor -- start 2024-04-25T01:39:43.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.417+0000 7fe172a53640 1 -- start start 2024-04-25T01:39:43.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.419+0000 7fe172a53640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe16c0c9b60 0x7fe16c1ed290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.419+0000 7fe16bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe16c0c9b60 0x7fe16c1ed290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.419+0000 7fe16bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe16c0c9b60 0x7fe16c1ed290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47006/0 (socket says 172.21.15.77:47006) 2024-04-25T01:39:43.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.420+0000 7fe16bfff640 1 -- 172.21.15.77:0/3946762787 learned_addr learned my addr 172.21.15.77:0/3946762787 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:43.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.420+0000 7fe172a53640 1 --2- 172.21.15.77:0/3946762787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe16c14e360 0x7fe16c14f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.420+0000 7fe172a53640 1 --2- 172.21.15.77:0/3946762787 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe16c154b10 0x7fe16c14fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.420+0000 7fe172a53640 1 -- 172.21.15.77:0/3946762787 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe16c0c6c30 con 0x7fe16c0c9b60 2024-04-25T01:39:43.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.420+0000 7fe16b7fe640 1 --2- 172.21.15.77:0/3946762787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe16c14e360 0x7fe16c14f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.420+0000 7fe170ff0640 1 --2- 172.21.15.77:0/3946762787 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe16c154b10 0x7fe16c14fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.420+0000 7fe172a53640 1 -- 172.21.15.77:0/3946762787 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe16c0c6ab0 con 0x7fe16c14e360 2024-04-25T01:39:43.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.420+0000 7fe172a53640 1 -- 172.21.15.77:0/3946762787 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe16c0c5d00 con 0x7fe16c154b10 2024-04-25T01:39:43.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.421+0000 7fe16bfff640 1 -- 172.21.15.77:0/3946762787 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe16c154b10 msgr2=0x7fe16c14fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.421+0000 7fe16bfff640 1 --2- 172.21.15.77:0/3946762787 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe16c154b10 0x7fe16c14fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.421+0000 7fe16bfff640 1 -- 172.21.15.77:0/3946762787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe16c14e360 msgr2=0x7fe16c14f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.421+0000 7fe16bfff640 1 --2- 172.21.15.77:0/3946762787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe16c14e360 0x7fe16c14f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.421+0000 7fe16bfff640 1 -- 172.21.15.77:0/3946762787 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe16c1edc80 con 0x7fe16c0c9b60 2024-04-25T01:39:43.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.422+0000 7fe16bfff640 1 --2- 172.21.15.77:0/3946762787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe16c0c9b60 0x7fe16c1ed290 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe15c00c780 tx=0x7fe15c00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:43.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.422+0000 7fe168ff9640 1 -- 172.21.15.77:0/3946762787 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15c017070 con 0x7fe16c0c9b60 2024-04-25T01:39:43.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.423+0000 7fe168ff9640 1 -- 172.21.15.77:0/3946762787 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe15c0058b0 con 0x7fe16c0c9b60 2024-04-25T01:39:43.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.423+0000 7fe172a53640 1 -- 172.21.15.77:0/3946762787 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe16c14ecd0 con 0x7fe16c0c9b60 2024-04-25T01:39:43.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.425+0000 7fe172a53640 1 -- 172.21.15.77:0/3946762787 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe16c0c8630 con 0x7fe16c0c9b60 2024-04-25T01:39:43.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.427+0000 7fe168ff9640 1 -- 172.21.15.77:0/3946762787 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15c005c60 con 0x7fe16c0c9b60 2024-04-25T01:39:43.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.427+0000 7fe168ff9640 1 -- 172.21.15.77:0/3946762787 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe15c01a070 con 0x7fe16c0c9b60 2024-04-25T01:39:43.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.428+0000 7fe168ff9640 1 --2- 172.21.15.77:0/3946762787 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe15806bf60 0x7fe15806e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.428+0000 7fe168ff9640 1 -- 172.21.15.77:0/3946762787 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fe15c08a200 con 0x7fe16c0c9b60 2024-04-25T01:39:43.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.429+0000 7fe172a53640 1 -- 172.21.15.77:0/3946762787 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe16c04f500 con 0x7fe16c0c9b60 2024-04-25T01:39:43.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.428+0000 7fe16b7fe640 1 --2- 172.21.15.77:0/3946762787 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe15806bf60 0x7fe15806e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.439+0000 7fe16b7fe640 1 --2- 172.21.15.77:0/3946762787 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe15806bf60 0x7fe15806e420 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0c8250 tx=0x7fe160018040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:43.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.439+0000 7fe168ff9640 1 -- 172.21.15.77:0/3946762787 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe15c058300 con 0x7fe16c0c9b60 2024-04-25T01:39:43.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.465+0000 7fe70296a640 1 Processor -- start 2024-04-25T01:39:43.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.465+0000 7fe70296a640 1 -- start start 2024-04-25T01:39:43.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.466+0000 7fe70296a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe6fc156430 0x7fe6fc0c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.467+0000 7fe6fb7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe6fc0c2cb0 0x7fe6fc070980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41530/0 (socket says 172.21.15.77:41530) 2024-04-25T01:39:43.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.467+0000 7fe6fb7fe640 1 -- 172.21.15.77:0/2727068424 learned_addr learned my addr 172.21.15.77:0/2727068424 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:43.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.467+0000 7fe70296a640 1 --2- 172.21.15.77:0/2727068424 >> v2:172.21.15.121:3300/0 conn(0x7fe6fc072940 0x7fe6fc06d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.467+0000 7fe70296a640 1 -- 172.21.15.77:0/2727068424 --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6fc06dbf0 con 0x7fe6fc0c2cb0 2024-04-25T01:39:43.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.467+0000 7fe70296a640 1 -- 172.21.15.77:0/2727068424 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe6fc0c64b0 con 0x7fe6fc156430 2024-04-25T01:39:43.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.467+0000 7fe70296a640 1 -- 172.21.15.77:0/2727068424 --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fe6fc0c6a70 con 0x7fe6fc072940 2024-04-25T01:39:43.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.469+0000 7fe6faffd640 1 -- 172.21.15.77:0/2727068424 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 711745987 0 0) 0x7fe6fc06dbf0 con 0x7fe6fc0c2cb0 2024-04-25T01:39:43.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.469+0000 7fe6faffd640 1 -- 172.21.15.77:0/2727068424 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6e4003520 con 0x7fe6fc0c2cb0 2024-04-25T01:39:43.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.470+0000 7fe700f07640 1 --2- 172.21.15.77:0/2727068424 >> v2:172.21.15.121:3300/0 conn(0x7fe6fc072940 0x7fe6fc06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.469+0000 7f9b5f24d640 1 Processor -- start 2024-04-25T01:39:43.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.469+0000 7f9b5f24d640 1 -- start start 2024-04-25T01:39:43.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.470+0000 7fe6fbfff640 1 --2- 172.21.15.77:0/2727068424 >> v2:172.21.15.77:3300/0 conn(0x7fe6fc156430 0x7fe6fc0c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.470+0000 7f9b5f24d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9b58157b90 0x7f9b58072370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.470+0000 7f9b5f24d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9b5815a430 0x7f9b580c9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.471+0000 7fe6fbfff640 1 -- 172.21.15.77:0/2727068424 >> v2:172.21.15.121:3300/0 conn(0x7fe6fc072940 msgr2=0x7fe6fc06d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:43.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.471+0000 7fe6fbfff640 1 --2- 172.21.15.77:0/2727068424 >> v2:172.21.15.121:3300/0 conn(0x7fe6fc072940 0x7fe6fc06d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.471+0000 7fe6fbfff640 1 -- 172.21.15.77:0/2727068424 >> v1:172.21.15.77:6789/0 conn(0x7fe6fc0c2cb0 legacy=0x7fe6fc070980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.471+0000 7fe6fbfff640 1 -- 172.21.15.77:0/2727068424 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6fc06ded0 con 0x7fe6fc156430 2024-04-25T01:39:43.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.470+0000 7f9b5f24d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b580703b0 con 0x7f9b580c9b80 2024-04-25T01:39:43.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.470+0000 7f9b5f24d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9b58072a10 con 0x7f9b58157b90 2024-04-25T01:39:43.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.470+0000 7f9b5f24d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9b580c5ed0 con 0x7f9b5815a430 2024-04-25T01:39:43.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.471+0000 7f9b5d7ea640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9b580c9b80 0x7f9b58072ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41544/0 (socket says 172.21.15.77:41544) 2024-04-25T01:39:43.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.471+0000 7f9b5d7ea640 1 -- 172.21.15.77:0/2755435381 learned_addr learned my addr 172.21.15.77:0/2755435381 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:43.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.471+0000 7f9b5cfe9640 1 --2- 172.21.15.77:0/2755435381 >> v2:172.21.15.77:3300/0 conn(0x7f9b58157b90 0x7f9b58072370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.472+0000 7f9b5cfe9640 1 -- 172.21.15.77:0/2755435381 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9b5815a430 msgr2=0x7f9b580c9640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T01:39:43.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.472+0000 7f9b5cfe9640 1 --2- 172.21.15.77:0/2755435381 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9b5815a430 0x7f9b580c9640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.472+0000 7f9b5cfe9640 1 -- 172.21.15.77:0/2755435381 >> v1:172.21.15.77:6789/0 conn(0x7f9b580c9b80 legacy=0x7f9b58072ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.472+0000 7f9b5cfe9640 1 -- 172.21.15.77:0/2755435381 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b5806fdf0 con 0x7f9b58157b90 2024-04-25T01:39:43.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.473+0000 7f9b5cfe9640 1 --2- 172.21.15.77:0/2755435381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b58157b90 0x7f9b58072370 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9b58072b90 tx=0x7f9b4002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458e61ec7745a1cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:43.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.474+0000 7fe6fbfff640 1 --2- 172.21.15.77:0/2727068424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6fc156430 0x7fe6fc0c6f00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc0c7680 tx=0x7fe6f002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41753d01ea1eff9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:43.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.475+0000 7fe6faffd640 1 -- 172.21.15.77:0/2727068424 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0037070 con 0x7fe6fc156430 2024-04-25T01:39:43.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.475+0000 7fe6faffd640 1 -- 172.21.15.77:0/2727068424 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6f002ae00 con 0x7fe6fc156430 2024-04-25T01:39:43.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.475+0000 7fe6faffd640 1 -- 172.21.15.77:0/2727068424 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0032660 con 0x7fe6fc156430 2024-04-25T01:39:43.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.475+0000 7f9b577fe640 1 -- 172.21.15.77:0/2755435381 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b40037070 con 0x7f9b58157b90 2024-04-25T01:39:43.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.475+0000 7f9b577fe640 1 -- 172.21.15.77:0/2755435381 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b40032440 con 0x7f9b58157b90 2024-04-25T01:39:43.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.476+0000 7fe70296a640 1 -- 172.21.15.77:0/2727068424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6fc156430 msgr2=0x7fe6fc0c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.476+0000 7fe70296a640 1 --2- 172.21.15.77:0/2727068424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6fc156430 0x7fe6fc0c6f00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc0c7680 tx=0x7fe6f002a0b0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.476+0000 7fe70296a640 1 -- 172.21.15.77:0/2727068424 shutdown_connections 2024-04-25T01:39:43.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.476+0000 7fe70296a640 1 --2- 172.21.15.77:0/2727068424 >> v2:172.21.15.121:3300/0 conn(0x7fe6fc072940 0x7fe6fc06d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.476+0000 7fe70296a640 1 --2- 172.21.15.77:0/2727068424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6fc156430 0x7fe6fc0c6f00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.476+0000 7fe70296a640 1 -- 172.21.15.77:0/2727068424 >> 172.21.15.77:0/2727068424 conn(0x7fe6fc0c7ba0 msgr2=0x7fe6fc0c7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:43.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.476+0000 7f9b5f24d640 1 -- 172.21.15.77:0/2755435381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b58157b90 msgr2=0x7f9b58072370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.476+0000 7f9b5f24d640 1 --2- 172.21.15.77:0/2755435381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b58157b90 0x7f9b58072370 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9b58072b90 tx=0x7f9b4002a130 comp rx=0 tx=0).stop 2024-04-25T01:39:43.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.476+0000 7f9b5f24d640 1 -- 172.21.15.77:0/2755435381 shutdown_connections 2024-04-25T01:39:43.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.476+0000 7f9b5f24d640 1 --2- 172.21.15.77:0/2755435381 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9b5815a430 0x7f9b580c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.476+0000 7f9b5f24d640 1 --2- 172.21.15.77:0/2755435381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b58157b90 0x7f9b58072370 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.476+0000 7f9b5f24d640 1 -- 172.21.15.77:0/2755435381 >> 172.21.15.77:0/2755435381 conn(0x7f9b5806b530 msgr2=0x7f9b580aa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:43.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.476+0000 7f9b5f24d640 1 -- 172.21.15.77:0/2755435381 shutdown_connections 2024-04-25T01:39:43.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.476+0000 7f9b5f24d640 1 -- 172.21.15.77:0/2755435381 wait complete. 2024-04-25T01:39:43.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.477+0000 7fe70296a640 1 -- 172.21.15.77:0/2727068424 shutdown_connections 2024-04-25T01:39:43.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.477+0000 7fe70296a640 1 -- 172.21.15.77:0/2727068424 wait complete. 2024-04-25T01:39:43.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.478+0000 7f9b5f24d640 1 Processor -- start 2024-04-25T01:39:43.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.478+0000 7f9b5f24d640 1 -- start start 2024-04-25T01:39:43.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.478+0000 7fe70296a640 1 Processor -- start 2024-04-25T01:39:43.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.480+0000 7f9b5f24d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b580c9b80 0x7f9b581f3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.479+0000 7fe70296a640 1 -- start start 2024-04-25T01:39:43.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.480+0000 7fe70296a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe6fc072940 0x7fe6fc14bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.480+0000 7fe70296a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6fc0c2cb0 0x7fe6fc1f0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.480+0000 7fe70296a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6fc156430 0x7fe6fc1f3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.480+0000 7f9b5f24d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b58157b90 0x7f9b581f3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.480+0000 7fe6fb7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6fc0c2cb0 0x7fe6fc1f0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.480+0000 7fe6fb7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6fc0c2cb0 0x7fe6fc1f0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:52492/0 (socket says 172.21.15.77:52492) 2024-04-25T01:39:43.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.480+0000 7fe6fbfff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe6fc072940 0x7fe6fc14bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.480+0000 7fe6fbfff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe6fc072940 0x7fe6fc14bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.77:52516/0 (socket says 172.21.15.77:52516) 2024-04-25T01:39:43.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.480+0000 7f9b5f24d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9b5815a430 0x7f9b581f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.481+0000 7fe6fb7fe640 1 -- 172.21.15.77:0/1258311556 learned_addr learned my addr 172.21.15.77:0/1258311556 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:43.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.481+0000 7fe70296a640 1 -- 172.21.15.77:0/1258311556 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe6fc156810 con 0x7fe6fc156430 2024-04-25T01:39:43.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.481+0000 7fe70296a640 1 -- 172.21.15.77:0/1258311556 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe6fc071090 con 0x7fe6fc0c2cb0 2024-04-25T01:39:43.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.480+0000 7f9b57fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b58157b90 0x7f9b581f3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.481+0000 7f9b5cfe9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b580c9b80 0x7f9b581f3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.481+0000 7f9b5cfe9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b580c9b80 0x7f9b581f3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:52490/0 (socket says 172.21.15.77:52490) 2024-04-25T01:39:43.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.481+0000 7f9b57fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b58157b90 0x7f9b581f3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47036/0 (socket says 172.21.15.77:47036) 2024-04-25T01:39:43.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.481+0000 7f9b5cfe9640 1 -- 172.21.15.77:0/3251331699 learned_addr learned my addr 172.21.15.77:0/3251331699 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:43.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.481+0000 7fe70296a640 1 -- 172.21.15.77:0/1258311556 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe6fc156990 con 0x7fe6fc072940 2024-04-25T01:39:43.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.481+0000 7fe700f07640 1 --2- 172.21.15.77:0/1258311556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6fc156430 0x7fe6fc1f3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.481+0000 7fe6fb7fe640 1 -- 172.21.15.77:0/1258311556 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe6fc072940 msgr2=0x7fe6fc14bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.481+0000 7fe6fb7fe640 1 --2- 172.21.15.77:0/1258311556 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe6fc072940 0x7fe6fc14bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.481+0000 7fe6fb7fe640 1 -- 172.21.15.77:0/1258311556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6fc156430 msgr2=0x7fe6fc1f3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.481+0000 7fe6fb7fe640 1 --2- 172.21.15.77:0/1258311556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6fc156430 0x7fe6fc1f3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.481+0000 7fe6fb7fe640 1 -- 172.21.15.77:0/1258311556 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6fc06d8a0 con 0x7fe6fc0c2cb0 2024-04-25T01:39:43.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.481+0000 7fe700f07640 1 --2- 172.21.15.77:0/1258311556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6fc156430 0x7fe6fc1f3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:43.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.481+0000 7fe6fbfff640 1 --2- 172.21.15.77:0/1258311556 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe6fc072940 0x7fe6fc14bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:43.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.482+0000 7fe6fb7fe640 1 --2- 172.21.15.77:0/1258311556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6fc0c2cb0 0x7fe6fc1f0060 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec00c3c0 tx=0x7fe6ec00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:43.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.481+0000 7f9b5f24d640 1 -- 172.21.15.77:0/3251331699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9b58073730 con 0x7f9b58157b90 2024-04-25T01:39:43.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.481+0000 7f9b5f24d640 1 -- 172.21.15.77:0/3251331699 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9b580735b0 con 0x7f9b580c9b80 2024-04-25T01:39:43.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.481+0000 7f9b5f24d640 1 -- 172.21.15.77:0/3251331699 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9b580c6b70 con 0x7f9b5815a430 2024-04-25T01:39:43.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.482+0000 7f9b5d7ea640 1 --2- 172.21.15.77:0/3251331699 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9b5815a430 0x7f9b581f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.482+0000 7f9b5cfe9640 1 -- 172.21.15.77:0/3251331699 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9b5815a430 msgr2=0x7f9b581f1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.482+0000 7f9b5cfe9640 1 --2- 172.21.15.77:0/3251331699 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9b5815a430 0x7f9b581f1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.482+0000 7f9b5cfe9640 1 -- 172.21.15.77:0/3251331699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b58157b90 msgr2=0x7f9b581f3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.482+0000 7f9b5cfe9640 1 --2- 172.21.15.77:0/3251331699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b58157b90 0x7f9b581f3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.482+0000 7f9b5cfe9640 1 -- 172.21.15.77:0/3251331699 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b581f1250 con 0x7f9b580c9b80 2024-04-25T01:39:43.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.482+0000 7f9b5d7ea640 1 --2- 172.21.15.77:0/3251331699 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9b5815a430 0x7f9b581f1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:43.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.482+0000 7f9b57fff640 1 --2- 172.21.15.77:0/3251331699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b58157b90 0x7f9b581f3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:43.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.483+0000 7f9b5cfe9640 1 --2- 172.21.15.77:0/3251331699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b580c9b80 0x7f9b581f3520 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9b40009890 tx=0x7f9b400046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:43.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.483+0000 7f9b557fa640 1 -- 172.21.15.77:0/3251331699 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b40037050 con 0x7f9b580c9b80 2024-04-25T01:39:43.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.483+0000 7f9b5f24d640 1 -- 172.21.15.77:0/3251331699 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b581f3fa0 con 0x7f9b580c9b80 2024-04-25T01:39:43.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.483+0000 7f9b5f24d640 1 -- 172.21.15.77:0/3251331699 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b581f14f0 con 0x7f9b580c9b80 2024-04-25T01:39:43.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.482+0000 7fe6f8ff9640 1 -- 172.21.15.77:0/1258311556 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec017070 con 0x7fe6fc0c2cb0 2024-04-25T01:39:43.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.482+0000 7fe6f8ff9640 1 -- 172.21.15.77:0/1258311556 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6ec005ce0 con 0x7fe6fc0c2cb0 2024-04-25T01:39:43.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.482+0000 7fe70296a640 1 -- 172.21.15.77:0/1258311556 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6fc1f05a0 con 0x7fe6fc0c2cb0 2024-04-25T01:39:43.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.482+0000 7fe70296a640 1 -- 172.21.15.77:0/1258311556 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6fc160680 con 0x7fe6fc0c2cb0 2024-04-25T01:39:43.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.485+0000 7fe6f8ff9640 1 -- 172.21.15.77:0/1258311556 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec0072d0 con 0x7fe6fc0c2cb0 2024-04-25T01:39:43.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.485+0000 7f9b557fa640 1 -- 172.21.15.77:0/3251331699 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b40043070 con 0x7f9b580c9b80 2024-04-25T01:39:43.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.485+0000 7f9b557fa640 1 -- 172.21.15.77:0/3251331699 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4003e690 con 0x7f9b580c9b80 2024-04-25T01:39:43.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.485+0000 7f9b4effd640 1 -- 172.21.15.77:0/3251331699 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b3c005290 con 0x7f9b580c9b80 2024-04-25T01:39:43.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.485+0000 7fe70296a640 1 -- 172.21.15.77:0/1258311556 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6dc005290 con 0x7fe6fc0c2cb0 2024-04-25T01:39:43.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.486+0000 7f9b557fa640 1 -- 172.21.15.77:0/3251331699 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9b4003e830 con 0x7f9b580c9b80 2024-04-25T01:39:43.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.487+0000 7f9b557fa640 1 --2- 172.21.15.77:0/3251331699 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9b3806bf00 0x7f9b3806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.487+0000 7f9b57fff640 1 --2- 172.21.15.77:0/3251331699 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9b3806bf00 0x7f9b3806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.488+0000 7fe6f8ff9640 1 -- 172.21.15.77:0/1258311556 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe6ec01a070 con 0x7fe6fc0c2cb0 2024-04-25T01:39:43.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.488+0000 7f9b557fa640 1 -- 172.21.15.77:0/3251331699 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f9b400ac3c0 con 0x7f9b580c9b80 2024-04-25T01:39:43.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.488+0000 7f9b57fff640 1 --2- 172.21.15.77:0/3251331699 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9b3806bf00 0x7f9b3806e3c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9b5815c3b0 tx=0x7f9b5000d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:43.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.488+0000 7fe6f8ff9640 1 --2- 172.21.15.77:0/1258311556 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe6e806be30 0x7fe6e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.489+0000 7fe6f8ff9640 1 -- 172.21.15.77:0/1258311556 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fe6ec08ac30 con 0x7fe6fc0c2cb0 2024-04-25T01:39:43.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.489+0000 7fe6fbfff640 1 --2- 172.21.15.77:0/1258311556 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe6e806be30 0x7fe6e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.489+0000 7fe6fbfff640 1 --2- 172.21.15.77:0/1258311556 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe6e806be30 0x7fe6e806e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0034000 tx=0x7fe6f002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:43.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.490+0000 7f9b557fa640 1 -- 172.21.15.77:0/3251331699 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9b4007aab0 con 0x7f9b580c9b80 2024-04-25T01:39:43.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.498+0000 7fe6f8ff9640 1 -- 172.21.15.77:0/1258311556 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe6ec058c50 con 0x7fe6fc0c2cb0 2024-04-25T01:39:43.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.533+0000 7fe144488640 1 Processor -- start 2024-04-25T01:39:43.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.533+0000 7fe144488640 1 -- start start 2024-04-25T01:39:43.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.534+0000 7f933d929640 1 Processor -- start 2024-04-25T01:39:43.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.534+0000 7f933d929640 1 -- start start 2024-04-25T01:39:43.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.534+0000 7fe144488640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe13c1544b0 0x7fe13c15a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.534+0000 7fe144488640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe13c0c32d0 0x7fe13c06cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.534+0000 7fe144488640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe13c0c2230 con 0x7fe13c0c3a00 2024-04-25T01:39:43.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.534+0000 7fe144488640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fe13c0c2510 con 0x7fe13c0c32d0 2024-04-25T01:39:43.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.534+0000 7fe144488640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe13c0c27f0 con 0x7fe13c1544b0 2024-04-25T01:39:43.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.535+0000 7fe142a25640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe13c0c32d0 0x7fe13c06cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.535+0000 7fe142a25640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe13c0c32d0 0x7fe13c06cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:52496/0 (socket says 172.21.15.77:52496) 2024-04-25T01:39:43.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.535+0000 7fe142a25640 1 -- 172.21.15.77:0/850786120 learned_addr learned my addr 172.21.15.77:0/850786120 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:43.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.535+0000 7fe142224640 1 --2- 172.21.15.77:0/850786120 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe13c1544b0 0x7fe13c15a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.535+0000 7f933d929640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f933814e360 0x7f9338157410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.535+0000 7f933d929640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93380c6e90 con 0x7f9338154b10 2024-04-25T01:39:43.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.535+0000 7f933d929640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9338154030 con 0x7f9338157950 2024-04-25T01:39:43.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.535+0000 7f933d929640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f9338154680 con 0x7f933814e360 2024-04-25T01:39:43.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.536+0000 7f9336ffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f933814e360 0x7f9338157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.536+0000 7f9336ffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f933814e360 0x7f9338157410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:52502/0 (socket says 172.21.15.77:52502) 2024-04-25T01:39:43.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.536+0000 7f93367fc640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f9338157950 0x7f93380c9620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.77:44872/0 (socket says 172.21.15.77:44872) 2024-04-25T01:39:43.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.536+0000 7f93367fc640 1 -- 172.21.15.77:0/3101324173 learned_addr learned my addr 172.21.15.77:0/3101324173 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:43.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.536+0000 7f9336ffd640 1 -- 172.21.15.77:0/3101324173 >> v1:172.21.15.121:6789/0 conn(0x7f9338157950 legacy=0x7f93380c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.536+0000 7f9336ffd640 1 -- 172.21.15.77:0/3101324173 >> v1:172.21.15.77:6789/0 conn(0x7f9338154b10 legacy=0x7f933815e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.536+0000 7f9336ffd640 1 -- 172.21.15.77:0/3101324173 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9338154310 con 0x7f933814e360 2024-04-25T01:39:43.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.535+0000 7fe142a25640 1 -- 172.21.15.77:0/850786120 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe13c1544b0 msgr2=0x7fe13c15a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:43.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.535+0000 7fe142a25640 1 --2- 172.21.15.77:0/850786120 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe13c1544b0 0x7fe13c15a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.535+0000 7fe142a25640 1 -- 172.21.15.77:0/850786120 >> v1:172.21.15.121:6789/0 conn(0x7fe13c0c3a00 legacy=0x7fe13c0aa7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:43.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.535+0000 7fe142a25640 1 -- 172.21.15.77:0/850786120 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe13c0c2ad0 con 0x7fe13c0c32d0 2024-04-25T01:39:43.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.536+0000 7fe142a25640 1 --2- 172.21.15.77:0/850786120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe13c0c32d0 0x7fe13c06cf90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe134009e50 tx=0x7fe13402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bed8bb2812706fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:43.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.537+0000 7fe141222640 1 -- 172.21.15.77:0/850786120 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe134036070 con 0x7fe13c0c32d0 2024-04-25T01:39:43.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.537+0000 7fe141222640 1 -- 172.21.15.77:0/850786120 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe134031600 con 0x7fe13c0c32d0 2024-04-25T01:39:43.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.537+0000 7f9336ffd640 1 --2- 172.21.15.77:0/3101324173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f933814e360 0x7f9338157410 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9330009d90 tx=0x7f933002a580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6508549977b4b0c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:43.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.537+0000 7fe141222640 1 -- 172.21.15.77:0/850786120 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe134031a10 con 0x7fe13c0c32d0 2024-04-25T01:39:43.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.537+0000 7f9335ffb640 1 -- 172.21.15.77:0/3101324173 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9330007740 con 0x7f933814e360 2024-04-25T01:39:43.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.538+0000 7f9335ffb640 1 -- 172.21.15.77:0/3101324173 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93300078e0 con 0x7f933814e360 2024-04-25T01:39:43.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.538+0000 7f9335ffb640 1 -- 172.21.15.77:0/3101324173 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9330007740 con 0x7f933814e360 2024-04-25T01:39:43.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.538+0000 7fe144488640 1 -- 172.21.15.77:0/850786120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe13c0c32d0 msgr2=0x7fe13c06cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.538+0000 7fe144488640 1 --2- 172.21.15.77:0/850786120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe13c0c32d0 0x7fe13c06cf90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe134009e50 tx=0x7fe13402a6f0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.538+0000 7fe144488640 1 -- 172.21.15.77:0/850786120 shutdown_connections 2024-04-25T01:39:43.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.538+0000 7fe144488640 1 --2- 172.21.15.77:0/850786120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe13c0c32d0 0x7fe13c06cf90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.538+0000 7fe144488640 1 --2- 172.21.15.77:0/850786120 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe13c1544b0 0x7fe13c15a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.538+0000 7fe144488640 1 -- 172.21.15.77:0/850786120 >> 172.21.15.77:0/850786120 conn(0x7fe13c0c7410 msgr2=0x7fe13c0c77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:43.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.538+0000 7fe144488640 1 -- 172.21.15.77:0/850786120 shutdown_connections 2024-04-25T01:39:43.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.539+0000 7f933d929640 1 -- 172.21.15.77:0/3101324173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f933814e360 msgr2=0x7f9338157410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.539+0000 7f933d929640 1 --2- 172.21.15.77:0/3101324173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f933814e360 0x7f9338157410 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9330009d90 tx=0x7f933002a580 comp rx=0 tx=0).stop 2024-04-25T01:39:43.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.539+0000 7f933d929640 1 -- 172.21.15.77:0/3101324173 shutdown_connections 2024-04-25T01:39:43.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.539+0000 7f933d929640 1 --2- 172.21.15.77:0/3101324173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f933814e360 0x7f9338157410 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.539+0000 7f933d929640 1 -- 172.21.15.77:0/3101324173 >> 172.21.15.77:0/3101324173 conn(0x7f933806b2f0 msgr2=0x7f93380aa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:43.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.539+0000 7fe144488640 1 -- 172.21.15.77:0/850786120 wait complete. 2024-04-25T01:39:43.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.540+0000 7f933d929640 1 -- 172.21.15.77:0/3101324173 shutdown_connections 2024-04-25T01:39:43.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.540+0000 7fe144488640 1 Processor -- start 2024-04-25T01:39:43.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.540+0000 7f933d929640 1 -- 172.21.15.77:0/3101324173 wait complete. 2024-04-25T01:39:43.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.540+0000 7fe144488640 1 -- start start 2024-04-25T01:39:43.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.541+0000 7fe144488640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe13c0c32d0 0x7fe13c1487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.541+0000 7f933d929640 1 Processor -- start 2024-04-25T01:39:43.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.542+0000 7fe144488640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe13c0c3a00 0x7fe13c1f1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.542+0000 7fe144488640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe13c1544b0 0x7fe13c1f0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.542+0000 7fe142a25640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe13c1544b0 0x7fe13c1f0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.542+0000 7fe142a25640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe13c1544b0 0x7fe13c1f0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47056/0 (socket says 172.21.15.77:47056) 2024-04-25T01:39:43.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.542+0000 7fe142a25640 1 -- 172.21.15.77:0/3402505034 learned_addr learned my addr 172.21.15.77:0/3402505034 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:43.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.542+0000 7fe141a23640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe13c0c3a00 0x7fe13c1f1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.542+0000 7fe144488640 1 -- 172.21.15.77:0/3402505034 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c154890 con 0x7fe13c1544b0 2024-04-25T01:39:43.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.542+0000 7fe144488640 1 -- 172.21.15.77:0/3402505034 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c0aaef0 con 0x7fe13c0c32d0 2024-04-25T01:39:43.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.543+0000 7fe142224640 1 --2- 172.21.15.77:0/3402505034 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe13c0c32d0 0x7fe13c1487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.543+0000 7fe144488640 1 -- 172.21.15.77:0/3402505034 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe13c154a10 con 0x7fe13c0c3a00 2024-04-25T01:39:43.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.542+0000 7f933d929640 1 -- start start 2024-04-25T01:39:43.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.543+0000 7f933d929640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f933814e360 0x7f93381f40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.543+0000 7f933d929640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9338154b10 0x7f93380c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.543+0000 7f933d929640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9338157950 0x7f93381f0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.543+0000 7f933d929640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f93380c6c30 con 0x7f9338154b10 2024-04-25T01:39:43.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.543+0000 7f933d929640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f93380c6ab0 con 0x7f933814e360 2024-04-25T01:39:43.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.543+0000 7f933d929640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f93380c5d00 con 0x7f9338157950 2024-04-25T01:39:43.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.543+0000 7f93367fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9338154b10 0x7f93380c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.543+0000 7f93367fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9338154b10 0x7f93380c8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47064/0 (socket says 172.21.15.77:47064) 2024-04-25T01:39:43.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.543+0000 7f93367fc640 1 -- 172.21.15.77:0/890898084 learned_addr learned my addr 172.21.15.77:0/890898084 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:43.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.543+0000 7f93377fe640 1 --2- 172.21.15.77:0/890898084 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9338157950 0x7f93381f0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.544+0000 7f9336ffd640 1 --2- 172.21.15.77:0/890898084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f933814e360 0x7f93381f40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.544+0000 7f93377fe640 1 -- 172.21.15.77:0/890898084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f933814e360 msgr2=0x7f93381f40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.544+0000 7f93377fe640 1 --2- 172.21.15.77:0/890898084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f933814e360 0x7f93381f40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.544+0000 7f93377fe640 1 -- 172.21.15.77:0/890898084 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9338154b10 msgr2=0x7f93380c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.544+0000 7f93377fe640 1 --2- 172.21.15.77:0/890898084 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9338154b10 0x7f93380c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.544+0000 7f93377fe640 1 -- 172.21.15.77:0/890898084 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93380ab520 con 0x7f9338157950 2024-04-25T01:39:43.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.544+0000 7f93377fe640 1 --2- 172.21.15.77:0/890898084 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9338157950 0x7f93381f0810 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f932800c3f0 tx=0x7f932800c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:43.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.544+0000 7fe141a23640 1 -- 172.21.15.77:0/3402505034 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe13c0c32d0 msgr2=0x7fe13c1487b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.544+0000 7fe141a23640 1 --2- 172.21.15.77:0/3402505034 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe13c0c32d0 0x7fe13c1487b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.544+0000 7fe141a23640 1 -- 172.21.15.77:0/3402505034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe13c1544b0 msgr2=0x7fe13c1f0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.544+0000 7f931ffff640 1 -- 172.21.15.77:0/890898084 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9328017070 con 0x7f9338157950 2024-04-25T01:39:43.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.545+0000 7f933d929640 1 -- 172.21.15.77:0/890898084 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93380ab800 con 0x7f9338157950 2024-04-25T01:39:43.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.545+0000 7f933d929640 1 -- 172.21.15.77:0/890898084 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f933806d750 con 0x7f9338157950 2024-04-25T01:39:43.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.544+0000 7fe141a23640 1 --2- 172.21.15.77:0/3402505034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe13c1544b0 0x7fe13c1f0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.544+0000 7fe141a23640 1 -- 172.21.15.77:0/3402505034 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe13c15ab20 con 0x7fe13c0c3a00 2024-04-25T01:39:43.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.544+0000 7fe142a25640 1 --2- 172.21.15.77:0/3402505034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe13c1544b0 0x7fe13c1f0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:43.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.545+0000 7fe141a23640 1 --2- 172.21.15.77:0/3402505034 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe13c0c3a00 0x7fe13c1f1080 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe13800c3e0 tx=0x7fe13800c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:43.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.545+0000 7fe132ffd640 1 -- 172.21.15.77:0/3402505034 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe138011790 con 0x7fe13c0c3a00 2024-04-25T01:39:43.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.545+0000 7fe132ffd640 1 -- 172.21.15.77:0/3402505034 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe138017070 con 0x7fe13c0c3a00 2024-04-25T01:39:43.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.545+0000 7fe132ffd640 1 -- 172.21.15.77:0/3402505034 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe138011b70 con 0x7fe13c0c3a00 2024-04-25T01:39:43.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.545+0000 7fe144488640 1 -- 172.21.15.77:0/3402505034 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe13c15ae00 con 0x7fe13c0c3a00 2024-04-25T01:39:43.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.545+0000 7fe144488640 1 -- 172.21.15.77:0/3402505034 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe13c159ad0 con 0x7fe13c0c3a00 2024-04-25T01:39:43.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.547+0000 7f931ffff640 1 -- 172.21.15.77:0/890898084 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93280052f0 con 0x7f9338157950 2024-04-25T01:39:43.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.547+0000 7f931ffff640 1 -- 172.21.15.77:0/890898084 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9328003830 con 0x7f9338157950 2024-04-25T01:39:43.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.548+0000 7f933d929640 1 -- 172.21.15.77:0/890898084 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9318005290 con 0x7f9338157950 2024-04-25T01:39:43.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.547+0000 7fe130ff9640 1 -- 172.21.15.77:0/3402505034 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe118005290 con 0x7fe13c0c3a00 2024-04-25T01:39:43.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.548+0000 7f931ffff640 1 -- 172.21.15.77:0/890898084 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f932801a070 con 0x7f9338157950 2024-04-25T01:39:43.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.549+0000 7f931ffff640 1 --2- 172.21.15.77:0/890898084 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f932406bf00 0x7f932406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.549+0000 7f931ffff640 1 -- 172.21.15.77:0/890898084 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f932808a3b0 con 0x7f9338157950 2024-04-25T01:39:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.549+0000 7fe132ffd640 1 -- 172.21.15.77:0/3402505034 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe138011d10 con 0x7fe13c0c3a00 2024-04-25T01:39:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.550+0000 7fe132ffd640 1 --2- 172.21.15.77:0/3402505034 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe12006bf00 0x7fe12006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.550+0000 7fe132ffd640 1 -- 172.21.15.77:0/3402505034 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fe13808ad60 con 0x7fe13c0c3a00 2024-04-25T01:39:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.549+0000 7f9336ffd640 1 --2- 172.21.15.77:0/890898084 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f932406bf00 0x7f932406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.550+0000 7f9336ffd640 1 --2- 172.21.15.77:0/890898084 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f932406bf00 0x7f932406e3c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9330034000 tx=0x7f933002f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.550+0000 7fe142224640 1 --2- 172.21.15.77:0/3402505034 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe12006bf00 0x7fe12006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.551+0000 7fe142224640 1 --2- 172.21.15.77:0/3402505034 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe12006bf00 0x7fe12006e3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe13c155040 tx=0x7fe12c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.553+0000 7f931ffff640 1 -- 172.21.15.77:0/890898084 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9328058450 con 0x7f9338157950 2024-04-25T01:39:43.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.558+0000 7fe132ffd640 1 -- 172.21.15.77:0/3402505034 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe138058e00 con 0x7fe13c0c3a00 2024-04-25T01:39:43.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.572+0000 7efcb05fb640 1 Processor -- start 2024-04-25T01:39:43.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.572+0000 7efcb05fb640 1 -- start start 2024-04-25T01:39:43.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.572+0000 7f636bb53640 1 Processor -- start 2024-04-25T01:39:43.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.572+0000 7f636bb53640 1 -- start start 2024-04-25T01:39:43.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.573+0000 7efcb05fb640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7efca8072390 0x7efca8072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.573+0000 7efcb05fb640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efca815b840 0x7efca815a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.573+0000 7efcb05fb640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efca8154aa0 con 0x7efca80c8f00 2024-04-25T01:39:43.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.573+0000 7efcb05fb640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7efca815a890 con 0x7efca8072390 2024-04-25T01:39:43.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.573+0000 7efcb05fb640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7efca815ab30 con 0x7efca815b840 2024-04-25T01:39:43.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.573+0000 7efcae397640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7efca8072390 0x7efca8072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.574+0000 7efcae397640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7efca8072390 0x7efca8072770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:52522/0 (socket says 172.21.15.77:52522) 2024-04-25T01:39:43.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.574+0000 7efcae397640 1 -- 172.21.15.77:0/1273484547 learned_addr learned my addr 172.21.15.77:0/1273484547 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:43.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.574+0000 7efcadb96640 1 --2- 172.21.15.77:0/1273484547 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efca815b840 0x7efca815a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.574+0000 7efcae397640 1 -- 172.21.15.77:0/1273484547 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efca815b840 msgr2=0x7efca815a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:43.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.574+0000 7efcae397640 1 --2- 172.21.15.77:0/1273484547 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efca815b840 0x7efca815a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.574+0000 7efcae397640 1 -- 172.21.15.77:0/1273484547 >> v1:172.21.15.121:6789/0 conn(0x7efca80c8f00 legacy=0x7efca815dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:43.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.574+0000 7efcae397640 1 -- 172.21.15.77:0/1273484547 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca815ae10 con 0x7efca8072390 2024-04-25T01:39:43.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.573+0000 7f636bb53640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6364156660 0x7f63640c2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.573+0000 7f636bb53640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f63640c5bb0 0x7f63640c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.574+0000 7f636bb53640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6364073320 0x7f63640a6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.574+0000 7f636bb53640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f63640acc10 con 0x7f6364073320 2024-04-25T01:39:43.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.574+0000 7f636bb53640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f6364156fa0 con 0x7f63640c5bb0 2024-04-25T01:39:43.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.574+0000 7f636bb53640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f63640aceb0 con 0x7f6364156660 2024-04-25T01:39:43.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.574+0000 7f63698ef640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6364156660 0x7f63640c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.575+0000 7f636a0f0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6364073320 0x7f63640a6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.575+0000 7f63690ee640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f63640c5bb0 0x7f63640c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.575+0000 7f636a0f0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6364073320 0x7f63640a6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47072/0 (socket says 172.21.15.77:47072) 2024-04-25T01:39:43.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.575+0000 7f636a0f0640 1 -- 172.21.15.77:0/2179233862 learned_addr learned my addr 172.21.15.77:0/2179233862 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:43.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.575+0000 7f63690ee640 1 -- 172.21.15.77:0/2179233862 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6364156660 msgr2=0x7f63640c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:43.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.575+0000 7f63690ee640 1 --2- 172.21.15.77:0/2179233862 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6364156660 0x7f63640c2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.575+0000 7f63690ee640 1 -- 172.21.15.77:0/2179233862 >> v2:172.21.15.77:3300/0 conn(0x7f6364073320 msgr2=0x7f63640a6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:43.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.575+0000 7f63690ee640 1 --2- 172.21.15.77:0/2179233862 >> v2:172.21.15.77:3300/0 conn(0x7f6364073320 0x7f63640a6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.575+0000 7f63690ee640 1 -- 172.21.15.77:0/2179233862 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6364157280 con 0x7f63640c5bb0 2024-04-25T01:39:43.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.575+0000 7f63698ef640 1 --2- 172.21.15.77:0/2179233862 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6364156660 0x7f63640c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:43.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.576+0000 7f636a0f0640 1 --2- 172.21.15.77:0/2179233862 >> v2:172.21.15.77:3300/0 conn(0x7f6364073320 0x7f63640a6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:43.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.575+0000 7efcae397640 1 --2- 172.21.15.77:0/1273484547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efca8072390 0x7efca8072770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efca4009870 tx=0x7efca402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6992b7d2187b4d3d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:43.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.576+0000 7efcad395640 1 -- 172.21.15.77:0/1273484547 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca4037070 con 0x7efca8072390 2024-04-25T01:39:43.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.576+0000 7efcad395640 1 -- 172.21.15.77:0/1273484547 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efca4032440 con 0x7efca8072390 2024-04-25T01:39:43.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.576+0000 7efcad395640 1 -- 172.21.15.77:0/1273484547 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca4032850 con 0x7efca8072390 2024-04-25T01:39:43.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.577+0000 7f63690ee640 1 --2- 172.21.15.77:0/2179233862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63640c5bb0 0x7f63640c6ef0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f636406c720 tx=0x7f635402c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f63c4d6f0911fdcc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:43.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.577+0000 7efcb05fb640 1 -- 172.21.15.77:0/1273484547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efca8072390 msgr2=0x7efca8072770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.577+0000 7efcb05fb640 1 --2- 172.21.15.77:0/1273484547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efca8072390 0x7efca8072770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efca4009870 tx=0x7efca402a1a0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.577+0000 7f63688ed640 1 -- 172.21.15.77:0/2179233862 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6354038070 con 0x7f63640c5bb0 2024-04-25T01:39:43.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.577+0000 7efcb05fb640 1 -- 172.21.15.77:0/1273484547 shutdown_connections 2024-04-25T01:39:43.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.577+0000 7efcb05fb640 1 --2- 172.21.15.77:0/1273484547 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efca815b840 0x7efca815a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.577+0000 7efcb05fb640 1 --2- 172.21.15.77:0/1273484547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efca8072390 0x7efca8072770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.577+0000 7efcb05fb640 1 -- 172.21.15.77:0/1273484547 >> 172.21.15.77:0/1273484547 conn(0x7efca80c60a0 msgr2=0x7efca80c6480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:43.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.577+0000 7f63688ed640 1 -- 172.21.15.77:0/2179233862 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6354031710 con 0x7f63640c5bb0 2024-04-25T01:39:43.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.578+0000 7f636bb53640 1 -- 172.21.15.77:0/2179233862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63640c5bb0 msgr2=0x7f63640c6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.578+0000 7f636bb53640 1 --2- 172.21.15.77:0/2179233862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63640c5bb0 0x7f63640c6ef0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f636406c720 tx=0x7f635402c410 comp rx=0 tx=0).stop 2024-04-25T01:39:43.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.579+0000 7f636bb53640 1 -- 172.21.15.77:0/2179233862 shutdown_connections 2024-04-25T01:39:43.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.579+0000 7f636bb53640 1 --2- 172.21.15.77:0/2179233862 >> v2:172.21.15.77:3300/0 conn(0x7f6364073320 0x7f63640a6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.579+0000 7f636bb53640 1 --2- 172.21.15.77:0/2179233862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63640c5bb0 0x7f63640c6ef0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.579+0000 7f636bb53640 1 --2- 172.21.15.77:0/2179233862 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6364156660 0x7f63640c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.579+0000 7f636bb53640 1 -- 172.21.15.77:0/2179233862 >> 172.21.15.77:0/2179233862 conn(0x7f63640a9870 msgr2=0x7f63640a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:43.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.579+0000 7f636bb53640 1 -- 172.21.15.77:0/2179233862 shutdown_connections 2024-04-25T01:39:43.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.577+0000 7efcb05fb640 1 -- 172.21.15.77:0/1273484547 shutdown_connections 2024-04-25T01:39:43.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.577+0000 7efcb05fb640 1 -- 172.21.15.77:0/1273484547 wait complete. 2024-04-25T01:39:43.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.579+0000 7f636bb53640 1 -- 172.21.15.77:0/2179233862 wait complete. 2024-04-25T01:39:43.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.581+0000 7f636bb53640 1 Processor -- start 2024-04-25T01:39:43.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.579+0000 7efcb05fb640 1 Processor -- start 2024-04-25T01:39:43.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.579+0000 7efcb05fb640 1 -- start start 2024-04-25T01:39:43.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.580+0000 7efcb05fb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efca8072390 0x7efca814f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.580+0000 7efcb05fb640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efca80c8f00 0x7efca80700e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.580+0000 7efcb05fb640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efca815b840 0x7efca8145340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.580+0000 7efcb05fb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efca815e6f0 con 0x7efca8072390 2024-04-25T01:39:43.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.580+0000 7efcb05fb640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efca815dac0 con 0x7efca815b840 2024-04-25T01:39:43.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.580+0000 7efcb05fb640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7efca815e870 con 0x7efca80c8f00 2024-04-25T01:39:43.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.581+0000 7efcae397640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efca8072390 0x7efca814f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.581+0000 7efcae397640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efca8072390 0x7efca814f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47078/0 (socket says 172.21.15.77:47078) 2024-04-25T01:39:43.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.581+0000 7efcae397640 1 -- 172.21.15.77:0/539454220 learned_addr learned my addr 172.21.15.77:0/539454220 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:43.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.581+0000 7efcaeb98640 1 --2- 172.21.15.77:0/539454220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efca815b840 0x7efca8145340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.581+0000 7efcae397640 1 -- 172.21.15.77:0/539454220 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efca80c8f00 msgr2=0x7efca80700e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T01:39:43.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.581+0000 7efcae397640 1 --2- 172.21.15.77:0/539454220 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efca80c8f00 0x7efca80700e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.581+0000 7efcae397640 1 -- 172.21.15.77:0/539454220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efca815b840 msgr2=0x7efca8145340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.581+0000 7f636bb53640 1 -- start start 2024-04-25T01:39:43.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.581+0000 7efcae397640 1 --2- 172.21.15.77:0/539454220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efca815b840 0x7efca8145340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.582+0000 7f636bb53640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6364073320 0x7f63641fbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.581+0000 7efcae397640 1 -- 172.21.15.77:0/539454220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca806e6e0 con 0x7efca8072390 2024-04-25T01:39:43.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.581+0000 7efcae397640 1 --2- 172.21.15.77:0/539454220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efca8072390 0x7efca814f350 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efca40090b0 tx=0x7efca40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:43.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.582+0000 7efc9effd640 1 -- 172.21.15.77:0/539454220 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca4041070 con 0x7efca8072390 2024-04-25T01:39:43.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.583+0000 7f63698ef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6364073320 0x7f63641fbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.583+0000 7f63698ef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6364073320 0x7f63641fbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47088/0 (socket says 172.21.15.77:47088) 2024-04-25T01:39:43.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.582+0000 7efcb05fb640 1 -- 172.21.15.77:0/539454220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efca814f890 con 0x7efca8072390 2024-04-25T01:39:43.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.583+0000 7f63698ef640 1 -- 172.21.15.77:0/360821515 learned_addr learned my addr 172.21.15.77:0/360821515 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:43.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.583+0000 7f636bb53640 1 --2- 172.21.15.77:0/360821515 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6364156660 0x7f63641ebb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.582+0000 7efcb05fb640 1 -- 172.21.15.77:0/539454220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efca80c54b0 con 0x7efca8072390 2024-04-25T01:39:43.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.583+0000 7efc9effd640 1 -- 172.21.15.77:0/539454220 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efca403c870 con 0x7efca8072390 2024-04-25T01:39:43.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.583+0000 7f636bb53640 1 --2- 172.21.15.77:0/360821515 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6364150cd0 0x7f63641ec0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.583+0000 7efc9effd640 1 -- 172.21.15.77:0/539454220 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca4037040 con 0x7efca8072390 2024-04-25T01:39:43.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.583+0000 7f636bb53640 1 -- 172.21.15.77:0/360821515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6364156bc0 con 0x7f6364073320 2024-04-25T01:39:43.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.583+0000 7f63690ee640 1 --2- 172.21.15.77:0/360821515 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6364156660 0x7f63641ebb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.583+0000 7f636a0f0640 1 --2- 172.21.15.77:0/360821515 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6364150cd0 0x7f63641ec0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.583+0000 7f636bb53640 1 -- 172.21.15.77:0/360821515 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6364156a40 con 0x7f6364156660 2024-04-25T01:39:43.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.583+0000 7f636bb53640 1 -- 172.21.15.77:0/360821515 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f6364156d40 con 0x7f6364150cd0 2024-04-25T01:39:43.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.584+0000 7f63698ef640 1 -- 172.21.15.77:0/360821515 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6364150cd0 msgr2=0x7f63641ec0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.584+0000 7f63698ef640 1 --2- 172.21.15.77:0/360821515 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6364150cd0 0x7f63641ec0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.584+0000 7f63698ef640 1 -- 172.21.15.77:0/360821515 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6364156660 msgr2=0x7f63641ebb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.584+0000 7f63698ef640 1 --2- 172.21.15.77:0/360821515 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6364156660 0x7f63641ebb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.584+0000 7f63698ef640 1 -- 172.21.15.77:0/360821515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63641fc6c0 con 0x7f6364073320 2024-04-25T01:39:43.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.584+0000 7f63690ee640 1 --2- 172.21.15.77:0/360821515 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6364156660 0x7f63641ebb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:43.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.584+0000 7f63698ef640 1 --2- 172.21.15.77:0/360821515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6364073320 0x7f63641fbe80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f635c00c3a0 tx=0x7f635c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:43.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.585+0000 7f89db64c640 1 Processor -- start 2024-04-25T01:39:43.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.585+0000 7f89db64c640 1 -- start start 2024-04-25T01:39:43.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.586+0000 7f635a7fc640 1 -- 172.21.15.77:0/360821515 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635c018020 con 0x7f6364073320 2024-04-25T01:39:43.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.586+0000 7f636bb53640 1 -- 172.21.15.77:0/360821515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63641fc960 con 0x7f6364073320 2024-04-25T01:39:43.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.586+0000 7f636bb53640 1 -- 172.21.15.77:0/360821515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63641fc3c0 con 0x7f6364073320 2024-04-25T01:39:43.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.586+0000 7f635a7fc640 1 -- 172.21.15.77:0/360821515 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f635c014680 con 0x7f6364073320 2024-04-25T01:39:43.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.586+0000 7f635a7fc640 1 -- 172.21.15.77:0/360821515 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635c014a50 con 0x7f6364073320 2024-04-25T01:39:43.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.586+0000 7efcb05fb640 1 -- 172.21.15.77:0/539454220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efca804f500 con 0x7efca8072390 2024-04-25T01:39:43.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.587+0000 7efc9effd640 1 -- 172.21.15.77:0/539454220 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efca4044070 con 0x7efca8072390 2024-04-25T01:39:43.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.588+0000 7efc9effd640 1 --2- 172.21.15.77:0/539454220 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7efc8c06be30 0x7efc8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.588+0000 7efc9effd640 1 -- 172.21.15.77:0/539454220 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7efca40aba80 con 0x7efca8072390 2024-04-25T01:39:43.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.588+0000 7f636bb53640 1 -- 172.21.15.77:0/360821515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f634c005290 con 0x7f6364073320 2024-04-25T01:39:43.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.586+0000 7f89db64c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f89d415b520 0x7f89d415bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.586+0000 7f89db64c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89d40c6330 0x7f89d40c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.586+0000 7f89db64c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89d415b900 con 0x7f89d4066ea0 2024-04-25T01:39:43.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.586+0000 7f89db64c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f89d40c5b20 con 0x7f89d415b520 2024-04-25T01:39:43.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.586+0000 7f89db64c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f89d406e460 con 0x7f89d40c6330 2024-04-25T01:39:43.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.587+0000 7f89d93e8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f89d415b520 0x7f89d415bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.587+0000 7f89d93e8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f89d415b520 0x7f89d415bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47098/0 (socket says 172.21.15.77:47098) 2024-04-25T01:39:43.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.587+0000 7f89d93e8640 1 -- 172.21.15.77:0/3652922847 learned_addr learned my addr 172.21.15.77:0/3652922847 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:43.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.588+0000 7f89d93e8640 1 -- 172.21.15.77:0/3652922847 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89d40c6330 msgr2=0x7f89d40c67c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T01:39:43.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.588+0000 7f89d93e8640 1 --2- 172.21.15.77:0/3652922847 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89d40c6330 0x7f89d40c67c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.588+0000 7f89d93e8640 1 -- 172.21.15.77:0/3652922847 >> v1:172.21.15.77:6789/0 conn(0x7f89d4066ea0 legacy=0x7f89d406e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:43.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.588+0000 7f89d93e8640 1 -- 172.21.15.77:0/3652922847 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d4067330 con 0x7f89d415b520 2024-04-25T01:39:43.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.589+0000 7f89d93e8640 1 --2- 172.21.15.77:0/3652922847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89d415b520 0x7f89d415bc20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00b1a0 tx=0x7f89cc02a8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547b53c90787705b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:43.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.589+0000 7efcadb96640 1 --2- 172.21.15.77:0/539454220 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7efc8c06be30 0x7efc8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.589+0000 7efcadb96640 1 --2- 172.21.15.77:0/539454220 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7efc8c06be30 0x7efc8c06e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efca806de70 tx=0x7efca000b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:43.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.590+0000 7f635a7fc640 1 -- 172.21.15.77:0/360821515 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f635c005d10 con 0x7f6364073320 2024-04-25T01:39:43.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.591+0000 7f635a7fc640 1 --2- 172.21.15.77:0/360821515 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f634806beb0 0x7f634806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.591+0000 7f635a7fc640 1 -- 172.21.15.77:0/360821515 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f635c08bda0 con 0x7f6364073320 2024-04-25T01:39:43.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.591+0000 7f63690ee640 1 --2- 172.21.15.77:0/360821515 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f634806beb0 0x7f634806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.592+0000 7f63690ee640 1 --2- 172.21.15.77:0/360821515 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f634806beb0 0x7f634806e370 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6354035000 tx=0x7f6354008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:43.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.594+0000 7efc9effd640 1 -- 172.21.15.77:0/539454220 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7efca8154aa0 con 0x7efca8072390 2024-04-25T01:39:43.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.594+0000 7f89cbfff640 1 -- 172.21.15.77:0/3652922847 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc037070 con 0x7f89d415b520 2024-04-25T01:39:43.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.598+0000 7f89cbfff640 1 -- 172.21.15.77:0/3652922847 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89cc032460 con 0x7f89d415b520 2024-04-25T01:39:43.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.599+0000 7f89db64c640 1 -- 172.21.15.77:0/3652922847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89d415b520 msgr2=0x7f89d415bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.599+0000 7f89db64c640 1 --2- 172.21.15.77:0/3652922847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89d415b520 0x7f89d415bc20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00b1a0 tx=0x7f89cc02a8b0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.600+0000 7f89db64c640 1 -- 172.21.15.77:0/3652922847 shutdown_connections 2024-04-25T01:39:43.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.600+0000 7f89db64c640 1 --2- 172.21.15.77:0/3652922847 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89d40c6330 0x7f89d40c67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.600+0000 7f89db64c640 1 --2- 172.21.15.77:0/3652922847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89d415b520 0x7f89d415bc20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.600+0000 7f89db64c640 1 -- 172.21.15.77:0/3652922847 >> 172.21.15.77:0/3652922847 conn(0x7f89d40a9870 msgr2=0x7f89d40a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:43.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.599+0000 7f635a7fc640 1 -- 172.21.15.77:0/360821515 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f635c022030 con 0x7f6364073320 2024-04-25T01:39:43.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.600+0000 7f89db64c640 1 -- 172.21.15.77:0/3652922847 shutdown_connections 2024-04-25T01:39:43.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.600+0000 7f89db64c640 1 -- 172.21.15.77:0/3652922847 wait complete. 2024-04-25T01:39:43.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.602+0000 7f89db64c640 1 Processor -- start 2024-04-25T01:39:43.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.602+0000 7f89db64c640 1 -- start start 2024-04-25T01:39:43.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.603+0000 7f89db64c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89d40c6330 0x7f89d408c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.603+0000 7f89db64c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89d4201250 0x7f89d415d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.603+0000 7f89db64c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89d415d810 0x7f89d41556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.603+0000 7f89db64c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f89d4072c50 con 0x7f89d4201250 2024-04-25T01:39:43.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.603+0000 7f89db64c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f89d40c6050 con 0x7f89d415d810 2024-04-25T01:39:43.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.603+0000 7f89db64c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f89d4072dd0 con 0x7f89d40c6330 2024-04-25T01:39:43.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.603+0000 7f89d8be7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89d4201250 0x7f89d415d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.603+0000 7f89d8be7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89d4201250 0x7f89d415d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47102/0 (socket says 172.21.15.77:47102) 2024-04-25T01:39:43.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.603+0000 7f89d8be7640 1 -- 172.21.15.77:0/965024442 learned_addr learned my addr 172.21.15.77:0/965024442 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:43.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.604+0000 7f89d8be7640 1 -- 172.21.15.77:0/965024442 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89d40c6330 msgr2=0x7f89d408c740 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T01:39:43.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.604+0000 7f89d8be7640 1 --2- 172.21.15.77:0/965024442 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89d40c6330 0x7f89d408c740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.604+0000 7f89d8be7640 1 -- 172.21.15.77:0/965024442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89d415d810 msgr2=0x7f89d41556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.604+0000 7f89d8be7640 1 --2- 172.21.15.77:0/965024442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89d415d810 0x7f89d41556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.604+0000 7f89d8be7640 1 -- 172.21.15.77:0/965024442 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d4204d00 con 0x7f89d4201250 2024-04-25T01:39:43.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.604+0000 7f89d8be7640 1 --2- 172.21.15.77:0/965024442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89d4201250 0x7f89d415d2d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f89c400c410 tx=0x7f89c400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:43.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.605+0000 7f89c9ffb640 1 -- 172.21.15.77:0/965024442 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c4017070 con 0x7f89d4201250 2024-04-25T01:39:43.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.605+0000 7f89db64c640 1 -- 172.21.15.77:0/965024442 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89d4203f40 con 0x7f89d4201250 2024-04-25T01:39:43.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.605+0000 7f89db64c640 1 -- 172.21.15.77:0/965024442 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89d4204500 con 0x7f89d4201250 2024-04-25T01:39:43.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.608+0000 7f89c9ffb640 1 -- 172.21.15.77:0/965024442 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89c40035f0 con 0x7f89d4201250 2024-04-25T01:39:43.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.608+0000 7f89c9ffb640 1 -- 172.21.15.77:0/965024442 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c40039a0 con 0x7f89d4201250 2024-04-25T01:39:43.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.608+0000 7f89c9ffb640 1 -- 172.21.15.77:0/965024442 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f89c401a070 con 0x7f89d4201250 2024-04-25T01:39:43.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.609+0000 7f89c9ffb640 1 --2- 172.21.15.77:0/965024442 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f89b806bf60 0x7f89b806e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:43.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.609+0000 7f89d93e8640 1 --2- 172.21.15.77:0/965024442 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f89b806bf60 0x7f89b806e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:43.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.610+0000 7f89d93e8640 1 --2- 172.21.15.77:0/965024442 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f89b806bf60 0x7f89b806e420 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f89cc034000 tx=0x7f89cc009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:43.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.610+0000 7f89c9ffb640 1 -- 172.21.15.77:0/965024442 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f89c408a3f0 con 0x7f89d4201250 2024-04-25T01:39:43.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.613+0000 7f89db64c640 1 -- 172.21.15.77:0/965024442 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89b4005290 con 0x7f89d4201250 2024-04-25T01:39:43.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.622+0000 7f89c9ffb640 1 -- 172.21.15.77:0/965024442 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f89c4058b40 con 0x7f89d4201250 2024-04-25T01:39:43.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.831+0000 7fe172a53640 1 -- 172.21.15.77:0/3946762787 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe16c0c6890 con 0x7fe16c0c9b60 2024-04-25T01:39:43.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.831+0000 7fe168ff9640 1 -- 172.21.15.77:0/3946762787 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe15c05c600 con 0x7fe16c0c9b60 2024-04-25T01:39:43.817 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2024-04-25T01:39:43.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.834+0000 7fe172a53640 1 -- 172.21.15.77:0/3946762787 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe15806bf60 msgr2=0x7fe15806e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.834+0000 7fe172a53640 1 --2- 172.21.15.77:0/3946762787 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe15806bf60 0x7fe15806e420 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0c8250 tx=0x7fe160018040 comp rx=0 tx=0).stop 2024-04-25T01:39:43.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.834+0000 7fe172a53640 1 -- 172.21.15.77:0/3946762787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe16c0c9b60 msgr2=0x7fe16c1ed290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.834+0000 7fe172a53640 1 --2- 172.21.15.77:0/3946762787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe16c0c9b60 0x7fe16c1ed290 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe15c00c780 tx=0x7fe15c00cb80 comp rx=0 tx=0).stop 2024-04-25T01:39:43.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.834+0000 7fe172a53640 1 -- 172.21.15.77:0/3946762787 shutdown_connections 2024-04-25T01:39:43.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.834+0000 7fe172a53640 1 --2- 172.21.15.77:0/3946762787 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe15806bf60 0x7fe15806e420 secure :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0c8250 tx=0x7fe160018040 comp rx=0 tx=0).stop 2024-04-25T01:39:43.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.834+0000 7fe172a53640 1 --2- 172.21.15.77:0/3946762787 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe16c154b10 0x7fe16c14fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.834+0000 7fe172a53640 1 --2- 172.21.15.77:0/3946762787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe16c14e360 0x7fe16c14f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.834+0000 7fe172a53640 1 --2- 172.21.15.77:0/3946762787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe16c0c9b60 0x7fe16c1ed290 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.834+0000 7fe172a53640 1 -- 172.21.15.77:0/3946762787 >> 172.21.15.77:0/3946762787 conn(0x7fe16c06b2f0 msgr2=0x7fe16c072370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:43.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.835+0000 7fe172a53640 1 -- 172.21.15.77:0/3946762787 shutdown_connections 2024-04-25T01:39:43.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.835+0000 7fe172a53640 1 -- 172.21.15.77:0/3946762787 wait complete. 2024-04-25T01:39:43.834 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2024-04-25T01:39:43.834 DEBUG:teuthology.parallel:result is None 2024-04-25T01:39:43.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.913+0000 7efcb05fb640 1 -- 172.21.15.77:0/539454220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7efca80c84f0 con 0x7efca8072390 2024-04-25T01:39:43.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.913+0000 7fe70296a640 1 -- 172.21.15.77:0/1258311556 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fe6dc005850 con 0x7fe6fc0c2cb0 2024-04-25T01:39:43.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.914+0000 7efc9effd640 1 -- 172.21.15.77:0/539454220 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efca407a0f0 con 0x7efca8072390 2024-04-25T01:39:43.898 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2024-04-25T01:39:43.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.914+0000 7fe6f8ff9640 1 -- 172.21.15.77:0/1258311556 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe6ec08a070 con 0x7fe6fc0c2cb0 2024-04-25T01:39:43.898 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2024-04-25T01:39:43.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.914+0000 7f9b4effd640 1 -- 172.21.15.77:0/3251331699 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f9b3c005850 con 0x7f9b580c9b80 2024-04-25T01:39:43.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.915+0000 7f9b557fa640 1 -- 172.21.15.77:0/3251331699 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9b4007a3b0 con 0x7f9b580c9b80 2024-04-25T01:39:43.899 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2024-04-25T01:39:43.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.916+0000 7efcb05fb640 1 -- 172.21.15.77:0/539454220 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7efc8c06be30 msgr2=0x7efc8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.916+0000 7efcb05fb640 1 --2- 172.21.15.77:0/539454220 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7efc8c06be30 0x7efc8c06e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efca806de70 tx=0x7efca000b040 comp rx=0 tx=0).stop 2024-04-25T01:39:43.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.916+0000 7efcb05fb640 1 -- 172.21.15.77:0/539454220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efca8072390 msgr2=0x7efca814f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.916+0000 7efcb05fb640 1 --2- 172.21.15.77:0/539454220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efca8072390 0x7efca814f350 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efca40090b0 tx=0x7efca40046c0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.916+0000 7efcb05fb640 1 -- 172.21.15.77:0/539454220 shutdown_connections 2024-04-25T01:39:43.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.916+0000 7efcb05fb640 1 --2- 172.21.15.77:0/539454220 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7efc8c06be30 0x7efc8c06e2f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.916+0000 7efcb05fb640 1 --2- 172.21.15.77:0/539454220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efca815b840 0x7efca8145340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.916+0000 7efcb05fb640 1 --2- 172.21.15.77:0/539454220 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efca80c8f00 0x7efca80700e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.916+0000 7efcb05fb640 1 --2- 172.21.15.77:0/539454220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efca8072390 0x7efca814f350 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.916+0000 7efcb05fb640 1 -- 172.21.15.77:0/539454220 >> 172.21.15.77:0/539454220 conn(0x7efca80c60a0 msgr2=0x7efca8159f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:43.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.916+0000 7efcb05fb640 1 -- 172.21.15.77:0/539454220 shutdown_connections 2024-04-25T01:39:43.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.916+0000 7efcb05fb640 1 -- 172.21.15.77:0/539454220 wait complete. 2024-04-25T01:39:43.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.917+0000 7fe70296a640 1 -- 172.21.15.77:0/1258311556 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe6e806be30 msgr2=0x7fe6e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.917+0000 7fe70296a640 1 --2- 172.21.15.77:0/1258311556 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe6e806be30 0x7fe6e806e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0034000 tx=0x7fe6f002e000 comp rx=0 tx=0).stop 2024-04-25T01:39:43.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.917+0000 7fe70296a640 1 -- 172.21.15.77:0/1258311556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6fc0c2cb0 msgr2=0x7fe6fc1f0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.917+0000 7fe70296a640 1 --2- 172.21.15.77:0/1258311556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6fc0c2cb0 0x7fe6fc1f0060 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec00c3c0 tx=0x7fe6ec00c880 comp rx=0 tx=0).stop 2024-04-25T01:39:43.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.917+0000 7fe70296a640 1 -- 172.21.15.77:0/1258311556 shutdown_connections 2024-04-25T01:39:43.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.917+0000 7fe70296a640 1 --2- 172.21.15.77:0/1258311556 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe6e806be30 0x7fe6e806e2f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.917+0000 7fe70296a640 1 --2- 172.21.15.77:0/1258311556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6fc156430 0x7fe6fc1f3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.917+0000 7fe70296a640 1 --2- 172.21.15.77:0/1258311556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6fc0c2cb0 0x7fe6fc1f0060 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.917+0000 7fe70296a640 1 --2- 172.21.15.77:0/1258311556 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe6fc072940 0x7fe6fc14bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.917+0000 7fe70296a640 1 -- 172.21.15.77:0/1258311556 >> 172.21.15.77:0/1258311556 conn(0x7fe6fc0c7ba0 msgr2=0x7fe6fc0c7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:43.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.917+0000 7fe70296a640 1 -- 172.21.15.77:0/1258311556 shutdown_connections 2024-04-25T01:39:43.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.917+0000 7fe70296a640 1 -- 172.21.15.77:0/1258311556 wait complete. 2024-04-25T01:39:43.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.918+0000 7f9b4effd640 1 -- 172.21.15.77:0/3251331699 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9b3806bf00 msgr2=0x7f9b3806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.918+0000 7f9b4effd640 1 --2- 172.21.15.77:0/3251331699 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9b3806bf00 0x7f9b3806e3c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9b5815c3b0 tx=0x7f9b5000d040 comp rx=0 tx=0).stop 2024-04-25T01:39:43.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.918+0000 7f9b4effd640 1 -- 172.21.15.77:0/3251331699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b580c9b80 msgr2=0x7f9b581f3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.918+0000 7f9b4effd640 1 --2- 172.21.15.77:0/3251331699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b580c9b80 0x7f9b581f3520 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9b40009890 tx=0x7f9b400046c0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.918+0000 7f9b4effd640 1 -- 172.21.15.77:0/3251331699 shutdown_connections 2024-04-25T01:39:43.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.918+0000 7f9b4effd640 1 --2- 172.21.15.77:0/3251331699 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9b3806bf00 0x7f9b3806e3c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.918+0000 7f9b4effd640 1 --2- 172.21.15.77:0/3251331699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b58157b90 0x7f9b581f3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.918+0000 7f9b4effd640 1 --2- 172.21.15.77:0/3251331699 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9b5815a430 0x7f9b581f1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.918+0000 7f9b4effd640 1 --2- 172.21.15.77:0/3251331699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b580c9b80 0x7f9b581f3520 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.918+0000 7f9b4effd640 1 -- 172.21.15.77:0/3251331699 >> 172.21.15.77:0/3251331699 conn(0x7f9b5806b530 msgr2=0x7f9b580ab370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:43.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.918+0000 7f9b4effd640 1 -- 172.21.15.77:0/3251331699 shutdown_connections 2024-04-25T01:39:43.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.918+0000 7f9b4effd640 1 -- 172.21.15.77:0/3251331699 wait complete. 2024-04-25T01:39:43.913 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.3 2024-04-25T01:39:43.913 DEBUG:teuthology.parallel:result is None 2024-04-25T01:39:43.919 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2024-04-25T01:39:43.920 DEBUG:teuthology.parallel:result is None 2024-04-25T01:39:43.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2024-04-25T01:39:43.920 DEBUG:teuthology.parallel:result is None 2024-04-25T01:39:43.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.973+0000 7fe130ff9640 1 -- 172.21.15.77:0/3402505034 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe118005580 con 0x7fe13c0c3a00 2024-04-25T01:39:43.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.974+0000 7fe132ffd640 1 -- 172.21.15.77:0/3402505034 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe13805d100 con 0x7fe13c0c3a00 2024-04-25T01:39:43.957 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2024-04-25T01:39:43.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.977+0000 7fe130ff9640 1 -- 172.21.15.77:0/3402505034 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe12006bf00 msgr2=0x7fe12006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.977+0000 7fe130ff9640 1 --2- 172.21.15.77:0/3402505034 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe12006bf00 0x7fe12006e3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe13c155040 tx=0x7fe12c008040 comp rx=0 tx=0).stop 2024-04-25T01:39:43.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.977+0000 7fe130ff9640 1 -- 172.21.15.77:0/3402505034 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe13c0c3a00 msgr2=0x7fe13c1f1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.977+0000 7fe130ff9640 1 --2- 172.21.15.77:0/3402505034 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe13c0c3a00 0x7fe13c1f1080 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe13800c3e0 tx=0x7fe13800c8a0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.977+0000 7fe130ff9640 1 -- 172.21.15.77:0/3402505034 shutdown_connections 2024-04-25T01:39:43.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.977+0000 7fe130ff9640 1 --2- 172.21.15.77:0/3402505034 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe12006bf00 0x7fe12006e3c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.977+0000 7fe130ff9640 1 --2- 172.21.15.77:0/3402505034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe13c1544b0 0x7fe13c1f0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.977+0000 7fe130ff9640 1 --2- 172.21.15.77:0/3402505034 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe13c0c3a00 0x7fe13c1f1080 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.977+0000 7fe130ff9640 1 --2- 172.21.15.77:0/3402505034 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe13c0c32d0 0x7fe13c1487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.977+0000 7fe130ff9640 1 -- 172.21.15.77:0/3402505034 >> 172.21.15.77:0/3402505034 conn(0x7fe13c0c7410 msgr2=0x7fe13c06cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:43.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.977+0000 7fe130ff9640 1 -- 172.21.15.77:0/3402505034 shutdown_connections 2024-04-25T01:39:43.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.977+0000 7fe130ff9640 1 -- 172.21.15.77:0/3402505034 wait complete. 2024-04-25T01:39:43.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.977+0000 7f933d929640 1 -- 172.21.15.77:0/890898084 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f9318005580 con 0x7f9338157950 2024-04-25T01:39:43.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.977+0000 7f931ffff640 1 -- 172.21.15.77:0/890898084 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f932805c750 con 0x7f9338157950 2024-04-25T01:39:43.964 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2024-04-25T01:39:43.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.980+0000 7f933d929640 1 -- 172.21.15.77:0/890898084 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f932406bf00 msgr2=0x7f932406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.980+0000 7f933d929640 1 --2- 172.21.15.77:0/890898084 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f932406bf00 0x7f932406e3c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9330034000 tx=0x7f933002f000 comp rx=0 tx=0).stop 2024-04-25T01:39:43.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.980+0000 7f933d929640 1 -- 172.21.15.77:0/890898084 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9338157950 msgr2=0x7f93381f0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.980+0000 7f933d929640 1 --2- 172.21.15.77:0/890898084 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9338157950 0x7f93381f0810 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f932800c3f0 tx=0x7f932800c8b0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.980+0000 7f933d929640 1 -- 172.21.15.77:0/890898084 shutdown_connections 2024-04-25T01:39:43.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.980+0000 7f933d929640 1 --2- 172.21.15.77:0/890898084 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f932406bf00 0x7f932406e3c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.980+0000 7f933d929640 1 --2- 172.21.15.77:0/890898084 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9338154b10 0x7f93380c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.980+0000 7f933d929640 1 --2- 172.21.15.77:0/890898084 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9338157950 0x7f93381f0810 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.980+0000 7f933d929640 1 --2- 172.21.15.77:0/890898084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f933814e360 0x7f93381f40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.980+0000 7f933d929640 1 -- 172.21.15.77:0/890898084 >> 172.21.15.77:0/890898084 conn(0x7f933806b2f0 msgr2=0x7f93380c9620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:43.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.980+0000 7f933d929640 1 -- 172.21.15.77:0/890898084 shutdown_connections 2024-04-25T01:39:43.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.980+0000 7f933d929640 1 -- 172.21.15.77:0/890898084 wait complete. 2024-04-25T01:39:43.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.984+0000 7f636bb53640 1 -- 172.21.15.77:0/360821515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f634c005580 con 0x7f6364073320 2024-04-25T01:39:43.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.984+0000 7f635a7fc640 1 -- 172.21.15.77:0/360821515 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f635c010040 con 0x7f6364073320 2024-04-25T01:39:43.968 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2024-04-25T01:39:43.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.986+0000 7f636bb53640 1 -- 172.21.15.77:0/360821515 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f634806beb0 msgr2=0x7f634806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.986+0000 7f636bb53640 1 --2- 172.21.15.77:0/360821515 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f634806beb0 0x7f634806e370 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6354035000 tx=0x7f6354008030 comp rx=0 tx=0).stop 2024-04-25T01:39:43.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.987+0000 7f636bb53640 1 -- 172.21.15.77:0/360821515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6364073320 msgr2=0x7f63641fbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.987+0000 7f636bb53640 1 --2- 172.21.15.77:0/360821515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6364073320 0x7f63641fbe80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f635c00c3a0 tx=0x7f635c00c860 comp rx=0 tx=0).stop 2024-04-25T01:39:43.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.987+0000 7f636bb53640 1 -- 172.21.15.77:0/360821515 shutdown_connections 2024-04-25T01:39:43.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.987+0000 7f636bb53640 1 --2- 172.21.15.77:0/360821515 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f634806beb0 0x7f634806e370 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.987+0000 7f636bb53640 1 --2- 172.21.15.77:0/360821515 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6364150cd0 0x7f63641ec0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.987+0000 7f636bb53640 1 --2- 172.21.15.77:0/360821515 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6364156660 0x7f63641ebb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.987+0000 7f636bb53640 1 --2- 172.21.15.77:0/360821515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6364073320 0x7f63641fbe80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.987+0000 7f636bb53640 1 -- 172.21.15.77:0/360821515 >> 172.21.15.77:0/360821515 conn(0x7f63640a9870 msgr2=0x7f6364154940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:43.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.987+0000 7f636bb53640 1 -- 172.21.15.77:0/360821515 shutdown_connections 2024-04-25T01:39:43.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.987+0000 7f636bb53640 1 -- 172.21.15.77:0/360821515 wait complete. 2024-04-25T01:39:43.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2024-04-25T01:39:43.976 DEBUG:teuthology.parallel:result is None 2024-04-25T01:39:43.979 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2024-04-25T01:39:43.979 DEBUG:teuthology.parallel:result is None 2024-04-25T01:39:43.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.997+0000 7f89db64c640 1 -- 172.21.15.77:0/965024442 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f89b4005850 con 0x7f89d4201250 2024-04-25T01:39:43.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.997+0000 7f89c9ffb640 1 -- 172.21.15.77:0/965024442 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f89c4058440 con 0x7f89d4201250 2024-04-25T01:39:43.980 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2024-04-25T01:39:43.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.7 2024-04-25T01:39:43.981 DEBUG:teuthology.parallel:result is None 2024-04-25T01:39:43.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.999+0000 7f89db64c640 1 -- 172.21.15.77:0/965024442 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f89b806bf60 msgr2=0x7f89b806e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.999+0000 7f89db64c640 1 --2- 172.21.15.77:0/965024442 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f89b806bf60 0x7f89b806e420 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f89cc034000 tx=0x7f89cc009000 comp rx=0 tx=0).stop 2024-04-25T01:39:43.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.999+0000 7f89db64c640 1 -- 172.21.15.77:0/965024442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89d4201250 msgr2=0x7f89d415d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:43.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.999+0000 7f89db64c640 1 --2- 172.21.15.77:0/965024442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89d4201250 0x7f89d415d2d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f89c400c410 tx=0x7f89c400c8d0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.999+0000 7f89db64c640 1 -- 172.21.15.77:0/965024442 shutdown_connections 2024-04-25T01:39:43.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.999+0000 7f89db64c640 1 --2- 172.21.15.77:0/965024442 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f89b806bf60 0x7f89b806e420 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.999+0000 7f89db64c640 1 --2- 172.21.15.77:0/965024442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89d4201250 0x7f89d415d2d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.999+0000 7f89db64c640 1 --2- 172.21.15.77:0/965024442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89d415d810 0x7f89d41556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.999+0000 7f89db64c640 1 --2- 172.21.15.77:0/965024442 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89d40c6330 0x7f89d408c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:43.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.999+0000 7f89db64c640 1 -- 172.21.15.77:0/965024442 >> 172.21.15.77:0/965024442 conn(0x7f89d40a9870 msgr2=0x7f89d4159640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:43.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.999+0000 7f89db64c640 1 -- 172.21.15.77:0/965024442 shutdown_connections 2024-04-25T01:39:43.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:43.999+0000 7f89db64c640 1 -- 172.21.15.77:0/965024442 wait complete. 2024-04-25T01:39:43.993 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2024-04-25T01:39:43.993 DEBUG:teuthology.parallel:result is None 2024-04-25T01:39:43.993 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T01:39:43.993 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T01:39:44.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.146+0000 7fc4c68e1640 1 Processor -- start 2024-04-25T01:39:44.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.146+0000 7fc4c68e1640 1 -- start start 2024-04-25T01:39:44.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.147+0000 7fc4c68e1640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc4c006c280 0x7fc4c00c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:44.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.147+0000 7fc4c68e1640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4c0157130 con 0x7fc4c0150090 2024-04-25T01:39:44.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.147+0000 7fc4c68e1640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4c00c89c0 con 0x7fc4c0156c80 2024-04-25T01:39:44.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.147+0000 7fc4c68e1640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc4c006b830 con 0x7fc4c006c280 2024-04-25T01:39:44.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.147+0000 7fc4bffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc4c0150090 0x7fc4c00c8200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41566/0 (socket says 172.21.15.77:41566) 2024-04-25T01:39:44.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.147+0000 7fc4bffff640 1 -- 172.21.15.77:0/1429656598 learned_addr learned my addr 172.21.15.77:0/1429656598 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:44.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.147+0000 7fc4c4e7e640 1 --2- 172.21.15.77:0/1429656598 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc4c006c280 0x7fc4c00c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:44.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.148+0000 7fc4beffd640 1 -- 172.21.15.77:0/1429656598 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1760026520 0 0) 0x7fc4b0001110 con 0x7fc4c0150090 2024-04-25T01:39:44.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.148+0000 7fc4beffd640 1 -- 172.21.15.77:0/1429656598 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4a8003520 con 0x7fc4c0150090 2024-04-25T01:39:44.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.148+0000 7fc4beffd640 1 -- 172.21.15.77:0/1429656598 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1595822268 0 0) 0x7fc4a8003520 con 0x7fc4c0150090 2024-04-25T01:39:44.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.148+0000 7fc4beffd640 1 -- 172.21.15.77:0/1429656598 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc4c006c280 msgr2=0x7fc4c00c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:44.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.148+0000 7fc4beffd640 1 --2- 172.21.15.77:0/1429656598 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc4c006c280 0x7fc4c00c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:44.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.148+0000 7fc4beffd640 1 -- 172.21.15.77:0/1429656598 >> v1:172.21.15.121:6789/0 conn(0x7fc4c0156c80 legacy=0x7fc4c00c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:44.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.148+0000 7fc4beffd640 1 -- 172.21.15.77:0/1429656598 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4c00c8ca0 con 0x7fc4c0150090 2024-04-25T01:39:44.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.148+0000 7fc4beffd640 1 -- 172.21.15.77:0/1429656598 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7fc4b0001840 con 0x7fc4c0150090 2024-04-25T01:39:44.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.148+0000 7fc4beffd640 1 -- 172.21.15.77:0/1429656598 >> v1:172.21.15.77:6789/0 conn(0x7fc4c0150090 legacy=0x7fc4c00c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:44.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.148+0000 7fc4beffd640 1 --2- 172.21.15.77:0/1429656598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4a80039e0 0x7fc4a8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:44.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.148+0000 7fc4beffd640 1 --2- 172.21.15.77:0/1429656598 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc4c006c280 0x7fc4a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:44.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.148+0000 7fc4beffd640 1 --2- 172.21.15.77:0/1429656598 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4a8004d40 0x7fc4a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:44.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.148+0000 7fc4beffd640 1 -- 172.21.15.77:0/1429656598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c006b830 con 0x7fc4a80039e0 2024-04-25T01:39:44.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.148+0000 7fc4beffd640 1 -- 172.21.15.77:0/1429656598 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a800ba70 con 0x7fc4a8004d40 2024-04-25T01:39:44.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.148+0000 7fc4beffd640 1 -- 172.21.15.77:0/1429656598 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc4a800bc20 con 0x7fc4c006c280 2024-04-25T01:39:44.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.148+0000 7fc4bffff640 1 --2- 172.21.15.77:0/1429656598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4a80039e0 0x7fc4a8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:44.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.148+0000 7fc4bf7fe640 1 --2- 172.21.15.77:0/1429656598 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc4c006c280 0x7fc4a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:44.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.148+0000 7fc4c4e7e640 1 --2- 172.21.15.77:0/1429656598 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4a8004d40 0x7fc4a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:44.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.148+0000 7fc4bffff640 1 -- 172.21.15.77:0/1429656598 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc4c006c280 msgr2=0x7fc4a8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:44.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.148+0000 7fc4bffff640 1 --2- 172.21.15.77:0/1429656598 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc4c006c280 0x7fc4a8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:44.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.148+0000 7fc4bffff640 1 -- 172.21.15.77:0/1429656598 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4a8004d40 msgr2=0x7fc4a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:44.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.148+0000 7fc4bffff640 1 --2- 172.21.15.77:0/1429656598 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4a8004d40 0x7fc4a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:44.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.148+0000 7fc4bffff640 1 -- 172.21.15.77:0/1429656598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a8003520 con 0x7fc4a80039e0 2024-04-25T01:39:44.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.148+0000 7fc4c4e7e640 1 --2- 172.21.15.77:0/1429656598 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4a8004d40 0x7fc4a80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:44.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.149+0000 7fc4bffff640 1 --2- 172.21.15.77:0/1429656598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4a80039e0 0x7fc4a8003dc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000c320 tx=0x7fc4a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2ac998498a1dc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:44.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.149+0000 7fc4beffd640 1 -- 172.21.15.77:0/1429656598 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0035070 con 0x7fc4a80039e0 2024-04-25T01:39:44.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.149+0000 7fc4beffd640 1 -- 172.21.15.77:0/1429656598 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4b0005ad0 con 0x7fc4a80039e0 2024-04-25T01:39:44.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.149+0000 7fc4beffd640 1 -- 172.21.15.77:0/1429656598 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0007e10 con 0x7fc4a80039e0 2024-04-25T01:39:44.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.150+0000 7fc4c68e1640 1 -- 172.21.15.77:0/1429656598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4a80039e0 msgr2=0x7fc4a8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:44.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.150+0000 7fc4c68e1640 1 --2- 172.21.15.77:0/1429656598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4a80039e0 0x7fc4a8003dc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000c320 tx=0x7fc4a8005830 comp rx=0 tx=0).stop 2024-04-25T01:39:44.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.150+0000 7fc4c4e7e640 1 -- 172.21.15.77:0/1429656598 reap_dead start 2024-04-25T01:39:44.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.150+0000 7fc4c68e1640 1 -- 172.21.15.77:0/1429656598 shutdown_connections 2024-04-25T01:39:44.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.150+0000 7fc4c68e1640 1 -- 172.21.15.77:0/1429656598 >> 172.21.15.77:0/1429656598 conn(0x7fc4c00ad4d0 msgr2=0x7fc4c00ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:44.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.150+0000 7fc4c68e1640 1 -- 172.21.15.77:0/1429656598 shutdown_connections 2024-04-25T01:39:44.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.150+0000 7fc4c68e1640 1 -- 172.21.15.77:0/1429656598 wait complete. 2024-04-25T01:39:44.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.151+0000 7fc4c68e1640 1 Processor -- start 2024-04-25T01:39:44.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.151+0000 7fc4c68e1640 1 -- start start 2024-04-25T01:39:44.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.151+0000 7fc4c68e1640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc4a80039e0 0x7fc4c01ee850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:44.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.151+0000 7fc4c68e1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4c01eed90 0x7fc4c014cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:44.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.151+0000 7fc4c68e1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4c014d310 0x7fc4c0159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:44.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.151+0000 7fc4c68e1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c006c6b0 con 0x7fc4c014d310 2024-04-25T01:39:44.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.151+0000 7fc4c68e1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c006bd60 con 0x7fc4c01eed90 2024-04-25T01:39:44.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.151+0000 7fc4c68e1640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc4c006c830 con 0x7fc4a80039e0 2024-04-25T01:39:44.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.152+0000 7fc4c4e7e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4c014d310 0x7fc4c0159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.152+0000 7fc4c4e7e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4c014d310 0x7fc4c0159b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47118/0 (socket says 172.21.15.77:47118) 2024-04-25T01:39:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.152+0000 7fc4c4e7e640 1 -- 172.21.15.77:0/2203243631 learned_addr learned my addr 172.21.15.77:0/2203243631 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.152+0000 7fc4bf7fe640 1 --2- 172.21.15.77:0/2203243631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4c01eed90 0x7fc4c014cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.152+0000 7fc4bffff640 1 --2- 172.21.15.77:0/2203243631 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc4a80039e0 0x7fc4c01ee850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.152+0000 7fc4c4e7e640 1 -- 172.21.15.77:0/2203243631 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc4a80039e0 msgr2=0x7fc4c01ee850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.152+0000 7fc4c4e7e640 1 --2- 172.21.15.77:0/2203243631 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc4a80039e0 0x7fc4c01ee850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.152+0000 7fc4c4e7e640 1 -- 172.21.15.77:0/2203243631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4c01eed90 msgr2=0x7fc4c014cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.152+0000 7fc4c4e7e640 1 --2- 172.21.15.77:0/2203243631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4c01eed90 0x7fc4c014cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.152+0000 7fc4c4e7e640 1 -- 172.21.15.77:0/2203243631 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4c01effe0 con 0x7fc4c014d310 2024-04-25T01:39:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.152+0000 7fc4c4e7e640 1 --2- 172.21.15.77:0/2203243631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4c014d310 0x7fc4c0159b10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc4c00ae590 tx=0x7fc4b8010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.152+0000 7fc4bcff9640 1 -- 172.21.15.77:0/2203243631 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b801a030 con 0x7fc4c014d310 2024-04-25T01:39:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.152+0000 7fc4bcff9640 1 -- 172.21.15.77:0/2203243631 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4b8010e00 con 0x7fc4c014d310 2024-04-25T01:39:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.152+0000 7fc4c68e1640 1 -- 172.21.15.77:0/2203243631 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4c01527f0 con 0x7fc4c014d310 2024-04-25T01:39:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.152+0000 7fc4bcff9640 1 -- 172.21.15.77:0/2203243631 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b8003bd0 con 0x7fc4c014d310 2024-04-25T01:39:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.152+0000 7fc4c68e1640 1 -- 172.21.15.77:0/2203243631 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4c01efc70 con 0x7fc4c014d310 2024-04-25T01:39:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.153+0000 7fc4c68e1640 1 -- 172.21.15.77:0/2203243631 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4c004f500 con 0x7fc4c014d310 2024-04-25T01:39:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.154+0000 7fc4bcff9640 1 -- 172.21.15.77:0/2203243631 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc4b8005d10 con 0x7fc4c014d310 2024-04-25T01:39:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.154+0000 7fc4bcff9640 1 --2- 172.21.15.77:0/2203243631 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc4ac06be30 0x7fc4ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.154+0000 7fc4bffff640 1 --2- 172.21.15.77:0/2203243631 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc4ac06be30 0x7fc4ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.154+0000 7fc4bcff9640 1 -- 172.21.15.77:0/2203243631 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fc4b808b780 con 0x7fc4c014d310 2024-04-25T01:39:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.154+0000 7fc4bffff640 1 --2- 172.21.15.77:0/2203243631 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc4ac06be30 0x7fc4ac06e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0032000 tx=0x7fc4b0009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.159+0000 7fc4bcff9640 1 -- 172.21.15.77:0/2203243631 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc4b8025020 con 0x7fc4c014d310 2024-04-25T01:39:44.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.328+0000 7fc4c68e1640 1 -- 172.21.15.77:0/2203243631 --> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc4c00c9300 con 0x7fc4ac06be30 2024-04-25T01:39:44.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.338+0000 7fc4bcff9640 1 -- 172.21.15.77:0/2203243631 <== mgr.4098 v2:172.21.15.77:6832/4208232183 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490306 (secure 0 0 0) 0x7fc4c00c9300 con 0x7fc4ac06be30 2024-04-25T01:39:44.327 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:44.331 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-25T01:39:44.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.342+0000 7fc4c68e1640 1 -- 172.21.15.77:0/2203243631 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc4ac06be30 msgr2=0x7fc4ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:44.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.342+0000 7fc4c68e1640 1 --2- 172.21.15.77:0/2203243631 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc4ac06be30 0x7fc4ac06e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0032000 tx=0x7fc4b0009030 comp rx=0 tx=0).stop 2024-04-25T01:39:44.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.342+0000 7fc4c68e1640 1 -- 172.21.15.77:0/2203243631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4c014d310 msgr2=0x7fc4c0159b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:44.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.342+0000 7fc4c68e1640 1 --2- 172.21.15.77:0/2203243631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4c014d310 0x7fc4c0159b10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc4c00ae590 tx=0x7fc4b8010590 comp rx=0 tx=0).stop 2024-04-25T01:39:44.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.342+0000 7fc4c68e1640 1 -- 172.21.15.77:0/2203243631 shutdown_connections 2024-04-25T01:39:44.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.342+0000 7fc4c68e1640 1 --2- 172.21.15.77:0/2203243631 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc4ac06be30 0x7fc4ac06e2f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:44.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.342+0000 7fc4c68e1640 1 --2- 172.21.15.77:0/2203243631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4c014d310 0x7fc4c0159b10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:44.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.342+0000 7fc4c68e1640 1 --2- 172.21.15.77:0/2203243631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4c01eed90 0x7fc4c014cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:44.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.342+0000 7fc4c68e1640 1 --2- 172.21.15.77:0/2203243631 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc4a80039e0 0x7fc4c01ee850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:44.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.342+0000 7fc4c68e1640 1 -- 172.21.15.77:0/2203243631 >> 172.21.15.77:0/2203243631 conn(0x7fc4c00ad4d0 msgr2=0x7fc4c014f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:44.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.342+0000 7fc4c68e1640 1 -- 172.21.15.77:0/2203243631 shutdown_connections 2024-04-25T01:39:44.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.342+0000 7fc4c68e1640 1 -- 172.21.15.77:0/2203243631 wait complete. 2024-04-25T01:39:44.337 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-04-25T01:39:43.655182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":249,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219460,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755260,"statfs":{"total":773094113280,"available":772869386240,"internally_reserved":0,"allocated":3350528,"data_stored":1984464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002553"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197412+0000","last_change":"2024-04-25T01:39:33.445614+0000","last_active":"2024-04-25T01:39:35.197412+0000","last_peered":"2024-04-25T01:39:35.197412+0000","last_clean":"2024-04-25T01:39:35.197412+0000","last_became_active":"2024-04-25T01:39:33.445090+0000","last_became_peered":"2024-04-25T01:39:33.445090+0000","last_unstale":"2024-04-25T01:39:35.197412+0000","last_undegraded":"2024-04-25T01:39:35.197412+0000","last_fullsized":"2024-04-25T01:39:35.197412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:50.951488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559582+0000","last_change":"2024-04-25T01:39:23.377096+0000","last_active":"2024-04-25T01:39:34.559582+0000","last_peered":"2024-04-25T01:39:34.559582+0000","last_clean":"2024-04-25T01:39:34.559582+0000","last_became_active":"2024-04-25T01:39:23.376811+0000","last_became_peered":"2024-04-25T01:39:23.376811+0000","last_unstale":"2024-04-25T01:39:34.559582+0000","last_undegraded":"2024-04-25T01:39:34.559582+0000","last_fullsized":"2024-04-25T01:39:34.559582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:26.888605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430280+0000","last_change":"2024-04-25T01:39:24.394317+0000","last_active":"2024-04-25T01:39:34.430280+0000","last_peered":"2024-04-25T01:39:34.430280+0000","last_clean":"2024-04-25T01:39:34.430280+0000","last_became_active":"2024-04-25T01:39:24.394032+0000","last_became_peered":"2024-04-25T01:39:24.394032+0000","last_unstale":"2024-04-25T01:39:34.430280+0000","last_undegraded":"2024-04-25T01:39:34.430280+0000","last_fullsized":"2024-04-25T01:39:34.430280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:11.795443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429310+0000","last_change":"2024-04-25T01:39:32.421607+0000","last_active":"2024-04-25T01:39:34.429310+0000","last_peered":"2024-04-25T01:39:34.429310+0000","last_clean":"2024-04-25T01:39:34.429310+0000","last_became_active":"2024-04-25T01:39:32.421355+0000","last_became_peered":"2024-04-25T01:39:32.421355+0000","last_unstale":"2024-04-25T01:39:34.429310+0000","last_undegraded":"2024-04-25T01:39:34.429310+0000","last_fullsized":"2024-04-25T01:39:34.429310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:12:14.019262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198433+0000","last_change":"2024-04-25T01:39:33.436651+0000","last_active":"2024-04-25T01:39:35.198433+0000","last_peered":"2024-04-25T01:39:35.198433+0000","last_clean":"2024-04-25T01:39:35.198433+0000","last_became_active":"2024-04-25T01:39:33.436370+0000","last_became_peered":"2024-04-25T01:39:33.436370+0000","last_unstale":"2024-04-25T01:39:35.198433+0000","last_undegraded":"2024-04-25T01:39:35.198433+0000","last_fullsized":"2024-04-25T01:39:35.198433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:57:10.341738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430287+0000","last_change":"2024-04-25T01:39:23.369400+0000","last_active":"2024-04-25T01:39:34.430287+0000","last_peered":"2024-04-25T01:39:34.430287+0000","last_clean":"2024-04-25T01:39:34.430287+0000","last_became_active":"2024-04-25T01:39:23.368726+0000","last_became_peered":"2024-04-25T01:39:23.368726+0000","last_unstale":"2024-04-25T01:39:34.430287+0000","last_undegraded":"2024-04-25T01:39:34.430287+0000","last_fullsized":"2024-04-25T01:39:34.430287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:35:42.971179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559440+0000","last_change":"2024-04-25T01:39:24.403873+0000","last_active":"2024-04-25T01:39:34.559440+0000","last_peered":"2024-04-25T01:39:34.559440+0000","last_clean":"2024-04-25T01:39:34.559440+0000","last_became_active":"2024-04-25T01:39:24.403623+0000","last_became_peered":"2024-04-25T01:39:24.403623+0000","last_unstale":"2024-04-25T01:39:34.559440+0000","last_undegraded":"2024-04-25T01:39:34.559440+0000","last_fullsized":"2024-04-25T01:39:34.559440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:49.360933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197343+0000","last_change":"2024-04-25T01:39:32.430985+0000","last_active":"2024-04-25T01:39:35.197343+0000","last_peered":"2024-04-25T01:39:35.197343+0000","last_clean":"2024-04-25T01:39:35.197343+0000","last_became_active":"2024-04-25T01:39:32.430617+0000","last_became_peered":"2024-04-25T01:39:32.430617+0000","last_unstale":"2024-04-25T01:39:35.197343+0000","last_undegraded":"2024-04-25T01:39:35.197343+0000","last_fullsized":"2024-04-25T01:39:35.197343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:13.938619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199408+0000","last_change":"2024-04-25T01:39:33.444043+0000","last_active":"2024-04-25T01:39:35.199408+0000","last_peered":"2024-04-25T01:39:35.199408+0000","last_clean":"2024-04-25T01:39:35.199408+0000","last_became_active":"2024-04-25T01:39:33.443737+0000","last_became_peered":"2024-04-25T01:39:33.443737+0000","last_unstale":"2024-04-25T01:39:35.199408+0000","last_undegraded":"2024-04-25T01:39:35.199408+0000","last_fullsized":"2024-04-25T01:39:35.199408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:02:50.401910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199857+0000","last_change":"2024-04-25T01:39:23.377963+0000","last_active":"2024-04-25T01:39:35.199857+0000","last_peered":"2024-04-25T01:39:35.199857+0000","last_clean":"2024-04-25T01:39:35.199857+0000","last_became_active":"2024-04-25T01:39:23.377402+0000","last_became_peered":"2024-04-25T01:39:23.377402+0000","last_unstale":"2024-04-25T01:39:35.199857+0000","last_undegraded":"2024-04-25T01:39:35.199857+0000","last_fullsized":"2024-04-25T01:39:35.199857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:15.873450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199352+0000","last_change":"2024-04-25T01:39:24.394512+0000","last_active":"2024-04-25T01:39:35.199352+0000","last_peered":"2024-04-25T01:39:35.199352+0000","last_clean":"2024-04-25T01:39:35.199352+0000","last_became_active":"2024-04-25T01:39:24.393954+0000","last_became_peered":"2024-04-25T01:39:24.393954+0000","last_unstale":"2024-04-25T01:39:35.199352+0000","last_undegraded":"2024-04-25T01:39:35.199352+0000","last_fullsized":"2024-04-25T01:39:35.199352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:30.534400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197850+0000","last_change":"2024-04-25T01:39:32.428198+0000","last_active":"2024-04-25T01:39:35.197850+0000","last_peered":"2024-04-25T01:39:35.197850+0000","last_clean":"2024-04-25T01:39:35.197850+0000","last_became_active":"2024-04-25T01:39:32.427955+0000","last_became_peered":"2024-04-25T01:39:32.427955+0000","last_unstale":"2024-04-25T01:39:35.197850+0000","last_undegraded":"2024-04-25T01:39:35.197850+0000","last_fullsized":"2024-04-25T01:39:35.197850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:07.684150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198064+0000","last_change":"2024-04-25T01:39:33.439854+0000","last_active":"2024-04-25T01:39:35.198064+0000","last_peered":"2024-04-25T01:39:35.198064+0000","last_clean":"2024-04-25T01:39:35.198064+0000","last_became_active":"2024-04-25T01:39:33.439555+0000","last_became_peered":"2024-04-25T01:39:33.439555+0000","last_unstale":"2024-04-25T01:39:35.198064+0000","last_undegraded":"2024-04-25T01:39:35.198064+0000","last_fullsized":"2024-04-25T01:39:35.198064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:50.250748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198904+0000","last_change":"2024-04-25T01:39:23.377093+0000","last_active":"2024-04-25T01:39:35.198904+0000","last_peered":"2024-04-25T01:39:35.198904+0000","last_clean":"2024-04-25T01:39:35.198904+0000","last_became_active":"2024-04-25T01:39:23.376744+0000","last_became_peered":"2024-04-25T01:39:23.376744+0000","last_unstale":"2024-04-25T01:39:35.198904+0000","last_undegraded":"2024-04-25T01:39:35.198904+0000","last_fullsized":"2024-04-25T01:39:35.198904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:43.529618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200129+0000","last_change":"2024-04-25T01:39:24.393293+0000","last_active":"2024-04-25T01:39:35.200129+0000","last_peered":"2024-04-25T01:39:35.200129+0000","last_clean":"2024-04-25T01:39:35.200129+0000","last_became_active":"2024-04-25T01:39:24.393005+0000","last_became_peered":"2024-04-25T01:39:24.393005+0000","last_unstale":"2024-04-25T01:39:35.200129+0000","last_undegraded":"2024-04-25T01:39:35.200129+0000","last_fullsized":"2024-04-25T01:39:35.200129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:32.070747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197654+0000","last_change":"2024-04-25T01:39:32.428956+0000","last_active":"2024-04-25T01:39:35.197654+0000","last_peered":"2024-04-25T01:39:35.197654+0000","last_clean":"2024-04-25T01:39:35.197654+0000","last_became_active":"2024-04-25T01:39:32.428705+0000","last_became_peered":"2024-04-25T01:39:32.428705+0000","last_unstale":"2024-04-25T01:39:35.197654+0000","last_undegraded":"2024-04-25T01:39:35.197654+0000","last_fullsized":"2024-04-25T01:39:35.197654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:06:22.998986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198197+0000","last_change":"2024-04-25T01:39:33.446571+0000","last_active":"2024-04-25T01:39:35.198197+0000","last_peered":"2024-04-25T01:39:35.198197+0000","last_clean":"2024-04-25T01:39:35.198197+0000","last_became_active":"2024-04-25T01:39:33.446234+0000","last_became_peered":"2024-04-25T01:39:33.446234+0000","last_unstale":"2024-04-25T01:39:35.198197+0000","last_undegraded":"2024-04-25T01:39:35.198197+0000","last_fullsized":"2024-04-25T01:39:35.198197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:12.742092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434733+0000","last_change":"2024-04-25T01:39:24.398859+0000","last_active":"2024-04-25T01:39:34.434733+0000","last_peered":"2024-04-25T01:39:34.434733+0000","last_clean":"2024-04-25T01:39:34.434733+0000","last_became_active":"2024-04-25T01:39:24.398618+0000","last_became_peered":"2024-04-25T01:39:24.398618+0000","last_unstale":"2024-04-25T01:39:34.434733+0000","last_undegraded":"2024-04-25T01:39:34.434733+0000","last_fullsized":"2024-04-25T01:39:34.434733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:15.278376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199208+0000","last_change":"2024-04-25T01:39:23.377717+0000","last_active":"2024-04-25T01:39:35.199208+0000","last_peered":"2024-04-25T01:39:35.199208+0000","last_clean":"2024-04-25T01:39:35.199208+0000","last_became_active":"2024-04-25T01:39:23.377291+0000","last_became_peered":"2024-04-25T01:39:23.377291+0000","last_unstale":"2024-04-25T01:39:35.199208+0000","last_undegraded":"2024-04-25T01:39:35.199208+0000","last_fullsized":"2024-04-25T01:39:35.199208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:06.402745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197947+0000","last_change":"2024-04-25T01:39:32.426840+0000","last_active":"2024-04-25T01:39:35.197947+0000","last_peered":"2024-04-25T01:39:35.197947+0000","last_clean":"2024-04-25T01:39:35.197947+0000","last_became_active":"2024-04-25T01:39:32.426529+0000","last_became_peered":"2024-04-25T01:39:32.426529+0000","last_unstale":"2024-04-25T01:39:35.197947+0000","last_undegraded":"2024-04-25T01:39:35.197947+0000","last_fullsized":"2024-04-25T01:39:35.197947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:57.097685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198092+0000","last_change":"2024-04-25T01:39:33.437767+0000","last_active":"2024-04-25T01:39:35.198092+0000","last_peered":"2024-04-25T01:39:35.198092+0000","last_clean":"2024-04-25T01:39:35.198092+0000","last_became_active":"2024-04-25T01:39:33.437483+0000","last_became_peered":"2024-04-25T01:39:33.437483+0000","last_unstale":"2024-04-25T01:39:35.198092+0000","last_undegraded":"2024-04-25T01:39:35.198092+0000","last_fullsized":"2024-04-25T01:39:35.198092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:44.321779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429750+0000","last_change":"2024-04-25T01:39:24.387100+0000","last_active":"2024-04-25T01:39:34.429750+0000","last_peered":"2024-04-25T01:39:34.429750+0000","last_clean":"2024-04-25T01:39:34.429750+0000","last_became_active":"2024-04-25T01:39:24.386782+0000","last_became_peered":"2024-04-25T01:39:24.386782+0000","last_unstale":"2024-04-25T01:39:34.429750+0000","last_undegraded":"2024-04-25T01:39:34.429750+0000","last_fullsized":"2024-04-25T01:39:34.429750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:48.789139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198800+0000","last_change":"2024-04-25T01:39:23.368446+0000","last_active":"2024-04-25T01:39:35.198800+0000","last_peered":"2024-04-25T01:39:35.198800+0000","last_clean":"2024-04-25T01:39:35.198800+0000","last_became_active":"2024-04-25T01:39:23.368183+0000","last_became_peered":"2024-04-25T01:39:23.368183+0000","last_unstale":"2024-04-25T01:39:35.198800+0000","last_undegraded":"2024-04-25T01:39:35.198800+0000","last_fullsized":"2024-04-25T01:39:35.198800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:13.738756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198383+0000","last_change":"2024-04-25T01:39:32.427589+0000","last_active":"2024-04-25T01:39:35.198383+0000","last_peered":"2024-04-25T01:39:35.198383+0000","last_clean":"2024-04-25T01:39:35.198383+0000","last_became_active":"2024-04-25T01:39:32.427328+0000","last_became_peered":"2024-04-25T01:39:32.427328+0000","last_unstale":"2024-04-25T01:39:35.198383+0000","last_undegraded":"2024-04-25T01:39:35.198383+0000","last_fullsized":"2024-04-25T01:39:35.198383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:12.328303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199145+0000","last_change":"2024-04-25T01:39:33.447634+0000","last_active":"2024-04-25T01:39:35.199145+0000","last_peered":"2024-04-25T01:39:35.199145+0000","last_clean":"2024-04-25T01:39:35.199145+0000","last_became_active":"2024-04-25T01:39:33.445908+0000","last_became_peered":"2024-04-25T01:39:33.445908+0000","last_unstale":"2024-04-25T01:39:35.199145+0000","last_undegraded":"2024-04-25T01:39:35.199145+0000","last_fullsized":"2024-04-25T01:39:35.199145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:13.586396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429559+0000","last_change":"2024-04-25T01:39:24.373600+0000","last_active":"2024-04-25T01:39:34.429559+0000","last_peered":"2024-04-25T01:39:34.429559+0000","last_clean":"2024-04-25T01:39:34.429559+0000","last_became_active":"2024-04-25T01:39:24.373311+0000","last_became_peered":"2024-04-25T01:39:24.373311+0000","last_unstale":"2024-04-25T01:39:34.429559+0000","last_undegraded":"2024-04-25T01:39:34.429559+0000","last_fullsized":"2024-04-25T01:39:34.429559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:46.338959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197953+0000","last_change":"2024-04-25T01:39:23.377103+0000","last_active":"2024-04-25T01:39:35.197953+0000","last_peered":"2024-04-25T01:39:35.197953+0000","last_clean":"2024-04-25T01:39:35.197953+0000","last_became_active":"2024-04-25T01:39:23.376826+0000","last_became_peered":"2024-04-25T01:39:23.376826+0000","last_unstale":"2024-04-25T01:39:35.197953+0000","last_undegraded":"2024-04-25T01:39:35.197953+0000","last_fullsized":"2024-04-25T01:39:35.197953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:46.663754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198643+0000","last_change":"2024-04-25T01:39:32.426839+0000","last_active":"2024-04-25T01:39:35.198643+0000","last_peered":"2024-04-25T01:39:35.198643+0000","last_clean":"2024-04-25T01:39:35.198643+0000","last_became_active":"2024-04-25T01:39:32.426545+0000","last_became_peered":"2024-04-25T01:39:32.426545+0000","last_unstale":"2024-04-25T01:39:35.198643+0000","last_undegraded":"2024-04-25T01:39:35.198643+0000","last_fullsized":"2024-04-25T01:39:35.198643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:22.161839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199023+0000","last_change":"2024-04-25T01:39:33.444616+0000","last_active":"2024-04-25T01:39:35.199023+0000","last_peered":"2024-04-25T01:39:35.199023+0000","last_clean":"2024-04-25T01:39:35.199023+0000","last_became_active":"2024-04-25T01:39:33.444350+0000","last_became_peered":"2024-04-25T01:39:33.444350+0000","last_unstale":"2024-04-25T01:39:35.199023+0000","last_undegraded":"2024-04-25T01:39:35.199023+0000","last_fullsized":"2024-04-25T01:39:35.199023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:47:15.686320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198460+0000","last_change":"2024-04-25T01:39:24.386969+0000","last_active":"2024-04-25T01:39:35.198460+0000","last_peered":"2024-04-25T01:39:35.198460+0000","last_clean":"2024-04-25T01:39:35.198460+0000","last_became_active":"2024-04-25T01:39:24.386376+0000","last_became_peered":"2024-04-25T01:39:24.386376+0000","last_unstale":"2024-04-25T01:39:35.198460+0000","last_undegraded":"2024-04-25T01:39:35.198460+0000","last_fullsized":"2024-04-25T01:39:35.198460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:13:31.585462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198150+0000","last_change":"2024-04-25T01:39:23.378993+0000","last_active":"2024-04-25T01:39:35.198150+0000","last_peered":"2024-04-25T01:39:35.198150+0000","last_clean":"2024-04-25T01:39:35.198150+0000","last_became_active":"2024-04-25T01:39:23.376908+0000","last_became_peered":"2024-04-25T01:39:23.376908+0000","last_unstale":"2024-04-25T01:39:35.198150+0000","last_undegraded":"2024-04-25T01:39:35.198150+0000","last_fullsized":"2024-04-25T01:39:35.198150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:13:18.370559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199153+0000","last_change":"2024-04-25T01:39:32.433597+0000","last_active":"2024-04-25T01:39:35.199153+0000","last_peered":"2024-04-25T01:39:35.199153+0000","last_clean":"2024-04-25T01:39:35.199153+0000","last_became_active":"2024-04-25T01:39:32.433307+0000","last_became_peered":"2024-04-25T01:39:32.433307+0000","last_unstale":"2024-04-25T01:39:35.199153+0000","last_undegraded":"2024-04-25T01:39:35.199153+0000","last_fullsized":"2024-04-25T01:39:35.199153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:20.784385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429204+0000","last_change":"2024-04-25T01:39:33.427297+0000","last_active":"2024-04-25T01:39:34.429204+0000","last_peered":"2024-04-25T01:39:34.429204+0000","last_clean":"2024-04-25T01:39:34.429204+0000","last_became_active":"2024-04-25T01:39:33.426132+0000","last_became_peered":"2024-04-25T01:39:33.426132+0000","last_unstale":"2024-04-25T01:39:34.429204+0000","last_undegraded":"2024-04-25T01:39:34.429204+0000","last_fullsized":"2024-04-25T01:39:34.429204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:04.147341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559652+0000","last_change":"2024-04-25T01:39:24.393003+0000","last_active":"2024-04-25T01:39:34.559652+0000","last_peered":"2024-04-25T01:39:34.559652+0000","last_clean":"2024-04-25T01:39:34.559652+0000","last_became_active":"2024-04-25T01:39:24.392209+0000","last_became_peered":"2024-04-25T01:39:24.392209+0000","last_unstale":"2024-04-25T01:39:34.559652+0000","last_undegraded":"2024-04-25T01:39:34.559652+0000","last_fullsized":"2024-04-25T01:39:34.559652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:44:58.432859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434880+0000","last_change":"2024-04-25T01:39:23.379804+0000","last_active":"2024-04-25T01:39:34.434880+0000","last_peered":"2024-04-25T01:39:34.434880+0000","last_clean":"2024-04-25T01:39:34.434880+0000","last_became_active":"2024-04-25T01:39:23.379430+0000","last_became_peered":"2024-04-25T01:39:23.379430+0000","last_unstale":"2024-04-25T01:39:34.434880+0000","last_undegraded":"2024-04-25T01:39:34.434880+0000","last_fullsized":"2024-04-25T01:39:34.434880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:42:23.254767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198196+0000","last_change":"2024-04-25T01:39:32.432763+0000","last_active":"2024-04-25T01:39:35.198196+0000","last_peered":"2024-04-25T01:39:35.198196+0000","last_clean":"2024-04-25T01:39:35.198196+0000","last_became_active":"2024-04-25T01:39:32.432482+0000","last_became_peered":"2024-04-25T01:39:32.432482+0000","last_unstale":"2024-04-25T01:39:35.198196+0000","last_undegraded":"2024-04-25T01:39:35.198196+0000","last_fullsized":"2024-04-25T01:39:35.198196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:04.848726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197990+0000","last_change":"2024-04-25T01:39:33.445800+0000","last_active":"2024-04-25T01:39:35.197990+0000","last_peered":"2024-04-25T01:39:35.197990+0000","last_clean":"2024-04-25T01:39:35.197990+0000","last_became_active":"2024-04-25T01:39:33.445500+0000","last_became_peered":"2024-04-25T01:39:33.445500+0000","last_unstale":"2024-04-25T01:39:35.197990+0000","last_undegraded":"2024-04-25T01:39:35.197990+0000","last_fullsized":"2024-04-25T01:39:35.197990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:06:36.800043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430196+0000","last_change":"2024-04-25T01:39:24.375811+0000","last_active":"2024-04-25T01:39:34.430196+0000","last_peered":"2024-04-25T01:39:34.430196+0000","last_clean":"2024-04-25T01:39:34.430196+0000","last_became_active":"2024-04-25T01:39:24.375603+0000","last_became_peered":"2024-04-25T01:39:24.375603+0000","last_unstale":"2024-04-25T01:39:34.430196+0000","last_undegraded":"2024-04-25T01:39:34.430196+0000","last_fullsized":"2024-04-25T01:39:34.430196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:10:26.247501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198161+0000","last_change":"2024-04-25T01:39:23.377687+0000","last_active":"2024-04-25T01:39:35.198161+0000","last_peered":"2024-04-25T01:39:35.198161+0000","last_clean":"2024-04-25T01:39:35.198161+0000","last_became_active":"2024-04-25T01:39:23.377372+0000","last_became_peered":"2024-04-25T01:39:23.377372+0000","last_unstale":"2024-04-25T01:39:35.198161+0000","last_undegraded":"2024-04-25T01:39:35.198161+0000","last_fullsized":"2024-04-25T01:39:35.198161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:51.983659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429145+0000","last_change":"2024-04-25T01:39:32.430816+0000","last_active":"2024-04-25T01:39:34.429145+0000","last_peered":"2024-04-25T01:39:34.429145+0000","last_clean":"2024-04-25T01:39:34.429145+0000","last_became_active":"2024-04-25T01:39:32.430537+0000","last_became_peered":"2024-04-25T01:39:32.430537+0000","last_unstale":"2024-04-25T01:39:34.429145+0000","last_undegraded":"2024-04-25T01:39:34.429145+0000","last_fullsized":"2024-04-25T01:39:34.429145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:58.939453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434436+0000","last_change":"2024-04-25T01:39:33.440287+0000","last_active":"2024-04-25T01:39:34.434436+0000","last_peered":"2024-04-25T01:39:34.434436+0000","last_clean":"2024-04-25T01:39:34.434436+0000","last_became_active":"2024-04-25T01:39:33.439796+0000","last_became_peered":"2024-04-25T01:39:33.439796+0000","last_unstale":"2024-04-25T01:39:34.434436+0000","last_undegraded":"2024-04-25T01:39:34.434436+0000","last_fullsized":"2024-04-25T01:39:34.434436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:08.515401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198342+0000","last_change":"2024-04-25T01:39:24.376933+0000","last_active":"2024-04-25T01:39:35.198342+0000","last_peered":"2024-04-25T01:39:35.198342+0000","last_clean":"2024-04-25T01:39:35.198342+0000","last_became_active":"2024-04-25T01:39:24.376612+0000","last_became_peered":"2024-04-25T01:39:24.376612+0000","last_unstale":"2024-04-25T01:39:35.198342+0000","last_undegraded":"2024-04-25T01:39:35.198342+0000","last_fullsized":"2024-04-25T01:39:35.198342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:56:55.534200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199969+0000","last_change":"2024-04-25T01:39:23.378190+0000","last_active":"2024-04-25T01:39:35.199969+0000","last_peered":"2024-04-25T01:39:35.199969+0000","last_clean":"2024-04-25T01:39:35.199969+0000","last_became_active":"2024-04-25T01:39:23.377677+0000","last_became_peered":"2024-04-25T01:39:23.377677+0000","last_unstale":"2024-04-25T01:39:35.199969+0000","last_undegraded":"2024-04-25T01:39:35.199969+0000","last_fullsized":"2024-04-25T01:39:35.199969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:09.516058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559452+0000","last_change":"2024-04-25T01:39:32.431542+0000","last_active":"2024-04-25T01:39:34.559452+0000","last_peered":"2024-04-25T01:39:34.559452+0000","last_clean":"2024-04-25T01:39:34.559452+0000","last_became_active":"2024-04-25T01:39:32.431253+0000","last_became_peered":"2024-04-25T01:39:32.431253+0000","last_unstale":"2024-04-25T01:39:34.559452+0000","last_undegraded":"2024-04-25T01:39:34.559452+0000","last_fullsized":"2024-04-25T01:39:34.559452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:36.723239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559765+0000","last_change":"2024-04-25T01:39:33.448529+0000","last_active":"2024-04-25T01:39:34.559765+0000","last_peered":"2024-04-25T01:39:34.559765+0000","last_clean":"2024-04-25T01:39:34.559765+0000","last_became_active":"2024-04-25T01:39:33.448266+0000","last_became_peered":"2024-04-25T01:39:33.448266+0000","last_unstale":"2024-04-25T01:39:34.559765+0000","last_undegraded":"2024-04-25T01:39:34.559765+0000","last_fullsized":"2024-04-25T01:39:34.559765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:18.788470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200112+0000","last_change":"2024-04-25T01:39:24.390844+0000","last_active":"2024-04-25T01:39:35.200112+0000","last_peered":"2024-04-25T01:39:35.200112+0000","last_clean":"2024-04-25T01:39:35.200112+0000","last_became_active":"2024-04-25T01:39:24.390543+0000","last_became_peered":"2024-04-25T01:39:24.390543+0000","last_unstale":"2024-04-25T01:39:35.200112+0000","last_undegraded":"2024-04-25T01:39:35.200112+0000","last_fullsized":"2024-04-25T01:39:35.200112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:01:03.804058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198467+0000","last_change":"2024-04-25T01:39:23.368562+0000","last_active":"2024-04-25T01:39:35.198467+0000","last_peered":"2024-04-25T01:39:35.198467+0000","last_clean":"2024-04-25T01:39:35.198467+0000","last_became_active":"2024-04-25T01:39:23.368272+0000","last_became_peered":"2024-04-25T01:39:23.368272+0000","last_unstale":"2024-04-25T01:39:35.198467+0000","last_undegraded":"2024-04-25T01:39:35.198467+0000","last_fullsized":"2024-04-25T01:39:35.198467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:15.464993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198483+0000","last_change":"2024-04-25T01:39:32.430196+0000","last_active":"2024-04-25T01:39:35.198483+0000","last_peered":"2024-04-25T01:39:35.198483+0000","last_clean":"2024-04-25T01:39:35.198483+0000","last_became_active":"2024-04-25T01:39:32.429759+0000","last_became_peered":"2024-04-25T01:39:32.429759+0000","last_unstale":"2024-04-25T01:39:35.198483+0000","last_undegraded":"2024-04-25T01:39:35.198483+0000","last_fullsized":"2024-04-25T01:39:35.198483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:58:09.299194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559415+0000","last_change":"2024-04-25T01:39:33.440935+0000","last_active":"2024-04-25T01:39:34.559415+0000","last_peered":"2024-04-25T01:39:34.559415+0000","last_clean":"2024-04-25T01:39:34.559415+0000","last_became_active":"2024-04-25T01:39:33.439344+0000","last_became_peered":"2024-04-25T01:39:33.439344+0000","last_unstale":"2024-04-25T01:39:34.559415+0000","last_undegraded":"2024-04-25T01:39:34.559415+0000","last_fullsized":"2024-04-25T01:39:34.559415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:23.928991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199059+0000","last_change":"2024-04-25T01:39:24.389203+0000","last_active":"2024-04-25T01:39:35.199059+0000","last_peered":"2024-04-25T01:39:35.199059+0000","last_clean":"2024-04-25T01:39:35.199059+0000","last_became_active":"2024-04-25T01:39:24.388306+0000","last_became_peered":"2024-04-25T01:39:24.388306+0000","last_unstale":"2024-04-25T01:39:35.199059+0000","last_undegraded":"2024-04-25T01:39:35.199059+0000","last_fullsized":"2024-04-25T01:39:35.199059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:59:33.951161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198256+0000","last_change":"2024-04-25T01:39:23.375729+0000","last_active":"2024-04-25T01:39:35.198256+0000","last_peered":"2024-04-25T01:39:35.198256+0000","last_clean":"2024-04-25T01:39:35.198256+0000","last_became_active":"2024-04-25T01:39:23.375488+0000","last_became_peered":"2024-04-25T01:39:23.375488+0000","last_unstale":"2024-04-25T01:39:35.198256+0000","last_undegraded":"2024-04-25T01:39:35.198256+0000","last_fullsized":"2024-04-25T01:39:35.198256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:00.039083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198302+0000","last_change":"2024-04-25T01:39:32.427586+0000","last_active":"2024-04-25T01:39:35.198302+0000","last_peered":"2024-04-25T01:39:35.198302+0000","last_clean":"2024-04-25T01:39:35.198302+0000","last_became_active":"2024-04-25T01:39:32.427282+0000","last_became_peered":"2024-04-25T01:39:32.427282+0000","last_unstale":"2024-04-25T01:39:35.198302+0000","last_undegraded":"2024-04-25T01:39:35.198302+0000","last_fullsized":"2024-04-25T01:39:35.198302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:35.956279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197828+0000","last_change":"2024-04-25T01:39:33.438949+0000","last_active":"2024-04-25T01:39:35.197828+0000","last_peered":"2024-04-25T01:39:35.197828+0000","last_clean":"2024-04-25T01:39:35.197828+0000","last_became_active":"2024-04-25T01:39:33.438669+0000","last_became_peered":"2024-04-25T01:39:33.438669+0000","last_unstale":"2024-04-25T01:39:35.197828+0000","last_undegraded":"2024-04-25T01:39:35.197828+0000","last_fullsized":"2024-04-25T01:39:35.197828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:07.849060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197529+0000","last_change":"2024-04-25T01:39:24.377438+0000","last_active":"2024-04-25T01:39:35.197529+0000","last_peered":"2024-04-25T01:39:35.197529+0000","last_clean":"2024-04-25T01:39:35.197529+0000","last_became_active":"2024-04-25T01:39:24.377146+0000","last_became_peered":"2024-04-25T01:39:24.377146+0000","last_unstale":"2024-04-25T01:39:35.197529+0000","last_undegraded":"2024-04-25T01:39:35.197529+0000","last_fullsized":"2024-04-25T01:39:35.197529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:54:17.698561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198084+0000","last_change":"2024-04-25T01:39:23.371019+0000","last_active":"2024-04-25T01:39:35.198084+0000","last_peered":"2024-04-25T01:39:35.198084+0000","last_clean":"2024-04-25T01:39:35.198084+0000","last_became_active":"2024-04-25T01:39:23.370727+0000","last_became_peered":"2024-04-25T01:39:23.370727+0000","last_unstale":"2024-04-25T01:39:35.198084+0000","last_undegraded":"2024-04-25T01:39:35.198084+0000","last_fullsized":"2024-04-25T01:39:35.198084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:10.714475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198753+0000","last_change":"2024-04-25T01:39:32.431610+0000","last_active":"2024-04-25T01:39:35.198753+0000","last_peered":"2024-04-25T01:39:35.198753+0000","last_clean":"2024-04-25T01:39:35.198753+0000","last_became_active":"2024-04-25T01:39:32.431335+0000","last_became_peered":"2024-04-25T01:39:32.431335+0000","last_unstale":"2024-04-25T01:39:35.198753+0000","last_undegraded":"2024-04-25T01:39:35.198753+0000","last_fullsized":"2024-04-25T01:39:35.198753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:54.882078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199183+0000","last_change":"2024-04-25T01:39:33.438896+0000","last_active":"2024-04-25T01:39:35.199183+0000","last_peered":"2024-04-25T01:39:35.199183+0000","last_clean":"2024-04-25T01:39:35.199183+0000","last_became_active":"2024-04-25T01:39:33.438622+0000","last_became_peered":"2024-04-25T01:39:33.438622+0000","last_unstale":"2024-04-25T01:39:35.199183+0000","last_undegraded":"2024-04-25T01:39:35.199183+0000","last_fullsized":"2024-04-25T01:39:35.199183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:40:47.408809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559149+0000","last_change":"2024-04-25T01:39:24.391366+0000","last_active":"2024-04-25T01:39:34.559149+0000","last_peered":"2024-04-25T01:39:34.559149+0000","last_clean":"2024-04-25T01:39:34.559149+0000","last_became_active":"2024-04-25T01:39:24.391093+0000","last_became_peered":"2024-04-25T01:39:24.391093+0000","last_unstale":"2024-04-25T01:39:34.559149+0000","last_undegraded":"2024-04-25T01:39:34.559149+0000","last_fullsized":"2024-04-25T01:39:34.559149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:10.906935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198243+0000","last_change":"2024-04-25T01:39:23.379767+0000","last_active":"2024-04-25T01:39:35.198243+0000","last_peered":"2024-04-25T01:39:35.198243+0000","last_clean":"2024-04-25T01:39:35.198243+0000","last_became_active":"2024-04-25T01:39:23.379294+0000","last_became_peered":"2024-04-25T01:39:23.379294+0000","last_unstale":"2024-04-25T01:39:35.198243+0000","last_undegraded":"2024-04-25T01:39:35.198243+0000","last_fullsized":"2024-04-25T01:39:35.198243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:36:37.823796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559671+0000","last_change":"2024-04-25T01:39:32.429452+0000","last_active":"2024-04-25T01:39:34.559671+0000","last_peered":"2024-04-25T01:39:34.559671+0000","last_clean":"2024-04-25T01:39:34.559671+0000","last_became_active":"2024-04-25T01:39:32.429189+0000","last_became_peered":"2024-04-25T01:39:32.429189+0000","last_unstale":"2024-04-25T01:39:34.559671+0000","last_undegraded":"2024-04-25T01:39:34.559671+0000","last_fullsized":"2024-04-25T01:39:34.559671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:58:02.723851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198704+0000","last_change":"2024-04-25T01:39:33.438945+0000","last_active":"2024-04-25T01:39:35.198704+0000","last_peered":"2024-04-25T01:39:35.198704+0000","last_clean":"2024-04-25T01:39:35.198704+0000","last_became_active":"2024-04-25T01:39:33.438233+0000","last_became_peered":"2024-04-25T01:39:33.438233+0000","last_unstale":"2024-04-25T01:39:35.198704+0000","last_undegraded":"2024-04-25T01:39:35.198704+0000","last_fullsized":"2024-04-25T01:39:35.198704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:50.545311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429728+0000","last_change":"2024-04-25T01:39:24.401208+0000","last_active":"2024-04-25T01:39:34.429728+0000","last_peered":"2024-04-25T01:39:34.429728+0000","last_clean":"2024-04-25T01:39:34.429728+0000","last_became_active":"2024-04-25T01:39:24.400502+0000","last_became_peered":"2024-04-25T01:39:24.400502+0000","last_unstale":"2024-04-25T01:39:34.429728+0000","last_undegraded":"2024-04-25T01:39:34.429728+0000","last_fullsized":"2024-04-25T01:39:34.429728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:55:09.076617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198391+0000","last_change":"2024-04-25T01:39:23.367826+0000","last_active":"2024-04-25T01:39:35.198391+0000","last_peered":"2024-04-25T01:39:35.198391+0000","last_clean":"2024-04-25T01:39:35.198391+0000","last_became_active":"2024-04-25T01:39:23.367520+0000","last_became_peered":"2024-04-25T01:39:23.367520+0000","last_unstale":"2024-04-25T01:39:35.198391+0000","last_undegraded":"2024-04-25T01:39:35.198391+0000","last_fullsized":"2024-04-25T01:39:35.198391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:05.997166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199929+0000","last_change":"2024-04-25T01:39:12.918495+0000","last_active":"2024-04-25T01:39:35.199929+0000","last_peered":"2024-04-25T01:39:35.199929+0000","last_clean":"2024-04-25T01:39:35.199929+0000","last_became_active":"2024-04-25T01:39:12.917330+0000","last_became_peered":"2024-04-25T01:39:12.917330+0000","last_unstale":"2024-04-25T01:39:35.199929+0000","last_undegraded":"2024-04-25T01:39:35.199929+0000","last_fullsized":"2024-04-25T01:39:35.199929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:11.731178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:11.731178+0000","last_clean_scrub_stamp":"2024-04-25T01:39:11.731178+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:26:14.153244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434088+0000","last_change":"2024-04-25T01:39:32.431797+0000","last_active":"2024-04-25T01:39:34.434088+0000","last_peered":"2024-04-25T01:39:34.434088+0000","last_clean":"2024-04-25T01:39:34.434088+0000","last_became_active":"2024-04-25T01:39:32.431523+0000","last_became_peered":"2024-04-25T01:39:32.431523+0000","last_unstale":"2024-04-25T01:39:34.434088+0000","last_undegraded":"2024-04-25T01:39:34.434088+0000","last_fullsized":"2024-04-25T01:39:34.434088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:45.752128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198056+0000","last_change":"2024-04-25T01:39:33.440488+0000","last_active":"2024-04-25T01:39:35.198056+0000","last_peered":"2024-04-25T01:39:35.198056+0000","last_clean":"2024-04-25T01:39:35.198056+0000","last_became_active":"2024-04-25T01:39:33.440161+0000","last_became_peered":"2024-04-25T01:39:33.440161+0000","last_unstale":"2024-04-25T01:39:35.198056+0000","last_undegraded":"2024-04-25T01:39:35.198056+0000","last_fullsized":"2024-04-25T01:39:35.198056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:45.542876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199802+0000","last_change":"2024-04-25T01:39:24.394350+0000","last_active":"2024-04-25T01:39:35.199802+0000","last_peered":"2024-04-25T01:39:35.199802+0000","last_clean":"2024-04-25T01:39:35.199802+0000","last_became_active":"2024-04-25T01:39:24.393235+0000","last_became_peered":"2024-04-25T01:39:24.393235+0000","last_unstale":"2024-04-25T01:39:35.199802+0000","last_undegraded":"2024-04-25T01:39:35.199802+0000","last_fullsized":"2024-04-25T01:39:35.199802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:00:48.588700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198113+0000","last_change":"2024-04-25T01:39:23.368352+0000","last_active":"2024-04-25T01:39:35.198113+0000","last_peered":"2024-04-25T01:39:35.198113+0000","last_clean":"2024-04-25T01:39:35.198113+0000","last_became_active":"2024-04-25T01:39:23.368075+0000","last_became_peered":"2024-04-25T01:39:23.368075+0000","last_unstale":"2024-04-25T01:39:35.198113+0000","last_undegraded":"2024-04-25T01:39:35.198113+0000","last_fullsized":"2024-04-25T01:39:35.198113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:11.300091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434486+0000","last_change":"2024-04-25T01:39:32.430007+0000","last_active":"2024-04-25T01:39:34.434486+0000","last_peered":"2024-04-25T01:39:34.434486+0000","last_clean":"2024-04-25T01:39:34.434486+0000","last_became_active":"2024-04-25T01:39:32.429721+0000","last_became_peered":"2024-04-25T01:39:32.429721+0000","last_unstale":"2024-04-25T01:39:34.434486+0000","last_undegraded":"2024-04-25T01:39:34.434486+0000","last_fullsized":"2024-04-25T01:39:34.434486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:47.409375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197603+0000","last_change":"2024-04-25T01:39:33.447230+0000","last_active":"2024-04-25T01:39:35.197603+0000","last_peered":"2024-04-25T01:39:35.197603+0000","last_clean":"2024-04-25T01:39:35.197603+0000","last_became_active":"2024-04-25T01:39:33.446930+0000","last_became_peered":"2024-04-25T01:39:33.446930+0000","last_unstale":"2024-04-25T01:39:35.197603+0000","last_undegraded":"2024-04-25T01:39:35.197603+0000","last_fullsized":"2024-04-25T01:39:35.197603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:51:40.920560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199534+0000","last_change":"2024-04-25T01:39:24.394286+0000","last_active":"2024-04-25T01:39:35.199534+0000","last_peered":"2024-04-25T01:39:35.199534+0000","last_clean":"2024-04-25T01:39:35.199534+0000","last_became_active":"2024-04-25T01:39:24.393558+0000","last_became_peered":"2024-04-25T01:39:24.393558+0000","last_unstale":"2024-04-25T01:39:35.199534+0000","last_undegraded":"2024-04-25T01:39:35.199534+0000","last_fullsized":"2024-04-25T01:39:35.199534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:59.100947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198699+0000","last_change":"2024-04-25T01:39:23.370690+0000","last_active":"2024-04-25T01:39:35.198699+0000","last_peered":"2024-04-25T01:39:35.198699+0000","last_clean":"2024-04-25T01:39:35.198699+0000","last_became_active":"2024-04-25T01:39:23.370391+0000","last_became_peered":"2024-04-25T01:39:23.370391+0000","last_unstale":"2024-04-25T01:39:35.198699+0000","last_undegraded":"2024-04-25T01:39:35.198699+0000","last_fullsized":"2024-04-25T01:39:35.198699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:29.647636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559440+0000","last_change":"2024-04-25T01:39:32.429412+0000","last_active":"2024-04-25T01:39:34.559440+0000","last_peered":"2024-04-25T01:39:34.559440+0000","last_clean":"2024-04-25T01:39:34.559440+0000","last_became_active":"2024-04-25T01:39:32.429143+0000","last_became_peered":"2024-04-25T01:39:32.429143+0000","last_unstale":"2024-04-25T01:39:34.559440+0000","last_undegraded":"2024-04-25T01:39:34.559440+0000","last_fullsized":"2024-04-25T01:39:34.559440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:53.637245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198532+0000","last_change":"2024-04-25T01:39:33.437128+0000","last_active":"2024-04-25T01:39:35.198532+0000","last_peered":"2024-04-25T01:39:35.198532+0000","last_clean":"2024-04-25T01:39:35.198532+0000","last_became_active":"2024-04-25T01:39:33.436861+0000","last_became_peered":"2024-04-25T01:39:33.436861+0000","last_unstale":"2024-04-25T01:39:35.198532+0000","last_undegraded":"2024-04-25T01:39:35.198532+0000","last_fullsized":"2024-04-25T01:39:35.198532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:41.746373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200378+0000","last_change":"2024-04-25T01:39:24.392170+0000","last_active":"2024-04-25T01:39:35.200378+0000","last_peered":"2024-04-25T01:39:35.200378+0000","last_clean":"2024-04-25T01:39:35.200378+0000","last_became_active":"2024-04-25T01:39:24.391811+0000","last_became_peered":"2024-04-25T01:39:24.391811+0000","last_unstale":"2024-04-25T01:39:35.200378+0000","last_undegraded":"2024-04-25T01:39:35.200378+0000","last_fullsized":"2024-04-25T01:39:35.200378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:32.859676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197996+0000","last_change":"2024-04-25T01:39:23.369872+0000","last_active":"2024-04-25T01:39:35.197996+0000","last_peered":"2024-04-25T01:39:35.197996+0000","last_clean":"2024-04-25T01:39:35.197996+0000","last_became_active":"2024-04-25T01:39:23.369314+0000","last_became_peered":"2024-04-25T01:39:23.369314+0000","last_unstale":"2024-04-25T01:39:35.197996+0000","last_undegraded":"2024-04-25T01:39:35.197996+0000","last_fullsized":"2024-04-25T01:39:35.197996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:14.571148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197245+0000","last_change":"2024-04-25T01:39:32.429664+0000","last_active":"2024-04-25T01:39:35.197245+0000","last_peered":"2024-04-25T01:39:35.197245+0000","last_clean":"2024-04-25T01:39:35.197245+0000","last_became_active":"2024-04-25T01:39:32.429358+0000","last_became_peered":"2024-04-25T01:39:32.429358+0000","last_unstale":"2024-04-25T01:39:35.197245+0000","last_undegraded":"2024-04-25T01:39:35.197245+0000","last_fullsized":"2024-04-25T01:39:35.197245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:57:10.913056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197472+0000","last_change":"2024-04-25T01:39:33.440419+0000","last_active":"2024-04-25T01:39:35.197472+0000","last_peered":"2024-04-25T01:39:35.197472+0000","last_clean":"2024-04-25T01:39:35.197472+0000","last_became_active":"2024-04-25T01:39:33.440054+0000","last_became_peered":"2024-04-25T01:39:33.440054+0000","last_unstale":"2024-04-25T01:39:35.197472+0000","last_undegraded":"2024-04-25T01:39:35.197472+0000","last_fullsized":"2024-04-25T01:39:35.197472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:42.321235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199726+0000","last_change":"2024-04-25T01:39:24.391240+0000","last_active":"2024-04-25T01:39:35.199726+0000","last_peered":"2024-04-25T01:39:35.199726+0000","last_clean":"2024-04-25T01:39:35.199726+0000","last_became_active":"2024-04-25T01:39:24.390948+0000","last_became_peered":"2024-04-25T01:39:24.390948+0000","last_unstale":"2024-04-25T01:39:35.199726+0000","last_undegraded":"2024-04-25T01:39:35.199726+0000","last_fullsized":"2024-04-25T01:39:35.199726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:41:30.579190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198161+0000","last_change":"2024-04-25T01:39:23.367322+0000","last_active":"2024-04-25T01:39:35.198161+0000","last_peered":"2024-04-25T01:39:35.198161+0000","last_clean":"2024-04-25T01:39:35.198161+0000","last_became_active":"2024-04-25T01:39:23.367054+0000","last_became_peered":"2024-04-25T01:39:23.367054+0000","last_unstale":"2024-04-25T01:39:35.198161+0000","last_undegraded":"2024-04-25T01:39:35.198161+0000","last_fullsized":"2024-04-25T01:39:35.198161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:10.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197919+0000","last_change":"2024-04-25T01:39:32.426874+0000","last_active":"2024-04-25T01:39:35.197919+0000","last_peered":"2024-04-25T01:39:35.197919+0000","last_clean":"2024-04-25T01:39:35.197919+0000","last_became_active":"2024-04-25T01:39:32.426599+0000","last_became_peered":"2024-04-25T01:39:32.426599+0000","last_unstale":"2024-04-25T01:39:35.197919+0000","last_undegraded":"2024-04-25T01:39:35.197919+0000","last_fullsized":"2024-04-25T01:39:35.197919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:27.672277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430134+0000","last_change":"2024-04-25T01:39:33.428909+0000","last_active":"2024-04-25T01:39:34.430134+0000","last_peered":"2024-04-25T01:39:34.430134+0000","last_clean":"2024-04-25T01:39:34.430134+0000","last_became_active":"2024-04-25T01:39:33.428626+0000","last_became_peered":"2024-04-25T01:39:33.428626+0000","last_unstale":"2024-04-25T01:39:34.430134+0000","last_undegraded":"2024-04-25T01:39:34.430134+0000","last_fullsized":"2024-04-25T01:39:34.430134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:21.188264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199068+0000","last_change":"2024-04-25T01:39:24.389946+0000","last_active":"2024-04-25T01:39:35.199068+0000","last_peered":"2024-04-25T01:39:35.199068+0000","last_clean":"2024-04-25T01:39:35.199068+0000","last_became_active":"2024-04-25T01:39:24.389656+0000","last_became_peered":"2024-04-25T01:39:24.389656+0000","last_unstale":"2024-04-25T01:39:35.199068+0000","last_undegraded":"2024-04-25T01:39:35.199068+0000","last_fullsized":"2024-04-25T01:39:35.199068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:55.943639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197475+0000","last_change":"2024-04-25T01:39:23.373599+0000","last_active":"2024-04-25T01:39:35.197475+0000","last_peered":"2024-04-25T01:39:35.197475+0000","last_clean":"2024-04-25T01:39:35.197475+0000","last_became_active":"2024-04-25T01:39:23.373281+0000","last_became_peered":"2024-04-25T01:39:23.373281+0000","last_unstale":"2024-04-25T01:39:35.197475+0000","last_undegraded":"2024-04-25T01:39:35.197475+0000","last_fullsized":"2024-04-25T01:39:35.197475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:40.850925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559604+0000","last_change":"2024-04-25T01:39:32.427502+0000","last_active":"2024-04-25T01:39:34.559604+0000","last_peered":"2024-04-25T01:39:34.559604+0000","last_clean":"2024-04-25T01:39:34.559604+0000","last_became_active":"2024-04-25T01:39:32.426499+0000","last_became_peered":"2024-04-25T01:39:32.426499+0000","last_unstale":"2024-04-25T01:39:34.559604+0000","last_undegraded":"2024-04-25T01:39:34.559604+0000","last_fullsized":"2024-04-25T01:39:34.559604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:26.977416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198695+0000","last_change":"2024-04-25T01:39:33.436901+0000","last_active":"2024-04-25T01:39:35.198695+0000","last_peered":"2024-04-25T01:39:35.198695+0000","last_clean":"2024-04-25T01:39:35.198695+0000","last_became_active":"2024-04-25T01:39:33.436001+0000","last_became_peered":"2024-04-25T01:39:33.436001+0000","last_unstale":"2024-04-25T01:39:35.198695+0000","last_undegraded":"2024-04-25T01:39:35.198695+0000","last_fullsized":"2024-04-25T01:39:35.198695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:34:41.678663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.433897+0000","last_change":"2024-04-25T01:39:24.394248+0000","last_active":"2024-04-25T01:39:34.433897+0000","last_peered":"2024-04-25T01:39:34.433897+0000","last_clean":"2024-04-25T01:39:34.433897+0000","last_became_active":"2024-04-25T01:39:24.393958+0000","last_became_peered":"2024-04-25T01:39:24.393958+0000","last_unstale":"2024-04-25T01:39:34.433897+0000","last_undegraded":"2024-04-25T01:39:34.433897+0000","last_fullsized":"2024-04-25T01:39:34.433897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:35.087577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434426+0000","last_change":"2024-04-25T01:39:23.372939+0000","last_active":"2024-04-25T01:39:34.434426+0000","last_peered":"2024-04-25T01:39:34.434426+0000","last_clean":"2024-04-25T01:39:34.434426+0000","last_became_active":"2024-04-25T01:39:23.372648+0000","last_became_peered":"2024-04-25T01:39:23.372648+0000","last_unstale":"2024-04-25T01:39:34.434426+0000","last_undegraded":"2024-04-25T01:39:34.434426+0000","last_fullsized":"2024-04-25T01:39:34.434426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:02:13.283096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430096+0000","last_change":"2024-04-25T01:39:32.432218+0000","last_active":"2024-04-25T01:39:34.430096+0000","last_peered":"2024-04-25T01:39:34.430096+0000","last_clean":"2024-04-25T01:39:34.430096+0000","last_became_active":"2024-04-25T01:39:32.431938+0000","last_became_peered":"2024-04-25T01:39:32.431938+0000","last_unstale":"2024-04-25T01:39:34.430096+0000","last_undegraded":"2024-04-25T01:39:34.430096+0000","last_fullsized":"2024-04-25T01:39:34.430096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:56:15.053817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199747+0000","last_change":"2024-04-25T01:39:33.441342+0000","last_active":"2024-04-25T01:39:35.199747+0000","last_peered":"2024-04-25T01:39:35.199747+0000","last_clean":"2024-04-25T01:39:35.199747+0000","last_became_active":"2024-04-25T01:39:33.441074+0000","last_became_peered":"2024-04-25T01:39:33.441074+0000","last_unstale":"2024-04-25T01:39:35.199747+0000","last_undegraded":"2024-04-25T01:39:35.199747+0000","last_fullsized":"2024-04-25T01:39:35.199747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:22:43.000112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199029+0000","last_change":"2024-04-25T01:39:24.390114+0000","last_active":"2024-04-25T01:39:35.199029+0000","last_peered":"2024-04-25T01:39:35.199029+0000","last_clean":"2024-04-25T01:39:35.199029+0000","last_became_active":"2024-04-25T01:39:24.389841+0000","last_became_peered":"2024-04-25T01:39:24.389841+0000","last_unstale":"2024-04-25T01:39:35.199029+0000","last_undegraded":"2024-04-25T01:39:35.199029+0000","last_fullsized":"2024-04-25T01:39:35.199029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:34.950624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198167+0000","last_change":"2024-04-25T01:39:23.369440+0000","last_active":"2024-04-25T01:39:35.198167+0000","last_peered":"2024-04-25T01:39:35.198167+0000","last_clean":"2024-04-25T01:39:35.198167+0000","last_became_active":"2024-04-25T01:39:23.369151+0000","last_became_peered":"2024-04-25T01:39:23.369151+0000","last_unstale":"2024-04-25T01:39:35.198167+0000","last_undegraded":"2024-04-25T01:39:35.198167+0000","last_fullsized":"2024-04-25T01:39:35.198167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:31:46.921287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"23'6","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429666+0000","last_change":"2024-04-25T01:39:32.430701+0000","last_active":"2024-04-25T01:39:34.429666+0000","last_peered":"2024-04-25T01:39:34.429666+0000","last_clean":"2024-04-25T01:39:34.429666+0000","last_became_active":"2024-04-25T01:39:32.430187+0000","last_became_peered":"2024-04-25T01:39:32.430187+0000","last_unstale":"2024-04-25T01:39:34.429666+0000","last_undegraded":"2024-04-25T01:39:34.429666+0000","last_fullsized":"2024-04-25T01:39:34.429666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:57.148375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429767+0000","last_change":"2024-04-25T01:39:33.427429+0000","last_active":"2024-04-25T01:39:34.429767+0000","last_peered":"2024-04-25T01:39:34.429767+0000","last_clean":"2024-04-25T01:39:34.429767+0000","last_became_active":"2024-04-25T01:39:33.427164+0000","last_became_peered":"2024-04-25T01:39:33.427164+0000","last_unstale":"2024-04-25T01:39:34.429767+0000","last_undegraded":"2024-04-25T01:39:34.429767+0000","last_fullsized":"2024-04-25T01:39:34.429767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:33:59.664252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559246+0000","last_change":"2024-04-25T01:39:24.388852+0000","last_active":"2024-04-25T01:39:34.559246+0000","last_peered":"2024-04-25T01:39:34.559246+0000","last_clean":"2024-04-25T01:39:34.559246+0000","last_became_active":"2024-04-25T01:39:24.388594+0000","last_became_peered":"2024-04-25T01:39:24.388594+0000","last_unstale":"2024-04-25T01:39:34.559246+0000","last_undegraded":"2024-04-25T01:39:34.559246+0000","last_fullsized":"2024-04-25T01:39:34.559246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:46:49.718182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559847+0000","last_change":"2024-04-25T01:39:23.372903+0000","last_active":"2024-04-25T01:39:34.559847+0000","last_peered":"2024-04-25T01:39:34.559847+0000","last_clean":"2024-04-25T01:39:34.559847+0000","last_became_active":"2024-04-25T01:39:23.372617+0000","last_became_peered":"2024-04-25T01:39:23.372617+0000","last_unstale":"2024-04-25T01:39:34.559847+0000","last_undegraded":"2024-04-25T01:39:34.559847+0000","last_fullsized":"2024-04-25T01:39:34.559847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:54:58.506432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199994+0000","last_change":"2024-04-25T01:39:32.430218+0000","last_active":"2024-04-25T01:39:35.199994+0000","last_peered":"2024-04-25T01:39:35.199994+0000","last_clean":"2024-04-25T01:39:35.199994+0000","last_became_active":"2024-04-25T01:39:32.429900+0000","last_became_peered":"2024-04-25T01:39:32.429900+0000","last_unstale":"2024-04-25T01:39:35.199994+0000","last_undegraded":"2024-04-25T01:39:35.199994+0000","last_fullsized":"2024-04-25T01:39:35.199994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:52.253045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429707+0000","last_change":"2024-04-25T01:39:33.440325+0000","last_active":"2024-04-25T01:39:34.429707+0000","last_peered":"2024-04-25T01:39:34.429707+0000","last_clean":"2024-04-25T01:39:34.429707+0000","last_became_active":"2024-04-25T01:39:33.439961+0000","last_became_peered":"2024-04-25T01:39:33.439961+0000","last_unstale":"2024-04-25T01:39:34.429707+0000","last_undegraded":"2024-04-25T01:39:34.429707+0000","last_fullsized":"2024-04-25T01:39:34.429707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:01.846576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199750+0000","last_change":"2024-04-25T01:39:24.380617+0000","last_active":"2024-04-25T01:39:35.199750+0000","last_peered":"2024-04-25T01:39:35.199750+0000","last_clean":"2024-04-25T01:39:35.199750+0000","last_became_active":"2024-04-25T01:39:24.380330+0000","last_became_peered":"2024-04-25T01:39:24.380330+0000","last_unstale":"2024-04-25T01:39:35.199750+0000","last_undegraded":"2024-04-25T01:39:35.199750+0000","last_fullsized":"2024-04-25T01:39:35.199750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:24.010569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434231+0000","last_change":"2024-04-25T01:39:23.373295+0000","last_active":"2024-04-25T01:39:34.434231+0000","last_peered":"2024-04-25T01:39:34.434231+0000","last_clean":"2024-04-25T01:39:34.434231+0000","last_became_active":"2024-04-25T01:39:23.372984+0000","last_became_peered":"2024-04-25T01:39:23.372984+0000","last_unstale":"2024-04-25T01:39:34.434231+0000","last_undegraded":"2024-04-25T01:39:34.434231+0000","last_fullsized":"2024-04-25T01:39:34.434231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:10.854190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198248+0000","last_change":"2024-04-25T01:39:32.433589+0000","last_active":"2024-04-25T01:39:35.198248+0000","last_peered":"2024-04-25T01:39:35.198248+0000","last_clean":"2024-04-25T01:39:35.198248+0000","last_became_active":"2024-04-25T01:39:32.433408+0000","last_became_peered":"2024-04-25T01:39:32.433408+0000","last_unstale":"2024-04-25T01:39:35.198248+0000","last_undegraded":"2024-04-25T01:39:35.198248+0000","last_fullsized":"2024-04-25T01:39:35.198248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:25.789951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198708+0000","last_change":"2024-04-25T01:39:33.433449+0000","last_active":"2024-04-25T01:39:35.198708+0000","last_peered":"2024-04-25T01:39:35.198708+0000","last_clean":"2024-04-25T01:39:35.198708+0000","last_became_active":"2024-04-25T01:39:33.432690+0000","last_became_peered":"2024-04-25T01:39:33.432690+0000","last_unstale":"2024-04-25T01:39:35.198708+0000","last_undegraded":"2024-04-25T01:39:35.198708+0000","last_fullsized":"2024-04-25T01:39:35.198708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:30.046453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198838+0000","last_change":"2024-04-25T01:39:24.391245+0000","last_active":"2024-04-25T01:39:35.198838+0000","last_peered":"2024-04-25T01:39:35.198838+0000","last_clean":"2024-04-25T01:39:35.198838+0000","last_became_active":"2024-04-25T01:39:24.390941+0000","last_became_peered":"2024-04-25T01:39:24.390941+0000","last_unstale":"2024-04-25T01:39:35.198838+0000","last_undegraded":"2024-04-25T01:39:35.198838+0000","last_fullsized":"2024-04-25T01:39:35.198838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:55.182405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198689+0000","last_change":"2024-04-25T01:39:23.369043+0000","last_active":"2024-04-25T01:39:35.198689+0000","last_peered":"2024-04-25T01:39:35.198689+0000","last_clean":"2024-04-25T01:39:35.198689+0000","last_became_active":"2024-04-25T01:39:23.368778+0000","last_became_peered":"2024-04-25T01:39:23.368778+0000","last_unstale":"2024-04-25T01:39:35.198689+0000","last_undegraded":"2024-04-25T01:39:35.198689+0000","last_fullsized":"2024-04-25T01:39:35.198689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:59.501724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198230+0000","last_change":"2024-04-25T01:39:32.431530+0000","last_active":"2024-04-25T01:39:35.198230+0000","last_peered":"2024-04-25T01:39:35.198230+0000","last_clean":"2024-04-25T01:39:35.198230+0000","last_became_active":"2024-04-25T01:39:32.431247+0000","last_became_peered":"2024-04-25T01:39:32.431247+0000","last_unstale":"2024-04-25T01:39:35.198230+0000","last_undegraded":"2024-04-25T01:39:35.198230+0000","last_fullsized":"2024-04-25T01:39:35.198230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:46:02.014508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434136+0000","last_change":"2024-04-25T01:39:33.446545+0000","last_active":"2024-04-25T01:39:34.434136+0000","last_peered":"2024-04-25T01:39:34.434136+0000","last_clean":"2024-04-25T01:39:34.434136+0000","last_became_active":"2024-04-25T01:39:33.446263+0000","last_became_peered":"2024-04-25T01:39:33.446263+0000","last_unstale":"2024-04-25T01:39:34.434136+0000","last_undegraded":"2024-04-25T01:39:34.434136+0000","last_fullsized":"2024-04-25T01:39:34.434136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:27.026460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559482+0000","last_change":"2024-04-25T01:39:24.403875+0000","last_active":"2024-04-25T01:39:34.559482+0000","last_peered":"2024-04-25T01:39:34.559482+0000","last_clean":"2024-04-25T01:39:34.559482+0000","last_became_active":"2024-04-25T01:39:24.403591+0000","last_became_peered":"2024-04-25T01:39:24.403591+0000","last_unstale":"2024-04-25T01:39:34.559482+0000","last_undegraded":"2024-04-25T01:39:34.559482+0000","last_fullsized":"2024-04-25T01:39:34.559482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:45.276173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198758+0000","last_change":"2024-04-25T01:39:23.378968+0000","last_active":"2024-04-25T01:39:35.198758+0000","last_peered":"2024-04-25T01:39:35.198758+0000","last_clean":"2024-04-25T01:39:35.198758+0000","last_became_active":"2024-04-25T01:39:23.378635+0000","last_became_peered":"2024-04-25T01:39:23.378635+0000","last_unstale":"2024-04-25T01:39:35.198758+0000","last_undegraded":"2024-04-25T01:39:35.198758+0000","last_fullsized":"2024-04-25T01:39:35.198758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:39.780544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429477+0000","last_change":"2024-04-25T01:39:32.427357+0000","last_active":"2024-04-25T01:39:34.429477+0000","last_peered":"2024-04-25T01:39:34.429477+0000","last_clean":"2024-04-25T01:39:34.429477+0000","last_became_active":"2024-04-25T01:39:32.427105+0000","last_became_peered":"2024-04-25T01:39:32.427105+0000","last_unstale":"2024-04-25T01:39:34.429477+0000","last_undegraded":"2024-04-25T01:39:34.429477+0000","last_fullsized":"2024-04-25T01:39:34.429477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:04.848726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197844+0000","last_change":"2024-04-25T01:39:33.444814+0000","last_active":"2024-04-25T01:39:35.197844+0000","last_peered":"2024-04-25T01:39:35.197844+0000","last_clean":"2024-04-25T01:39:35.197844+0000","last_became_active":"2024-04-25T01:39:33.444489+0000","last_became_peered":"2024-04-25T01:39:33.444489+0000","last_unstale":"2024-04-25T01:39:35.197844+0000","last_undegraded":"2024-04-25T01:39:35.197844+0000","last_fullsized":"2024-04-25T01:39:35.197844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:06.718940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198707+0000","last_change":"2024-04-25T01:39:24.392642+0000","last_active":"2024-04-25T01:39:35.198707+0000","last_peered":"2024-04-25T01:39:35.198707+0000","last_clean":"2024-04-25T01:39:35.198707+0000","last_became_active":"2024-04-25T01:39:24.391605+0000","last_became_peered":"2024-04-25T01:39:24.391605+0000","last_unstale":"2024-04-25T01:39:35.198707+0000","last_undegraded":"2024-04-25T01:39:35.198707+0000","last_fullsized":"2024-04-25T01:39:35.198707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:01:23.217074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434798+0000","last_change":"2024-04-25T01:39:23.377236+0000","last_active":"2024-04-25T01:39:34.434798+0000","last_peered":"2024-04-25T01:39:34.434798+0000","last_clean":"2024-04-25T01:39:34.434798+0000","last_became_active":"2024-04-25T01:39:23.376727+0000","last_became_peered":"2024-04-25T01:39:23.376727+0000","last_unstale":"2024-04-25T01:39:34.434798+0000","last_undegraded":"2024-04-25T01:39:34.434798+0000","last_fullsized":"2024-04-25T01:39:34.434798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:08.103707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429200+0000","last_change":"2024-04-25T01:39:32.424457+0000","last_active":"2024-04-25T01:39:34.429200+0000","last_peered":"2024-04-25T01:39:34.429200+0000","last_clean":"2024-04-25T01:39:34.429200+0000","last_became_active":"2024-04-25T01:39:32.424203+0000","last_became_peered":"2024-04-25T01:39:32.424203+0000","last_unstale":"2024-04-25T01:39:34.429200+0000","last_undegraded":"2024-04-25T01:39:34.429200+0000","last_fullsized":"2024-04-25T01:39:34.429200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:12:20.824070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434672+0000","last_change":"2024-04-25T01:39:33.445948+0000","last_active":"2024-04-25T01:39:34.434672+0000","last_peered":"2024-04-25T01:39:34.434672+0000","last_clean":"2024-04-25T01:39:34.434672+0000","last_became_active":"2024-04-25T01:39:33.445654+0000","last_became_peered":"2024-04-25T01:39:33.445654+0000","last_unstale":"2024-04-25T01:39:34.434672+0000","last_undegraded":"2024-04-25T01:39:34.434672+0000","last_fullsized":"2024-04-25T01:39:34.434672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:51.323909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559508+0000","last_change":"2024-04-25T01:39:32.430484+0000","last_active":"2024-04-25T01:39:34.559508+0000","last_peered":"2024-04-25T01:39:34.559508+0000","last_clean":"2024-04-25T01:39:34.559508+0000","last_became_active":"2024-04-25T01:39:32.430220+0000","last_became_peered":"2024-04-25T01:39:32.430220+0000","last_unstale":"2024-04-25T01:39:34.559508+0000","last_undegraded":"2024-04-25T01:39:34.559508+0000","last_fullsized":"2024-04-25T01:39:34.559508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:36:53.152442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197722+0000","last_change":"2024-04-25T01:39:24.375457+0000","last_active":"2024-04-25T01:39:35.197722+0000","last_peered":"2024-04-25T01:39:35.197722+0000","last_clean":"2024-04-25T01:39:35.197722+0000","last_became_active":"2024-04-25T01:39:24.375178+0000","last_became_peered":"2024-04-25T01:39:24.375178+0000","last_unstale":"2024-04-25T01:39:35.197722+0000","last_undegraded":"2024-04-25T01:39:35.197722+0000","last_fullsized":"2024-04-25T01:39:35.197722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:58:15.640882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197478+0000","last_change":"2024-04-25T01:39:23.369998+0000","last_active":"2024-04-25T01:39:35.197478+0000","last_peered":"2024-04-25T01:39:35.197478+0000","last_clean":"2024-04-25T01:39:35.197478+0000","last_became_active":"2024-04-25T01:39:23.369710+0000","last_became_peered":"2024-04-25T01:39:23.369710+0000","last_unstale":"2024-04-25T01:39:35.197478+0000","last_undegraded":"2024-04-25T01:39:35.197478+0000","last_fullsized":"2024-04-25T01:39:35.197478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:32:34.329452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559536+0000","last_change":"2024-04-25T01:39:33.447666+0000","last_active":"2024-04-25T01:39:34.559536+0000","last_peered":"2024-04-25T01:39:34.559536+0000","last_clean":"2024-04-25T01:39:34.559536+0000","last_became_active":"2024-04-25T01:39:33.447436+0000","last_became_peered":"2024-04-25T01:39:33.447436+0000","last_unstale":"2024-04-25T01:39:34.559536+0000","last_undegraded":"2024-04-25T01:39:34.559536+0000","last_fullsized":"2024-04-25T01:39:34.559536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:25:20.440422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434733+0000","last_change":"2024-04-25T01:39:32.436300+0000","last_active":"2024-04-25T01:39:34.434733+0000","last_peered":"2024-04-25T01:39:34.434733+0000","last_clean":"2024-04-25T01:39:34.434733+0000","last_became_active":"2024-04-25T01:39:32.436000+0000","last_became_peered":"2024-04-25T01:39:32.436000+0000","last_unstale":"2024-04-25T01:39:34.434733+0000","last_undegraded":"2024-04-25T01:39:34.434733+0000","last_fullsized":"2024-04-25T01:39:34.434733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:38.044992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429461+0000","last_change":"2024-04-25T01:39:24.387708+0000","last_active":"2024-04-25T01:39:34.429461+0000","last_peered":"2024-04-25T01:39:34.429461+0000","last_clean":"2024-04-25T01:39:34.429461+0000","last_became_active":"2024-04-25T01:39:24.387433+0000","last_became_peered":"2024-04-25T01:39:24.387433+0000","last_unstale":"2024-04-25T01:39:34.429461+0000","last_undegraded":"2024-04-25T01:39:34.429461+0000","last_fullsized":"2024-04-25T01:39:34.429461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:34.312066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429418+0000","last_change":"2024-04-25T01:39:23.377487+0000","last_active":"2024-04-25T01:39:34.429418+0000","last_peered":"2024-04-25T01:39:34.429418+0000","last_clean":"2024-04-25T01:39:34.429418+0000","last_became_active":"2024-04-25T01:39:23.377181+0000","last_became_peered":"2024-04-25T01:39:23.377181+0000","last_unstale":"2024-04-25T01:39:34.429418+0000","last_undegraded":"2024-04-25T01:39:34.429418+0000","last_fullsized":"2024-04-25T01:39:34.429418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:17.434141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198602+0000","last_change":"2024-04-25T01:39:33.444973+0000","last_active":"2024-04-25T01:39:35.198602+0000","last_peered":"2024-04-25T01:39:35.198602+0000","last_clean":"2024-04-25T01:39:35.198602+0000","last_became_active":"2024-04-25T01:39:33.444673+0000","last_became_peered":"2024-04-25T01:39:33.444673+0000","last_unstale":"2024-04-25T01:39:35.198602+0000","last_undegraded":"2024-04-25T01:39:35.198602+0000","last_fullsized":"2024-04-25T01:39:35.198602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:08.372714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434713+0000","last_change":"2024-04-25T01:39:23.372975+0000","last_active":"2024-04-25T01:39:34.434713+0000","last_peered":"2024-04-25T01:39:34.434713+0000","last_clean":"2024-04-25T01:39:34.434713+0000","last_became_active":"2024-04-25T01:39:23.372688+0000","last_became_peered":"2024-04-25T01:39:23.372688+0000","last_unstale":"2024-04-25T01:39:34.434713+0000","last_undegraded":"2024-04-25T01:39:34.434713+0000","last_fullsized":"2024-04-25T01:39:34.434713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:42:57.195844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559766+0000","last_change":"2024-04-25T01:39:24.388095+0000","last_active":"2024-04-25T01:39:34.559766+0000","last_peered":"2024-04-25T01:39:34.559766+0000","last_clean":"2024-04-25T01:39:34.559766+0000","last_became_active":"2024-04-25T01:39:24.387797+0000","last_became_peered":"2024-04-25T01:39:24.387797+0000","last_unstale":"2024-04-25T01:39:34.559766+0000","last_undegraded":"2024-04-25T01:39:34.559766+0000","last_fullsized":"2024-04-25T01:39:34.559766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:43:16.385957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197731+0000","last_change":"2024-04-25T01:39:32.427081+0000","last_active":"2024-04-25T01:39:35.197731+0000","last_peered":"2024-04-25T01:39:35.197731+0000","last_clean":"2024-04-25T01:39:35.197731+0000","last_became_active":"2024-04-25T01:39:32.426626+0000","last_became_peered":"2024-04-25T01:39:32.426626+0000","last_unstale":"2024-04-25T01:39:35.197731+0000","last_undegraded":"2024-04-25T01:39:35.197731+0000","last_fullsized":"2024-04-25T01:39:35.197731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:45.358400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198937+0000","last_change":"2024-04-25T01:39:33.446301+0000","last_active":"2024-04-25T01:39:35.198937+0000","last_peered":"2024-04-25T01:39:35.198937+0000","last_clean":"2024-04-25T01:39:35.198937+0000","last_became_active":"2024-04-25T01:39:33.445158+0000","last_became_peered":"2024-04-25T01:39:33.445158+0000","last_unstale":"2024-04-25T01:39:35.198937+0000","last_undegraded":"2024-04-25T01:39:35.198937+0000","last_fullsized":"2024-04-25T01:39:35.198937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:53:26.017968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429884+0000","last_change":"2024-04-25T01:39:23.371716+0000","last_active":"2024-04-25T01:39:34.429884+0000","last_peered":"2024-04-25T01:39:34.429884+0000","last_clean":"2024-04-25T01:39:34.429884+0000","last_became_active":"2024-04-25T01:39:23.371475+0000","last_became_peered":"2024-04-25T01:39:23.371475+0000","last_unstale":"2024-04-25T01:39:34.429884+0000","last_undegraded":"2024-04-25T01:39:34.429884+0000","last_fullsized":"2024-04-25T01:39:34.429884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:10.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198751+0000","last_change":"2024-04-25T01:39:24.388083+0000","last_active":"2024-04-25T01:39:35.198751+0000","last_peered":"2024-04-25T01:39:35.198751+0000","last_clean":"2024-04-25T01:39:35.198751+0000","last_became_active":"2024-04-25T01:39:24.387789+0000","last_became_peered":"2024-04-25T01:39:24.387789+0000","last_unstale":"2024-04-25T01:39:35.198751+0000","last_undegraded":"2024-04-25T01:39:35.198751+0000","last_fullsized":"2024-04-25T01:39:35.198751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:31.760631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429824+0000","last_change":"2024-04-25T01:39:32.429613+0000","last_active":"2024-04-25T01:39:34.429824+0000","last_peered":"2024-04-25T01:39:34.429824+0000","last_clean":"2024-04-25T01:39:34.429824+0000","last_became_active":"2024-04-25T01:39:32.429361+0000","last_became_peered":"2024-04-25T01:39:32.429361+0000","last_unstale":"2024-04-25T01:39:34.429824+0000","last_undegraded":"2024-04-25T01:39:34.429824+0000","last_fullsized":"2024-04-25T01:39:34.429824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:04:59.928602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430227+0000","last_change":"2024-04-25T01:39:33.426384+0000","last_active":"2024-04-25T01:39:34.430227+0000","last_peered":"2024-04-25T01:39:34.430227+0000","last_clean":"2024-04-25T01:39:34.430227+0000","last_became_active":"2024-04-25T01:39:33.426101+0000","last_became_peered":"2024-04-25T01:39:33.426101+0000","last_unstale":"2024-04-25T01:39:34.430227+0000","last_undegraded":"2024-04-25T01:39:34.430227+0000","last_fullsized":"2024-04-25T01:39:34.430227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:36.820458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.433902+0000","last_change":"2024-04-25T01:39:24.395618+0000","last_active":"2024-04-25T01:39:34.433902+0000","last_peered":"2024-04-25T01:39:34.433902+0000","last_clean":"2024-04-25T01:39:34.433902+0000","last_became_active":"2024-04-25T01:39:24.394816+0000","last_became_peered":"2024-04-25T01:39:24.394816+0000","last_unstale":"2024-04-25T01:39:34.433902+0000","last_undegraded":"2024-04-25T01:39:34.433902+0000","last_fullsized":"2024-04-25T01:39:34.433902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:01.025135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198676+0000","last_change":"2024-04-25T01:39:33.432537+0000","last_active":"2024-04-25T01:39:35.198676+0000","last_peered":"2024-04-25T01:39:35.198676+0000","last_clean":"2024-04-25T01:39:35.198676+0000","last_became_active":"2024-04-25T01:39:33.432266+0000","last_became_peered":"2024-04-25T01:39:33.432266+0000","last_unstale":"2024-04-25T01:39:35.198676+0000","last_undegraded":"2024-04-25T01:39:35.198676+0000","last_fullsized":"2024-04-25T01:39:35.198676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:31.703689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197383+0000","last_change":"2024-04-25T01:39:24.390981+0000","last_active":"2024-04-25T01:39:35.197383+0000","last_peered":"2024-04-25T01:39:35.197383+0000","last_clean":"2024-04-25T01:39:35.197383+0000","last_became_active":"2024-04-25T01:39:24.390716+0000","last_became_peered":"2024-04-25T01:39:24.390716+0000","last_unstale":"2024-04-25T01:39:35.197383+0000","last_undegraded":"2024-04-25T01:39:35.197383+0000","last_fullsized":"2024-04-25T01:39:35.197383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:08.458504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199057+0000","last_change":"2024-04-25T01:39:33.439086+0000","last_active":"2024-04-25T01:39:35.199057+0000","last_peered":"2024-04-25T01:39:35.199057+0000","last_clean":"2024-04-25T01:39:35.199057+0000","last_became_active":"2024-04-25T01:39:33.438811+0000","last_became_peered":"2024-04-25T01:39:33.438811+0000","last_unstale":"2024-04-25T01:39:35.199057+0000","last_undegraded":"2024-04-25T01:39:35.199057+0000","last_fullsized":"2024-04-25T01:39:35.199057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:49:23.604749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198076+0000","last_change":"2024-04-25T01:39:24.399738+0000","last_active":"2024-04-25T01:39:35.198076+0000","last_peered":"2024-04-25T01:39:35.198076+0000","last_clean":"2024-04-25T01:39:35.198076+0000","last_became_active":"2024-04-25T01:39:24.399499+0000","last_became_peered":"2024-04-25T01:39:24.399499+0000","last_unstale":"2024-04-25T01:39:35.198076+0000","last_undegraded":"2024-04-25T01:39:35.198076+0000","last_fullsized":"2024-04-25T01:39:35.198076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:58.646669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198407+0000","last_change":"2024-04-25T01:39:33.444074+0000","last_active":"2024-04-25T01:39:35.198407+0000","last_peered":"2024-04-25T01:39:35.198407+0000","last_clean":"2024-04-25T01:39:35.198407+0000","last_became_active":"2024-04-25T01:39:33.443796+0000","last_became_peered":"2024-04-25T01:39:33.443796+0000","last_unstale":"2024-04-25T01:39:35.198407+0000","last_undegraded":"2024-04-25T01:39:35.198407+0000","last_fullsized":"2024-04-25T01:39:35.198407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:56.379211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559685+0000","last_change":"2024-04-25T01:39:24.390631+0000","last_active":"2024-04-25T01:39:34.559685+0000","last_peered":"2024-04-25T01:39:34.559685+0000","last_clean":"2024-04-25T01:39:34.559685+0000","last_became_active":"2024-04-25T01:39:24.390363+0000","last_became_peered":"2024-04-25T01:39:24.390363+0000","last_unstale":"2024-04-25T01:39:34.559685+0000","last_undegraded":"2024-04-25T01:39:34.559685+0000","last_fullsized":"2024-04-25T01:39:34.559685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:48.830416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199245+0000","last_change":"2024-04-25T01:39:33.437787+0000","last_active":"2024-04-25T01:39:35.199245+0000","last_peered":"2024-04-25T01:39:35.199245+0000","last_clean":"2024-04-25T01:39:35.199245+0000","last_became_active":"2024-04-25T01:39:33.436131+0000","last_became_peered":"2024-04-25T01:39:33.436131+0000","last_unstale":"2024-04-25T01:39:35.199245+0000","last_undegraded":"2024-04-25T01:39:35.199245+0000","last_fullsized":"2024-04-25T01:39:35.199245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:29:13.213643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429883+0000","last_change":"2024-04-25T01:39:24.389645+0000","last_active":"2024-04-25T01:39:34.429883+0000","last_peered":"2024-04-25T01:39:34.429883+0000","last_clean":"2024-04-25T01:39:34.429883+0000","last_became_active":"2024-04-25T01:39:24.389375+0000","last_became_peered":"2024-04-25T01:39:24.389375+0000","last_unstale":"2024-04-25T01:39:34.429883+0000","last_undegraded":"2024-04-25T01:39:34.429883+0000","last_fullsized":"2024-04-25T01:39:34.429883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:13:12.753893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197777+0000","last_change":"2024-04-25T01:39:33.448177+0000","last_active":"2024-04-25T01:39:35.197777+0000","last_peered":"2024-04-25T01:39:35.197777+0000","last_clean":"2024-04-25T01:39:35.197777+0000","last_became_active":"2024-04-25T01:39:33.447588+0000","last_became_peered":"2024-04-25T01:39:33.447588+0000","last_unstale":"2024-04-25T01:39:35.197777+0000","last_undegraded":"2024-04-25T01:39:35.197777+0000","last_fullsized":"2024-04-25T01:39:35.197777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:11:20.466189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198572+0000","last_change":"2024-04-25T01:39:24.374082+0000","last_active":"2024-04-25T01:39:35.198572+0000","last_peered":"2024-04-25T01:39:35.198572+0000","last_clean":"2024-04-25T01:39:35.198572+0000","last_became_active":"2024-04-25T01:39:24.373731+0000","last_became_peered":"2024-04-25T01:39:24.373731+0000","last_unstale":"2024-04-25T01:39:35.198572+0000","last_undegraded":"2024-04-25T01:39:35.198572+0000","last_fullsized":"2024-04-25T01:39:35.198572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:45.817483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197536+0000","last_change":"2024-04-25T01:39:33.446992+0000","last_active":"2024-04-25T01:39:35.197536+0000","last_peered":"2024-04-25T01:39:35.197536+0000","last_clean":"2024-04-25T01:39:35.197536+0000","last_became_active":"2024-04-25T01:39:33.446652+0000","last_became_peered":"2024-04-25T01:39:33.446652+0000","last_unstale":"2024-04-25T01:39:35.197536+0000","last_undegraded":"2024-04-25T01:39:35.197536+0000","last_fullsized":"2024-04-25T01:39:35.197536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:43:52.959274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434529+0000","last_change":"2024-04-25T01:39:24.398614+0000","last_active":"2024-04-25T01:39:34.434529+0000","last_peered":"2024-04-25T01:39:34.434529+0000","last_clean":"2024-04-25T01:39:34.434529+0000","last_became_active":"2024-04-25T01:39:24.398299+0000","last_became_peered":"2024-04-25T01:39:24.398299+0000","last_unstale":"2024-04-25T01:39:34.434529+0000","last_undegraded":"2024-04-25T01:39:34.434529+0000","last_fullsized":"2024-04-25T01:39:34.434529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:54:51.191225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434363+0000","last_change":"2024-04-25T01:39:33.441401+0000","last_active":"2024-04-25T01:39:34.434363+0000","last_peered":"2024-04-25T01:39:34.434363+0000","last_clean":"2024-04-25T01:39:34.434363+0000","last_became_active":"2024-04-25T01:39:33.441104+0000","last_became_peered":"2024-04-25T01:39:33.441104+0000","last_unstale":"2024-04-25T01:39:34.434363+0000","last_undegraded":"2024-04-25T01:39:34.434363+0000","last_fullsized":"2024-04-25T01:39:34.434363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:51.503340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430186+0000","last_change":"2024-04-25T01:39:24.390352+0000","last_active":"2024-04-25T01:39:34.430186+0000","last_peered":"2024-04-25T01:39:34.430186+0000","last_clean":"2024-04-25T01:39:34.430186+0000","last_became_active":"2024-04-25T01:39:24.389809+0000","last_became_peered":"2024-04-25T01:39:24.389809+0000","last_unstale":"2024-04-25T01:39:34.430186+0000","last_undegraded":"2024-04-25T01:39:34.430186+0000","last_fullsized":"2024-04-25T01:39:34.430186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:22:44.221898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430089+0000","last_change":"2024-04-25T01:39:33.426710+0000","last_active":"2024-04-25T01:39:34.430089+0000","last_peered":"2024-04-25T01:39:34.430089+0000","last_clean":"2024-04-25T01:39:34.430089+0000","last_became_active":"2024-04-25T01:39:33.426056+0000","last_became_peered":"2024-04-25T01:39:33.426056+0000","last_unstale":"2024-04-25T01:39:34.430089+0000","last_undegraded":"2024-04-25T01:39:34.430089+0000","last_fullsized":"2024-04-25T01:39:34.430089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:53:41.174851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197416+0000","last_change":"2024-04-25T01:39:24.387093+0000","last_active":"2024-04-25T01:39:35.197416+0000","last_peered":"2024-04-25T01:39:35.197416+0000","last_clean":"2024-04-25T01:39:35.197416+0000","last_became_active":"2024-04-25T01:39:24.386809+0000","last_became_peered":"2024-04-25T01:39:24.386809+0000","last_unstale":"2024-04-25T01:39:35.197416+0000","last_undegraded":"2024-04-25T01:39:35.197416+0000","last_fullsized":"2024-04-25T01:39:35.197416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:46:05.313828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200264+0000","last_change":"2024-04-25T01:39:33.436499+0000","last_active":"2024-04-25T01:39:35.200264+0000","last_peered":"2024-04-25T01:39:35.200264+0000","last_clean":"2024-04-25T01:39:35.200264+0000","last_became_active":"2024-04-25T01:39:33.436017+0000","last_became_peered":"2024-04-25T01:39:33.436017+0000","last_unstale":"2024-04-25T01:39:35.200264+0000","last_undegraded":"2024-04-25T01:39:35.200264+0000","last_fullsized":"2024-04-25T01:39:35.200264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:46:09.302012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429495+0000","last_change":"2024-04-25T01:39:24.389039+0000","last_active":"2024-04-25T01:39:34.429495+0000","last_peered":"2024-04-25T01:39:34.429495+0000","last_clean":"2024-04-25T01:39:34.429495+0000","last_became_active":"2024-04-25T01:39:24.388793+0000","last_became_peered":"2024-04-25T01:39:24.388793+0000","last_unstale":"2024-04-25T01:39:34.429495+0000","last_undegraded":"2024-04-25T01:39:34.429495+0000","last_fullsized":"2024-04-25T01:39:34.429495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:13.093550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197668+0000","last_change":"2024-04-25T01:39:33.441122+0000","last_active":"2024-04-25T01:39:35.197668+0000","last_peered":"2024-04-25T01:39:35.197668+0000","last_clean":"2024-04-25T01:39:35.197668+0000","last_became_active":"2024-04-25T01:39:33.440760+0000","last_became_peered":"2024-04-25T01:39:33.440760+0000","last_unstale":"2024-04-25T01:39:35.197668+0000","last_undegraded":"2024-04-25T01:39:35.197668+0000","last_fullsized":"2024-04-25T01:39:35.197668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:30:12.603789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197981+0000","last_change":"2024-04-25T01:39:24.390884+0000","last_active":"2024-04-25T01:39:35.197981+0000","last_peered":"2024-04-25T01:39:35.197981+0000","last_clean":"2024-04-25T01:39:35.197981+0000","last_became_active":"2024-04-25T01:39:24.390591+0000","last_became_peered":"2024-04-25T01:39:24.390591+0000","last_unstale":"2024-04-25T01:39:35.197981+0000","last_undegraded":"2024-04-25T01:39:35.197981+0000","last_fullsized":"2024-04-25T01:39:35.197981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:51.274363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429740+0000","last_change":"2024-04-25T01:39:33.429482+0000","last_active":"2024-04-25T01:39:34.429740+0000","last_peered":"2024-04-25T01:39:34.429740+0000","last_clean":"2024-04-25T01:39:34.429740+0000","last_became_active":"2024-04-25T01:39:33.429158+0000","last_became_peered":"2024-04-25T01:39:33.429158+0000","last_unstale":"2024-04-25T01:39:34.429740+0000","last_undegraded":"2024-04-25T01:39:34.429740+0000","last_fullsized":"2024-04-25T01:39:34.429740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:58:07.372868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559599+0000","last_change":"2024-04-25T01:39:24.388891+0000","last_active":"2024-04-25T01:39:34.559599+0000","last_peered":"2024-04-25T01:39:34.559599+0000","last_clean":"2024-04-25T01:39:34.559599+0000","last_became_active":"2024-04-25T01:39:24.388619+0000","last_became_peered":"2024-04-25T01:39:24.388619+0000","last_unstale":"2024-04-25T01:39:34.559599+0000","last_undegraded":"2024-04-25T01:39:34.559599+0000","last_fullsized":"2024-04-25T01:39:34.559599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:05.176386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198216+0000","last_change":"2024-04-25T01:39:33.443534+0000","last_active":"2024-04-25T01:39:35.198216+0000","last_peered":"2024-04-25T01:39:35.198216+0000","last_clean":"2024-04-25T01:39:35.198216+0000","last_became_active":"2024-04-25T01:39:33.443257+0000","last_became_peered":"2024-04-25T01:39:33.443257+0000","last_unstale":"2024-04-25T01:39:35.198216+0000","last_undegraded":"2024-04-25T01:39:35.198216+0000","last_fullsized":"2024-04-25T01:39:35.198216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:44:30.154519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434181+0000","last_change":"2024-04-25T01:39:24.395109+0000","last_active":"2024-04-25T01:39:34.434181+0000","last_peered":"2024-04-25T01:39:34.434181+0000","last_clean":"2024-04-25T01:39:34.434181+0000","last_became_active":"2024-04-25T01:39:24.394784+0000","last_became_peered":"2024-04-25T01:39:24.394784+0000","last_unstale":"2024-04-25T01:39:34.434181+0000","last_undegraded":"2024-04-25T01:39:34.434181+0000","last_fullsized":"2024-04-25T01:39:34.434181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:44:09.102603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197600+0000","last_change":"2024-04-25T01:39:33.446683+0000","last_active":"2024-04-25T01:39:35.197600+0000","last_peered":"2024-04-25T01:39:35.197600+0000","last_clean":"2024-04-25T01:39:35.197600+0000","last_became_active":"2024-04-25T01:39:33.445949+0000","last_became_peered":"2024-04-25T01:39:33.445949+0000","last_unstale":"2024-04-25T01:39:35.197600+0000","last_undegraded":"2024-04-25T01:39:35.197600+0000","last_fullsized":"2024-04-25T01:39:35.197600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:28.864821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199913+0000","last_change":"2024-04-25T01:39:24.380199+0000","last_active":"2024-04-25T01:39:35.199913+0000","last_peered":"2024-04-25T01:39:35.199913+0000","last_clean":"2024-04-25T01:39:35.199913+0000","last_became_active":"2024-04-25T01:39:24.379591+0000","last_became_peered":"2024-04-25T01:39:24.379591+0000","last_unstale":"2024-04-25T01:39:35.199913+0000","last_undegraded":"2024-04-25T01:39:35.199913+0000","last_fullsized":"2024-04-25T01:39:35.199913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:54.534683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197349+0000","last_change":"2024-04-25T01:39:33.439702+0000","last_active":"2024-04-25T01:39:35.197349+0000","last_peered":"2024-04-25T01:39:35.197349+0000","last_clean":"2024-04-25T01:39:35.197349+0000","last_became_active":"2024-04-25T01:39:33.439424+0000","last_became_peered":"2024-04-25T01:39:33.439424+0000","last_unstale":"2024-04-25T01:39:35.197349+0000","last_undegraded":"2024-04-25T01:39:35.197349+0000","last_fullsized":"2024-04-25T01:39:35.197349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:31.528140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197883+0000","last_change":"2024-04-25T01:39:24.395125+0000","last_active":"2024-04-25T01:39:35.197883+0000","last_peered":"2024-04-25T01:39:35.197883+0000","last_clean":"2024-04-25T01:39:35.197883+0000","last_became_active":"2024-04-25T01:39:24.392605+0000","last_became_peered":"2024-04-25T01:39:24.392605+0000","last_unstale":"2024-04-25T01:39:35.197883+0000","last_undegraded":"2024-04-25T01:39:35.197883+0000","last_fullsized":"2024-04-25T01:39:35.197883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:53.333616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559178+0000","last_change":"2024-04-25T01:39:33.438104+0000","last_active":"2024-04-25T01:39:34.559178+0000","last_peered":"2024-04-25T01:39:34.559178+0000","last_clean":"2024-04-25T01:39:34.559178+0000","last_became_active":"2024-04-25T01:39:33.437795+0000","last_became_peered":"2024-04-25T01:39:33.437795+0000","last_unstale":"2024-04-25T01:39:34.559178+0000","last_undegraded":"2024-04-25T01:39:34.559178+0000","last_fullsized":"2024-04-25T01:39:34.559178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:32.294104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199422+0000","last_change":"2024-04-25T01:39:24.391312+0000","last_active":"2024-04-25T01:39:35.199422+0000","last_peered":"2024-04-25T01:39:35.199422+0000","last_clean":"2024-04-25T01:39:35.199422+0000","last_became_active":"2024-04-25T01:39:24.390978+0000","last_became_peered":"2024-04-25T01:39:24.390978+0000","last_unstale":"2024-04-25T01:39:35.199422+0000","last_undegraded":"2024-04-25T01:39:35.199422+0000","last_fullsized":"2024-04-25T01:39:35.199422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:38:25.637031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197875+0000","last_change":"2024-04-25T01:39:33.431262+0000","last_active":"2024-04-25T01:39:35.197875+0000","last_peered":"2024-04-25T01:39:35.197875+0000","last_clean":"2024-04-25T01:39:35.197875+0000","last_became_active":"2024-04-25T01:39:33.430982+0000","last_became_peered":"2024-04-25T01:39:33.430982+0000","last_unstale":"2024-04-25T01:39:35.197875+0000","last_undegraded":"2024-04-25T01:39:35.197875+0000","last_fullsized":"2024-04-25T01:39:35.197875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:11.821542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197372+0000","last_change":"2024-04-25T01:39:24.399270+0000","last_active":"2024-04-25T01:39:35.197372+0000","last_peered":"2024-04-25T01:39:35.197372+0000","last_clean":"2024-04-25T01:39:35.197372+0000","last_became_active":"2024-04-25T01:39:24.399011+0000","last_became_peered":"2024-04-25T01:39:24.399011+0000","last_unstale":"2024-04-25T01:39:35.197372+0000","last_undegraded":"2024-04-25T01:39:35.197372+0000","last_fullsized":"2024-04-25T01:39:35.197372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:00.987674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197770+0000","last_change":"2024-04-25T01:39:33.443939+0000","last_active":"2024-04-25T01:39:35.197770+0000","last_peered":"2024-04-25T01:39:35.197770+0000","last_clean":"2024-04-25T01:39:35.197770+0000","last_became_active":"2024-04-25T01:39:33.443608+0000","last_became_peered":"2024-04-25T01:39:33.443608+0000","last_unstale":"2024-04-25T01:39:35.197770+0000","last_undegraded":"2024-04-25T01:39:35.197770+0000","last_fullsized":"2024-04-25T01:39:35.197770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:35.561173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197831+0000","last_change":"2024-04-25T01:39:24.388943+0000","last_active":"2024-04-25T01:39:35.197831+0000","last_peered":"2024-04-25T01:39:35.197831+0000","last_clean":"2024-04-25T01:39:35.197831+0000","last_became_active":"2024-04-25T01:39:24.388690+0000","last_became_peered":"2024-04-25T01:39:24.388690+0000","last_unstale":"2024-04-25T01:39:35.197831+0000","last_undegraded":"2024-04-25T01:39:35.197831+0000","last_fullsized":"2024-04-25T01:39:35.197831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:42:18.260701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198911+0000","last_change":"2024-04-25T01:39:33.438460+0000","last_active":"2024-04-25T01:39:35.198911+0000","last_peered":"2024-04-25T01:39:35.198911+0000","last_clean":"2024-04-25T01:39:35.198911+0000","last_became_active":"2024-04-25T01:39:33.436581+0000","last_became_peered":"2024-04-25T01:39:33.436581+0000","last_unstale":"2024-04-25T01:39:35.198911+0000","last_undegraded":"2024-04-25T01:39:35.198911+0000","last_fullsized":"2024-04-25T01:39:35.198911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:03:27.382925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559241+0000","last_change":"2024-04-25T01:39:24.389556+0000","last_active":"2024-04-25T01:39:34.559241+0000","last_peered":"2024-04-25T01:39:34.559241+0000","last_clean":"2024-04-25T01:39:34.559241+0000","last_became_active":"2024-04-25T01:39:24.389254+0000","last_became_peered":"2024-04-25T01:39:24.389254+0000","last_unstale":"2024-04-25T01:39:34.559241+0000","last_undegraded":"2024-04-25T01:39:34.559241+0000","last_fullsized":"2024-04-25T01:39:34.559241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:56.208172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199719+0000","last_change":"2024-04-25T01:39:33.433893+0000","last_active":"2024-04-25T01:39:35.199719+0000","last_peered":"2024-04-25T01:39:35.199719+0000","last_clean":"2024-04-25T01:39:35.199719+0000","last_became_active":"2024-04-25T01:39:33.433577+0000","last_became_peered":"2024-04-25T01:39:33.433577+0000","last_unstale":"2024-04-25T01:39:35.199719+0000","last_undegraded":"2024-04-25T01:39:35.199719+0000","last_fullsized":"2024-04-25T01:39:35.199719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:16.371837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429725+0000","last_change":"2024-04-25T01:39:24.392021+0000","last_active":"2024-04-25T01:39:34.429725+0000","last_peered":"2024-04-25T01:39:34.429725+0000","last_clean":"2024-04-25T01:39:34.429725+0000","last_became_active":"2024-04-25T01:39:24.391352+0000","last_became_peered":"2024-04-25T01:39:24.391352+0000","last_unstale":"2024-04-25T01:39:34.429725+0000","last_undegraded":"2024-04-25T01:39:34.429725+0000","last_fullsized":"2024-04-25T01:39:34.429725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:44.434749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429972+0000","last_change":"2024-04-25T01:39:33.436641+0000","last_active":"2024-04-25T01:39:34.429972+0000","last_peered":"2024-04-25T01:39:34.429972+0000","last_clean":"2024-04-25T01:39:34.429972+0000","last_became_active":"2024-04-25T01:39:33.436389+0000","last_became_peered":"2024-04-25T01:39:33.436389+0000","last_unstale":"2024-04-25T01:39:34.429972+0000","last_undegraded":"2024-04-25T01:39:34.429972+0000","last_fullsized":"2024-04-25T01:39:34.429972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:19:51.940088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198744+0000","last_change":"2024-04-25T01:39:24.396300+0000","last_active":"2024-04-25T01:39:35.198744+0000","last_peered":"2024-04-25T01:39:35.198744+0000","last_clean":"2024-04-25T01:39:35.198744+0000","last_became_active":"2024-04-25T01:39:24.396023+0000","last_became_peered":"2024-04-25T01:39:24.396023+0000","last_unstale":"2024-04-25T01:39:35.198744+0000","last_undegraded":"2024-04-25T01:39:35.198744+0000","last_fullsized":"2024-04-25T01:39:35.198744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:21.500721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197770+0000","last_change":"2024-04-25T01:39:33.443419+0000","last_active":"2024-04-25T01:39:35.197770+0000","last_peered":"2024-04-25T01:39:35.197770+0000","last_clean":"2024-04-25T01:39:35.197770+0000","last_became_active":"2024-04-25T01:39:33.443163+0000","last_became_peered":"2024-04-25T01:39:33.443163+0000","last_unstale":"2024-04-25T01:39:35.197770+0000","last_undegraded":"2024-04-25T01:39:35.197770+0000","last_fullsized":"2024-04-25T01:39:35.197770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:22.156410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434366+0000","last_change":"2024-04-25T01:39:24.404047+0000","last_active":"2024-04-25T01:39:34.434366+0000","last_peered":"2024-04-25T01:39:34.434366+0000","last_clean":"2024-04-25T01:39:34.434366+0000","last_became_active":"2024-04-25T01:39:24.403700+0000","last_became_peered":"2024-04-25T01:39:24.403700+0000","last_unstale":"2024-04-25T01:39:34.434366+0000","last_undegraded":"2024-04-25T01:39:34.434366+0000","last_fullsized":"2024-04-25T01:39:34.434366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:53.123061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199905+0000","last_change":"2024-04-25T01:39:33.435520+0000","last_active":"2024-04-25T01:39:35.199905+0000","last_peered":"2024-04-25T01:39:35.199905+0000","last_clean":"2024-04-25T01:39:35.199905+0000","last_became_active":"2024-04-25T01:39:33.434446+0000","last_became_peered":"2024-04-25T01:39:33.434446+0000","last_unstale":"2024-04-25T01:39:35.199905+0000","last_undegraded":"2024-04-25T01:39:35.199905+0000","last_fullsized":"2024-04-25T01:39:35.199905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:59.696009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434467+0000","last_change":"2024-04-25T01:39:24.406158+0000","last_active":"2024-04-25T01:39:34.434467+0000","last_peered":"2024-04-25T01:39:34.434467+0000","last_clean":"2024-04-25T01:39:34.434467+0000","last_became_active":"2024-04-25T01:39:24.405876+0000","last_became_peered":"2024-04-25T01:39:24.405876+0000","last_unstale":"2024-04-25T01:39:34.434467+0000","last_undegraded":"2024-04-25T01:39:34.434467+0000","last_fullsized":"2024-04-25T01:39:34.434467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:18:19.895651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198497+0000","last_change":"2024-04-25T01:39:33.436479+0000","last_active":"2024-04-25T01:39:35.198497+0000","last_peered":"2024-04-25T01:39:35.198497+0000","last_clean":"2024-04-25T01:39:35.198497+0000","last_became_active":"2024-04-25T01:39:33.436193+0000","last_became_peered":"2024-04-25T01:39:33.436193+0000","last_unstale":"2024-04-25T01:39:35.198497+0000","last_undegraded":"2024-04-25T01:39:35.198497+0000","last_fullsized":"2024-04-25T01:39:35.198497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:20:03.455536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200363+0000","last_change":"2024-04-25T01:39:24.393362+0000","last_active":"2024-04-25T01:39:35.200363+0000","last_peered":"2024-04-25T01:39:35.200363+0000","last_clean":"2024-04-25T01:39:35.200363+0000","last_became_active":"2024-04-25T01:39:24.392836+0000","last_became_peered":"2024-04-25T01:39:24.392836+0000","last_unstale":"2024-04-25T01:39:35.200363+0000","last_undegraded":"2024-04-25T01:39:35.200363+0000","last_fullsized":"2024-04-25T01:39:35.200363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:58.871777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430064+0000","last_change":"2024-04-25T01:39:33.440164+0000","last_active":"2024-04-25T01:39:34.430064+0000","last_peered":"2024-04-25T01:39:34.430064+0000","last_clean":"2024-04-25T01:39:34.430064+0000","last_became_active":"2024-04-25T01:39:33.439878+0000","last_became_peered":"2024-04-25T01:39:33.439878+0000","last_unstale":"2024-04-25T01:39:34.430064+0000","last_undegraded":"2024-04-25T01:39:34.430064+0000","last_fullsized":"2024-04-25T01:39:34.430064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:44:52.817169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429296+0000","last_change":"2024-04-25T01:39:24.401765+0000","last_active":"2024-04-25T01:39:34.429296+0000","last_peered":"2024-04-25T01:39:34.429296+0000","last_clean":"2024-04-25T01:39:34.429296+0000","last_became_active":"2024-04-25T01:39:24.400509+0000","last_became_peered":"2024-04-25T01:39:24.400509+0000","last_unstale":"2024-04-25T01:39:34.429296+0000","last_undegraded":"2024-04-25T01:39:34.429296+0000","last_fullsized":"2024-04-25T01:39:34.429296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:25.031622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434669+0000","last_change":"2024-04-25T01:39:33.439353+0000","last_active":"2024-04-25T01:39:34.434669+0000","last_peered":"2024-04-25T01:39:34.434669+0000","last_clean":"2024-04-25T01:39:34.434669+0000","last_became_active":"2024-04-25T01:39:33.438915+0000","last_became_peered":"2024-04-25T01:39:33.438915+0000","last_unstale":"2024-04-25T01:39:34.434669+0000","last_undegraded":"2024-04-25T01:39:34.434669+0000","last_fullsized":"2024-04-25T01:39:34.434669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:19.180919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198881+0000","last_change":"2024-04-25T01:39:24.387941+0000","last_active":"2024-04-25T01:39:35.198881+0000","last_peered":"2024-04-25T01:39:35.198881+0000","last_clean":"2024-04-25T01:39:35.198881+0000","last_became_active":"2024-04-25T01:39:24.387674+0000","last_became_peered":"2024-04-25T01:39:24.387674+0000","last_unstale":"2024-04-25T01:39:35.198881+0000","last_undegraded":"2024-04-25T01:39:35.198881+0000","last_fullsized":"2024-04-25T01:39:35.198881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:05.676143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197803+0000","last_change":"2024-04-25T01:39:33.444917+0000","last_active":"2024-04-25T01:39:35.197803+0000","last_peered":"2024-04-25T01:39:35.197803+0000","last_clean":"2024-04-25T01:39:35.197803+0000","last_became_active":"2024-04-25T01:39:33.444636+0000","last_became_peered":"2024-04-25T01:39:33.444636+0000","last_unstale":"2024-04-25T01:39:35.197803+0000","last_undegraded":"2024-04-25T01:39:35.197803+0000","last_fullsized":"2024-04-25T01:39:35.197803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:31.531502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197880+0000","last_change":"2024-04-25T01:39:24.399950+0000","last_active":"2024-04-25T01:39:35.197880+0000","last_peered":"2024-04-25T01:39:35.197880+0000","last_clean":"2024-04-25T01:39:35.197880+0000","last_became_active":"2024-04-25T01:39:24.399701+0000","last_became_peered":"2024-04-25T01:39:24.399701+0000","last_unstale":"2024-04-25T01:39:35.197880+0000","last_undegraded":"2024-04-25T01:39:35.197880+0000","last_fullsized":"2024-04-25T01:39:35.197880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:49.618370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200035+0000","last_change":"2024-04-25T01:39:33.440936+0000","last_active":"2024-04-25T01:39:35.200035+0000","last_peered":"2024-04-25T01:39:35.200035+0000","last_clean":"2024-04-25T01:39:35.200035+0000","last_became_active":"2024-04-25T01:39:33.440679+0000","last_became_peered":"2024-04-25T01:39:33.440679+0000","last_unstale":"2024-04-25T01:39:35.200035+0000","last_undegraded":"2024-04-25T01:39:35.200035+0000","last_fullsized":"2024-04-25T01:39:35.200035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:08:53.629572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198222+0000","last_change":"2024-04-25T01:39:24.380318+0000","last_active":"2024-04-25T01:39:35.198222+0000","last_peered":"2024-04-25T01:39:35.198222+0000","last_clean":"2024-04-25T01:39:35.198222+0000","last_became_active":"2024-04-25T01:39:24.379573+0000","last_became_peered":"2024-04-25T01:39:24.379573+0000","last_unstale":"2024-04-25T01:39:35.198222+0000","last_undegraded":"2024-04-25T01:39:35.198222+0000","last_fullsized":"2024-04-25T01:39:35.198222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:12.089917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429399+0000","last_change":"2024-04-25T01:39:33.426380+0000","last_active":"2024-04-25T01:39:34.429399+0000","last_peered":"2024-04-25T01:39:34.429399+0000","last_clean":"2024-04-25T01:39:34.429399+0000","last_became_active":"2024-04-25T01:39:33.426090+0000","last_became_peered":"2024-04-25T01:39:33.426090+0000","last_unstale":"2024-04-25T01:39:34.429399+0000","last_undegraded":"2024-04-25T01:39:34.429399+0000","last_fullsized":"2024-04-25T01:39:34.429399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:34.329217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199243+0000","last_change":"2024-04-25T01:39:24.398726+0000","last_active":"2024-04-25T01:39:35.199243+0000","last_peered":"2024-04-25T01:39:35.199243+0000","last_clean":"2024-04-25T01:39:35.199243+0000","last_became_active":"2024-04-25T01:39:24.398449+0000","last_became_peered":"2024-04-25T01:39:24.398449+0000","last_unstale":"2024-04-25T01:39:35.199243+0000","last_undegraded":"2024-04-25T01:39:35.199243+0000","last_fullsized":"2024-04-25T01:39:35.199243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:41:38.230939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197750+0000","last_change":"2024-04-25T01:39:33.436488+0000","last_active":"2024-04-25T01:39:35.197750+0000","last_peered":"2024-04-25T01:39:35.197750+0000","last_clean":"2024-04-25T01:39:35.197750+0000","last_became_active":"2024-04-25T01:39:33.436224+0000","last_became_peered":"2024-04-25T01:39:33.436224+0000","last_unstale":"2024-04-25T01:39:35.197750+0000","last_undegraded":"2024-04-25T01:39:35.197750+0000","last_fullsized":"2024-04-25T01:39:35.197750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:38.227206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559398+0000","last_change":"2024-04-25T01:39:24.386909+0000","last_active":"2024-04-25T01:39:34.559398+0000","last_peered":"2024-04-25T01:39:34.559398+0000","last_clean":"2024-04-25T01:39:34.559398+0000","last_became_active":"2024-04-25T01:39:24.386568+0000","last_became_peered":"2024-04-25T01:39:24.386568+0000","last_unstale":"2024-04-25T01:39:34.559398+0000","last_undegraded":"2024-04-25T01:39:34.559398+0000","last_fullsized":"2024-04-25T01:39:34.559398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:29.904064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197979+0000","last_change":"2024-04-25T01:39:33.440753+0000","last_active":"2024-04-25T01:39:35.197979+0000","last_peered":"2024-04-25T01:39:35.197979+0000","last_clean":"2024-04-25T01:39:35.197979+0000","last_became_active":"2024-04-25T01:39:33.440480+0000","last_became_peered":"2024-04-25T01:39:33.440480+0000","last_unstale":"2024-04-25T01:39:35.197979+0000","last_undegraded":"2024-04-25T01:39:35.197979+0000","last_fullsized":"2024-04-25T01:39:35.197979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:18.113293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197980+0000","last_change":"2024-04-25T01:39:24.386803+0000","last_active":"2024-04-25T01:39:35.197980+0000","last_peered":"2024-04-25T01:39:35.197980+0000","last_clean":"2024-04-25T01:39:35.197980+0000","last_became_active":"2024-04-25T01:39:24.386531+0000","last_became_peered":"2024-04-25T01:39:24.386531+0000","last_unstale":"2024-04-25T01:39:35.197980+0000","last_undegraded":"2024-04-25T01:39:35.197980+0000","last_fullsized":"2024-04-25T01:39:35.197980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:19.160345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198690+0000","last_change":"2024-04-25T01:39:33.436433+0000","last_active":"2024-04-25T01:39:35.198690+0000","last_peered":"2024-04-25T01:39:35.198690+0000","last_clean":"2024-04-25T01:39:35.198690+0000","last_became_active":"2024-04-25T01:39:33.436134+0000","last_became_peered":"2024-04-25T01:39:33.436134+0000","last_unstale":"2024-04-25T01:39:35.198690+0000","last_undegraded":"2024-04-25T01:39:35.198690+0000","last_fullsized":"2024-04-25T01:39:35.198690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:08:30.641790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200300+0000","last_change":"2024-04-25T01:39:24.396231+0000","last_active":"2024-04-25T01:39:35.200300+0000","last_peered":"2024-04-25T01:39:35.200300+0000","last_clean":"2024-04-25T01:39:35.200300+0000","last_became_active":"2024-04-25T01:39:24.395958+0000","last_became_peered":"2024-04-25T01:39:24.395958+0000","last_unstale":"2024-04-25T01:39:35.200300+0000","last_undegraded":"2024-04-25T01:39:35.200300+0000","last_fullsized":"2024-04-25T01:39:35.200300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:54.898765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":690301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":101489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":99491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":102507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":101055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T01:39:44.344 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T01:39:44.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.492+0000 7f6721f70640 1 Processor -- start 2024-04-25T01:39:44.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.492+0000 7f6721f70640 1 -- start start 2024-04-25T01:39:44.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.492+0000 7f6721f70640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f671c151390 0x7f671c0ab380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:44.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.492+0000 7f6721f70640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f671c0ab8c0 0x7f671c157450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:44.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.492+0000 7f6721f70640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f671c070170 con 0x7f671c0c6b70 2024-04-25T01:39:44.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.492+0000 7f6721f70640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f671c1541f0 con 0x7f671c151390 2024-04-25T01:39:44.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.492+0000 7f6721f70640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f671c1544d0 con 0x7f671c0ab8c0 2024-04-25T01:39:44.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.492+0000 7f671b7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f671c151390 0x7f671c0ab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:44.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.492+0000 7f671b7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f671c151390 0x7f671c0ab380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47120/0 (socket says 172.21.15.77:47120) 2024-04-25T01:39:44.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.492+0000 7f671b7fe640 1 -- 172.21.15.77:0/3249663585 learned_addr learned my addr 172.21.15.77:0/3249663585 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:44.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.493+0000 7f671b7fe640 1 -- 172.21.15.77:0/3249663585 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f671c0ab8c0 msgr2=0x7f671c157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:44.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.493+0000 7f671b7fe640 1 --2- 172.21.15.77:0/3249663585 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f671c0ab8c0 0x7f671c157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:44.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.493+0000 7f671b7fe640 1 -- 172.21.15.77:0/3249663585 >> v1:172.21.15.121:6789/0 conn(0x7f671c0c6b70 legacy=0x7f671c0c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:44.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.493+0000 7f671b7fe640 1 -- 172.21.15.77:0/3249663585 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f671c1547b0 con 0x7f671c151390 2024-04-25T01:39:44.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.493+0000 7f671b7fe640 1 --2- 172.21.15.77:0/3249663585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f671c151390 0x7f671c0ab380 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f670c009870 tx=0x7f670c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dba92d1911046da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:44.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.493+0000 7f671a7fc640 1 -- 172.21.15.77:0/3249663585 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670c037070 con 0x7f671c151390 2024-04-25T01:39:44.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.493+0000 7f671a7fc640 1 -- 172.21.15.77:0/3249663585 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f670c02ae10 con 0x7f671c151390 2024-04-25T01:39:44.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.493+0000 7f671a7fc640 1 -- 172.21.15.77:0/3249663585 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670c032660 con 0x7f671c151390 2024-04-25T01:39:44.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.494+0000 7f6721f70640 1 -- 172.21.15.77:0/3249663585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f671c151390 msgr2=0x7f671c0ab380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:44.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.494+0000 7f6721f70640 1 --2- 172.21.15.77:0/3249663585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f671c151390 0x7f671c0ab380 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f670c009870 tx=0x7f670c02a100 comp rx=0 tx=0).stop 2024-04-25T01:39:44.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.494+0000 7f6721f70640 1 -- 172.21.15.77:0/3249663585 shutdown_connections 2024-04-25T01:39:44.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.494+0000 7f6721f70640 1 --2- 172.21.15.77:0/3249663585 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f671c0ab8c0 0x7f671c157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:44.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.494+0000 7f6721f70640 1 --2- 172.21.15.77:0/3249663585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f671c151390 0x7f671c0ab380 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:44.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.494+0000 7f6721f70640 1 -- 172.21.15.77:0/3249663585 >> 172.21.15.77:0/3249663585 conn(0x7f671c06b530 msgr2=0x7f671c0aa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:44.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.494+0000 7f6721f70640 1 -- 172.21.15.77:0/3249663585 shutdown_connections 2024-04-25T01:39:44.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.494+0000 7f6721f70640 1 -- 172.21.15.77:0/3249663585 wait complete. 2024-04-25T01:39:44.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.495+0000 7f6721f70640 1 Processor -- start 2024-04-25T01:39:44.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.495+0000 7f6721f70640 1 -- start start 2024-04-25T01:39:44.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.496+0000 7f6721f70640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f671c0ab8c0 0x7f671c14a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:44.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.496+0000 7f6721f70640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f671c0c6b70 0x7f671c0ac740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:44.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.496+0000 7f6721f70640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f671c151390 0x7f671c1ea3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:44.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.496+0000 7f6721f70640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f671c154cd0 con 0x7f671c0ab8c0 2024-04-25T01:39:44.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.496+0000 7f6721f70640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f671c06f290 con 0x7f671c151390 2024-04-25T01:39:44.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.496+0000 7f6721f70640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f671c154e50 con 0x7f671c0c6b70 2024-04-25T01:39:44.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.496+0000 7f671b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f671c0ab8c0 0x7f671c14a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:44.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.496+0000 7f671b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f671c0ab8c0 0x7f671c14a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47130/0 (socket says 172.21.15.77:47130) 2024-04-25T01:39:44.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.496+0000 7f671b7fe640 1 -- 172.21.15.77:0/4037601026 learned_addr learned my addr 172.21.15.77:0/4037601026 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:44.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.496+0000 7f671affd640 1 --2- 172.21.15.77:0/4037601026 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f671c0c6b70 0x7f671c0ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:44.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.496+0000 7f671bfff640 1 --2- 172.21.15.77:0/4037601026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f671c151390 0x7f671c1ea3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:44.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.496+0000 7f671b7fe640 1 -- 172.21.15.77:0/4037601026 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f671c0c6b70 msgr2=0x7f671c0ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:44.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.496+0000 7f671b7fe640 1 --2- 172.21.15.77:0/4037601026 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f671c0c6b70 0x7f671c0ac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:44.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.496+0000 7f671b7fe640 1 -- 172.21.15.77:0/4037601026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f671c151390 msgr2=0x7f671c1ea3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:44.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.496+0000 7f671b7fe640 1 --2- 172.21.15.77:0/4037601026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f671c151390 0x7f671c1ea3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:44.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.496+0000 7f671b7fe640 1 -- 172.21.15.77:0/4037601026 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f671c1defa0 con 0x7f671c0ab8c0 2024-04-25T01:39:44.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.496+0000 7f671bfff640 1 --2- 172.21.15.77:0/4037601026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f671c151390 0x7f671c1ea3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:44.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.497+0000 7f671b7fe640 1 --2- 172.21.15.77:0/4037601026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f671c0ab8c0 0x7f671c14a190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f670c009870 tx=0x7f670c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:44.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.497+0000 7f6703fff640 1 -- 172.21.15.77:0/4037601026 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670c042070 con 0x7f671c0ab8c0 2024-04-25T01:39:44.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.497+0000 7f6703fff640 1 -- 172.21.15.77:0/4037601026 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f670c03e670 con 0x7f671c0ab8c0 2024-04-25T01:39:44.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.497+0000 7f6721f70640 1 -- 172.21.15.77:0/4037601026 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f671c1df280 con 0x7f671c0ab8c0 2024-04-25T01:39:44.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.497+0000 7f6703fff640 1 -- 172.21.15.77:0/4037601026 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670c037040 con 0x7f671c0ab8c0 2024-04-25T01:39:44.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.497+0000 7f6721f70640 1 -- 172.21.15.77:0/4037601026 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f671c1e9ed0 con 0x7f671c0ab8c0 2024-04-25T01:39:44.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.498+0000 7f6721f70640 1 -- 172.21.15.77:0/4037601026 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f671c0688e0 con 0x7f671c0ab8c0 2024-04-25T01:39:44.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.498+0000 7f6703fff640 1 -- 172.21.15.77:0/4037601026 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f670c045070 con 0x7f671c0ab8c0 2024-04-25T01:39:44.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.499+0000 7f6703fff640 1 --2- 172.21.15.77:0/4037601026 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f670806be30 0x7f670806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:44.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.499+0000 7f6703fff640 1 -- 172.21.15.77:0/4037601026 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f670c0abb10 con 0x7f671c0ab8c0 2024-04-25T01:39:44.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.499+0000 7f671affd640 1 --2- 172.21.15.77:0/4037601026 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f670806be30 0x7f670806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:44.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.499+0000 7f671affd640 1 --2- 172.21.15.77:0/4037601026 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f670806be30 0x7f670806e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f671c14e020 tx=0x7f6710009110 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:44.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.503+0000 7f6703fff640 1 -- 172.21.15.77:0/4037601026 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f670c07a340 con 0x7f671c0ab8c0 2024-04-25T01:39:44.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.674+0000 7f6721f70640 1 -- 172.21.15.77:0/4037601026 --> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f671c1ded50 con 0x7f670806be30 2024-04-25T01:39:44.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.684+0000 7f6703fff640 1 -- 172.21.15.77:0/4037601026 <== mgr.4098 v2:172.21.15.77:6832/4208232183 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490306 (secure 0 0 0) 0x7f671c1ded50 con 0x7f670806be30 2024-04-25T01:39:44.673 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:44.676 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-25T01:39:44.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.688+0000 7f6721f70640 1 -- 172.21.15.77:0/4037601026 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f670806be30 msgr2=0x7f670806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:44.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.688+0000 7f6721f70640 1 --2- 172.21.15.77:0/4037601026 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f670806be30 0x7f670806e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f671c14e020 tx=0x7f6710009110 comp rx=0 tx=0).stop 2024-04-25T01:39:44.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.688+0000 7f6721f70640 1 -- 172.21.15.77:0/4037601026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f671c0ab8c0 msgr2=0x7f671c14a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:44.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.688+0000 7f6721f70640 1 --2- 172.21.15.77:0/4037601026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f671c0ab8c0 0x7f671c14a190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f670c009870 tx=0x7f670c0046c0 comp rx=0 tx=0).stop 2024-04-25T01:39:44.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.689+0000 7f6721f70640 1 -- 172.21.15.77:0/4037601026 shutdown_connections 2024-04-25T01:39:44.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.689+0000 7f6721f70640 1 --2- 172.21.15.77:0/4037601026 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f670806be30 0x7f670806e2f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:44.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.689+0000 7f6721f70640 1 --2- 172.21.15.77:0/4037601026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f671c151390 0x7f671c1ea3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:44.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.689+0000 7f6721f70640 1 --2- 172.21.15.77:0/4037601026 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f671c0c6b70 0x7f671c0ac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:44.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.689+0000 7f6721f70640 1 --2- 172.21.15.77:0/4037601026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f671c0ab8c0 0x7f671c14a190 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:44.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.689+0000 7f6721f70640 1 -- 172.21.15.77:0/4037601026 >> 172.21.15.77:0/4037601026 conn(0x7f671c06b530 msgr2=0x7f671c0aa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:44.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.689+0000 7f6721f70640 1 -- 172.21.15.77:0/4037601026 shutdown_connections 2024-04-25T01:39:44.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.689+0000 7f6721f70640 1 -- 172.21.15.77:0/4037601026 wait complete. 2024-04-25T01:39:44.683 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-04-25T01:39:43.655182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":249,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219460,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755260,"statfs":{"total":773094113280,"available":772869386240,"internally_reserved":0,"allocated":3350528,"data_stored":1984464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002553"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197412+0000","last_change":"2024-04-25T01:39:33.445614+0000","last_active":"2024-04-25T01:39:35.197412+0000","last_peered":"2024-04-25T01:39:35.197412+0000","last_clean":"2024-04-25T01:39:35.197412+0000","last_became_active":"2024-04-25T01:39:33.445090+0000","last_became_peered":"2024-04-25T01:39:33.445090+0000","last_unstale":"2024-04-25T01:39:35.197412+0000","last_undegraded":"2024-04-25T01:39:35.197412+0000","last_fullsized":"2024-04-25T01:39:35.197412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:50.951488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559582+0000","last_change":"2024-04-25T01:39:23.377096+0000","last_active":"2024-04-25T01:39:34.559582+0000","last_peered":"2024-04-25T01:39:34.559582+0000","last_clean":"2024-04-25T01:39:34.559582+0000","last_became_active":"2024-04-25T01:39:23.376811+0000","last_became_peered":"2024-04-25T01:39:23.376811+0000","last_unstale":"2024-04-25T01:39:34.559582+0000","last_undegraded":"2024-04-25T01:39:34.559582+0000","last_fullsized":"2024-04-25T01:39:34.559582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:26.888605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430280+0000","last_change":"2024-04-25T01:39:24.394317+0000","last_active":"2024-04-25T01:39:34.430280+0000","last_peered":"2024-04-25T01:39:34.430280+0000","last_clean":"2024-04-25T01:39:34.430280+0000","last_became_active":"2024-04-25T01:39:24.394032+0000","last_became_peered":"2024-04-25T01:39:24.394032+0000","last_unstale":"2024-04-25T01:39:34.430280+0000","last_undegraded":"2024-04-25T01:39:34.430280+0000","last_fullsized":"2024-04-25T01:39:34.430280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:11.795443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429310+0000","last_change":"2024-04-25T01:39:32.421607+0000","last_active":"2024-04-25T01:39:34.429310+0000","last_peered":"2024-04-25T01:39:34.429310+0000","last_clean":"2024-04-25T01:39:34.429310+0000","last_became_active":"2024-04-25T01:39:32.421355+0000","last_became_peered":"2024-04-25T01:39:32.421355+0000","last_unstale":"2024-04-25T01:39:34.429310+0000","last_undegraded":"2024-04-25T01:39:34.429310+0000","last_fullsized":"2024-04-25T01:39:34.429310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:12:14.019262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198433+0000","last_change":"2024-04-25T01:39:33.436651+0000","last_active":"2024-04-25T01:39:35.198433+0000","last_peered":"2024-04-25T01:39:35.198433+0000","last_clean":"2024-04-25T01:39:35.198433+0000","last_became_active":"2024-04-25T01:39:33.436370+0000","last_became_peered":"2024-04-25T01:39:33.436370+0000","last_unstale":"2024-04-25T01:39:35.198433+0000","last_undegraded":"2024-04-25T01:39:35.198433+0000","last_fullsized":"2024-04-25T01:39:35.198433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:57:10.341738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430287+0000","last_change":"2024-04-25T01:39:23.369400+0000","last_active":"2024-04-25T01:39:34.430287+0000","last_peered":"2024-04-25T01:39:34.430287+0000","last_clean":"2024-04-25T01:39:34.430287+0000","last_became_active":"2024-04-25T01:39:23.368726+0000","last_became_peered":"2024-04-25T01:39:23.368726+0000","last_unstale":"2024-04-25T01:39:34.430287+0000","last_undegraded":"2024-04-25T01:39:34.430287+0000","last_fullsized":"2024-04-25T01:39:34.430287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:35:42.971179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559440+0000","last_change":"2024-04-25T01:39:24.403873+0000","last_active":"2024-04-25T01:39:34.559440+0000","last_peered":"2024-04-25T01:39:34.559440+0000","last_clean":"2024-04-25T01:39:34.559440+0000","last_became_active":"2024-04-25T01:39:24.403623+0000","last_became_peered":"2024-04-25T01:39:24.403623+0000","last_unstale":"2024-04-25T01:39:34.559440+0000","last_undegraded":"2024-04-25T01:39:34.559440+0000","last_fullsized":"2024-04-25T01:39:34.559440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:49.360933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197343+0000","last_change":"2024-04-25T01:39:32.430985+0000","last_active":"2024-04-25T01:39:35.197343+0000","last_peered":"2024-04-25T01:39:35.197343+0000","last_clean":"2024-04-25T01:39:35.197343+0000","last_became_active":"2024-04-25T01:39:32.430617+0000","last_became_peered":"2024-04-25T01:39:32.430617+0000","last_unstale":"2024-04-25T01:39:35.197343+0000","last_undegraded":"2024-04-25T01:39:35.197343+0000","last_fullsized":"2024-04-25T01:39:35.197343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:13.938619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199408+0000","last_change":"2024-04-25T01:39:33.444043+0000","last_active":"2024-04-25T01:39:35.199408+0000","last_peered":"2024-04-25T01:39:35.199408+0000","last_clean":"2024-04-25T01:39:35.199408+0000","last_became_active":"2024-04-25T01:39:33.443737+0000","last_became_peered":"2024-04-25T01:39:33.443737+0000","last_unstale":"2024-04-25T01:39:35.199408+0000","last_undegraded":"2024-04-25T01:39:35.199408+0000","last_fullsized":"2024-04-25T01:39:35.199408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:02:50.401910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199857+0000","last_change":"2024-04-25T01:39:23.377963+0000","last_active":"2024-04-25T01:39:35.199857+0000","last_peered":"2024-04-25T01:39:35.199857+0000","last_clean":"2024-04-25T01:39:35.199857+0000","last_became_active":"2024-04-25T01:39:23.377402+0000","last_became_peered":"2024-04-25T01:39:23.377402+0000","last_unstale":"2024-04-25T01:39:35.199857+0000","last_undegraded":"2024-04-25T01:39:35.199857+0000","last_fullsized":"2024-04-25T01:39:35.199857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:15.873450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199352+0000","last_change":"2024-04-25T01:39:24.394512+0000","last_active":"2024-04-25T01:39:35.199352+0000","last_peered":"2024-04-25T01:39:35.199352+0000","last_clean":"2024-04-25T01:39:35.199352+0000","last_became_active":"2024-04-25T01:39:24.393954+0000","last_became_peered":"2024-04-25T01:39:24.393954+0000","last_unstale":"2024-04-25T01:39:35.199352+0000","last_undegraded":"2024-04-25T01:39:35.199352+0000","last_fullsized":"2024-04-25T01:39:35.199352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:30.534400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197850+0000","last_change":"2024-04-25T01:39:32.428198+0000","last_active":"2024-04-25T01:39:35.197850+0000","last_peered":"2024-04-25T01:39:35.197850+0000","last_clean":"2024-04-25T01:39:35.197850+0000","last_became_active":"2024-04-25T01:39:32.427955+0000","last_became_peered":"2024-04-25T01:39:32.427955+0000","last_unstale":"2024-04-25T01:39:35.197850+0000","last_undegraded":"2024-04-25T01:39:35.197850+0000","last_fullsized":"2024-04-25T01:39:35.197850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:07.684150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198064+0000","last_change":"2024-04-25T01:39:33.439854+0000","last_active":"2024-04-25T01:39:35.198064+0000","last_peered":"2024-04-25T01:39:35.198064+0000","last_clean":"2024-04-25T01:39:35.198064+0000","last_became_active":"2024-04-25T01:39:33.439555+0000","last_became_peered":"2024-04-25T01:39:33.439555+0000","last_unstale":"2024-04-25T01:39:35.198064+0000","last_undegraded":"2024-04-25T01:39:35.198064+0000","last_fullsized":"2024-04-25T01:39:35.198064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:50.250748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198904+0000","last_change":"2024-04-25T01:39:23.377093+0000","last_active":"2024-04-25T01:39:35.198904+0000","last_peered":"2024-04-25T01:39:35.198904+0000","last_clean":"2024-04-25T01:39:35.198904+0000","last_became_active":"2024-04-25T01:39:23.376744+0000","last_became_peered":"2024-04-25T01:39:23.376744+0000","last_unstale":"2024-04-25T01:39:35.198904+0000","last_undegraded":"2024-04-25T01:39:35.198904+0000","last_fullsized":"2024-04-25T01:39:35.198904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:43.529618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200129+0000","last_change":"2024-04-25T01:39:24.393293+0000","last_active":"2024-04-25T01:39:35.200129+0000","last_peered":"2024-04-25T01:39:35.200129+0000","last_clean":"2024-04-25T01:39:35.200129+0000","last_became_active":"2024-04-25T01:39:24.393005+0000","last_became_peered":"2024-04-25T01:39:24.393005+0000","last_unstale":"2024-04-25T01:39:35.200129+0000","last_undegraded":"2024-04-25T01:39:35.200129+0000","last_fullsized":"2024-04-25T01:39:35.200129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:32.070747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197654+0000","last_change":"2024-04-25T01:39:32.428956+0000","last_active":"2024-04-25T01:39:35.197654+0000","last_peered":"2024-04-25T01:39:35.197654+0000","last_clean":"2024-04-25T01:39:35.197654+0000","last_became_active":"2024-04-25T01:39:32.428705+0000","last_became_peered":"2024-04-25T01:39:32.428705+0000","last_unstale":"2024-04-25T01:39:35.197654+0000","last_undegraded":"2024-04-25T01:39:35.197654+0000","last_fullsized":"2024-04-25T01:39:35.197654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:06:22.998986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198197+0000","last_change":"2024-04-25T01:39:33.446571+0000","last_active":"2024-04-25T01:39:35.198197+0000","last_peered":"2024-04-25T01:39:35.198197+0000","last_clean":"2024-04-25T01:39:35.198197+0000","last_became_active":"2024-04-25T01:39:33.446234+0000","last_became_peered":"2024-04-25T01:39:33.446234+0000","last_unstale":"2024-04-25T01:39:35.198197+0000","last_undegraded":"2024-04-25T01:39:35.198197+0000","last_fullsized":"2024-04-25T01:39:35.198197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:12.742092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434733+0000","last_change":"2024-04-25T01:39:24.398859+0000","last_active":"2024-04-25T01:39:34.434733+0000","last_peered":"2024-04-25T01:39:34.434733+0000","last_clean":"2024-04-25T01:39:34.434733+0000","last_became_active":"2024-04-25T01:39:24.398618+0000","last_became_peered":"2024-04-25T01:39:24.398618+0000","last_unstale":"2024-04-25T01:39:34.434733+0000","last_undegraded":"2024-04-25T01:39:34.434733+0000","last_fullsized":"2024-04-25T01:39:34.434733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:15.278376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199208+0000","last_change":"2024-04-25T01:39:23.377717+0000","last_active":"2024-04-25T01:39:35.199208+0000","last_peered":"2024-04-25T01:39:35.199208+0000","last_clean":"2024-04-25T01:39:35.199208+0000","last_became_active":"2024-04-25T01:39:23.377291+0000","last_became_peered":"2024-04-25T01:39:23.377291+0000","last_unstale":"2024-04-25T01:39:35.199208+0000","last_undegraded":"2024-04-25T01:39:35.199208+0000","last_fullsized":"2024-04-25T01:39:35.199208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:06.402745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197947+0000","last_change":"2024-04-25T01:39:32.426840+0000","last_active":"2024-04-25T01:39:35.197947+0000","last_peered":"2024-04-25T01:39:35.197947+0000","last_clean":"2024-04-25T01:39:35.197947+0000","last_became_active":"2024-04-25T01:39:32.426529+0000","last_became_peered":"2024-04-25T01:39:32.426529+0000","last_unstale":"2024-04-25T01:39:35.197947+0000","last_undegraded":"2024-04-25T01:39:35.197947+0000","last_fullsized":"2024-04-25T01:39:35.197947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:57.097685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198092+0000","last_change":"2024-04-25T01:39:33.437767+0000","last_active":"2024-04-25T01:39:35.198092+0000","last_peered":"2024-04-25T01:39:35.198092+0000","last_clean":"2024-04-25T01:39:35.198092+0000","last_became_active":"2024-04-25T01:39:33.437483+0000","last_became_peered":"2024-04-25T01:39:33.437483+0000","last_unstale":"2024-04-25T01:39:35.198092+0000","last_undegraded":"2024-04-25T01:39:35.198092+0000","last_fullsized":"2024-04-25T01:39:35.198092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:44.321779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429750+0000","last_change":"2024-04-25T01:39:24.387100+0000","last_active":"2024-04-25T01:39:34.429750+0000","last_peered":"2024-04-25T01:39:34.429750+0000","last_clean":"2024-04-25T01:39:34.429750+0000","last_became_active":"2024-04-25T01:39:24.386782+0000","last_became_peered":"2024-04-25T01:39:24.386782+0000","last_unstale":"2024-04-25T01:39:34.429750+0000","last_undegraded":"2024-04-25T01:39:34.429750+0000","last_fullsized":"2024-04-25T01:39:34.429750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:48.789139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198800+0000","last_change":"2024-04-25T01:39:23.368446+0000","last_active":"2024-04-25T01:39:35.198800+0000","last_peered":"2024-04-25T01:39:35.198800+0000","last_clean":"2024-04-25T01:39:35.198800+0000","last_became_active":"2024-04-25T01:39:23.368183+0000","last_became_peered":"2024-04-25T01:39:23.368183+0000","last_unstale":"2024-04-25T01:39:35.198800+0000","last_undegraded":"2024-04-25T01:39:35.198800+0000","last_fullsized":"2024-04-25T01:39:35.198800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:13.738756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198383+0000","last_change":"2024-04-25T01:39:32.427589+0000","last_active":"2024-04-25T01:39:35.198383+0000","last_peered":"2024-04-25T01:39:35.198383+0000","last_clean":"2024-04-25T01:39:35.198383+0000","last_became_active":"2024-04-25T01:39:32.427328+0000","last_became_peered":"2024-04-25T01:39:32.427328+0000","last_unstale":"2024-04-25T01:39:35.198383+0000","last_undegraded":"2024-04-25T01:39:35.198383+0000","last_fullsized":"2024-04-25T01:39:35.198383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:12.328303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199145+0000","last_change":"2024-04-25T01:39:33.447634+0000","last_active":"2024-04-25T01:39:35.199145+0000","last_peered":"2024-04-25T01:39:35.199145+0000","last_clean":"2024-04-25T01:39:35.199145+0000","last_became_active":"2024-04-25T01:39:33.445908+0000","last_became_peered":"2024-04-25T01:39:33.445908+0000","last_unstale":"2024-04-25T01:39:35.199145+0000","last_undegraded":"2024-04-25T01:39:35.199145+0000","last_fullsized":"2024-04-25T01:39:35.199145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:13.586396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429559+0000","last_change":"2024-04-25T01:39:24.373600+0000","last_active":"2024-04-25T01:39:34.429559+0000","last_peered":"2024-04-25T01:39:34.429559+0000","last_clean":"2024-04-25T01:39:34.429559+0000","last_became_active":"2024-04-25T01:39:24.373311+0000","last_became_peered":"2024-04-25T01:39:24.373311+0000","last_unstale":"2024-04-25T01:39:34.429559+0000","last_undegraded":"2024-04-25T01:39:34.429559+0000","last_fullsized":"2024-04-25T01:39:34.429559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:46.338959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197953+0000","last_change":"2024-04-25T01:39:23.377103+0000","last_active":"2024-04-25T01:39:35.197953+0000","last_peered":"2024-04-25T01:39:35.197953+0000","last_clean":"2024-04-25T01:39:35.197953+0000","last_became_active":"2024-04-25T01:39:23.376826+0000","last_became_peered":"2024-04-25T01:39:23.376826+0000","last_unstale":"2024-04-25T01:39:35.197953+0000","last_undegraded":"2024-04-25T01:39:35.197953+0000","last_fullsized":"2024-04-25T01:39:35.197953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:46.663754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198643+0000","last_change":"2024-04-25T01:39:32.426839+0000","last_active":"2024-04-25T01:39:35.198643+0000","last_peered":"2024-04-25T01:39:35.198643+0000","last_clean":"2024-04-25T01:39:35.198643+0000","last_became_active":"2024-04-25T01:39:32.426545+0000","last_became_peered":"2024-04-25T01:39:32.426545+0000","last_unstale":"2024-04-25T01:39:35.198643+0000","last_undegraded":"2024-04-25T01:39:35.198643+0000","last_fullsized":"2024-04-25T01:39:35.198643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:22.161839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199023+0000","last_change":"2024-04-25T01:39:33.444616+0000","last_active":"2024-04-25T01:39:35.199023+0000","last_peered":"2024-04-25T01:39:35.199023+0000","last_clean":"2024-04-25T01:39:35.199023+0000","last_became_active":"2024-04-25T01:39:33.444350+0000","last_became_peered":"2024-04-25T01:39:33.444350+0000","last_unstale":"2024-04-25T01:39:35.199023+0000","last_undegraded":"2024-04-25T01:39:35.199023+0000","last_fullsized":"2024-04-25T01:39:35.199023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:47:15.686320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198460+0000","last_change":"2024-04-25T01:39:24.386969+0000","last_active":"2024-04-25T01:39:35.198460+0000","last_peered":"2024-04-25T01:39:35.198460+0000","last_clean":"2024-04-25T01:39:35.198460+0000","last_became_active":"2024-04-25T01:39:24.386376+0000","last_became_peered":"2024-04-25T01:39:24.386376+0000","last_unstale":"2024-04-25T01:39:35.198460+0000","last_undegraded":"2024-04-25T01:39:35.198460+0000","last_fullsized":"2024-04-25T01:39:35.198460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:13:31.585462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198150+0000","last_change":"2024-04-25T01:39:23.378993+0000","last_active":"2024-04-25T01:39:35.198150+0000","last_peered":"2024-04-25T01:39:35.198150+0000","last_clean":"2024-04-25T01:39:35.198150+0000","last_became_active":"2024-04-25T01:39:23.376908+0000","last_became_peered":"2024-04-25T01:39:23.376908+0000","last_unstale":"2024-04-25T01:39:35.198150+0000","last_undegraded":"2024-04-25T01:39:35.198150+0000","last_fullsized":"2024-04-25T01:39:35.198150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:13:18.370559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199153+0000","last_change":"2024-04-25T01:39:32.433597+0000","last_active":"2024-04-25T01:39:35.199153+0000","last_peered":"2024-04-25T01:39:35.199153+0000","last_clean":"2024-04-25T01:39:35.199153+0000","last_became_active":"2024-04-25T01:39:32.433307+0000","last_became_peered":"2024-04-25T01:39:32.433307+0000","last_unstale":"2024-04-25T01:39:35.199153+0000","last_undegraded":"2024-04-25T01:39:35.199153+0000","last_fullsized":"2024-04-25T01:39:35.199153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:20.784385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429204+0000","last_change":"2024-04-25T01:39:33.427297+0000","last_active":"2024-04-25T01:39:34.429204+0000","last_peered":"2024-04-25T01:39:34.429204+0000","last_clean":"2024-04-25T01:39:34.429204+0000","last_became_active":"2024-04-25T01:39:33.426132+0000","last_became_peered":"2024-04-25T01:39:33.426132+0000","last_unstale":"2024-04-25T01:39:34.429204+0000","last_undegraded":"2024-04-25T01:39:34.429204+0000","last_fullsized":"2024-04-25T01:39:34.429204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:04.147341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559652+0000","last_change":"2024-04-25T01:39:24.393003+0000","last_active":"2024-04-25T01:39:34.559652+0000","last_peered":"2024-04-25T01:39:34.559652+0000","last_clean":"2024-04-25T01:39:34.559652+0000","last_became_active":"2024-04-25T01:39:24.392209+0000","last_became_peered":"2024-04-25T01:39:24.392209+0000","last_unstale":"2024-04-25T01:39:34.559652+0000","last_undegraded":"2024-04-25T01:39:34.559652+0000","last_fullsized":"2024-04-25T01:39:34.559652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:44:58.432859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434880+0000","last_change":"2024-04-25T01:39:23.379804+0000","last_active":"2024-04-25T01:39:34.434880+0000","last_peered":"2024-04-25T01:39:34.434880+0000","last_clean":"2024-04-25T01:39:34.434880+0000","last_became_active":"2024-04-25T01:39:23.379430+0000","last_became_peered":"2024-04-25T01:39:23.379430+0000","last_unstale":"2024-04-25T01:39:34.434880+0000","last_undegraded":"2024-04-25T01:39:34.434880+0000","last_fullsized":"2024-04-25T01:39:34.434880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:42:23.254767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198196+0000","last_change":"2024-04-25T01:39:32.432763+0000","last_active":"2024-04-25T01:39:35.198196+0000","last_peered":"2024-04-25T01:39:35.198196+0000","last_clean":"2024-04-25T01:39:35.198196+0000","last_became_active":"2024-04-25T01:39:32.432482+0000","last_became_peered":"2024-04-25T01:39:32.432482+0000","last_unstale":"2024-04-25T01:39:35.198196+0000","last_undegraded":"2024-04-25T01:39:35.198196+0000","last_fullsized":"2024-04-25T01:39:35.198196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:04.848726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197990+0000","last_change":"2024-04-25T01:39:33.445800+0000","last_active":"2024-04-25T01:39:35.197990+0000","last_peered":"2024-04-25T01:39:35.197990+0000","last_clean":"2024-04-25T01:39:35.197990+0000","last_became_active":"2024-04-25T01:39:33.445500+0000","last_became_peered":"2024-04-25T01:39:33.445500+0000","last_unstale":"2024-04-25T01:39:35.197990+0000","last_undegraded":"2024-04-25T01:39:35.197990+0000","last_fullsized":"2024-04-25T01:39:35.197990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:06:36.800043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430196+0000","last_change":"2024-04-25T01:39:24.375811+0000","last_active":"2024-04-25T01:39:34.430196+0000","last_peered":"2024-04-25T01:39:34.430196+0000","last_clean":"2024-04-25T01:39:34.430196+0000","last_became_active":"2024-04-25T01:39:24.375603+0000","last_became_peered":"2024-04-25T01:39:24.375603+0000","last_unstale":"2024-04-25T01:39:34.430196+0000","last_undegraded":"2024-04-25T01:39:34.430196+0000","last_fullsized":"2024-04-25T01:39:34.430196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:10:26.247501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198161+0000","last_change":"2024-04-25T01:39:23.377687+0000","last_active":"2024-04-25T01:39:35.198161+0000","last_peered":"2024-04-25T01:39:35.198161+0000","last_clean":"2024-04-25T01:39:35.198161+0000","last_became_active":"2024-04-25T01:39:23.377372+0000","last_became_peered":"2024-04-25T01:39:23.377372+0000","last_unstale":"2024-04-25T01:39:35.198161+0000","last_undegraded":"2024-04-25T01:39:35.198161+0000","last_fullsized":"2024-04-25T01:39:35.198161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:51.983659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429145+0000","last_change":"2024-04-25T01:39:32.430816+0000","last_active":"2024-04-25T01:39:34.429145+0000","last_peered":"2024-04-25T01:39:34.429145+0000","last_clean":"2024-04-25T01:39:34.429145+0000","last_became_active":"2024-04-25T01:39:32.430537+0000","last_became_peered":"2024-04-25T01:39:32.430537+0000","last_unstale":"2024-04-25T01:39:34.429145+0000","last_undegraded":"2024-04-25T01:39:34.429145+0000","last_fullsized":"2024-04-25T01:39:34.429145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:58.939453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434436+0000","last_change":"2024-04-25T01:39:33.440287+0000","last_active":"2024-04-25T01:39:34.434436+0000","last_peered":"2024-04-25T01:39:34.434436+0000","last_clean":"2024-04-25T01:39:34.434436+0000","last_became_active":"2024-04-25T01:39:33.439796+0000","last_became_peered":"2024-04-25T01:39:33.439796+0000","last_unstale":"2024-04-25T01:39:34.434436+0000","last_undegraded":"2024-04-25T01:39:34.434436+0000","last_fullsized":"2024-04-25T01:39:34.434436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:08.515401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198342+0000","last_change":"2024-04-25T01:39:24.376933+0000","last_active":"2024-04-25T01:39:35.198342+0000","last_peered":"2024-04-25T01:39:35.198342+0000","last_clean":"2024-04-25T01:39:35.198342+0000","last_became_active":"2024-04-25T01:39:24.376612+0000","last_became_peered":"2024-04-25T01:39:24.376612+0000","last_unstale":"2024-04-25T01:39:35.198342+0000","last_undegraded":"2024-04-25T01:39:35.198342+0000","last_fullsized":"2024-04-25T01:39:35.198342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:56:55.534200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199969+0000","last_change":"2024-04-25T01:39:23.378190+0000","last_active":"2024-04-25T01:39:35.199969+0000","last_peered":"2024-04-25T01:39:35.199969+0000","last_clean":"2024-04-25T01:39:35.199969+0000","last_became_active":"2024-04-25T01:39:23.377677+0000","last_became_peered":"2024-04-25T01:39:23.377677+0000","last_unstale":"2024-04-25T01:39:35.199969+0000","last_undegraded":"2024-04-25T01:39:35.199969+0000","last_fullsized":"2024-04-25T01:39:35.199969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:09.516058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559452+0000","last_change":"2024-04-25T01:39:32.431542+0000","last_active":"2024-04-25T01:39:34.559452+0000","last_peered":"2024-04-25T01:39:34.559452+0000","last_clean":"2024-04-25T01:39:34.559452+0000","last_became_active":"2024-04-25T01:39:32.431253+0000","last_became_peered":"2024-04-25T01:39:32.431253+0000","last_unstale":"2024-04-25T01:39:34.559452+0000","last_undegraded":"2024-04-25T01:39:34.559452+0000","last_fullsized":"2024-04-25T01:39:34.559452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:36.723239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559765+0000","last_change":"2024-04-25T01:39:33.448529+0000","last_active":"2024-04-25T01:39:34.559765+0000","last_peered":"2024-04-25T01:39:34.559765+0000","last_clean":"2024-04-25T01:39:34.559765+0000","last_became_active":"2024-04-25T01:39:33.448266+0000","last_became_peered":"2024-04-25T01:39:33.448266+0000","last_unstale":"2024-04-25T01:39:34.559765+0000","last_undegraded":"2024-04-25T01:39:34.559765+0000","last_fullsized":"2024-04-25T01:39:34.559765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:18.788470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200112+0000","last_change":"2024-04-25T01:39:24.390844+0000","last_active":"2024-04-25T01:39:35.200112+0000","last_peered":"2024-04-25T01:39:35.200112+0000","last_clean":"2024-04-25T01:39:35.200112+0000","last_became_active":"2024-04-25T01:39:24.390543+0000","last_became_peered":"2024-04-25T01:39:24.390543+0000","last_unstale":"2024-04-25T01:39:35.200112+0000","last_undegraded":"2024-04-25T01:39:35.200112+0000","last_fullsized":"2024-04-25T01:39:35.200112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:01:03.804058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198467+0000","last_change":"2024-04-25T01:39:23.368562+0000","last_active":"2024-04-25T01:39:35.198467+0000","last_peered":"2024-04-25T01:39:35.198467+0000","last_clean":"2024-04-25T01:39:35.198467+0000","last_became_active":"2024-04-25T01:39:23.368272+0000","last_became_peered":"2024-04-25T01:39:23.368272+0000","last_unstale":"2024-04-25T01:39:35.198467+0000","last_undegraded":"2024-04-25T01:39:35.198467+0000","last_fullsized":"2024-04-25T01:39:35.198467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:15.464993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198483+0000","last_change":"2024-04-25T01:39:32.430196+0000","last_active":"2024-04-25T01:39:35.198483+0000","last_peered":"2024-04-25T01:39:35.198483+0000","last_clean":"2024-04-25T01:39:35.198483+0000","last_became_active":"2024-04-25T01:39:32.429759+0000","last_became_peered":"2024-04-25T01:39:32.429759+0000","last_unstale":"2024-04-25T01:39:35.198483+0000","last_undegraded":"2024-04-25T01:39:35.198483+0000","last_fullsized":"2024-04-25T01:39:35.198483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:58:09.299194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559415+0000","last_change":"2024-04-25T01:39:33.440935+0000","last_active":"2024-04-25T01:39:34.559415+0000","last_peered":"2024-04-25T01:39:34.559415+0000","last_clean":"2024-04-25T01:39:34.559415+0000","last_became_active":"2024-04-25T01:39:33.439344+0000","last_became_peered":"2024-04-25T01:39:33.439344+0000","last_unstale":"2024-04-25T01:39:34.559415+0000","last_undegraded":"2024-04-25T01:39:34.559415+0000","last_fullsized":"2024-04-25T01:39:34.559415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:23.928991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199059+0000","last_change":"2024-04-25T01:39:24.389203+0000","last_active":"2024-04-25T01:39:35.199059+0000","last_peered":"2024-04-25T01:39:35.199059+0000","last_clean":"2024-04-25T01:39:35.199059+0000","last_became_active":"2024-04-25T01:39:24.388306+0000","last_became_peered":"2024-04-25T01:39:24.388306+0000","last_unstale":"2024-04-25T01:39:35.199059+0000","last_undegraded":"2024-04-25T01:39:35.199059+0000","last_fullsized":"2024-04-25T01:39:35.199059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:59:33.951161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198256+0000","last_change":"2024-04-25T01:39:23.375729+0000","last_active":"2024-04-25T01:39:35.198256+0000","last_peered":"2024-04-25T01:39:35.198256+0000","last_clean":"2024-04-25T01:39:35.198256+0000","last_became_active":"2024-04-25T01:39:23.375488+0000","last_became_peered":"2024-04-25T01:39:23.375488+0000","last_unstale":"2024-04-25T01:39:35.198256+0000","last_undegraded":"2024-04-25T01:39:35.198256+0000","last_fullsized":"2024-04-25T01:39:35.198256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:00.039083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198302+0000","last_change":"2024-04-25T01:39:32.427586+0000","last_active":"2024-04-25T01:39:35.198302+0000","last_peered":"2024-04-25T01:39:35.198302+0000","last_clean":"2024-04-25T01:39:35.198302+0000","last_became_active":"2024-04-25T01:39:32.427282+0000","last_became_peered":"2024-04-25T01:39:32.427282+0000","last_unstale":"2024-04-25T01:39:35.198302+0000","last_undegraded":"2024-04-25T01:39:35.198302+0000","last_fullsized":"2024-04-25T01:39:35.198302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:35.956279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197828+0000","last_change":"2024-04-25T01:39:33.438949+0000","last_active":"2024-04-25T01:39:35.197828+0000","last_peered":"2024-04-25T01:39:35.197828+0000","last_clean":"2024-04-25T01:39:35.197828+0000","last_became_active":"2024-04-25T01:39:33.438669+0000","last_became_peered":"2024-04-25T01:39:33.438669+0000","last_unstale":"2024-04-25T01:39:35.197828+0000","last_undegraded":"2024-04-25T01:39:35.197828+0000","last_fullsized":"2024-04-25T01:39:35.197828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:07.849060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197529+0000","last_change":"2024-04-25T01:39:24.377438+0000","last_active":"2024-04-25T01:39:35.197529+0000","last_peered":"2024-04-25T01:39:35.197529+0000","last_clean":"2024-04-25T01:39:35.197529+0000","last_became_active":"2024-04-25T01:39:24.377146+0000","last_became_peered":"2024-04-25T01:39:24.377146+0000","last_unstale":"2024-04-25T01:39:35.197529+0000","last_undegraded":"2024-04-25T01:39:35.197529+0000","last_fullsized":"2024-04-25T01:39:35.197529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:54:17.698561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198084+0000","last_change":"2024-04-25T01:39:23.371019+0000","last_active":"2024-04-25T01:39:35.198084+0000","last_peered":"2024-04-25T01:39:35.198084+0000","last_clean":"2024-04-25T01:39:35.198084+0000","last_became_active":"2024-04-25T01:39:23.370727+0000","last_became_peered":"2024-04-25T01:39:23.370727+0000","last_unstale":"2024-04-25T01:39:35.198084+0000","last_undegraded":"2024-04-25T01:39:35.198084+0000","last_fullsized":"2024-04-25T01:39:35.198084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:10.714475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198753+0000","last_change":"2024-04-25T01:39:32.431610+0000","last_active":"2024-04-25T01:39:35.198753+0000","last_peered":"2024-04-25T01:39:35.198753+0000","last_clean":"2024-04-25T01:39:35.198753+0000","last_became_active":"2024-04-25T01:39:32.431335+0000","last_became_peered":"2024-04-25T01:39:32.431335+0000","last_unstale":"2024-04-25T01:39:35.198753+0000","last_undegraded":"2024-04-25T01:39:35.198753+0000","last_fullsized":"2024-04-25T01:39:35.198753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:54.882078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199183+0000","last_change":"2024-04-25T01:39:33.438896+0000","last_active":"2024-04-25T01:39:35.199183+0000","last_peered":"2024-04-25T01:39:35.199183+0000","last_clean":"2024-04-25T01:39:35.199183+0000","last_became_active":"2024-04-25T01:39:33.438622+0000","last_became_peered":"2024-04-25T01:39:33.438622+0000","last_unstale":"2024-04-25T01:39:35.199183+0000","last_undegraded":"2024-04-25T01:39:35.199183+0000","last_fullsized":"2024-04-25T01:39:35.199183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:40:47.408809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559149+0000","last_change":"2024-04-25T01:39:24.391366+0000","last_active":"2024-04-25T01:39:34.559149+0000","last_peered":"2024-04-25T01:39:34.559149+0000","last_clean":"2024-04-25T01:39:34.559149+0000","last_became_active":"2024-04-25T01:39:24.391093+0000","last_became_peered":"2024-04-25T01:39:24.391093+0000","last_unstale":"2024-04-25T01:39:34.559149+0000","last_undegraded":"2024-04-25T01:39:34.559149+0000","last_fullsized":"2024-04-25T01:39:34.559149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:10.906935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198243+0000","last_change":"2024-04-25T01:39:23.379767+0000","last_active":"2024-04-25T01:39:35.198243+0000","last_peered":"2024-04-25T01:39:35.198243+0000","last_clean":"2024-04-25T01:39:35.198243+0000","last_became_active":"2024-04-25T01:39:23.379294+0000","last_became_peered":"2024-04-25T01:39:23.379294+0000","last_unstale":"2024-04-25T01:39:35.198243+0000","last_undegraded":"2024-04-25T01:39:35.198243+0000","last_fullsized":"2024-04-25T01:39:35.198243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:36:37.823796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559671+0000","last_change":"2024-04-25T01:39:32.429452+0000","last_active":"2024-04-25T01:39:34.559671+0000","last_peered":"2024-04-25T01:39:34.559671+0000","last_clean":"2024-04-25T01:39:34.559671+0000","last_became_active":"2024-04-25T01:39:32.429189+0000","last_became_peered":"2024-04-25T01:39:32.429189+0000","last_unstale":"2024-04-25T01:39:34.559671+0000","last_undegraded":"2024-04-25T01:39:34.559671+0000","last_fullsized":"2024-04-25T01:39:34.559671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:58:02.723851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198704+0000","last_change":"2024-04-25T01:39:33.438945+0000","last_active":"2024-04-25T01:39:35.198704+0000","last_peered":"2024-04-25T01:39:35.198704+0000","last_clean":"2024-04-25T01:39:35.198704+0000","last_became_active":"2024-04-25T01:39:33.438233+0000","last_became_peered":"2024-04-25T01:39:33.438233+0000","last_unstale":"2024-04-25T01:39:35.198704+0000","last_undegraded":"2024-04-25T01:39:35.198704+0000","last_fullsized":"2024-04-25T01:39:35.198704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:50.545311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429728+0000","last_change":"2024-04-25T01:39:24.401208+0000","last_active":"2024-04-25T01:39:34.429728+0000","last_peered":"2024-04-25T01:39:34.429728+0000","last_clean":"2024-04-25T01:39:34.429728+0000","last_became_active":"2024-04-25T01:39:24.400502+0000","last_became_peered":"2024-04-25T01:39:24.400502+0000","last_unstale":"2024-04-25T01:39:34.429728+0000","last_undegraded":"2024-04-25T01:39:34.429728+0000","last_fullsized":"2024-04-25T01:39:34.429728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:55:09.076617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198391+0000","last_change":"2024-04-25T01:39:23.367826+0000","last_active":"2024-04-25T01:39:35.198391+0000","last_peered":"2024-04-25T01:39:35.198391+0000","last_clean":"2024-04-25T01:39:35.198391+0000","last_became_active":"2024-04-25T01:39:23.367520+0000","last_became_peered":"2024-04-25T01:39:23.367520+0000","last_unstale":"2024-04-25T01:39:35.198391+0000","last_undegraded":"2024-04-25T01:39:35.198391+0000","last_fullsized":"2024-04-25T01:39:35.198391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:05.997166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199929+0000","last_change":"2024-04-25T01:39:12.918495+0000","last_active":"2024-04-25T01:39:35.199929+0000","last_peered":"2024-04-25T01:39:35.199929+0000","last_clean":"2024-04-25T01:39:35.199929+0000","last_became_active":"2024-04-25T01:39:12.917330+0000","last_became_peered":"2024-04-25T01:39:12.917330+0000","last_unstale":"2024-04-25T01:39:35.199929+0000","last_undegraded":"2024-04-25T01:39:35.199929+0000","last_fullsized":"2024-04-25T01:39:35.199929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:11.731178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:11.731178+0000","last_clean_scrub_stamp":"2024-04-25T01:39:11.731178+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:26:14.153244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434088+0000","last_change":"2024-04-25T01:39:32.431797+0000","last_active":"2024-04-25T01:39:34.434088+0000","last_peered":"2024-04-25T01:39:34.434088+0000","last_clean":"2024-04-25T01:39:34.434088+0000","last_became_active":"2024-04-25T01:39:32.431523+0000","last_became_peered":"2024-04-25T01:39:32.431523+0000","last_unstale":"2024-04-25T01:39:34.434088+0000","last_undegraded":"2024-04-25T01:39:34.434088+0000","last_fullsized":"2024-04-25T01:39:34.434088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:45.752128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198056+0000","last_change":"2024-04-25T01:39:33.440488+0000","last_active":"2024-04-25T01:39:35.198056+0000","last_peered":"2024-04-25T01:39:35.198056+0000","last_clean":"2024-04-25T01:39:35.198056+0000","last_became_active":"2024-04-25T01:39:33.440161+0000","last_became_peered":"2024-04-25T01:39:33.440161+0000","last_unstale":"2024-04-25T01:39:35.198056+0000","last_undegraded":"2024-04-25T01:39:35.198056+0000","last_fullsized":"2024-04-25T01:39:35.198056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:45.542876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199802+0000","last_change":"2024-04-25T01:39:24.394350+0000","last_active":"2024-04-25T01:39:35.199802+0000","last_peered":"2024-04-25T01:39:35.199802+0000","last_clean":"2024-04-25T01:39:35.199802+0000","last_became_active":"2024-04-25T01:39:24.393235+0000","last_became_peered":"2024-04-25T01:39:24.393235+0000","last_unstale":"2024-04-25T01:39:35.199802+0000","last_undegraded":"2024-04-25T01:39:35.199802+0000","last_fullsized":"2024-04-25T01:39:35.199802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:00:48.588700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198113+0000","last_change":"2024-04-25T01:39:23.368352+0000","last_active":"2024-04-25T01:39:35.198113+0000","last_peered":"2024-04-25T01:39:35.198113+0000","last_clean":"2024-04-25T01:39:35.198113+0000","last_became_active":"2024-04-25T01:39:23.368075+0000","last_became_peered":"2024-04-25T01:39:23.368075+0000","last_unstale":"2024-04-25T01:39:35.198113+0000","last_undegraded":"2024-04-25T01:39:35.198113+0000","last_fullsized":"2024-04-25T01:39:35.198113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:11.300091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434486+0000","last_change":"2024-04-25T01:39:32.430007+0000","last_active":"2024-04-25T01:39:34.434486+0000","last_peered":"2024-04-25T01:39:34.434486+0000","last_clean":"2024-04-25T01:39:34.434486+0000","last_became_active":"2024-04-25T01:39:32.429721+0000","last_became_peered":"2024-04-25T01:39:32.429721+0000","last_unstale":"2024-04-25T01:39:34.434486+0000","last_undegraded":"2024-04-25T01:39:34.434486+0000","last_fullsized":"2024-04-25T01:39:34.434486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:47.409375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197603+0000","last_change":"2024-04-25T01:39:33.447230+0000","last_active":"2024-04-25T01:39:35.197603+0000","last_peered":"2024-04-25T01:39:35.197603+0000","last_clean":"2024-04-25T01:39:35.197603+0000","last_became_active":"2024-04-25T01:39:33.446930+0000","last_became_peered":"2024-04-25T01:39:33.446930+0000","last_unstale":"2024-04-25T01:39:35.197603+0000","last_undegraded":"2024-04-25T01:39:35.197603+0000","last_fullsized":"2024-04-25T01:39:35.197603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:51:40.920560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199534+0000","last_change":"2024-04-25T01:39:24.394286+0000","last_active":"2024-04-25T01:39:35.199534+0000","last_peered":"2024-04-25T01:39:35.199534+0000","last_clean":"2024-04-25T01:39:35.199534+0000","last_became_active":"2024-04-25T01:39:24.393558+0000","last_became_peered":"2024-04-25T01:39:24.393558+0000","last_unstale":"2024-04-25T01:39:35.199534+0000","last_undegraded":"2024-04-25T01:39:35.199534+0000","last_fullsized":"2024-04-25T01:39:35.199534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:59.100947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198699+0000","last_change":"2024-04-25T01:39:23.370690+0000","last_active":"2024-04-25T01:39:35.198699+0000","last_peered":"2024-04-25T01:39:35.198699+0000","last_clean":"2024-04-25T01:39:35.198699+0000","last_became_active":"2024-04-25T01:39:23.370391+0000","last_became_peered":"2024-04-25T01:39:23.370391+0000","last_unstale":"2024-04-25T01:39:35.198699+0000","last_undegraded":"2024-04-25T01:39:35.198699+0000","last_fullsized":"2024-04-25T01:39:35.198699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:29.647636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559440+0000","last_change":"2024-04-25T01:39:32.429412+0000","last_active":"2024-04-25T01:39:34.559440+0000","last_peered":"2024-04-25T01:39:34.559440+0000","last_clean":"2024-04-25T01:39:34.559440+0000","last_became_active":"2024-04-25T01:39:32.429143+0000","last_became_peered":"2024-04-25T01:39:32.429143+0000","last_unstale":"2024-04-25T01:39:34.559440+0000","last_undegraded":"2024-04-25T01:39:34.559440+0000","last_fullsized":"2024-04-25T01:39:34.559440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:53.637245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198532+0000","last_change":"2024-04-25T01:39:33.437128+0000","last_active":"2024-04-25T01:39:35.198532+0000","last_peered":"2024-04-25T01:39:35.198532+0000","last_clean":"2024-04-25T01:39:35.198532+0000","last_became_active":"2024-04-25T01:39:33.436861+0000","last_became_peered":"2024-04-25T01:39:33.436861+0000","last_unstale":"2024-04-25T01:39:35.198532+0000","last_undegraded":"2024-04-25T01:39:35.198532+0000","last_fullsized":"2024-04-25T01:39:35.198532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:41.746373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200378+0000","last_change":"2024-04-25T01:39:24.392170+0000","last_active":"2024-04-25T01:39:35.200378+0000","last_peered":"2024-04-25T01:39:35.200378+0000","last_clean":"2024-04-25T01:39:35.200378+0000","last_became_active":"2024-04-25T01:39:24.391811+0000","last_became_peered":"2024-04-25T01:39:24.391811+0000","last_unstale":"2024-04-25T01:39:35.200378+0000","last_undegraded":"2024-04-25T01:39:35.200378+0000","last_fullsized":"2024-04-25T01:39:35.200378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:32.859676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197996+0000","last_change":"2024-04-25T01:39:23.369872+0000","last_active":"2024-04-25T01:39:35.197996+0000","last_peered":"2024-04-25T01:39:35.197996+0000","last_clean":"2024-04-25T01:39:35.197996+0000","last_became_active":"2024-04-25T01:39:23.369314+0000","last_became_peered":"2024-04-25T01:39:23.369314+0000","last_unstale":"2024-04-25T01:39:35.197996+0000","last_undegraded":"2024-04-25T01:39:35.197996+0000","last_fullsized":"2024-04-25T01:39:35.197996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:14.571148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197245+0000","last_change":"2024-04-25T01:39:32.429664+0000","last_active":"2024-04-25T01:39:35.197245+0000","last_peered":"2024-04-25T01:39:35.197245+0000","last_clean":"2024-04-25T01:39:35.197245+0000","last_became_active":"2024-04-25T01:39:32.429358+0000","last_became_peered":"2024-04-25T01:39:32.429358+0000","last_unstale":"2024-04-25T01:39:35.197245+0000","last_undegraded":"2024-04-25T01:39:35.197245+0000","last_fullsized":"2024-04-25T01:39:35.197245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:57:10.913056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197472+0000","last_change":"2024-04-25T01:39:33.440419+0000","last_active":"2024-04-25T01:39:35.197472+0000","last_peered":"2024-04-25T01:39:35.197472+0000","last_clean":"2024-04-25T01:39:35.197472+0000","last_became_active":"2024-04-25T01:39:33.440054+0000","last_became_peered":"2024-04-25T01:39:33.440054+0000","last_unstale":"2024-04-25T01:39:35.197472+0000","last_undegraded":"2024-04-25T01:39:35.197472+0000","last_fullsized":"2024-04-25T01:39:35.197472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:42.321235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199726+0000","last_change":"2024-04-25T01:39:24.391240+0000","last_active":"2024-04-25T01:39:35.199726+0000","last_peered":"2024-04-25T01:39:35.199726+0000","last_clean":"2024-04-25T01:39:35.199726+0000","last_became_active":"2024-04-25T01:39:24.390948+0000","last_became_peered":"2024-04-25T01:39:24.390948+0000","last_unstale":"2024-04-25T01:39:35.199726+0000","last_undegraded":"2024-04-25T01:39:35.199726+0000","last_fullsized":"2024-04-25T01:39:35.199726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:41:30.579190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198161+0000","last_change":"2024-04-25T01:39:23.367322+0000","last_active":"2024-04-25T01:39:35.198161+0000","last_peered":"2024-04-25T01:39:35.198161+0000","last_clean":"2024-04-25T01:39:35.198161+0000","last_became_active":"2024-04-25T01:39:23.367054+0000","last_became_peered":"2024-04-25T01:39:23.367054+0000","last_unstale":"2024-04-25T01:39:35.198161+0000","last_undegraded":"2024-04-25T01:39:35.198161+0000","last_fullsized":"2024-04-25T01:39:35.198161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:10.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197919+0000","last_change":"2024-04-25T01:39:32.426874+0000","last_active":"2024-04-25T01:39:35.197919+0000","last_peered":"2024-04-25T01:39:35.197919+0000","last_clean":"2024-04-25T01:39:35.197919+0000","last_became_active":"2024-04-25T01:39:32.426599+0000","last_became_peered":"2024-04-25T01:39:32.426599+0000","last_unstale":"2024-04-25T01:39:35.197919+0000","last_undegraded":"2024-04-25T01:39:35.197919+0000","last_fullsized":"2024-04-25T01:39:35.197919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:27.672277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430134+0000","last_change":"2024-04-25T01:39:33.428909+0000","last_active":"2024-04-25T01:39:34.430134+0000","last_peered":"2024-04-25T01:39:34.430134+0000","last_clean":"2024-04-25T01:39:34.430134+0000","last_became_active":"2024-04-25T01:39:33.428626+0000","last_became_peered":"2024-04-25T01:39:33.428626+0000","last_unstale":"2024-04-25T01:39:34.430134+0000","last_undegraded":"2024-04-25T01:39:34.430134+0000","last_fullsized":"2024-04-25T01:39:34.430134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:21.188264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199068+0000","last_change":"2024-04-25T01:39:24.389946+0000","last_active":"2024-04-25T01:39:35.199068+0000","last_peered":"2024-04-25T01:39:35.199068+0000","last_clean":"2024-04-25T01:39:35.199068+0000","last_became_active":"2024-04-25T01:39:24.389656+0000","last_became_peered":"2024-04-25T01:39:24.389656+0000","last_unstale":"2024-04-25T01:39:35.199068+0000","last_undegraded":"2024-04-25T01:39:35.199068+0000","last_fullsized":"2024-04-25T01:39:35.199068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:55.943639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197475+0000","last_change":"2024-04-25T01:39:23.373599+0000","last_active":"2024-04-25T01:39:35.197475+0000","last_peered":"2024-04-25T01:39:35.197475+0000","last_clean":"2024-04-25T01:39:35.197475+0000","last_became_active":"2024-04-25T01:39:23.373281+0000","last_became_peered":"2024-04-25T01:39:23.373281+0000","last_unstale":"2024-04-25T01:39:35.197475+0000","last_undegraded":"2024-04-25T01:39:35.197475+0000","last_fullsized":"2024-04-25T01:39:35.197475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:40.850925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559604+0000","last_change":"2024-04-25T01:39:32.427502+0000","last_active":"2024-04-25T01:39:34.559604+0000","last_peered":"2024-04-25T01:39:34.559604+0000","last_clean":"2024-04-25T01:39:34.559604+0000","last_became_active":"2024-04-25T01:39:32.426499+0000","last_became_peered":"2024-04-25T01:39:32.426499+0000","last_unstale":"2024-04-25T01:39:34.559604+0000","last_undegraded":"2024-04-25T01:39:34.559604+0000","last_fullsized":"2024-04-25T01:39:34.559604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:26.977416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198695+0000","last_change":"2024-04-25T01:39:33.436901+0000","last_active":"2024-04-25T01:39:35.198695+0000","last_peered":"2024-04-25T01:39:35.198695+0000","last_clean":"2024-04-25T01:39:35.198695+0000","last_became_active":"2024-04-25T01:39:33.436001+0000","last_became_peered":"2024-04-25T01:39:33.436001+0000","last_unstale":"2024-04-25T01:39:35.198695+0000","last_undegraded":"2024-04-25T01:39:35.198695+0000","last_fullsized":"2024-04-25T01:39:35.198695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:34:41.678663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.433897+0000","last_change":"2024-04-25T01:39:24.394248+0000","last_active":"2024-04-25T01:39:34.433897+0000","last_peered":"2024-04-25T01:39:34.433897+0000","last_clean":"2024-04-25T01:39:34.433897+0000","last_became_active":"2024-04-25T01:39:24.393958+0000","last_became_peered":"2024-04-25T01:39:24.393958+0000","last_unstale":"2024-04-25T01:39:34.433897+0000","last_undegraded":"2024-04-25T01:39:34.433897+0000","last_fullsized":"2024-04-25T01:39:34.433897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:35.087577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434426+0000","last_change":"2024-04-25T01:39:23.372939+0000","last_active":"2024-04-25T01:39:34.434426+0000","last_peered":"2024-04-25T01:39:34.434426+0000","last_clean":"2024-04-25T01:39:34.434426+0000","last_became_active":"2024-04-25T01:39:23.372648+0000","last_became_peered":"2024-04-25T01:39:23.372648+0000","last_unstale":"2024-04-25T01:39:34.434426+0000","last_undegraded":"2024-04-25T01:39:34.434426+0000","last_fullsized":"2024-04-25T01:39:34.434426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:02:13.283096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430096+0000","last_change":"2024-04-25T01:39:32.432218+0000","last_active":"2024-04-25T01:39:34.430096+0000","last_peered":"2024-04-25T01:39:34.430096+0000","last_clean":"2024-04-25T01:39:34.430096+0000","last_became_active":"2024-04-25T01:39:32.431938+0000","last_became_peered":"2024-04-25T01:39:32.431938+0000","last_unstale":"2024-04-25T01:39:34.430096+0000","last_undegraded":"2024-04-25T01:39:34.430096+0000","last_fullsized":"2024-04-25T01:39:34.430096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:56:15.053817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199747+0000","last_change":"2024-04-25T01:39:33.441342+0000","last_active":"2024-04-25T01:39:35.199747+0000","last_peered":"2024-04-25T01:39:35.199747+0000","last_clean":"2024-04-25T01:39:35.199747+0000","last_became_active":"2024-04-25T01:39:33.441074+0000","last_became_peered":"2024-04-25T01:39:33.441074+0000","last_unstale":"2024-04-25T01:39:35.199747+0000","last_undegraded":"2024-04-25T01:39:35.199747+0000","last_fullsized":"2024-04-25T01:39:35.199747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:22:43.000112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199029+0000","last_change":"2024-04-25T01:39:24.390114+0000","last_active":"2024-04-25T01:39:35.199029+0000","last_peered":"2024-04-25T01:39:35.199029+0000","last_clean":"2024-04-25T01:39:35.199029+0000","last_became_active":"2024-04-25T01:39:24.389841+0000","last_became_peered":"2024-04-25T01:39:24.389841+0000","last_unstale":"2024-04-25T01:39:35.199029+0000","last_undegraded":"2024-04-25T01:39:35.199029+0000","last_fullsized":"2024-04-25T01:39:35.199029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:34.950624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198167+0000","last_change":"2024-04-25T01:39:23.369440+0000","last_active":"2024-04-25T01:39:35.198167+0000","last_peered":"2024-04-25T01:39:35.198167+0000","last_clean":"2024-04-25T01:39:35.198167+0000","last_became_active":"2024-04-25T01:39:23.369151+0000","last_became_peered":"2024-04-25T01:39:23.369151+0000","last_unstale":"2024-04-25T01:39:35.198167+0000","last_undegraded":"2024-04-25T01:39:35.198167+0000","last_fullsized":"2024-04-25T01:39:35.198167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:31:46.921287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"23'6","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429666+0000","last_change":"2024-04-25T01:39:32.430701+0000","last_active":"2024-04-25T01:39:34.429666+0000","last_peered":"2024-04-25T01:39:34.429666+0000","last_clean":"2024-04-25T01:39:34.429666+0000","last_became_active":"2024-04-25T01:39:32.430187+0000","last_became_peered":"2024-04-25T01:39:32.430187+0000","last_unstale":"2024-04-25T01:39:34.429666+0000","last_undegraded":"2024-04-25T01:39:34.429666+0000","last_fullsized":"2024-04-25T01:39:34.429666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:57.148375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429767+0000","last_change":"2024-04-25T01:39:33.427429+0000","last_active":"2024-04-25T01:39:34.429767+0000","last_peered":"2024-04-25T01:39:34.429767+0000","last_clean":"2024-04-25T01:39:34.429767+0000","last_became_active":"2024-04-25T01:39:33.427164+0000","last_became_peered":"2024-04-25T01:39:33.427164+0000","last_unstale":"2024-04-25T01:39:34.429767+0000","last_undegraded":"2024-04-25T01:39:34.429767+0000","last_fullsized":"2024-04-25T01:39:34.429767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:33:59.664252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559246+0000","last_change":"2024-04-25T01:39:24.388852+0000","last_active":"2024-04-25T01:39:34.559246+0000","last_peered":"2024-04-25T01:39:34.559246+0000","last_clean":"2024-04-25T01:39:34.559246+0000","last_became_active":"2024-04-25T01:39:24.388594+0000","last_became_peered":"2024-04-25T01:39:24.388594+0000","last_unstale":"2024-04-25T01:39:34.559246+0000","last_undegraded":"2024-04-25T01:39:34.559246+0000","last_fullsized":"2024-04-25T01:39:34.559246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:46:49.718182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559847+0000","last_change":"2024-04-25T01:39:23.372903+0000","last_active":"2024-04-25T01:39:34.559847+0000","last_peered":"2024-04-25T01:39:34.559847+0000","last_clean":"2024-04-25T01:39:34.559847+0000","last_became_active":"2024-04-25T01:39:23.372617+0000","last_became_peered":"2024-04-25T01:39:23.372617+0000","last_unstale":"2024-04-25T01:39:34.559847+0000","last_undegraded":"2024-04-25T01:39:34.559847+0000","last_fullsized":"2024-04-25T01:39:34.559847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:54:58.506432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199994+0000","last_change":"2024-04-25T01:39:32.430218+0000","last_active":"2024-04-25T01:39:35.199994+0000","last_peered":"2024-04-25T01:39:35.199994+0000","last_clean":"2024-04-25T01:39:35.199994+0000","last_became_active":"2024-04-25T01:39:32.429900+0000","last_became_peered":"2024-04-25T01:39:32.429900+0000","last_unstale":"2024-04-25T01:39:35.199994+0000","last_undegraded":"2024-04-25T01:39:35.199994+0000","last_fullsized":"2024-04-25T01:39:35.199994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:52.253045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429707+0000","last_change":"2024-04-25T01:39:33.440325+0000","last_active":"2024-04-25T01:39:34.429707+0000","last_peered":"2024-04-25T01:39:34.429707+0000","last_clean":"2024-04-25T01:39:34.429707+0000","last_became_active":"2024-04-25T01:39:33.439961+0000","last_became_peered":"2024-04-25T01:39:33.439961+0000","last_unstale":"2024-04-25T01:39:34.429707+0000","last_undegraded":"2024-04-25T01:39:34.429707+0000","last_fullsized":"2024-04-25T01:39:34.429707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:01.846576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199750+0000","last_change":"2024-04-25T01:39:24.380617+0000","last_active":"2024-04-25T01:39:35.199750+0000","last_peered":"2024-04-25T01:39:35.199750+0000","last_clean":"2024-04-25T01:39:35.199750+0000","last_became_active":"2024-04-25T01:39:24.380330+0000","last_became_peered":"2024-04-25T01:39:24.380330+0000","last_unstale":"2024-04-25T01:39:35.199750+0000","last_undegraded":"2024-04-25T01:39:35.199750+0000","last_fullsized":"2024-04-25T01:39:35.199750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:24.010569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434231+0000","last_change":"2024-04-25T01:39:23.373295+0000","last_active":"2024-04-25T01:39:34.434231+0000","last_peered":"2024-04-25T01:39:34.434231+0000","last_clean":"2024-04-25T01:39:34.434231+0000","last_became_active":"2024-04-25T01:39:23.372984+0000","last_became_peered":"2024-04-25T01:39:23.372984+0000","last_unstale":"2024-04-25T01:39:34.434231+0000","last_undegraded":"2024-04-25T01:39:34.434231+0000","last_fullsized":"2024-04-25T01:39:34.434231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:10.854190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198248+0000","last_change":"2024-04-25T01:39:32.433589+0000","last_active":"2024-04-25T01:39:35.198248+0000","last_peered":"2024-04-25T01:39:35.198248+0000","last_clean":"2024-04-25T01:39:35.198248+0000","last_became_active":"2024-04-25T01:39:32.433408+0000","last_became_peered":"2024-04-25T01:39:32.433408+0000","last_unstale":"2024-04-25T01:39:35.198248+0000","last_undegraded":"2024-04-25T01:39:35.198248+0000","last_fullsized":"2024-04-25T01:39:35.198248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:25.789951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198708+0000","last_change":"2024-04-25T01:39:33.433449+0000","last_active":"2024-04-25T01:39:35.198708+0000","last_peered":"2024-04-25T01:39:35.198708+0000","last_clean":"2024-04-25T01:39:35.198708+0000","last_became_active":"2024-04-25T01:39:33.432690+0000","last_became_peered":"2024-04-25T01:39:33.432690+0000","last_unstale":"2024-04-25T01:39:35.198708+0000","last_undegraded":"2024-04-25T01:39:35.198708+0000","last_fullsized":"2024-04-25T01:39:35.198708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:30.046453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198838+0000","last_change":"2024-04-25T01:39:24.391245+0000","last_active":"2024-04-25T01:39:35.198838+0000","last_peered":"2024-04-25T01:39:35.198838+0000","last_clean":"2024-04-25T01:39:35.198838+0000","last_became_active":"2024-04-25T01:39:24.390941+0000","last_became_peered":"2024-04-25T01:39:24.390941+0000","last_unstale":"2024-04-25T01:39:35.198838+0000","last_undegraded":"2024-04-25T01:39:35.198838+0000","last_fullsized":"2024-04-25T01:39:35.198838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:55.182405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198689+0000","last_change":"2024-04-25T01:39:23.369043+0000","last_active":"2024-04-25T01:39:35.198689+0000","last_peered":"2024-04-25T01:39:35.198689+0000","last_clean":"2024-04-25T01:39:35.198689+0000","last_became_active":"2024-04-25T01:39:23.368778+0000","last_became_peered":"2024-04-25T01:39:23.368778+0000","last_unstale":"2024-04-25T01:39:35.198689+0000","last_undegraded":"2024-04-25T01:39:35.198689+0000","last_fullsized":"2024-04-25T01:39:35.198689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:59.501724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198230+0000","last_change":"2024-04-25T01:39:32.431530+0000","last_active":"2024-04-25T01:39:35.198230+0000","last_peered":"2024-04-25T01:39:35.198230+0000","last_clean":"2024-04-25T01:39:35.198230+0000","last_became_active":"2024-04-25T01:39:32.431247+0000","last_became_peered":"2024-04-25T01:39:32.431247+0000","last_unstale":"2024-04-25T01:39:35.198230+0000","last_undegraded":"2024-04-25T01:39:35.198230+0000","last_fullsized":"2024-04-25T01:39:35.198230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:46:02.014508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434136+0000","last_change":"2024-04-25T01:39:33.446545+0000","last_active":"2024-04-25T01:39:34.434136+0000","last_peered":"2024-04-25T01:39:34.434136+0000","last_clean":"2024-04-25T01:39:34.434136+0000","last_became_active":"2024-04-25T01:39:33.446263+0000","last_became_peered":"2024-04-25T01:39:33.446263+0000","last_unstale":"2024-04-25T01:39:34.434136+0000","last_undegraded":"2024-04-25T01:39:34.434136+0000","last_fullsized":"2024-04-25T01:39:34.434136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:27.026460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559482+0000","last_change":"2024-04-25T01:39:24.403875+0000","last_active":"2024-04-25T01:39:34.559482+0000","last_peered":"2024-04-25T01:39:34.559482+0000","last_clean":"2024-04-25T01:39:34.559482+0000","last_became_active":"2024-04-25T01:39:24.403591+0000","last_became_peered":"2024-04-25T01:39:24.403591+0000","last_unstale":"2024-04-25T01:39:34.559482+0000","last_undegraded":"2024-04-25T01:39:34.559482+0000","last_fullsized":"2024-04-25T01:39:34.559482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:45.276173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198758+0000","last_change":"2024-04-25T01:39:23.378968+0000","last_active":"2024-04-25T01:39:35.198758+0000","last_peered":"2024-04-25T01:39:35.198758+0000","last_clean":"2024-04-25T01:39:35.198758+0000","last_became_active":"2024-04-25T01:39:23.378635+0000","last_became_peered":"2024-04-25T01:39:23.378635+0000","last_unstale":"2024-04-25T01:39:35.198758+0000","last_undegraded":"2024-04-25T01:39:35.198758+0000","last_fullsized":"2024-04-25T01:39:35.198758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:39.780544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429477+0000","last_change":"2024-04-25T01:39:32.427357+0000","last_active":"2024-04-25T01:39:34.429477+0000","last_peered":"2024-04-25T01:39:34.429477+0000","last_clean":"2024-04-25T01:39:34.429477+0000","last_became_active":"2024-04-25T01:39:32.427105+0000","last_became_peered":"2024-04-25T01:39:32.427105+0000","last_unstale":"2024-04-25T01:39:34.429477+0000","last_undegraded":"2024-04-25T01:39:34.429477+0000","last_fullsized":"2024-04-25T01:39:34.429477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:04.848726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197844+0000","last_change":"2024-04-25T01:39:33.444814+0000","last_active":"2024-04-25T01:39:35.197844+0000","last_peered":"2024-04-25T01:39:35.197844+0000","last_clean":"2024-04-25T01:39:35.197844+0000","last_became_active":"2024-04-25T01:39:33.444489+0000","last_became_peered":"2024-04-25T01:39:33.444489+0000","last_unstale":"2024-04-25T01:39:35.197844+0000","last_undegraded":"2024-04-25T01:39:35.197844+0000","last_fullsized":"2024-04-25T01:39:35.197844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:06.718940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198707+0000","last_change":"2024-04-25T01:39:24.392642+0000","last_active":"2024-04-25T01:39:35.198707+0000","last_peered":"2024-04-25T01:39:35.198707+0000","last_clean":"2024-04-25T01:39:35.198707+0000","last_became_active":"2024-04-25T01:39:24.391605+0000","last_became_peered":"2024-04-25T01:39:24.391605+0000","last_unstale":"2024-04-25T01:39:35.198707+0000","last_undegraded":"2024-04-25T01:39:35.198707+0000","last_fullsized":"2024-04-25T01:39:35.198707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:01:23.217074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434798+0000","last_change":"2024-04-25T01:39:23.377236+0000","last_active":"2024-04-25T01:39:34.434798+0000","last_peered":"2024-04-25T01:39:34.434798+0000","last_clean":"2024-04-25T01:39:34.434798+0000","last_became_active":"2024-04-25T01:39:23.376727+0000","last_became_peered":"2024-04-25T01:39:23.376727+0000","last_unstale":"2024-04-25T01:39:34.434798+0000","last_undegraded":"2024-04-25T01:39:34.434798+0000","last_fullsized":"2024-04-25T01:39:34.434798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:08.103707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429200+0000","last_change":"2024-04-25T01:39:32.424457+0000","last_active":"2024-04-25T01:39:34.429200+0000","last_peered":"2024-04-25T01:39:34.429200+0000","last_clean":"2024-04-25T01:39:34.429200+0000","last_became_active":"2024-04-25T01:39:32.424203+0000","last_became_peered":"2024-04-25T01:39:32.424203+0000","last_unstale":"2024-04-25T01:39:34.429200+0000","last_undegraded":"2024-04-25T01:39:34.429200+0000","last_fullsized":"2024-04-25T01:39:34.429200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:12:20.824070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434672+0000","last_change":"2024-04-25T01:39:33.445948+0000","last_active":"2024-04-25T01:39:34.434672+0000","last_peered":"2024-04-25T01:39:34.434672+0000","last_clean":"2024-04-25T01:39:34.434672+0000","last_became_active":"2024-04-25T01:39:33.445654+0000","last_became_peered":"2024-04-25T01:39:33.445654+0000","last_unstale":"2024-04-25T01:39:34.434672+0000","last_undegraded":"2024-04-25T01:39:34.434672+0000","last_fullsized":"2024-04-25T01:39:34.434672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:51.323909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559508+0000","last_change":"2024-04-25T01:39:32.430484+0000","last_active":"2024-04-25T01:39:34.559508+0000","last_peered":"2024-04-25T01:39:34.559508+0000","last_clean":"2024-04-25T01:39:34.559508+0000","last_became_active":"2024-04-25T01:39:32.430220+0000","last_became_peered":"2024-04-25T01:39:32.430220+0000","last_unstale":"2024-04-25T01:39:34.559508+0000","last_undegraded":"2024-04-25T01:39:34.559508+0000","last_fullsized":"2024-04-25T01:39:34.559508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:36:53.152442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197722+0000","last_change":"2024-04-25T01:39:24.375457+0000","last_active":"2024-04-25T01:39:35.197722+0000","last_peered":"2024-04-25T01:39:35.197722+0000","last_clean":"2024-04-25T01:39:35.197722+0000","last_became_active":"2024-04-25T01:39:24.375178+0000","last_became_peered":"2024-04-25T01:39:24.375178+0000","last_unstale":"2024-04-25T01:39:35.197722+0000","last_undegraded":"2024-04-25T01:39:35.197722+0000","last_fullsized":"2024-04-25T01:39:35.197722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:58:15.640882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197478+0000","last_change":"2024-04-25T01:39:23.369998+0000","last_active":"2024-04-25T01:39:35.197478+0000","last_peered":"2024-04-25T01:39:35.197478+0000","last_clean":"2024-04-25T01:39:35.197478+0000","last_became_active":"2024-04-25T01:39:23.369710+0000","last_became_peered":"2024-04-25T01:39:23.369710+0000","last_unstale":"2024-04-25T01:39:35.197478+0000","last_undegraded":"2024-04-25T01:39:35.197478+0000","last_fullsized":"2024-04-25T01:39:35.197478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:32:34.329452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559536+0000","last_change":"2024-04-25T01:39:33.447666+0000","last_active":"2024-04-25T01:39:34.559536+0000","last_peered":"2024-04-25T01:39:34.559536+0000","last_clean":"2024-04-25T01:39:34.559536+0000","last_became_active":"2024-04-25T01:39:33.447436+0000","last_became_peered":"2024-04-25T01:39:33.447436+0000","last_unstale":"2024-04-25T01:39:34.559536+0000","last_undegraded":"2024-04-25T01:39:34.559536+0000","last_fullsized":"2024-04-25T01:39:34.559536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:25:20.440422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434733+0000","last_change":"2024-04-25T01:39:32.436300+0000","last_active":"2024-04-25T01:39:34.434733+0000","last_peered":"2024-04-25T01:39:34.434733+0000","last_clean":"2024-04-25T01:39:34.434733+0000","last_became_active":"2024-04-25T01:39:32.436000+0000","last_became_peered":"2024-04-25T01:39:32.436000+0000","last_unstale":"2024-04-25T01:39:34.434733+0000","last_undegraded":"2024-04-25T01:39:34.434733+0000","last_fullsized":"2024-04-25T01:39:34.434733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:38.044992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429461+0000","last_change":"2024-04-25T01:39:24.387708+0000","last_active":"2024-04-25T01:39:34.429461+0000","last_peered":"2024-04-25T01:39:34.429461+0000","last_clean":"2024-04-25T01:39:34.429461+0000","last_became_active":"2024-04-25T01:39:24.387433+0000","last_became_peered":"2024-04-25T01:39:24.387433+0000","last_unstale":"2024-04-25T01:39:34.429461+0000","last_undegraded":"2024-04-25T01:39:34.429461+0000","last_fullsized":"2024-04-25T01:39:34.429461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:34.312066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429418+0000","last_change":"2024-04-25T01:39:23.377487+0000","last_active":"2024-04-25T01:39:34.429418+0000","last_peered":"2024-04-25T01:39:34.429418+0000","last_clean":"2024-04-25T01:39:34.429418+0000","last_became_active":"2024-04-25T01:39:23.377181+0000","last_became_peered":"2024-04-25T01:39:23.377181+0000","last_unstale":"2024-04-25T01:39:34.429418+0000","last_undegraded":"2024-04-25T01:39:34.429418+0000","last_fullsized":"2024-04-25T01:39:34.429418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:17.434141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198602+0000","last_change":"2024-04-25T01:39:33.444973+0000","last_active":"2024-04-25T01:39:35.198602+0000","last_peered":"2024-04-25T01:39:35.198602+0000","last_clean":"2024-04-25T01:39:35.198602+0000","last_became_active":"2024-04-25T01:39:33.444673+0000","last_became_peered":"2024-04-25T01:39:33.444673+0000","last_unstale":"2024-04-25T01:39:35.198602+0000","last_undegraded":"2024-04-25T01:39:35.198602+0000","last_fullsized":"2024-04-25T01:39:35.198602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:08.372714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434713+0000","last_change":"2024-04-25T01:39:23.372975+0000","last_active":"2024-04-25T01:39:34.434713+0000","last_peered":"2024-04-25T01:39:34.434713+0000","last_clean":"2024-04-25T01:39:34.434713+0000","last_became_active":"2024-04-25T01:39:23.372688+0000","last_became_peered":"2024-04-25T01:39:23.372688+0000","last_unstale":"2024-04-25T01:39:34.434713+0000","last_undegraded":"2024-04-25T01:39:34.434713+0000","last_fullsized":"2024-04-25T01:39:34.434713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:42:57.195844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559766+0000","last_change":"2024-04-25T01:39:24.388095+0000","last_active":"2024-04-25T01:39:34.559766+0000","last_peered":"2024-04-25T01:39:34.559766+0000","last_clean":"2024-04-25T01:39:34.559766+0000","last_became_active":"2024-04-25T01:39:24.387797+0000","last_became_peered":"2024-04-25T01:39:24.387797+0000","last_unstale":"2024-04-25T01:39:34.559766+0000","last_undegraded":"2024-04-25T01:39:34.559766+0000","last_fullsized":"2024-04-25T01:39:34.559766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:43:16.385957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197731+0000","last_change":"2024-04-25T01:39:32.427081+0000","last_active":"2024-04-25T01:39:35.197731+0000","last_peered":"2024-04-25T01:39:35.197731+0000","last_clean":"2024-04-25T01:39:35.197731+0000","last_became_active":"2024-04-25T01:39:32.426626+0000","last_became_peered":"2024-04-25T01:39:32.426626+0000","last_unstale":"2024-04-25T01:39:35.197731+0000","last_undegraded":"2024-04-25T01:39:35.197731+0000","last_fullsized":"2024-04-25T01:39:35.197731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:45.358400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198937+0000","last_change":"2024-04-25T01:39:33.446301+0000","last_active":"2024-04-25T01:39:35.198937+0000","last_peered":"2024-04-25T01:39:35.198937+0000","last_clean":"2024-04-25T01:39:35.198937+0000","last_became_active":"2024-04-25T01:39:33.445158+0000","last_became_peered":"2024-04-25T01:39:33.445158+0000","last_unstale":"2024-04-25T01:39:35.198937+0000","last_undegraded":"2024-04-25T01:39:35.198937+0000","last_fullsized":"2024-04-25T01:39:35.198937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:53:26.017968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429884+0000","last_change":"2024-04-25T01:39:23.371716+0000","last_active":"2024-04-25T01:39:34.429884+0000","last_peered":"2024-04-25T01:39:34.429884+0000","last_clean":"2024-04-25T01:39:34.429884+0000","last_became_active":"2024-04-25T01:39:23.371475+0000","last_became_peered":"2024-04-25T01:39:23.371475+0000","last_unstale":"2024-04-25T01:39:34.429884+0000","last_undegraded":"2024-04-25T01:39:34.429884+0000","last_fullsized":"2024-04-25T01:39:34.429884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:10.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198751+0000","last_change":"2024-04-25T01:39:24.388083+0000","last_active":"2024-04-25T01:39:35.198751+0000","last_peered":"2024-04-25T01:39:35.198751+0000","last_clean":"2024-04-25T01:39:35.198751+0000","last_became_active":"2024-04-25T01:39:24.387789+0000","last_became_peered":"2024-04-25T01:39:24.387789+0000","last_unstale":"2024-04-25T01:39:35.198751+0000","last_undegraded":"2024-04-25T01:39:35.198751+0000","last_fullsized":"2024-04-25T01:39:35.198751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:31.760631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429824+0000","last_change":"2024-04-25T01:39:32.429613+0000","last_active":"2024-04-25T01:39:34.429824+0000","last_peered":"2024-04-25T01:39:34.429824+0000","last_clean":"2024-04-25T01:39:34.429824+0000","last_became_active":"2024-04-25T01:39:32.429361+0000","last_became_peered":"2024-04-25T01:39:32.429361+0000","last_unstale":"2024-04-25T01:39:34.429824+0000","last_undegraded":"2024-04-25T01:39:34.429824+0000","last_fullsized":"2024-04-25T01:39:34.429824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:04:59.928602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430227+0000","last_change":"2024-04-25T01:39:33.426384+0000","last_active":"2024-04-25T01:39:34.430227+0000","last_peered":"2024-04-25T01:39:34.430227+0000","last_clean":"2024-04-25T01:39:34.430227+0000","last_became_active":"2024-04-25T01:39:33.426101+0000","last_became_peered":"2024-04-25T01:39:33.426101+0000","last_unstale":"2024-04-25T01:39:34.430227+0000","last_undegraded":"2024-04-25T01:39:34.430227+0000","last_fullsized":"2024-04-25T01:39:34.430227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:36.820458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.433902+0000","last_change":"2024-04-25T01:39:24.395618+0000","last_active":"2024-04-25T01:39:34.433902+0000","last_peered":"2024-04-25T01:39:34.433902+0000","last_clean":"2024-04-25T01:39:34.433902+0000","last_became_active":"2024-04-25T01:39:24.394816+0000","last_became_peered":"2024-04-25T01:39:24.394816+0000","last_unstale":"2024-04-25T01:39:34.433902+0000","last_undegraded":"2024-04-25T01:39:34.433902+0000","last_fullsized":"2024-04-25T01:39:34.433902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:01.025135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198676+0000","last_change":"2024-04-25T01:39:33.432537+0000","last_active":"2024-04-25T01:39:35.198676+0000","last_peered":"2024-04-25T01:39:35.198676+0000","last_clean":"2024-04-25T01:39:35.198676+0000","last_became_active":"2024-04-25T01:39:33.432266+0000","last_became_peered":"2024-04-25T01:39:33.432266+0000","last_unstale":"2024-04-25T01:39:35.198676+0000","last_undegraded":"2024-04-25T01:39:35.198676+0000","last_fullsized":"2024-04-25T01:39:35.198676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:31.703689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197383+0000","last_change":"2024-04-25T01:39:24.390981+0000","last_active":"2024-04-25T01:39:35.197383+0000","last_peered":"2024-04-25T01:39:35.197383+0000","last_clean":"2024-04-25T01:39:35.197383+0000","last_became_active":"2024-04-25T01:39:24.390716+0000","last_became_peered":"2024-04-25T01:39:24.390716+0000","last_unstale":"2024-04-25T01:39:35.197383+0000","last_undegraded":"2024-04-25T01:39:35.197383+0000","last_fullsized":"2024-04-25T01:39:35.197383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:08.458504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199057+0000","last_change":"2024-04-25T01:39:33.439086+0000","last_active":"2024-04-25T01:39:35.199057+0000","last_peered":"2024-04-25T01:39:35.199057+0000","last_clean":"2024-04-25T01:39:35.199057+0000","last_became_active":"2024-04-25T01:39:33.438811+0000","last_became_peered":"2024-04-25T01:39:33.438811+0000","last_unstale":"2024-04-25T01:39:35.199057+0000","last_undegraded":"2024-04-25T01:39:35.199057+0000","last_fullsized":"2024-04-25T01:39:35.199057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:49:23.604749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198076+0000","last_change":"2024-04-25T01:39:24.399738+0000","last_active":"2024-04-25T01:39:35.198076+0000","last_peered":"2024-04-25T01:39:35.198076+0000","last_clean":"2024-04-25T01:39:35.198076+0000","last_became_active":"2024-04-25T01:39:24.399499+0000","last_became_peered":"2024-04-25T01:39:24.399499+0000","last_unstale":"2024-04-25T01:39:35.198076+0000","last_undegraded":"2024-04-25T01:39:35.198076+0000","last_fullsized":"2024-04-25T01:39:35.198076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:58.646669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198407+0000","last_change":"2024-04-25T01:39:33.444074+0000","last_active":"2024-04-25T01:39:35.198407+0000","last_peered":"2024-04-25T01:39:35.198407+0000","last_clean":"2024-04-25T01:39:35.198407+0000","last_became_active":"2024-04-25T01:39:33.443796+0000","last_became_peered":"2024-04-25T01:39:33.443796+0000","last_unstale":"2024-04-25T01:39:35.198407+0000","last_undegraded":"2024-04-25T01:39:35.198407+0000","last_fullsized":"2024-04-25T01:39:35.198407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:56.379211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559685+0000","last_change":"2024-04-25T01:39:24.390631+0000","last_active":"2024-04-25T01:39:34.559685+0000","last_peered":"2024-04-25T01:39:34.559685+0000","last_clean":"2024-04-25T01:39:34.559685+0000","last_became_active":"2024-04-25T01:39:24.390363+0000","last_became_peered":"2024-04-25T01:39:24.390363+0000","last_unstale":"2024-04-25T01:39:34.559685+0000","last_undegraded":"2024-04-25T01:39:34.559685+0000","last_fullsized":"2024-04-25T01:39:34.559685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:48.830416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199245+0000","last_change":"2024-04-25T01:39:33.437787+0000","last_active":"2024-04-25T01:39:35.199245+0000","last_peered":"2024-04-25T01:39:35.199245+0000","last_clean":"2024-04-25T01:39:35.199245+0000","last_became_active":"2024-04-25T01:39:33.436131+0000","last_became_peered":"2024-04-25T01:39:33.436131+0000","last_unstale":"2024-04-25T01:39:35.199245+0000","last_undegraded":"2024-04-25T01:39:35.199245+0000","last_fullsized":"2024-04-25T01:39:35.199245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:29:13.213643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429883+0000","last_change":"2024-04-25T01:39:24.389645+0000","last_active":"2024-04-25T01:39:34.429883+0000","last_peered":"2024-04-25T01:39:34.429883+0000","last_clean":"2024-04-25T01:39:34.429883+0000","last_became_active":"2024-04-25T01:39:24.389375+0000","last_became_peered":"2024-04-25T01:39:24.389375+0000","last_unstale":"2024-04-25T01:39:34.429883+0000","last_undegraded":"2024-04-25T01:39:34.429883+0000","last_fullsized":"2024-04-25T01:39:34.429883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:13:12.753893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197777+0000","last_change":"2024-04-25T01:39:33.448177+0000","last_active":"2024-04-25T01:39:35.197777+0000","last_peered":"2024-04-25T01:39:35.197777+0000","last_clean":"2024-04-25T01:39:35.197777+0000","last_became_active":"2024-04-25T01:39:33.447588+0000","last_became_peered":"2024-04-25T01:39:33.447588+0000","last_unstale":"2024-04-25T01:39:35.197777+0000","last_undegraded":"2024-04-25T01:39:35.197777+0000","last_fullsized":"2024-04-25T01:39:35.197777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:11:20.466189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198572+0000","last_change":"2024-04-25T01:39:24.374082+0000","last_active":"2024-04-25T01:39:35.198572+0000","last_peered":"2024-04-25T01:39:35.198572+0000","last_clean":"2024-04-25T01:39:35.198572+0000","last_became_active":"2024-04-25T01:39:24.373731+0000","last_became_peered":"2024-04-25T01:39:24.373731+0000","last_unstale":"2024-04-25T01:39:35.198572+0000","last_undegraded":"2024-04-25T01:39:35.198572+0000","last_fullsized":"2024-04-25T01:39:35.198572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:45.817483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197536+0000","last_change":"2024-04-25T01:39:33.446992+0000","last_active":"2024-04-25T01:39:35.197536+0000","last_peered":"2024-04-25T01:39:35.197536+0000","last_clean":"2024-04-25T01:39:35.197536+0000","last_became_active":"2024-04-25T01:39:33.446652+0000","last_became_peered":"2024-04-25T01:39:33.446652+0000","last_unstale":"2024-04-25T01:39:35.197536+0000","last_undegraded":"2024-04-25T01:39:35.197536+0000","last_fullsized":"2024-04-25T01:39:35.197536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:43:52.959274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434529+0000","last_change":"2024-04-25T01:39:24.398614+0000","last_active":"2024-04-25T01:39:34.434529+0000","last_peered":"2024-04-25T01:39:34.434529+0000","last_clean":"2024-04-25T01:39:34.434529+0000","last_became_active":"2024-04-25T01:39:24.398299+0000","last_became_peered":"2024-04-25T01:39:24.398299+0000","last_unstale":"2024-04-25T01:39:34.434529+0000","last_undegraded":"2024-04-25T01:39:34.434529+0000","last_fullsized":"2024-04-25T01:39:34.434529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:54:51.191225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434363+0000","last_change":"2024-04-25T01:39:33.441401+0000","last_active":"2024-04-25T01:39:34.434363+0000","last_peered":"2024-04-25T01:39:34.434363+0000","last_clean":"2024-04-25T01:39:34.434363+0000","last_became_active":"2024-04-25T01:39:33.441104+0000","last_became_peered":"2024-04-25T01:39:33.441104+0000","last_unstale":"2024-04-25T01:39:34.434363+0000","last_undegraded":"2024-04-25T01:39:34.434363+0000","last_fullsized":"2024-04-25T01:39:34.434363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:51.503340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430186+0000","last_change":"2024-04-25T01:39:24.390352+0000","last_active":"2024-04-25T01:39:34.430186+0000","last_peered":"2024-04-25T01:39:34.430186+0000","last_clean":"2024-04-25T01:39:34.430186+0000","last_became_active":"2024-04-25T01:39:24.389809+0000","last_became_peered":"2024-04-25T01:39:24.389809+0000","last_unstale":"2024-04-25T01:39:34.430186+0000","last_undegraded":"2024-04-25T01:39:34.430186+0000","last_fullsized":"2024-04-25T01:39:34.430186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:22:44.221898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430089+0000","last_change":"2024-04-25T01:39:33.426710+0000","last_active":"2024-04-25T01:39:34.430089+0000","last_peered":"2024-04-25T01:39:34.430089+0000","last_clean":"2024-04-25T01:39:34.430089+0000","last_became_active":"2024-04-25T01:39:33.426056+0000","last_became_peered":"2024-04-25T01:39:33.426056+0000","last_unstale":"2024-04-25T01:39:34.430089+0000","last_undegraded":"2024-04-25T01:39:34.430089+0000","last_fullsized":"2024-04-25T01:39:34.430089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:53:41.174851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197416+0000","last_change":"2024-04-25T01:39:24.387093+0000","last_active":"2024-04-25T01:39:35.197416+0000","last_peered":"2024-04-25T01:39:35.197416+0000","last_clean":"2024-04-25T01:39:35.197416+0000","last_became_active":"2024-04-25T01:39:24.386809+0000","last_became_peered":"2024-04-25T01:39:24.386809+0000","last_unstale":"2024-04-25T01:39:35.197416+0000","last_undegraded":"2024-04-25T01:39:35.197416+0000","last_fullsized":"2024-04-25T01:39:35.197416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:46:05.313828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200264+0000","last_change":"2024-04-25T01:39:33.436499+0000","last_active":"2024-04-25T01:39:35.200264+0000","last_peered":"2024-04-25T01:39:35.200264+0000","last_clean":"2024-04-25T01:39:35.200264+0000","last_became_active":"2024-04-25T01:39:33.436017+0000","last_became_peered":"2024-04-25T01:39:33.436017+0000","last_unstale":"2024-04-25T01:39:35.200264+0000","last_undegraded":"2024-04-25T01:39:35.200264+0000","last_fullsized":"2024-04-25T01:39:35.200264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:46:09.302012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429495+0000","last_change":"2024-04-25T01:39:24.389039+0000","last_active":"2024-04-25T01:39:34.429495+0000","last_peered":"2024-04-25T01:39:34.429495+0000","last_clean":"2024-04-25T01:39:34.429495+0000","last_became_active":"2024-04-25T01:39:24.388793+0000","last_became_peered":"2024-04-25T01:39:24.388793+0000","last_unstale":"2024-04-25T01:39:34.429495+0000","last_undegraded":"2024-04-25T01:39:34.429495+0000","last_fullsized":"2024-04-25T01:39:34.429495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:13.093550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197668+0000","last_change":"2024-04-25T01:39:33.441122+0000","last_active":"2024-04-25T01:39:35.197668+0000","last_peered":"2024-04-25T01:39:35.197668+0000","last_clean":"2024-04-25T01:39:35.197668+0000","last_became_active":"2024-04-25T01:39:33.440760+0000","last_became_peered":"2024-04-25T01:39:33.440760+0000","last_unstale":"2024-04-25T01:39:35.197668+0000","last_undegraded":"2024-04-25T01:39:35.197668+0000","last_fullsized":"2024-04-25T01:39:35.197668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:30:12.603789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197981+0000","last_change":"2024-04-25T01:39:24.390884+0000","last_active":"2024-04-25T01:39:35.197981+0000","last_peered":"2024-04-25T01:39:35.197981+0000","last_clean":"2024-04-25T01:39:35.197981+0000","last_became_active":"2024-04-25T01:39:24.390591+0000","last_became_peered":"2024-04-25T01:39:24.390591+0000","last_unstale":"2024-04-25T01:39:35.197981+0000","last_undegraded":"2024-04-25T01:39:35.197981+0000","last_fullsized":"2024-04-25T01:39:35.197981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:51.274363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429740+0000","last_change":"2024-04-25T01:39:33.429482+0000","last_active":"2024-04-25T01:39:34.429740+0000","last_peered":"2024-04-25T01:39:34.429740+0000","last_clean":"2024-04-25T01:39:34.429740+0000","last_became_active":"2024-04-25T01:39:33.429158+0000","last_became_peered":"2024-04-25T01:39:33.429158+0000","last_unstale":"2024-04-25T01:39:34.429740+0000","last_undegraded":"2024-04-25T01:39:34.429740+0000","last_fullsized":"2024-04-25T01:39:34.429740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:58:07.372868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559599+0000","last_change":"2024-04-25T01:39:24.388891+0000","last_active":"2024-04-25T01:39:34.559599+0000","last_peered":"2024-04-25T01:39:34.559599+0000","last_clean":"2024-04-25T01:39:34.559599+0000","last_became_active":"2024-04-25T01:39:24.388619+0000","last_became_peered":"2024-04-25T01:39:24.388619+0000","last_unstale":"2024-04-25T01:39:34.559599+0000","last_undegraded":"2024-04-25T01:39:34.559599+0000","last_fullsized":"2024-04-25T01:39:34.559599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:05.176386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198216+0000","last_change":"2024-04-25T01:39:33.443534+0000","last_active":"2024-04-25T01:39:35.198216+0000","last_peered":"2024-04-25T01:39:35.198216+0000","last_clean":"2024-04-25T01:39:35.198216+0000","last_became_active":"2024-04-25T01:39:33.443257+0000","last_became_peered":"2024-04-25T01:39:33.443257+0000","last_unstale":"2024-04-25T01:39:35.198216+0000","last_undegraded":"2024-04-25T01:39:35.198216+0000","last_fullsized":"2024-04-25T01:39:35.198216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:44:30.154519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434181+0000","last_change":"2024-04-25T01:39:24.395109+0000","last_active":"2024-04-25T01:39:34.434181+0000","last_peered":"2024-04-25T01:39:34.434181+0000","last_clean":"2024-04-25T01:39:34.434181+0000","last_became_active":"2024-04-25T01:39:24.394784+0000","last_became_peered":"2024-04-25T01:39:24.394784+0000","last_unstale":"2024-04-25T01:39:34.434181+0000","last_undegraded":"2024-04-25T01:39:34.434181+0000","last_fullsized":"2024-04-25T01:39:34.434181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:44:09.102603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197600+0000","last_change":"2024-04-25T01:39:33.446683+0000","last_active":"2024-04-25T01:39:35.197600+0000","last_peered":"2024-04-25T01:39:35.197600+0000","last_clean":"2024-04-25T01:39:35.197600+0000","last_became_active":"2024-04-25T01:39:33.445949+0000","last_became_peered":"2024-04-25T01:39:33.445949+0000","last_unstale":"2024-04-25T01:39:35.197600+0000","last_undegraded":"2024-04-25T01:39:35.197600+0000","last_fullsized":"2024-04-25T01:39:35.197600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:28.864821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199913+0000","last_change":"2024-04-25T01:39:24.380199+0000","last_active":"2024-04-25T01:39:35.199913+0000","last_peered":"2024-04-25T01:39:35.199913+0000","last_clean":"2024-04-25T01:39:35.199913+0000","last_became_active":"2024-04-25T01:39:24.379591+0000","last_became_peered":"2024-04-25T01:39:24.379591+0000","last_unstale":"2024-04-25T01:39:35.199913+0000","last_undegraded":"2024-04-25T01:39:35.199913+0000","last_fullsized":"2024-04-25T01:39:35.199913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:54.534683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197349+0000","last_change":"2024-04-25T01:39:33.439702+0000","last_active":"2024-04-25T01:39:35.197349+0000","last_peered":"2024-04-25T01:39:35.197349+0000","last_clean":"2024-04-25T01:39:35.197349+0000","last_became_active":"2024-04-25T01:39:33.439424+0000","last_became_peered":"2024-04-25T01:39:33.439424+0000","last_unstale":"2024-04-25T01:39:35.197349+0000","last_undegraded":"2024-04-25T01:39:35.197349+0000","last_fullsized":"2024-04-25T01:39:35.197349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:31.528140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197883+0000","last_change":"2024-04-25T01:39:24.395125+0000","last_active":"2024-04-25T01:39:35.197883+0000","last_peered":"2024-04-25T01:39:35.197883+0000","last_clean":"2024-04-25T01:39:35.197883+0000","last_became_active":"2024-04-25T01:39:24.392605+0000","last_became_peered":"2024-04-25T01:39:24.392605+0000","last_unstale":"2024-04-25T01:39:35.197883+0000","last_undegraded":"2024-04-25T01:39:35.197883+0000","last_fullsized":"2024-04-25T01:39:35.197883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:53.333616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559178+0000","last_change":"2024-04-25T01:39:33.438104+0000","last_active":"2024-04-25T01:39:34.559178+0000","last_peered":"2024-04-25T01:39:34.559178+0000","last_clean":"2024-04-25T01:39:34.559178+0000","last_became_active":"2024-04-25T01:39:33.437795+0000","last_became_peered":"2024-04-25T01:39:33.437795+0000","last_unstale":"2024-04-25T01:39:34.559178+0000","last_undegraded":"2024-04-25T01:39:34.559178+0000","last_fullsized":"2024-04-25T01:39:34.559178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:32.294104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199422+0000","last_change":"2024-04-25T01:39:24.391312+0000","last_active":"2024-04-25T01:39:35.199422+0000","last_peered":"2024-04-25T01:39:35.199422+0000","last_clean":"2024-04-25T01:39:35.199422+0000","last_became_active":"2024-04-25T01:39:24.390978+0000","last_became_peered":"2024-04-25T01:39:24.390978+0000","last_unstale":"2024-04-25T01:39:35.199422+0000","last_undegraded":"2024-04-25T01:39:35.199422+0000","last_fullsized":"2024-04-25T01:39:35.199422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:38:25.637031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197875+0000","last_change":"2024-04-25T01:39:33.431262+0000","last_active":"2024-04-25T01:39:35.197875+0000","last_peered":"2024-04-25T01:39:35.197875+0000","last_clean":"2024-04-25T01:39:35.197875+0000","last_became_active":"2024-04-25T01:39:33.430982+0000","last_became_peered":"2024-04-25T01:39:33.430982+0000","last_unstale":"2024-04-25T01:39:35.197875+0000","last_undegraded":"2024-04-25T01:39:35.197875+0000","last_fullsized":"2024-04-25T01:39:35.197875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:11.821542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197372+0000","last_change":"2024-04-25T01:39:24.399270+0000","last_active":"2024-04-25T01:39:35.197372+0000","last_peered":"2024-04-25T01:39:35.197372+0000","last_clean":"2024-04-25T01:39:35.197372+0000","last_became_active":"2024-04-25T01:39:24.399011+0000","last_became_peered":"2024-04-25T01:39:24.399011+0000","last_unstale":"2024-04-25T01:39:35.197372+0000","last_undegraded":"2024-04-25T01:39:35.197372+0000","last_fullsized":"2024-04-25T01:39:35.197372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:00.987674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197770+0000","last_change":"2024-04-25T01:39:33.443939+0000","last_active":"2024-04-25T01:39:35.197770+0000","last_peered":"2024-04-25T01:39:35.197770+0000","last_clean":"2024-04-25T01:39:35.197770+0000","last_became_active":"2024-04-25T01:39:33.443608+0000","last_became_peered":"2024-04-25T01:39:33.443608+0000","last_unstale":"2024-04-25T01:39:35.197770+0000","last_undegraded":"2024-04-25T01:39:35.197770+0000","last_fullsized":"2024-04-25T01:39:35.197770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:35.561173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197831+0000","last_change":"2024-04-25T01:39:24.388943+0000","last_active":"2024-04-25T01:39:35.197831+0000","last_peered":"2024-04-25T01:39:35.197831+0000","last_clean":"2024-04-25T01:39:35.197831+0000","last_became_active":"2024-04-25T01:39:24.388690+0000","last_became_peered":"2024-04-25T01:39:24.388690+0000","last_unstale":"2024-04-25T01:39:35.197831+0000","last_undegraded":"2024-04-25T01:39:35.197831+0000","last_fullsized":"2024-04-25T01:39:35.197831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:42:18.260701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198911+0000","last_change":"2024-04-25T01:39:33.438460+0000","last_active":"2024-04-25T01:39:35.198911+0000","last_peered":"2024-04-25T01:39:35.198911+0000","last_clean":"2024-04-25T01:39:35.198911+0000","last_became_active":"2024-04-25T01:39:33.436581+0000","last_became_peered":"2024-04-25T01:39:33.436581+0000","last_unstale":"2024-04-25T01:39:35.198911+0000","last_undegraded":"2024-04-25T01:39:35.198911+0000","last_fullsized":"2024-04-25T01:39:35.198911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:03:27.382925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559241+0000","last_change":"2024-04-25T01:39:24.389556+0000","last_active":"2024-04-25T01:39:34.559241+0000","last_peered":"2024-04-25T01:39:34.559241+0000","last_clean":"2024-04-25T01:39:34.559241+0000","last_became_active":"2024-04-25T01:39:24.389254+0000","last_became_peered":"2024-04-25T01:39:24.389254+0000","last_unstale":"2024-04-25T01:39:34.559241+0000","last_undegraded":"2024-04-25T01:39:34.559241+0000","last_fullsized":"2024-04-25T01:39:34.559241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:56.208172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199719+0000","last_change":"2024-04-25T01:39:33.433893+0000","last_active":"2024-04-25T01:39:35.199719+0000","last_peered":"2024-04-25T01:39:35.199719+0000","last_clean":"2024-04-25T01:39:35.199719+0000","last_became_active":"2024-04-25T01:39:33.433577+0000","last_became_peered":"2024-04-25T01:39:33.433577+0000","last_unstale":"2024-04-25T01:39:35.199719+0000","last_undegraded":"2024-04-25T01:39:35.199719+0000","last_fullsized":"2024-04-25T01:39:35.199719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:16.371837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429725+0000","last_change":"2024-04-25T01:39:24.392021+0000","last_active":"2024-04-25T01:39:34.429725+0000","last_peered":"2024-04-25T01:39:34.429725+0000","last_clean":"2024-04-25T01:39:34.429725+0000","last_became_active":"2024-04-25T01:39:24.391352+0000","last_became_peered":"2024-04-25T01:39:24.391352+0000","last_unstale":"2024-04-25T01:39:34.429725+0000","last_undegraded":"2024-04-25T01:39:34.429725+0000","last_fullsized":"2024-04-25T01:39:34.429725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:44.434749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429972+0000","last_change":"2024-04-25T01:39:33.436641+0000","last_active":"2024-04-25T01:39:34.429972+0000","last_peered":"2024-04-25T01:39:34.429972+0000","last_clean":"2024-04-25T01:39:34.429972+0000","last_became_active":"2024-04-25T01:39:33.436389+0000","last_became_peered":"2024-04-25T01:39:33.436389+0000","last_unstale":"2024-04-25T01:39:34.429972+0000","last_undegraded":"2024-04-25T01:39:34.429972+0000","last_fullsized":"2024-04-25T01:39:34.429972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:19:51.940088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198744+0000","last_change":"2024-04-25T01:39:24.396300+0000","last_active":"2024-04-25T01:39:35.198744+0000","last_peered":"2024-04-25T01:39:35.198744+0000","last_clean":"2024-04-25T01:39:35.198744+0000","last_became_active":"2024-04-25T01:39:24.396023+0000","last_became_peered":"2024-04-25T01:39:24.396023+0000","last_unstale":"2024-04-25T01:39:35.198744+0000","last_undegraded":"2024-04-25T01:39:35.198744+0000","last_fullsized":"2024-04-25T01:39:35.198744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:21.500721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197770+0000","last_change":"2024-04-25T01:39:33.443419+0000","last_active":"2024-04-25T01:39:35.197770+0000","last_peered":"2024-04-25T01:39:35.197770+0000","last_clean":"2024-04-25T01:39:35.197770+0000","last_became_active":"2024-04-25T01:39:33.443163+0000","last_became_peered":"2024-04-25T01:39:33.443163+0000","last_unstale":"2024-04-25T01:39:35.197770+0000","last_undegraded":"2024-04-25T01:39:35.197770+0000","last_fullsized":"2024-04-25T01:39:35.197770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:22.156410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434366+0000","last_change":"2024-04-25T01:39:24.404047+0000","last_active":"2024-04-25T01:39:34.434366+0000","last_peered":"2024-04-25T01:39:34.434366+0000","last_clean":"2024-04-25T01:39:34.434366+0000","last_became_active":"2024-04-25T01:39:24.403700+0000","last_became_peered":"2024-04-25T01:39:24.403700+0000","last_unstale":"2024-04-25T01:39:34.434366+0000","last_undegraded":"2024-04-25T01:39:34.434366+0000","last_fullsized":"2024-04-25T01:39:34.434366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:53.123061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199905+0000","last_change":"2024-04-25T01:39:33.435520+0000","last_active":"2024-04-25T01:39:35.199905+0000","last_peered":"2024-04-25T01:39:35.199905+0000","last_clean":"2024-04-25T01:39:35.199905+0000","last_became_active":"2024-04-25T01:39:33.434446+0000","last_became_peered":"2024-04-25T01:39:33.434446+0000","last_unstale":"2024-04-25T01:39:35.199905+0000","last_undegraded":"2024-04-25T01:39:35.199905+0000","last_fullsized":"2024-04-25T01:39:35.199905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:59.696009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434467+0000","last_change":"2024-04-25T01:39:24.406158+0000","last_active":"2024-04-25T01:39:34.434467+0000","last_peered":"2024-04-25T01:39:34.434467+0000","last_clean":"2024-04-25T01:39:34.434467+0000","last_became_active":"2024-04-25T01:39:24.405876+0000","last_became_peered":"2024-04-25T01:39:24.405876+0000","last_unstale":"2024-04-25T01:39:34.434467+0000","last_undegraded":"2024-04-25T01:39:34.434467+0000","last_fullsized":"2024-04-25T01:39:34.434467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:18:19.895651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198497+0000","last_change":"2024-04-25T01:39:33.436479+0000","last_active":"2024-04-25T01:39:35.198497+0000","last_peered":"2024-04-25T01:39:35.198497+0000","last_clean":"2024-04-25T01:39:35.198497+0000","last_became_active":"2024-04-25T01:39:33.436193+0000","last_became_peered":"2024-04-25T01:39:33.436193+0000","last_unstale":"2024-04-25T01:39:35.198497+0000","last_undegraded":"2024-04-25T01:39:35.198497+0000","last_fullsized":"2024-04-25T01:39:35.198497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:20:03.455536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200363+0000","last_change":"2024-04-25T01:39:24.393362+0000","last_active":"2024-04-25T01:39:35.200363+0000","last_peered":"2024-04-25T01:39:35.200363+0000","last_clean":"2024-04-25T01:39:35.200363+0000","last_became_active":"2024-04-25T01:39:24.392836+0000","last_became_peered":"2024-04-25T01:39:24.392836+0000","last_unstale":"2024-04-25T01:39:35.200363+0000","last_undegraded":"2024-04-25T01:39:35.200363+0000","last_fullsized":"2024-04-25T01:39:35.200363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:58.871777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430064+0000","last_change":"2024-04-25T01:39:33.440164+0000","last_active":"2024-04-25T01:39:34.430064+0000","last_peered":"2024-04-25T01:39:34.430064+0000","last_clean":"2024-04-25T01:39:34.430064+0000","last_became_active":"2024-04-25T01:39:33.439878+0000","last_became_peered":"2024-04-25T01:39:33.439878+0000","last_unstale":"2024-04-25T01:39:34.430064+0000","last_undegraded":"2024-04-25T01:39:34.430064+0000","last_fullsized":"2024-04-25T01:39:34.430064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:44:52.817169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429296+0000","last_change":"2024-04-25T01:39:24.401765+0000","last_active":"2024-04-25T01:39:34.429296+0000","last_peered":"2024-04-25T01:39:34.429296+0000","last_clean":"2024-04-25T01:39:34.429296+0000","last_became_active":"2024-04-25T01:39:24.400509+0000","last_became_peered":"2024-04-25T01:39:24.400509+0000","last_unstale":"2024-04-25T01:39:34.429296+0000","last_undegraded":"2024-04-25T01:39:34.429296+0000","last_fullsized":"2024-04-25T01:39:34.429296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:25.031622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434669+0000","last_change":"2024-04-25T01:39:33.439353+0000","last_active":"2024-04-25T01:39:34.434669+0000","last_peered":"2024-04-25T01:39:34.434669+0000","last_clean":"2024-04-25T01:39:34.434669+0000","last_became_active":"2024-04-25T01:39:33.438915+0000","last_became_peered":"2024-04-25T01:39:33.438915+0000","last_unstale":"2024-04-25T01:39:34.434669+0000","last_undegraded":"2024-04-25T01:39:34.434669+0000","last_fullsized":"2024-04-25T01:39:34.434669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:19.180919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198881+0000","last_change":"2024-04-25T01:39:24.387941+0000","last_active":"2024-04-25T01:39:35.198881+0000","last_peered":"2024-04-25T01:39:35.198881+0000","last_clean":"2024-04-25T01:39:35.198881+0000","last_became_active":"2024-04-25T01:39:24.387674+0000","last_became_peered":"2024-04-25T01:39:24.387674+0000","last_unstale":"2024-04-25T01:39:35.198881+0000","last_undegraded":"2024-04-25T01:39:35.198881+0000","last_fullsized":"2024-04-25T01:39:35.198881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:05.676143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197803+0000","last_change":"2024-04-25T01:39:33.444917+0000","last_active":"2024-04-25T01:39:35.197803+0000","last_peered":"2024-04-25T01:39:35.197803+0000","last_clean":"2024-04-25T01:39:35.197803+0000","last_became_active":"2024-04-25T01:39:33.444636+0000","last_became_peered":"2024-04-25T01:39:33.444636+0000","last_unstale":"2024-04-25T01:39:35.197803+0000","last_undegraded":"2024-04-25T01:39:35.197803+0000","last_fullsized":"2024-04-25T01:39:35.197803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:31.531502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197880+0000","last_change":"2024-04-25T01:39:24.399950+0000","last_active":"2024-04-25T01:39:35.197880+0000","last_peered":"2024-04-25T01:39:35.197880+0000","last_clean":"2024-04-25T01:39:35.197880+0000","last_became_active":"2024-04-25T01:39:24.399701+0000","last_became_peered":"2024-04-25T01:39:24.399701+0000","last_unstale":"2024-04-25T01:39:35.197880+0000","last_undegraded":"2024-04-25T01:39:35.197880+0000","last_fullsized":"2024-04-25T01:39:35.197880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:49.618370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200035+0000","last_change":"2024-04-25T01:39:33.440936+0000","last_active":"2024-04-25T01:39:35.200035+0000","last_peered":"2024-04-25T01:39:35.200035+0000","last_clean":"2024-04-25T01:39:35.200035+0000","last_became_active":"2024-04-25T01:39:33.440679+0000","last_became_peered":"2024-04-25T01:39:33.440679+0000","last_unstale":"2024-04-25T01:39:35.200035+0000","last_undegraded":"2024-04-25T01:39:35.200035+0000","last_fullsized":"2024-04-25T01:39:35.200035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:08:53.629572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198222+0000","last_change":"2024-04-25T01:39:24.380318+0000","last_active":"2024-04-25T01:39:35.198222+0000","last_peered":"2024-04-25T01:39:35.198222+0000","last_clean":"2024-04-25T01:39:35.198222+0000","last_became_active":"2024-04-25T01:39:24.379573+0000","last_became_peered":"2024-04-25T01:39:24.379573+0000","last_unstale":"2024-04-25T01:39:35.198222+0000","last_undegraded":"2024-04-25T01:39:35.198222+0000","last_fullsized":"2024-04-25T01:39:35.198222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:12.089917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429399+0000","last_change":"2024-04-25T01:39:33.426380+0000","last_active":"2024-04-25T01:39:34.429399+0000","last_peered":"2024-04-25T01:39:34.429399+0000","last_clean":"2024-04-25T01:39:34.429399+0000","last_became_active":"2024-04-25T01:39:33.426090+0000","last_became_peered":"2024-04-25T01:39:33.426090+0000","last_unstale":"2024-04-25T01:39:34.429399+0000","last_undegraded":"2024-04-25T01:39:34.429399+0000","last_fullsized":"2024-04-25T01:39:34.429399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:34.329217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199243+0000","last_change":"2024-04-25T01:39:24.398726+0000","last_active":"2024-04-25T01:39:35.199243+0000","last_peered":"2024-04-25T01:39:35.199243+0000","last_clean":"2024-04-25T01:39:35.199243+0000","last_became_active":"2024-04-25T01:39:24.398449+0000","last_became_peered":"2024-04-25T01:39:24.398449+0000","last_unstale":"2024-04-25T01:39:35.199243+0000","last_undegraded":"2024-04-25T01:39:35.199243+0000","last_fullsized":"2024-04-25T01:39:35.199243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:41:38.230939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197750+0000","last_change":"2024-04-25T01:39:33.436488+0000","last_active":"2024-04-25T01:39:35.197750+0000","last_peered":"2024-04-25T01:39:35.197750+0000","last_clean":"2024-04-25T01:39:35.197750+0000","last_became_active":"2024-04-25T01:39:33.436224+0000","last_became_peered":"2024-04-25T01:39:33.436224+0000","last_unstale":"2024-04-25T01:39:35.197750+0000","last_undegraded":"2024-04-25T01:39:35.197750+0000","last_fullsized":"2024-04-25T01:39:35.197750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:38.227206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559398+0000","last_change":"2024-04-25T01:39:24.386909+0000","last_active":"2024-04-25T01:39:34.559398+0000","last_peered":"2024-04-25T01:39:34.559398+0000","last_clean":"2024-04-25T01:39:34.559398+0000","last_became_active":"2024-04-25T01:39:24.386568+0000","last_became_peered":"2024-04-25T01:39:24.386568+0000","last_unstale":"2024-04-25T01:39:34.559398+0000","last_undegraded":"2024-04-25T01:39:34.559398+0000","last_fullsized":"2024-04-25T01:39:34.559398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:29.904064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197979+0000","last_change":"2024-04-25T01:39:33.440753+0000","last_active":"2024-04-25T01:39:35.197979+0000","last_peered":"2024-04-25T01:39:35.197979+0000","last_clean":"2024-04-25T01:39:35.197979+0000","last_became_active":"2024-04-25T01:39:33.440480+0000","last_became_peered":"2024-04-25T01:39:33.440480+0000","last_unstale":"2024-04-25T01:39:35.197979+0000","last_undegraded":"2024-04-25T01:39:35.197979+0000","last_fullsized":"2024-04-25T01:39:35.197979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:18.113293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197980+0000","last_change":"2024-04-25T01:39:24.386803+0000","last_active":"2024-04-25T01:39:35.197980+0000","last_peered":"2024-04-25T01:39:35.197980+0000","last_clean":"2024-04-25T01:39:35.197980+0000","last_became_active":"2024-04-25T01:39:24.386531+0000","last_became_peered":"2024-04-25T01:39:24.386531+0000","last_unstale":"2024-04-25T01:39:35.197980+0000","last_undegraded":"2024-04-25T01:39:35.197980+0000","last_fullsized":"2024-04-25T01:39:35.197980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:19.160345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198690+0000","last_change":"2024-04-25T01:39:33.436433+0000","last_active":"2024-04-25T01:39:35.198690+0000","last_peered":"2024-04-25T01:39:35.198690+0000","last_clean":"2024-04-25T01:39:35.198690+0000","last_became_active":"2024-04-25T01:39:33.436134+0000","last_became_peered":"2024-04-25T01:39:33.436134+0000","last_unstale":"2024-04-25T01:39:35.198690+0000","last_undegraded":"2024-04-25T01:39:35.198690+0000","last_fullsized":"2024-04-25T01:39:35.198690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:08:30.641790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200300+0000","last_change":"2024-04-25T01:39:24.396231+0000","last_active":"2024-04-25T01:39:35.200300+0000","last_peered":"2024-04-25T01:39:35.200300+0000","last_clean":"2024-04-25T01:39:35.200300+0000","last_became_active":"2024-04-25T01:39:24.395958+0000","last_became_peered":"2024-04-25T01:39:24.395958+0000","last_unstale":"2024-04-25T01:39:35.200300+0000","last_undegraded":"2024-04-25T01:39:35.200300+0000","last_fullsized":"2024-04-25T01:39:35.200300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:54.898765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":690301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":101489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":99491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":102507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":101055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T01:39:44.690 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T01:39:44.690 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T01:39:44.690 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T01:39:44.690 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T01:39:44.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.835+0000 7f87acf96640 1 Processor -- start 2024-04-25T01:39:44.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.835+0000 7f87acf96640 1 -- start start 2024-04-25T01:39:44.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.836+0000 7f87acf96640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f87a8150090 0x7f87a8156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:44.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.836+0000 7f87acf96640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87a80c8200 0x7f87a80c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:44.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.836+0000 7f87acf96640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f87a806c280 0x7f87a80c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:44.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.836+0000 7f87acf96640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f87a806b830 con 0x7f87a8150090 2024-04-25T01:39:44.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.836+0000 7f87acf96640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f87a80c9de0 con 0x7f87a806c280 2024-04-25T01:39:44.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.836+0000 7f87acf96640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f87a80c89c0 con 0x7f87a80c8200 2024-04-25T01:39:44.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.836+0000 7f87a659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f87a8150090 0x7f87a8156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:44.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.836+0000 7f87a659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f87a8150090 0x7f87a8156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47140/0 (socket says 172.21.15.77:47140) 2024-04-25T01:39:44.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.836+0000 7f87a659c640 1 -- 172.21.15.77:0/318436128 learned_addr learned my addr 172.21.15.77:0/318436128 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:44.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.836+0000 7f87a5d9b640 1 --2- 172.21.15.77:0/318436128 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87a80c8200 0x7f87a80c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:44.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.836+0000 7f87a6d9d640 1 --2- 172.21.15.77:0/318436128 >> v2:172.21.15.121:3300/0 conn(0x7f87a806c280 0x7f87a80c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:44.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.836+0000 7f87a659c640 1 -- 172.21.15.77:0/318436128 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87a80c8200 msgr2=0x7f87a80c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:44.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.836+0000 7f87a659c640 1 --2- 172.21.15.77:0/318436128 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87a80c8200 0x7f87a80c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:44.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.836+0000 7f87a659c640 1 -- 172.21.15.77:0/318436128 >> v2:172.21.15.121:3300/0 conn(0x7f87a806c280 msgr2=0x7f87a80c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:44.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.836+0000 7f87a659c640 1 --2- 172.21.15.77:0/318436128 >> v2:172.21.15.121:3300/0 conn(0x7f87a806c280 0x7f87a80c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:44.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.836+0000 7f87a659c640 1 -- 172.21.15.77:0/318436128 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87a80c8ca0 con 0x7f87a8150090 2024-04-25T01:39:44.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.837+0000 7f87a659c640 1 --2- 172.21.15.77:0/318436128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87a8150090 0x7f87a8156c80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f87a80ab3d0 tx=0x7f879802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd0c03ff8b885995 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:44.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.837+0000 7f87a559a640 1 -- 172.21.15.77:0/318436128 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8798036070 con 0x7f87a8150090 2024-04-25T01:39:44.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.837+0000 7f87a559a640 1 -- 172.21.15.77:0/318436128 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8798031600 con 0x7f87a8150090 2024-04-25T01:39:44.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.837+0000 7f87a559a640 1 -- 172.21.15.77:0/318436128 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87980319d0 con 0x7f87a8150090 2024-04-25T01:39:44.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.838+0000 7f87acf96640 1 -- 172.21.15.77:0/318436128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87a8150090 msgr2=0x7f87a8156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:44.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.838+0000 7f87acf96640 1 --2- 172.21.15.77:0/318436128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87a8150090 0x7f87a8156c80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f87a80ab3d0 tx=0x7f879802a6a0 comp rx=0 tx=0).stop 2024-04-25T01:39:44.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.838+0000 7f87acf96640 1 -- 172.21.15.77:0/318436128 shutdown_connections 2024-04-25T01:39:44.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.838+0000 7f87acf96640 1 --2- 172.21.15.77:0/318436128 >> v2:172.21.15.121:3300/0 conn(0x7f87a806c280 0x7f87a80c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:44.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.838+0000 7f87acf96640 1 --2- 172.21.15.77:0/318436128 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87a80c8200 0x7f87a80c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:44.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.838+0000 7f87acf96640 1 --2- 172.21.15.77:0/318436128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87a8150090 0x7f87a8156c80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:44.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.838+0000 7f87acf96640 1 -- 172.21.15.77:0/318436128 >> 172.21.15.77:0/318436128 conn(0x7f87a80ad4d0 msgr2=0x7f87a80ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:44.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.838+0000 7f87acf96640 1 -- 172.21.15.77:0/318436128 shutdown_connections 2024-04-25T01:39:44.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.838+0000 7f87acf96640 1 -- 172.21.15.77:0/318436128 wait complete. 2024-04-25T01:39:44.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.839+0000 7f87acf96640 1 Processor -- start 2024-04-25T01:39:44.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.839+0000 7f87acf96640 1 -- start start 2024-04-25T01:39:44.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.840+0000 7f87acf96640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87a806c280 0x7f87a80c2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:44.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.840+0000 7f87acf96640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87a80c8200 0x7f87a81e8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:44.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.840+0000 7f87acf96640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87a8150090 0x7f87a81e9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:44.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.840+0000 7f87acf96640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f87a80c86b0 con 0x7f87a80c8200 2024-04-25T01:39:44.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.840+0000 7f87acf96640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f87a806bd60 con 0x7f87a8150090 2024-04-25T01:39:44.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.840+0000 7f87acf96640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f87a806c6d0 con 0x7f87a806c280 2024-04-25T01:39:44.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.840+0000 7f87a5d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87a80c8200 0x7f87a81e8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:44.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.840+0000 7f87a5d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87a80c8200 0x7f87a81e8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47150/0 (socket says 172.21.15.77:47150) 2024-04-25T01:39:44.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.840+0000 7f87a5d9b640 1 -- 172.21.15.77:0/303339449 learned_addr learned my addr 172.21.15.77:0/303339449 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:44.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.840+0000 7f87a659c640 1 --2- 172.21.15.77:0/303339449 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87a806c280 0x7f87a80c2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:44.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.840+0000 7f87a6d9d640 1 --2- 172.21.15.77:0/303339449 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87a8150090 0x7f87a81e9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:44.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.840+0000 7f87a5d9b640 1 -- 172.21.15.77:0/303339449 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87a806c280 msgr2=0x7f87a80c2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:44.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.840+0000 7f87a5d9b640 1 --2- 172.21.15.77:0/303339449 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87a806c280 0x7f87a80c2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:44.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.840+0000 7f87a5d9b640 1 -- 172.21.15.77:0/303339449 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87a8150090 msgr2=0x7f87a81e9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:44.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.840+0000 7f87a5d9b640 1 --2- 172.21.15.77:0/303339449 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87a8150090 0x7f87a81e9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:44.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.840+0000 7f87a5d9b640 1 -- 172.21.15.77:0/303339449 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87a81eef00 con 0x7f87a80c8200 2024-04-25T01:39:44.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.840+0000 7f87a6d9d640 1 --2- 172.21.15.77:0/303339449 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87a8150090 0x7f87a81e9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:44.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.841+0000 7f87a5d9b640 1 --2- 172.21.15.77:0/303339449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87a80c8200 0x7f87a81e8c20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f879c00d620 tx=0x7f879c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:44.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.841+0000 7f8796ffd640 1 -- 172.21.15.77:0/303339449 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f879c00b620 con 0x7f87a80c8200 2024-04-25T01:39:44.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.841+0000 7f8796ffd640 1 -- 172.21.15.77:0/303339449 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f879c019070 con 0x7f87a80c8200 2024-04-25T01:39:44.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.841+0000 7f8796ffd640 1 -- 172.21.15.77:0/303339449 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f879c00ba00 con 0x7f87a80c8200 2024-04-25T01:39:44.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.841+0000 7f87acf96640 1 -- 172.21.15.77:0/303339449 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87a81ef1e0 con 0x7f87a80c8200 2024-04-25T01:39:44.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.841+0000 7f87acf96640 1 -- 172.21.15.77:0/303339449 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87a81ef7a0 con 0x7f87a80c8200 2024-04-25T01:39:44.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.842+0000 7f87acf96640 1 -- 172.21.15.77:0/303339449 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87a804f500 con 0x7f87a80c8200 2024-04-25T01:39:44.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.842+0000 7f8796ffd640 1 -- 172.21.15.77:0/303339449 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f879c00bba0 con 0x7f87a80c8200 2024-04-25T01:39:44.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.842+0000 7f8796ffd640 1 --2- 172.21.15.77:0/303339449 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f878806be30 0x7f878806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:44.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.843+0000 7f8796ffd640 1 -- 172.21.15.77:0/303339449 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f879c08b450 con 0x7f87a80c8200 2024-04-25T01:39:44.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.843+0000 7f87a659c640 1 --2- 172.21.15.77:0/303339449 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f878806be30 0x7f878806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:44.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.843+0000 7f87a659c640 1 --2- 172.21.15.77:0/303339449 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f878806be30 0x7f878806e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8798033000 tx=0x7f8798009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:44.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:44.847+0000 7f8796ffd640 1 -- 172.21.15.77:0/303339449 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f879c059b60 con 0x7f87a80c8200 2024-04-25T01:39:45.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.055+0000 7f87acf96640 1 -- 172.21.15.77:0/303339449 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f87a806cec0 con 0x7f87a80c8200 2024-04-25T01:39:45.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.056+0000 7f8796ffd640 1 -- 172.21.15.77:0/303339449 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f879c059460 con 0x7f87a80c8200 2024-04-25T01:39:45.039 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:45.039 INFO:teuthology.orchestra.run.smithi077.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T01:39:45.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.058+0000 7f87acf96640 1 -- 172.21.15.77:0/303339449 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f878806be30 msgr2=0x7f878806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:45.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.058+0000 7f87acf96640 1 --2- 172.21.15.77:0/303339449 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f878806be30 0x7f878806e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8798033000 tx=0x7f8798009000 comp rx=0 tx=0).stop 2024-04-25T01:39:45.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.058+0000 7f87acf96640 1 -- 172.21.15.77:0/303339449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87a80c8200 msgr2=0x7f87a81e8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:45.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.058+0000 7f87acf96640 1 --2- 172.21.15.77:0/303339449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87a80c8200 0x7f87a81e8c20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f879c00d620 tx=0x7f879c00dae0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.058+0000 7f87acf96640 1 -- 172.21.15.77:0/303339449 shutdown_connections 2024-04-25T01:39:45.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.058+0000 7f87acf96640 1 --2- 172.21.15.77:0/303339449 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f878806be30 0x7f878806e2f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.058+0000 7f87acf96640 1 --2- 172.21.15.77:0/303339449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87a80c8200 0x7f87a81e8c20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.058+0000 7f87acf96640 1 --2- 172.21.15.77:0/303339449 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87a8150090 0x7f87a81e9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.058+0000 7f87acf96640 1 --2- 172.21.15.77:0/303339449 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87a806c280 0x7f87a80c2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.058+0000 7f87acf96640 1 -- 172.21.15.77:0/303339449 >> 172.21.15.77:0/303339449 conn(0x7f87a80ad4d0 msgr2=0x7f87a8154b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:45.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.058+0000 7f87acf96640 1 -- 172.21.15.77:0/303339449 shutdown_connections 2024-04-25T01:39:45.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.058+0000 7f87acf96640 1 -- 172.21.15.77:0/303339449 wait complete. 2024-04-25T01:39:45.052 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T01:39:45.052 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T01:39:45.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.165+0000 7fd4729ce640 1 Processor -- start 2024-04-25T01:39:45.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.165+0000 7fd4729ce640 1 -- start start 2024-04-25T01:39:45.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.165+0000 7fd4729ce640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd46c150090 0x7fd46c156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:45.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.165+0000 7fd4729ce640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd46c0c8200 0x7fd46c0c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:45.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.165+0000 7fd4729ce640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd46c06c280 0x7fd46c0c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:45.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.165+0000 7fd4729ce640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd46c06b830 con 0x7fd46c0c8200 2024-04-25T01:39:45.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.165+0000 7fd4729ce640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fd46c0c9de0 con 0x7fd46c06c280 2024-04-25T01:39:45.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.165+0000 7fd4729ce640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd46c0c89c0 con 0x7fd46c150090 2024-04-25T01:39:45.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.165+0000 7fd46b7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd46c0c8200 0x7fd46c0c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:45.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.165+0000 7fd46b7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd46c0c8200 0x7fd46c0c98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47164/0 (socket says 172.21.15.77:47164) 2024-04-25T01:39:45.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.165+0000 7fd46b7fe640 1 -- 172.21.15.77:0/2031448164 learned_addr learned my addr 172.21.15.77:0/2031448164 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:45.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.166+0000 7fd46bfff640 1 --2- 172.21.15.77:0/2031448164 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd46c150090 0x7fd46c156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:45.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.166+0000 7fd470f6b640 1 --2- 172.21.15.77:0/2031448164 >> v2:172.21.15.121:3300/0 conn(0x7fd46c06c280 0x7fd46c0c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:45.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.166+0000 7fd46b7fe640 1 -- 172.21.15.77:0/2031448164 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd46c150090 msgr2=0x7fd46c156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:45.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.166+0000 7fd46b7fe640 1 --2- 172.21.15.77:0/2031448164 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd46c150090 0x7fd46c156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.166+0000 7fd46b7fe640 1 -- 172.21.15.77:0/2031448164 >> v2:172.21.15.121:3300/0 conn(0x7fd46c06c280 msgr2=0x7fd46c0c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:45.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.166+0000 7fd46b7fe640 1 --2- 172.21.15.77:0/2031448164 >> v2:172.21.15.121:3300/0 conn(0x7fd46c06c280 0x7fd46c0c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.166+0000 7fd46b7fe640 1 -- 172.21.15.77:0/2031448164 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd46c0c8ca0 con 0x7fd46c0c8200 2024-04-25T01:39:45.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.166+0000 7fd470f6b640 1 --2- 172.21.15.77:0/2031448164 >> v2:172.21.15.121:3300/0 conn(0x7fd46c06c280 0x7fd46c0c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:45.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.166+0000 7fd46b7fe640 1 --2- 172.21.15.77:0/2031448164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd46c0c8200 0x7fd46c0c98a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd46c06ce70 tx=0x7fd46002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a1da1fb9675d7d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:45.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.166+0000 7fd46affd640 1 -- 172.21.15.77:0/2031448164 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd460037070 con 0x7fd46c0c8200 2024-04-25T01:39:45.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.167+0000 7fd46affd640 1 -- 172.21.15.77:0/2031448164 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd460032440 con 0x7fd46c0c8200 2024-04-25T01:39:45.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.167+0000 7fd46affd640 1 -- 172.21.15.77:0/2031448164 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd460032810 con 0x7fd46c0c8200 2024-04-25T01:39:45.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.167+0000 7fd4729ce640 1 -- 172.21.15.77:0/2031448164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd46c0c8200 msgr2=0x7fd46c0c98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:45.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.167+0000 7fd4729ce640 1 --2- 172.21.15.77:0/2031448164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd46c0c8200 0x7fd46c0c98a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd46c06ce70 tx=0x7fd46002a1e0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.167+0000 7fd4729ce640 1 -- 172.21.15.77:0/2031448164 shutdown_connections 2024-04-25T01:39:45.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.167+0000 7fd4729ce640 1 --2- 172.21.15.77:0/2031448164 >> v2:172.21.15.121:3300/0 conn(0x7fd46c06c280 0x7fd46c0c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.167+0000 7fd4729ce640 1 --2- 172.21.15.77:0/2031448164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd46c0c8200 0x7fd46c0c98a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.167+0000 7fd4729ce640 1 --2- 172.21.15.77:0/2031448164 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd46c150090 0x7fd46c156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.167+0000 7fd4729ce640 1 -- 172.21.15.77:0/2031448164 >> 172.21.15.77:0/2031448164 conn(0x7fd46c0ad4d0 msgr2=0x7fd46c0ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:45.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.167+0000 7fd4729ce640 1 -- 172.21.15.77:0/2031448164 shutdown_connections 2024-04-25T01:39:45.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.167+0000 7fd4729ce640 1 -- 172.21.15.77:0/2031448164 wait complete. 2024-04-25T01:39:45.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.168+0000 7fd4729ce640 1 Processor -- start 2024-04-25T01:39:45.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.168+0000 7fd4729ce640 1 -- start start 2024-04-25T01:39:45.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.169+0000 7fd4729ce640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd46c06c280 0x7fd46c0c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:45.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.169+0000 7fd4729ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd46c0c8200 0x7fd46c1e8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:45.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.169+0000 7fd4729ce640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd46c150090 0x7fd46c1eeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:45.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.169+0000 7fd4729ce640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd46c0c8680 con 0x7fd46c0c8200 2024-04-25T01:39:45.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.169+0000 7fd4729ce640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd46c06bd60 con 0x7fd46c06c280 2024-04-25T01:39:45.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.169+0000 7fd4729ce640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd46c06c6b0 con 0x7fd46c150090 2024-04-25T01:39:45.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.169+0000 7fd46b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd46c0c8200 0x7fd46c1e8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:45.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.169+0000 7fd46b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd46c0c8200 0x7fd46c1e8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47178/0 (socket says 172.21.15.77:47178) 2024-04-25T01:39:45.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.169+0000 7fd46b7fe640 1 -- 172.21.15.77:0/2084171654 learned_addr learned my addr 172.21.15.77:0/2084171654 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:45.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.169+0000 7fd46bfff640 1 --2- 172.21.15.77:0/2084171654 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd46c06c280 0x7fd46c0c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:45.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.169+0000 7fd470f6b640 1 --2- 172.21.15.77:0/2084171654 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd46c150090 0x7fd46c1eeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:45.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.169+0000 7fd46b7fe640 1 -- 172.21.15.77:0/2084171654 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd46c150090 msgr2=0x7fd46c1eeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:45.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.169+0000 7fd46b7fe640 1 --2- 172.21.15.77:0/2084171654 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd46c150090 0x7fd46c1eeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.169+0000 7fd46b7fe640 1 -- 172.21.15.77:0/2084171654 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd46c06c280 msgr2=0x7fd46c0c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:45.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.169+0000 7fd46b7fe640 1 --2- 172.21.15.77:0/2084171654 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd46c06c280 0x7fd46c0c3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.169+0000 7fd46b7fe640 1 -- 172.21.15.77:0/2084171654 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd46c0c4130 con 0x7fd46c0c8200 2024-04-25T01:39:45.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.169+0000 7fd46b7fe640 1 --2- 172.21.15.77:0/2084171654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd46c0c8200 0x7fd46c1e8860 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd46002a220 tx=0x7fd4600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:45.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.170+0000 7fd468ff9640 1 -- 172.21.15.77:0/2084171654 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd460041020 con 0x7fd46c0c8200 2024-04-25T01:39:45.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.170+0000 7fd468ff9640 1 -- 172.21.15.77:0/2084171654 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4600306c0 con 0x7fd46c0c8200 2024-04-25T01:39:45.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.170+0000 7fd4729ce640 1 -- 172.21.15.77:0/2084171654 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd46c0c2c10 con 0x7fd46c0c8200 2024-04-25T01:39:45.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.170+0000 7fd468ff9640 1 -- 172.21.15.77:0/2084171654 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd460037040 con 0x7fd46c0c8200 2024-04-25T01:39:45.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.170+0000 7fd4729ce640 1 -- 172.21.15.77:0/2084171654 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd46c1587d0 con 0x7fd46c0c8200 2024-04-25T01:39:45.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.171+0000 7fd4729ce640 1 -- 172.21.15.77:0/2084171654 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd46c04f500 con 0x7fd46c0c8200 2024-04-25T01:39:45.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.171+0000 7fd468ff9640 1 -- 172.21.15.77:0/2084171654 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd460044020 con 0x7fd46c0c8200 2024-04-25T01:39:45.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.171+0000 7fd468ff9640 1 --2- 172.21.15.77:0/2084171654 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd45806be30 0x7fd45806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:45.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.171+0000 7fd468ff9640 1 -- 172.21.15.77:0/2084171654 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fd4600ab750 con 0x7fd46c0c8200 2024-04-25T01:39:45.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.171+0000 7fd46bfff640 1 --2- 172.21.15.77:0/2084171654 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd45806be30 0x7fd45806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:45.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.172+0000 7fd46bfff640 1 --2- 172.21.15.77:0/2084171654 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd45806be30 0x7fd45806e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd45c0079a0 tx=0x7fd45c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:45.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.176+0000 7fd468ff9640 1 -- 172.21.15.77:0/2084171654 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd46004b030 con 0x7fd46c0c8200 2024-04-25T01:39:45.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.351+0000 7fd4729ce640 1 -- 172.21.15.77:0/2084171654 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd46c06cec0 con 0x7fd46c0c8200 2024-04-25T01:39:45.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.353+0000 7fd468ff9640 1 -- 172.21.15.77:0/2084171654 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20331 (secure 0 0 0) 0x7fd46c0c4130 con 0x7fd46c0c8200 2024-04-25T01:39:45.336 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:45.336 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:39:34.425701+0000","last_up_change":"2024-04-25T01:39:10.729600+0000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T01:39:11.681151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T01:39:21.606752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T01:39:22.677664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T01:39:30.501700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T01:39:31.740717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6811","nonce":3366980158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6817","nonce":3366980158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6828","nonce":3366980158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6825","nonce":3366980158}]},"public_addr":"172.21.15.77:6811/3366980158","cluster_addr":"172.21.15.77:6817/3366980158","heartbeat_back_addr":"172.21.15.77:6828/3366980158","heartbeat_front_addr":"172.21.15.77:6825/3366980158","state":["exists","up"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6801","nonce":3971619298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6803","nonce":3971619298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6807","nonce":3971619298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6805","nonce":3971619298}]},"public_addr":"172.21.15.77:6801/3971619298","cluster_addr":"172.21.15.77:6803/3971619298","heartbeat_back_addr":"172.21.15.77:6807/3971619298","heartbeat_front_addr":"172.21.15.77:6805/3971619298","state":["exists","up"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6810","nonce":4103452689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6813","nonce":4103452689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6823","nonce":4103452689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6818","nonce":4103452689}]},"public_addr":"172.21.15.77:6810/4103452689","cluster_addr":"172.21.15.77:6813/4103452689","heartbeat_back_addr":"172.21.15.77:6823/4103452689","heartbeat_front_addr":"172.21.15.77:6818/4103452689","state":["exists","up"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6819","nonce":217398906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6824","nonce":217398906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6831","nonce":217398906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6829","nonce":217398906}]},"public_addr":"172.21.15.77:6819/217398906","cluster_addr":"172.21.15.77:6824/217398906","heartbeat_back_addr":"172.21.15.77:6831/217398906","heartbeat_front_addr":"172.21.15.77:6829/217398906","state":["exists","up"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6801","nonce":2565483070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6803","nonce":2565483070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6810","nonce":2565483070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6806","nonce":2565483070}]},"public_addr":"172.21.15.121:6801/2565483070","cluster_addr":"172.21.15.121:6803/2565483070","heartbeat_back_addr":"172.21.15.121:6810/2565483070","heartbeat_front_addr":"172.21.15.121:6806/2565483070","state":["exists","up"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6807","nonce":2785294752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6809","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6811","nonce":2785294752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6815","nonce":2785294752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6813","nonce":2785294752}]},"public_addr":"172.21.15.121:6807/2785294752","cluster_addr":"172.21.15.121:6811/2785294752","heartbeat_back_addr":"172.21.15.121:6815/2785294752","heartbeat_front_addr":"172.21.15.121:6813/2785294752","state":["exists","up"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6820","nonce":523906818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6824","nonce":523906818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6831","nonce":523906818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6828","nonce":523906818}]},"public_addr":"172.21.15.121:6820/523906818","cluster_addr":"172.21.15.121:6824/523906818","heartbeat_back_addr":"172.21.15.121:6831/523906818","heartbeat_front_addr":"172.21.15.121:6828/523906818","state":["exists","up"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6817","nonce":1683602459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6819","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6821","nonce":1683602459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6829","nonce":1683602459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6823","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6825","nonce":1683602459}]},"public_addr":"172.21.15.121:6817/1683602459","cluster_addr":"172.21.15.121:6821/1683602459","heartbeat_back_addr":"172.21.15.121:6829/1683602459","heartbeat_front_addr":"172.21.15.121:6825/1683602459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.839443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.818842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.776243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.793085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.822396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.907311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.918374+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.848430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:39:45.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.355+0000 7fd4729ce640 1 -- 172.21.15.77:0/2084171654 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd45806be30 msgr2=0x7fd45806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:45.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.355+0000 7fd4729ce640 1 --2- 172.21.15.77:0/2084171654 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd45806be30 0x7fd45806e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd45c0079a0 tx=0x7fd45c008040 comp rx=0 tx=0).stop 2024-04-25T01:39:45.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.355+0000 7fd4729ce640 1 -- 172.21.15.77:0/2084171654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd46c0c8200 msgr2=0x7fd46c1e8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:45.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.355+0000 7fd4729ce640 1 --2- 172.21.15.77:0/2084171654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd46c0c8200 0x7fd46c1e8860 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd46002a220 tx=0x7fd4600046c0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.355+0000 7fd4729ce640 1 -- 172.21.15.77:0/2084171654 shutdown_connections 2024-04-25T01:39:45.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.355+0000 7fd4729ce640 1 --2- 172.21.15.77:0/2084171654 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd45806be30 0x7fd45806e2f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.355+0000 7fd4729ce640 1 --2- 172.21.15.77:0/2084171654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd46c0c8200 0x7fd46c1e8860 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.355+0000 7fd4729ce640 1 --2- 172.21.15.77:0/2084171654 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd46c150090 0x7fd46c1eeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.355+0000 7fd4729ce640 1 --2- 172.21.15.77:0/2084171654 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd46c06c280 0x7fd46c0c3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.355+0000 7fd4729ce640 1 -- 172.21.15.77:0/2084171654 >> 172.21.15.77:0/2084171654 conn(0x7fd46c0ad4d0 msgr2=0x7fd46c0cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:45.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.355+0000 7fd4729ce640 1 -- 172.21.15.77:0/2084171654 shutdown_connections 2024-04-25T01:39:45.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.355+0000 7fd4729ce640 1 -- 172.21.15.77:0/2084171654 wait complete. 2024-04-25T01:39:45.349 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T01:39:11.681151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-25T01:39:21.606752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-25T01:39:22.677664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-25T01:39:30.501700+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-25T01:39:31.740717+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T01:39:45.350 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T01:39:45.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.467+0000 7f7d666f7640 1 Processor -- start 2024-04-25T01:39:45.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.467+0000 7f7d666f7640 1 -- start start 2024-04-25T01:39:45.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.468+0000 7f7d666f7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d60153820 0x7f7d600c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:45.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.468+0000 7f7d666f7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7d60072820 0x7f7d600c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:45.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.468+0000 7f7d666f7640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d60159f50 con 0x7f7d600c8780 2024-04-25T01:39:45.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.468+0000 7f7d666f7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f7d600c7870 con 0x7f7d60072820 2024-04-25T01:39:45.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.468+0000 7f7d666f7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f7d6015a4d0 con 0x7f7d60153820 2024-04-25T01:39:45.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.468+0000 7f7d5f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7d60072820 0x7f7d600c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:45.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.468+0000 7f7d5f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7d60072820 0x7f7d600c8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47184/0 (socket says 172.21.15.77:47184) 2024-04-25T01:39:45.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.468+0000 7f7d5f7fe640 1 -- 172.21.15.77:0/3388235016 learned_addr learned my addr 172.21.15.77:0/3388235016 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:45.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.468+0000 7f7d5ffff640 1 --2- 172.21.15.77:0/3388235016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d60153820 0x7f7d600c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:45.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.468+0000 7f7d5f7fe640 1 -- 172.21.15.77:0/3388235016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d60153820 msgr2=0x7f7d600c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:45.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.468+0000 7f7d5f7fe640 1 --2- 172.21.15.77:0/3388235016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d60153820 0x7f7d600c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.468+0000 7f7d5f7fe640 1 -- 172.21.15.77:0/3388235016 >> v1:172.21.15.121:6789/0 conn(0x7f7d600c8780 legacy=0x7f7d600c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:45.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.468+0000 7f7d5f7fe640 1 -- 172.21.15.77:0/3388235016 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d600732a0 con 0x7f7d60072820 2024-04-25T01:39:45.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.468+0000 7f7d5ffff640 1 --2- 172.21.15.77:0/3388235016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d60153820 0x7f7d600c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:45.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.469+0000 7f7d5f7fe640 1 --2- 172.21.15.77:0/3388235016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d60072820 0x7f7d600c8240 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009870 tx=0x7f7d5402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c1eaa31d1f73423 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:45.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.469+0000 7f7d5effd640 1 -- 172.21.15.77:0/3388235016 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d54037070 con 0x7f7d60072820 2024-04-25T01:39:45.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.469+0000 7f7d5effd640 1 -- 172.21.15.77:0/3388235016 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d5402ae10 con 0x7f7d60072820 2024-04-25T01:39:45.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.469+0000 7f7d5effd640 1 -- 172.21.15.77:0/3388235016 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d54032660 con 0x7f7d60072820 2024-04-25T01:39:45.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.469+0000 7f7d666f7640 1 -- 172.21.15.77:0/3388235016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d60072820 msgr2=0x7f7d600c8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:45.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.469+0000 7f7d666f7640 1 --2- 172.21.15.77:0/3388235016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d60072820 0x7f7d600c8240 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009870 tx=0x7f7d5402a100 comp rx=0 tx=0).stop 2024-04-25T01:39:45.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.469+0000 7f7d666f7640 1 -- 172.21.15.77:0/3388235016 shutdown_connections 2024-04-25T01:39:45.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.469+0000 7f7d666f7640 1 --2- 172.21.15.77:0/3388235016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d60072820 0x7f7d600c8240 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.469+0000 7f7d666f7640 1 --2- 172.21.15.77:0/3388235016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d60153820 0x7f7d600c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.469+0000 7f7d666f7640 1 -- 172.21.15.77:0/3388235016 >> 172.21.15.77:0/3388235016 conn(0x7f7d60067780 msgr2=0x7f7d600c97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:45.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.469+0000 7f7d666f7640 1 -- 172.21.15.77:0/3388235016 shutdown_connections 2024-04-25T01:39:45.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.469+0000 7f7d666f7640 1 -- 172.21.15.77:0/3388235016 wait complete. 2024-04-25T01:39:45.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.470+0000 7f7d666f7640 1 Processor -- start 2024-04-25T01:39:45.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.471+0000 7f7d666f7640 1 -- start start 2024-04-25T01:39:45.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.471+0000 7f7d666f7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d60072820 0x7f7d6014b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:45.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.471+0000 7f7d666f7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d600c8780 0x7f7d601e1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:45.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.471+0000 7f7d666f7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d60153820 0x7f7d60151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:45.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.471+0000 7f7d666f7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7d600c32f0 con 0x7f7d600c8780 2024-04-25T01:39:45.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.471+0000 7f7d666f7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7d60072f30 con 0x7f7d60153820 2024-04-25T01:39:45.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.471+0000 7f7d666f7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f7d600c3470 con 0x7f7d60072820 2024-04-25T01:39:45.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.471+0000 7f7d5f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d600c8780 0x7f7d601e1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:45.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.471+0000 7f7d5f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d600c8780 0x7f7d601e1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47188/0 (socket says 172.21.15.77:47188) 2024-04-25T01:39:45.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.471+0000 7f7d5f7fe640 1 -- 172.21.15.77:0/2828359158 learned_addr learned my addr 172.21.15.77:0/2828359158 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:45.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.472+0000 7f7d5ffff640 1 --2- 172.21.15.77:0/2828359158 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d60072820 0x7f7d6014b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:45.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.472+0000 7f7d64c94640 1 --2- 172.21.15.77:0/2828359158 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d60153820 0x7f7d60151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:45.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.472+0000 7f7d5f7fe640 1 -- 172.21.15.77:0/2828359158 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d60072820 msgr2=0x7f7d6014b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:45.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.472+0000 7f7d5f7fe640 1 --2- 172.21.15.77:0/2828359158 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d60072820 0x7f7d6014b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.472+0000 7f7d5f7fe640 1 -- 172.21.15.77:0/2828359158 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d60153820 msgr2=0x7f7d60151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:45.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.472+0000 7f7d5f7fe640 1 --2- 172.21.15.77:0/2828359158 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d60153820 0x7f7d60151b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.472+0000 7f7d5f7fe640 1 -- 172.21.15.77:0/2828359158 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d6014e730 con 0x7f7d600c8780 2024-04-25T01:39:45.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.472+0000 7f7d5f7fe640 1 --2- 172.21.15.77:0/2828359158 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d600c8780 0x7f7d601e1a40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7d54000c00 tx=0x7f7d540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:45.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.472+0000 7f7d5cff9640 1 -- 172.21.15.77:0/2828359158 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d54041070 con 0x7f7d600c8780 2024-04-25T01:39:45.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.472+0000 7f7d5cff9640 1 -- 172.21.15.77:0/2828359158 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d5403c670 con 0x7f7d600c8780 2024-04-25T01:39:45.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.472+0000 7f7d5cff9640 1 -- 172.21.15.77:0/2828359158 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d54037040 con 0x7f7d600c8780 2024-04-25T01:39:45.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.472+0000 7f7d666f7640 1 -- 172.21.15.77:0/2828359158 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d60150450 con 0x7f7d600c8780 2024-04-25T01:39:45.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.472+0000 7f7d666f7640 1 -- 172.21.15.77:0/2828359158 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d601e1f80 con 0x7f7d600c8780 2024-04-25T01:39:45.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.473+0000 7f7d666f7640 1 -- 172.21.15.77:0/2828359158 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d6004f500 con 0x7f7d600c8780 2024-04-25T01:39:45.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.473+0000 7f7d5cff9640 1 -- 172.21.15.77:0/2828359158 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d54044070 con 0x7f7d600c8780 2024-04-25T01:39:45.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.474+0000 7f7d5cff9640 1 --2- 172.21.15.77:0/2828359158 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7d4c06be30 0x7f7d4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:45.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.474+0000 7f7d5ffff640 1 --2- 172.21.15.77:0/2828359158 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7d4c06be30 0x7f7d4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:45.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.474+0000 7f7d5cff9640 1 -- 172.21.15.77:0/2828359158 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f7d540ab980 con 0x7f7d600c8780 2024-04-25T01:39:45.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.474+0000 7f7d5ffff640 1 --2- 172.21.15.77:0/2828359158 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7d4c06be30 0x7f7d4c06e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000a950 tx=0x7f7d50008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:45.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.478+0000 7f7d5cff9640 1 -- 172.21.15.77:0/2828359158 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7d5407a090 con 0x7f7d600c8780 2024-04-25T01:39:45.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.651+0000 7f7d666f7640 1 -- 172.21.15.77:0/2828359158 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7d60072600 con 0x7f7d600c8780 2024-04-25T01:39:45.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.651+0000 7f7d5cff9640 1 -- 172.21.15.77:0/2828359158 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f7d54079990 con 0x7f7d600c8780 2024-04-25T01:39:45.635 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-25T01:39:45.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.653+0000 7f7d666f7640 1 -- 172.21.15.77:0/2828359158 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7d4c06be30 msgr2=0x7f7d4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:45.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.653+0000 7f7d666f7640 1 --2- 172.21.15.77:0/2828359158 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7d4c06be30 0x7f7d4c06e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000a950 tx=0x7f7d50008040 comp rx=0 tx=0).stop 2024-04-25T01:39:45.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.653+0000 7f7d666f7640 1 -- 172.21.15.77:0/2828359158 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d600c8780 msgr2=0x7f7d601e1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:45.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.653+0000 7f7d666f7640 1 --2- 172.21.15.77:0/2828359158 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d600c8780 0x7f7d601e1a40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7d54000c00 tx=0x7f7d540046c0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.653+0000 7f7d666f7640 1 -- 172.21.15.77:0/2828359158 shutdown_connections 2024-04-25T01:39:45.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.653+0000 7f7d666f7640 1 --2- 172.21.15.77:0/2828359158 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7d4c06be30 0x7f7d4c06e2f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.653+0000 7f7d666f7640 1 --2- 172.21.15.77:0/2828359158 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d600c8780 0x7f7d601e1a40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.653+0000 7f7d666f7640 1 --2- 172.21.15.77:0/2828359158 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d60153820 0x7f7d60151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.653+0000 7f7d666f7640 1 --2- 172.21.15.77:0/2828359158 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7d60072820 0x7f7d6014b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.653+0000 7f7d666f7640 1 -- 172.21.15.77:0/2828359158 >> 172.21.15.77:0/2828359158 conn(0x7f7d60067780 msgr2=0x7f7d601e26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:45.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.654+0000 7f7d666f7640 1 -- 172.21.15.77:0/2828359158 shutdown_connections 2024-04-25T01:39:45.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.654+0000 7f7d666f7640 1 -- 172.21.15.77:0/2828359158 wait complete. 2024-04-25T01:39:45.648 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-25T01:39:45.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.765+0000 7fded6029640 1 Processor -- start 2024-04-25T01:39:45.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.765+0000 7fded6029640 1 -- start start 2024-04-25T01:39:45.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.766+0000 7fded6029640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fded0073450 0x7fded00c5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:45.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.766+0000 7fded6029640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fded00c4cb0 0x7fded00c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:45.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.766+0000 7fded6029640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fded00c7040 con 0x7fded00c4280 2024-04-25T01:39:45.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.766+0000 7fded6029640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fded00c1cd0 con 0x7fded00c4cb0 2024-04-25T01:39:45.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.766+0000 7fded6029640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fded00c5f00 con 0x7fded0073450 2024-04-25T01:39:45.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.766+0000 7fdecf7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fded00c4280 0x7fded01538f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41570/0 (socket says 172.21.15.77:41570) 2024-04-25T01:39:45.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.766+0000 7fdecf7fe640 1 -- 172.21.15.77:0/3062335945 learned_addr learned my addr 172.21.15.77:0/3062335945 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:45.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.766+0000 7fdecffff640 1 --2- 172.21.15.77:0/3062335945 >> v2:172.21.15.121:3300/0 conn(0x7fded00c4cb0 0x7fded00c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:45.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.766+0000 7fdeceffd640 1 --2- 172.21.15.77:0/3062335945 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fded0073450 0x7fded00c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:45.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.766+0000 7fdece7fc640 1 -- 172.21.15.77:0/3062335945 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3957777269 0 0) 0x7fded00c7040 con 0x7fded00c4280 2024-04-25T01:39:45.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.766+0000 7fdece7fc640 1 -- 172.21.15.77:0/3062335945 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdeb8003520 con 0x7fded00c4280 2024-04-25T01:39:45.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.766+0000 7fdece7fc640 1 -- 172.21.15.77:0/3062335945 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1325123011 0 0) 0x7fdeb8003520 con 0x7fded00c4280 2024-04-25T01:39:45.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.766+0000 7fdece7fc640 1 -- 172.21.15.77:0/3062335945 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fded0073450 msgr2=0x7fded00c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:45.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.766+0000 7fdece7fc640 1 --2- 172.21.15.77:0/3062335945 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fded0073450 0x7fded00c5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.766+0000 7fdece7fc640 1 -- 172.21.15.77:0/3062335945 >> v2:172.21.15.121:3300/0 conn(0x7fded00c4cb0 msgr2=0x7fded00c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:45.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.766+0000 7fdece7fc640 1 --2- 172.21.15.77:0/3062335945 >> v2:172.21.15.121:3300/0 conn(0x7fded00c4cb0 0x7fded00c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.766+0000 7fdece7fc640 1 -- 172.21.15.77:0/3062335945 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded00ac010 con 0x7fded00c4280 2024-04-25T01:39:45.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.766+0000 7fdece7fc640 1 -- 172.21.15.77:0/3062335945 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7fdec0001670 con 0x7fded00c4280 2024-04-25T01:39:45.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.766+0000 7fdece7fc640 1 -- 172.21.15.77:0/3062335945 >> v1:172.21.15.77:6789/0 conn(0x7fded00c4280 legacy=0x7fded01538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:45.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.766+0000 7fdece7fc640 1 --2- 172.21.15.77:0/3062335945 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdeb80039b0 0x7fdeb8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:45.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.766+0000 7fdece7fc640 1 --2- 172.21.15.77:0/3062335945 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fded0073450 0x7fdeb8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:45.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.766+0000 7fdece7fc640 1 --2- 172.21.15.77:0/3062335945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeb8004d40 0x7fdeb80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:45.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.766+0000 7fdece7fc640 1 -- 172.21.15.77:0/3062335945 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fded00c1cd0 con 0x7fdeb80039b0 2024-04-25T01:39:45.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.766+0000 7fdece7fc640 1 -- 172.21.15.77:0/3062335945 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fded00c5f00 con 0x7fdeb8004d40 2024-04-25T01:39:45.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.766+0000 7fdece7fc640 1 -- 172.21.15.77:0/3062335945 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fdeb800b9c0 con 0x7fded0073450 2024-04-25T01:39:45.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.766+0000 7fdecf7fe640 1 --2- 172.21.15.77:0/3062335945 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdeb80039b0 0x7fdeb8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:45.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.766+0000 7fdeceffd640 1 --2- 172.21.15.77:0/3062335945 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fded0073450 0x7fdeb8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:45.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.766+0000 7fdecffff640 1 --2- 172.21.15.77:0/3062335945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeb8004d40 0x7fdeb80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:45.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.767+0000 7fdecf7fe640 1 -- 172.21.15.77:0/3062335945 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fded0073450 msgr2=0x7fdeb8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:45.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.767+0000 7fdecf7fe640 1 --2- 172.21.15.77:0/3062335945 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fded0073450 0x7fdeb8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.767+0000 7fdecf7fe640 1 -- 172.21.15.77:0/3062335945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeb8004d40 msgr2=0x7fdeb80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:45.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.767+0000 7fdecf7fe640 1 --2- 172.21.15.77:0/3062335945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeb8004d40 0x7fdeb80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.767+0000 7fdecf7fe640 1 -- 172.21.15.77:0/3062335945 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb8003520 con 0x7fdeb80039b0 2024-04-25T01:39:45.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.767+0000 7fdecffff640 1 --2- 172.21.15.77:0/3062335945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeb8004d40 0x7fdeb80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:45.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.767+0000 7fdecf7fe640 1 --2- 172.21.15.77:0/3062335945 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdeb80039b0 0x7fdeb8003dd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdec000c210 tx=0x7fdeb8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe5f70465e42af4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:45.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.767+0000 7fdece7fc640 1 -- 172.21.15.77:0/3062335945 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec0007d50 con 0x7fdeb80039b0 2024-04-25T01:39:45.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.767+0000 7fdece7fc640 1 -- 172.21.15.77:0/3062335945 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec0005af0 con 0x7fdeb80039b0 2024-04-25T01:39:45.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.767+0000 7fdece7fc640 1 -- 172.21.15.77:0/3062335945 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec0007070 con 0x7fdeb80039b0 2024-04-25T01:39:45.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.768+0000 7fded6029640 1 -- 172.21.15.77:0/3062335945 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdeb80039b0 msgr2=0x7fdeb8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:45.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.768+0000 7fded6029640 1 --2- 172.21.15.77:0/3062335945 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdeb80039b0 0x7fdeb8003dd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdec000c210 tx=0x7fdeb8005830 comp rx=0 tx=0).stop 2024-04-25T01:39:45.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.768+0000 7fdecffff640 1 -- 172.21.15.77:0/3062335945 reap_dead start 2024-04-25T01:39:45.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.768+0000 7fded6029640 1 -- 172.21.15.77:0/3062335945 shutdown_connections 2024-04-25T01:39:45.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.768+0000 7fded6029640 1 -- 172.21.15.77:0/3062335945 >> 172.21.15.77:0/3062335945 conn(0x7fded00c7580 msgr2=0x7fded00c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:45.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.768+0000 7fded6029640 1 -- 172.21.15.77:0/3062335945 shutdown_connections 2024-04-25T01:39:45.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.768+0000 7fded6029640 1 -- 172.21.15.77:0/3062335945 wait complete. 2024-04-25T01:39:45.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.769+0000 7fded6029640 1 Processor -- start 2024-04-25T01:39:45.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.769+0000 7fded6029640 1 -- start start 2024-04-25T01:39:45.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.770+0000 7fded6029640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdeb80039b0 0x7fded00a7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:45.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.770+0000 7fded6029640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fded014c2f0 0x7fded01dfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:45.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.770+0000 7fded6029640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fded01ec870 0x7fded014b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:45.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.770+0000 7fded6029640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fded00c1910 con 0x7fdeb80039b0 2024-04-25T01:39:45.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.770+0000 7fded6029640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fded00ac810 con 0x7fded014c2f0 2024-04-25T01:39:45.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.770+0000 7fded6029640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fded00c1a90 con 0x7fded01ec870 2024-04-25T01:39:45.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.770+0000 7fdecf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdeb80039b0 0x7fded00a7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:45.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.770+0000 7fdecf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdeb80039b0 0x7fded00a7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47200/0 (socket says 172.21.15.77:47200) 2024-04-25T01:39:45.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.770+0000 7fdecf7fe640 1 -- 172.21.15.77:0/2963742432 learned_addr learned my addr 172.21.15.77:0/2963742432 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:45.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.770+0000 7fdeceffd640 1 --2- 172.21.15.77:0/2963742432 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fded014c2f0 0x7fded01dfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:45.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.770+0000 7fdecffff640 1 --2- 172.21.15.77:0/2963742432 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fded01ec870 0x7fded014b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:45.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.770+0000 7fdecf7fe640 1 -- 172.21.15.77:0/2963742432 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fded01ec870 msgr2=0x7fded014b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:45.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.770+0000 7fdecf7fe640 1 --2- 172.21.15.77:0/2963742432 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fded01ec870 0x7fded014b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.770+0000 7fdecf7fe640 1 -- 172.21.15.77:0/2963742432 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fded014c2f0 msgr2=0x7fded01dfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:45.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.770+0000 7fdecf7fe640 1 --2- 172.21.15.77:0/2963742432 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fded014c2f0 0x7fded01dfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.770+0000 7fdecf7fe640 1 -- 172.21.15.77:0/2963742432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded00a7c60 con 0x7fdeb80039b0 2024-04-25T01:39:45.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.770+0000 7fdeceffd640 1 --2- 172.21.15.77:0/2963742432 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fded014c2f0 0x7fded01dfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:45.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.770+0000 7fdecffff640 1 --2- 172.21.15.77:0/2963742432 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fded01ec870 0x7fded014b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:45.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.770+0000 7fdecf7fe640 1 --2- 172.21.15.77:0/2963742432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdeb80039b0 0x7fded00a7720 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdec0034040 tx=0x7fdec0001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:45.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.770+0000 7fdeb7fff640 1 -- 172.21.15.77:0/2963742432 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec0042070 con 0x7fdeb80039b0 2024-04-25T01:39:45.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.771+0000 7fdeb7fff640 1 -- 172.21.15.77:0/2963742432 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec0007480 con 0x7fdeb80039b0 2024-04-25T01:39:45.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.771+0000 7fdeb7fff640 1 -- 172.21.15.77:0/2963742432 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec0001c90 con 0x7fdeb80039b0 2024-04-25T01:39:45.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.771+0000 7fded6029640 1 -- 172.21.15.77:0/2963742432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fded014c8d0 con 0x7fdeb80039b0 2024-04-25T01:39:45.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.771+0000 7fded6029640 1 -- 172.21.15.77:0/2963742432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fded00a90b0 con 0x7fdeb80039b0 2024-04-25T01:39:45.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.772+0000 7fded6029640 1 -- 172.21.15.77:0/2963742432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fded006c1d0 con 0x7fdeb80039b0 2024-04-25T01:39:45.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.772+0000 7fdeb7fff640 1 -- 172.21.15.77:0/2963742432 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdec0045070 con 0x7fdeb80039b0 2024-04-25T01:39:45.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.772+0000 7fdeb7fff640 1 --2- 172.21.15.77:0/2963742432 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fdebc06be60 0x7fdebc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:45.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.772+0000 7fdeceffd640 1 --2- 172.21.15.77:0/2963742432 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fdebc06be60 0x7fdebc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:45.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.773+0000 7fdeb7fff640 1 -- 172.21.15.77:0/2963742432 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fdec00abcf0 con 0x7fdeb80039b0 2024-04-25T01:39:45.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.773+0000 7fdeceffd640 1 --2- 172.21.15.77:0/2963742432 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fdebc06be60 0x7fdebc06e320 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fded0154ce0 tx=0x7fdec4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:45.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.777+0000 7fdeb7fff640 1 -- 172.21.15.77:0/2963742432 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fded006c1d0 con 0x7fdeb80039b0 2024-04-25T01:39:45.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.949+0000 7fded6029640 1 -- 172.21.15.77:0/2963742432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7fded004f500 con 0x7fdeb80039b0 2024-04-25T01:39:45.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.949+0000 7fdeb7fff640 1 -- 172.21.15.77:0/2963742432 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v24) ==== 99+0+11 (secure 0 0 0) 0x7fdec00b0070 con 0x7fdeb80039b0 2024-04-25T01:39:45.933 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T01:39:45.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.951+0000 7fded6029640 1 -- 172.21.15.77:0/2963742432 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fdebc06be60 msgr2=0x7fdebc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:45.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.951+0000 7fded6029640 1 --2- 172.21.15.77:0/2963742432 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fdebc06be60 0x7fdebc06e320 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fded0154ce0 tx=0x7fdec4008040 comp rx=0 tx=0).stop 2024-04-25T01:39:45.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.951+0000 7fded6029640 1 -- 172.21.15.77:0/2963742432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdeb80039b0 msgr2=0x7fded00a7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:45.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.951+0000 7fded6029640 1 --2- 172.21.15.77:0/2963742432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdeb80039b0 0x7fded00a7720 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdec0034040 tx=0x7fdec0001a40 comp rx=0 tx=0).stop 2024-04-25T01:39:45.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.951+0000 7fded6029640 1 -- 172.21.15.77:0/2963742432 shutdown_connections 2024-04-25T01:39:45.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.951+0000 7fded6029640 1 --2- 172.21.15.77:0/2963742432 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fdebc06be60 0x7fdebc06e320 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.951+0000 7fded6029640 1 --2- 172.21.15.77:0/2963742432 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fded01ec870 0x7fded014b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.951+0000 7fded6029640 1 --2- 172.21.15.77:0/2963742432 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fded014c2f0 0x7fded01dfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.951+0000 7fded6029640 1 --2- 172.21.15.77:0/2963742432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdeb80039b0 0x7fded00a7720 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:45.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.951+0000 7fded6029640 1 -- 172.21.15.77:0/2963742432 >> 172.21.15.77:0/2963742432 conn(0x7fded00c7580 msgr2=0x7fded00c54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:45.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.951+0000 7fded6029640 1 -- 172.21.15.77:0/2963742432 shutdown_connections 2024-04-25T01:39:45.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:45.951+0000 7fded6029640 1 -- 172.21.15.77:0/2963742432 wait complete. 2024-04-25T01:39:45.945 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-25T01:39:46.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.061+0000 7f9640631640 1 Processor -- start 2024-04-25T01:39:46.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.062+0000 7f9640631640 1 -- start start 2024-04-25T01:39:46.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.062+0000 7f9640631640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f96380c4cb0 0x7f963815e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:46.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.062+0000 7f9640631640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96380c7040 con 0x7f9638073450 2024-04-25T01:39:46.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.062+0000 7f9640631640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96380ac010 con 0x7f96380c4280 2024-04-25T01:39:46.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.062+0000 7f9640631640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f96380c1cd0 con 0x7f96380c4cb0 2024-04-25T01:39:46.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.063+0000 7f963dbcc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9638073450 0x7f96380c5480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41578/0 (socket says 172.21.15.77:41578) 2024-04-25T01:39:46.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.063+0000 7f963dbcc640 1 -- 172.21.15.77:0/2781198057 learned_addr learned my addr 172.21.15.77:0/2781198057 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:46.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.063+0000 7f963ebce640 1 --2- 172.21.15.77:0/2781198057 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f96380c4cb0 0x7f963815e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:46.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.063+0000 7f963d3cb640 1 -- 172.21.15.77:0/2781198057 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4272661432 0 0) 0x7f96380c7040 con 0x7f9638073450 2024-04-25T01:39:46.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.063+0000 7f963d3cb640 1 -- 172.21.15.77:0/2781198057 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9624003520 con 0x7f9638073450 2024-04-25T01:39:46.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.063+0000 7f963d3cb640 1 -- 172.21.15.77:0/2781198057 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2641741216 0 0) 0x7f96380ac010 con 0x7f96380c4280 2024-04-25T01:39:46.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.063+0000 7f963d3cb640 1 -- 172.21.15.77:0/2781198057 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96380c7040 con 0x7f96380c4280 2024-04-25T01:39:46.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.063+0000 7f963d3cb640 1 -- 172.21.15.77:0/2781198057 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1689340735 0 0) 0x7f9624003520 con 0x7f9638073450 2024-04-25T01:39:46.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.063+0000 7f963d3cb640 1 -- 172.21.15.77:0/2781198057 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f96380c4cb0 msgr2=0x7f963815e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:46.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.063+0000 7f963d3cb640 1 --2- 172.21.15.77:0/2781198057 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f96380c4cb0 0x7f963815e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.063+0000 7f963d3cb640 1 -- 172.21.15.77:0/2781198057 >> v1:172.21.15.121:6789/0 conn(0x7f96380c4280 legacy=0x7f96381538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:46.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.063+0000 7f963d3cb640 1 -- 172.21.15.77:0/2781198057 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96380ac2f0 con 0x7f9638073450 2024-04-25T01:39:46.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.063+0000 7f963d3cb640 1 -- 172.21.15.77:0/2781198057 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7f9628001690 con 0x7f9638073450 2024-04-25T01:39:46.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.063+0000 7f963ebce640 1 --2- 172.21.15.77:0/2781198057 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f96380c4cb0 0x7f963815e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:46.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.063+0000 7f963d3cb640 1 -- 172.21.15.77:0/2781198057 >> v1:172.21.15.77:6789/0 conn(0x7f9638073450 legacy=0x7f96380c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:46.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.063+0000 7f963d3cb640 1 --2- 172.21.15.77:0/2781198057 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9624003b70 0x7f9624003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:46.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.063+0000 7f963d3cb640 1 --2- 172.21.15.77:0/2781198057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9624004800 0x7f9624004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:46.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.063+0000 7f963d3cb640 1 --2- 172.21.15.77:0/2781198057 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f96380c4cb0 0x7f96240051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:46.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.063+0000 7f963d3cb640 1 -- 172.21.15.77:0/2781198057 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f96380c1cd0 con 0x7f9624004800 2024-04-25T01:39:46.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.063+0000 7f963d3cb640 1 -- 172.21.15.77:0/2781198057 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f962400bad0 con 0x7f9624003b70 2024-04-25T01:39:46.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.063+0000 7f963d3cb640 1 -- 172.21.15.77:0/2781198057 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f962400bcd0 con 0x7f96380c4cb0 2024-04-25T01:39:46.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.063+0000 7f963dbcc640 1 --2- 172.21.15.77:0/2781198057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9624004800 0x7f9624004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:46.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.063+0000 7f963e3cd640 1 --2- 172.21.15.77:0/2781198057 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9624003b70 0x7f9624003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:46.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.063+0000 7f963ebce640 1 --2- 172.21.15.77:0/2781198057 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f96380c4cb0 0x7f96240051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:46.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.063+0000 7f963dbcc640 1 -- 172.21.15.77:0/2781198057 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f96380c4cb0 msgr2=0x7f96240051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:46.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.064+0000 7f963dbcc640 1 --2- 172.21.15.77:0/2781198057 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f96380c4cb0 0x7f96240051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.064+0000 7f963dbcc640 1 -- 172.21.15.77:0/2781198057 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9624003b70 msgr2=0x7f9624003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:46.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.064+0000 7f963dbcc640 1 --2- 172.21.15.77:0/2781198057 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9624003b70 0x7f9624003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.064+0000 7f963dbcc640 1 -- 172.21.15.77:0/2781198057 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9624003520 con 0x7f9624004800 2024-04-25T01:39:46.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.064+0000 7f963dbcc640 1 --2- 172.21.15.77:0/2781198057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9624004800 0x7f9624004c80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9628007f90 tx=0x7f9624005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c019c716385723e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:46.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.064+0000 7f963d3cb640 1 -- 172.21.15.77:0/2781198057 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9628007be0 con 0x7f9624004800 2024-04-25T01:39:46.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.064+0000 7f963d3cb640 1 -- 172.21.15.77:0/2781198057 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9628005ad0 con 0x7f9624004800 2024-04-25T01:39:46.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.064+0000 7f963d3cb640 1 -- 172.21.15.77:0/2781198057 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9628007070 con 0x7f9624004800 2024-04-25T01:39:46.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.065+0000 7f9640631640 1 -- 172.21.15.77:0/2781198057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9624004800 msgr2=0x7f9624004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:46.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.065+0000 7f9640631640 1 --2- 172.21.15.77:0/2781198057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9624004800 0x7f9624004c80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9628007f90 tx=0x7f9624005830 comp rx=0 tx=0).stop 2024-04-25T01:39:46.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.065+0000 7f963ebce640 1 -- 172.21.15.77:0/2781198057 reap_dead start 2024-04-25T01:39:46.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.065+0000 7f9640631640 1 -- 172.21.15.77:0/2781198057 shutdown_connections 2024-04-25T01:39:46.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.065+0000 7f9640631640 1 -- 172.21.15.77:0/2781198057 >> 172.21.15.77:0/2781198057 conn(0x7f96380c7580 msgr2=0x7f96380c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:46.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.065+0000 7f9640631640 1 -- 172.21.15.77:0/2781198057 shutdown_connections 2024-04-25T01:39:46.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.065+0000 7f9640631640 1 -- 172.21.15.77:0/2781198057 wait complete. 2024-04-25T01:39:46.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.066+0000 7f9640631640 1 Processor -- start 2024-04-25T01:39:46.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.066+0000 7f9640631640 1 -- start start 2024-04-25T01:39:46.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.067+0000 7f9640631640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9624004800 0x7f96380c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:46.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.067+0000 7f9640631640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9638148ec0 0x7f96381626b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:46.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.067+0000 7f9640631640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9638162bf0 0x7f9638160de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:46.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.067+0000 7f9640631640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f96380c1a90 con 0x7f9638162bf0 2024-04-25T01:39:46.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.067+0000 7f9640631640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f96380c1910 con 0x7f9638148ec0 2024-04-25T01:39:46.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.067+0000 7f9640631640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9638154000 con 0x7f9624004800 2024-04-25T01:39:46.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.067+0000 7f963ebce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9638162bf0 0x7f9638160de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:46.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.067+0000 7f963ebce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9638162bf0 0x7f9638160de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47204/0 (socket says 172.21.15.77:47204) 2024-04-25T01:39:46.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.067+0000 7f963ebce640 1 -- 172.21.15.77:0/2850525390 learned_addr learned my addr 172.21.15.77:0/2850525390 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:46.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.067+0000 7f963e3cd640 1 --2- 172.21.15.77:0/2850525390 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9624004800 0x7f96380c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:46.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.067+0000 7f963dbcc640 1 --2- 172.21.15.77:0/2850525390 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9638148ec0 0x7f96381626b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:46.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.067+0000 7f963ebce640 1 -- 172.21.15.77:0/2850525390 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9624004800 msgr2=0x7f96380c0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:46.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.067+0000 7f963ebce640 1 --2- 172.21.15.77:0/2850525390 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9624004800 0x7f96380c0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.067+0000 7f963ebce640 1 -- 172.21.15.77:0/2850525390 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9638148ec0 msgr2=0x7f96381626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:46.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.067+0000 7f963ebce640 1 --2- 172.21.15.77:0/2850525390 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9638148ec0 0x7f96381626b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.067+0000 7f963ebce640 1 -- 172.21.15.77:0/2850525390 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9638162340 con 0x7f9638162bf0 2024-04-25T01:39:46.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.067+0000 7f963ebce640 1 --2- 172.21.15.77:0/2850525390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9638162bf0 0x7f9638160de0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f963806e8c0 tx=0x7f9630011b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:46.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.067+0000 7f962effd640 1 -- 172.21.15.77:0/2850525390 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9630019070 con 0x7f9638162bf0 2024-04-25T01:39:46.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.067+0000 7f962effd640 1 -- 172.21.15.77:0/2850525390 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9630004020 con 0x7f9638162bf0 2024-04-25T01:39:46.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.067+0000 7f962effd640 1 -- 172.21.15.77:0/2850525390 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9630004410 con 0x7f9638162bf0 2024-04-25T01:39:46.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.067+0000 7f9640631640 1 -- 172.21.15.77:0/2850525390 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96381620a0 con 0x7f9638162bf0 2024-04-25T01:39:46.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.067+0000 7f9640631640 1 -- 172.21.15.77:0/2850525390 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96381464a0 con 0x7f9638162bf0 2024-04-25T01:39:46.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.069+0000 7f9640631640 1 -- 172.21.15.77:0/2850525390 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f963804f500 con 0x7f9638162bf0 2024-04-25T01:39:46.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.069+0000 7f962effd640 1 -- 172.21.15.77:0/2850525390 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9630012040 con 0x7f9638162bf0 2024-04-25T01:39:46.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.069+0000 7f962effd640 1 --2- 172.21.15.77:0/2850525390 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f961c06be30 0x7f961c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:46.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.069+0000 7f962effd640 1 -- 172.21.15.77:0/2850525390 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f963008ad70 con 0x7f9638162bf0 2024-04-25T01:39:46.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.069+0000 7f963e3cd640 1 --2- 172.21.15.77:0/2850525390 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f961c06be30 0x7f961c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:46.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.070+0000 7f963e3cd640 1 --2- 172.21.15.77:0/2850525390 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f961c06be30 0x7f961c06e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9634000f80 tx=0x7f9634009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:46.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.074+0000 7f962effd640 1 -- 172.21.15.77:0/2850525390 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9630059480 con 0x7f9638162bf0 2024-04-25T01:39:46.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.246+0000 7f9640631640 1 -- 172.21.15.77:0/2850525390 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7f96380c6bf0 con 0x7f9638162bf0 2024-04-25T01:39:46.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.246+0000 7f962effd640 1 -- 172.21.15.77:0/2850525390 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v24) ==== 95+0+11 (secure 0 0 0) 0x7f9630058d80 con 0x7f9638162bf0 2024-04-25T01:39:46.230 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-25T01:39:46.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.248+0000 7f9640631640 1 -- 172.21.15.77:0/2850525390 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f961c06be30 msgr2=0x7f961c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:46.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.248+0000 7f9640631640 1 --2- 172.21.15.77:0/2850525390 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f961c06be30 0x7f961c06e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9634000f80 tx=0x7f9634009040 comp rx=0 tx=0).stop 2024-04-25T01:39:46.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.248+0000 7f9640631640 1 -- 172.21.15.77:0/2850525390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9638162bf0 msgr2=0x7f9638160de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:46.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.248+0000 7f9640631640 1 --2- 172.21.15.77:0/2850525390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9638162bf0 0x7f9638160de0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f963806e8c0 tx=0x7f9630011b80 comp rx=0 tx=0).stop 2024-04-25T01:39:46.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.248+0000 7f9640631640 1 -- 172.21.15.77:0/2850525390 shutdown_connections 2024-04-25T01:39:46.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.248+0000 7f9640631640 1 --2- 172.21.15.77:0/2850525390 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f961c06be30 0x7f961c06e2f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.248+0000 7f9640631640 1 --2- 172.21.15.77:0/2850525390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9638162bf0 0x7f9638160de0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.248+0000 7f9640631640 1 --2- 172.21.15.77:0/2850525390 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9638148ec0 0x7f96381626b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.248+0000 7f9640631640 1 --2- 172.21.15.77:0/2850525390 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9624004800 0x7f96380c0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.248+0000 7f9640631640 1 -- 172.21.15.77:0/2850525390 >> 172.21.15.77:0/2850525390 conn(0x7f96380c7580 msgr2=0x7f96381456c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:46.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.248+0000 7f9640631640 1 -- 172.21.15.77:0/2850525390 shutdown_connections 2024-04-25T01:39:46.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.248+0000 7f9640631640 1 -- 172.21.15.77:0/2850525390 wait complete. 2024-04-25T01:39:46.242 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-25T01:39:46.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.358+0000 7f7bd66a3640 1 Processor -- start 2024-04-25T01:39:46.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.358+0000 7f7bd66a3640 1 -- start start 2024-04-25T01:39:46.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.358+0000 7f7bd66a3640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7bd00c4280 0x7f7bd01538f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:46.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.358+0000 7f7bd66a3640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7bd00c4cb0 0x7f7bd0153e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:46.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.358+0000 7f7bd66a3640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bd00c7040 con 0x7f7bd0073450 2024-04-25T01:39:46.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.358+0000 7f7bd66a3640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f7bd00c1cd0 con 0x7f7bd00c4280 2024-04-25T01:39:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.358+0000 7f7bd66a3640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f7bd00ac010 con 0x7f7bd00c4cb0 2024-04-25T01:39:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.358+0000 7f7bcffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7bd00c4280 0x7f7bd01538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.358+0000 7f7bcffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7bd00c4280 0x7f7bd01538f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47220/0 (socket says 172.21.15.77:47220) 2024-04-25T01:39:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.358+0000 7f7bcf7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7bd0073450 0x7f7bd00c5480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41588/0 (socket says 172.21.15.77:41588) 2024-04-25T01:39:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.358+0000 7f7bcffff640 1 -- 172.21.15.77:0/1131972625 learned_addr learned my addr 172.21.15.77:0/1131972625 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.359+0000 7f7bd4c40640 1 --2- 172.21.15.77:0/1131972625 >> v2:172.21.15.121:3300/0 conn(0x7f7bd00c4cb0 0x7f7bd0153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.359+0000 7f7bcffff640 1 -- 172.21.15.77:0/1131972625 >> v2:172.21.15.121:3300/0 conn(0x7f7bd00c4cb0 msgr2=0x7f7bd0153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.359+0000 7f7bcffff640 1 --2- 172.21.15.77:0/1131972625 >> v2:172.21.15.121:3300/0 conn(0x7f7bd00c4cb0 0x7f7bd0153e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.359+0000 7f7bcffff640 1 -- 172.21.15.77:0/1131972625 >> v1:172.21.15.77:6789/0 conn(0x7f7bd0073450 legacy=0x7f7bd00c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.359+0000 7f7bcffff640 1 -- 172.21.15.77:0/1131972625 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd00ac2f0 con 0x7f7bd00c4280 2024-04-25T01:39:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.359+0000 7f7bceffd640 1 -- 172.21.15.77:0/1131972625 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1484572344 0 0) 0x7f7bd00c7040 con 0x7f7bd0073450 2024-04-25T01:39:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.359+0000 7f7bcffff640 1 --2- 172.21.15.77:0/1131972625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd00c4280 0x7f7bd01538f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7bd00c1890 tx=0x7f7bc002c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4399262068c8b12f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.360+0000 7f7bceffd640 1 -- 172.21.15.77:0/1131972625 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0036020 con 0x7f7bd00c4280 2024-04-25T01:39:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.360+0000 7f7bceffd640 1 -- 172.21.15.77:0/1131972625 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc0032640 con 0x7f7bd00c4280 2024-04-25T01:39:46.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.360+0000 7f7bceffd640 1 -- 172.21.15.77:0/1131972625 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0032a10 con 0x7f7bd00c4280 2024-04-25T01:39:46.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.360+0000 7f7bd66a3640 1 -- 172.21.15.77:0/1131972625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd00c4280 msgr2=0x7f7bd01538f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:46.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.360+0000 7f7bd66a3640 1 --2- 172.21.15.77:0/1131972625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd00c4280 0x7f7bd01538f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7bd00c1890 tx=0x7f7bc002c940 comp rx=0 tx=0).stop 2024-04-25T01:39:46.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.360+0000 7f7bd66a3640 1 -- 172.21.15.77:0/1131972625 shutdown_connections 2024-04-25T01:39:46.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.360+0000 7f7bd66a3640 1 --2- 172.21.15.77:0/1131972625 >> v2:172.21.15.121:3300/0 conn(0x7f7bd00c4cb0 0x7f7bd0153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.360+0000 7f7bd66a3640 1 --2- 172.21.15.77:0/1131972625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd00c4280 0x7f7bd01538f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.360+0000 7f7bd66a3640 1 -- 172.21.15.77:0/1131972625 >> 172.21.15.77:0/1131972625 conn(0x7f7bd00c7580 msgr2=0x7f7bd00c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:46.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.360+0000 7f7bd66a3640 1 -- 172.21.15.77:0/1131972625 shutdown_connections 2024-04-25T01:39:46.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.360+0000 7f7bd66a3640 1 -- 172.21.15.77:0/1131972625 wait complete. 2024-04-25T01:39:46.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.361+0000 7f7bd66a3640 1 Processor -- start 2024-04-25T01:39:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.361+0000 7f7bd66a3640 1 -- start start 2024-04-25T01:39:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.362+0000 7f7bd66a3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7bd0073450 0x7f7bd01eadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.362+0000 7f7bd66a3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd00c4280 0x7f7bd0149300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.362+0000 7f7bd66a3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7bd00c4cb0 0x7f7bd0149840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.362+0000 7f7bd66a3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd00c1a90 con 0x7f7bd00c4280 2024-04-25T01:39:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.362+0000 7f7bd66a3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd00c1910 con 0x7f7bd0073450 2024-04-25T01:39:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.362+0000 7f7bd66a3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f7bd00c4660 con 0x7f7bd00c4cb0 2024-04-25T01:39:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.362+0000 7f7bcf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd00c4280 0x7f7bd0149300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.362+0000 7f7bcf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd00c4280 0x7f7bd0149300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47234/0 (socket says 172.21.15.77:47234) 2024-04-25T01:39:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.362+0000 7f7bcf7fe640 1 -- 172.21.15.77:0/3639990577 learned_addr learned my addr 172.21.15.77:0/3639990577 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.362+0000 7f7bcffff640 1 --2- 172.21.15.77:0/3639990577 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7bd0073450 0x7f7bd01eadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.362+0000 7f7bd4c40640 1 --2- 172.21.15.77:0/3639990577 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7bd00c4cb0 0x7f7bd0149840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.362+0000 7f7bcf7fe640 1 -- 172.21.15.77:0/3639990577 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7bd00c4cb0 msgr2=0x7f7bd0149840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:46.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.362+0000 7f7bcf7fe640 1 --2- 172.21.15.77:0/3639990577 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7bd00c4cb0 0x7f7bd0149840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.362+0000 7f7bcf7fe640 1 -- 172.21.15.77:0/3639990577 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7bd0073450 msgr2=0x7f7bd01eadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:46.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.362+0000 7f7bcf7fe640 1 --2- 172.21.15.77:0/3639990577 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7bd0073450 0x7f7bd01eadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.362+0000 7f7bcf7fe640 1 -- 172.21.15.77:0/3639990577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd014ab70 con 0x7f7bd00c4280 2024-04-25T01:39:46.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.362+0000 7f7bd4c40640 1 --2- 172.21.15.77:0/3639990577 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7bd00c4cb0 0x7f7bd0149840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:46.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.362+0000 7f7bcf7fe640 1 --2- 172.21.15.77:0/3639990577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd00c4280 0x7f7bd0149300 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7bc400c4d0 tx=0x7f7bc400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:46.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.363+0000 7f7bccff9640 1 -- 172.21.15.77:0/3639990577 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4018070 con 0x7f7bd00c4280 2024-04-25T01:39:46.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.363+0000 7f7bccff9640 1 -- 172.21.15.77:0/3639990577 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc4007500 con 0x7f7bd00c4280 2024-04-25T01:39:46.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.363+0000 7f7bd66a3640 1 -- 172.21.15.77:0/3639990577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd0149d80 con 0x7f7bd00c4280 2024-04-25T01:39:46.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.363+0000 7f7bccff9640 1 -- 172.21.15.77:0/3639990577 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4004a20 con 0x7f7bd00c4280 2024-04-25T01:39:46.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.363+0000 7f7bd66a3640 1 -- 172.21.15.77:0/3639990577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd01eb850 con 0x7f7bd00c4280 2024-04-25T01:39:46.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.364+0000 7f7bd66a3640 1 -- 172.21.15.77:0/3639990577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bd004f500 con 0x7f7bd00c4280 2024-04-25T01:39:46.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.364+0000 7f7bccff9640 1 -- 172.21.15.77:0/3639990577 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7bc401b070 con 0x7f7bd00c4280 2024-04-25T01:39:46.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.364+0000 7f7bccff9640 1 --2- 172.21.15.77:0/3639990577 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7bbc06be30 0x7f7bbc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:46.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.365+0000 7f7bccff9640 1 -- 172.21.15.77:0/3639990577 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f7bc408a430 con 0x7f7bd00c4280 2024-04-25T01:39:46.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.365+0000 7f7bcffff640 1 --2- 172.21.15.77:0/3639990577 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7bbc06be30 0x7f7bbc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:46.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.365+0000 7f7bcffff640 1 --2- 172.21.15.77:0/3639990577 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7bbc06be30 0x7f7bbc06e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0037000 tx=0x7f7bc003d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:46.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.369+0000 7f7bccff9640 1 -- 172.21.15.77:0/3639990577 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7bc4058b40 con 0x7f7bd00c4280 2024-04-25T01:39:46.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.544+0000 7f7bd66a3640 1 -- 172.21.15.77:0/3639990577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7f7bd00c6bf0 con 0x7f7bd00c4280 2024-04-25T01:39:46.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.544+0000 7f7bccff9640 1 -- 172.21.15.77:0/3639990577 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v24) ==== 99+0+11 (secure 0 0 0) 0x7f7bc4058440 con 0x7f7bd00c4280 2024-04-25T01:39:46.528 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T01:39:46.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.546+0000 7f7bd66a3640 1 -- 172.21.15.77:0/3639990577 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7bbc06be30 msgr2=0x7f7bbc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:46.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.546+0000 7f7bd66a3640 1 --2- 172.21.15.77:0/3639990577 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7bbc06be30 0x7f7bbc06e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0037000 tx=0x7f7bc003d040 comp rx=0 tx=0).stop 2024-04-25T01:39:46.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.546+0000 7f7bd66a3640 1 -- 172.21.15.77:0/3639990577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd00c4280 msgr2=0x7f7bd0149300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:46.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.546+0000 7f7bd66a3640 1 --2- 172.21.15.77:0/3639990577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd00c4280 0x7f7bd0149300 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7bc400c4d0 tx=0x7f7bc400c990 comp rx=0 tx=0).stop 2024-04-25T01:39:46.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.546+0000 7f7bd66a3640 1 -- 172.21.15.77:0/3639990577 shutdown_connections 2024-04-25T01:39:46.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.546+0000 7f7bd66a3640 1 --2- 172.21.15.77:0/3639990577 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7bbc06be30 0x7f7bbc06e2f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.546+0000 7f7bd66a3640 1 --2- 172.21.15.77:0/3639990577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd00c4280 0x7f7bd0149300 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.546+0000 7f7bd66a3640 1 --2- 172.21.15.77:0/3639990577 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7bd00c4cb0 0x7f7bd0149840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.546+0000 7f7bd66a3640 1 --2- 172.21.15.77:0/3639990577 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7bd0073450 0x7f7bd01eadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.546+0000 7f7bd66a3640 1 -- 172.21.15.77:0/3639990577 >> 172.21.15.77:0/3639990577 conn(0x7f7bd00c7580 msgr2=0x7f7bd0152ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:46.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.546+0000 7f7bd66a3640 1 -- 172.21.15.77:0/3639990577 shutdown_connections 2024-04-25T01:39:46.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.546+0000 7f7bd66a3640 1 -- 172.21.15.77:0/3639990577 wait complete. 2024-04-25T01:39:46.540 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-25T01:39:46.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.656+0000 7f4b9f6f5640 1 Processor -- start 2024-04-25T01:39:46.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.656+0000 7f4b9f6f5640 1 -- start start 2024-04-25T01:39:46.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.657+0000 7f4b9f6f5640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4b980c6c50 0x7f4b980abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:46.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.657+0000 7f4b9f6f5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4b980c4d10 0x7f4b980ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:46.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.657+0000 7f4b9f6f5640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b980acf70 con 0x7f4b9806d470 2024-04-25T01:39:46.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.657+0000 7f4b9f6f5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f4b980acd20 con 0x7f4b980c4d10 2024-04-25T01:39:46.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.657+0000 7f4b9f6f5640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f4b98153120 con 0x7f4b980c6c50 2024-04-25T01:39:46.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.657+0000 7f4b9dc92640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4b980c4d10 0x7f4b980ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:46.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.657+0000 7f4b9dc92640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4b980c4d10 0x7f4b980ac4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47242/0 (socket says 172.21.15.77:47242) 2024-04-25T01:39:46.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.657+0000 7f4b9dc92640 1 -- 172.21.15.77:0/3829746732 learned_addr learned my addr 172.21.15.77:0/3829746732 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:46.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.657+0000 7f4b9cc90640 1 --2- 172.21.15.77:0/3829746732 >> v2:172.21.15.121:3300/0 conn(0x7f4b980c6c50 0x7f4b980abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:46.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.657+0000 7f4b9dc92640 1 -- 172.21.15.77:0/3829746732 >> v2:172.21.15.121:3300/0 conn(0x7f4b980c6c50 msgr2=0x7f4b980abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:46.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.657+0000 7f4b9dc92640 1 --2- 172.21.15.77:0/3829746732 >> v2:172.21.15.121:3300/0 conn(0x7f4b980c6c50 0x7f4b980abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.657+0000 7f4b9dc92640 1 -- 172.21.15.77:0/3829746732 >> v1:172.21.15.121:6789/0 conn(0x7f4b9806d470 legacy=0x7f4b9806d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:46.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.657+0000 7f4b9dc92640 1 -- 172.21.15.77:0/3829746732 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b98153400 con 0x7f4b980c4d10 2024-04-25T01:39:46.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.658+0000 7f4b9dc92640 1 --2- 172.21.15.77:0/3829746732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b980c4d10 0x7f4b980ac4d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4b980c8310 tx=0x7f4b9002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cdb5e8ad8cc3d7f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:46.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.658+0000 7f4b8ffff640 1 -- 172.21.15.77:0/3829746732 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b90037070 con 0x7f4b980c4d10 2024-04-25T01:39:46.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.658+0000 7f4b8ffff640 1 -- 172.21.15.77:0/3829746732 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b9002ae20 con 0x7f4b980c4d10 2024-04-25T01:39:46.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.658+0000 7f4b8ffff640 1 -- 172.21.15.77:0/3829746732 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b90032660 con 0x7f4b980c4d10 2024-04-25T01:39:46.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.659+0000 7f4b9f6f5640 1 -- 172.21.15.77:0/3829746732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b980c4d10 msgr2=0x7f4b980ac4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:46.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.659+0000 7f4b9f6f5640 1 --2- 172.21.15.77:0/3829746732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b980c4d10 0x7f4b980ac4d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4b980c8310 tx=0x7f4b9002a110 comp rx=0 tx=0).stop 2024-04-25T01:39:46.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.659+0000 7f4b9f6f5640 1 -- 172.21.15.77:0/3829746732 shutdown_connections 2024-04-25T01:39:46.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.659+0000 7f4b9f6f5640 1 --2- 172.21.15.77:0/3829746732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b980c4d10 0x7f4b980ac4d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.659+0000 7f4b9f6f5640 1 --2- 172.21.15.77:0/3829746732 >> v2:172.21.15.121:3300/0 conn(0x7f4b980c6c50 0x7f4b980abf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.659+0000 7f4b9f6f5640 1 -- 172.21.15.77:0/3829746732 >> 172.21.15.77:0/3829746732 conn(0x7f4b980c7580 msgr2=0x7f4b980c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:46.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.659+0000 7f4b9f6f5640 1 -- 172.21.15.77:0/3829746732 shutdown_connections 2024-04-25T01:39:46.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.659+0000 7f4b9f6f5640 1 -- 172.21.15.77:0/3829746732 wait complete. 2024-04-25T01:39:46.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.660+0000 7f4b9f6f5640 1 Processor -- start 2024-04-25T01:39:46.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.660+0000 7f4b9f6f5640 1 -- start start 2024-04-25T01:39:46.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.661+0000 7f4b9f6f5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b9806d470 0x7f4b9814c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:46.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.661+0000 7f4b9f6f5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4b980c4d10 0x7f4b981e9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:46.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.661+0000 7f4b9f6f5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b980c6c50 0x7f4b980a8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:46.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.661+0000 7f4b9f6f5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4b980c26d0 con 0x7f4b9806d470 2024-04-25T01:39:46.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.661+0000 7f4b9f6f5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4b980c2550 con 0x7f4b980c6c50 2024-04-25T01:39:46.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.661+0000 7f4b9f6f5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f4b980c2850 con 0x7f4b980c4d10 2024-04-25T01:39:46.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.661+0000 7f4b9d491640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b9806d470 0x7f4b9814c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:46.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.661+0000 7f4b9d491640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b9806d470 0x7f4b9814c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47250/0 (socket says 172.21.15.77:47250) 2024-04-25T01:39:46.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.661+0000 7f4b9d491640 1 -- 172.21.15.77:0/721155684 learned_addr learned my addr 172.21.15.77:0/721155684 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:46.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.661+0000 7f4b9dc92640 1 --2- 172.21.15.77:0/721155684 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b980c6c50 0x7f4b980a8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:46.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.661+0000 7f4b9d491640 1 -- 172.21.15.77:0/721155684 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4b980c4d10 msgr2=0x7f4b981e9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:46.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.661+0000 7f4b9d491640 1 --2- 172.21.15.77:0/721155684 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4b980c4d10 0x7f4b981e9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.661+0000 7f4b9d491640 1 -- 172.21.15.77:0/721155684 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b980c6c50 msgr2=0x7f4b980a8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:46.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.661+0000 7f4b9d491640 1 --2- 172.21.15.77:0/721155684 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b980c6c50 0x7f4b980a8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.661+0000 7f4b9d491640 1 -- 172.21.15.77:0/721155684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b981de820 con 0x7f4b9806d470 2024-04-25T01:39:46.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.661+0000 7f4b9d491640 1 --2- 172.21.15.77:0/721155684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b9806d470 0x7f4b9814c710 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400c7c0 tx=0x7f4b9400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:46.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.661+0000 7f4b8dffb640 1 -- 172.21.15.77:0/721155684 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b94016020 con 0x7f4b9806d470 2024-04-25T01:39:46.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.661+0000 7f4b8dffb640 1 -- 172.21.15.77:0/721155684 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b9400aa50 con 0x7f4b9806d470 2024-04-25T01:39:46.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.661+0000 7f4b8dffb640 1 -- 172.21.15.77:0/721155684 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9400ae40 con 0x7f4b9806d470 2024-04-25T01:39:46.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.661+0000 7f4b9f6f5640 1 -- 172.21.15.77:0/721155684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b981ddfc0 con 0x7f4b9806d470 2024-04-25T01:39:46.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.662+0000 7f4b9f6f5640 1 -- 172.21.15.77:0/721155684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b981de540 con 0x7f4b9806d470 2024-04-25T01:39:46.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.662+0000 7f4b9f6f5640 1 -- 172.21.15.77:0/721155684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b9804f500 con 0x7f4b9806d470 2024-04-25T01:39:46.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.663+0000 7f4b8dffb640 1 -- 172.21.15.77:0/721155684 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4b94019020 con 0x7f4b9806d470 2024-04-25T01:39:46.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.663+0000 7f4b8dffb640 1 --2- 172.21.15.77:0/721155684 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4b7c06be30 0x7f4b7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:46.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.663+0000 7f4b8dffb640 1 -- 172.21.15.77:0/721155684 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f4b9408ae50 con 0x7f4b9806d470 2024-04-25T01:39:46.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.663+0000 7f4b9cc90640 1 --2- 172.21.15.77:0/721155684 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4b7c06be30 0x7f4b7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:46.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.664+0000 7f4b9cc90640 1 --2- 172.21.15.77:0/721155684 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4b7c06be30 0x7f4b7c06e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4b88006fd0 tx=0x7f4b88008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:46.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.667+0000 7f4b8dffb640 1 -- 172.21.15.77:0/721155684 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4b94020070 con 0x7f4b9806d470 2024-04-25T01:39:46.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.841+0000 7f4b9f6f5640 1 -- 172.21.15.77:0/721155684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7f4b981526e0 con 0x7f4b9806d470 2024-04-25T01:39:46.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.841+0000 7f4b8dffb640 1 -- 172.21.15.77:0/721155684 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v24) ==== 95+0+11 (secure 0 0 0) 0x7f4b94059560 con 0x7f4b9806d470 2024-04-25T01:39:46.825 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-25T01:39:46.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.844+0000 7f4b9f6f5640 1 -- 172.21.15.77:0/721155684 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4b7c06be30 msgr2=0x7f4b7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:46.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.844+0000 7f4b9f6f5640 1 --2- 172.21.15.77:0/721155684 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4b7c06be30 0x7f4b7c06e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4b88006fd0 tx=0x7f4b88008040 comp rx=0 tx=0).stop 2024-04-25T01:39:46.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.844+0000 7f4b9f6f5640 1 -- 172.21.15.77:0/721155684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b9806d470 msgr2=0x7f4b9814c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:46.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.844+0000 7f4b9f6f5640 1 --2- 172.21.15.77:0/721155684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b9806d470 0x7f4b9814c710 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400c7c0 tx=0x7f4b9400cc80 comp rx=0 tx=0).stop 2024-04-25T01:39:46.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.844+0000 7f4b9f6f5640 1 -- 172.21.15.77:0/721155684 shutdown_connections 2024-04-25T01:39:46.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.844+0000 7f4b9f6f5640 1 --2- 172.21.15.77:0/721155684 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4b7c06be30 0x7f4b7c06e2f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.844+0000 7f4b9f6f5640 1 --2- 172.21.15.77:0/721155684 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b980c6c50 0x7f4b980a8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.844+0000 7f4b9f6f5640 1 --2- 172.21.15.77:0/721155684 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4b980c4d10 0x7f4b981e9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.844+0000 7f4b9f6f5640 1 --2- 172.21.15.77:0/721155684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b9806d470 0x7f4b9814c710 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.844+0000 7f4b9f6f5640 1 -- 172.21.15.77:0/721155684 >> 172.21.15.77:0/721155684 conn(0x7f4b980c7580 msgr2=0x7f4b980c4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:46.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.844+0000 7f4b9f6f5640 1 -- 172.21.15.77:0/721155684 shutdown_connections 2024-04-25T01:39:46.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.844+0000 7f4b9f6f5640 1 -- 172.21.15.77:0/721155684 wait complete. 2024-04-25T01:39:46.838 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:39:46.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.952+0000 7f2c1b1e3640 1 Processor -- start 2024-04-25T01:39:46.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.952+0000 7f2c1b1e3640 1 -- start start 2024-04-25T01:39:46.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.953+0000 7f2c1b1e3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2c14156c80 0x7f2c140c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:46.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.953+0000 7f2c1b1e3640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2c1406c280 0x7f2c140c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:46.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.953+0000 7f2c1b1e3640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c14157130 con 0x7f2c14150090 2024-04-25T01:39:46.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.953+0000 7f2c1b1e3640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f2c1406b830 con 0x7f2c1406c280 2024-04-25T01:39:46.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.953+0000 7f2c1b1e3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f2c140c9de0 con 0x7f2c14156c80 2024-04-25T01:39:46.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.953+0000 7f2c18f7f640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f2c14150090 0x7f2c140c8200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41602/0 (socket says 172.21.15.77:41602) 2024-04-25T01:39:46.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.953+0000 7f2c18f7f640 1 -- 172.21.15.77:0/2199124447 learned_addr learned my addr 172.21.15.77:0/2199124447 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:46.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.953+0000 7f2c13fff640 1 --2- 172.21.15.77:0/2199124447 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2c14156c80 0x7f2c140c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:46.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.953+0000 7f2c19780640 1 --2- 172.21.15.77:0/2199124447 >> v2:172.21.15.121:3300/0 conn(0x7f2c1406c280 0x7f2c140c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:46.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.953+0000 7f2c137fe640 1 -- 172.21.15.77:0/2199124447 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 305848627 0 0) 0x7f2c08001110 con 0x7f2c14150090 2024-04-25T01:39:46.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.954+0000 7f2c137fe640 1 -- 172.21.15.77:0/2199124447 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c04003520 con 0x7f2c14150090 2024-04-25T01:39:46.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.954+0000 7f2c137fe640 1 -- 172.21.15.77:0/2199124447 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4264981077 0 0) 0x7f2c04003520 con 0x7f2c14150090 2024-04-25T01:39:46.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.954+0000 7f2c137fe640 1 -- 172.21.15.77:0/2199124447 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2c14156c80 msgr2=0x7f2c140c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:46.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.954+0000 7f2c137fe640 1 --2- 172.21.15.77:0/2199124447 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2c14156c80 0x7f2c140c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.954+0000 7f2c137fe640 1 -- 172.21.15.77:0/2199124447 >> v2:172.21.15.121:3300/0 conn(0x7f2c1406c280 msgr2=0x7f2c140c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:46.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.954+0000 7f2c137fe640 1 --2- 172.21.15.77:0/2199124447 >> v2:172.21.15.121:3300/0 conn(0x7f2c1406c280 0x7f2c140c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.954+0000 7f2c137fe640 1 -- 172.21.15.77:0/2199124447 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c140c89c0 con 0x7f2c14150090 2024-04-25T01:39:46.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.954+0000 7f2c137fe640 1 -- 172.21.15.77:0/2199124447 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7f2c08001840 con 0x7f2c14150090 2024-04-25T01:39:46.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.954+0000 7f2c137fe640 1 -- 172.21.15.77:0/2199124447 >> v1:172.21.15.77:6789/0 conn(0x7f2c14150090 legacy=0x7f2c140c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:46.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.954+0000 7f2c137fe640 1 --2- 172.21.15.77:0/2199124447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c040039b0 0x7f2c04003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:46.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.954+0000 7f2c137fe640 1 --2- 172.21.15.77:0/2199124447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c04004800 0x7f2c04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:46.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.954+0000 7f2c137fe640 1 --2- 172.21.15.77:0/2199124447 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2c14156c80 0x7f2c040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:46.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.954+0000 7f2c137fe640 1 -- 172.21.15.77:0/2199124447 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1406b830 con 0x7f2c040039b0 2024-04-25T01:39:46.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.954+0000 7f2c137fe640 1 -- 172.21.15.77:0/2199124447 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2c140c9de0 con 0x7f2c04004800 2024-04-25T01:39:46.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.954+0000 7f2c137fe640 1 -- 172.21.15.77:0/2199124447 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f2c0400b9c0 con 0x7f2c14156c80 2024-04-25T01:39:46.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.954+0000 7f2c18f7f640 1 --2- 172.21.15.77:0/2199124447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c040039b0 0x7f2c04003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:46.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.954+0000 7f2c13fff640 1 --2- 172.21.15.77:0/2199124447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c04004800 0x7f2c04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:46.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.954+0000 7f2c19780640 1 --2- 172.21.15.77:0/2199124447 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2c14156c80 0x7f2c040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:46.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.954+0000 7f2c18f7f640 1 -- 172.21.15.77:0/2199124447 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2c14156c80 msgr2=0x7f2c040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:46.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.954+0000 7f2c18f7f640 1 --2- 172.21.15.77:0/2199124447 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2c14156c80 0x7f2c040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.954+0000 7f2c18f7f640 1 -- 172.21.15.77:0/2199124447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c04004800 msgr2=0x7f2c04004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:46.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.954+0000 7f2c18f7f640 1 --2- 172.21.15.77:0/2199124447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c04004800 0x7f2c04004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.954+0000 7f2c18f7f640 1 -- 172.21.15.77:0/2199124447 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c04003520 con 0x7f2c040039b0 2024-04-25T01:39:46.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.954+0000 7f2c13fff640 1 --2- 172.21.15.77:0/2199124447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c04004800 0x7f2c04004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:46.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.955+0000 7f2c18f7f640 1 --2- 172.21.15.77:0/2199124447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c040039b0 0x7f2c04003dd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2c0800c4c0 tx=0x7f2c04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf72f395ca18644 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:46.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.955+0000 7f2c137fe640 1 -- 172.21.15.77:0/2199124447 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0800c0e0 con 0x7f2c040039b0 2024-04-25T01:39:46.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.955+0000 7f2c137fe640 1 -- 172.21.15.77:0/2199124447 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c08034070 con 0x7f2c040039b0 2024-04-25T01:39:46.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.955+0000 7f2c137fe640 1 -- 172.21.15.77:0/2199124447 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c08005d30 con 0x7f2c040039b0 2024-04-25T01:39:46.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.955+0000 7f2c1b1e3640 1 -- 172.21.15.77:0/2199124447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c040039b0 msgr2=0x7f2c04003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:46.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.955+0000 7f2c1b1e3640 1 --2- 172.21.15.77:0/2199124447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c040039b0 0x7f2c04003dd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2c0800c4c0 tx=0x7f2c04005830 comp rx=0 tx=0).stop 2024-04-25T01:39:46.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.955+0000 7f2c19780640 1 -- 172.21.15.77:0/2199124447 reap_dead start 2024-04-25T01:39:46.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.956+0000 7f2c1b1e3640 1 -- 172.21.15.77:0/2199124447 shutdown_connections 2024-04-25T01:39:46.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.956+0000 7f2c1b1e3640 1 -- 172.21.15.77:0/2199124447 >> 172.21.15.77:0/2199124447 conn(0x7f2c140ad4d0 msgr2=0x7f2c140ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:46.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.956+0000 7f2c1b1e3640 1 -- 172.21.15.77:0/2199124447 shutdown_connections 2024-04-25T01:39:46.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.956+0000 7f2c1b1e3640 1 -- 172.21.15.77:0/2199124447 wait complete. 2024-04-25T01:39:46.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.957+0000 7f2c1b1e3640 1 Processor -- start 2024-04-25T01:39:46.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.957+0000 7f2c1b1e3640 1 -- start start 2024-04-25T01:39:46.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.957+0000 7f2c1b1e3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2c040039b0 0x7f2c141597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:46.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.957+0000 7f2c1b1e3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c141536d0 0x7f2c140af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:46.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.957+0000 7f2c1b1e3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c140afe20 0x7f2c141eb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:46.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.957+0000 7f2c1b1e3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1406bd60 con 0x7f2c141536d0 2024-04-25T01:39:46.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.957+0000 7f2c1b1e3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1406ba80 con 0x7f2c140afe20 2024-04-25T01:39:46.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.957+0000 7f2c1b1e3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f2c1406c6d0 con 0x7f2c040039b0 2024-04-25T01:39:46.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.957+0000 7f2c13fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c141536d0 0x7f2c140af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:46.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.958+0000 7f2c13fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c141536d0 0x7f2c140af8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47264/0 (socket says 172.21.15.77:47264) 2024-04-25T01:39:46.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.958+0000 7f2c13fff640 1 -- 172.21.15.77:0/1645737095 learned_addr learned my addr 172.21.15.77:0/1645737095 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:46.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.958+0000 7f2c19780640 1 --2- 172.21.15.77:0/1645737095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c140afe20 0x7f2c141eb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:46.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.958+0000 7f2c18f7f640 1 --2- 172.21.15.77:0/1645737095 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2c040039b0 0x7f2c141597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:46.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.958+0000 7f2c13fff640 1 -- 172.21.15.77:0/1645737095 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2c040039b0 msgr2=0x7f2c141597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:46.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.958+0000 7f2c13fff640 1 --2- 172.21.15.77:0/1645737095 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2c040039b0 0x7f2c141597a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.958+0000 7f2c13fff640 1 -- 172.21.15.77:0/1645737095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c140afe20 msgr2=0x7f2c141eb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:46.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.958+0000 7f2c13fff640 1 --2- 172.21.15.77:0/1645737095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c140afe20 0x7f2c141eb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:46.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.958+0000 7f2c13fff640 1 -- 172.21.15.77:0/1645737095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c141ef770 con 0x7f2c141536d0 2024-04-25T01:39:46.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.958+0000 7f2c13fff640 1 --2- 172.21.15.77:0/1645737095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c141536d0 0x7f2c140af8e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2c00011570 tx=0x7f2c00011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:46.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.958+0000 7f2c117fa640 1 -- 172.21.15.77:0/1645737095 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c00015870 con 0x7f2c141536d0 2024-04-25T01:39:46.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.958+0000 7f2c117fa640 1 -- 172.21.15.77:0/1645737095 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c00015a10 con 0x7f2c141536d0 2024-04-25T01:39:46.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.958+0000 7f2c1b1e3640 1 -- 172.21.15.77:0/1645737095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c140c5100 con 0x7f2c141536d0 2024-04-25T01:39:46.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.958+0000 7f2c117fa640 1 -- 172.21.15.77:0/1645737095 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c00015dc0 con 0x7f2c141536d0 2024-04-25T01:39:46.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.958+0000 7f2c1b1e3640 1 -- 172.21.15.77:0/1645737095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c140c56c0 con 0x7f2c141536d0 2024-04-25T01:39:46.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.959+0000 7f2c1b1e3640 1 -- 172.21.15.77:0/1645737095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c1404f500 con 0x7f2c141536d0 2024-04-25T01:39:46.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.960+0000 7f2c117fa640 1 -- 172.21.15.77:0/1645737095 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2c0000f460 con 0x7f2c141536d0 2024-04-25T01:39:46.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.960+0000 7f2c117fa640 1 --2- 172.21.15.77:0/1645737095 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2bf806be60 0x7f2bf806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:46.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.960+0000 7f2c117fa640 1 -- 172.21.15.77:0/1645737095 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f2c0008b8e0 con 0x7f2c141536d0 2024-04-25T01:39:46.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.960+0000 7f2c18f7f640 1 --2- 172.21.15.77:0/1645737095 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2bf806be60 0x7f2bf806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:46.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.960+0000 7f2c18f7f640 1 --2- 172.21.15.77:0/1645737095 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2bf806be60 0x7f2bf806e320 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2c08033000 tx=0x7f2c08009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:46.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:46.964+0000 7f2c117fa640 1 -- 172.21.15.77:0/1645737095 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2c00019030 con 0x7f2c141536d0 2024-04-25T01:39:47.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.171+0000 7f2c1b1e3640 1 -- 172.21.15.77:0/1645737095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c1406cec0 con 0x7f2c141536d0 2024-04-25T01:39:47.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.172+0000 7f2c117fa640 1 -- 172.21.15.77:0/1645737095 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6488 (secure 0 0 0) 0x7f2c00059910 con 0x7f2c141536d0 2024-04-25T01:39:47.155 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:47.155 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:39:36.787357+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6837/3454203695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3454203695},{"type":"v1","addr":"172.21.15.77:6837","nonce":3454203695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-04-25T01:39:47.155 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 12 2024-04-25T01:39:47.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.173+0000 7f2c1b1e3640 1 -- 172.21.15.77:0/1645737095 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2bf806be60 msgr2=0x7f2bf806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:47.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.173+0000 7f2c1b1e3640 1 --2- 172.21.15.77:0/1645737095 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2bf806be60 0x7f2bf806e320 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2c08033000 tx=0x7f2c08009030 comp rx=0 tx=0).stop 2024-04-25T01:39:47.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.173+0000 7f2c1b1e3640 1 -- 172.21.15.77:0/1645737095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c141536d0 msgr2=0x7f2c140af8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:47.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.173+0000 7f2c1b1e3640 1 --2- 172.21.15.77:0/1645737095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c141536d0 0x7f2c140af8e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2c00011570 tx=0x7f2c00011a30 comp rx=0 tx=0).stop 2024-04-25T01:39:47.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.174+0000 7f2c1b1e3640 1 -- 172.21.15.77:0/1645737095 shutdown_connections 2024-04-25T01:39:47.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.174+0000 7f2c1b1e3640 1 --2- 172.21.15.77:0/1645737095 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2bf806be60 0x7f2bf806e320 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.174+0000 7f2c1b1e3640 1 --2- 172.21.15.77:0/1645737095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c141536d0 0x7f2c140af8e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.174+0000 7f2c1b1e3640 1 --2- 172.21.15.77:0/1645737095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c140afe20 0x7f2c141eb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.174+0000 7f2c1b1e3640 1 --2- 172.21.15.77:0/1645737095 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2c040039b0 0x7f2c141597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.174+0000 7f2c1b1e3640 1 -- 172.21.15.77:0/1645737095 >> 172.21.15.77:0/1645737095 conn(0x7f2c140ad4d0 msgr2=0x7f2c140ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:47.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.174+0000 7f2c1b1e3640 1 -- 172.21.15.77:0/1645737095 shutdown_connections 2024-04-25T01:39:47.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.174+0000 7f2c1b1e3640 1 -- 172.21.15.77:0/1645737095 wait complete. 2024-04-25T01:39:47.168 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T01:39:47.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.280+0000 7f734fa38640 1 Processor -- start 2024-04-25T01:39:47.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.280+0000 7f734fa38640 1 -- start start 2024-04-25T01:39:47.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.281+0000 7f734fa38640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f73480c3af0 0x7f7348070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:47.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.281+0000 7f734fa38640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f73481596b0 0x7f734814c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:47.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.281+0000 7f734fa38640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7348072c30 con 0x7f73480adb60 2024-04-25T01:39:47.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.281+0000 7f734fa38640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f734806c870 con 0x7f73480c3af0 2024-04-25T01:39:47.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.281+0000 7f734fa38640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f7348072f10 con 0x7f73481596b0 2024-04-25T01:39:47.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.281+0000 7f734d7d4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f73480c3af0 0x7f7348070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:47.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.281+0000 7f734d7d4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f73480c3af0 0x7f7348070e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47272/0 (socket says 172.21.15.77:47272) 2024-04-25T01:39:47.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.281+0000 7f734d7d4640 1 -- 172.21.15.77:0/3541205707 learned_addr learned my addr 172.21.15.77:0/3541205707 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:47.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.281+0000 7f734dfd5640 1 --2- 172.21.15.77:0/3541205707 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f73481596b0 0x7f734814c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:47.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.281+0000 7f734d7d4640 1 -- 172.21.15.77:0/3541205707 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f73481596b0 msgr2=0x7f734814c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:47.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.281+0000 7f734d7d4640 1 --2- 172.21.15.77:0/3541205707 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f73481596b0 0x7f734814c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.281+0000 7f734d7d4640 1 -- 172.21.15.77:0/3541205707 >> v1:172.21.15.121:6789/0 conn(0x7f73480adb60 legacy=0x7f7348156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:47.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.281+0000 7f734d7d4640 1 -- 172.21.15.77:0/3541205707 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734806cac0 con 0x7f73480c3af0 2024-04-25T01:39:47.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.282+0000 7f734d7d4640 1 --2- 172.21.15.77:0/3541205707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73480c3af0 0x7f7348070e00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7344009870 tx=0x7f734402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a122b19354e83ff7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:47.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.282+0000 7f733ffff640 1 -- 172.21.15.77:0/3541205707 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7344037070 con 0x7f73480c3af0 2024-04-25T01:39:47.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.282+0000 7f733ffff640 1 -- 172.21.15.77:0/3541205707 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7344032440 con 0x7f73480c3af0 2024-04-25T01:39:47.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.282+0000 7f733ffff640 1 -- 172.21.15.77:0/3541205707 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7344032810 con 0x7f73480c3af0 2024-04-25T01:39:47.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.283+0000 7f734fa38640 1 -- 172.21.15.77:0/3541205707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73480c3af0 msgr2=0x7f7348070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:47.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.283+0000 7f734fa38640 1 --2- 172.21.15.77:0/3541205707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73480c3af0 0x7f7348070e00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7344009870 tx=0x7f734402a130 comp rx=0 tx=0).stop 2024-04-25T01:39:47.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.283+0000 7f734fa38640 1 -- 172.21.15.77:0/3541205707 shutdown_connections 2024-04-25T01:39:47.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.283+0000 7f734fa38640 1 --2- 172.21.15.77:0/3541205707 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f73481596b0 0x7f734814c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.283+0000 7f734fa38640 1 --2- 172.21.15.77:0/3541205707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73480c3af0 0x7f7348070e00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.283+0000 7f734fa38640 1 -- 172.21.15.77:0/3541205707 >> 172.21.15.77:0/3541205707 conn(0x7f73480c4970 msgr2=0x7f73480c4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:47.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.283+0000 7f734fa38640 1 -- 172.21.15.77:0/3541205707 shutdown_connections 2024-04-25T01:39:47.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.283+0000 7f734fa38640 1 -- 172.21.15.77:0/3541205707 wait complete. 2024-04-25T01:39:47.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.284+0000 7f734fa38640 1 Processor -- start 2024-04-25T01:39:47.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.284+0000 7f734fa38640 1 -- start start 2024-04-25T01:39:47.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.285+0000 7f734fa38640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73480adb60 0x7f73481588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:47.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.285+0000 7f734fa38640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73480c3af0 0x7f73481ebd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:47.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.285+0000 7f734fa38640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f73481596b0 0x7f73481ec2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:47.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.285+0000 7f734fa38640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f73480c4050 con 0x7f73480adb60 2024-04-25T01:39:47.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.285+0000 7f734fa38640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f73480c3ed0 con 0x7f73480c3af0 2024-04-25T01:39:47.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.285+0000 7f734fa38640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f7348159ae0 con 0x7f73481596b0 2024-04-25T01:39:47.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.285+0000 7f734d7d4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73480adb60 0x7f73481588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:47.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.285+0000 7f734d7d4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73480adb60 0x7f73481588a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47288/0 (socket says 172.21.15.77:47288) 2024-04-25T01:39:47.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.285+0000 7f734d7d4640 1 -- 172.21.15.77:0/3999786226 learned_addr learned my addr 172.21.15.77:0/3999786226 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:47.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.285+0000 7f734d7d4640 1 -- 172.21.15.77:0/3999786226 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f73481596b0 msgr2=0x7f73481ec2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:47.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.285+0000 7f734d7d4640 1 --2- 172.21.15.77:0/3999786226 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f73481596b0 0x7f73481ec2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.285+0000 7f734d7d4640 1 -- 172.21.15.77:0/3999786226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73480c3af0 msgr2=0x7f73481ebd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:47.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.285+0000 7f734d7d4640 1 --2- 172.21.15.77:0/3999786226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73480c3af0 0x7f73481ebd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.285+0000 7f734d7d4640 1 -- 172.21.15.77:0/3999786226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73481ef2b0 con 0x7f73480adb60 2024-04-25T01:39:47.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.285+0000 7f734d7d4640 1 --2- 172.21.15.77:0/3999786226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73480adb60 0x7f73481588a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7344000c00 tx=0x7f73440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:47.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.285+0000 7f733dffb640 1 -- 172.21.15.77:0/3999786226 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7344041020 con 0x7f73480adb60 2024-04-25T01:39:47.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.285+0000 7f733dffb640 1 -- 172.21.15.77:0/3999786226 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f734403d620 con 0x7f73480adb60 2024-04-25T01:39:47.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.285+0000 7f734fa38640 1 -- 172.21.15.77:0/3999786226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73481ef590 con 0x7f73480adb60 2024-04-25T01:39:47.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.285+0000 7f733dffb640 1 -- 172.21.15.77:0/3999786226 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7344037040 con 0x7f73480adb60 2024-04-25T01:39:47.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.285+0000 7f734fa38640 1 -- 172.21.15.77:0/3999786226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73481efb50 con 0x7f73480adb60 2024-04-25T01:39:47.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.286+0000 7f734fa38640 1 -- 172.21.15.77:0/3999786226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7348071480 con 0x7f73480adb60 2024-04-25T01:39:47.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.287+0000 7f733dffb640 1 -- 172.21.15.77:0/3999786226 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7344044020 con 0x7f73480adb60 2024-04-25T01:39:47.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.287+0000 7f733dffb640 1 --2- 172.21.15.77:0/3999786226 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f732c06be30 0x7f732c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:47.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.287+0000 7f733dffb640 1 -- 172.21.15.77:0/3999786226 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f73440ab920 con 0x7f73480adb60 2024-04-25T01:39:47.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.287+0000 7f734cfd3640 1 --2- 172.21.15.77:0/3999786226 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f732c06be30 0x7f732c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:47.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.288+0000 7f734cfd3640 1 --2- 172.21.15.77:0/3999786226 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f732c06be30 0x7f732c06e2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7338000f60 tx=0x7f73380079d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:47.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.291+0000 7f733dffb640 1 -- 172.21.15.77:0/3999786226 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7348071480 con 0x7f73480adb60 2024-04-25T01:39:47.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.468+0000 7f734fa38640 1 -- 172.21.15.77:0/3999786226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f734804f500 con 0x7f73480adb60 2024-04-25T01:39:47.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.469+0000 7f733dffb640 1 -- 172.21.15.77:0/3999786226 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20331 (secure 0 0 0) 0x7f734404b030 con 0x7f73480adb60 2024-04-25T01:39:47.453 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:47.453 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:39:34.425701+0000","last_up_change":"2024-04-25T01:39:10.729600+0000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T01:39:11.681151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T01:39:21.606752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T01:39:22.677664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T01:39:30.501700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T01:39:31.740717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6811","nonce":3366980158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6817","nonce":3366980158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6828","nonce":3366980158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6825","nonce":3366980158}]},"public_addr":"172.21.15.77:6811/3366980158","cluster_addr":"172.21.15.77:6817/3366980158","heartbeat_back_addr":"172.21.15.77:6828/3366980158","heartbeat_front_addr":"172.21.15.77:6825/3366980158","state":["exists","up"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6801","nonce":3971619298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6803","nonce":3971619298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6807","nonce":3971619298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6805","nonce":3971619298}]},"public_addr":"172.21.15.77:6801/3971619298","cluster_addr":"172.21.15.77:6803/3971619298","heartbeat_back_addr":"172.21.15.77:6807/3971619298","heartbeat_front_addr":"172.21.15.77:6805/3971619298","state":["exists","up"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6810","nonce":4103452689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6813","nonce":4103452689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6823","nonce":4103452689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6818","nonce":4103452689}]},"public_addr":"172.21.15.77:6810/4103452689","cluster_addr":"172.21.15.77:6813/4103452689","heartbeat_back_addr":"172.21.15.77:6823/4103452689","heartbeat_front_addr":"172.21.15.77:6818/4103452689","state":["exists","up"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6819","nonce":217398906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6824","nonce":217398906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6831","nonce":217398906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6829","nonce":217398906}]},"public_addr":"172.21.15.77:6819/217398906","cluster_addr":"172.21.15.77:6824/217398906","heartbeat_back_addr":"172.21.15.77:6831/217398906","heartbeat_front_addr":"172.21.15.77:6829/217398906","state":["exists","up"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6801","nonce":2565483070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6803","nonce":2565483070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6810","nonce":2565483070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6806","nonce":2565483070}]},"public_addr":"172.21.15.121:6801/2565483070","cluster_addr":"172.21.15.121:6803/2565483070","heartbeat_back_addr":"172.21.15.121:6810/2565483070","heartbeat_front_addr":"172.21.15.121:6806/2565483070","state":["exists","up"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6807","nonce":2785294752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6809","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6811","nonce":2785294752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6815","nonce":2785294752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6813","nonce":2785294752}]},"public_addr":"172.21.15.121:6807/2785294752","cluster_addr":"172.21.15.121:6811/2785294752","heartbeat_back_addr":"172.21.15.121:6815/2785294752","heartbeat_front_addr":"172.21.15.121:6813/2785294752","state":["exists","up"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6820","nonce":523906818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6824","nonce":523906818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6831","nonce":523906818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6828","nonce":523906818}]},"public_addr":"172.21.15.121:6820/523906818","cluster_addr":"172.21.15.121:6824/523906818","heartbeat_back_addr":"172.21.15.121:6831/523906818","heartbeat_front_addr":"172.21.15.121:6828/523906818","state":["exists","up"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6817","nonce":1683602459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6819","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6821","nonce":1683602459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6829","nonce":1683602459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6823","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6825","nonce":1683602459}]},"public_addr":"172.21.15.121:6817/1683602459","cluster_addr":"172.21.15.121:6821/1683602459","heartbeat_back_addr":"172.21.15.121:6829/1683602459","heartbeat_front_addr":"172.21.15.121:6825/1683602459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.839443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.818842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.776243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.793085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.822396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.907311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.918374+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.848430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:39:47.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.471+0000 7f734fa38640 1 -- 172.21.15.77:0/3999786226 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f732c06be30 msgr2=0x7f732c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:47.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.471+0000 7f734fa38640 1 --2- 172.21.15.77:0/3999786226 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f732c06be30 0x7f732c06e2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7338000f60 tx=0x7f73380079d0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.471+0000 7f734fa38640 1 -- 172.21.15.77:0/3999786226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73480adb60 msgr2=0x7f73481588a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:47.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.471+0000 7f734fa38640 1 --2- 172.21.15.77:0/3999786226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73480adb60 0x7f73481588a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7344000c00 tx=0x7f73440046c0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.471+0000 7f734fa38640 1 -- 172.21.15.77:0/3999786226 shutdown_connections 2024-04-25T01:39:47.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.471+0000 7f734fa38640 1 --2- 172.21.15.77:0/3999786226 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f732c06be30 0x7f732c06e2f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.471+0000 7f734fa38640 1 --2- 172.21.15.77:0/3999786226 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f73481596b0 0x7f73481ec2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.471+0000 7f734fa38640 1 --2- 172.21.15.77:0/3999786226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73480c3af0 0x7f73481ebd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.471+0000 7f734fa38640 1 --2- 172.21.15.77:0/3999786226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73480adb60 0x7f73481588a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.471+0000 7f734fa38640 1 -- 172.21.15.77:0/3999786226 >> 172.21.15.77:0/3999786226 conn(0x7f73480c4970 msgr2=0x7f73480c4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:47.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.471+0000 7f734fa38640 1 -- 172.21.15.77:0/3999786226 shutdown_connections 2024-04-25T01:39:47.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.471+0000 7f734fa38640 1 -- 172.21.15.77:0/3999786226 wait complete. 2024-04-25T01:39:47.466 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T01:39:11.681151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-25T01:39:21.606752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-25T01:39:22.677664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-25T01:39:30.501700+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-25T01:39:31.740717+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T01:39:47.466 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T01:39:47.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.581+0000 7f2bb69d5640 1 Processor -- start 2024-04-25T01:39:47.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.581+0000 7f2bb69d5640 1 -- start start 2024-04-25T01:39:47.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.582+0000 7f2bb69d5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2bb00cbef0 0x7f2bb0156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:47.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.582+0000 7f2bb69d5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2bb015a0e0 0x7f2bb00c9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:47.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.582+0000 7f2bb69d5640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2bb014fd20 0x7f2bb01501b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:47.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.582+0000 7f2bb69d5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f2bb00c6ca0 con 0x7f2bb015a0e0 2024-04-25T01:39:47.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.582+0000 7f2bb69d5640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f2bb00c66e0 con 0x7f2bb014fd20 2024-04-25T01:39:47.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.582+0000 7f2bb69d5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f2bb00c69c0 con 0x7f2bb00cbef0 2024-04-25T01:39:47.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.582+0000 7f2baf7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2bb015a0e0 0x7f2bb00c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:47.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.582+0000 7f2baf7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2bb015a0e0 0x7f2bb00c9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44836/0 (socket says 172.21.15.77:44836) 2024-04-25T01:39:47.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.582+0000 7f2baf7fe640 1 -- 172.21.15.77:0/682545613 learned_addr learned my addr 172.21.15.77:0/682545613 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:47.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.582+0000 7f2baffff640 1 --2- 172.21.15.77:0/682545613 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2bb00cbef0 0x7f2bb0156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:47.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.582+0000 7f2bb4f72640 1 --2- 172.21.15.77:0/682545613 >> v2:172.21.15.121:3300/0 conn(0x7f2bb014fd20 0x7f2bb01501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:47.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.582+0000 7f2baf7fe640 1 -- 172.21.15.77:0/682545613 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2bb00cbef0 msgr2=0x7f2bb0156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:47.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.582+0000 7f2baf7fe640 1 --2- 172.21.15.77:0/682545613 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2bb00cbef0 0x7f2bb0156ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.582+0000 7f2baf7fe640 1 -- 172.21.15.77:0/682545613 >> v2:172.21.15.121:3300/0 conn(0x7f2bb014fd20 msgr2=0x7f2bb01501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:47.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.582+0000 7f2baf7fe640 1 --2- 172.21.15.77:0/682545613 >> v2:172.21.15.121:3300/0 conn(0x7f2bb014fd20 0x7f2bb01501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.582+0000 7f2baf7fe640 1 -- 172.21.15.77:0/682545613 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb01598e0 con 0x7f2bb015a0e0 2024-04-25T01:39:47.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.583+0000 7f2baf7fe640 1 --2- 172.21.15.77:0/682545613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bb015a0e0 0x7f2bb00c9810 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2bb00c8170 tx=0x7f2ba402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f25f0680afcf6d64 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:47.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.583+0000 7f2baeffd640 1 -- 172.21.15.77:0/682545613 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4037070 con 0x7f2bb015a0e0 2024-04-25T01:39:47.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.583+0000 7f2baeffd640 1 -- 172.21.15.77:0/682545613 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ba4032440 con 0x7f2bb015a0e0 2024-04-25T01:39:47.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.583+0000 7f2baeffd640 1 -- 172.21.15.77:0/682545613 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4032810 con 0x7f2bb015a0e0 2024-04-25T01:39:47.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.584+0000 7f2bb69d5640 1 -- 172.21.15.77:0/682545613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bb015a0e0 msgr2=0x7f2bb00c9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:47.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.584+0000 7f2bb69d5640 1 --2- 172.21.15.77:0/682545613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bb015a0e0 0x7f2bb00c9810 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2bb00c8170 tx=0x7f2ba402a140 comp rx=0 tx=0).stop 2024-04-25T01:39:47.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.584+0000 7f2bb69d5640 1 -- 172.21.15.77:0/682545613 shutdown_connections 2024-04-25T01:39:47.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.584+0000 7f2bb69d5640 1 --2- 172.21.15.77:0/682545613 >> v2:172.21.15.121:3300/0 conn(0x7f2bb014fd20 0x7f2bb01501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.584+0000 7f2bb69d5640 1 --2- 172.21.15.77:0/682545613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bb015a0e0 0x7f2bb00c9810 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.584+0000 7f2bb69d5640 1 --2- 172.21.15.77:0/682545613 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2bb00cbef0 0x7f2bb0156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.584+0000 7f2bb69d5640 1 -- 172.21.15.77:0/682545613 >> 172.21.15.77:0/682545613 conn(0x7f2bb0067080 msgr2=0x7f2bb0067460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:47.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.584+0000 7f2bb69d5640 1 -- 172.21.15.77:0/682545613 shutdown_connections 2024-04-25T01:39:47.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.584+0000 7f2bb69d5640 1 -- 172.21.15.77:0/682545613 wait complete. 2024-04-25T01:39:47.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.585+0000 7f2bb69d5640 1 Processor -- start 2024-04-25T01:39:47.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.585+0000 7f2bb69d5640 1 -- start start 2024-04-25T01:39:47.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.586+0000 7f2bb69d5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bb00cbef0 0x7f2bb0155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:47.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.586+0000 7f2bb69d5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bb014fd20 0x7f2bb014ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:47.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.586+0000 7f2bb69d5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2bb015a0e0 0x7f2bb01ecc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:47.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.586+0000 7f2bb69d5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb006d0d0 con 0x7f2bb00cbef0 2024-04-25T01:39:47.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.586+0000 7f2bb69d5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb00c9d50 con 0x7f2bb014fd20 2024-04-25T01:39:47.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.586+0000 7f2bb69d5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f2bb015a500 con 0x7f2bb015a0e0 2024-04-25T01:39:47.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.586+0000 7f2baffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bb00cbef0 0x7f2bb0155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:47.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.586+0000 7f2baffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bb00cbef0 0x7f2bb0155840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44842/0 (socket says 172.21.15.77:44842) 2024-04-25T01:39:47.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.586+0000 7f2baffff640 1 -- 172.21.15.77:0/1722866 learned_addr learned my addr 172.21.15.77:0/1722866 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:47.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.586+0000 7f2baf7fe640 1 --2- 172.21.15.77:0/1722866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bb014fd20 0x7f2bb014ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:47.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.586+0000 7f2bb4f72640 1 --2- 172.21.15.77:0/1722866 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2bb015a0e0 0x7f2bb01ecc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:47.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.586+0000 7f2baffff640 1 -- 172.21.15.77:0/1722866 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2bb015a0e0 msgr2=0x7f2bb01ecc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:47.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.586+0000 7f2baffff640 1 --2- 172.21.15.77:0/1722866 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2bb015a0e0 0x7f2bb01ecc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.586+0000 7f2baffff640 1 -- 172.21.15.77:0/1722866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bb014fd20 msgr2=0x7f2bb014ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:47.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.586+0000 7f2baffff640 1 --2- 172.21.15.77:0/1722866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bb014fd20 0x7f2bb014ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.586+0000 7f2baffff640 1 -- 172.21.15.77:0/1722866 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb00c4c90 con 0x7f2bb00cbef0 2024-04-25T01:39:47.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.586+0000 7f2baf7fe640 1 --2- 172.21.15.77:0/1722866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bb014fd20 0x7f2bb014ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:47.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.586+0000 7f2bb4f72640 1 --2- 172.21.15.77:0/1722866 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2bb015a0e0 0x7f2bb01ecc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:47.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.586+0000 7f2baffff640 1 --2- 172.21.15.77:0/1722866 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bb00cbef0 0x7f2bb0155840 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000d830 tx=0x7f2ba000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:47.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.586+0000 7f2bacff9640 1 -- 172.21.15.77:0/1722866 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0018030 con 0x7f2bb00cbef0 2024-04-25T01:39:47.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.586+0000 7f2bacff9640 1 -- 172.21.15.77:0/1722866 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ba000be10 con 0x7f2bb00cbef0 2024-04-25T01:39:47.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.586+0000 7f2bb69d5640 1 -- 172.21.15.77:0/1722866 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bb01efab0 con 0x7f2bb00cbef0 2024-04-25T01:39:47.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.586+0000 7f2bacff9640 1 -- 172.21.15.77:0/1722866 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba00098b0 con 0x7f2bb00cbef0 2024-04-25T01:39:47.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.586+0000 7f2bb69d5640 1 -- 172.21.15.77:0/1722866 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bb0154d60 con 0x7f2bb00cbef0 2024-04-25T01:39:47.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.587+0000 7f2bb69d5640 1 -- 172.21.15.77:0/1722866 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bb004f500 con 0x7f2bb00cbef0 2024-04-25T01:39:47.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.588+0000 7f2bacff9640 1 -- 172.21.15.77:0/1722866 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2ba001b070 con 0x7f2bb00cbef0 2024-04-25T01:39:47.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.588+0000 7f2bacff9640 1 --2- 172.21.15.77:0/1722866 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2b9c06be30 0x7f2b9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:47.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.588+0000 7f2baf7fe640 1 --2- 172.21.15.77:0/1722866 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2b9c06be30 0x7f2b9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:47.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.588+0000 7f2bacff9640 1 -- 172.21.15.77:0/1722866 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f2ba008b3c0 con 0x7f2bb00cbef0 2024-04-25T01:39:47.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.588+0000 7f2baf7fe640 1 --2- 172.21.15.77:0/1722866 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2b9c06be30 0x7f2b9c06e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4034000 tx=0x7f2ba402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:47.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.592+0000 7f2bacff9640 1 -- 172.21.15.77:0/1722866 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2ba0059a40 con 0x7f2bb00cbef0 2024-04-25T01:39:47.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.769+0000 7f2bb69d5640 1 -- 172.21.15.77:0/1722866 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2bb006ce20 con 0x7f2bb00cbef0 2024-04-25T01:39:47.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.770+0000 7f2bacff9640 1 -- 172.21.15.77:0/1722866 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f2ba0059340 con 0x7f2bb00cbef0 2024-04-25T01:39:47.753 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-25T01:39:47.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.772+0000 7f2bb69d5640 1 -- 172.21.15.77:0/1722866 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2b9c06be30 msgr2=0x7f2b9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:47.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.772+0000 7f2bb69d5640 1 --2- 172.21.15.77:0/1722866 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2b9c06be30 0x7f2b9c06e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4034000 tx=0x7f2ba402e000 comp rx=0 tx=0).stop 2024-04-25T01:39:47.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.772+0000 7f2bb69d5640 1 -- 172.21.15.77:0/1722866 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bb00cbef0 msgr2=0x7f2bb0155840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:47.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.772+0000 7f2bb69d5640 1 --2- 172.21.15.77:0/1722866 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bb00cbef0 0x7f2bb0155840 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000d830 tx=0x7f2ba000dcf0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.772+0000 7f2bb69d5640 1 -- 172.21.15.77:0/1722866 shutdown_connections 2024-04-25T01:39:47.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.772+0000 7f2bb69d5640 1 --2- 172.21.15.77:0/1722866 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2b9c06be30 0x7f2b9c06e2f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.772+0000 7f2bb69d5640 1 --2- 172.21.15.77:0/1722866 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2bb015a0e0 0x7f2bb01ecc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.772+0000 7f2bb69d5640 1 --2- 172.21.15.77:0/1722866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bb014fd20 0x7f2bb014ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.772+0000 7f2bb69d5640 1 --2- 172.21.15.77:0/1722866 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bb00cbef0 0x7f2bb0155840 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.772+0000 7f2bb69d5640 1 -- 172.21.15.77:0/1722866 >> 172.21.15.77:0/1722866 conn(0x7f2bb0067080 msgr2=0x7f2bb01580c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:47.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.772+0000 7f2bb69d5640 1 -- 172.21.15.77:0/1722866 shutdown_connections 2024-04-25T01:39:47.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.772+0000 7f2bb69d5640 1 -- 172.21.15.77:0/1722866 wait complete. 2024-04-25T01:39:47.767 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-25T01:39:47.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.882+0000 7f4721510640 1 Processor -- start 2024-04-25T01:39:47.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.882+0000 7f4721510640 1 -- start start 2024-04-25T01:39:47.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.883+0000 7f4721510640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f471c06d470 0x7f471c06d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:47.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.883+0000 7f4721510640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f471c0acf70 con 0x7f471c0c4d10 2024-04-25T01:39:47.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.883+0000 7f4721510640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f471c153120 con 0x7f471c0c6c50 2024-04-25T01:39:47.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.883+0000 7f4721510640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f471c0acd20 con 0x7f471c06d470 2024-04-25T01:39:47.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.883+0000 7f471b7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f471c0c4d10 0x7f471c0c2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:37922/0 (socket says 172.21.15.77:37922) 2024-04-25T01:39:47.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.883+0000 7f471b7fe640 1 -- 172.21.15.77:0/318237728 learned_addr learned my addr 172.21.15.77:0/318237728 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:47.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.884+0000 7f471affd640 1 --2- 172.21.15.77:0/318237728 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f471c06d470 0x7f471c06d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:47.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.884+0000 7f4719ffb640 1 -- 172.21.15.77:0/318237728 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2555704383 0 0) 0x7f471c0acf70 con 0x7f471c0c4d10 2024-04-25T01:39:47.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.884+0000 7f4719ffb640 1 -- 172.21.15.77:0/318237728 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4704003520 con 0x7f471c0c4d10 2024-04-25T01:39:47.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.884+0000 7f4719ffb640 1 -- 172.21.15.77:0/318237728 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2915677782 0 0) 0x7f4704003520 con 0x7f471c0c4d10 2024-04-25T01:39:47.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.884+0000 7f4719ffb640 1 -- 172.21.15.77:0/318237728 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f471c06d470 msgr2=0x7f471c06d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:47.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.884+0000 7f4719ffb640 1 --2- 172.21.15.77:0/318237728 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f471c06d470 0x7f471c06d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.884+0000 7f4719ffb640 1 -- 172.21.15.77:0/318237728 >> v1:172.21.15.121:6789/0 conn(0x7f471c0c6c50 legacy=0x7f471c0abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:47.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.884+0000 7f4719ffb640 1 -- 172.21.15.77:0/318237728 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f471c153400 con 0x7f471c0c4d10 2024-04-25T01:39:47.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.884+0000 7f4719ffb640 1 -- 172.21.15.77:0/318237728 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7f4714001670 con 0x7f471c0c4d10 2024-04-25T01:39:47.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.884+0000 7f4719ffb640 1 -- 172.21.15.77:0/318237728 >> v1:172.21.15.77:6789/0 conn(0x7f471c0c4d10 legacy=0x7f471c0c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:47.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.884+0000 7f4719ffb640 1 --2- 172.21.15.77:0/318237728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47040039e0 0x7f4704003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:47.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.884+0000 7f4719ffb640 1 --2- 172.21.15.77:0/318237728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4704004800 0x7f4704004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:47.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.884+0000 7f4719ffb640 1 --2- 172.21.15.77:0/318237728 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f471c06d470 0x7f470400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:47.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.884+0000 7f4719ffb640 1 -- 172.21.15.77:0/318237728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f471c0acd20 con 0x7f4704004800 2024-04-25T01:39:47.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.884+0000 7f4719ffb640 1 -- 172.21.15.77:0/318237728 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4704005520 con 0x7f47040039e0 2024-04-25T01:39:47.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.884+0000 7f4719ffb640 1 -- 172.21.15.77:0/318237728 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f470400bf00 con 0x7f471c06d470 2024-04-25T01:39:47.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.884+0000 7f471a7fc640 1 --2- 172.21.15.77:0/318237728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4704004800 0x7f4704004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:47.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.884+0000 7f471affd640 1 --2- 172.21.15.77:0/318237728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47040039e0 0x7f4704003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:47.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.884+0000 7f471b7fe640 1 --2- 172.21.15.77:0/318237728 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f471c06d470 0x7f470400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:47.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.884+0000 7f471a7fc640 1 -- 172.21.15.77:0/318237728 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f471c06d470 msgr2=0x7f470400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:47.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.884+0000 7f471a7fc640 1 --2- 172.21.15.77:0/318237728 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f471c06d470 0x7f470400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.884+0000 7f471a7fc640 1 -- 172.21.15.77:0/318237728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47040039e0 msgr2=0x7f4704003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:47.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.884+0000 7f471a7fc640 1 --2- 172.21.15.77:0/318237728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47040039e0 0x7f4704003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.884+0000 7f471a7fc640 1 -- 172.21.15.77:0/318237728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4704003520 con 0x7f4704004800 2024-04-25T01:39:47.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.885+0000 7f471a7fc640 1 --2- 172.21.15.77:0/318237728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4704004800 0x7f4704004c80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4710001720 tx=0x7f4704005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=370ca92a643a618d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:47.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.885+0000 7f4719ffb640 1 -- 172.21.15.77:0/318237728 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4710001370 con 0x7f4704004800 2024-04-25T01:39:47.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.885+0000 7f4719ffb640 1 -- 172.21.15.77:0/318237728 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47100052d0 con 0x7f4704004800 2024-04-25T01:39:47.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.885+0000 7f4719ffb640 1 -- 172.21.15.77:0/318237728 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471002abc0 con 0x7f4704004800 2024-04-25T01:39:47.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.886+0000 7f4721510640 1 -- 172.21.15.77:0/318237728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4704004800 msgr2=0x7f4704004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:47.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.886+0000 7f4721510640 1 --2- 172.21.15.77:0/318237728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4704004800 0x7f4704004c80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4710001720 tx=0x7f4704005830 comp rx=0 tx=0).stop 2024-04-25T01:39:47.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.886+0000 7f471b7fe640 1 -- 172.21.15.77:0/318237728 reap_dead start 2024-04-25T01:39:47.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.886+0000 7f4721510640 1 -- 172.21.15.77:0/318237728 shutdown_connections 2024-04-25T01:39:47.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.886+0000 7f4721510640 1 -- 172.21.15.77:0/318237728 >> 172.21.15.77:0/318237728 conn(0x7f471c0c7580 msgr2=0x7f471c0c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:47.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.886+0000 7f4721510640 1 -- 172.21.15.77:0/318237728 shutdown_connections 2024-04-25T01:39:47.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.886+0000 7f4721510640 1 -- 172.21.15.77:0/318237728 wait complete. 2024-04-25T01:39:47.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.887+0000 7f4721510640 1 Processor -- start 2024-04-25T01:39:47.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.887+0000 7f4721510640 1 -- start start 2024-04-25T01:39:47.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.888+0000 7f4721510640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4704004800 0x7f471c0bca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:47.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.888+0000 7f4721510640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f471c1ed1b0 0x7f471c0726a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:47.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.888+0000 7f4721510640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f471c1e9aa0 0x7f471c14a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:47.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.888+0000 7f4721510640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f471c0c2a50 con 0x7f4704004800 2024-04-25T01:39:47.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.888+0000 7f4721510640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f471c0ac970 con 0x7f471c1e9aa0 2024-04-25T01:39:47.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.888+0000 7f4721510640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f471c0c2bd0 con 0x7f471c1ed1b0 2024-04-25T01:39:47.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.888+0000 7f471affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4704004800 0x7f471c0bca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:47.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.888+0000 7f471affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4704004800 0x7f471c0bca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44866/0 (socket says 172.21.15.77:44866) 2024-04-25T01:39:47.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.888+0000 7f471affd640 1 -- 172.21.15.77:0/2527988040 learned_addr learned my addr 172.21.15.77:0/2527988040 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:47.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.888+0000 7f471b7fe640 1 --2- 172.21.15.77:0/2527988040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f471c1e9aa0 0x7f471c14a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:47.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.888+0000 7f471affd640 1 -- 172.21.15.77:0/2527988040 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f471c1ed1b0 msgr2=0x7f471c0726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:47.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.888+0000 7f471a7fc640 1 --2- 172.21.15.77:0/2527988040 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f471c1ed1b0 0x7f471c0726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:47.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.888+0000 7f471affd640 1 --2- 172.21.15.77:0/2527988040 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f471c1ed1b0 0x7f471c0726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.888+0000 7f471affd640 1 -- 172.21.15.77:0/2527988040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f471c1e9aa0 msgr2=0x7f471c14a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:47.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.888+0000 7f471affd640 1 --2- 172.21.15.77:0/2527988040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f471c1e9aa0 0x7f471c14a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:47.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.888+0000 7f471affd640 1 -- 172.21.15.77:0/2527988040 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f471c14d220 con 0x7f4704004800 2024-04-25T01:39:47.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.888+0000 7f471affd640 1 --2- 172.21.15.77:0/2527988040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4704004800 0x7f471c0bca60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f470c011e30 tx=0x7f470c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:47.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.888+0000 7f47037fe640 1 -- 172.21.15.77:0/2527988040 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c015630 con 0x7f4704004800 2024-04-25T01:39:47.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.888+0000 7f47037fe640 1 -- 172.21.15.77:0/2527988040 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f470c0157d0 con 0x7f4704004800 2024-04-25T01:39:47.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.888+0000 7f4721510640 1 -- 172.21.15.77:0/2527988040 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f471c14d500 con 0x7f4704004800 2024-04-25T01:39:47.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.888+0000 7f47037fe640 1 -- 172.21.15.77:0/2527988040 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c015ba0 con 0x7f4704004800 2024-04-25T01:39:47.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.888+0000 7f4721510640 1 -- 172.21.15.77:0/2527988040 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f471c14dac0 con 0x7f4704004800 2024-04-25T01:39:47.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.889+0000 7f4721510640 1 -- 172.21.15.77:0/2527988040 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f471c04f500 con 0x7f4704004800 2024-04-25T01:39:47.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.890+0000 7f47037fe640 1 -- 172.21.15.77:0/2527988040 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f470c01d400 con 0x7f4704004800 2024-04-25T01:39:47.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.890+0000 7f47037fe640 1 --2- 172.21.15.77:0/2527988040 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f470806be60 0x7f470806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:47.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.890+0000 7f471a7fc640 1 --2- 172.21.15.77:0/2527988040 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f470806be60 0x7f470806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:47.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.890+0000 7f47037fe640 1 -- 172.21.15.77:0/2527988040 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f470c08c300 con 0x7f4704004800 2024-04-25T01:39:47.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.890+0000 7f471a7fc640 1 --2- 172.21.15.77:0/2527988040 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f470806be60 0x7f470806e320 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4710032000 tx=0x7f471002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:47.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:47.894+0000 7f47037fe640 1 -- 172.21.15.77:0/2527988040 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f470c019030 con 0x7f4704004800 2024-04-25T01:39:48.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.065+0000 7f4721510640 1 -- 172.21.15.77:0/2527988040 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7f471c0678b0 con 0x7f4704004800 2024-04-25T01:39:48.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.066+0000 7f47037fe640 1 -- 172.21.15.77:0/2527988040 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v24) ==== 99+0+11 (secure 0 0 0) 0x7f470c010040 con 0x7f4704004800 2024-04-25T01:39:48.049 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T01:39:48.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.067+0000 7f4721510640 1 -- 172.21.15.77:0/2527988040 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f470806be60 msgr2=0x7f470806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:48.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.067+0000 7f4721510640 1 --2- 172.21.15.77:0/2527988040 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f470806be60 0x7f470806e320 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4710032000 tx=0x7f471002e000 comp rx=0 tx=0).stop 2024-04-25T01:39:48.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.067+0000 7f4721510640 1 -- 172.21.15.77:0/2527988040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4704004800 msgr2=0x7f471c0bca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:48.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.067+0000 7f4721510640 1 --2- 172.21.15.77:0/2527988040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4704004800 0x7f471c0bca60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f470c011e30 tx=0x7f470c00f580 comp rx=0 tx=0).stop 2024-04-25T01:39:48.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.067+0000 7f4721510640 1 -- 172.21.15.77:0/2527988040 shutdown_connections 2024-04-25T01:39:48.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.067+0000 7f4721510640 1 --2- 172.21.15.77:0/2527988040 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f470806be60 0x7f470806e320 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.067+0000 7f4721510640 1 --2- 172.21.15.77:0/2527988040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f471c1e9aa0 0x7f471c14a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.067+0000 7f4721510640 1 --2- 172.21.15.77:0/2527988040 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f471c1ed1b0 0x7f471c0726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.067+0000 7f4721510640 1 --2- 172.21.15.77:0/2527988040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4704004800 0x7f471c0bca60 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.068+0000 7f4721510640 1 -- 172.21.15.77:0/2527988040 >> 172.21.15.77:0/2527988040 conn(0x7f471c0c7580 msgr2=0x7f471c14fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:48.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.068+0000 7f4721510640 1 -- 172.21.15.77:0/2527988040 shutdown_connections 2024-04-25T01:39:48.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.068+0000 7f4721510640 1 -- 172.21.15.77:0/2527988040 wait complete. 2024-04-25T01:39:48.062 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-25T01:39:48.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.178+0000 7fc6776b3640 1 Processor -- start 2024-04-25T01:39:48.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.178+0000 7fc6776b3640 1 -- start start 2024-04-25T01:39:48.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.179+0000 7fc6776b3640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc670154030 0x7fc670070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:48.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.179+0000 7fc6776b3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc6700a74f0 0x7fc6700c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:48.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.179+0000 7fc6776b3640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc670154c60 con 0x7fc670154410 2024-04-25T01:39:48.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.179+0000 7fc6776b3640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc6700c5b10 con 0x7fc670154030 2024-04-25T01:39:48.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.179+0000 7fc6776b3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc670072fe0 con 0x7fc6700a74f0 2024-04-25T01:39:48.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.179+0000 7fc67544f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc670154030 0x7fc670070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:48.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.179+0000 7fc67544f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc670154030 0x7fc670070ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44876/0 (socket says 172.21.15.77:44876) 2024-04-25T01:39:48.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.179+0000 7fc67544f640 1 -- 172.21.15.77:0/86418345 learned_addr learned my addr 172.21.15.77:0/86418345 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:48.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.179+0000 7fc675c50640 1 --2- 172.21.15.77:0/86418345 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc6700a74f0 0x7fc6700c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:48.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.179+0000 7fc67544f640 1 -- 172.21.15.77:0/86418345 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc6700a74f0 msgr2=0x7fc6700c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:48.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.179+0000 7fc67544f640 1 --2- 172.21.15.77:0/86418345 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc6700a74f0 0x7fc6700c5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.179+0000 7fc67544f640 1 -- 172.21.15.77:0/86418345 >> v1:172.21.15.121:6789/0 conn(0x7fc670154410 legacy=0x7fc6700a6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:48.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.179+0000 7fc67544f640 1 -- 172.21.15.77:0/86418345 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6700732c0 con 0x7fc670154030 2024-04-25T01:39:48.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.180+0000 7fc67544f640 1 --2- 172.21.15.77:0/86418345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc670154030 0x7fc670070ad0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc66c009870 tx=0x7fc66c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3e652177c9ae65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:48.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.180+0000 7fc667fff640 1 -- 172.21.15.77:0/86418345 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc66c037070 con 0x7fc670154030 2024-04-25T01:39:48.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.180+0000 7fc667fff640 1 -- 172.21.15.77:0/86418345 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc66c032440 con 0x7fc670154030 2024-04-25T01:39:48.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.180+0000 7fc667fff640 1 -- 172.21.15.77:0/86418345 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc66c032810 con 0x7fc670154030 2024-04-25T01:39:48.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.180+0000 7fc6776b3640 1 -- 172.21.15.77:0/86418345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc670154030 msgr2=0x7fc670070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:48.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.180+0000 7fc6776b3640 1 --2- 172.21.15.77:0/86418345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc670154030 0x7fc670070ad0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc66c009870 tx=0x7fc66c02a1c0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.180+0000 7fc6776b3640 1 -- 172.21.15.77:0/86418345 shutdown_connections 2024-04-25T01:39:48.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.180+0000 7fc6776b3640 1 --2- 172.21.15.77:0/86418345 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc6700a74f0 0x7fc6700c5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.180+0000 7fc6776b3640 1 --2- 172.21.15.77:0/86418345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc670154030 0x7fc670070ad0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.180+0000 7fc6776b3640 1 -- 172.21.15.77:0/86418345 >> 172.21.15.77:0/86418345 conn(0x7fc6700c46d0 msgr2=0x7fc6700c4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:48.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.180+0000 7fc6776b3640 1 -- 172.21.15.77:0/86418345 shutdown_connections 2024-04-25T01:39:48.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.181+0000 7fc6776b3640 1 -- 172.21.15.77:0/86418345 wait complete. 2024-04-25T01:39:48.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.182+0000 7fc6776b3640 1 Processor -- start 2024-04-25T01:39:48.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.182+0000 7fc6776b3640 1 -- start start 2024-04-25T01:39:48.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.182+0000 7fc6776b3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6700a74f0 0x7fc6701e0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.182+0000 7fc6776b3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc670154030 0x7fc670144170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.182+0000 7fc6776b3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc670154410 0x7fc67006ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.182+0000 7fc6776b3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc670154870 con 0x7fc6700a74f0 2024-04-25T01:39:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.182+0000 7fc6776b3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc6700670c0 con 0x7fc670154030 2024-04-25T01:39:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.182+0000 7fc6776b3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc6701549f0 con 0x7fc670154410 2024-04-25T01:39:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.182+0000 7fc67544f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6700a74f0 0x7fc6701e0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.182+0000 7fc67544f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6700a74f0 0x7fc6701e0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44880/0 (socket says 172.21.15.77:44880) 2024-04-25T01:39:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.182+0000 7fc67544f640 1 -- 172.21.15.77:0/3996968123 learned_addr learned my addr 172.21.15.77:0/3996968123 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.182+0000 7fc674c4e640 1 --2- 172.21.15.77:0/3996968123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc670154030 0x7fc670144170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.182+0000 7fc675c50640 1 --2- 172.21.15.77:0/3996968123 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc670154410 0x7fc67006ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.183+0000 7fc67544f640 1 -- 172.21.15.77:0/3996968123 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc670154410 msgr2=0x7fc67006ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.183+0000 7fc67544f640 1 --2- 172.21.15.77:0/3996968123 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc670154410 0x7fc67006ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.183+0000 7fc67544f640 1 -- 172.21.15.77:0/3996968123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc670154030 msgr2=0x7fc670144170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.183+0000 7fc67544f640 1 --2- 172.21.15.77:0/3996968123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc670154030 0x7fc670144170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.183+0000 7fc67544f640 1 -- 172.21.15.77:0/3996968123 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc67014d940 con 0x7fc6700a74f0 2024-04-25T01:39:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.183+0000 7fc67544f640 1 --2- 172.21.15.77:0/3996968123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6700a74f0 0x7fc6701e0c50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc66c000c00 tx=0x7fc66c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.183+0000 7fc665ffb640 1 -- 172.21.15.77:0/3996968123 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc66c041020 con 0x7fc6700a74f0 2024-04-25T01:39:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.183+0000 7fc665ffb640 1 -- 172.21.15.77:0/3996968123 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc66c0306c0 con 0x7fc6700a74f0 2024-04-25T01:39:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.183+0000 7fc6776b3640 1 -- 172.21.15.77:0/3996968123 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6701eba10 con 0x7fc6700a74f0 2024-04-25T01:39:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.183+0000 7fc665ffb640 1 -- 172.21.15.77:0/3996968123 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc66c037040 con 0x7fc6700a74f0 2024-04-25T01:39:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.183+0000 7fc6776b3640 1 -- 172.21.15.77:0/3996968123 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6701ebfd0 con 0x7fc6700a74f0 2024-04-25T01:39:48.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.184+0000 7fc6776b3640 1 -- 172.21.15.77:0/3996968123 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc67004f500 con 0x7fc6700a74f0 2024-04-25T01:39:48.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.184+0000 7fc665ffb640 1 -- 172.21.15.77:0/3996968123 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc66c044020 con 0x7fc6700a74f0 2024-04-25T01:39:48.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.185+0000 7fc665ffb640 1 --2- 172.21.15.77:0/3996968123 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc65406be30 0x7fc65406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:48.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.185+0000 7fc665ffb640 1 -- 172.21.15.77:0/3996968123 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fc66c0ab800 con 0x7fc6700a74f0 2024-04-25T01:39:48.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.185+0000 7fc674c4e640 1 --2- 172.21.15.77:0/3996968123 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc65406be30 0x7fc65406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:48.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.185+0000 7fc674c4e640 1 --2- 172.21.15.77:0/3996968123 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc65406be30 0x7fc65406e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc6700adcf0 tx=0x7fc660009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:48.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.189+0000 7fc665ffb640 1 -- 172.21.15.77:0/3996968123 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc66c04b030 con 0x7fc6700a74f0 2024-04-25T01:39:48.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.361+0000 7fc6776b3640 1 -- 172.21.15.77:0/3996968123 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7fc670066ea0 con 0x7fc6700a74f0 2024-04-25T01:39:48.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.362+0000 7fc665ffb640 1 -- 172.21.15.77:0/3996968123 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v24) ==== 95+0+11 (secure 0 0 0) 0x7fc66c0a9e20 con 0x7fc6700a74f0 2024-04-25T01:39:48.345 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-25T01:39:48.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.364+0000 7fc6776b3640 1 -- 172.21.15.77:0/3996968123 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc65406be30 msgr2=0x7fc65406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:48.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.364+0000 7fc6776b3640 1 --2- 172.21.15.77:0/3996968123 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc65406be30 0x7fc65406e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc6700adcf0 tx=0x7fc660009040 comp rx=0 tx=0).stop 2024-04-25T01:39:48.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.364+0000 7fc6776b3640 1 -- 172.21.15.77:0/3996968123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6700a74f0 msgr2=0x7fc6701e0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:48.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.364+0000 7fc6776b3640 1 --2- 172.21.15.77:0/3996968123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6700a74f0 0x7fc6701e0c50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc66c000c00 tx=0x7fc66c0046c0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.364+0000 7fc6776b3640 1 -- 172.21.15.77:0/3996968123 shutdown_connections 2024-04-25T01:39:48.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.364+0000 7fc6776b3640 1 --2- 172.21.15.77:0/3996968123 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc65406be30 0x7fc65406e2f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.364+0000 7fc6776b3640 1 --2- 172.21.15.77:0/3996968123 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc670154410 0x7fc67006ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.364+0000 7fc6776b3640 1 --2- 172.21.15.77:0/3996968123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc670154030 0x7fc670144170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.364+0000 7fc6776b3640 1 --2- 172.21.15.77:0/3996968123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6700a74f0 0x7fc6701e0c50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.364+0000 7fc6776b3640 1 -- 172.21.15.77:0/3996968123 >> 172.21.15.77:0/3996968123 conn(0x7fc6700c46d0 msgr2=0x7fc6700a78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:48.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.364+0000 7fc6776b3640 1 -- 172.21.15.77:0/3996968123 shutdown_connections 2024-04-25T01:39:48.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.364+0000 7fc6776b3640 1 -- 172.21.15.77:0/3996968123 wait complete. 2024-04-25T01:39:48.358 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-25T01:39:48.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.476+0000 7f0ba3309640 1 Processor -- start 2024-04-25T01:39:48.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.476+0000 7f0ba3309640 1 -- start start 2024-04-25T01:39:48.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.477+0000 7f0ba3309640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0b9c154030 0x7f0b9c070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:48.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.477+0000 7f0ba3309640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b9c154c60 con 0x7f0b9c154410 2024-04-25T01:39:48.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.477+0000 7f0ba3309640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b9c072fe0 con 0x7f0b9c0a74f0 2024-04-25T01:39:48.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.477+0000 7f0ba3309640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f0b9c0c5b10 con 0x7f0b9c154030 2024-04-25T01:39:48.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.477+0000 7f0ba08a4640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0b9c154410 0x7f0b9c0a6de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:37928/0 (socket says 172.21.15.77:37928) 2024-04-25T01:39:48.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.477+0000 7f0ba08a4640 1 -- 172.21.15.77:0/1675276906 learned_addr learned my addr 172.21.15.77:0/1675276906 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:48.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.477+0000 7f0ba10a5640 1 --2- 172.21.15.77:0/1675276906 >> v2:172.21.15.121:3300/0 conn(0x7f0b9c154030 0x7f0b9c070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:48.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.477+0000 7f0b93fff640 1 -- 172.21.15.77:0/1675276906 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3402399792 0 0) 0x7f0b9c154c60 con 0x7f0b9c154410 2024-04-25T01:39:48.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.477+0000 7f0b93fff640 1 -- 172.21.15.77:0/1675276906 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b88003520 con 0x7f0b9c154410 2024-04-25T01:39:48.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.477+0000 7f0b93fff640 1 -- 172.21.15.77:0/1675276906 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 521760867 0 0) 0x7f0b9c072fe0 con 0x7f0b9c0a74f0 2024-04-25T01:39:48.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.478+0000 7f0b93fff640 1 -- 172.21.15.77:0/1675276906 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b9c154c60 con 0x7f0b9c0a74f0 2024-04-25T01:39:48.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.478+0000 7f0ba10a5640 1 -- 172.21.15.77:0/1675276906 >> v1:172.21.15.121:6789/0 conn(0x7f0b9c0a74f0 legacy=0x7f0b9c0c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:48.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.478+0000 7f0ba10a5640 1 -- 172.21.15.77:0/1675276906 >> v1:172.21.15.77:6789/0 conn(0x7f0b9c154410 legacy=0x7f0b9c0a6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:48.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.478+0000 7f0ba10a5640 1 -- 172.21.15.77:0/1675276906 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9c0732c0 con 0x7f0b9c154030 2024-04-25T01:39:48.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.478+0000 7f0ba10a5640 1 --2- 172.21.15.77:0/1675276906 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b9c154030 0x7f0b9c070ad0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c0c5c90 tx=0x7f0b9802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f759d8b279dfcaf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:48.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.478+0000 7f0b93fff640 1 -- 172.21.15.77:0/1675276906 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b98037070 con 0x7f0b9c154030 2024-04-25T01:39:48.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.479+0000 7f0b93fff640 1 -- 172.21.15.77:0/1675276906 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b98032440 con 0x7f0b9c154030 2024-04-25T01:39:48.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.479+0000 7f0b93fff640 1 -- 172.21.15.77:0/1675276906 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b980327f0 con 0x7f0b9c154030 2024-04-25T01:39:48.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.479+0000 7f0ba3309640 1 -- 172.21.15.77:0/1675276906 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b9c154030 msgr2=0x7f0b9c070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:48.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.479+0000 7f0ba3309640 1 --2- 172.21.15.77:0/1675276906 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b9c154030 0x7f0b9c070ad0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c0c5c90 tx=0x7f0b9802a180 comp rx=0 tx=0).stop 2024-04-25T01:39:48.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.479+0000 7f0ba3309640 1 -- 172.21.15.77:0/1675276906 shutdown_connections 2024-04-25T01:39:48.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.479+0000 7f0ba3309640 1 --2- 172.21.15.77:0/1675276906 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b9c154030 0x7f0b9c070ad0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.479+0000 7f0ba3309640 1 -- 172.21.15.77:0/1675276906 >> 172.21.15.77:0/1675276906 conn(0x7f0b9c0c46d0 msgr2=0x7f0b9c0c4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:48.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.479+0000 7f0ba3309640 1 -- 172.21.15.77:0/1675276906 shutdown_connections 2024-04-25T01:39:48.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.479+0000 7f0ba3309640 1 -- 172.21.15.77:0/1675276906 wait complete. 2024-04-25T01:39:48.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.480+0000 7f0ba3309640 1 Processor -- start 2024-04-25T01:39:48.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.480+0000 7f0ba3309640 1 -- start start 2024-04-25T01:39:48.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.481+0000 7f0ba3309640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0b9c0a74f0 0x7f0b9c14c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:48.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.481+0000 7f0ba3309640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b9c154030 0x7f0b9c14e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:48.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.481+0000 7f0ba3309640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b9c154410 0x7f0b9c0ad070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:48.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.481+0000 7f0ba3309640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9c154870 con 0x7f0b9c154410 2024-04-25T01:39:48.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.481+0000 7f0ba3309640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9c0670c0 con 0x7f0b9c154030 2024-04-25T01:39:48.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.481+0000 7f0ba3309640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f0b9c1549f0 con 0x7f0b9c0a74f0 2024-04-25T01:39:48.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.481+0000 7f0ba18a6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b9c154410 0x7f0b9c0ad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:48.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.481+0000 7f0ba18a6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b9c154410 0x7f0b9c0ad070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44894/0 (socket says 172.21.15.77:44894) 2024-04-25T01:39:48.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.481+0000 7f0ba18a6640 1 -- 172.21.15.77:0/4273382004 learned_addr learned my addr 172.21.15.77:0/4273382004 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:48.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.481+0000 7f0ba08a4640 1 --2- 172.21.15.77:0/4273382004 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b9c154030 0x7f0b9c14e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:48.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.481+0000 7f0ba10a5640 1 --2- 172.21.15.77:0/4273382004 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0b9c0a74f0 0x7f0b9c14c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:48.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.481+0000 7f0ba18a6640 1 -- 172.21.15.77:0/4273382004 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0b9c0a74f0 msgr2=0x7f0b9c14c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:48.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.481+0000 7f0ba18a6640 1 --2- 172.21.15.77:0/4273382004 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0b9c0a74f0 0x7f0b9c14c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.481+0000 7f0ba18a6640 1 -- 172.21.15.77:0/4273382004 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b9c154030 msgr2=0x7f0b9c14e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:48.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.481+0000 7f0ba18a6640 1 --2- 172.21.15.77:0/4273382004 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b9c154030 0x7f0b9c14e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.481+0000 7f0ba18a6640 1 -- 172.21.15.77:0/4273382004 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9c156d80 con 0x7f0b9c154410 2024-04-25T01:39:48.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.481+0000 7f0ba18a6640 1 --2- 172.21.15.77:0/4273382004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b9c154410 0x7f0b9c0ad070 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400c6e0 tx=0x7f0b9400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:48.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.481+0000 7f0b91ffb640 1 -- 172.21.15.77:0/4273382004 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b94003b70 con 0x7f0b9c154410 2024-04-25T01:39:48.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.482+0000 7f0b91ffb640 1 -- 172.21.15.77:0/4273382004 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b94003d10 con 0x7f0b9c154410 2024-04-25T01:39:48.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.482+0000 7f0ba3309640 1 -- 172.21.15.77:0/4273382004 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b9c157f00 con 0x7f0b9c154410 2024-04-25T01:39:48.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.482+0000 7f0b91ffb640 1 -- 172.21.15.77:0/4273382004 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b940052d0 con 0x7f0b9c154410 2024-04-25T01:39:48.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.482+0000 7f0ba3309640 1 -- 172.21.15.77:0/4273382004 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b9c1ed760 con 0x7f0b9c154410 2024-04-25T01:39:48.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.483+0000 7f0ba3309640 1 -- 172.21.15.77:0/4273382004 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b9c04f500 con 0x7f0b9c154410 2024-04-25T01:39:48.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.483+0000 7f0b91ffb640 1 -- 172.21.15.77:0/4273382004 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0b94005470 con 0x7f0b9c154410 2024-04-25T01:39:48.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.483+0000 7f0b91ffb640 1 --2- 172.21.15.77:0/4273382004 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0b8006be30 0x7f0b8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:48.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.483+0000 7f0b91ffb640 1 -- 172.21.15.77:0/4273382004 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f0b9408aea0 con 0x7f0b9c154410 2024-04-25T01:39:48.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.483+0000 7f0ba10a5640 1 --2- 172.21.15.77:0/4273382004 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0b8006be30 0x7f0b8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:48.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.484+0000 7f0ba10a5640 1 --2- 172.21.15.77:0/4273382004 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0b8006be30 0x7f0b8006e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0b98034000 tx=0x7f0b9802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:48.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.488+0000 7f0b91ffb640 1 -- 172.21.15.77:0/4273382004 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0b94058f60 con 0x7f0b9c154410 2024-04-25T01:39:48.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.660+0000 7f0ba3309640 1 -- 172.21.15.77:0/4273382004 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7f0b9c066ea0 con 0x7f0b9c154410 2024-04-25T01:39:48.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.660+0000 7f0b91ffb640 1 -- 172.21.15.77:0/4273382004 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v24) ==== 99+0+11 (secure 0 0 0) 0x7f0b9405d260 con 0x7f0b9c154410 2024-04-25T01:39:48.644 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T01:39:48.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.662+0000 7f0ba3309640 1 -- 172.21.15.77:0/4273382004 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0b8006be30 msgr2=0x7f0b8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:48.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.662+0000 7f0ba3309640 1 --2- 172.21.15.77:0/4273382004 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0b8006be30 0x7f0b8006e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0b98034000 tx=0x7f0b9802e000 comp rx=0 tx=0).stop 2024-04-25T01:39:48.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.662+0000 7f0ba3309640 1 -- 172.21.15.77:0/4273382004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b9c154410 msgr2=0x7f0b9c0ad070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:48.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.662+0000 7f0ba3309640 1 --2- 172.21.15.77:0/4273382004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b9c154410 0x7f0b9c0ad070 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400c6e0 tx=0x7f0b9400cba0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.662+0000 7f0ba3309640 1 -- 172.21.15.77:0/4273382004 shutdown_connections 2024-04-25T01:39:48.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.662+0000 7f0ba3309640 1 --2- 172.21.15.77:0/4273382004 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0b8006be30 0x7f0b8006e2f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.662+0000 7f0ba3309640 1 --2- 172.21.15.77:0/4273382004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b9c154410 0x7f0b9c0ad070 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.662+0000 7f0ba3309640 1 --2- 172.21.15.77:0/4273382004 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b9c154030 0x7f0b9c14e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.662+0000 7f0ba3309640 1 --2- 172.21.15.77:0/4273382004 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0b9c0a74f0 0x7f0b9c14c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.662+0000 7f0ba3309640 1 -- 172.21.15.77:0/4273382004 >> 172.21.15.77:0/4273382004 conn(0x7f0b9c0c46d0 msgr2=0x7f0b9c0a7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:48.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.663+0000 7f0ba3309640 1 -- 172.21.15.77:0/4273382004 shutdown_connections 2024-04-25T01:39:48.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.663+0000 7f0ba3309640 1 -- 172.21.15.77:0/4273382004 wait complete. 2024-04-25T01:39:48.656 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-25T01:39:48.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.772+0000 7fc8c829a640 1 Processor -- start 2024-04-25T01:39:48.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.772+0000 7fc8c829a640 1 -- start start 2024-04-25T01:39:48.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.773+0000 7fc8c829a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc8c00c6c50 0x7fc8c00abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:48.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.773+0000 7fc8c829a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8c00acf70 con 0x7fc8c006d470 2024-04-25T01:39:48.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.773+0000 7fc8c829a640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8c0153120 con 0x7fc8c00c4d10 2024-04-25T01:39:48.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.773+0000 7fc8c829a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc8c00acd20 con 0x7fc8c00c6c50 2024-04-25T01:39:48.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.773+0000 7fc8c5835640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc8c00c6c50 0x7fc8c00abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:48.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.773+0000 7fc8c5835640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc8c00c6c50 0x7fc8c00abf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44898/0 (socket says 172.21.15.77:44898) 2024-04-25T01:39:48.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.773+0000 7fc8c6036640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc8c006d470 0x7fc8c006d850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:37942/0 (socket says 172.21.15.77:37942) 2024-04-25T01:39:48.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.773+0000 7fc8c5835640 1 -- 172.21.15.77:0/3043802275 learned_addr learned my addr 172.21.15.77:0/3043802275 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:48.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.773+0000 7fc8c5835640 1 -- 172.21.15.77:0/3043802275 >> v1:172.21.15.121:6789/0 conn(0x7fc8c00c4d10 legacy=0x7fc8c00c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:48.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.773+0000 7fc8c5835640 1 -- 172.21.15.77:0/3043802275 >> v1:172.21.15.77:6789/0 conn(0x7fc8c006d470 legacy=0x7fc8c006d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:48.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.773+0000 7fc8c5835640 1 -- 172.21.15.77:0/3043802275 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c0153400 con 0x7fc8c00c6c50 2024-04-25T01:39:48.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.773+0000 7fc8c5034640 1 -- 172.21.15.77:0/3043802275 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2622354323 0 0) 0x7fc8c00acf70 con 0x7fc8c006d470 2024-04-25T01:39:48.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.774+0000 7fc8c5835640 1 --2- 172.21.15.77:0/3043802275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8c00c6c50 0x7fc8c00abf90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0009870 tx=0x7fc8b002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20344ec4936df6a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:48.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.774+0000 7fc8c5034640 1 -- 172.21.15.77:0/3043802275 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0037070 con 0x7fc8c00c6c50 2024-04-25T01:39:48.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.774+0000 7fc8c5034640 1 -- 172.21.15.77:0/3043802275 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b0032440 con 0x7fc8c00c6c50 2024-04-25T01:39:48.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.774+0000 7fc8c5034640 1 -- 172.21.15.77:0/3043802275 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0032810 con 0x7fc8c00c6c50 2024-04-25T01:39:48.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.775+0000 7fc8c829a640 1 -- 172.21.15.77:0/3043802275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8c00c6c50 msgr2=0x7fc8c00abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:48.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.775+0000 7fc8c829a640 1 --2- 172.21.15.77:0/3043802275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8c00c6c50 0x7fc8c00abf90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0009870 tx=0x7fc8b002a180 comp rx=0 tx=0).stop 2024-04-25T01:39:48.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.775+0000 7fc8c829a640 1 -- 172.21.15.77:0/3043802275 shutdown_connections 2024-04-25T01:39:48.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.775+0000 7fc8c829a640 1 --2- 172.21.15.77:0/3043802275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8c00c6c50 0x7fc8c00abf90 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.775+0000 7fc8c829a640 1 -- 172.21.15.77:0/3043802275 >> 172.21.15.77:0/3043802275 conn(0x7fc8c00c7580 msgr2=0x7fc8c00c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:48.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.775+0000 7fc8c829a640 1 -- 172.21.15.77:0/3043802275 shutdown_connections 2024-04-25T01:39:48.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.775+0000 7fc8c829a640 1 -- 172.21.15.77:0/3043802275 wait complete. 2024-04-25T01:39:48.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.776+0000 7fc8c829a640 1 Processor -- start 2024-04-25T01:39:48.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.776+0000 7fc8c829a640 1 -- start start 2024-04-25T01:39:48.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.776+0000 7fc8c829a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8c006d470 0x7fc8c01ec3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:48.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.776+0000 7fc8c829a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc8c00c4d10 0x7fc8c0072ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:48.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.776+0000 7fc8c829a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8c00c6c50 0x7fc8c014d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:48.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.776+0000 7fc8c829a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c00ac860 con 0x7fc8c00c6c50 2024-04-25T01:39:48.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.776+0000 7fc8c829a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c00ac6e0 con 0x7fc8c006d470 2024-04-25T01:39:48.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.776+0000 7fc8c829a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc8c00c2a50 con 0x7fc8c00c4d10 2024-04-25T01:39:48.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.777+0000 7fc8c6837640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8c00c6c50 0x7fc8c014d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:48.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.777+0000 7fc8c6837640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8c00c6c50 0x7fc8c014d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44910/0 (socket says 172.21.15.77:44910) 2024-04-25T01:39:48.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.777+0000 7fc8c6837640 1 -- 172.21.15.77:0/784411992 learned_addr learned my addr 172.21.15.77:0/784411992 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:48.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.777+0000 7fc8c6837640 1 -- 172.21.15.77:0/784411992 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc8c00c4d10 msgr2=0x7fc8c0072ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:48.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.777+0000 7fc8c6837640 1 --2- 172.21.15.77:0/784411992 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc8c00c4d10 0x7fc8c0072ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.777+0000 7fc8c6837640 1 -- 172.21.15.77:0/784411992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8c006d470 msgr2=0x7fc8c01ec3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:48.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.777+0000 7fc8c6036640 1 --2- 172.21.15.77:0/784411992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8c006d470 0x7fc8c01ec3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:48.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.777+0000 7fc8c6837640 1 --2- 172.21.15.77:0/784411992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8c006d470 0x7fc8c01ec3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.777+0000 7fc8c6837640 1 -- 172.21.15.77:0/784411992 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c0072120 con 0x7fc8c00c6c50 2024-04-25T01:39:48.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.777+0000 7fc8c6837640 1 --2- 172.21.15.77:0/784411992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8c00c6c50 0x7fc8c014d790 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800c360 tx=0x7fc8b800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:48.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.777+0000 7fc8b6ffd640 1 -- 172.21.15.77:0/784411992 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8017070 con 0x7fc8c00c6c50 2024-04-25T01:39:48.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.777+0000 7fc8b6ffd640 1 -- 172.21.15.77:0/784411992 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b80035f0 con 0x7fc8c00c6c50 2024-04-25T01:39:48.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.777+0000 7fc8c829a640 1 -- 172.21.15.77:0/784411992 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8c00c15d0 con 0x7fc8c00c6c50 2024-04-25T01:39:48.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.777+0000 7fc8b6ffd640 1 -- 172.21.15.77:0/784411992 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8003a20 con 0x7fc8c00c6c50 2024-04-25T01:39:48.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.777+0000 7fc8c829a640 1 -- 172.21.15.77:0/784411992 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8c0071e40 con 0x7fc8c00c6c50 2024-04-25T01:39:48.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.778+0000 7fc8c829a640 1 -- 172.21.15.77:0/784411992 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8c004f500 con 0x7fc8c00c6c50 2024-04-25T01:39:48.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.778+0000 7fc8b6ffd640 1 -- 172.21.15.77:0/784411992 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc8b801a070 con 0x7fc8c00c6c50 2024-04-25T01:39:48.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.779+0000 7fc8b6ffd640 1 --2- 172.21.15.77:0/784411992 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc8a406be30 0x7fc8a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:48.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.779+0000 7fc8c6036640 1 --2- 172.21.15.77:0/784411992 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc8a406be30 0x7fc8a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:48.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.779+0000 7fc8b6ffd640 1 -- 172.21.15.77:0/784411992 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fc8b808a530 con 0x7fc8c00c6c50 2024-04-25T01:39:48.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.779+0000 7fc8c6036640 1 --2- 172.21.15.77:0/784411992 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc8a406be30 0x7fc8a406e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0012e0 tx=0x7fc8bc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:48.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.783+0000 7fc8b6ffd640 1 -- 172.21.15.77:0/784411992 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc8c0072120 con 0x7fc8c00c6c50 2024-04-25T01:39:48.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.956+0000 7fc8c829a640 1 -- 172.21.15.77:0/784411992 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7fc8c00c5170 con 0x7fc8c00c6c50 2024-04-25T01:39:48.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.957+0000 7fc8b6ffd640 1 -- 172.21.15.77:0/784411992 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v24) ==== 95+0+11 (secure 0 0 0) 0x7fc8b8058c40 con 0x7fc8c00c6c50 2024-04-25T01:39:48.940 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-25T01:39:48.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.959+0000 7fc8c829a640 1 -- 172.21.15.77:0/784411992 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc8a406be30 msgr2=0x7fc8a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:48.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.959+0000 7fc8c829a640 1 --2- 172.21.15.77:0/784411992 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc8a406be30 0x7fc8a406e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0012e0 tx=0x7fc8bc009040 comp rx=0 tx=0).stop 2024-04-25T01:39:48.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.959+0000 7fc8c829a640 1 -- 172.21.15.77:0/784411992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8c00c6c50 msgr2=0x7fc8c014d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:48.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.959+0000 7fc8c829a640 1 --2- 172.21.15.77:0/784411992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8c00c6c50 0x7fc8c014d790 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800c360 tx=0x7fc8b800c820 comp rx=0 tx=0).stop 2024-04-25T01:39:48.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.959+0000 7fc8c829a640 1 -- 172.21.15.77:0/784411992 shutdown_connections 2024-04-25T01:39:48.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.959+0000 7fc8c829a640 1 --2- 172.21.15.77:0/784411992 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc8a406be30 0x7fc8a406e2f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.959+0000 7fc8c829a640 1 --2- 172.21.15.77:0/784411992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8c00c6c50 0x7fc8c014d790 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.959+0000 7fc8c829a640 1 --2- 172.21.15.77:0/784411992 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc8c00c4d10 0x7fc8c0072ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.959+0000 7fc8c829a640 1 --2- 172.21.15.77:0/784411992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8c006d470 0x7fc8c01ec3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:48.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.959+0000 7fc8c829a640 1 -- 172.21.15.77:0/784411992 >> 172.21.15.77:0/784411992 conn(0x7fc8c00c7580 msgr2=0x7fc8c00c2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:48.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.959+0000 7fc8c829a640 1 -- 172.21.15.77:0/784411992 shutdown_connections 2024-04-25T01:39:48.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:48.959+0000 7fc8c829a640 1 -- 172.21.15.77:0/784411992 wait complete. 2024-04-25T01:39:48.953 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:39:49.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.065+0000 7ff2898f5640 1 Processor -- start 2024-04-25T01:39:49.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.065+0000 7ff2898f5640 1 -- start start 2024-04-25T01:39:49.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.066+0000 7ff2898f5640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff284150090 0x7ff284156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:49.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.066+0000 7ff2898f5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff2840c8200 0x7ff2840c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:49.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.066+0000 7ff2898f5640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2840c9de0 con 0x7ff28406c280 2024-04-25T01:39:49.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.066+0000 7ff2898f5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff28406b830 con 0x7ff2840c8200 2024-04-25T01:39:49.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.066+0000 7ff2898f5640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7ff2840c89c0 con 0x7ff284150090 2024-04-25T01:39:49.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.066+0000 7ff2827fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff2840c8200 0x7ff2840c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:49.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.066+0000 7ff2827fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff2840c8200 0x7ff2840c98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44912/0 (socket says 172.21.15.77:44912) 2024-04-25T01:39:49.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.066+0000 7ff2827fc640 1 -- 172.21.15.77:0/195825800 learned_addr learned my addr 172.21.15.77:0/195825800 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:49.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.066+0000 7ff2827fc640 1 -- 172.21.15.77:0/195825800 >> v2:172.21.15.121:3300/0 conn(0x7ff284150090 msgr2=0x7ff284156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:49.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.066+0000 7ff282ffd640 1 --2- 172.21.15.77:0/195825800 >> v2:172.21.15.121:3300/0 conn(0x7ff284150090 0x7ff284156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:49.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.066+0000 7ff2827fc640 1 --2- 172.21.15.77:0/195825800 >> v2:172.21.15.121:3300/0 conn(0x7ff284150090 0x7ff284156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:49.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.066+0000 7ff2827fc640 1 -- 172.21.15.77:0/195825800 >> v1:172.21.15.121:6789/0 conn(0x7ff28406c280 legacy=0x7ff2840c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:49.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.066+0000 7ff2827fc640 1 -- 172.21.15.77:0/195825800 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2840c8ca0 con 0x7ff2840c8200 2024-04-25T01:39:49.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.067+0000 7ff2827fc640 1 --2- 172.21.15.77:0/195825800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2840c8200 0x7ff2840c98a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff28406b9b0 tx=0x7ff27802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d003fae42a975d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:49.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.067+0000 7ff281ffb640 1 -- 172.21.15.77:0/195825800 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff278037070 con 0x7ff2840c8200 2024-04-25T01:39:49.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.067+0000 7ff281ffb640 1 -- 172.21.15.77:0/195825800 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff278032440 con 0x7ff2840c8200 2024-04-25T01:39:49.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.067+0000 7ff281ffb640 1 -- 172.21.15.77:0/195825800 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff278032810 con 0x7ff2840c8200 2024-04-25T01:39:49.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.068+0000 7ff2898f5640 1 -- 172.21.15.77:0/195825800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2840c8200 msgr2=0x7ff2840c98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:49.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.068+0000 7ff2898f5640 1 --2- 172.21.15.77:0/195825800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2840c8200 0x7ff2840c98a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff28406b9b0 tx=0x7ff27802a210 comp rx=0 tx=0).stop 2024-04-25T01:39:49.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.068+0000 7ff2898f5640 1 -- 172.21.15.77:0/195825800 shutdown_connections 2024-04-25T01:39:49.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.068+0000 7ff2898f5640 1 --2- 172.21.15.77:0/195825800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2840c8200 0x7ff2840c98a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:49.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.068+0000 7ff2898f5640 1 --2- 172.21.15.77:0/195825800 >> v2:172.21.15.121:3300/0 conn(0x7ff284150090 0x7ff284156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:49.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.068+0000 7ff2898f5640 1 -- 172.21.15.77:0/195825800 >> 172.21.15.77:0/195825800 conn(0x7ff2840ad4d0 msgr2=0x7ff2840ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:49.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.068+0000 7ff2898f5640 1 -- 172.21.15.77:0/195825800 shutdown_connections 2024-04-25T01:39:49.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.068+0000 7ff2898f5640 1 -- 172.21.15.77:0/195825800 wait complete. 2024-04-25T01:39:49.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.069+0000 7ff2898f5640 1 Processor -- start 2024-04-25T01:39:49.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.069+0000 7ff2898f5640 1 -- start start 2024-04-25T01:39:49.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.070+0000 7ff2898f5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff28406c280 0x7ff2840bfb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:49.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.070+0000 7ff2898f5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2840c8200 0x7ff2841eee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:49.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.070+0000 7ff2898f5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff284150090 0x7ff2841ef390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:49.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.070+0000 7ff2898f5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff2840c86b0 con 0x7ff28406c280 2024-04-25T01:39:49.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.070+0000 7ff2898f5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff28406bd60 con 0x7ff284150090 2024-04-25T01:39:49.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.070+0000 7ff2898f5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff2840c6a30 con 0x7ff2840c8200 2024-04-25T01:39:49.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.070+0000 7ff282ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff28406c280 0x7ff2840bfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:49.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.070+0000 7ff282ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff28406c280 0x7ff2840bfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44914/0 (socket says 172.21.15.77:44914) 2024-04-25T01:39:49.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.070+0000 7ff282ffd640 1 -- 172.21.15.77:0/363930211 learned_addr learned my addr 172.21.15.77:0/363930211 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:49.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.070+0000 7ff2837fe640 1 --2- 172.21.15.77:0/363930211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff284150090 0x7ff2841ef390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:49.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.070+0000 7ff282ffd640 1 -- 172.21.15.77:0/363930211 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2840c8200 msgr2=0x7ff2841eee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:49.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.070+0000 7ff282ffd640 1 --2- 172.21.15.77:0/363930211 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2840c8200 0x7ff2841eee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:49.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.070+0000 7ff282ffd640 1 -- 172.21.15.77:0/363930211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff284150090 msgr2=0x7ff2841ef390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:49.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.070+0000 7ff282ffd640 1 --2- 172.21.15.77:0/363930211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff284150090 0x7ff2841ef390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:49.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.070+0000 7ff282ffd640 1 -- 172.21.15.77:0/363930211 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff28414c570 con 0x7ff28406c280 2024-04-25T01:39:49.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.070+0000 7ff2837fe640 1 --2- 172.21.15.77:0/363930211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff284150090 0x7ff2841ef390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:49.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.070+0000 7ff282ffd640 1 --2- 172.21.15.77:0/363930211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff28406c280 0x7ff2840bfb00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff27400cd00 tx=0x7ff27400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:49.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.070+0000 7ff26bfff640 1 -- 172.21.15.77:0/363930211 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff274003990 con 0x7ff28406c280 2024-04-25T01:39:49.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.070+0000 7ff26bfff640 1 -- 172.21.15.77:0/363930211 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff274003b30 con 0x7ff28406c280 2024-04-25T01:39:49.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.070+0000 7ff2898f5640 1 -- 172.21.15.77:0/363930211 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff28414bde0 con 0x7ff28406c280 2024-04-25T01:39:49.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.070+0000 7ff26bfff640 1 -- 172.21.15.77:0/363930211 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff274004020 con 0x7ff28406c280 2024-04-25T01:39:49.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.070+0000 7ff2898f5640 1 -- 172.21.15.77:0/363930211 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2840c0040 con 0x7ff28406c280 2024-04-25T01:39:49.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.071+0000 7ff2898f5640 1 -- 172.21.15.77:0/363930211 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff28404f500 con 0x7ff28406c280 2024-04-25T01:39:49.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.072+0000 7ff26bfff640 1 -- 172.21.15.77:0/363930211 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff2740041c0 con 0x7ff28406c280 2024-04-25T01:39:49.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.072+0000 7ff26bfff640 1 --2- 172.21.15.77:0/363930211 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff27006be30 0x7ff27006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:49.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.072+0000 7ff2827fc640 1 --2- 172.21.15.77:0/363930211 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff27006be30 0x7ff27006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:49.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.072+0000 7ff26bfff640 1 -- 172.21.15.77:0/363930211 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7ff27408b600 con 0x7ff28406c280 2024-04-25T01:39:49.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.072+0000 7ff2827fc640 1 --2- 172.21.15.77:0/363930211 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff27006be30 0x7ff27006e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff278034000 tx=0x7ff27802c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:49.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.076+0000 7ff26bfff640 1 -- 172.21.15.77:0/363930211 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff274014030 con 0x7ff28406c280 2024-04-25T01:39:49.108 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:39:49.111 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:39:49.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.290+0000 7ff2898f5640 1 -- 172.21.15.77:0/363930211 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff28415a270 con 0x7ff28406c280 2024-04-25T01:39:49.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.290+0000 7ff26bfff640 1 -- 172.21.15.77:0/363930211 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6488 (secure 0 0 0) 0x7ff274059d10 con 0x7ff28406c280 2024-04-25T01:39:49.274 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:49.274 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:39:36.787357+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6837/3454203695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3454203695},{"type":"v1","addr":"172.21.15.77:6837","nonce":3454203695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-04-25T01:39:49.275 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 12 2024-04-25T01:39:49.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.292+0000 7ff2898f5640 1 -- 172.21.15.77:0/363930211 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff27006be30 msgr2=0x7ff27006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:49.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.292+0000 7ff2898f5640 1 --2- 172.21.15.77:0/363930211 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff27006be30 0x7ff27006e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff278034000 tx=0x7ff27802c000 comp rx=0 tx=0).stop 2024-04-25T01:39:49.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.292+0000 7ff2898f5640 1 -- 172.21.15.77:0/363930211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff28406c280 msgr2=0x7ff2840bfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:49.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.292+0000 7ff2898f5640 1 --2- 172.21.15.77:0/363930211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff28406c280 0x7ff2840bfb00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff27400cd00 tx=0x7ff27400a5c0 comp rx=0 tx=0).stop 2024-04-25T01:39:49.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.292+0000 7ff2898f5640 1 -- 172.21.15.77:0/363930211 shutdown_connections 2024-04-25T01:39:49.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.292+0000 7ff2898f5640 1 --2- 172.21.15.77:0/363930211 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff27006be30 0x7ff27006e2f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:49.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.292+0000 7ff2898f5640 1 --2- 172.21.15.77:0/363930211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff284150090 0x7ff2841ef390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:49.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.292+0000 7ff2898f5640 1 --2- 172.21.15.77:0/363930211 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2840c8200 0x7ff2841eee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:49.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.292+0000 7ff2898f5640 1 --2- 172.21.15.77:0/363930211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff28406c280 0x7ff2840bfb00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:49.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.292+0000 7ff2898f5640 1 -- 172.21.15.77:0/363930211 >> 172.21.15.77:0/363930211 conn(0x7ff2840ad4d0 msgr2=0x7ff2840c6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:49.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.293+0000 7ff2898f5640 1 -- 172.21.15.77:0/363930211 shutdown_connections 2024-04-25T01:39:49.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.293+0000 7ff2898f5640 1 -- 172.21.15.77:0/363930211 wait complete. 2024-04-25T01:39:49.287 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T01:39:49.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.400+0000 7f36e0e9a640 1 Processor -- start 2024-04-25T01:39:49.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.400+0000 7f36e0e9a640 1 -- start start 2024-04-25T01:39:49.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.400+0000 7f36e0e9a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36dc14fdd0 0x7f36dc06da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:49.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.401+0000 7f36e0e9a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f36dc06df70 0x7f36dc156170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:49.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.401+0000 7f36e0e9a640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36dc0c2cb0 con 0x7f36dc0ad3a0 2024-04-25T01:39:49.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.401+0000 7f36e0e9a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f36dc0c30e0 con 0x7f36dc06df70 2024-04-25T01:39:49.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.401+0000 7f36e0e9a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f36dc152f80 con 0x7f36dc14fdd0 2024-04-25T01:39:49.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.401+0000 7f36dad9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f36dc06df70 0x7f36dc156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:49.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.401+0000 7f36dad9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f36dc06df70 0x7f36dc156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44918/0 (socket says 172.21.15.77:44918) 2024-04-25T01:39:49.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.401+0000 7f36dad9d640 1 -- 172.21.15.77:0/963632898 learned_addr learned my addr 172.21.15.77:0/963632898 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:49.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.401+0000 7f36da59c640 1 --2- 172.21.15.77:0/963632898 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36dc14fdd0 0x7f36dc06da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:49.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.401+0000 7f36dad9d640 1 -- 172.21.15.77:0/963632898 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36dc14fdd0 msgr2=0x7f36dc06da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:49.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.401+0000 7f36dad9d640 1 --2- 172.21.15.77:0/963632898 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36dc14fdd0 0x7f36dc06da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:49.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.401+0000 7f36dad9d640 1 -- 172.21.15.77:0/963632898 >> v1:172.21.15.121:6789/0 conn(0x7f36dc0ad3a0 legacy=0x7f36dc155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:49.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.401+0000 7f36dad9d640 1 -- 172.21.15.77:0/963632898 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36dc153260 con 0x7f36dc06df70 2024-04-25T01:39:49.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.401+0000 7f36da59c640 1 --2- 172.21.15.77:0/963632898 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36dc14fdd0 0x7f36dc06da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:49.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.402+0000 7f36dad9d640 1 --2- 172.21.15.77:0/963632898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36dc06df70 0x7f36dc156170 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0c3260 tx=0x7f36d402c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef628b8ea00df13 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:49.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.402+0000 7f36d9d9b640 1 -- 172.21.15.77:0/963632898 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d403b070 con 0x7f36dc06df70 2024-04-25T01:39:49.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.402+0000 7f36d9d9b640 1 -- 172.21.15.77:0/963632898 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36d4031070 con 0x7f36dc06df70 2024-04-25T01:39:49.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.402+0000 7f36d9d9b640 1 -- 172.21.15.77:0/963632898 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d4033880 con 0x7f36dc06df70 2024-04-25T01:39:49.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.402+0000 7f36e0e9a640 1 -- 172.21.15.77:0/963632898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36dc06df70 msgr2=0x7f36dc156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:49.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.402+0000 7f36e0e9a640 1 --2- 172.21.15.77:0/963632898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36dc06df70 0x7f36dc156170 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0c3260 tx=0x7f36d402c830 comp rx=0 tx=0).stop 2024-04-25T01:39:49.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.402+0000 7f36e0e9a640 1 -- 172.21.15.77:0/963632898 shutdown_connections 2024-04-25T01:39:49.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.402+0000 7f36e0e9a640 1 --2- 172.21.15.77:0/963632898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36dc06df70 0x7f36dc156170 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:49.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.402+0000 7f36e0e9a640 1 --2- 172.21.15.77:0/963632898 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36dc14fdd0 0x7f36dc06da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:49.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.402+0000 7f36e0e9a640 1 -- 172.21.15.77:0/963632898 >> 172.21.15.77:0/963632898 conn(0x7f36dc0c3f80 msgr2=0x7f36dc0c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:49.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.402+0000 7f36e0e9a640 1 -- 172.21.15.77:0/963632898 shutdown_connections 2024-04-25T01:39:49.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.402+0000 7f36e0e9a640 1 -- 172.21.15.77:0/963632898 wait complete. 2024-04-25T01:39:49.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.404+0000 7f36e0e9a640 1 Processor -- start 2024-04-25T01:39:49.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.404+0000 7f36e0e9a640 1 -- start start 2024-04-25T01:39:49.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.404+0000 7f36e0e9a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36dc06df70 0x7f36dc072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:49.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.404+0000 7f36e0e9a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36dc0ad3a0 0x7f36dc071410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:49.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.404+0000 7f36e0e9a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36dc14fdd0 0x7f36dc0c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:49.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.404+0000 7f36e0e9a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f36dc0c28f0 con 0x7f36dc14fdd0 2024-04-25T01:39:49.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.404+0000 7f36e0e9a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f36dc1566b0 con 0x7f36dc06df70 2024-04-25T01:39:49.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.404+0000 7f36e0e9a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f36dc0c2a70 con 0x7f36dc0ad3a0 2024-04-25T01:39:49.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.404+0000 7f36dad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36dc14fdd0 0x7f36dc0c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:49.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.404+0000 7f36dad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36dc14fdd0 0x7f36dc0c5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44932/0 (socket says 172.21.15.77:44932) 2024-04-25T01:39:49.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.404+0000 7f36dad9d640 1 -- 172.21.15.77:0/175634822 learned_addr learned my addr 172.21.15.77:0/175634822 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:49.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.405+0000 7f36da59c640 1 --2- 172.21.15.77:0/175634822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36dc06df70 0x7f36dc072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:49.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.405+0000 7f36d3fff640 1 --2- 172.21.15.77:0/175634822 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36dc0ad3a0 0x7f36dc071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:49.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.405+0000 7f36dad9d640 1 -- 172.21.15.77:0/175634822 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36dc0ad3a0 msgr2=0x7f36dc071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:49.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.405+0000 7f36dad9d640 1 --2- 172.21.15.77:0/175634822 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36dc0ad3a0 0x7f36dc071410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:49.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.405+0000 7f36dad9d640 1 -- 172.21.15.77:0/175634822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36dc06df70 msgr2=0x7f36dc072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:49.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.405+0000 7f36dad9d640 1 --2- 172.21.15.77:0/175634822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36dc06df70 0x7f36dc072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:49.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.405+0000 7f36dad9d640 1 -- 172.21.15.77:0/175634822 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36dc151570 con 0x7f36dc14fdd0 2024-04-25T01:39:49.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.405+0000 7f36dad9d640 1 --2- 172.21.15.77:0/175634822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36dc14fdd0 0x7f36dc0c5d70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f36d400d210 tx=0x7f36d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:49.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.405+0000 7f36d2ffd640 1 -- 172.21.15.77:0/175634822 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d4045070 con 0x7f36dc14fdd0 2024-04-25T01:39:49.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.405+0000 7f36d2ffd640 1 -- 172.21.15.77:0/175634822 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36d4040680 con 0x7f36dc14fdd0 2024-04-25T01:39:49.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.405+0000 7f36e0e9a640 1 -- 172.21.15.77:0/175634822 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36dc1e8ab0 con 0x7f36dc14fdd0 2024-04-25T01:39:49.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.405+0000 7f36d2ffd640 1 -- 172.21.15.77:0/175634822 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d403b040 con 0x7f36dc14fdd0 2024-04-25T01:39:49.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.405+0000 7f36e0e9a640 1 -- 172.21.15.77:0/175634822 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36dc070ef0 con 0x7f36dc14fdd0 2024-04-25T01:39:49.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.406+0000 7f36e0e9a640 1 -- 172.21.15.77:0/175634822 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36dc0710f0 con 0x7f36dc14fdd0 2024-04-25T01:39:49.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.407+0000 7f36d2ffd640 1 -- 172.21.15.77:0/175634822 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f36d403e070 con 0x7f36dc14fdd0 2024-04-25T01:39:49.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.407+0000 7f36d2ffd640 1 --2- 172.21.15.77:0/175634822 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f36bc06be30 0x7f36bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:49.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.407+0000 7f36d2ffd640 1 -- 172.21.15.77:0/175634822 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f36d40ad650 con 0x7f36dc14fdd0 2024-04-25T01:39:49.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.407+0000 7f36da59c640 1 --2- 172.21.15.77:0/175634822 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f36bc06be30 0x7f36bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:49.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.407+0000 7f36da59c640 1 --2- 172.21.15.77:0/175634822 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f36bc06be30 0x7f36bc06e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f36cc00a950 tx=0x7f36cc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:49.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.411+0000 7f36d2ffd640 1 -- 172.21.15.77:0/175634822 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f36dc0710f0 con 0x7f36dc14fdd0 2024-04-25T01:39:49.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.592+0000 7f36e0e9a640 1 -- 172.21.15.77:0/175634822 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f36dc04f500 con 0x7f36dc14fdd0 2024-04-25T01:39:49.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.594+0000 7f36d2ffd640 1 -- 172.21.15.77:0/175634822 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20331 (secure 0 0 0) 0x7f36d4033070 con 0x7f36dc14fdd0 2024-04-25T01:39:49.577 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:49.578 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:39:34.425701+0000","last_up_change":"2024-04-25T01:39:10.729600+0000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T01:39:11.681151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T01:39:21.606752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T01:39:22.677664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T01:39:30.501700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T01:39:31.740717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6811","nonce":3366980158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6817","nonce":3366980158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6828","nonce":3366980158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6825","nonce":3366980158}]},"public_addr":"172.21.15.77:6811/3366980158","cluster_addr":"172.21.15.77:6817/3366980158","heartbeat_back_addr":"172.21.15.77:6828/3366980158","heartbeat_front_addr":"172.21.15.77:6825/3366980158","state":["exists","up"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6801","nonce":3971619298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6803","nonce":3971619298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6807","nonce":3971619298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6805","nonce":3971619298}]},"public_addr":"172.21.15.77:6801/3971619298","cluster_addr":"172.21.15.77:6803/3971619298","heartbeat_back_addr":"172.21.15.77:6807/3971619298","heartbeat_front_addr":"172.21.15.77:6805/3971619298","state":["exists","up"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6810","nonce":4103452689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6813","nonce":4103452689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6823","nonce":4103452689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6818","nonce":4103452689}]},"public_addr":"172.21.15.77:6810/4103452689","cluster_addr":"172.21.15.77:6813/4103452689","heartbeat_back_addr":"172.21.15.77:6823/4103452689","heartbeat_front_addr":"172.21.15.77:6818/4103452689","state":["exists","up"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6819","nonce":217398906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6824","nonce":217398906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6831","nonce":217398906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6829","nonce":217398906}]},"public_addr":"172.21.15.77:6819/217398906","cluster_addr":"172.21.15.77:6824/217398906","heartbeat_back_addr":"172.21.15.77:6831/217398906","heartbeat_front_addr":"172.21.15.77:6829/217398906","state":["exists","up"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6801","nonce":2565483070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6803","nonce":2565483070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6810","nonce":2565483070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6806","nonce":2565483070}]},"public_addr":"172.21.15.121:6801/2565483070","cluster_addr":"172.21.15.121:6803/2565483070","heartbeat_back_addr":"172.21.15.121:6810/2565483070","heartbeat_front_addr":"172.21.15.121:6806/2565483070","state":["exists","up"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6807","nonce":2785294752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6809","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6811","nonce":2785294752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6815","nonce":2785294752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6813","nonce":2785294752}]},"public_addr":"172.21.15.121:6807/2785294752","cluster_addr":"172.21.15.121:6811/2785294752","heartbeat_back_addr":"172.21.15.121:6815/2785294752","heartbeat_front_addr":"172.21.15.121:6813/2785294752","state":["exists","up"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6820","nonce":523906818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6824","nonce":523906818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6831","nonce":523906818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6828","nonce":523906818}]},"public_addr":"172.21.15.121:6820/523906818","cluster_addr":"172.21.15.121:6824/523906818","heartbeat_back_addr":"172.21.15.121:6831/523906818","heartbeat_front_addr":"172.21.15.121:6828/523906818","state":["exists","up"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6817","nonce":1683602459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6819","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6821","nonce":1683602459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6829","nonce":1683602459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6823","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6825","nonce":1683602459}]},"public_addr":"172.21.15.121:6817/1683602459","cluster_addr":"172.21.15.121:6821/1683602459","heartbeat_back_addr":"172.21.15.121:6829/1683602459","heartbeat_front_addr":"172.21.15.121:6825/1683602459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.839443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.818842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.776243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.793085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.822396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.907311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.918374+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.848430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:39:49.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.596+0000 7f36e0e9a640 1 -- 172.21.15.77:0/175634822 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f36bc06be30 msgr2=0x7f36bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:49.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.596+0000 7f36e0e9a640 1 --2- 172.21.15.77:0/175634822 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f36bc06be30 0x7f36bc06e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f36cc00a950 tx=0x7f36cc008040 comp rx=0 tx=0).stop 2024-04-25T01:39:49.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.596+0000 7f36e0e9a640 1 -- 172.21.15.77:0/175634822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36dc14fdd0 msgr2=0x7f36dc0c5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:49.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.596+0000 7f36e0e9a640 1 --2- 172.21.15.77:0/175634822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36dc14fdd0 0x7f36dc0c5d70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f36d400d210 tx=0x7f36d4004a40 comp rx=0 tx=0).stop 2024-04-25T01:39:49.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.596+0000 7f36e0e9a640 1 -- 172.21.15.77:0/175634822 shutdown_connections 2024-04-25T01:39:49.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.596+0000 7f36e0e9a640 1 --2- 172.21.15.77:0/175634822 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f36bc06be30 0x7f36bc06e2f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:49.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.596+0000 7f36e0e9a640 1 --2- 172.21.15.77:0/175634822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36dc14fdd0 0x7f36dc0c5d70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:49.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.596+0000 7f36e0e9a640 1 --2- 172.21.15.77:0/175634822 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36dc0ad3a0 0x7f36dc071410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:49.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.596+0000 7f36e0e9a640 1 --2- 172.21.15.77:0/175634822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36dc06df70 0x7f36dc072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:49.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.596+0000 7f36e0e9a640 1 -- 172.21.15.77:0/175634822 >> 172.21.15.77:0/175634822 conn(0x7f36dc0c3f80 msgr2=0x7f36dc14ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:49.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.596+0000 7f36e0e9a640 1 -- 172.21.15.77:0/175634822 shutdown_connections 2024-04-25T01:39:49.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.596+0000 7f36e0e9a640 1 -- 172.21.15.77:0/175634822 wait complete. 2024-04-25T01:39:49.591 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:39:49.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.704+0000 7f3ea1415640 1 Processor -- start 2024-04-25T01:39:49.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.704+0000 7f3ea1415640 1 -- start start 2024-04-25T01:39:49.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.705+0000 7f3ea1415640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3e9c0c3af0 0x7f3e9c070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:49.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.705+0000 7f3ea1415640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3e9c0adb60 0x7f3e9c156b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:49.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.705+0000 7f3ea1415640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e9c157080 con 0x7f3e9c1596b0 2024-04-25T01:39:49.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.705+0000 7f3ea1415640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f3e9c06c870 con 0x7f3e9c0adb60 2024-04-25T01:39:49.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.705+0000 7f3ea1415640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f3e9c072c30 con 0x7f3e9c0c3af0 2024-04-25T01:39:49.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.705+0000 7f3e9a7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3e9c0adb60 0x7f3e9c156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:49.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.705+0000 7f3e9a7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3e9c0adb60 0x7f3e9c156b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44944/0 (socket says 172.21.15.77:44944) 2024-04-25T01:39:49.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.705+0000 7f3e9a7fc640 1 -- 172.21.15.77:0/3670679023 learned_addr learned my addr 172.21.15.77:0/3670679023 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:49.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.705+0000 7f3e9affd640 1 --2- 172.21.15.77:0/3670679023 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3e9c0c3af0 0x7f3e9c070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:49.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.705+0000 7f3e9a7fc640 1 -- 172.21.15.77:0/3670679023 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3e9c0c3af0 msgr2=0x7f3e9c070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:49.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.705+0000 7f3e9a7fc640 1 --2- 172.21.15.77:0/3670679023 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3e9c0c3af0 0x7f3e9c070e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:49.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.705+0000 7f3e9a7fc640 1 -- 172.21.15.77:0/3670679023 >> v1:172.21.15.121:6789/0 conn(0x7f3e9c1596b0 legacy=0x7f3e9c14c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:49.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.705+0000 7f3e9a7fc640 1 -- 172.21.15.77:0/3670679023 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e9c072f10 con 0x7f3e9c0adb60 2024-04-25T01:39:49.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.706+0000 7f3e9a7fc640 1 --2- 172.21.15.77:0/3670679023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e9c0adb60 0x7f3e9c156b40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009870 tx=0x7f3e9002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d7d20b80e26822 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:49.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.706+0000 7f3e99ffb640 1 -- 172.21.15.77:0/3670679023 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e90037070 con 0x7f3e9c0adb60 2024-04-25T01:39:49.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.706+0000 7f3e99ffb640 1 -- 172.21.15.77:0/3670679023 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e9002ae10 con 0x7f3e9c0adb60 2024-04-25T01:39:49.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.706+0000 7f3e99ffb640 1 -- 172.21.15.77:0/3670679023 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e90032660 con 0x7f3e9c0adb60 2024-04-25T01:39:49.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.706+0000 7f3ea1415640 1 -- 172.21.15.77:0/3670679023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e9c0adb60 msgr2=0x7f3e9c156b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:49.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.706+0000 7f3ea1415640 1 --2- 172.21.15.77:0/3670679023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e9c0adb60 0x7f3e9c156b40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009870 tx=0x7f3e9002a100 comp rx=0 tx=0).stop 2024-04-25T01:39:49.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.707+0000 7f3ea1415640 1 -- 172.21.15.77:0/3670679023 shutdown_connections 2024-04-25T01:39:49.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.707+0000 7f3ea1415640 1 --2- 172.21.15.77:0/3670679023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e9c0adb60 0x7f3e9c156b40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:49.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.707+0000 7f3ea1415640 1 --2- 172.21.15.77:0/3670679023 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3e9c0c3af0 0x7f3e9c070e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:49.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.707+0000 7f3ea1415640 1 -- 172.21.15.77:0/3670679023 >> 172.21.15.77:0/3670679023 conn(0x7f3e9c0c4970 msgr2=0x7f3e9c0c4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:49.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.707+0000 7f3ea1415640 1 -- 172.21.15.77:0/3670679023 shutdown_connections 2024-04-25T01:39:49.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.707+0000 7f3ea1415640 1 -- 172.21.15.77:0/3670679023 wait complete. 2024-04-25T01:39:49.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.708+0000 7f3ea1415640 1 Processor -- start 2024-04-25T01:39:49.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.708+0000 7f3ea1415640 1 -- start start 2024-04-25T01:39:49.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.708+0000 7f3ea1415640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e9c0adb60 0x7f3e9c1484c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:49.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.708+0000 7f3ea1415640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e9c0c3af0 0x7f3e9c145250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:49.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.708+0000 7f3ea1415640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3e9c1596b0 0x7f3e9c145790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:49.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.708+0000 7f3ea1415640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c06cf20 con 0x7f3e9c0c3af0 2024-04-25T01:39:49.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.708+0000 7f3ea1415640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c06cda0 con 0x7f3e9c0adb60 2024-04-25T01:39:49.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.709+0000 7f3ea1415640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f3e9c14ceb0 con 0x7f3e9c1596b0 2024-04-25T01:39:49.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.709+0000 7f3e9a7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e9c0c3af0 0x7f3e9c145250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:49.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.709+0000 7f3e9a7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e9c0c3af0 0x7f3e9c145250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44946/0 (socket says 172.21.15.77:44946) 2024-04-25T01:39:49.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.709+0000 7f3e9a7fc640 1 -- 172.21.15.77:0/1200931969 learned_addr learned my addr 172.21.15.77:0/1200931969 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:49.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.709+0000 7f3e9affd640 1 --2- 172.21.15.77:0/1200931969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e9c0adb60 0x7f3e9c1484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:49.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.709+0000 7f3e9a7fc640 1 -- 172.21.15.77:0/1200931969 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3e9c1596b0 msgr2=0x7f3e9c145790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:49.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.709+0000 7f3e9a7fc640 1 --2- 172.21.15.77:0/1200931969 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3e9c1596b0 0x7f3e9c145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:49.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.709+0000 7f3e9a7fc640 1 -- 172.21.15.77:0/1200931969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e9c0adb60 msgr2=0x7f3e9c1484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:49.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.709+0000 7f3e9a7fc640 1 --2- 172.21.15.77:0/1200931969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e9c0adb60 0x7f3e9c1484c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:49.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.709+0000 7f3e9a7fc640 1 -- 172.21.15.77:0/1200931969 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e9c149430 con 0x7f3e9c0c3af0 2024-04-25T01:39:49.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.709+0000 7f3e9a7fc640 1 --2- 172.21.15.77:0/1200931969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e9c0c3af0 0x7f3e9c145250 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3e90000c00 tx=0x7f3e900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:49.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.709+0000 7f3e837fe640 1 -- 172.21.15.77:0/1200931969 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e90041070 con 0x7f3e9c0c3af0 2024-04-25T01:39:49.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.709+0000 7f3e837fe640 1 -- 172.21.15.77:0/1200931969 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e9003c680 con 0x7f3e9c0c3af0 2024-04-25T01:39:49.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.709+0000 7f3e837fe640 1 -- 172.21.15.77:0/1200931969 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e90037040 con 0x7f3e9c0c3af0 2024-04-25T01:39:49.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.709+0000 7f3ea1415640 1 -- 172.21.15.77:0/1200931969 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e9c146fa0 con 0x7f3e9c0c3af0 2024-04-25T01:39:49.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.709+0000 7f3ea1415640 1 -- 172.21.15.77:0/1200931969 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e9c147560 con 0x7f3e9c0c3af0 2024-04-25T01:39:49.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.710+0000 7f3ea1415640 1 -- 172.21.15.77:0/1200931969 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e9c04f500 con 0x7f3e9c0c3af0 2024-04-25T01:39:49.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.710+0000 7f3e837fe640 1 -- 172.21.15.77:0/1200931969 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e90044070 con 0x7f3e9c0c3af0 2024-04-25T01:39:49.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.711+0000 7f3e837fe640 1 --2- 172.21.15.77:0/1200931969 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3e8806be30 0x7f3e8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:49.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.711+0000 7f3e9affd640 1 --2- 172.21.15.77:0/1200931969 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3e8806be30 0x7f3e8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:49.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.711+0000 7f3e837fe640 1 -- 172.21.15.77:0/1200931969 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f3e900abb80 con 0x7f3e9c0c3af0 2024-04-25T01:39:49.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.711+0000 7f3e9affd640 1 --2- 172.21.15.77:0/1200931969 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3e8806be30 0x7f3e8806e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c008ef0 tx=0x7f3e8c008440 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:49.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.715+0000 7f3e837fe640 1 -- 172.21.15.77:0/1200931969 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3e9c157080 con 0x7f3e9c0c3af0 2024-04-25T01:39:49.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.923+0000 7f3ea1415640 1 -- 172.21.15.77:0/1200931969 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e9c0671b0 con 0x7f3e9c0c3af0 2024-04-25T01:39:49.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.923+0000 7f3e837fe640 1 -- 172.21.15.77:0/1200931969 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6488 (secure 0 0 0) 0x7f3e9007a3b0 con 0x7f3e9c0c3af0 2024-04-25T01:39:49.907 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:49.907 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:39:36.787357+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6837/3454203695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3454203695},{"type":"v1","addr":"172.21.15.77:6837","nonce":3454203695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-04-25T01:39:49.907 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 12 2024-04-25T01:39:49.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.925+0000 7f3ea1415640 1 -- 172.21.15.77:0/1200931969 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3e8806be30 msgr2=0x7f3e8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:49.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.925+0000 7f3ea1415640 1 --2- 172.21.15.77:0/1200931969 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3e8806be30 0x7f3e8806e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c008ef0 tx=0x7f3e8c008440 comp rx=0 tx=0).stop 2024-04-25T01:39:49.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.925+0000 7f3ea1415640 1 -- 172.21.15.77:0/1200931969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e9c0c3af0 msgr2=0x7f3e9c145250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:49.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.925+0000 7f3ea1415640 1 --2- 172.21.15.77:0/1200931969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e9c0c3af0 0x7f3e9c145250 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3e90000c00 tx=0x7f3e900046c0 comp rx=0 tx=0).stop 2024-04-25T01:39:49.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.925+0000 7f3ea1415640 1 -- 172.21.15.77:0/1200931969 shutdown_connections 2024-04-25T01:39:49.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.925+0000 7f3ea1415640 1 --2- 172.21.15.77:0/1200931969 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3e8806be30 0x7f3e8806e2f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:49.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.925+0000 7f3ea1415640 1 --2- 172.21.15.77:0/1200931969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e9c0c3af0 0x7f3e9c145250 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:49.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.925+0000 7f3ea1415640 1 --2- 172.21.15.77:0/1200931969 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3e9c1596b0 0x7f3e9c145790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:49.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.925+0000 7f3ea1415640 1 --2- 172.21.15.77:0/1200931969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e9c0adb60 0x7f3e9c1484c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:49.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.925+0000 7f3ea1415640 1 -- 172.21.15.77:0/1200931969 >> 172.21.15.77:0/1200931969 conn(0x7f3e9c0c4970 msgr2=0x7f3e9c14c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:49.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.926+0000 7f3ea1415640 1 -- 172.21.15.77:0/1200931969 shutdown_connections 2024-04-25T01:39:49.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:49.926+0000 7f3ea1415640 1 -- 172.21.15.77:0/1200931969 wait complete. 2024-04-25T01:39:50.323 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T01:39:23.701997+0000', 'modified': '2024-04-25T01:39:26.722911+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.121:6835/2449150984', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6833', 'nonce': 2449150984}, {'type': 'v1', 'addr': '172.21.15.121:6835', 'nonce': 2449150984}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'a', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4290, 'qdb_cluster': [4290]} 2024-04-25T01:39:50.323 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T01:39:50.323 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T01:39:50.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.439+0000 7fd52d570640 1 Processor -- start 2024-04-25T01:39:50.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.439+0000 7fd52d570640 1 -- start start 2024-04-25T01:39:50.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.439+0000 7fd52d570640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd5280cbef0 0x7fd528156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:50.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.439+0000 7fd52d570640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd52815a0e0 0x7fd5280c9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:50.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.439+0000 7fd52d570640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd52814fd20 0x7fd5281501b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:50.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.439+0000 7fd52d570640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd5280c6ca0 con 0x7fd5280cbef0 2024-04-25T01:39:50.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.439+0000 7fd52d570640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fd5280c66e0 con 0x7fd52814fd20 2024-04-25T01:39:50.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.439+0000 7fd52d570640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd5280c69c0 con 0x7fd52815a0e0 2024-04-25T01:39:50.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.440+0000 7fd526ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd5280cbef0 0x7fd528156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:50.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.440+0000 7fd526ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd5280cbef0 0x7fd528156ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44960/0 (socket says 172.21.15.77:44960) 2024-04-25T01:39:50.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.440+0000 7fd526ffd640 1 -- 172.21.15.77:0/345990065 learned_addr learned my addr 172.21.15.77:0/345990065 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:50.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.440+0000 7fd5277fe640 1 --2- 172.21.15.77:0/345990065 >> v2:172.21.15.121:3300/0 conn(0x7fd52814fd20 0x7fd5281501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:50.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.440+0000 7fd51ffff640 1 --2- 172.21.15.77:0/345990065 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd52815a0e0 0x7fd5280c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:50.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.440+0000 7fd526ffd640 1 -- 172.21.15.77:0/345990065 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd52815a0e0 msgr2=0x7fd5280c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:50.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.440+0000 7fd526ffd640 1 --2- 172.21.15.77:0/345990065 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd52815a0e0 0x7fd5280c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.440+0000 7fd526ffd640 1 -- 172.21.15.77:0/345990065 >> v2:172.21.15.121:3300/0 conn(0x7fd52814fd20 msgr2=0x7fd5281501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:50.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.440+0000 7fd526ffd640 1 --2- 172.21.15.77:0/345990065 >> v2:172.21.15.121:3300/0 conn(0x7fd52814fd20 0x7fd5281501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.440+0000 7fd526ffd640 1 -- 172.21.15.77:0/345990065 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5281598e0 con 0x7fd5280cbef0 2024-04-25T01:39:50.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.440+0000 7fd51ffff640 1 --2- 172.21.15.77:0/345990065 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd52815a0e0 0x7fd5280c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:50.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.440+0000 7fd5277fe640 1 --2- 172.21.15.77:0/345990065 >> v2:172.21.15.121:3300/0 conn(0x7fd52814fd20 0x7fd5281501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:50.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.440+0000 7fd526ffd640 1 --2- 172.21.15.77:0/345990065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5280cbef0 0x7fd528156ba0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd5280c8170 tx=0x7fd51802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e94936e9ea0eeb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:50.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.441+0000 7fd5267fc640 1 -- 172.21.15.77:0/345990065 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd518037070 con 0x7fd5280cbef0 2024-04-25T01:39:50.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.441+0000 7fd5267fc640 1 -- 172.21.15.77:0/345990065 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd518032440 con 0x7fd5280cbef0 2024-04-25T01:39:50.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.441+0000 7fd5267fc640 1 -- 172.21.15.77:0/345990065 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd518032810 con 0x7fd5280cbef0 2024-04-25T01:39:50.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.441+0000 7fd52d570640 1 -- 172.21.15.77:0/345990065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5280cbef0 msgr2=0x7fd528156ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:50.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.441+0000 7fd52d570640 1 --2- 172.21.15.77:0/345990065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5280cbef0 0x7fd528156ba0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd5280c8170 tx=0x7fd51802a140 comp rx=0 tx=0).stop 2024-04-25T01:39:50.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.441+0000 7fd52d570640 1 -- 172.21.15.77:0/345990065 shutdown_connections 2024-04-25T01:39:50.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.441+0000 7fd52d570640 1 --2- 172.21.15.77:0/345990065 >> v2:172.21.15.121:3300/0 conn(0x7fd52814fd20 0x7fd5281501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.441+0000 7fd52d570640 1 --2- 172.21.15.77:0/345990065 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd52815a0e0 0x7fd5280c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.441+0000 7fd52d570640 1 --2- 172.21.15.77:0/345990065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5280cbef0 0x7fd528156ba0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.441+0000 7fd52d570640 1 -- 172.21.15.77:0/345990065 >> 172.21.15.77:0/345990065 conn(0x7fd528067080 msgr2=0x7fd528067460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:50.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.441+0000 7fd52d570640 1 -- 172.21.15.77:0/345990065 shutdown_connections 2024-04-25T01:39:50.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.441+0000 7fd52d570640 1 -- 172.21.15.77:0/345990065 wait complete. 2024-04-25T01:39:50.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.442+0000 7fd52d570640 1 Processor -- start 2024-04-25T01:39:50.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.442+0000 7fd52d570640 1 -- start start 2024-04-25T01:39:50.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.443+0000 7fd52d570640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5280cbef0 0x7fd5281ef3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:50.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.443+0000 7fd52d570640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd52814fd20 0x7fd5280c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:50.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.443+0000 7fd52d570640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd52815a0e0 0x7fd52814b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:50.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.443+0000 7fd52d570640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd52806d0d0 con 0x7fd5280cbef0 2024-04-25T01:39:50.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.443+0000 7fd52d570640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd5280c9d50 con 0x7fd52814fd20 2024-04-25T01:39:50.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.443+0000 7fd52d570640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd52815a500 con 0x7fd52815a0e0 2024-04-25T01:39:50.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.443+0000 7fd526ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5280cbef0 0x7fd5281ef3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:50.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.443+0000 7fd526ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5280cbef0 0x7fd5281ef3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44966/0 (socket says 172.21.15.77:44966) 2024-04-25T01:39:50.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.443+0000 7fd526ffd640 1 -- 172.21.15.77:0/2590994118 learned_addr learned my addr 172.21.15.77:0/2590994118 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:50.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.443+0000 7fd51ffff640 1 --2- 172.21.15.77:0/2590994118 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd52814fd20 0x7fd5280c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:50.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.443+0000 7fd5277fe640 1 --2- 172.21.15.77:0/2590994118 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd52815a0e0 0x7fd52814b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:50.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.443+0000 7fd526ffd640 1 -- 172.21.15.77:0/2590994118 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd52815a0e0 msgr2=0x7fd52814b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:50.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.443+0000 7fd526ffd640 1 --2- 172.21.15.77:0/2590994118 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd52815a0e0 0x7fd52814b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.443+0000 7fd526ffd640 1 -- 172.21.15.77:0/2590994118 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd52814fd20 msgr2=0x7fd5280c4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:50.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.443+0000 7fd526ffd640 1 --2- 172.21.15.77:0/2590994118 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd52814fd20 0x7fd5280c4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.443+0000 7fd526ffd640 1 -- 172.21.15.77:0/2590994118 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5280ca3c0 con 0x7fd5280cbef0 2024-04-25T01:39:50.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.443+0000 7fd526ffd640 1 --2- 172.21.15.77:0/2590994118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5280cbef0 0x7fd5281ef3f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd51802a180 tx=0x7fd5180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:50.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.444+0000 7fd51f7fe640 1 -- 172.21.15.77:0/2590994118 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd518037040 con 0x7fd5280cbef0 2024-04-25T01:39:50.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.444+0000 7fd51f7fe640 1 -- 172.21.15.77:0/2590994118 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd518042070 con 0x7fd5280cbef0 2024-04-25T01:39:50.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.444+0000 7fd52d570640 1 -- 172.21.15.77:0/2590994118 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd528150820 con 0x7fd5280cbef0 2024-04-25T01:39:50.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.444+0000 7fd51f7fe640 1 -- 172.21.15.77:0/2590994118 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd518030bb0 con 0x7fd5280cbef0 2024-04-25T01:39:50.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.444+0000 7fd52d570640 1 -- 172.21.15.77:0/2590994118 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd528155e40 con 0x7fd5280cbef0 2024-04-25T01:39:50.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.445+0000 7fd51f7fe640 1 -- 172.21.15.77:0/2590994118 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd518047460 con 0x7fd5280cbef0 2024-04-25T01:39:50.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.445+0000 7fd51f7fe640 1 --2- 172.21.15.77:0/2590994118 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd50806be60 0x7fd50806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:50.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.446+0000 7fd51f7fe640 1 -- 172.21.15.77:0/2590994118 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fd5180abd50 con 0x7fd5280cbef0 2024-04-25T01:39:50.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.446+0000 7fd51ffff640 1 --2- 172.21.15.77:0/2590994118 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd50806be60 0x7fd50806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:50.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.446+0000 7fd51ffff640 1 --2- 172.21.15.77:0/2590994118 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd50806be60 0x7fd50806e320 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd5280ca7b0 tx=0x7fd510008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:50.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.446+0000 7fd530284740 1 Processor -- start 2024-04-25T01:39:50.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.447+0000 7fd530284740 1 -- start start 2024-04-25T01:39:50.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.447+0000 7fd530284740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5646615c1ad0 0x5646615be940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:50.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.447+0000 7fd530284740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646615848e0 0x5646615bee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:50.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.447+0000 7fd530284740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5646615a5510 0x5646615bfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:50.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.447+0000 7fd530284740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5646614e6f00 con 0x5646615c1ad0 2024-04-25T01:39:50.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.447+0000 7fd530284740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56466148f750 con 0x5646615848e0 2024-04-25T01:39:50.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.447+0000 7fd530284740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x5646614e2ec0 con 0x5646615a5510 2024-04-25T01:39:50.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.447+0000 7fd526ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5646615c1ad0 0x5646615be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:50.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.447+0000 7fd526ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5646615c1ad0 0x5646615be940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44972/0 (socket says 172.21.15.77:44972) 2024-04-25T01:39:50.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.447+0000 7fd526ffd640 1 -- 172.21.15.77:0/3936758670 learned_addr learned my addr 172.21.15.77:0/3936758670 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:50.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.447+0000 7fd51ffff640 1 --2- 172.21.15.77:0/3936758670 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646615848e0 0x5646615bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:50.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.447+0000 7fd5277fe640 1 --2- 172.21.15.77:0/3936758670 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5646615a5510 0x5646615bfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:50.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.448+0000 7fd526ffd640 1 -- 172.21.15.77:0/3936758670 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5646615a5510 msgr2=0x5646615bfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:50.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.448+0000 7fd526ffd640 1 --2- 172.21.15.77:0/3936758670 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5646615a5510 0x5646615bfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.448+0000 7fd526ffd640 1 -- 172.21.15.77:0/3936758670 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646615848e0 msgr2=0x5646615bee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:50.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.448+0000 7fd526ffd640 1 --2- 172.21.15.77:0/3936758670 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646615848e0 0x5646615bee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.448+0000 7fd526ffd640 1 -- 172.21.15.77:0/3936758670 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646611fb2d0 con 0x5646615c1ad0 2024-04-25T01:39:50.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.448+0000 7fd51ffff640 1 --2- 172.21.15.77:0/3936758670 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646615848e0 0x5646615bee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:50.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.448+0000 7fd526ffd640 1 --2- 172.21.15.77:0/3936758670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5646615c1ad0 0x5646615be940 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd5180a9ef0 tx=0x7fd5180796f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b771e0ba4cf93c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:50.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.448+0000 7fd51cff9640 1 -- 172.21.15.77:0/3936758670 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd518079cd0 con 0x5646615c1ad0 2024-04-25T01:39:50.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.448+0000 7fd51cff9640 1 -- 172.21.15.77:0/3936758670 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd51807e080 con 0x5646615c1ad0 2024-04-25T01:39:50.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.448+0000 7fd51cff9640 1 -- 172.21.15.77:0/3936758670 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5180828b0 con 0x5646615c1ad0 2024-04-25T01:39:50.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.448+0000 7fd530284740 1 -- 172.21.15.77:0/3936758670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5646615c1ad0 msgr2=0x5646615be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:50.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.448+0000 7fd530284740 1 --2- 172.21.15.77:0/3936758670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5646615c1ad0 0x5646615be940 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd5180a9ef0 tx=0x7fd5180796f0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.448+0000 7fd530284740 1 -- 172.21.15.77:0/3936758670 shutdown_connections 2024-04-25T01:39:50.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.448+0000 7fd530284740 1 --2- 172.21.15.77:0/3936758670 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5646615a5510 0x5646615bfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.448+0000 7fd530284740 1 --2- 172.21.15.77:0/3936758670 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646615848e0 0x5646615bee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.448+0000 7fd530284740 1 --2- 172.21.15.77:0/3936758670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5646615c1ad0 0x5646615be940 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.448+0000 7fd530284740 1 -- 172.21.15.77:0/3936758670 >> 172.21.15.77:0/3936758670 conn(0x564661580640 msgr2=0x5646615a4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:50.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.449+0000 7fd530284740 1 -- 172.21.15.77:0/3936758670 shutdown_connections 2024-04-25T01:39:50.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.449+0000 7fd530284740 1 -- 172.21.15.77:0/3936758670 wait complete. 2024-04-25T01:39:50.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.449+0000 7fd530284740 1 -- start start 2024-04-25T01:39:50.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.449+0000 7fd530284740 1 Processor -- start 2024-04-25T01:39:50.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.450+0000 7fd530284740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646615a5510 0x5646615bb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:50.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.450+0000 7fd530284740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5646615c1ad0 0x564661582c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:50.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.450+0000 7fd530284740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5646615d3a90 0x56466159fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:50.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.450+0000 7fd530284740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564661584dc0 con 0x5646615c1ad0 2024-04-25T01:39:50.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.450+0000 7fd530284740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5646614a2cf0 con 0x5646615a5510 2024-04-25T01:39:50.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.450+0000 7fd530284740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x5646614e6f00 con 0x5646615d3a90 2024-04-25T01:39:50.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.450+0000 7fd530284740 10 client.0 _ll_register_callbacks cb 0x5646614a26e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T01:39:50.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.450+0000 7fd51ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5646615c1ad0 0x564661582c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:50.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.450+0000 7fd51ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5646615c1ad0 0x564661582c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44976/0 (socket says 172.21.15.77:44976) 2024-04-25T01:39:50.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.450+0000 7fd51ffff640 1 -- 172.21.15.77:0/4113205689 learned_addr learned my addr 172.21.15.77:0/4113205689 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:50.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.450+0000 7fd526ffd640 1 --2- 172.21.15.77:0/4113205689 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646615a5510 0x5646615bb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:50.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.450+0000 7fd5277fe640 1 --2- 172.21.15.77:0/4113205689 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5646615d3a90 0x56466159fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:50.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.450+0000 7fd51ffff640 1 -- 172.21.15.77:0/4113205689 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5646615d3a90 msgr2=0x56466159fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:50.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.450+0000 7fd51ffff640 1 --2- 172.21.15.77:0/4113205689 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5646615d3a90 0x56466159fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.450+0000 7fd51ffff640 1 -- 172.21.15.77:0/4113205689 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646615a5510 msgr2=0x5646615bb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:50.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.450+0000 7fd51ffff640 1 --2- 172.21.15.77:0/4113205689 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646615a5510 0x5646615bb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.450+0000 7fd51ffff640 1 -- 172.21.15.77:0/4113205689 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646612c56b0 con 0x5646615c1ad0 2024-04-25T01:39:50.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.450+0000 7fd5277fe640 1 --2- 172.21.15.77:0/4113205689 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5646615d3a90 0x56466159fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:50.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.450+0000 7fd51ffff640 1 --2- 172.21.15.77:0/4113205689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5646615c1ad0 0x564661582c70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd51000fff0 tx=0x7fd510004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a1aa5b0eea3662 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:50.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.450+0000 7fd505ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-25T01:39:50.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.450+0000 7fd505ffb640 1 -- 172.21.15.77:0/4113205689 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd510025020 con 0x5646615c1ad0 2024-04-25T01:39:50.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.450+0000 7fd505ffb640 1 -- 172.21.15.77:0/4113205689 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fd510021830 con 0x5646615c1ad0 2024-04-25T01:39:50.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.450+0000 7fd530284740 1 -- 172.21.15.77:0/4113205689 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd51807e080 con 0x5646615c1ad0 2024-04-25T01:39:50.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.451+0000 7fd505ffb640 1 -- 172.21.15.77:0/4113205689 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7fd51001b070 con 0x5646615c1ad0 2024-04-25T01:39:50.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.451+0000 7fd530284740 10 client.4851 fetch_fsmap learned FSMap version 12 2024-04-25T01:39:50.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.451+0000 7fd530284740 1 -- 172.21.15.77:0/4113205689 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) -- 0x5646615b7090 con 0x5646615c1ad0 2024-04-25T01:39:50.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.451+0000 7fd505ffb640 1 -- 172.21.15.77:0/4113205689 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd51807e080 con 0x5646615c1ad0 2024-04-25T01:39:50.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.451+0000 7fd505ffb640 1 -- 172.21.15.77:0/4113205689 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 12) ==== 4128+0+0 (secure 0 0 0) 0x7fd510032080 con 0x5646615c1ad0 2024-04-25T01:39:50.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.451+0000 7fd530284740 10 client.4851 fetch_fsmap finished waiting for FSMap version 12 2024-04-25T01:39:50.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.451+0000 7fd530284740 10 client.4851 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T01:39:50.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.451+0000 7fd530284740 20 client.4851 populate_metadata read hostname 'smithi077' 2024-04-25T01:39:50.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.451+0000 7fd530284740 1 --2- 172.21.15.77:0/4113205689 >> [v2:172.21.15.121:6833/2449150984,v1:172.21.15.121:6835/2449150984] conn(0x5646615d0930 0x5646615decf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:50.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.451+0000 7fd530284740 4 client.4851 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T01:39:50.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.451+0000 7fd530284740 1 -- 172.21.15.77:0/4113205689 --> [v2:172.21.15.121:6833/2449150984,v1:172.21.15.121:6835/2449150984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646614f4440 con 0x5646615d0930 2024-04-25T01:39:50.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.451+0000 7fd526ffd640 1 --2- 172.21.15.77:0/4113205689 >> [v2:172.21.15.121:6833/2449150984,v1:172.21.15.121:6835/2449150984] conn(0x5646615d0930 0x5646615decf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:50.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.451+0000 7fd526ffd640 1 -- 172.21.15.77:0/4113205689 >> [v2:172.21.15.121:6833/2449150984,v1:172.21.15.121:6835/2449150984] conn(0x5646615d0930 msgr2=0x5646615decf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-04-25T01:39:50.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.451+0000 7fd526ffd640 1 -- 172.21.15.77:0/4113205689 >> [v2:172.21.15.121:6833/2449150984,v1:172.21.15.121:6835/2449150984] conn(0x5646615d0930 msgr2=0x5646615decf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T01:39:50.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.451+0000 7fd526ffd640 1 --2- 172.21.15.77:0/4113205689 >> [v2:172.21.15.121:6833/2449150984,v1:172.21.15.121:6835/2449150984] conn(0x5646615d0930 0x5646615decf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T01:39:50.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.451+0000 7fd526ffd640 1 --2- 172.21.15.77:0/4113205689 >> [v2:172.21.15.121:6833/2449150984,v1:172.21.15.121:6835/2449150984] conn(0x5646615d0930 0x5646615decf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T01:39:50.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.652+0000 7fd526ffd640 1 --2- 172.21.15.77:0/4113205689 >> [v2:172.21.15.121:6833/2449150984,v1:172.21.15.121:6835/2449150984] conn(0x5646615d0930 0x5646615decf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:50.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.652+0000 7fd526ffd640 1 --2- 172.21.15.77:0/4113205689 >> [v2:172.21.15.121:6833/2449150984,v1:172.21.15.121:6835/2449150984] conn(0x5646615d0930 0x5646615decf0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1f9c9ed848c4f06 server_cookie=b8ab40990391c1d7 in_seq=0 out_seq=0 2024-04-25T01:39:50.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.652+0000 7fd505ffb640 10 client.4851 ms_handle_connect on v2:172.21.15.121:6833/2449150984 2024-04-25T01:39:50.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.653+0000 7fd505ffb640 1 -- 172.21.15.77:0/4113205689 <== mds.0 v2:172.21.15.121:6833/2449150984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5646614f4440 con 0x5646615d0930 2024-04-25T01:39:50.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.653+0000 7fd505ffb640 10 client.4851 handle_command_reply: tid=0 2024-04-25T01:39:50.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.653+0000 7fd530284740 1 client.4851 shutdown 2024-04-25T01:39:50.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.653+0000 7fd530284740 1 -- 172.21.15.77:0/4113205689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5646615c1ad0 msgr2=0x564661582c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:50.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.653+0000 7fd530284740 1 --2- 172.21.15.77:0/4113205689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5646615c1ad0 0x564661582c70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd51000fff0 tx=0x7fd510004730 comp rx=0 tx=0).stop 2024-04-25T01:39:50.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.654+0000 7fd530284740 1 -- 172.21.15.77:0/4113205689 shutdown_connections 2024-04-25T01:39:50.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.654+0000 7fd530284740 1 --2- 172.21.15.77:0/4113205689 >> [v2:172.21.15.121:6833/2449150984,v1:172.21.15.121:6835/2449150984] conn(0x5646615d0930 0x5646615decf0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.654+0000 7fd530284740 1 --2- 172.21.15.77:0/4113205689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5646615c1ad0 0x564661582c70 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.654+0000 7fd530284740 1 --2- 172.21.15.77:0/4113205689 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5646615d3a90 0x56466159fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.654+0000 7fd505ffb640 0 client.4851 ms_handle_reset on v2:172.21.15.121:6833/2449150984 2024-04-25T01:39:50.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.654+0000 7fd530284740 1 --2- 172.21.15.77:0/4113205689 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646615a5510 0x5646615bb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.654+0000 7fd530284740 1 -- 172.21.15.77:0/4113205689 >> 172.21.15.77:0/4113205689 conn(0x5646615848e0 msgr2=0x5646615bf510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:50.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.654+0000 7fd530284740 1 -- 172.21.15.77:0/4113205689 shutdown_connections 2024-04-25T01:39:50.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.654+0000 7fd530284740 1 -- 172.21.15.77:0/4113205689 wait complete. 2024-04-25T01:39:50.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.654+0000 7fd530284740 20 client.4851 trim_cache size 0 max 16384 2024-04-25T01:39:50.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.672+0000 7fd530284740 1 Processor -- start 2024-04-25T01:39:50.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.672+0000 7fd530284740 1 -- start start 2024-04-25T01:39:50.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.672+0000 7fd530284740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5646615a5510 0x5646615b6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:50.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.672+0000 7fd530284740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646615c1ad0 0x5646615b97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:50.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.672+0000 7fd530284740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5646615d3a90 0x5646615b9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:50.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.672+0000 7fd530284740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd5281fb600 con 0x5646615d3a90 2024-04-25T01:39:50.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.672+0000 7fd530284740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd5281ec0a0 con 0x5646615c1ad0 2024-04-25T01:39:50.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.672+0000 7fd530284740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd5281f9620 con 0x5646615a5510 2024-04-25T01:39:50.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.672+0000 7fd5277fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5646615d3a90 0x5646615b9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:50.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.672+0000 7fd5277fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5646615d3a90 0x5646615b9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44982/0 (socket says 172.21.15.77:44982) 2024-04-25T01:39:50.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.672+0000 7fd5277fe640 1 -- 172.21.15.77:0/4013362077 learned_addr learned my addr 172.21.15.77:0/4013362077 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:50.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.673+0000 7fd5277fe640 1 -- 172.21.15.77:0/4013362077 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5646615a5510 msgr2=0x5646615b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:50.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.673+0000 7fd5277fe640 1 --2- 172.21.15.77:0/4013362077 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5646615a5510 0x5646615b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.673+0000 7fd5277fe640 1 -- 172.21.15.77:0/4013362077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646615c1ad0 msgr2=0x5646615b97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:50.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.673+0000 7fd5277fe640 1 --2- 172.21.15.77:0/4013362077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646615c1ad0 0x5646615b97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.673+0000 7fd5277fe640 1 -- 172.21.15.77:0/4013362077 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646615baac0 con 0x5646615d3a90 2024-04-25T01:39:50.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.673+0000 7fd5277fe640 1 --2- 172.21.15.77:0/4013362077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5646615d3a90 0x5646615b9d00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd520007f20 tx=0x7fd520010890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b27f0ad49b6c559 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:50.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.673+0000 7fd507fff640 1 -- 172.21.15.77:0/4013362077 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52001e070 con 0x5646615d3a90 2024-04-25T01:39:50.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.673+0000 7fd507fff640 1 -- 172.21.15.77:0/4013362077 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd52000e5f0 con 0x5646615d3a90 2024-04-25T01:39:50.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.673+0000 7fd507fff640 1 -- 172.21.15.77:0/4013362077 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52000e9a0 con 0x5646615d3a90 2024-04-25T01:39:50.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.674+0000 7fd530284740 1 -- 172.21.15.77:0/4013362077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5646615d3a90 msgr2=0x5646615b9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:50.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.674+0000 7fd530284740 1 --2- 172.21.15.77:0/4013362077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5646615d3a90 0x5646615b9d00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd520007f20 tx=0x7fd520010890 comp rx=0 tx=0).stop 2024-04-25T01:39:50.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.674+0000 7fd530284740 1 -- 172.21.15.77:0/4013362077 shutdown_connections 2024-04-25T01:39:50.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.674+0000 7fd530284740 1 --2- 172.21.15.77:0/4013362077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5646615d3a90 0x5646615b9d00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.674+0000 7fd530284740 1 --2- 172.21.15.77:0/4013362077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646615c1ad0 0x5646615b97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.674+0000 7fd530284740 1 --2- 172.21.15.77:0/4013362077 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5646615a5510 0x5646615b6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.674+0000 7fd530284740 1 -- 172.21.15.77:0/4013362077 >> 172.21.15.77:0/4013362077 conn(0x5646615848e0 msgr2=0x56466157ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:50.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.674+0000 7fd530284740 1 -- 172.21.15.77:0/4013362077 shutdown_connections 2024-04-25T01:39:50.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.674+0000 7fd530284740 1 -- 172.21.15.77:0/4013362077 wait complete. 2024-04-25T01:39:50.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.674+0000 7fd530284740 1 -- start start 2024-04-25T01:39:50.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.674+0000 7fd530284740 1 Processor -- start 2024-04-25T01:39:50.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.675+0000 7fd530284740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5646615a5510 0x56466157dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:50.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.675+0000 7fd530284740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5646615c1ad0 0x56466163e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:50.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.675+0000 7fd530284740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646615d3a90 0x564661637840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:50.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.675+0000 7fd530284740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564661584490 con 0x5646615c1ad0 2024-04-25T01:39:50.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.675+0000 7fd530284740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56466148f750 con 0x5646615d3a90 2024-04-25T01:39:50.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.675+0000 7fd530284740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x5646615d03e0 con 0x5646615a5510 2024-04-25T01:39:50.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.675+0000 7fd530284740 10 client.0 _ll_register_callbacks cb 0x7fd51000a660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T01:39:50.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.675+0000 7fd51ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5646615c1ad0 0x56466163e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:50.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.675+0000 7fd51ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5646615c1ad0 0x56466163e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44996/0 (socket says 172.21.15.77:44996) 2024-04-25T01:39:50.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.675+0000 7fd51ffff640 1 -- 172.21.15.77:0/4268500640 learned_addr learned my addr 172.21.15.77:0/4268500640 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:50.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.675+0000 7fd526ffd640 1 --2- 172.21.15.77:0/4268500640 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5646615a5510 0x56466157dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:50.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.675+0000 7fd5277fe640 1 --2- 172.21.15.77:0/4268500640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646615d3a90 0x564661637840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:50.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.675+0000 7fd51ffff640 1 -- 172.21.15.77:0/4268500640 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5646615a5510 msgr2=0x56466157dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:50.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.675+0000 7fd51ffff640 1 --2- 172.21.15.77:0/4268500640 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5646615a5510 0x56466157dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.675+0000 7fd51ffff640 1 -- 172.21.15.77:0/4268500640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646615d3a90 msgr2=0x564661637840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:50.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.675+0000 7fd51ffff640 1 --2- 172.21.15.77:0/4268500640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646615d3a90 0x564661637840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.675+0000 7fd51ffff640 1 -- 172.21.15.77:0/4268500640 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646615bed20 con 0x5646615c1ad0 2024-04-25T01:39:50.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.675+0000 7fd5277fe640 1 --2- 172.21.15.77:0/4268500640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646615d3a90 0x564661637840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:50.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.675+0000 7fd51ffff640 1 --2- 172.21.15.77:0/4268500640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5646615c1ad0 0x56466163e4e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd51000a510 tx=0x7fd51000fe80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56cc0ed682956d22 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:50.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.675+0000 7fd505ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-25T01:39:50.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.676+0000 7fd505ffb640 1 -- 172.21.15.77:0/4268500640 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd510025030 con 0x5646615c1ad0 2024-04-25T01:39:50.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.676+0000 7fd505ffb640 1 -- 172.21.15.77:0/4268500640 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fd510021b20 con 0x5646615c1ad0 2024-04-25T01:39:50.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.676+0000 7fd530284740 1 -- 172.21.15.77:0/4268500640 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd52000e5f0 con 0x5646615c1ad0 2024-04-25T01:39:50.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.676+0000 7fd505ffb640 1 -- 172.21.15.77:0/4268500640 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7fd510021840 con 0x5646615c1ad0 2024-04-25T01:39:50.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.676+0000 7fd530284740 10 client.4857 fetch_fsmap learned FSMap version 12 2024-04-25T01:39:50.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.676+0000 7fd530284740 1 -- 172.21.15.77:0/4268500640 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) -- 0x5646615b6e90 con 0x5646615c1ad0 2024-04-25T01:39:50.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.676+0000 7fd505ffb640 1 -- 172.21.15.77:0/4268500640 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd52000e5f0 con 0x5646615c1ad0 2024-04-25T01:39:50.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.676+0000 7fd505ffb640 1 -- 172.21.15.77:0/4268500640 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 12) ==== 4128+0+0 (secure 0 0 0) 0x7fd510005990 con 0x5646615c1ad0 2024-04-25T01:39:50.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.676+0000 7fd530284740 10 client.4857 fetch_fsmap finished waiting for FSMap version 12 2024-04-25T01:39:50.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.676+0000 7fd530284740 10 client.4857 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T01:39:50.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.676+0000 7fd530284740 20 client.4857 populate_metadata read hostname 'smithi077' 2024-04-25T01:39:50.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.676+0000 7fd530284740 1 --2- 172.21.15.77:0/4268500640 >> [v2:172.21.15.121:6833/2449150984,v1:172.21.15.121:6835/2449150984] conn(0x5646615a3d50 0x5646615a4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:50.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.676+0000 7fd530284740 4 client.4857 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T01:39:50.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.676+0000 7fd530284740 1 -- 172.21.15.77:0/4268500640 --> [v2:172.21.15.121:6833/2449150984,v1:172.21.15.121:6835/2449150984] -- command(tid 0: {"prefix": "status"}) -- 0x5646614ee790 con 0x5646615a3d50 2024-04-25T01:39:50.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.676+0000 7fd526ffd640 1 --2- 172.21.15.77:0/4268500640 >> [v2:172.21.15.121:6833/2449150984,v1:172.21.15.121:6835/2449150984] conn(0x5646615a3d50 0x5646615a4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:50.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.677+0000 7fd526ffd640 1 --2- 172.21.15.77:0/4268500640 >> [v2:172.21.15.121:6833/2449150984,v1:172.21.15.121:6835/2449150984] conn(0x5646615a3d50 0x5646615a4130 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0c7293503abd16f server_cookie=7457afbe0048c681 in_seq=0 out_seq=0 2024-04-25T01:39:50.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.677+0000 7fd505ffb640 10 client.4857 ms_handle_connect on v2:172.21.15.121:6833/2449150984 2024-04-25T01:39:50.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.677+0000 7fd505ffb640 1 -- 172.21.15.77:0/4268500640 <== mds.0 v2:172.21.15.121:6833/2449150984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x5646614ee790 con 0x5646615a3d50 2024-04-25T01:39:50.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.677+0000 7fd505ffb640 10 client.4857 handle_command_reply: tid=0 2024-04-25T01:39:50.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.677+0000 7fd530284740 1 client.4857 shutdown 2024-04-25T01:39:50.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.677+0000 7fd530284740 1 -- 172.21.15.77:0/4268500640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5646615c1ad0 msgr2=0x56466163e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:50.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.677+0000 7fd530284740 1 --2- 172.21.15.77:0/4268500640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5646615c1ad0 0x56466163e4e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd51000a510 tx=0x7fd51000fe80 comp rx=0 tx=0).stop 2024-04-25T01:39:50.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.677+0000 7fd530284740 1 -- 172.21.15.77:0/4268500640 shutdown_connections 2024-04-25T01:39:50.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.677+0000 7fd530284740 1 --2- 172.21.15.77:0/4268500640 >> [v2:172.21.15.121:6833/2449150984,v1:172.21.15.121:6835/2449150984] conn(0x5646615a3d50 0x5646615a4130 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.677+0000 7fd530284740 1 --2- 172.21.15.77:0/4268500640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5646615c1ad0 0x56466163e4e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.677+0000 7fd505ffb640 0 client.4857 ms_handle_reset on v2:172.21.15.121:6833/2449150984 2024-04-25T01:39:50.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.677+0000 7fd530284740 1 --2- 172.21.15.77:0/4268500640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5646615d3a90 0x564661637840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.677+0000 7fd530284740 1 --2- 172.21.15.77:0/4268500640 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5646615a5510 0x56466157dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.677+0000 7fd530284740 1 -- 172.21.15.77:0/4268500640 >> 172.21.15.77:0/4268500640 conn(0x5646615848e0 msgr2=0x5646615c1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:50.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.677+0000 7fd530284740 1 -- 172.21.15.77:0/4268500640 shutdown_connections 2024-04-25T01:39:50.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.677+0000 7fd530284740 1 -- 172.21.15.77:0/4268500640 wait complete. 2024-04-25T01:39:50.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.677+0000 7fd530284740 20 client.4857 trim_cache size 0 max 16384 2024-04-25T01:39:50.671 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T01:39:50.671 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "70f1c0d7-4e08-4883-a8bd-1451a32d9af1", 2024-04-25T01:39:50.671 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2024-04-25T01:39:50.671 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 4290, 2024-04-25T01:39:50.671 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2024-04-25T01:39:50.671 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2024-04-25T01:39:50.671 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "a", 2024-04-25T01:39:50.671 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 26.300204597, 2024-04-25T01:39:50.671 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 7, 2024-04-25T01:39:50.671 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 24, 2024-04-25T01:39:50.672 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 20, 2024-04-25T01:39:50.672 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 33.455434246999999 2024-04-25T01:39:50.672 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T01:39:50.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.677+0000 7fd52d570640 1 -- 172.21.15.77:0/2590994118 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd50806be60 msgr2=0x7fd50806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:50.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.677+0000 7fd52d570640 1 --2- 172.21.15.77:0/2590994118 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd50806be60 0x7fd50806e320 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd5280ca7b0 tx=0x7fd510008040 comp rx=0 tx=0).stop 2024-04-25T01:39:50.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.677+0000 7fd52d570640 1 -- 172.21.15.77:0/2590994118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5280cbef0 msgr2=0x7fd5281ef3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:50.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.678+0000 7fd52d570640 1 --2- 172.21.15.77:0/2590994118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5280cbef0 0x7fd5281ef3f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd51802a180 tx=0x7fd5180046c0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.678+0000 7fd52d570640 1 -- 172.21.15.77:0/2590994118 shutdown_connections 2024-04-25T01:39:50.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.678+0000 7fd52d570640 1 --2- 172.21.15.77:0/2590994118 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd50806be60 0x7fd50806e320 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.678+0000 7fd52d570640 1 --2- 172.21.15.77:0/2590994118 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd52815a0e0 0x7fd52814b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.678+0000 7fd52d570640 1 --2- 172.21.15.77:0/2590994118 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd52814fd20 0x7fd5280c4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.678+0000 7fd52d570640 1 --2- 172.21.15.77:0/2590994118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5280cbef0 0x7fd5281ef3f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.678+0000 7fd52d570640 1 -- 172.21.15.77:0/2590994118 >> 172.21.15.77:0/2590994118 conn(0x7fd528067080 msgr2=0x7fd528158250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:50.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.678+0000 7fd52d570640 1 -- 172.21.15.77:0/2590994118 shutdown_connections 2024-04-25T01:39:50.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.678+0000 7fd52d570640 1 -- 172.21.15.77:0/2590994118 wait complete. 2024-04-25T01:39:50.675 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T01:39:50.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.788+0000 7f401f610640 1 Processor -- start 2024-04-25T01:39:50.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.789+0000 7f401f610640 1 -- start start 2024-04-25T01:39:50.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.789+0000 7f401f610640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f40180c3af0 0x7f4018070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:50.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.789+0000 7f401f610640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40181596b0 0x7f401814c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:50.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.789+0000 7f401f610640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4018072c30 con 0x7f40180adb60 2024-04-25T01:39:50.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.789+0000 7f401f610640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f401806c870 con 0x7f40180c3af0 2024-04-25T01:39:50.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.789+0000 7f401f610640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f4018072f10 con 0x7f40181596b0 2024-04-25T01:39:50.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.789+0000 7f401d3ac640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f40180c3af0 0x7f4018070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:50.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.789+0000 7f401d3ac640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f40180c3af0 0x7f4018070e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44998/0 (socket says 172.21.15.77:44998) 2024-04-25T01:39:50.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.790+0000 7f401d3ac640 1 -- 172.21.15.77:0/3296292021 learned_addr learned my addr 172.21.15.77:0/3296292021 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:50.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.790+0000 7f401dbad640 1 --2- 172.21.15.77:0/3296292021 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40181596b0 0x7f401814c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:50.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.790+0000 7f401d3ac640 1 -- 172.21.15.77:0/3296292021 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40181596b0 msgr2=0x7f401814c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:50.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.790+0000 7f401d3ac640 1 --2- 172.21.15.77:0/3296292021 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40181596b0 0x7f401814c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.790+0000 7f401d3ac640 1 -- 172.21.15.77:0/3296292021 >> v1:172.21.15.121:6789/0 conn(0x7f40180adb60 legacy=0x7f4018156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:50.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.790+0000 7f401d3ac640 1 -- 172.21.15.77:0/3296292021 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f401806cac0 con 0x7f40180c3af0 2024-04-25T01:39:50.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.790+0000 7f401dbad640 1 --2- 172.21.15.77:0/3296292021 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40181596b0 0x7f401814c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:50.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.790+0000 7f401d3ac640 1 --2- 172.21.15.77:0/3296292021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40180c3af0 0x7f4018070e00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4010009e50 tx=0x7f401002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce750e47946251a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:50.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.791+0000 7f400ffff640 1 -- 172.21.15.77:0/3296292021 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4010036070 con 0x7f40180c3af0 2024-04-25T01:39:50.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.791+0000 7f400ffff640 1 -- 172.21.15.77:0/3296292021 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4010031600 con 0x7f40180c3af0 2024-04-25T01:39:50.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.791+0000 7f400ffff640 1 -- 172.21.15.77:0/3296292021 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40100319d0 con 0x7f40180c3af0 2024-04-25T01:39:50.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.791+0000 7f401f610640 1 -- 172.21.15.77:0/3296292021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40180c3af0 msgr2=0x7f4018070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:50.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.791+0000 7f401f610640 1 --2- 172.21.15.77:0/3296292021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40180c3af0 0x7f4018070e00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4010009e50 tx=0x7f401002a5f0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.791+0000 7f401f610640 1 -- 172.21.15.77:0/3296292021 shutdown_connections 2024-04-25T01:39:50.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.791+0000 7f401f610640 1 --2- 172.21.15.77:0/3296292021 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40181596b0 0x7f401814c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.791+0000 7f401f610640 1 --2- 172.21.15.77:0/3296292021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40180c3af0 0x7f4018070e00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.791+0000 7f401f610640 1 -- 172.21.15.77:0/3296292021 >> 172.21.15.77:0/3296292021 conn(0x7f40180c4970 msgr2=0x7f40180c4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:50.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.791+0000 7f401f610640 1 -- 172.21.15.77:0/3296292021 shutdown_connections 2024-04-25T01:39:50.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.791+0000 7f401f610640 1 -- 172.21.15.77:0/3296292021 wait complete. 2024-04-25T01:39:50.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.792+0000 7f401f610640 1 Processor -- start 2024-04-25T01:39:50.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.792+0000 7f401f610640 1 -- start start 2024-04-25T01:39:50.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.793+0000 7f401f610640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40180adb60 0x7f40181ebe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:50.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.793+0000 7f401f610640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40180c3af0 0x7f4018155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:50.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.793+0000 7f401f610640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40181596b0 0x7f40180c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:50.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.793+0000 7f401f610640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f40180c4050 con 0x7f40180adb60 2024-04-25T01:39:50.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.793+0000 7f401f610640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f40180c3ed0 con 0x7f40180c3af0 2024-04-25T01:39:50.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.793+0000 7f401f610640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f4018159ae0 con 0x7f40181596b0 2024-04-25T01:39:50.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.793+0000 7f401d3ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40180adb60 0x7f40181ebe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:50.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.793+0000 7f401d3ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40180adb60 0x7f40181ebe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45004/0 (socket says 172.21.15.77:45004) 2024-04-25T01:39:50.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.793+0000 7f401d3ac640 1 -- 172.21.15.77:0/1431108056 learned_addr learned my addr 172.21.15.77:0/1431108056 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:50.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.793+0000 7f401dbad640 1 --2- 172.21.15.77:0/1431108056 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40181596b0 0x7f40180c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:50.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.793+0000 7f401cbab640 1 --2- 172.21.15.77:0/1431108056 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40180c3af0 0x7f4018155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:50.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.793+0000 7f401d3ac640 1 -- 172.21.15.77:0/1431108056 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40181596b0 msgr2=0x7f40180c6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:50.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.793+0000 7f401d3ac640 1 --2- 172.21.15.77:0/1431108056 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40181596b0 0x7f40180c6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.793+0000 7f401d3ac640 1 -- 172.21.15.77:0/1431108056 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40180c3af0 msgr2=0x7f4018155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:50.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.793+0000 7f401d3ac640 1 --2- 172.21.15.77:0/1431108056 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40180c3af0 0x7f4018155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.793+0000 7f401d3ac640 1 -- 172.21.15.77:0/1431108056 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f401814d4e0 con 0x7f40180adb60 2024-04-25T01:39:50.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.793+0000 7f401d3ac640 1 --2- 172.21.15.77:0/1431108056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40180adb60 0x7f40181ebe00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4010009f70 tx=0x7f4010004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:50.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.794+0000 7f400dffb640 1 -- 172.21.15.77:0/1431108056 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4010036050 con 0x7f40180adb60 2024-04-25T01:39:50.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.794+0000 7f400dffb640 1 -- 172.21.15.77:0/1431108056 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4010042070 con 0x7f40180adb60 2024-04-25T01:39:50.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.794+0000 7f401f610640 1 -- 172.21.15.77:0/1431108056 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40181ec340 con 0x7f40180adb60 2024-04-25T01:39:50.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.794+0000 7f400dffb640 1 -- 172.21.15.77:0/1431108056 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4010007c50 con 0x7f40180adb60 2024-04-25T01:39:50.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.794+0000 7f401f610640 1 -- 172.21.15.77:0/1431108056 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40180aa970 con 0x7f40180adb60 2024-04-25T01:39:50.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.795+0000 7f401f610640 1 -- 172.21.15.77:0/1431108056 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f401804f500 con 0x7f40180adb60 2024-04-25T01:39:50.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.795+0000 7f400dffb640 1 -- 172.21.15.77:0/1431108056 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4010047460 con 0x7f40180adb60 2024-04-25T01:39:50.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.796+0000 7f400dffb640 1 --2- 172.21.15.77:0/1431108056 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3ffc06be30 0x7f3ffc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:50.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.796+0000 7f400dffb640 1 -- 172.21.15.77:0/1431108056 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f40100ac000 con 0x7f40180adb60 2024-04-25T01:39:50.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.796+0000 7f401cbab640 1 --2- 172.21.15.77:0/1431108056 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3ffc06be30 0x7f3ffc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:50.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.796+0000 7f401cbab640 1 --2- 172.21.15.77:0/1431108056 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3ffc06be30 0x7f3ffc06e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f40180c7da0 tx=0x7f4008009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:50.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.800+0000 7f400dffb640 1 -- 172.21.15.77:0/1431108056 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f40181ec340 con 0x7f40180adb60 2024-04-25T01:39:50.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.972+0000 7f401f610640 1 -- 172.21.15.77:0/1431108056 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f40180671b0 con 0x7f40180adb60 2024-04-25T01:39:50.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.974+0000 7f400dffb640 1 -- 172.21.15.77:0/1431108056 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20331 (secure 0 0 0) 0x7f401007a0c0 con 0x7f40180adb60 2024-04-25T01:39:50.958 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:50.958 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:39:34.425701+0000","last_up_change":"2024-04-25T01:39:10.729600+0000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T01:39:11.681151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T01:39:21.606752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T01:39:22.677664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T01:39:30.501700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T01:39:31.740717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6811","nonce":3366980158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6817","nonce":3366980158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6828","nonce":3366980158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6825","nonce":3366980158}]},"public_addr":"172.21.15.77:6811/3366980158","cluster_addr":"172.21.15.77:6817/3366980158","heartbeat_back_addr":"172.21.15.77:6828/3366980158","heartbeat_front_addr":"172.21.15.77:6825/3366980158","state":["exists","up"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6801","nonce":3971619298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6803","nonce":3971619298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6807","nonce":3971619298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6805","nonce":3971619298}]},"public_addr":"172.21.15.77:6801/3971619298","cluster_addr":"172.21.15.77:6803/3971619298","heartbeat_back_addr":"172.21.15.77:6807/3971619298","heartbeat_front_addr":"172.21.15.77:6805/3971619298","state":["exists","up"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6810","nonce":4103452689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6813","nonce":4103452689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6823","nonce":4103452689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6818","nonce":4103452689}]},"public_addr":"172.21.15.77:6810/4103452689","cluster_addr":"172.21.15.77:6813/4103452689","heartbeat_back_addr":"172.21.15.77:6823/4103452689","heartbeat_front_addr":"172.21.15.77:6818/4103452689","state":["exists","up"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6819","nonce":217398906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6824","nonce":217398906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6831","nonce":217398906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6829","nonce":217398906}]},"public_addr":"172.21.15.77:6819/217398906","cluster_addr":"172.21.15.77:6824/217398906","heartbeat_back_addr":"172.21.15.77:6831/217398906","heartbeat_front_addr":"172.21.15.77:6829/217398906","state":["exists","up"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6801","nonce":2565483070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6803","nonce":2565483070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6810","nonce":2565483070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6806","nonce":2565483070}]},"public_addr":"172.21.15.121:6801/2565483070","cluster_addr":"172.21.15.121:6803/2565483070","heartbeat_back_addr":"172.21.15.121:6810/2565483070","heartbeat_front_addr":"172.21.15.121:6806/2565483070","state":["exists","up"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6807","nonce":2785294752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6809","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6811","nonce":2785294752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6815","nonce":2785294752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6813","nonce":2785294752}]},"public_addr":"172.21.15.121:6807/2785294752","cluster_addr":"172.21.15.121:6811/2785294752","heartbeat_back_addr":"172.21.15.121:6815/2785294752","heartbeat_front_addr":"172.21.15.121:6813/2785294752","state":["exists","up"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6820","nonce":523906818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6824","nonce":523906818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6831","nonce":523906818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6828","nonce":523906818}]},"public_addr":"172.21.15.121:6820/523906818","cluster_addr":"172.21.15.121:6824/523906818","heartbeat_back_addr":"172.21.15.121:6831/523906818","heartbeat_front_addr":"172.21.15.121:6828/523906818","state":["exists","up"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6817","nonce":1683602459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6819","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6821","nonce":1683602459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6829","nonce":1683602459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6823","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6825","nonce":1683602459}]},"public_addr":"172.21.15.121:6817/1683602459","cluster_addr":"172.21.15.121:6821/1683602459","heartbeat_back_addr":"172.21.15.121:6829/1683602459","heartbeat_front_addr":"172.21.15.121:6825/1683602459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.839443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.818842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.776243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.793085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.822396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.907311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.918374+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.848430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:39:50.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.976+0000 7f401f610640 1 -- 172.21.15.77:0/1431108056 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3ffc06be30 msgr2=0x7f3ffc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:50.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.976+0000 7f401f610640 1 --2- 172.21.15.77:0/1431108056 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3ffc06be30 0x7f3ffc06e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f40180c7da0 tx=0x7f4008009040 comp rx=0 tx=0).stop 2024-04-25T01:39:50.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.976+0000 7f401f610640 1 -- 172.21.15.77:0/1431108056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40180adb60 msgr2=0x7f40181ebe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:50.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.976+0000 7f401f610640 1 --2- 172.21.15.77:0/1431108056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40180adb60 0x7f40181ebe00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4010009f70 tx=0x7f4010004a40 comp rx=0 tx=0).stop 2024-04-25T01:39:50.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.976+0000 7f401f610640 1 -- 172.21.15.77:0/1431108056 shutdown_connections 2024-04-25T01:39:50.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.976+0000 7f401f610640 1 --2- 172.21.15.77:0/1431108056 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3ffc06be30 0x7f3ffc06e2f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.976+0000 7f401f610640 1 --2- 172.21.15.77:0/1431108056 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40181596b0 0x7f40180c6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.976+0000 7f401f610640 1 --2- 172.21.15.77:0/1431108056 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40180c3af0 0x7f4018155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.976+0000 7f401f610640 1 --2- 172.21.15.77:0/1431108056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40180adb60 0x7f40181ebe00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:50.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.976+0000 7f401f610640 1 -- 172.21.15.77:0/1431108056 >> 172.21.15.77:0/1431108056 conn(0x7f40180c4970 msgr2=0x7f4018070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:50.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.976+0000 7f401f610640 1 -- 172.21.15.77:0/1431108056 shutdown_connections 2024-04-25T01:39:50.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:50.976+0000 7f401f610640 1 -- 172.21.15.77:0/1431108056 wait complete. 2024-04-25T01:39:50.970 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T01:39:11.681151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-25T01:39:21.606752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-25T01:39:22.677664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-25T01:39:30.501700+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-25T01:39:31.740717+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T01:39:50.971 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T01:39:51.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.087+0000 7f28ae09a640 1 Processor -- start 2024-04-25T01:39:51.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.087+0000 7f28ae09a640 1 -- start start 2024-04-25T01:39:51.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.088+0000 7f28ae09a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f28a80c4280 0x7f28a8153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:51.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.088+0000 7f28ae09a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f28a8151900 0x7f28a806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:51.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.088+0000 7f28ae09a640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28a8154430 con 0x7f28a80aca40 2024-04-25T01:39:51.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.088+0000 7f28ae09a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f28a81546b0 con 0x7f28a80c4280 2024-04-25T01:39:51.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.088+0000 7f28ae09a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f28a8154990 con 0x7f28a8151900 2024-04-25T01:39:51.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.088+0000 7f28a77fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f28a80c4280 0x7f28a8153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:51.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.088+0000 7f28a77fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f28a80c4280 0x7f28a8153ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45014/0 (socket says 172.21.15.77:45014) 2024-04-25T01:39:51.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.088+0000 7f28a77fe640 1 -- 172.21.15.77:0/1335693837 learned_addr learned my addr 172.21.15.77:0/1335693837 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:51.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.088+0000 7f28a77fe640 1 -- 172.21.15.77:0/1335693837 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f28a8151900 msgr2=0x7f28a806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:51.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.088+0000 7f28a7fff640 1 --2- 172.21.15.77:0/1335693837 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f28a8151900 0x7f28a806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:51.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.088+0000 7f28a77fe640 1 --2- 172.21.15.77:0/1335693837 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f28a8151900 0x7f28a806d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.088+0000 7f28a77fe640 1 -- 172.21.15.77:0/1335693837 >> v1:172.21.15.121:6789/0 conn(0x7f28a80aca40 legacy=0x7f28a81511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:51.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.088+0000 7f28a77fe640 1 -- 172.21.15.77:0/1335693837 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a8154c70 con 0x7f28a80c4280 2024-04-25T01:39:51.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.089+0000 7f28a77fe640 1 --2- 172.21.15.77:0/1335693837 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28a80c4280 0x7f28a8153ef0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2898009870 tx=0x7f289802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9468c00c80c1897 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:51.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.089+0000 7f28a67fc640 1 -- 172.21.15.77:0/1335693837 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2898037070 con 0x7f28a80c4280 2024-04-25T01:39:51.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.089+0000 7f28a67fc640 1 -- 172.21.15.77:0/1335693837 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2898032440 con 0x7f28a80c4280 2024-04-25T01:39:51.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.089+0000 7f28a67fc640 1 -- 172.21.15.77:0/1335693837 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2898032810 con 0x7f28a80c4280 2024-04-25T01:39:51.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.089+0000 7f28ae09a640 1 -- 172.21.15.77:0/1335693837 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28a80c4280 msgr2=0x7f28a8153ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:51.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.089+0000 7f28ae09a640 1 --2- 172.21.15.77:0/1335693837 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28a80c4280 0x7f28a8153ef0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2898009870 tx=0x7f289802a180 comp rx=0 tx=0).stop 2024-04-25T01:39:51.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.089+0000 7f28ae09a640 1 -- 172.21.15.77:0/1335693837 shutdown_connections 2024-04-25T01:39:51.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.089+0000 7f28ae09a640 1 --2- 172.21.15.77:0/1335693837 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f28a8151900 0x7f28a806d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.089+0000 7f28ae09a640 1 --2- 172.21.15.77:0/1335693837 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28a80c4280 0x7f28a8153ef0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.089+0000 7f28ae09a640 1 -- 172.21.15.77:0/1335693837 >> 172.21.15.77:0/1335693837 conn(0x7f28a80c7580 msgr2=0x7f28a80c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:51.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.089+0000 7f28ae09a640 1 -- 172.21.15.77:0/1335693837 shutdown_connections 2024-04-25T01:39:51.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.089+0000 7f28ae09a640 1 -- 172.21.15.77:0/1335693837 wait complete. 2024-04-25T01:39:51.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.090+0000 7f28ae09a640 1 Processor -- start 2024-04-25T01:39:51.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.091+0000 7f28ae09a640 1 -- start start 2024-04-25T01:39:51.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.091+0000 7f28ae09a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28a80aca40 0x7f28a80c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:51.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.091+0000 7f28ae09a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28a80c4280 0x7f28a81ef690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:51.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.091+0000 7f28ae09a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f28a8151900 0x7f28a81efbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:51.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.091+0000 7f28ae09a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f28a80c47e0 con 0x7f28a80c4280 2024-04-25T01:39:51.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.091+0000 7f28ae09a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f28a80c4660 con 0x7f28a80aca40 2024-04-25T01:39:51.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.091+0000 7f28ae09a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f28a806de00 con 0x7f28a8151900 2024-04-25T01:39:51.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.091+0000 7f28a6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28a80c4280 0x7f28a81ef690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:51.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.091+0000 7f28a6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28a80c4280 0x7f28a81ef690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45024/0 (socket says 172.21.15.77:45024) 2024-04-25T01:39:51.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.091+0000 7f28a6ffd640 1 -- 172.21.15.77:0/1607706440 learned_addr learned my addr 172.21.15.77:0/1607706440 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:51.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.092+0000 7f28a77fe640 1 --2- 172.21.15.77:0/1607706440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28a80aca40 0x7f28a80c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:51.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.092+0000 7f28a7fff640 1 --2- 172.21.15.77:0/1607706440 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f28a8151900 0x7f28a81efbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:51.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.092+0000 7f28a6ffd640 1 -- 172.21.15.77:0/1607706440 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f28a8151900 msgr2=0x7f28a81efbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:51.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.092+0000 7f28a6ffd640 1 --2- 172.21.15.77:0/1607706440 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f28a8151900 0x7f28a81efbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.092+0000 7f28a6ffd640 1 -- 172.21.15.77:0/1607706440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28a80aca40 msgr2=0x7f28a80c0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:51.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.092+0000 7f28a6ffd640 1 --2- 172.21.15.77:0/1607706440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28a80aca40 0x7f28a80c0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.092+0000 7f28a6ffd640 1 -- 172.21.15.77:0/1607706440 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a80abd20 con 0x7f28a80c4280 2024-04-25T01:39:51.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.092+0000 7f28a77fe640 1 --2- 172.21.15.77:0/1607706440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28a80aca40 0x7f28a80c0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:51.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.092+0000 7f28a6ffd640 1 --2- 172.21.15.77:0/1607706440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28a80c4280 0x7f28a81ef690 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f289c00c430 tx=0x7f289c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:51.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.092+0000 7f288ffff640 1 -- 172.21.15.77:0/1607706440 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c011790 con 0x7f28a80c4280 2024-04-25T01:39:51.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.092+0000 7f288ffff640 1 -- 172.21.15.77:0/1607706440 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f289c017070 con 0x7f28a80c4280 2024-04-25T01:39:51.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.092+0000 7f28ae09a640 1 -- 172.21.15.77:0/1607706440 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28a80ac420 con 0x7f28a80c4280 2024-04-25T01:39:51.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.092+0000 7f288ffff640 1 -- 172.21.15.77:0/1607706440 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c011bb0 con 0x7f28a80c4280 2024-04-25T01:39:51.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.092+0000 7f28ae09a640 1 -- 172.21.15.77:0/1607706440 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28a80c6780 con 0x7f28a80c4280 2024-04-25T01:39:51.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.093+0000 7f28ae09a640 1 -- 172.21.15.77:0/1607706440 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28a80c25e0 con 0x7f28a80c4280 2024-04-25T01:39:51.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.094+0000 7f288ffff640 1 -- 172.21.15.77:0/1607706440 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f289c01c460 con 0x7f28a80c4280 2024-04-25T01:39:51.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.094+0000 7f288ffff640 1 --2- 172.21.15.77:0/1607706440 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f289406be30 0x7f289406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:51.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.094+0000 7f28a77fe640 1 --2- 172.21.15.77:0/1607706440 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f289406be30 0x7f289406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:51.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.094+0000 7f288ffff640 1 -- 172.21.15.77:0/1607706440 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f289c08afd0 con 0x7f28a80c4280 2024-04-25T01:39:51.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.094+0000 7f28a77fe640 1 --2- 172.21.15.77:0/1607706440 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f289406be30 0x7f289406e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2898034000 tx=0x7f289802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:51.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.098+0000 7f288ffff640 1 -- 172.21.15.77:0/1607706440 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f28a80c25e0 con 0x7f28a80c4280 2024-04-25T01:39:51.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.274+0000 7f28ae09a640 1 -- 172.21.15.77:0/1607706440 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f28a804f500 con 0x7f28a80c4280 2024-04-25T01:39:51.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.275+0000 7f288ffff640 1 -- 172.21.15.77:0/1607706440 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f289c0596e0 con 0x7f28a80c4280 2024-04-25T01:39:51.258 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-25T01:39:51.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.277+0000 7f28ae09a640 1 -- 172.21.15.77:0/1607706440 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f289406be30 msgr2=0x7f289406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:51.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.277+0000 7f28ae09a640 1 --2- 172.21.15.77:0/1607706440 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f289406be30 0x7f289406e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2898034000 tx=0x7f289802e000 comp rx=0 tx=0).stop 2024-04-25T01:39:51.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.277+0000 7f28ae09a640 1 -- 172.21.15.77:0/1607706440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28a80c4280 msgr2=0x7f28a81ef690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:51.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.277+0000 7f28ae09a640 1 --2- 172.21.15.77:0/1607706440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28a80c4280 0x7f28a81ef690 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f289c00c430 tx=0x7f289c00c8f0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.277+0000 7f28ae09a640 1 -- 172.21.15.77:0/1607706440 shutdown_connections 2024-04-25T01:39:51.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.277+0000 7f28ae09a640 1 --2- 172.21.15.77:0/1607706440 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f289406be30 0x7f289406e2f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.277+0000 7f28ae09a640 1 --2- 172.21.15.77:0/1607706440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28a80c4280 0x7f28a81ef690 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.277+0000 7f28ae09a640 1 --2- 172.21.15.77:0/1607706440 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f28a8151900 0x7f28a81efbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.277+0000 7f28ae09a640 1 --2- 172.21.15.77:0/1607706440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28a80aca40 0x7f28a80c0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.277+0000 7f28ae09a640 1 -- 172.21.15.77:0/1607706440 >> 172.21.15.77:0/1607706440 conn(0x7f28a80c7580 msgr2=0x7f28a8151130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:51.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.277+0000 7f28ae09a640 1 -- 172.21.15.77:0/1607706440 shutdown_connections 2024-04-25T01:39:51.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.277+0000 7f28ae09a640 1 -- 172.21.15.77:0/1607706440 wait complete. 2024-04-25T01:39:51.271 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-25T01:39:51.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.387+0000 7ff13859e640 1 Processor -- start 2024-04-25T01:39:51.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.387+0000 7ff13859e640 1 -- start start 2024-04-25T01:39:51.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.387+0000 7ff13859e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff1300c4280 0x7ff1301538f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:51.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.388+0000 7ff13859e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1300c7040 con 0x7ff130073450 2024-04-25T01:39:51.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.388+0000 7ff13859e640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1300ac010 con 0x7ff1300c4cb0 2024-04-25T01:39:51.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.388+0000 7ff13859e640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7ff1300c1cd0 con 0x7ff1300c4280 2024-04-25T01:39:51.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.388+0000 7ff135b39640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff130073450 0x7ff1300c5480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:37952/0 (socket says 172.21.15.77:37952) 2024-04-25T01:39:51.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.388+0000 7ff135b39640 1 -- 172.21.15.77:0/10044587 learned_addr learned my addr 172.21.15.77:0/10044587 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:51.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.388+0000 7ff13633a640 1 --2- 172.21.15.77:0/10044587 >> v2:172.21.15.121:3300/0 conn(0x7ff1300c4280 0x7ff1301538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:51.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.388+0000 7ff135338640 1 -- 172.21.15.77:0/10044587 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1833129136 0 0) 0x7ff1300c7040 con 0x7ff130073450 2024-04-25T01:39:51.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.388+0000 7ff135338640 1 -- 172.21.15.77:0/10044587 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff11c003520 con 0x7ff130073450 2024-04-25T01:39:51.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.388+0000 7ff135338640 1 -- 172.21.15.77:0/10044587 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2048375016 0 0) 0x7ff11c003520 con 0x7ff130073450 2024-04-25T01:39:51.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.388+0000 7ff135338640 1 -- 172.21.15.77:0/10044587 >> v2:172.21.15.121:3300/0 conn(0x7ff1300c4280 msgr2=0x7ff1301538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:51.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.388+0000 7ff135338640 1 --2- 172.21.15.77:0/10044587 >> v2:172.21.15.121:3300/0 conn(0x7ff1300c4280 0x7ff1301538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.388+0000 7ff135338640 1 -- 172.21.15.77:0/10044587 >> v1:172.21.15.121:6789/0 conn(0x7ff1300c4cb0 legacy=0x7ff13015d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:51.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.388+0000 7ff135338640 1 -- 172.21.15.77:0/10044587 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1300ac2f0 con 0x7ff130073450 2024-04-25T01:39:51.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.388+0000 7ff135338640 1 -- 172.21.15.77:0/10044587 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7ff120001670 con 0x7ff130073450 2024-04-25T01:39:51.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.388+0000 7ff13633a640 1 --2- 172.21.15.77:0/10044587 >> v2:172.21.15.121:3300/0 conn(0x7ff1300c4280 0x7ff1301538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:51.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.388+0000 7ff135338640 1 -- 172.21.15.77:0/10044587 >> v1:172.21.15.77:6789/0 conn(0x7ff130073450 legacy=0x7ff1300c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:51.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.388+0000 7ff135338640 1 --2- 172.21.15.77:0/10044587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff11c0039b0 0x7ff11c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:51.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.388+0000 7ff135338640 1 --2- 172.21.15.77:0/10044587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff11c004800 0x7ff11c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:51.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.388+0000 7ff135338640 1 --2- 172.21.15.77:0/10044587 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff11c0051c0 0x7ff11c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:51.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.388+0000 7ff135338640 1 -- 172.21.15.77:0/10044587 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff1300c1cd0 con 0x7ff11c004800 2024-04-25T01:39:51.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.388+0000 7ff135338640 1 -- 172.21.15.77:0/10044587 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff11c00c090 con 0x7ff11c0039b0 2024-04-25T01:39:51.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.388+0000 7ff135338640 1 -- 172.21.15.77:0/10044587 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff11c00c290 con 0x7ff11c0051c0 2024-04-25T01:39:51.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.388+0000 7ff135b39640 1 --2- 172.21.15.77:0/10044587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff11c004800 0x7ff11c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:51.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.388+0000 7ff13633a640 1 --2- 172.21.15.77:0/10044587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff11c0039b0 0x7ff11c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:51.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.388+0000 7ff136b3b640 1 --2- 172.21.15.77:0/10044587 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff11c0051c0 0x7ff11c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:51.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.389+0000 7ff135b39640 1 -- 172.21.15.77:0/10044587 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff11c0051c0 msgr2=0x7ff11c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:51.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.389+0000 7ff135b39640 1 --2- 172.21.15.77:0/10044587 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff11c0051c0 0x7ff11c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.389+0000 7ff135b39640 1 -- 172.21.15.77:0/10044587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff11c0039b0 msgr2=0x7ff11c003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:51.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.389+0000 7ff135b39640 1 --2- 172.21.15.77:0/10044587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff11c0039b0 0x7ff11c003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.389+0000 7ff136b3b640 1 -- 172.21.15.77:0/10044587 reap_dead start 2024-04-25T01:39:51.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.389+0000 7ff135b39640 1 -- 172.21.15.77:0/10044587 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11c003520 con 0x7ff11c004800 2024-04-25T01:39:51.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.389+0000 7ff135b39640 1 --2- 172.21.15.77:0/10044587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff11c004800 0x7ff11c004c80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff12000c240 tx=0x7ff11c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf969b3c1337fa8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:51.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.389+0000 7ff135338640 1 -- 172.21.15.77:0/10044587 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff120007cf0 con 0x7ff11c004800 2024-04-25T01:39:51.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.390+0000 7ff135338640 1 -- 172.21.15.77:0/10044587 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff120005af0 con 0x7ff11c004800 2024-04-25T01:39:51.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.390+0000 7ff135338640 1 -- 172.21.15.77:0/10044587 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff120007070 con 0x7ff11c004800 2024-04-25T01:39:51.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.390+0000 7ff13859e640 1 -- 172.21.15.77:0/10044587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff11c004800 msgr2=0x7ff11c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:51.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.390+0000 7ff13859e640 1 --2- 172.21.15.77:0/10044587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff11c004800 0x7ff11c004c80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff12000c240 tx=0x7ff11c005830 comp rx=0 tx=0).stop 2024-04-25T01:39:51.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.390+0000 7ff13859e640 1 -- 172.21.15.77:0/10044587 shutdown_connections 2024-04-25T01:39:51.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.390+0000 7ff13859e640 1 --2- 172.21.15.77:0/10044587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff11c004800 0x7ff11c004c80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.390+0000 7ff13859e640 1 -- 172.21.15.77:0/10044587 >> 172.21.15.77:0/10044587 conn(0x7ff1300c7580 msgr2=0x7ff1300c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:51.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.390+0000 7ff13859e640 1 -- 172.21.15.77:0/10044587 shutdown_connections 2024-04-25T01:39:51.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.390+0000 7ff13859e640 1 -- 172.21.15.77:0/10044587 wait complete. 2024-04-25T01:39:51.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.391+0000 7ff13859e640 1 Processor -- start 2024-04-25T01:39:51.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.391+0000 7ff13859e640 1 -- start start 2024-04-25T01:39:51.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.392+0000 7ff13859e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff11c004800 0x7ff1301e0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:51.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.392+0000 7ff13859e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1301e1120 0x7ff1300c2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:51.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.392+0000 7ff13859e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff13014af30 0x7ff1301e9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:51.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.392+0000 7ff13859e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff1300c1a90 con 0x7ff13014af30 2024-04-25T01:39:51.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.392+0000 7ff13859e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff1300c1910 con 0x7ff1301e1120 2024-04-25T01:39:51.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.392+0000 7ff13859e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff1300c4660 con 0x7ff11c004800 2024-04-25T01:39:51.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.392+0000 7ff136b3b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff13014af30 0x7ff1301e9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:51.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.392+0000 7ff136b3b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff13014af30 0x7ff1301e9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45050/0 (socket says 172.21.15.77:45050) 2024-04-25T01:39:51.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.392+0000 7ff136b3b640 1 -- 172.21.15.77:0/3868480733 learned_addr learned my addr 172.21.15.77:0/3868480733 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:51.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.392+0000 7ff135b39640 1 --2- 172.21.15.77:0/3868480733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1301e1120 0x7ff1300c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:51.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.392+0000 7ff13633a640 1 --2- 172.21.15.77:0/3868480733 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff11c004800 0x7ff1301e0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:51.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.392+0000 7ff136b3b640 1 -- 172.21.15.77:0/3868480733 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff11c004800 msgr2=0x7ff1301e0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:51.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.392+0000 7ff136b3b640 1 --2- 172.21.15.77:0/3868480733 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff11c004800 0x7ff1301e0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.392+0000 7ff136b3b640 1 -- 172.21.15.77:0/3868480733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1301e1120 msgr2=0x7ff1300c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:51.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.392+0000 7ff136b3b640 1 --2- 172.21.15.77:0/3868480733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1301e1120 0x7ff1300c2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.392+0000 7ff136b3b640 1 -- 172.21.15.77:0/3868480733 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1301ed230 con 0x7ff13014af30 2024-04-25T01:39:51.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.392+0000 7ff136b3b640 1 --2- 172.21.15.77:0/3868480733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff13014af30 0x7ff1301e9d20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff1300ab0f0 tx=0x7ff12800fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:51.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.392+0000 7ff126ffd640 1 -- 172.21.15.77:0/3868480733 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff128003b80 con 0x7ff13014af30 2024-04-25T01:39:51.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.393+0000 7ff126ffd640 1 -- 172.21.15.77:0/3868480733 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff128018070 con 0x7ff13014af30 2024-04-25T01:39:51.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.393+0000 7ff126ffd640 1 -- 172.21.15.77:0/3868480733 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1280050d0 con 0x7ff13014af30 2024-04-25T01:39:51.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.393+0000 7ff13859e640 1 -- 172.21.15.77:0/3868480733 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1301ed510 con 0x7ff13014af30 2024-04-25T01:39:51.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.393+0000 7ff13859e640 1 -- 172.21.15.77:0/3868480733 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1301edad0 con 0x7ff13014af30 2024-04-25T01:39:51.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.394+0000 7ff13859e640 1 -- 172.21.15.77:0/3868480733 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff13004f500 con 0x7ff13014af30 2024-04-25T01:39:51.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.394+0000 7ff126ffd640 1 -- 172.21.15.77:0/3868480733 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff128005270 con 0x7ff13014af30 2024-04-25T01:39:51.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.394+0000 7ff126ffd640 1 --2- 172.21.15.77:0/3868480733 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff11406be60 0x7ff11406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:51.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.395+0000 7ff126ffd640 1 -- 172.21.15.77:0/3868480733 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7ff12808ae20 con 0x7ff13014af30 2024-04-25T01:39:51.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.395+0000 7ff13633a640 1 --2- 172.21.15.77:0/3868480733 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff11406be60 0x7ff11406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:51.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.395+0000 7ff13633a640 1 --2- 172.21.15.77:0/3868480733 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff11406be60 0x7ff11406e320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff130050e00 tx=0x7ff12c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:51.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.399+0000 7ff126ffd640 1 -- 172.21.15.77:0/3868480733 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff128058ee0 con 0x7ff13014af30 2024-04-25T01:39:51.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.571+0000 7ff13859e640 1 -- 172.21.15.77:0/3868480733 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7ff1300c4a90 con 0x7ff13014af30 2024-04-25T01:39:51.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.572+0000 7ff126ffd640 1 -- 172.21.15.77:0/3868480733 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v24) ==== 99+0+11 (secure 0 0 0) 0x7ff12805d1e0 con 0x7ff13014af30 2024-04-25T01:39:51.556 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T01:39:51.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.574+0000 7ff13859e640 1 -- 172.21.15.77:0/3868480733 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff11406be60 msgr2=0x7ff11406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:51.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.574+0000 7ff13859e640 1 --2- 172.21.15.77:0/3868480733 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff11406be60 0x7ff11406e320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff130050e00 tx=0x7ff12c009190 comp rx=0 tx=0).stop 2024-04-25T01:39:51.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.574+0000 7ff13859e640 1 -- 172.21.15.77:0/3868480733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff13014af30 msgr2=0x7ff1301e9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:51.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.574+0000 7ff13859e640 1 --2- 172.21.15.77:0/3868480733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff13014af30 0x7ff1301e9d20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff1300ab0f0 tx=0x7ff12800fd40 comp rx=0 tx=0).stop 2024-04-25T01:39:51.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.574+0000 7ff13859e640 1 -- 172.21.15.77:0/3868480733 shutdown_connections 2024-04-25T01:39:51.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.574+0000 7ff13859e640 1 --2- 172.21.15.77:0/3868480733 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff11406be60 0x7ff11406e320 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.574+0000 7ff13859e640 1 --2- 172.21.15.77:0/3868480733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff13014af30 0x7ff1301e9d20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.574+0000 7ff13859e640 1 --2- 172.21.15.77:0/3868480733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1301e1120 0x7ff1300c2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.574+0000 7ff13859e640 1 --2- 172.21.15.77:0/3868480733 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff11c004800 0x7ff1301e0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.574+0000 7ff13859e640 1 -- 172.21.15.77:0/3868480733 >> 172.21.15.77:0/3868480733 conn(0x7ff1300c7580 msgr2=0x7ff1300c3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:51.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.574+0000 7ff13859e640 1 -- 172.21.15.77:0/3868480733 shutdown_connections 2024-04-25T01:39:51.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.574+0000 7ff13859e640 1 -- 172.21.15.77:0/3868480733 wait complete. 2024-04-25T01:39:51.568 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-25T01:39:51.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.685+0000 7fae720e7640 1 Processor -- start 2024-04-25T01:39:51.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.685+0000 7fae720e7640 1 -- start start 2024-04-25T01:39:51.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.686+0000 7fae720e7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fae6c0c4280 0x7fae6c1538f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:51.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.686+0000 7fae720e7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae6c0c4cb0 0x7fae6c153e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:51.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.686+0000 7fae720e7640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae6c0c7040 con 0x7fae6c073450 2024-04-25T01:39:51.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.686+0000 7fae720e7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fae6c0c1cd0 con 0x7fae6c0c4280 2024-04-25T01:39:51.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.686+0000 7fae720e7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fae6c0ac010 con 0x7fae6c0c4cb0 2024-04-25T01:39:51.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.686+0000 7fae6b7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fae6c0c4280 0x7fae6c1538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:51.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.686+0000 7fae6b7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fae6c0c4280 0x7fae6c1538f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45052/0 (socket says 172.21.15.77:45052) 2024-04-25T01:39:51.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.686+0000 7fae6b7fe640 1 -- 172.21.15.77:0/1630613251 learned_addr learned my addr 172.21.15.77:0/1630613251 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:51.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.686+0000 7fae6b7fe640 1 -- 172.21.15.77:0/1630613251 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae6c0c4cb0 msgr2=0x7fae6c153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:51.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.686+0000 7fae6bfff640 1 --2- 172.21.15.77:0/1630613251 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae6c0c4cb0 0x7fae6c153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:51.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.686+0000 7fae6b7fe640 1 --2- 172.21.15.77:0/1630613251 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae6c0c4cb0 0x7fae6c153e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.686+0000 7fae6b7fe640 1 -- 172.21.15.77:0/1630613251 >> v1:172.21.15.121:6789/0 conn(0x7fae6c073450 legacy=0x7fae6c0c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:51.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.686+0000 7fae6b7fe640 1 -- 172.21.15.77:0/1630613251 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae6c0ac2f0 con 0x7fae6c0c4280 2024-04-25T01:39:51.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.687+0000 7fae6b7fe640 1 --2- 172.21.15.77:0/1630613251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae6c0c4280 0x7fae6c1538f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fae5c009870 tx=0x7fae5c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fcb19341e9c8f89 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:51.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.687+0000 7fae6a7fc640 1 -- 172.21.15.77:0/1630613251 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae5c037070 con 0x7fae6c0c4280 2024-04-25T01:39:51.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.687+0000 7fae6a7fc640 1 -- 172.21.15.77:0/1630613251 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae5c032440 con 0x7fae6c0c4280 2024-04-25T01:39:51.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.687+0000 7fae6a7fc640 1 -- 172.21.15.77:0/1630613251 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae5c032810 con 0x7fae6c0c4280 2024-04-25T01:39:51.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.688+0000 7fae720e7640 1 -- 172.21.15.77:0/1630613251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae6c0c4280 msgr2=0x7fae6c1538f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:51.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.688+0000 7fae720e7640 1 --2- 172.21.15.77:0/1630613251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae6c0c4280 0x7fae6c1538f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fae5c009870 tx=0x7fae5c02a180 comp rx=0 tx=0).stop 2024-04-25T01:39:51.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.688+0000 7fae720e7640 1 -- 172.21.15.77:0/1630613251 shutdown_connections 2024-04-25T01:39:51.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.688+0000 7fae720e7640 1 --2- 172.21.15.77:0/1630613251 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae6c0c4cb0 0x7fae6c153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.688+0000 7fae720e7640 1 --2- 172.21.15.77:0/1630613251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae6c0c4280 0x7fae6c1538f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.688+0000 7fae720e7640 1 -- 172.21.15.77:0/1630613251 >> 172.21.15.77:0/1630613251 conn(0x7fae6c0c7580 msgr2=0x7fae6c0c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:51.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.688+0000 7fae720e7640 1 -- 172.21.15.77:0/1630613251 shutdown_connections 2024-04-25T01:39:51.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.688+0000 7fae720e7640 1 -- 172.21.15.77:0/1630613251 wait complete. 2024-04-25T01:39:51.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.689+0000 7fae720e7640 1 Processor -- start 2024-04-25T01:39:51.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.689+0000 7fae720e7640 1 -- start start 2024-04-25T01:39:51.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.689+0000 7fae720e7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae6c073450 0x7fae6c156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:51.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.689+0000 7fae720e7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae6c0c4280 0x7fae6c0c0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:51.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.689+0000 7fae720e7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae6c0c4cb0 0x7fae6c0c05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:51.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.689+0000 7fae720e7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fae6c0c1a90 con 0x7fae6c0c4cb0 2024-04-25T01:39:51.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.689+0000 7fae720e7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fae6c0c1910 con 0x7fae6c073450 2024-04-25T01:39:51.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.690+0000 7fae720e7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fae6c0c4660 con 0x7fae6c0c4280 2024-04-25T01:39:51.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.690+0000 7fae6bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae6c0c4cb0 0x7fae6c0c05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:51.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.690+0000 7fae6bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae6c0c4cb0 0x7fae6c0c05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45068/0 (socket says 172.21.15.77:45068) 2024-04-25T01:39:51.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.690+0000 7fae6bfff640 1 -- 172.21.15.77:0/781069125 learned_addr learned my addr 172.21.15.77:0/781069125 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:51.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.690+0000 7fae6b7fe640 1 --2- 172.21.15.77:0/781069125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae6c073450 0x7fae6c156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:51.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.690+0000 7fae6affd640 1 --2- 172.21.15.77:0/781069125 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae6c0c4280 0x7fae6c0c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:51.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.690+0000 7fae6bfff640 1 -- 172.21.15.77:0/781069125 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae6c0c4280 msgr2=0x7fae6c0c0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:51.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.690+0000 7fae6bfff640 1 --2- 172.21.15.77:0/781069125 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae6c0c4280 0x7fae6c0c0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.690+0000 7fae6bfff640 1 -- 172.21.15.77:0/781069125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae6c073450 msgr2=0x7fae6c156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:51.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.690+0000 7fae6bfff640 1 --2- 172.21.15.77:0/781069125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae6c073450 0x7fae6c156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.690+0000 7fae6bfff640 1 -- 172.21.15.77:0/781069125 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae6c072040 con 0x7fae6c0c4cb0 2024-04-25T01:39:51.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.690+0000 7fae6bfff640 1 --2- 172.21.15.77:0/781069125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae6c0c4cb0 0x7fae6c0c05d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fae6400cc60 tx=0x7fae6400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:51.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.690+0000 7fae53fff640 1 -- 172.21.15.77:0/781069125 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae64003990 con 0x7fae6c0c4cb0 2024-04-25T01:39:51.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.690+0000 7fae53fff640 1 -- 172.21.15.77:0/781069125 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae64003b30 con 0x7fae6c0c4cb0 2024-04-25T01:39:51.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.690+0000 7fae720e7640 1 -- 172.21.15.77:0/781069125 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae6c0c1030 con 0x7fae6c0c4cb0 2024-04-25T01:39:51.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.690+0000 7fae53fff640 1 -- 172.21.15.77:0/781069125 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae64004020 con 0x7fae6c0c4cb0 2024-04-25T01:39:51.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.690+0000 7fae720e7640 1 -- 172.21.15.77:0/781069125 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae6c1eb640 con 0x7fae6c0c4cb0 2024-04-25T01:39:51.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.691+0000 7fae720e7640 1 -- 172.21.15.77:0/781069125 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae6c1eb840 con 0x7fae6c0c4cb0 2024-04-25T01:39:51.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.692+0000 7fae53fff640 1 -- 172.21.15.77:0/781069125 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fae640041c0 con 0x7fae6c0c4cb0 2024-04-25T01:39:51.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.692+0000 7fae53fff640 1 --2- 172.21.15.77:0/781069125 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fae5806be30 0x7fae5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:51.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.692+0000 7fae53fff640 1 -- 172.21.15.77:0/781069125 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fae6408b6c0 con 0x7fae6c0c4cb0 2024-04-25T01:39:51.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.692+0000 7fae6b7fe640 1 --2- 172.21.15.77:0/781069125 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fae5806be30 0x7fae5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:51.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.693+0000 7fae6b7fe640 1 --2- 172.21.15.77:0/781069125 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fae5806be30 0x7fae5806e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fae5c034000 tx=0x7fae5c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:51.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.696+0000 7fae53fff640 1 -- 172.21.15.77:0/781069125 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fae6c1eb840 con 0x7fae6c0c4cb0 2024-04-25T01:39:51.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.869+0000 7fae720e7640 1 -- 172.21.15.77:0/781069125 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7fae6c04f500 con 0x7fae6c0c4cb0 2024-04-25T01:39:51.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.869+0000 7fae53fff640 1 -- 172.21.15.77:0/781069125 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v24) ==== 95+0+11 (secure 0 0 0) 0x7fae64014030 con 0x7fae6c0c4cb0 2024-04-25T01:39:51.853 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-25T01:39:51.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.871+0000 7fae720e7640 1 -- 172.21.15.77:0/781069125 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fae5806be30 msgr2=0x7fae5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:51.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.871+0000 7fae720e7640 1 --2- 172.21.15.77:0/781069125 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fae5806be30 0x7fae5806e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fae5c034000 tx=0x7fae5c02e000 comp rx=0 tx=0).stop 2024-04-25T01:39:51.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.871+0000 7fae720e7640 1 -- 172.21.15.77:0/781069125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae6c0c4cb0 msgr2=0x7fae6c0c05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:51.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.871+0000 7fae720e7640 1 --2- 172.21.15.77:0/781069125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae6c0c4cb0 0x7fae6c0c05d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fae6400cc60 tx=0x7fae6400a5c0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.871+0000 7fae720e7640 1 -- 172.21.15.77:0/781069125 shutdown_connections 2024-04-25T01:39:51.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.871+0000 7fae720e7640 1 --2- 172.21.15.77:0/781069125 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fae5806be30 0x7fae5806e2f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.871+0000 7fae720e7640 1 --2- 172.21.15.77:0/781069125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae6c0c4cb0 0x7fae6c0c05d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.871+0000 7fae720e7640 1 --2- 172.21.15.77:0/781069125 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae6c0c4280 0x7fae6c0c0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.871+0000 7fae720e7640 1 --2- 172.21.15.77:0/781069125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae6c073450 0x7fae6c156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.871+0000 7fae720e7640 1 -- 172.21.15.77:0/781069125 >> 172.21.15.77:0/781069125 conn(0x7fae6c0c7580 msgr2=0x7fae6c151f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:51.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.871+0000 7fae720e7640 1 -- 172.21.15.77:0/781069125 shutdown_connections 2024-04-25T01:39:51.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.871+0000 7fae720e7640 1 -- 172.21.15.77:0/781069125 wait complete. 2024-04-25T01:39:51.865 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-25T01:39:51.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.981+0000 7f03622d4640 1 Processor -- start 2024-04-25T01:39:51.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.981+0000 7f03622d4640 1 -- start start 2024-04-25T01:39:51.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.982+0000 7f03622d4640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f035c06d200 0x7f035c0c2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:51.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.982+0000 7f03622d4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f035c0c4ab0 con 0x7f035c156c50 2024-04-25T01:39:51.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.982+0000 7f03622d4640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f035c0c1460 con 0x7f035c06e1c0 2024-04-25T01:39:51.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.982+0000 7f03622d4640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f035c0c1740 con 0x7f035c06d200 2024-04-25T01:39:51.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.982+0000 7f035bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f035c156c50 0x7f035c0c09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:37962/0 (socket says 172.21.15.77:37962) 2024-04-25T01:39:51.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.982+0000 7f035bfff640 1 -- 172.21.15.77:0/2880027733 learned_addr learned my addr 172.21.15.77:0/2880027733 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:51.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.982+0000 7f035b7fe640 1 --2- 172.21.15.77:0/2880027733 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f035c06d200 0x7f035c0c2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:51.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.982+0000 7f035affd640 1 -- 172.21.15.77:0/2880027733 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 83492556 0 0) 0x7f035c0c4ab0 con 0x7f035c156c50 2024-04-25T01:39:51.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.982+0000 7f035affd640 1 -- 172.21.15.77:0/2880027733 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0344003520 con 0x7f035c156c50 2024-04-25T01:39:51.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.983+0000 7f035affd640 1 -- 172.21.15.77:0/2880027733 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 329755298 0 0) 0x7f0344003520 con 0x7f035c156c50 2024-04-25T01:39:51.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.983+0000 7f035affd640 1 -- 172.21.15.77:0/2880027733 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f035c06d200 msgr2=0x7f035c0c2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:51.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.983+0000 7f035affd640 1 --2- 172.21.15.77:0/2880027733 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f035c06d200 0x7f035c0c2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.983+0000 7f035affd640 1 -- 172.21.15.77:0/2880027733 >> v1:172.21.15.121:6789/0 conn(0x7f035c06e1c0 legacy=0x7f035c0c3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:51.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.983+0000 7f035affd640 1 -- 172.21.15.77:0/2880027733 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f035c0c47d0 con 0x7f035c156c50 2024-04-25T01:39:51.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.983+0000 7f035affd640 1 -- 172.21.15.77:0/2880027733 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7f034c001670 con 0x7f035c156c50 2024-04-25T01:39:51.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.983+0000 7f035affd640 1 -- 172.21.15.77:0/2880027733 >> v1:172.21.15.77:6789/0 conn(0x7f035c156c50 legacy=0x7f035c0c09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:51.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.983+0000 7f035affd640 1 --2- 172.21.15.77:0/2880027733 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f035c06d200 0x7f03440039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:51.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.983+0000 7f035affd640 1 --2- 172.21.15.77:0/2880027733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0344003f20 0x7f0344004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:51.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.983+0000 7f035affd640 1 --2- 172.21.15.77:0/2880027733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0344004d40 0x7f03440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:51.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.983+0000 7f035affd640 1 -- 172.21.15.77:0/2880027733 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f035c0c1740 con 0x7f0344003f20 2024-04-25T01:39:51.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.983+0000 7f035affd640 1 -- 172.21.15.77:0/2880027733 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f034400ba20 con 0x7f0344004d40 2024-04-25T01:39:51.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.983+0000 7f035affd640 1 -- 172.21.15.77:0/2880027733 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f034400bc20 con 0x7f035c06d200 2024-04-25T01:39:51.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.983+0000 7f035b7fe640 1 --2- 172.21.15.77:0/2880027733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0344003f20 0x7f0344004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:51.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.983+0000 7f035bfff640 1 --2- 172.21.15.77:0/2880027733 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f035c06d200 0x7f03440039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:51.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.983+0000 7f0360871640 1 --2- 172.21.15.77:0/2880027733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0344004d40 0x7f03440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:51.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.983+0000 7f035b7fe640 1 -- 172.21.15.77:0/2880027733 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f035c06d200 msgr2=0x7f03440039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:51.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.983+0000 7f035b7fe640 1 --2- 172.21.15.77:0/2880027733 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f035c06d200 0x7f03440039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.983+0000 7f035b7fe640 1 -- 172.21.15.77:0/2880027733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0344004d40 msgr2=0x7f03440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:51.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.983+0000 7f035b7fe640 1 --2- 172.21.15.77:0/2880027733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0344004d40 0x7f03440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.983+0000 7f035b7fe640 1 -- 172.21.15.77:0/2880027733 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0344003520 con 0x7f0344003f20 2024-04-25T01:39:51.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.983+0000 7f0360871640 1 --2- 172.21.15.77:0/2880027733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0344004d40 0x7f03440051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:51.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.984+0000 7f035b7fe640 1 --2- 172.21.15.77:0/2880027733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0344003f20 0x7f0344004800 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0350009a90 tx=0x7f0344005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc94424060e89bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:51.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.984+0000 7f035affd640 1 -- 172.21.15.77:0/2880027733 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0350036070 con 0x7f0344003f20 2024-04-25T01:39:51.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.984+0000 7f035affd640 1 -- 172.21.15.77:0/2880027733 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0350031400 con 0x7f0344003f20 2024-04-25T01:39:51.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.984+0000 7f035affd640 1 -- 172.21.15.77:0/2880027733 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0350009690 con 0x7f0344003f20 2024-04-25T01:39:51.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.984+0000 7f03622d4640 1 -- 172.21.15.77:0/2880027733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0344003f20 msgr2=0x7f0344004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:51.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.984+0000 7f03622d4640 1 --2- 172.21.15.77:0/2880027733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0344003f20 0x7f0344004800 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0350009a90 tx=0x7f0344005830 comp rx=0 tx=0).stop 2024-04-25T01:39:51.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.984+0000 7f0360871640 1 -- 172.21.15.77:0/2880027733 reap_dead start 2024-04-25T01:39:51.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.984+0000 7f03622d4640 1 -- 172.21.15.77:0/2880027733 shutdown_connections 2024-04-25T01:39:51.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.984+0000 7f03622d4640 1 -- 172.21.15.77:0/2880027733 >> 172.21.15.77:0/2880027733 conn(0x7f035c0c7580 msgr2=0x7f035c0c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:51.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.984+0000 7f03622d4640 1 -- 172.21.15.77:0/2880027733 shutdown_connections 2024-04-25T01:39:51.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.984+0000 7f03622d4640 1 -- 172.21.15.77:0/2880027733 wait complete. 2024-04-25T01:39:51.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.985+0000 7f03622d4640 1 Processor -- start 2024-04-25T01:39:51.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.986+0000 7f03622d4640 1 -- start start 2024-04-25T01:39:51.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.986+0000 7f03622d4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0344003f20 0x7f035c1ef420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:51.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.986+0000 7f03622d4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f035c159ee0 0x7f035c1ef960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:51.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.986+0000 7f03622d4640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f035c070180 0x7f035c151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:51.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.986+0000 7f03622d4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f035c0c10c0 con 0x7f0344003f20 2024-04-25T01:39:51.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.986+0000 7f03622d4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f035c0c44c0 con 0x7f035c159ee0 2024-04-25T01:39:51.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.986+0000 7f03622d4640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f035c0c1240 con 0x7f035c070180 2024-04-25T01:39:51.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.986+0000 7f035bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0344003f20 0x7f035c1ef420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:51.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.986+0000 7f035bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0344003f20 0x7f035c1ef420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45092/0 (socket says 172.21.15.77:45092) 2024-04-25T01:39:51.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.986+0000 7f035bfff640 1 -- 172.21.15.77:0/1219862864 learned_addr learned my addr 172.21.15.77:0/1219862864 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:51.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.987+0000 7f035b7fe640 1 --2- 172.21.15.77:0/1219862864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f035c159ee0 0x7f035c1ef960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:51.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.987+0000 7f0360871640 1 --2- 172.21.15.77:0/1219862864 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f035c070180 0x7f035c151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:51.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.987+0000 7f035bfff640 1 -- 172.21.15.77:0/1219862864 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f035c070180 msgr2=0x7f035c151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:51.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.987+0000 7f035bfff640 1 --2- 172.21.15.77:0/1219862864 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f035c070180 0x7f035c151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.987+0000 7f035bfff640 1 -- 172.21.15.77:0/1219862864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f035c159ee0 msgr2=0x7f035c1ef960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:51.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.987+0000 7f035bfff640 1 --2- 172.21.15.77:0/1219862864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f035c159ee0 0x7f035c1ef960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:51.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.987+0000 7f035bfff640 1 -- 172.21.15.77:0/1219862864 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f035c158c30 con 0x7f0344003f20 2024-04-25T01:39:51.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.987+0000 7f035b7fe640 1 --2- 172.21.15.77:0/1219862864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f035c159ee0 0x7f035c1ef960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:51.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.987+0000 7f0360871640 1 --2- 172.21.15.77:0/1219862864 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f035c070180 0x7f035c151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:51.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.987+0000 7f035bfff640 1 --2- 172.21.15.77:0/1219862864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0344003f20 0x7f035c1ef420 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f034c007370 tx=0x7f034c007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:51.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.987+0000 7f0358ff9640 1 -- 172.21.15.77:0/1219862864 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f034c01a070 con 0x7f0344003f20 2024-04-25T01:39:51.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.987+0000 7f0358ff9640 1 -- 172.21.15.77:0/1219862864 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f034c00f930 con 0x7f0344003f20 2024-04-25T01:39:51.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.987+0000 7f0358ff9640 1 -- 172.21.15.77:0/1219862864 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f034c00fce0 con 0x7f0344003f20 2024-04-25T01:39:51.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.987+0000 7f03622d4640 1 -- 172.21.15.77:0/1219862864 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f035c158f10 con 0x7f0344003f20 2024-04-25T01:39:51.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.987+0000 7f03622d4640 1 -- 172.21.15.77:0/1219862864 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f035c1594d0 con 0x7f0344003f20 2024-04-25T01:39:51.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.988+0000 7f03622d4640 1 -- 172.21.15.77:0/1219862864 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f035c1596d0 con 0x7f0344003f20 2024-04-25T01:39:51.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.988+0000 7f0358ff9640 1 -- 172.21.15.77:0/1219862864 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f034c01d070 con 0x7f0344003f20 2024-04-25T01:39:51.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.989+0000 7f0358ff9640 1 --2- 172.21.15.77:0/1219862864 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f034806be60 0x7f034806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:51.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.989+0000 7f0358ff9640 1 -- 172.21.15.77:0/1219862864 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f034c08ab50 con 0x7f0344003f20 2024-04-25T01:39:51.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.989+0000 7f035b7fe640 1 --2- 172.21.15.77:0/1219862864 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f034806be60 0x7f034806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:51.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.989+0000 7f035b7fe640 1 --2- 172.21.15.77:0/1219862864 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f034806be60 0x7f034806e320 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0350033000 tx=0x7f0350008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:51.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:51.993+0000 7f0358ff9640 1 -- 172.21.15.77:0/1219862864 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f035c1596d0 con 0x7f0344003f20 2024-04-25T01:39:52.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.166+0000 7f03622d4640 1 -- 172.21.15.77:0/1219862864 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7f035c04f500 con 0x7f0344003f20 2024-04-25T01:39:52.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.167+0000 7f0358ff9640 1 -- 172.21.15.77:0/1219862864 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v24) ==== 99+0+11 (secure 0 0 0) 0x7f034c059260 con 0x7f0344003f20 2024-04-25T01:39:52.150 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T01:39:52.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.169+0000 7f03622d4640 1 -- 172.21.15.77:0/1219862864 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f034806be60 msgr2=0x7f034806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:52.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.169+0000 7f03622d4640 1 --2- 172.21.15.77:0/1219862864 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f034806be60 0x7f034806e320 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0350033000 tx=0x7f0350008030 comp rx=0 tx=0).stop 2024-04-25T01:39:52.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.169+0000 7f03622d4640 1 -- 172.21.15.77:0/1219862864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0344003f20 msgr2=0x7f035c1ef420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:52.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.169+0000 7f03622d4640 1 --2- 172.21.15.77:0/1219862864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0344003f20 0x7f035c1ef420 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f034c007370 tx=0x7f034c007830 comp rx=0 tx=0).stop 2024-04-25T01:39:52.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.169+0000 7f03622d4640 1 -- 172.21.15.77:0/1219862864 shutdown_connections 2024-04-25T01:39:52.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.169+0000 7f03622d4640 1 --2- 172.21.15.77:0/1219862864 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f034806be60 0x7f034806e320 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.169+0000 7f03622d4640 1 --2- 172.21.15.77:0/1219862864 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f035c070180 0x7f035c151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.169+0000 7f03622d4640 1 --2- 172.21.15.77:0/1219862864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f035c159ee0 0x7f035c1ef960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.169+0000 7f03622d4640 1 --2- 172.21.15.77:0/1219862864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0344003f20 0x7f035c1ef420 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.169+0000 7f03622d4640 1 -- 172.21.15.77:0/1219862864 >> 172.21.15.77:0/1219862864 conn(0x7f035c0c7580 msgr2=0x7f035c0c5170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:52.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.169+0000 7f03622d4640 1 -- 172.21.15.77:0/1219862864 shutdown_connections 2024-04-25T01:39:52.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.169+0000 7f03622d4640 1 -- 172.21.15.77:0/1219862864 wait complete. 2024-04-25T01:39:52.163 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-25T01:39:52.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.279+0000 7f2b25493640 1 Processor -- start 2024-04-25T01:39:52.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.279+0000 7f2b25493640 1 -- start start 2024-04-25T01:39:52.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.280+0000 7f2b25493640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b20153530 0x7f2b200c6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:52.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.280+0000 7f2b25493640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b2006d110 con 0x7f2b200bef50 2024-04-25T01:39:52.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.280+0000 7f2b25493640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b20153910 con 0x7f2b200c97c0 2024-04-25T01:39:52.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.280+0000 7f2b25493640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f2b20156980 con 0x7f2b20153530 2024-04-25T01:39:52.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.280+0000 7f2b1e7fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f2b200bef50 0x7f2b201595f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:37966/0 (socket says 172.21.15.77:37966) 2024-04-25T01:39:52.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.280+0000 7f2b1e7fc640 1 -- 172.21.15.77:0/1088618873 learned_addr learned my addr 172.21.15.77:0/1088618873 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:52.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.280+0000 7f2b1effd640 1 --2- 172.21.15.77:0/1088618873 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b20153530 0x7f2b200c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:52.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.280+0000 7f2b1dffb640 1 -- 172.21.15.77:0/1088618873 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 824270062 0 0) 0x7f2b2006d110 con 0x7f2b200bef50 2024-04-25T01:39:52.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.280+0000 7f2b1dffb640 1 -- 172.21.15.77:0/1088618873 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b08003520 con 0x7f2b200bef50 2024-04-25T01:39:52.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.280+0000 7f2b1dffb640 1 -- 172.21.15.77:0/1088618873 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 464170064 0 0) 0x7f2b20153910 con 0x7f2b200c97c0 2024-04-25T01:39:52.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.280+0000 7f2b1dffb640 1 -- 172.21.15.77:0/1088618873 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b2006d110 con 0x7f2b200c97c0 2024-04-25T01:39:52.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.280+0000 7f2b1dffb640 1 -- 172.21.15.77:0/1088618873 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3558124894 0 0) 0x7f2b08003520 con 0x7f2b200bef50 2024-04-25T01:39:52.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.280+0000 7f2b1dffb640 1 -- 172.21.15.77:0/1088618873 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b20153530 msgr2=0x7f2b200c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:52.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.280+0000 7f2b1dffb640 1 --2- 172.21.15.77:0/1088618873 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b20153530 0x7f2b200c6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.280+0000 7f2b1dffb640 1 -- 172.21.15.77:0/1088618873 >> v1:172.21.15.121:6789/0 conn(0x7f2b200c97c0 legacy=0x7f2b20159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:52.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.280+0000 7f2b1dffb640 1 -- 172.21.15.77:0/1088618873 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b20156c60 con 0x7f2b200bef50 2024-04-25T01:39:52.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.280+0000 7f2b1dffb640 1 -- 172.21.15.77:0/1088618873 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7f2b140017f0 con 0x7f2b200bef50 2024-04-25T01:39:52.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.281+0000 7f2b1dffb640 1 -- 172.21.15.77:0/1088618873 >> v1:172.21.15.77:6789/0 conn(0x7f2b200bef50 legacy=0x7f2b201595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:52.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.281+0000 7f2b1dffb640 1 --2- 172.21.15.77:0/1088618873 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b08003b70 0x7f2b08003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:52.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.281+0000 7f2b1dffb640 1 --2- 172.21.15.77:0/1088618873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b08004800 0x7f2b08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:52.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.281+0000 7f2b1dffb640 1 --2- 172.21.15.77:0/1088618873 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b20153530 0x7f2b080052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:52.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.281+0000 7f2b1dffb640 1 -- 172.21.15.77:0/1088618873 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2b20156980 con 0x7f2b08004800 2024-04-25T01:39:52.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.281+0000 7f2b1dffb640 1 -- 172.21.15.77:0/1088618873 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0800bbc0 con 0x7f2b08003b70 2024-04-25T01:39:52.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.281+0000 7f2b1dffb640 1 -- 172.21.15.77:0/1088618873 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f2b0800bdc0 con 0x7f2b20153530 2024-04-25T01:39:52.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.281+0000 7f2b1e7fc640 1 --2- 172.21.15.77:0/1088618873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b08004800 0x7f2b08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:52.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.281+0000 7f2b1effd640 1 --2- 172.21.15.77:0/1088618873 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b08003b70 0x7f2b08003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:52.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.281+0000 7f2b1f7fe640 1 --2- 172.21.15.77:0/1088618873 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b20153530 0x7f2b080052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:52.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.281+0000 7f2b1e7fc640 1 -- 172.21.15.77:0/1088618873 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b20153530 msgr2=0x7f2b080052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:52.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.281+0000 7f2b1e7fc640 1 --2- 172.21.15.77:0/1088618873 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b20153530 0x7f2b080052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.281+0000 7f2b1e7fc640 1 -- 172.21.15.77:0/1088618873 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b08003b70 msgr2=0x7f2b08003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:52.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.281+0000 7f2b1e7fc640 1 --2- 172.21.15.77:0/1088618873 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b08003b70 0x7f2b08003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.281+0000 7f2b1e7fc640 1 -- 172.21.15.77:0/1088618873 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b08003520 con 0x7f2b08004800 2024-04-25T01:39:52.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.282+0000 7f2b1e7fc640 1 --2- 172.21.15.77:0/1088618873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b08004800 0x7f2b08004c80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2b200bf390 tx=0x7f2b08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de73f20fa2682dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:52.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.282+0000 7f2b1dffb640 1 -- 172.21.15.77:0/1088618873 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b14007be0 con 0x7f2b08004800 2024-04-25T01:39:52.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.282+0000 7f2b1dffb640 1 -- 172.21.15.77:0/1088618873 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b14007290 con 0x7f2b08004800 2024-04-25T01:39:52.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.282+0000 7f2b1dffb640 1 -- 172.21.15.77:0/1088618873 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b140057a0 con 0x7f2b08004800 2024-04-25T01:39:52.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.282+0000 7f2b25493640 1 -- 172.21.15.77:0/1088618873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b08004800 msgr2=0x7f2b08004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:52.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.282+0000 7f2b25493640 1 --2- 172.21.15.77:0/1088618873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b08004800 0x7f2b08004c80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2b200bf390 tx=0x7f2b08005830 comp rx=0 tx=0).stop 2024-04-25T01:39:52.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.282+0000 7f2b1f7fe640 1 -- 172.21.15.77:0/1088618873 reap_dead start 2024-04-25T01:39:52.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.282+0000 7f2b25493640 1 -- 172.21.15.77:0/1088618873 shutdown_connections 2024-04-25T01:39:52.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.282+0000 7f2b25493640 1 -- 172.21.15.77:0/1088618873 >> 172.21.15.77:0/1088618873 conn(0x7f2b200672c0 msgr2=0x7f2b200676d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:52.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.282+0000 7f2b25493640 1 -- 172.21.15.77:0/1088618873 shutdown_connections 2024-04-25T01:39:52.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.282+0000 7f2b25493640 1 -- 172.21.15.77:0/1088618873 wait complete. 2024-04-25T01:39:52.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.284+0000 7f2b25493640 1 Processor -- start 2024-04-25T01:39:52.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.284+0000 7f2b25493640 1 -- start start 2024-04-25T01:39:52.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.284+0000 7f2b25493640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b08004800 0x7f2b200c09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:52.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.284+0000 7f2b25493640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b200c1930 0x7f2b200c1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:52.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.284+0000 7f2b25493640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b201513f0 0x7f2b201518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:52.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.284+0000 7f2b25493640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2b200c6240 con 0x7f2b08004800 2024-04-25T01:39:52.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.284+0000 7f2b25493640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2b200cc250 con 0x7f2b201513f0 2024-04-25T01:39:52.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.284+0000 7f2b25493640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f2b200c63c0 con 0x7f2b200c1930 2024-04-25T01:39:52.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.284+0000 7f2b1effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b08004800 0x7f2b200c09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:52.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.284+0000 7f2b1effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b08004800 0x7f2b200c09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45106/0 (socket says 172.21.15.77:45106) 2024-04-25T01:39:52.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.284+0000 7f2b1effd640 1 -- 172.21.15.77:0/1508144372 learned_addr learned my addr 172.21.15.77:0/1508144372 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:52.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.284+0000 7f2b1effd640 1 -- 172.21.15.77:0/1508144372 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b200c1930 msgr2=0x7f2b200c1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:52.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.284+0000 7f2b1effd640 1 --2- 172.21.15.77:0/1508144372 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b200c1930 0x7f2b200c1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.285+0000 7f2b1effd640 1 -- 172.21.15.77:0/1508144372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b201513f0 msgr2=0x7f2b201518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:52.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.285+0000 7f2b1effd640 1 --2- 172.21.15.77:0/1508144372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b201513f0 0x7f2b201518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.285+0000 7f2b1effd640 1 -- 172.21.15.77:0/1508144372 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2014a760 con 0x7f2b08004800 2024-04-25T01:39:52.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.285+0000 7f2b1effd640 1 --2- 172.21.15.77:0/1508144372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b08004800 0x7f2b200c09e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2b100118e0 tx=0x7f2b10011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:52.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.285+0000 7f2b077fe640 1 -- 172.21.15.77:0/1508144372 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1000fa70 con 0x7f2b08004800 2024-04-25T01:39:52.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.285+0000 7f2b077fe640 1 -- 172.21.15.77:0/1508144372 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b1000fc10 con 0x7f2b08004800 2024-04-25T01:39:52.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.285+0000 7f2b077fe640 1 -- 172.21.15.77:0/1508144372 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b10014440 con 0x7f2b08004800 2024-04-25T01:39:52.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.285+0000 7f2b25493640 1 -- 172.21.15.77:0/1508144372 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b2014aa40 con 0x7f2b08004800 2024-04-25T01:39:52.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.285+0000 7f2b25493640 1 -- 172.21.15.77:0/1508144372 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b20150ed0 con 0x7f2b08004800 2024-04-25T01:39:52.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.286+0000 7f2b25493640 1 -- 172.21.15.77:0/1508144372 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b2004f500 con 0x7f2b08004800 2024-04-25T01:39:52.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.286+0000 7f2b077fe640 1 -- 172.21.15.77:0/1508144372 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2b10012040 con 0x7f2b08004800 2024-04-25T01:39:52.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.286+0000 7f2b077fe640 1 --2- 172.21.15.77:0/1508144372 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2b0c06be60 0x7f2b0c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:52.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.287+0000 7f2b077fe640 1 -- 172.21.15.77:0/1508144372 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f2b1008b6e0 con 0x7f2b08004800 2024-04-25T01:39:52.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.287+0000 7f2b1e7fc640 1 --2- 172.21.15.77:0/1508144372 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2b0c06be60 0x7f2b0c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:52.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.287+0000 7f2b1e7fc640 1 --2- 172.21.15.77:0/1508144372 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2b0c06be60 0x7f2b0c06e320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2b14032000 tx=0x7f2b14009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:52.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.291+0000 7f2b077fe640 1 -- 172.21.15.77:0/1508144372 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2b10019030 con 0x7f2b08004800 2024-04-25T01:39:52.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.463+0000 7f2b25493640 1 -- 172.21.15.77:0/1508144372 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7f2b2006cac0 con 0x7f2b08004800 2024-04-25T01:39:52.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.463+0000 7f2b077fe640 1 -- 172.21.15.77:0/1508144372 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v24) ==== 95+0+11 (secure 0 0 0) 0x7f2b10059df0 con 0x7f2b08004800 2024-04-25T01:39:52.447 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-25T01:39:52.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.465+0000 7f2b25493640 1 -- 172.21.15.77:0/1508144372 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2b0c06be60 msgr2=0x7f2b0c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:52.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.465+0000 7f2b25493640 1 --2- 172.21.15.77:0/1508144372 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2b0c06be60 0x7f2b0c06e320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2b14032000 tx=0x7f2b14009030 comp rx=0 tx=0).stop 2024-04-25T01:39:52.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.465+0000 7f2b25493640 1 -- 172.21.15.77:0/1508144372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b08004800 msgr2=0x7f2b200c09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:52.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.465+0000 7f2b25493640 1 --2- 172.21.15.77:0/1508144372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b08004800 0x7f2b200c09e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2b100118e0 tx=0x7f2b10011da0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.465+0000 7f2b25493640 1 -- 172.21.15.77:0/1508144372 shutdown_connections 2024-04-25T01:39:52.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.465+0000 7f2b25493640 1 --2- 172.21.15.77:0/1508144372 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2b0c06be60 0x7f2b0c06e320 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.465+0000 7f2b25493640 1 --2- 172.21.15.77:0/1508144372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b201513f0 0x7f2b201518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.465+0000 7f2b25493640 1 --2- 172.21.15.77:0/1508144372 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b200c1930 0x7f2b200c1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.465+0000 7f2b25493640 1 --2- 172.21.15.77:0/1508144372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b08004800 0x7f2b200c09e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.465+0000 7f2b25493640 1 -- 172.21.15.77:0/1508144372 >> 172.21.15.77:0/1508144372 conn(0x7f2b200672c0 msgr2=0x7f2b20155f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:52.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.465+0000 7f2b25493640 1 -- 172.21.15.77:0/1508144372 shutdown_connections 2024-04-25T01:39:52.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.465+0000 7f2b25493640 1 -- 172.21.15.77:0/1508144372 wait complete. 2024-04-25T01:39:52.459 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:39:52.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.572+0000 7f6f4539e640 1 Processor -- start 2024-04-25T01:39:52.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.572+0000 7f6f4539e640 1 -- start start 2024-04-25T01:39:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.573+0000 7f6f4539e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6f400c3d20 0x7f6f40157900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.573+0000 7f6f4539e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f40071180 con 0x7f6f4006f3e0 2024-04-25T01:39:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.573+0000 7f6f4539e640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f40071460 con 0x7f6f40072930 2024-04-25T01:39:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.573+0000 7f6f4539e640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f6f40071d90 con 0x7f6f400c3d20 2024-04-25T01:39:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.573+0000 7f6f3ffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6f4006f3e0 0x7f6f40072220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:37978/0 (socket says 172.21.15.77:37978) 2024-04-25T01:39:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.573+0000 7f6f3ffff640 1 -- 172.21.15.77:0/1535706177 learned_addr learned my addr 172.21.15.77:0/1535706177 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.573+0000 7f6f3effd640 1 -- 172.21.15.77:0/1535706177 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1578034172 0 0) 0x7f6f40071180 con 0x7f6f4006f3e0 2024-04-25T01:39:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.574+0000 7f6f3effd640 1 -- 172.21.15.77:0/1535706177 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f28003520 con 0x7f6f4006f3e0 2024-04-25T01:39:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.574+0000 7f6f44b9d640 1 --2- 172.21.15.77:0/1535706177 >> v2:172.21.15.121:3300/0 conn(0x7f6f400c3d20 0x7f6f40157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.574+0000 7f6f3effd640 1 -- 172.21.15.77:0/1535706177 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 381345792 0 0) 0x7f6f28003520 con 0x7f6f4006f3e0 2024-04-25T01:39:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.574+0000 7f6f3effd640 1 -- 172.21.15.77:0/1535706177 >> v2:172.21.15.121:3300/0 conn(0x7f6f400c3d20 msgr2=0x7f6f40157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.574+0000 7f6f3effd640 1 --2- 172.21.15.77:0/1535706177 >> v2:172.21.15.121:3300/0 conn(0x7f6f400c3d20 0x7f6f40157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.574+0000 7f6f3effd640 1 -- 172.21.15.77:0/1535706177 >> v1:172.21.15.121:6789/0 conn(0x7f6f40072930 legacy=0x7f6f401571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.574+0000 7f6f3effd640 1 -- 172.21.15.77:0/1535706177 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f40071740 con 0x7f6f4006f3e0 2024-04-25T01:39:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.574+0000 7f6f3effd640 1 -- 172.21.15.77:0/1535706177 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7f6f30001670 con 0x7f6f4006f3e0 2024-04-25T01:39:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.574+0000 7f6f3effd640 1 -- 172.21.15.77:0/1535706177 >> v1:172.21.15.77:6789/0 conn(0x7f6f4006f3e0 legacy=0x7f6f40072220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.574+0000 7f6f3effd640 1 --2- 172.21.15.77:0/1535706177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f280039b0 0x7f6f28003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.574+0000 7f6f3effd640 1 --2- 172.21.15.77:0/1535706177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f28004800 0x7f6f28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.574+0000 7f6f3effd640 1 --2- 172.21.15.77:0/1535706177 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6f280052e0 0x7f6f2800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.574+0000 7f6f3effd640 1 -- 172.21.15.77:0/1535706177 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6f40071d90 con 0x7f6f28004800 2024-04-25T01:39:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.574+0000 7f6f3effd640 1 -- 172.21.15.77:0/1535706177 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2800c1e0 con 0x7f6f280039b0 2024-04-25T01:39:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.574+0000 7f6f3effd640 1 -- 172.21.15.77:0/1535706177 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f6f2800c3e0 con 0x7f6f280052e0 2024-04-25T01:39:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.574+0000 7f6f3f7fe640 1 --2- 172.21.15.77:0/1535706177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f28004800 0x7f6f28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:52.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.574+0000 7f6f3ffff640 1 --2- 172.21.15.77:0/1535706177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f280039b0 0x7f6f28003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:52.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.574+0000 7f6f44b9d640 1 --2- 172.21.15.77:0/1535706177 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6f280052e0 0x7f6f2800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:52.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.574+0000 7f6f3f7fe640 1 -- 172.21.15.77:0/1535706177 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6f280052e0 msgr2=0x7f6f2800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:52.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.574+0000 7f6f3f7fe640 1 --2- 172.21.15.77:0/1535706177 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6f280052e0 0x7f6f2800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.574+0000 7f6f3f7fe640 1 -- 172.21.15.77:0/1535706177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f280039b0 msgr2=0x7f6f28003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:52.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.574+0000 7f6f3f7fe640 1 --2- 172.21.15.77:0/1535706177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f280039b0 0x7f6f28003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.574+0000 7f6f3f7fe640 1 -- 172.21.15.77:0/1535706177 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f28003520 con 0x7f6f28004800 2024-04-25T01:39:52.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.574+0000 7f6f44b9d640 1 -- 172.21.15.77:0/1535706177 reap_dead start 2024-04-25T01:39:52.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.575+0000 7f6f3f7fe640 1 --2- 172.21.15.77:0/1535706177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f28004800 0x7f6f28004c80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6f34001720 tx=0x7f6f28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=407d5bdd4a3feda1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:52.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.575+0000 7f6f3effd640 1 -- 172.21.15.77:0/1535706177 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f34001370 con 0x7f6f28004800 2024-04-25T01:39:52.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.575+0000 7f6f3effd640 1 -- 172.21.15.77:0/1535706177 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f340052d0 con 0x7f6f28004800 2024-04-25T01:39:52.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.575+0000 7f6f3effd640 1 -- 172.21.15.77:0/1535706177 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3402ab70 con 0x7f6f28004800 2024-04-25T01:39:52.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.575+0000 7f6f4539e640 1 -- 172.21.15.77:0/1535706177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f28004800 msgr2=0x7f6f28004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:52.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.575+0000 7f6f4539e640 1 --2- 172.21.15.77:0/1535706177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f28004800 0x7f6f28004c80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6f34001720 tx=0x7f6f28005830 comp rx=0 tx=0).stop 2024-04-25T01:39:52.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.575+0000 7f6f4539e640 1 -- 172.21.15.77:0/1535706177 shutdown_connections 2024-04-25T01:39:52.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.575+0000 7f6f4539e640 1 --2- 172.21.15.77:0/1535706177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f28004800 0x7f6f28004c80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.576+0000 7f6f4539e640 1 -- 172.21.15.77:0/1535706177 >> 172.21.15.77:0/1535706177 conn(0x7f6f400c8450 msgr2=0x7f6f400c8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:52.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.576+0000 7f6f4539e640 1 -- 172.21.15.77:0/1535706177 shutdown_connections 2024-04-25T01:39:52.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.576+0000 7f6f4539e640 1 -- 172.21.15.77:0/1535706177 wait complete. 2024-04-25T01:39:52.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.577+0000 7f6f4539e640 1 Processor -- start 2024-04-25T01:39:52.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.577+0000 7f6f4539e640 1 -- start start 2024-04-25T01:39:52.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.578+0000 7f6f4539e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f28004800 0x7f6f401536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:52.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.578+0000 7f6f4539e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6f4006e9d0 0x7f6f401eaa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:52.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.578+0000 7f6f4539e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f401e0150 0x7f6f401eafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:52.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.578+0000 7f6f4539e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6f4006f7c0 con 0x7f6f28004800 2024-04-25T01:39:52.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.578+0000 7f6f4539e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6f40155130 con 0x7f6f401e0150 2024-04-25T01:39:52.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.578+0000 7f6f4539e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f6f4006f940 con 0x7f6f4006e9d0 2024-04-25T01:39:52.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.578+0000 7f6f3ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f28004800 0x7f6f401536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:52.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.578+0000 7f6f3ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f28004800 0x7f6f401536b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45124/0 (socket says 172.21.15.77:45124) 2024-04-25T01:39:52.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.578+0000 7f6f3ffff640 1 -- 172.21.15.77:0/194375654 learned_addr learned my addr 172.21.15.77:0/194375654 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:52.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.578+0000 7f6f3f7fe640 1 --2- 172.21.15.77:0/194375654 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6f4006e9d0 0x7f6f401eaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:52.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.578+0000 7f6f44b9d640 1 --2- 172.21.15.77:0/194375654 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f401e0150 0x7f6f401eafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.578+0000 7f6f3ffff640 1 -- 172.21.15.77:0/194375654 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6f4006e9d0 msgr2=0x7f6f401eaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.578+0000 7f6f3ffff640 1 --2- 172.21.15.77:0/194375654 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6f4006e9d0 0x7f6f401eaa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.578+0000 7f6f3ffff640 1 -- 172.21.15.77:0/194375654 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f401e0150 msgr2=0x7f6f401eafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.578+0000 7f6f3ffff640 1 --2- 172.21.15.77:0/194375654 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f401e0150 0x7f6f401eafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.578+0000 7f6f3ffff640 1 -- 172.21.15.77:0/194375654 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f4006e510 con 0x7f6f28004800 2024-04-25T01:39:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.578+0000 7f6f3ffff640 1 --2- 172.21.15.77:0/194375654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f28004800 0x7f6f401536b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6f30007370 tx=0x7f6f30007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.578+0000 7f6f3cff9640 1 -- 172.21.15.77:0/194375654 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3001a070 con 0x7f6f28004800 2024-04-25T01:39:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.578+0000 7f6f3cff9640 1 -- 172.21.15.77:0/194375654 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f3000f960 con 0x7f6f28004800 2024-04-25T01:39:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.578+0000 7f6f4539e640 1 -- 172.21.15.77:0/194375654 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f401ed7b0 con 0x7f6f28004800 2024-04-25T01:39:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.578+0000 7f6f3cff9640 1 -- 172.21.15.77:0/194375654 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3000fd30 con 0x7f6f28004800 2024-04-25T01:39:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.578+0000 7f6f4539e640 1 -- 172.21.15.77:0/194375654 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f401e0c40 con 0x7f6f28004800 2024-04-25T01:39:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.579+0000 7f6f4539e640 1 -- 172.21.15.77:0/194375654 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f400c5ce0 con 0x7f6f28004800 2024-04-25T01:39:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.580+0000 7f6f3cff9640 1 -- 172.21.15.77:0/194375654 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f3001d070 con 0x7f6f28004800 2024-04-25T01:39:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.580+0000 7f6f3cff9640 1 --2- 172.21.15.77:0/194375654 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6f2c06be60 0x7f6f2c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.580+0000 7f6f3f7fe640 1 --2- 172.21.15.77:0/194375654 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6f2c06be60 0x7f6f2c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:52.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.580+0000 7f6f3cff9640 1 -- 172.21.15.77:0/194375654 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f6f3008aad0 con 0x7f6f28004800 2024-04-25T01:39:52.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.581+0000 7f6f3f7fe640 1 --2- 172.21.15.77:0/194375654 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6f2c06be60 0x7f6f2c06e320 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6f34032000 tx=0x7f6f3402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:52.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.585+0000 7f6f3cff9640 1 -- 172.21.15.77:0/194375654 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6f400c5ce0 con 0x7f6f28004800 2024-04-25T01:39:52.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.793+0000 7f6f4539e640 1 -- 172.21.15.77:0/194375654 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f40075d10 con 0x7f6f28004800 2024-04-25T01:39:52.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.793+0000 7f6f3cff9640 1 -- 172.21.15.77:0/194375654 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6488 (secure 0 0 0) 0x7f6f4006e510 con 0x7f6f28004800 2024-04-25T01:39:52.777 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:52.777 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:39:36.787357+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6837/3454203695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3454203695},{"type":"v1","addr":"172.21.15.77:6837","nonce":3454203695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-04-25T01:39:52.777 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 12 2024-04-25T01:39:52.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.795+0000 7f6f4539e640 1 -- 172.21.15.77:0/194375654 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6f2c06be60 msgr2=0x7f6f2c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:52.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.795+0000 7f6f4539e640 1 --2- 172.21.15.77:0/194375654 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6f2c06be60 0x7f6f2c06e320 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6f34032000 tx=0x7f6f3402e000 comp rx=0 tx=0).stop 2024-04-25T01:39:52.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.795+0000 7f6f4539e640 1 -- 172.21.15.77:0/194375654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f28004800 msgr2=0x7f6f401536b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:52.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.795+0000 7f6f4539e640 1 --2- 172.21.15.77:0/194375654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f28004800 0x7f6f401536b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6f30007370 tx=0x7f6f30007830 comp rx=0 tx=0).stop 2024-04-25T01:39:52.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.795+0000 7f6f4539e640 1 -- 172.21.15.77:0/194375654 shutdown_connections 2024-04-25T01:39:52.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.795+0000 7f6f4539e640 1 --2- 172.21.15.77:0/194375654 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6f2c06be60 0x7f6f2c06e320 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.795+0000 7f6f4539e640 1 --2- 172.21.15.77:0/194375654 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f401e0150 0x7f6f401eafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.795+0000 7f6f4539e640 1 --2- 172.21.15.77:0/194375654 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6f4006e9d0 0x7f6f401eaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.795+0000 7f6f4539e640 1 --2- 172.21.15.77:0/194375654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f28004800 0x7f6f401536b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.795+0000 7f6f4539e640 1 -- 172.21.15.77:0/194375654 >> 172.21.15.77:0/194375654 conn(0x7f6f400c8450 msgr2=0x7f6f400c55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:52.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.795+0000 7f6f4539e640 1 -- 172.21.15.77:0/194375654 shutdown_connections 2024-04-25T01:39:52.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.795+0000 7f6f4539e640 1 -- 172.21.15.77:0/194375654 wait complete. 2024-04-25T01:39:52.790 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T01:39:52.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.903+0000 7f77aabd5640 1 Processor -- start 2024-04-25T01:39:52.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.903+0000 7f77aabd5640 1 -- start start 2024-04-25T01:39:52.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.904+0000 7f77aabd5640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f77a406d0a0 0x7f77a406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:52.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.904+0000 7f77aabd5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f77a4154380 0x7f77a4154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:52.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.904+0000 7f77aabd5640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77a4153be0 con 0x7f77a4150320 2024-04-25T01:39:52.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.904+0000 7f77aabd5640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f77a4152fd0 con 0x7f77a406d0a0 2024-04-25T01:39:52.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.904+0000 7f77aabd5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f77a41532b0 con 0x7f77a4154380 2024-04-25T01:39:52.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.904+0000 7f77a9172640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f77a4154380 0x7f77a4154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:52.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.904+0000 7f77a3fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f77a406d0a0 0x7f77a406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:52.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.904+0000 7f77a8971640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f77a4150320 0x7f77a4156bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.77:56078/0 (socket says 172.21.15.77:56078) 2024-04-25T01:39:52.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.904+0000 7f77a8971640 1 -- 172.21.15.77:0/3215123383 learned_addr learned my addr 172.21.15.77:0/3215123383 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:52.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.904+0000 7f77a37fe640 1 -- 172.21.15.77:0/3215123383 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3225144333 0 0) 0x7f77a4153be0 con 0x7f77a4150320 2024-04-25T01:39:52.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.904+0000 7f77a37fe640 1 -- 172.21.15.77:0/3215123383 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7794003520 con 0x7f77a4150320 2024-04-25T01:39:52.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.904+0000 7f77a9172640 1 -- 172.21.15.77:0/3215123383 >> v2:172.21.15.121:3300/0 conn(0x7f77a406d0a0 msgr2=0x7f77a406d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:52.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.904+0000 7f77a9172640 1 --2- 172.21.15.77:0/3215123383 >> v2:172.21.15.121:3300/0 conn(0x7f77a406d0a0 0x7f77a406d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.904+0000 7f77a9172640 1 -- 172.21.15.77:0/3215123383 >> v1:172.21.15.121:6789/0 conn(0x7f77a4150320 legacy=0x7f77a4156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:52.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.904+0000 7f77a9172640 1 -- 172.21.15.77:0/3215123383 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a4153590 con 0x7f77a4154380 2024-04-25T01:39:52.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.904+0000 7f77a3fff640 1 --2- 172.21.15.77:0/3215123383 >> v2:172.21.15.121:3300/0 conn(0x7f77a406d0a0 0x7f77a406d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:39:52.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.905+0000 7f77a9172640 1 --2- 172.21.15.77:0/3215123383 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f77a4154380 0x7f77a4154830 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f779c009d90 tx=0x7f779c02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f297350c7fde8616 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:52.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.905+0000 7f77a37fe640 1 -- 172.21.15.77:0/3215123383 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779c031600 con 0x7f77a4154380 2024-04-25T01:39:52.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.905+0000 7f77a37fe640 1 -- 172.21.15.77:0/3215123383 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f779c0317a0 con 0x7f77a4154380 2024-04-25T01:39:52.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.905+0000 7f77a37fe640 1 -- 172.21.15.77:0/3215123383 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779c031b50 con 0x7f77a4154380 2024-04-25T01:39:52.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.906+0000 7f77aabd5640 1 -- 172.21.15.77:0/3215123383 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f77a4154380 msgr2=0x7f77a4154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:52.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.906+0000 7f77aabd5640 1 --2- 172.21.15.77:0/3215123383 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f77a4154380 0x7f77a4154830 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f779c009d90 tx=0x7f779c02a5d0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.906+0000 7f77aabd5640 1 -- 172.21.15.77:0/3215123383 shutdown_connections 2024-04-25T01:39:52.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.906+0000 7f77aabd5640 1 --2- 172.21.15.77:0/3215123383 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f77a4154380 0x7f77a4154830 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.906+0000 7f77aabd5640 1 --2- 172.21.15.77:0/3215123383 >> v2:172.21.15.121:3300/0 conn(0x7f77a406d0a0 0x7f77a406d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.906+0000 7f77aabd5640 1 -- 172.21.15.77:0/3215123383 >> 172.21.15.77:0/3215123383 conn(0x7f77a40c3f80 msgr2=0x7f77a40c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:52.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.906+0000 7f77aabd5640 1 -- 172.21.15.77:0/3215123383 shutdown_connections 2024-04-25T01:39:52.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.906+0000 7f77aabd5640 1 -- 172.21.15.77:0/3215123383 wait complete. 2024-04-25T01:39:52.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.907+0000 7f77aabd5640 1 Processor -- start 2024-04-25T01:39:52.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.907+0000 7f77aabd5640 1 -- start start 2024-04-25T01:39:52.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.908+0000 7f77aabd5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f77a406d0a0 0x7f77a40c0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:52.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.908+0000 7f77aabd5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77a4150320 0x7f77a4146990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:52.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.908+0000 7f77aabd5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77a4154380 0x7f77a4146ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:52.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.908+0000 7f77aabd5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f77a4152d70 con 0x7f77a4154380 2024-04-25T01:39:52.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.908+0000 7f77aabd5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f77a4152bf0 con 0x7f77a4150320 2024-04-25T01:39:52.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.908+0000 7f77aabd5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f77a40c3100 con 0x7f77a406d0a0 2024-04-25T01:39:52.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.908+0000 7f77a9172640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77a4154380 0x7f77a4146ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:52.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.908+0000 7f77a9172640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77a4154380 0x7f77a4146ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45136/0 (socket says 172.21.15.77:45136) 2024-04-25T01:39:52.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.908+0000 7f77a9172640 1 -- 172.21.15.77:0/375526791 learned_addr learned my addr 172.21.15.77:0/375526791 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:52.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.908+0000 7f77a8971640 1 --2- 172.21.15.77:0/375526791 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f77a406d0a0 0x7f77a40c0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:52.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.908+0000 7f77a3fff640 1 --2- 172.21.15.77:0/375526791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77a4150320 0x7f77a4146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:52.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.908+0000 7f77a9172640 1 -- 172.21.15.77:0/375526791 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f77a406d0a0 msgr2=0x7f77a40c0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:52.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.908+0000 7f77a9172640 1 --2- 172.21.15.77:0/375526791 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f77a406d0a0 0x7f77a40c0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.908+0000 7f77a9172640 1 -- 172.21.15.77:0/375526791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77a4150320 msgr2=0x7f77a4146990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:52.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.908+0000 7f77a9172640 1 --2- 172.21.15.77:0/375526791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77a4150320 0x7f77a4146990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:52.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.908+0000 7f77a9172640 1 -- 172.21.15.77:0/375526791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a40a8f50 con 0x7f77a4154380 2024-04-25T01:39:52.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.908+0000 7f77a9172640 1 --2- 172.21.15.77:0/375526791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77a4154380 0x7f77a4146ed0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f779c009d90 tx=0x7f779c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:52.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.908+0000 7f77a17fa640 1 -- 172.21.15.77:0/375526791 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779c040070 con 0x7f77a4154380 2024-04-25T01:39:52.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.908+0000 7f77a17fa640 1 -- 172.21.15.77:0/375526791 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f779c004260 con 0x7f77a4154380 2024-04-25T01:39:52.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.908+0000 7f77aabd5640 1 -- 172.21.15.77:0/375526791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77a4072d20 con 0x7f77a4154380 2024-04-25T01:39:52.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.908+0000 7f77a17fa640 1 -- 172.21.15.77:0/375526791 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779c009450 con 0x7f77a4154380 2024-04-25T01:39:52.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.908+0000 7f77aabd5640 1 -- 172.21.15.77:0/375526791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77a4073000 con 0x7f77a4154380 2024-04-25T01:39:52.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.909+0000 7f77aabd5640 1 -- 172.21.15.77:0/375526791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77a414e9c0 con 0x7f77a4154380 2024-04-25T01:39:52.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.910+0000 7f77a17fa640 1 -- 172.21.15.77:0/375526791 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f779c039040 con 0x7f77a4154380 2024-04-25T01:39:52.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.910+0000 7f77a17fa640 1 --2- 172.21.15.77:0/375526791 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f778806be30 0x7f778806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:52.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.910+0000 7f77a17fa640 1 -- 172.21.15.77:0/375526791 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f779c0ac160 con 0x7f77a4154380 2024-04-25T01:39:52.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.910+0000 7f77a8971640 1 --2- 172.21.15.77:0/375526791 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f778806be30 0x7f778806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:52.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.911+0000 7f77a8971640 1 --2- 172.21.15.77:0/375526791 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f778806be30 0x7f778806e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7798005880 tx=0x7f7798009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:52.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:52.914+0000 7f77a17fa640 1 -- 172.21.15.77:0/375526791 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f77a414e9c0 con 0x7f77a4154380 2024-04-25T01:39:53.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.087+0000 7f77aabd5640 1 -- 172.21.15.77:0/375526791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f77a414eeb0 con 0x7f77a4154380 2024-04-25T01:39:53.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.089+0000 7f77a17fa640 1 -- 172.21.15.77:0/375526791 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20331 (secure 0 0 0) 0x7f77a414eeb0 con 0x7f77a4154380 2024-04-25T01:39:53.072 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:53.073 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:39:34.425701+0000","last_up_change":"2024-04-25T01:39:10.729600+0000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T01:39:11.681151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T01:39:21.606752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T01:39:22.677664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T01:39:30.501700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T01:39:31.740717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6811","nonce":3366980158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6817","nonce":3366980158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6828","nonce":3366980158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6825","nonce":3366980158}]},"public_addr":"172.21.15.77:6811/3366980158","cluster_addr":"172.21.15.77:6817/3366980158","heartbeat_back_addr":"172.21.15.77:6828/3366980158","heartbeat_front_addr":"172.21.15.77:6825/3366980158","state":["exists","up"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6801","nonce":3971619298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6803","nonce":3971619298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6807","nonce":3971619298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6805","nonce":3971619298}]},"public_addr":"172.21.15.77:6801/3971619298","cluster_addr":"172.21.15.77:6803/3971619298","heartbeat_back_addr":"172.21.15.77:6807/3971619298","heartbeat_front_addr":"172.21.15.77:6805/3971619298","state":["exists","up"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6810","nonce":4103452689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6813","nonce":4103452689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6823","nonce":4103452689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6818","nonce":4103452689}]},"public_addr":"172.21.15.77:6810/4103452689","cluster_addr":"172.21.15.77:6813/4103452689","heartbeat_back_addr":"172.21.15.77:6823/4103452689","heartbeat_front_addr":"172.21.15.77:6818/4103452689","state":["exists","up"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6819","nonce":217398906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6824","nonce":217398906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6831","nonce":217398906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6829","nonce":217398906}]},"public_addr":"172.21.15.77:6819/217398906","cluster_addr":"172.21.15.77:6824/217398906","heartbeat_back_addr":"172.21.15.77:6831/217398906","heartbeat_front_addr":"172.21.15.77:6829/217398906","state":["exists","up"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6801","nonce":2565483070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6803","nonce":2565483070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6810","nonce":2565483070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6806","nonce":2565483070}]},"public_addr":"172.21.15.121:6801/2565483070","cluster_addr":"172.21.15.121:6803/2565483070","heartbeat_back_addr":"172.21.15.121:6810/2565483070","heartbeat_front_addr":"172.21.15.121:6806/2565483070","state":["exists","up"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6807","nonce":2785294752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6809","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6811","nonce":2785294752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6815","nonce":2785294752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6813","nonce":2785294752}]},"public_addr":"172.21.15.121:6807/2785294752","cluster_addr":"172.21.15.121:6811/2785294752","heartbeat_back_addr":"172.21.15.121:6815/2785294752","heartbeat_front_addr":"172.21.15.121:6813/2785294752","state":["exists","up"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6820","nonce":523906818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6824","nonce":523906818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6831","nonce":523906818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6828","nonce":523906818}]},"public_addr":"172.21.15.121:6820/523906818","cluster_addr":"172.21.15.121:6824/523906818","heartbeat_back_addr":"172.21.15.121:6831/523906818","heartbeat_front_addr":"172.21.15.121:6828/523906818","state":["exists","up"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6817","nonce":1683602459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6819","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6821","nonce":1683602459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6829","nonce":1683602459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6823","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6825","nonce":1683602459}]},"public_addr":"172.21.15.121:6817/1683602459","cluster_addr":"172.21.15.121:6821/1683602459","heartbeat_back_addr":"172.21.15.121:6829/1683602459","heartbeat_front_addr":"172.21.15.121:6825/1683602459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.839443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.818842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.776243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.793085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.822396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.907311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.918374+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.848430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:39:53.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.090+0000 7f77aabd5640 1 -- 172.21.15.77:0/375526791 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f778806be30 msgr2=0x7f778806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:53.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.090+0000 7f77aabd5640 1 --2- 172.21.15.77:0/375526791 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f778806be30 0x7f778806e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7798005880 tx=0x7f7798009040 comp rx=0 tx=0).stop 2024-04-25T01:39:53.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.090+0000 7f77aabd5640 1 -- 172.21.15.77:0/375526791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77a4154380 msgr2=0x7f77a4146ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:53.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.090+0000 7f77aabd5640 1 --2- 172.21.15.77:0/375526791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77a4154380 0x7f77a4146ed0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f779c009d90 tx=0x7f779c004a40 comp rx=0 tx=0).stop 2024-04-25T01:39:53.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.091+0000 7f77aabd5640 1 -- 172.21.15.77:0/375526791 shutdown_connections 2024-04-25T01:39:53.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.091+0000 7f77aabd5640 1 --2- 172.21.15.77:0/375526791 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f778806be30 0x7f778806e2f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.091+0000 7f77aabd5640 1 --2- 172.21.15.77:0/375526791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77a4154380 0x7f77a4146ed0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.091+0000 7f77aabd5640 1 --2- 172.21.15.77:0/375526791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77a4150320 0x7f77a4146990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.091+0000 7f77aabd5640 1 --2- 172.21.15.77:0/375526791 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f77a406d0a0 0x7f77a40c0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.091+0000 7f77aabd5640 1 -- 172.21.15.77:0/375526791 >> 172.21.15.77:0/375526791 conn(0x7f77a40c3f80 msgr2=0x7f77a414ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:53.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.091+0000 7f77aabd5640 1 -- 172.21.15.77:0/375526791 shutdown_connections 2024-04-25T01:39:53.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.091+0000 7f77aabd5640 1 -- 172.21.15.77:0/375526791 wait complete. 2024-04-25T01:39:53.085 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:39:53.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.199+0000 7f3e03d4f640 1 Processor -- start 2024-04-25T01:39:53.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.199+0000 7f3e03d4f640 1 -- start start 2024-04-25T01:39:53.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.200+0000 7f3e03d4f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3dfc150320 0x7f3dfc156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:53.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.200+0000 7f3e03d4f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dfc153be0 con 0x7f3dfc06d0a0 2024-04-25T01:39:53.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.200+0000 7f3e03d4f640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dfc157100 con 0x7f3dfc06d4e0 2024-04-25T01:39:53.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.200+0000 7f3e03d4f640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f3dfc152fd0 con 0x7f3dfc150320 2024-04-25T01:39:53.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.200+0000 7f3e012ea640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3dfc06d0a0 0x7f3dfc154380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:37986/0 (socket says 172.21.15.77:37986) 2024-04-25T01:39:53.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.200+0000 7f3e012ea640 1 -- 172.21.15.77:0/2909699477 learned_addr learned my addr 172.21.15.77:0/2909699477 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:53.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.200+0000 7f3e01aeb640 1 --2- 172.21.15.77:0/2909699477 >> v2:172.21.15.121:3300/0 conn(0x7f3dfc150320 0x7f3dfc156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:53.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.200+0000 7f3e00ae9640 1 -- 172.21.15.77:0/2909699477 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 718423114 0 0) 0x7f3dfc153be0 con 0x7f3dfc06d0a0 2024-04-25T01:39:53.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.200+0000 7f3e00ae9640 1 -- 172.21.15.77:0/2909699477 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3de8003520 con 0x7f3dfc06d0a0 2024-04-25T01:39:53.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.201+0000 7f3e01aeb640 1 -- 172.21.15.77:0/2909699477 >> v1:172.21.15.121:6789/0 conn(0x7f3dfc06d4e0 legacy=0x7f3dfc154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:53.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.201+0000 7f3e01aeb640 1 -- 172.21.15.77:0/2909699477 >> v1:172.21.15.77:6789/0 conn(0x7f3dfc06d0a0 legacy=0x7f3dfc154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:53.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.201+0000 7f3e01aeb640 1 -- 172.21.15.77:0/2909699477 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dfc1532b0 con 0x7f3dfc150320 2024-04-25T01:39:53.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.201+0000 7f3e01aeb640 1 --2- 172.21.15.77:0/2909699477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3dfc150320 0x7f3dfc156bc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3df80097a0 tx=0x7f3df802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58435f4bfd3ed11a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:53.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.201+0000 7f3e00ae9640 1 -- 172.21.15.77:0/2909699477 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df8037070 con 0x7f3dfc150320 2024-04-25T01:39:53.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.202+0000 7f3e00ae9640 1 -- 172.21.15.77:0/2909699477 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df8032440 con 0x7f3dfc150320 2024-04-25T01:39:53.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.202+0000 7f3e00ae9640 1 -- 172.21.15.77:0/2909699477 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df8032810 con 0x7f3dfc150320 2024-04-25T01:39:53.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.202+0000 7f3e03d4f640 1 -- 172.21.15.77:0/2909699477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3dfc150320 msgr2=0x7f3dfc156bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:53.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.202+0000 7f3e03d4f640 1 --2- 172.21.15.77:0/2909699477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3dfc150320 0x7f3dfc156bc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3df80097a0 tx=0x7f3df802a1a0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.202+0000 7f3e03d4f640 1 -- 172.21.15.77:0/2909699477 shutdown_connections 2024-04-25T01:39:53.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.202+0000 7f3e03d4f640 1 --2- 172.21.15.77:0/2909699477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3dfc150320 0x7f3dfc156bc0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.202+0000 7f3e03d4f640 1 -- 172.21.15.77:0/2909699477 >> 172.21.15.77:0/2909699477 conn(0x7f3dfc0c3f80 msgr2=0x7f3dfc0c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:53.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.202+0000 7f3e03d4f640 1 -- 172.21.15.77:0/2909699477 shutdown_connections 2024-04-25T01:39:53.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.202+0000 7f3e03d4f640 1 -- 172.21.15.77:0/2909699477 wait complete. 2024-04-25T01:39:53.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.203+0000 7f3e03d4f640 1 Processor -- start 2024-04-25T01:39:53.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.203+0000 7f3e03d4f640 1 -- start start 2024-04-25T01:39:53.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.204+0000 7f3e03d4f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3dfc06d0a0 0x7f3dfc14cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:53.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.204+0000 7f3e03d4f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dfc06d4e0 0x7f3dfc1e9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:53.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.204+0000 7f3e03d4f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3dfc150320 0x7f3dfc1ea040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:53.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.204+0000 7f3e03d4f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc152bf0 con 0x7f3dfc06d4e0 2024-04-25T01:39:53.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.204+0000 7f3e03d4f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc153870 con 0x7f3dfc06d0a0 2024-04-25T01:39:53.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.204+0000 7f3e03d4f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f3dfc152d70 con 0x7f3dfc150320 2024-04-25T01:39:53.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.204+0000 7f3e012ea640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dfc06d4e0 0x7f3dfc1e9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:53.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.204+0000 7f3e012ea640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dfc06d4e0 0x7f3dfc1e9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45142/0 (socket says 172.21.15.77:45142) 2024-04-25T01:39:53.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.204+0000 7f3e012ea640 1 -- 172.21.15.77:0/1020537580 learned_addr learned my addr 172.21.15.77:0/1020537580 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:53.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.204+0000 7f3e01aeb640 1 --2- 172.21.15.77:0/1020537580 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3dfc06d0a0 0x7f3dfc14cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:53.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.204+0000 7f3e022ec640 1 --2- 172.21.15.77:0/1020537580 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3dfc150320 0x7f3dfc1ea040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:53.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.204+0000 7f3e012ea640 1 -- 172.21.15.77:0/1020537580 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3dfc150320 msgr2=0x7f3dfc1ea040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:53.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.204+0000 7f3e012ea640 1 --2- 172.21.15.77:0/1020537580 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3dfc150320 0x7f3dfc1ea040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.204+0000 7f3e012ea640 1 -- 172.21.15.77:0/1020537580 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3dfc06d0a0 msgr2=0x7f3dfc14cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:53.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.204+0000 7f3e012ea640 1 --2- 172.21.15.77:0/1020537580 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3dfc06d0a0 0x7f3dfc14cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.204+0000 7f3e012ea640 1 -- 172.21.15.77:0/1020537580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dfc0ab170 con 0x7f3dfc06d4e0 2024-04-25T01:39:53.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.204+0000 7f3e012ea640 1 --2- 172.21.15.77:0/1020537580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dfc06d4e0 0x7f3dfc1e9b00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3dec00c4d0 tx=0x7f3dec00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:53.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.205+0000 7f3df27fc640 1 -- 172.21.15.77:0/1020537580 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec017070 con 0x7f3dfc06d4e0 2024-04-25T01:39:53.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.205+0000 7f3df27fc640 1 -- 172.21.15.77:0/1020537580 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dec005ce0 con 0x7f3dfc06d4e0 2024-04-25T01:39:53.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.205+0000 7f3e03d4f640 1 -- 172.21.15.77:0/1020537580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dfc1edac0 con 0x7f3dfc06d4e0 2024-04-25T01:39:53.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.205+0000 7f3df27fc640 1 -- 172.21.15.77:0/1020537580 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec007270 con 0x7f3dfc06d4e0 2024-04-25T01:39:53.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.205+0000 7f3e03d4f640 1 -- 172.21.15.77:0/1020537580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dfc0ac130 con 0x7f3dfc06d4e0 2024-04-25T01:39:53.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.206+0000 7f3e03d4f640 1 -- 172.21.15.77:0/1020537580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dfc04f500 con 0x7f3dfc06d4e0 2024-04-25T01:39:53.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.206+0000 7f3df27fc640 1 -- 172.21.15.77:0/1020537580 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3dec01a070 con 0x7f3dfc06d4e0 2024-04-25T01:39:53.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.206+0000 7f3df27fc640 1 --2- 172.21.15.77:0/1020537580 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3de006be30 0x7f3de006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:53.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.206+0000 7f3df27fc640 1 -- 172.21.15.77:0/1020537580 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f3dec08a3c0 con 0x7f3dfc06d4e0 2024-04-25T01:39:53.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.207+0000 7f3e01aeb640 1 --2- 172.21.15.77:0/1020537580 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3de006be30 0x7f3de006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:53.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.207+0000 7f3e01aeb640 1 --2- 172.21.15.77:0/1020537580 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3de006be30 0x7f3de006e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3df8034000 tx=0x7f3df802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:53.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.211+0000 7f3df27fc640 1 -- 172.21.15.77:0/1020537580 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3dfc0ab170 con 0x7f3dfc06d4e0 2024-04-25T01:39:53.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.416+0000 7f3e03d4f640 1 -- 172.21.15.77:0/1020537580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3dfc14d080 con 0x7f3dfc06d4e0 2024-04-25T01:39:53.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.417+0000 7f3df27fc640 1 -- 172.21.15.77:0/1020537580 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6488 (secure 0 0 0) 0x7f3dec058400 con 0x7f3dfc06d4e0 2024-04-25T01:39:53.401 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:53.401 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:39:36.787357+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6837/3454203695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3454203695},{"type":"v1","addr":"172.21.15.77:6837","nonce":3454203695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-04-25T01:39:53.401 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 12 2024-04-25T01:39:53.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.419+0000 7f3e03d4f640 1 -- 172.21.15.77:0/1020537580 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3de006be30 msgr2=0x7f3de006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:53.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.419+0000 7f3e03d4f640 1 --2- 172.21.15.77:0/1020537580 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3de006be30 0x7f3de006e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3df8034000 tx=0x7f3df802e000 comp rx=0 tx=0).stop 2024-04-25T01:39:53.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.419+0000 7f3e03d4f640 1 -- 172.21.15.77:0/1020537580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dfc06d4e0 msgr2=0x7f3dfc1e9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:53.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.419+0000 7f3e03d4f640 1 --2- 172.21.15.77:0/1020537580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dfc06d4e0 0x7f3dfc1e9b00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3dec00c4d0 tx=0x7f3dec00c990 comp rx=0 tx=0).stop 2024-04-25T01:39:53.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.419+0000 7f3e03d4f640 1 -- 172.21.15.77:0/1020537580 shutdown_connections 2024-04-25T01:39:53.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.419+0000 7f3e03d4f640 1 --2- 172.21.15.77:0/1020537580 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3de006be30 0x7f3de006e2f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.419+0000 7f3e03d4f640 1 --2- 172.21.15.77:0/1020537580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dfc06d4e0 0x7f3dfc1e9b00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.419+0000 7f3e03d4f640 1 --2- 172.21.15.77:0/1020537580 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3dfc150320 0x7f3dfc1ea040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.419+0000 7f3e03d4f640 1 --2- 172.21.15.77:0/1020537580 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3dfc06d0a0 0x7f3dfc14cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.419+0000 7f3e03d4f640 1 -- 172.21.15.77:0/1020537580 >> 172.21.15.77:0/1020537580 conn(0x7f3dfc0c3f80 msgr2=0x7f3dfc148a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:53.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.419+0000 7f3e03d4f640 1 -- 172.21.15.77:0/1020537580 shutdown_connections 2024-04-25T01:39:53.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.419+0000 7f3e03d4f640 1 -- 172.21.15.77:0/1020537580 wait complete. 2024-04-25T01:39:53.816 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T01:39:32.761220+0000', 'modified': '2024-04-25T01:39:36.787357+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4278': {'gid': 4278, 'name': 'c', 'rank': 0, 'incarnation': 8, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.77:6837/3454203695', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6836', 'nonce': 3454203695}, {'type': 'v1', 'addr': '172.21.15.77:6837', 'nonce': 3454203695}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'b', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4278, 'qdb_cluster': [4278]} 2024-04-25T01:39:53.817 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T01:39:53.817 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T01:39:53.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.934+0000 7f402f563640 1 Processor -- start 2024-04-25T01:39:53.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.934+0000 7f402f563640 1 -- start start 2024-04-25T01:39:53.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.935+0000 7f402f563640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4028072820 0x7f40280c8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:53.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.935+0000 7f402f563640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f40280c2be0 0x7f40280c3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:53.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.935+0000 7f402f563640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4028159f50 con 0x7f4028153820 2024-04-25T01:39:53.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.935+0000 7f402f563640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f40280c7870 con 0x7f40280c2be0 2024-04-25T01:39:53.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.935+0000 7f402f563640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f402815a4d0 con 0x7f4028072820 2024-04-25T01:39:53.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.935+0000 7f402db00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f40280c2be0 0x7f40280c3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:53.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.935+0000 7f402d2ff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4028153820 0x7f40280c7d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:38002/0 (socket says 172.21.15.77:38002) 2024-04-25T01:39:53.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.935+0000 7f402d2ff640 1 -- 172.21.15.77:0/965359508 learned_addr learned my addr 172.21.15.77:0/965359508 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:53.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.935+0000 7f402cafe640 1 --2- 172.21.15.77:0/965359508 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4028072820 0x7f40280c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:53.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.935+0000 7f402db00640 1 -- 172.21.15.77:0/965359508 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4028072820 msgr2=0x7f40280c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:53.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.935+0000 7f402db00640 1 --2- 172.21.15.77:0/965359508 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4028072820 0x7f40280c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.935+0000 7f402db00640 1 -- 172.21.15.77:0/965359508 >> v1:172.21.15.77:6789/0 conn(0x7f4028153820 legacy=0x7f40280c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:53.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.935+0000 7f401ffff640 1 -- 172.21.15.77:0/965359508 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1506128323 0 0) 0x7f4028159f50 con 0x7f4028153820 2024-04-25T01:39:53.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.935+0000 7f402db00640 1 -- 172.21.15.77:0/965359508 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40280732a0 con 0x7f40280c2be0 2024-04-25T01:39:53.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.936+0000 7f402cafe640 1 --2- 172.21.15.77:0/965359508 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4028072820 0x7f40280c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:53.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.936+0000 7f402db00640 1 --2- 172.21.15.77:0/965359508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40280c2be0 0x7f40280c3070 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f40200097a0 tx=0x7f402002a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab99b0bc3fe0078d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:53.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.936+0000 7f401ffff640 1 -- 172.21.15.77:0/965359508 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4020037070 con 0x7f40280c2be0 2024-04-25T01:39:53.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.936+0000 7f401ffff640 1 -- 172.21.15.77:0/965359508 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f402002adb0 con 0x7f40280c2be0 2024-04-25T01:39:53.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.936+0000 7f401ffff640 1 -- 172.21.15.77:0/965359508 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4020032660 con 0x7f40280c2be0 2024-04-25T01:39:53.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.937+0000 7f402f563640 1 -- 172.21.15.77:0/965359508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40280c2be0 msgr2=0x7f40280c3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:53.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.937+0000 7f402f563640 1 --2- 172.21.15.77:0/965359508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40280c2be0 0x7f40280c3070 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f40200097a0 tx=0x7f402002a060 comp rx=0 tx=0).stop 2024-04-25T01:39:53.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.937+0000 7f402f563640 1 -- 172.21.15.77:0/965359508 shutdown_connections 2024-04-25T01:39:53.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.937+0000 7f402f563640 1 --2- 172.21.15.77:0/965359508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40280c2be0 0x7f40280c3070 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.937+0000 7f402f563640 1 --2- 172.21.15.77:0/965359508 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4028072820 0x7f40280c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.937+0000 7f402f563640 1 -- 172.21.15.77:0/965359508 >> 172.21.15.77:0/965359508 conn(0x7f4028067780 msgr2=0x7f40280c97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:53.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.937+0000 7f402f563640 1 -- 172.21.15.77:0/965359508 shutdown_connections 2024-04-25T01:39:53.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.937+0000 7f402f563640 1 -- 172.21.15.77:0/965359508 wait complete. 2024-04-25T01:39:53.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.938+0000 7f402f563640 1 Processor -- start 2024-04-25T01:39:53.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.938+0000 7f402f563640 1 -- start start 2024-04-25T01:39:53.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.939+0000 7f402f563640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4028072820 0x7f40281eeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:53.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.939+0000 7f402f563640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40280c2be0 0x7f40281ef420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:53.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.939+0000 7f402f563640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4028153820 0x7f402814bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:53.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.939+0000 7f402f563640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4028072f30 con 0x7f4028072820 2024-04-25T01:39:53.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.939+0000 7f402f563640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f40280c8950 con 0x7f40280c2be0 2024-04-25T01:39:53.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.939+0000 7f402f563640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f40280c35b0 con 0x7f4028153820 2024-04-25T01:39:53.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.939+0000 7f402d2ff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4028072820 0x7f40281eeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:53.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.939+0000 7f402d2ff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4028072820 0x7f40281eeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45164/0 (socket says 172.21.15.77:45164) 2024-04-25T01:39:53.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.939+0000 7f402d2ff640 1 -- 172.21.15.77:0/1690373503 learned_addr learned my addr 172.21.15.77:0/1690373503 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:53.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.939+0000 7f402d2ff640 1 -- 172.21.15.77:0/1690373503 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4028153820 msgr2=0x7f402814bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:53.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.939+0000 7f402d2ff640 1 --2- 172.21.15.77:0/1690373503 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4028153820 0x7f402814bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.939+0000 7f402d2ff640 1 -- 172.21.15.77:0/1690373503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40280c2be0 msgr2=0x7f40281ef420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:53.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.939+0000 7f402d2ff640 1 --2- 172.21.15.77:0/1690373503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40280c2be0 0x7f40281ef420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.939+0000 7f402d2ff640 1 -- 172.21.15.77:0/1690373503 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f402806dcb0 con 0x7f4028072820 2024-04-25T01:39:53.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.939+0000 7f402d2ff640 1 --2- 172.21.15.77:0/1690373503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4028072820 0x7f40281eeee0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f402400c7c0 tx=0x7f402400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:53.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.939+0000 7f401dffb640 1 -- 172.21.15.77:0/1690373503 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4024018070 con 0x7f4028072820 2024-04-25T01:39:53.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.939+0000 7f401dffb640 1 -- 172.21.15.77:0/1690373503 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f402400a640 con 0x7f4028072820 2024-04-25T01:39:53.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.939+0000 7f402f563640 1 -- 172.21.15.77:0/1690373503 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40281ef960 con 0x7f4028072820 2024-04-25T01:39:53.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.939+0000 7f401dffb640 1 -- 172.21.15.77:0/1690373503 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402400aa30 con 0x7f4028072820 2024-04-25T01:39:53.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.939+0000 7f402f563640 1 -- 172.21.15.77:0/1690373503 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f402806df50 con 0x7f4028072820 2024-04-25T01:39:53.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.941+0000 7f401dffb640 1 -- 172.21.15.77:0/1690373503 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f402401b070 con 0x7f4028072820 2024-04-25T01:39:53.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.941+0000 7f401dffb640 1 --2- 172.21.15.77:0/1690373503 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f400c06be30 0x7f400c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:53.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.941+0000 7f402cafe640 1 --2- 172.21.15.77:0/1690373503 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f400c06be30 0x7f400c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:53.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.942+0000 7f401dffb640 1 -- 172.21.15.77:0/1690373503 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f402408a700 con 0x7f4028072820 2024-04-25T01:39:53.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.942+0000 7f402cafe640 1 --2- 172.21.15.77:0/1690373503 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f400c06be30 0x7f400c06e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4018006fd0 tx=0x7f4018008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:53.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.942+0000 7f4032279740 1 Processor -- start 2024-04-25T01:39:53.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.942+0000 7f4032279740 1 -- start start 2024-04-25T01:39:53.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.943+0000 7f4032279740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557652629ad0 0x557652626940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:53.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.943+0000 7f4032279740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576525ec8e0 0x557652626e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:53.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.943+0000 7f4032279740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55765260d510 0x557652627bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:53.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.943+0000 7f4032279740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55765254ef00 con 0x5576525ec8e0 2024-04-25T01:39:53.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.943+0000 7f4032279740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5576524f7750 con 0x557652629ad0 2024-04-25T01:39:53.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.943+0000 7f4032279740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55765254aec0 con 0x55765260d510 2024-04-25T01:39:53.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.943+0000 7f402cafe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576525ec8e0 0x557652626e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:53.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.943+0000 7f402cafe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576525ec8e0 0x557652626e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45176/0 (socket says 172.21.15.77:45176) 2024-04-25T01:39:53.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.943+0000 7f402cafe640 1 -- 172.21.15.77:0/1831847638 learned_addr learned my addr 172.21.15.77:0/1831847638 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:53.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.943+0000 7f402db00640 1 --2- 172.21.15.77:0/1831847638 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55765260d510 0x557652627bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:53.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.943+0000 7f402d2ff640 1 --2- 172.21.15.77:0/1831847638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557652629ad0 0x557652626940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:53.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.943+0000 7f402cafe640 1 -- 172.21.15.77:0/1831847638 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55765260d510 msgr2=0x557652627bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:53.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.943+0000 7f402cafe640 1 --2- 172.21.15.77:0/1831847638 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55765260d510 0x557652627bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.943+0000 7f402cafe640 1 -- 172.21.15.77:0/1831847638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557652629ad0 msgr2=0x557652626940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:53.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.943+0000 7f402cafe640 1 --2- 172.21.15.77:0/1831847638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557652629ad0 0x557652626940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.943+0000 7f402cafe640 1 -- 172.21.15.77:0/1831847638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576522632d0 con 0x5576525ec8e0 2024-04-25T01:39:53.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.943+0000 7f402db00640 1 --2- 172.21.15.77:0/1831847638 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55765260d510 0x557652627bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:53.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.943+0000 7f402d2ff640 1 --2- 172.21.15.77:0/1831847638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557652629ad0 0x557652626940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:53.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.944+0000 7f402cafe640 1 --2- 172.21.15.77:0/1831847638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576525ec8e0 0x557652626e80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f401800cb20 tx=0x7f401800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7a7b5ddc88eaa48 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:53.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.944+0000 7f4012ffd640 1 -- 172.21.15.77:0/1831847638 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4018019040 con 0x5576525ec8e0 2024-04-25T01:39:53.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.944+0000 7f4012ffd640 1 -- 172.21.15.77:0/1831847638 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4018022070 con 0x5576525ec8e0 2024-04-25T01:39:53.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.944+0000 7f4012ffd640 1 -- 172.21.15.77:0/1831847638 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4018013da0 con 0x5576525ec8e0 2024-04-25T01:39:53.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.944+0000 7f4032279740 1 -- 172.21.15.77:0/1831847638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576525ec8e0 msgr2=0x557652626e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:53.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.944+0000 7f4032279740 1 --2- 172.21.15.77:0/1831847638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576525ec8e0 0x557652626e80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f401800cb20 tx=0x7f401800f000 comp rx=0 tx=0).stop 2024-04-25T01:39:53.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.944+0000 7f4032279740 1 -- 172.21.15.77:0/1831847638 shutdown_connections 2024-04-25T01:39:53.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.944+0000 7f4032279740 1 --2- 172.21.15.77:0/1831847638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576525ec8e0 0x557652626e80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.944+0000 7f4032279740 1 --2- 172.21.15.77:0/1831847638 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55765260d510 0x557652627bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.944+0000 7f4032279740 1 --2- 172.21.15.77:0/1831847638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557652629ad0 0x557652626940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.944+0000 7f4032279740 1 -- 172.21.15.77:0/1831847638 >> 172.21.15.77:0/1831847638 conn(0x5576525e8640 msgr2=0x55765260ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:53.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.944+0000 7f4032279740 1 -- 172.21.15.77:0/1831847638 shutdown_connections 2024-04-25T01:39:53.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.944+0000 7f4032279740 1 -- 172.21.15.77:0/1831847638 wait complete. 2024-04-25T01:39:53.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.945+0000 7f4032279740 1 -- start start 2024-04-25T01:39:53.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.945+0000 7f4032279740 1 Processor -- start 2024-04-25T01:39:53.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.946+0000 7f4032279740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55765260d510 0x557652628280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:53.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.946+0000 7f4032279740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557652629ad0 0x55765263b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:53.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.946+0000 7f4032279740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55765263bd10 0x557652607970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:53.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.946+0000 7f4032279740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5576525ecdc0 con 0x557652629ad0 2024-04-25T01:39:53.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.946+0000 7f4032279740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55765250acf0 con 0x55765263bd10 2024-04-25T01:39:53.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.946+0000 7f4032279740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x5576526264b0 con 0x55765260d510 2024-04-25T01:39:53.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.946+0000 7f4032279740 10 client.0 _ll_register_callbacks cb 0x55765250a6e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T01:39:53.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.946+0000 7f402cafe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557652629ad0 0x55765263b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:53.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.946+0000 7f402cafe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557652629ad0 0x55765263b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45192/0 (socket says 172.21.15.77:45192) 2024-04-25T01:39:53.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.946+0000 7f402cafe640 1 -- 172.21.15.77:0/2983114131 learned_addr learned my addr 172.21.15.77:0/2983114131 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:53.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.946+0000 7f402d2ff640 1 --2- 172.21.15.77:0/2983114131 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55765260d510 0x557652628280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:53.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.946+0000 7f402db00640 1 --2- 172.21.15.77:0/2983114131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55765263bd10 0x557652607970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:53.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.946+0000 7f402cafe640 1 -- 172.21.15.77:0/2983114131 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55765260d510 msgr2=0x557652628280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:53.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.946+0000 7f402cafe640 1 --2- 172.21.15.77:0/2983114131 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55765260d510 0x557652628280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.946+0000 7f402cafe640 1 -- 172.21.15.77:0/2983114131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55765263bd10 msgr2=0x557652607970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:53.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.946+0000 7f402cafe640 1 --2- 172.21.15.77:0/2983114131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55765263bd10 0x557652607970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.946+0000 7f402cafe640 1 -- 172.21.15.77:0/2983114131 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55765232d6b0 con 0x557652629ad0 2024-04-25T01:39:53.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.946+0000 7f402cafe640 1 --2- 172.21.15.77:0/2983114131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557652629ad0 0x55765263b7d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f401800cac0 tx=0x7f4018006c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f47eed75a29e83 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:53.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.946+0000 7f4007fff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-25T01:39:53.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.946+0000 7f4007fff640 1 -- 172.21.15.77:0/2983114131 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401802c070 con 0x557652629ad0 2024-04-25T01:39:53.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.946+0000 7f4007fff640 1 -- 172.21.15.77:0/2983114131 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f40180263f0 con 0x557652629ad0 2024-04-25T01:39:53.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.946+0000 7f4032279740 1 -- 172.21.15.77:0/2983114131 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4018022070 con 0x557652629ad0 2024-04-25T01:39:53.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.946+0000 7f4007fff640 1 -- 172.21.15.77:0/2983114131 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7f4018038050 con 0x557652629ad0 2024-04-25T01:39:53.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.946+0000 7f4032279740 10 client.4923 fetch_fsmap learned FSMap version 12 2024-04-25T01:39:53.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.946+0000 7f4032279740 1 -- 172.21.15.77:0/2983114131 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) -- 0x55765263b2b0 con 0x557652629ad0 2024-04-25T01:39:53.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.947+0000 7f4007fff640 1 -- 172.21.15.77:0/2983114131 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4018022070 con 0x557652629ad0 2024-04-25T01:39:53.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.947+0000 7f4007fff640 1 -- 172.21.15.77:0/2983114131 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 12) ==== 4128+0+0 (secure 0 0 0) 0x7f401803b020 con 0x557652629ad0 2024-04-25T01:39:53.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.947+0000 7f4032279740 10 client.4923 fetch_fsmap finished waiting for FSMap version 12 2024-04-25T01:39:53.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.947+0000 7f4032279740 10 client.4923 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T01:39:53.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.947+0000 7f4032279740 20 client.4923 populate_metadata read hostname 'smithi077' 2024-04-25T01:39:53.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.947+0000 7f4032279740 1 --2- 172.21.15.77:0/2983114131 >> [v2:172.21.15.77:6836/3454203695,v1:172.21.15.77:6837/3454203695] conn(0x5576525e9ce0 0x557652646700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:53.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.947+0000 7f4032279740 4 client.4923 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T01:39:53.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.947+0000 7f4032279740 1 -- 172.21.15.77:0/2983114131 --> [v2:172.21.15.77:6836/3454203695,v1:172.21.15.77:6837/3454203695] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55765255c440 con 0x5576525e9ce0 2024-04-25T01:39:53.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.947+0000 7f402d2ff640 1 --2- 172.21.15.77:0/2983114131 >> [v2:172.21.15.77:6836/3454203695,v1:172.21.15.77:6837/3454203695] conn(0x5576525e9ce0 0x557652646700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:53.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.947+0000 7f4007fff640 10 client.4923 ms_handle_connect on v2:172.21.15.77:6836/3454203695 2024-04-25T01:39:53.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.947+0000 7f402d2ff640 1 --2- 172.21.15.77:0/2983114131 >> [v2:172.21.15.77:6836/3454203695,v1:172.21.15.77:6837/3454203695] conn(0x5576525e9ce0 0x557652646700 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fac6a33c231adf3 server_cookie=302961eb191450e in_seq=0 out_seq=0 2024-04-25T01:39:53.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.948+0000 7f4007fff640 1 -- 172.21.15.77:0/2983114131 <== mds.0 v2:172.21.15.77:6836/3454203695 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55765255c440 con 0x5576525e9ce0 2024-04-25T01:39:53.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.948+0000 7f4007fff640 10 client.4923 handle_command_reply: tid=0 2024-04-25T01:39:53.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.948+0000 7f4032279740 1 client.4923 shutdown 2024-04-25T01:39:53.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.948+0000 7f4032279740 1 -- 172.21.15.77:0/2983114131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557652629ad0 msgr2=0x55765263b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:53.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.948+0000 7f4032279740 1 --2- 172.21.15.77:0/2983114131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557652629ad0 0x55765263b7d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f401800cac0 tx=0x7f4018006c90 comp rx=0 tx=0).stop 2024-04-25T01:39:53.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.948+0000 7f4032279740 1 -- 172.21.15.77:0/2983114131 shutdown_connections 2024-04-25T01:39:53.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.948+0000 7f4032279740 1 --2- 172.21.15.77:0/2983114131 >> [v2:172.21.15.77:6836/3454203695,v1:172.21.15.77:6837/3454203695] conn(0x5576525e9ce0 0x557652646700 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.948+0000 7f4032279740 1 --2- 172.21.15.77:0/2983114131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557652629ad0 0x55765263b7d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.948+0000 7f4007fff640 0 client.4923 ms_handle_reset on v2:172.21.15.77:6836/3454203695 2024-04-25T01:39:53.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.948+0000 7f4032279740 1 --2- 172.21.15.77:0/2983114131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55765263bd10 0x557652607970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.948+0000 7f4032279740 1 --2- 172.21.15.77:0/2983114131 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55765260d510 0x557652628280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.948+0000 7f4032279740 1 -- 172.21.15.77:0/2983114131 >> 172.21.15.77:0/2983114131 conn(0x5576525ec8e0 msgr2=0x55765260ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:53.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.948+0000 7f4032279740 1 -- 172.21.15.77:0/2983114131 shutdown_connections 2024-04-25T01:39:53.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.948+0000 7f4032279740 1 -- 172.21.15.77:0/2983114131 wait complete. 2024-04-25T01:39:53.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.948+0000 7f4032279740 20 client.4923 trim_cache size 0 max 16384 2024-04-25T01:39:53.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.966+0000 7f4032279740 1 Processor -- start 2024-04-25T01:39:53.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.966+0000 7f4032279740 1 -- start start 2024-04-25T01:39:53.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.966+0000 7f4032279740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55765260d510 0x5576525ea2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:53.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.966+0000 7f4032279740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557652629ad0 0x557652699920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:53.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.966+0000 7f4032279740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576525e7800 0x557652699e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:53.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.966+0000 7f4032279740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f40281fb4a0 con 0x557652629ad0 2024-04-25T01:39:53.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.966+0000 7f4032279740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f40281f8f00 con 0x5576525e7800 2024-04-25T01:39:53.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.966+0000 7f4032279740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f40281f9550 con 0x55765260d510 2024-04-25T01:39:53.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.967+0000 7f402cafe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557652629ad0 0x557652699920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:53.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.967+0000 7f402cafe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557652629ad0 0x557652699920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45208/0 (socket says 172.21.15.77:45208) 2024-04-25T01:39:53.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.967+0000 7f402cafe640 1 -- 172.21.15.77:0/2167082451 learned_addr learned my addr 172.21.15.77:0/2167082451 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:53.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.967+0000 7f402cafe640 1 -- 172.21.15.77:0/2167082451 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55765260d510 msgr2=0x5576525ea2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:53.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.967+0000 7f402cafe640 1 --2- 172.21.15.77:0/2167082451 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55765260d510 0x5576525ea2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.967+0000 7f402cafe640 1 -- 172.21.15.77:0/2167082451 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576525e7800 msgr2=0x557652699e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:53.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.967+0000 7f402cafe640 1 --2- 172.21.15.77:0/2167082451 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576525e7800 0x557652699e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.967+0000 7f402cafe640 1 -- 172.21.15.77:0/2167082451 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55765262aee0 con 0x557652629ad0 2024-04-25T01:39:53.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.967+0000 7f402cafe640 1 --2- 172.21.15.77:0/2167082451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557652629ad0 0x557652699920 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4018013ba0 tx=0x7f4018016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5197e9ced28fdd21 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:53.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.967+0000 7f40127fc640 1 -- 172.21.15.77:0/2167082451 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401802c040 con 0x557652629ad0 2024-04-25T01:39:53.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.967+0000 7f40127fc640 1 -- 172.21.15.77:0/2167082451 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4018022070 con 0x557652629ad0 2024-04-25T01:39:53.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.967+0000 7f40127fc640 1 -- 172.21.15.77:0/2167082451 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40180308f0 con 0x557652629ad0 2024-04-25T01:39:53.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.967+0000 7f4032279740 1 -- 172.21.15.77:0/2167082451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557652629ad0 msgr2=0x557652699920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:53.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.967+0000 7f4032279740 1 --2- 172.21.15.77:0/2167082451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557652629ad0 0x557652699920 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4018013ba0 tx=0x7f4018016000 comp rx=0 tx=0).stop 2024-04-25T01:39:53.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.968+0000 7f4032279740 1 -- 172.21.15.77:0/2167082451 shutdown_connections 2024-04-25T01:39:53.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.968+0000 7f4032279740 1 --2- 172.21.15.77:0/2167082451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557652629ad0 0x557652699920 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.968+0000 7f4032279740 1 --2- 172.21.15.77:0/2167082451 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576525e7800 0x557652699e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.968+0000 7f4032279740 1 --2- 172.21.15.77:0/2167082451 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55765260d510 0x5576525ea2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.968+0000 7f4032279740 1 -- 172.21.15.77:0/2167082451 >> 172.21.15.77:0/2167082451 conn(0x5576525ec8e0 msgr2=0x5576526282e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:53.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.968+0000 7f4032279740 1 -- 172.21.15.77:0/2167082451 shutdown_connections 2024-04-25T01:39:53.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.968+0000 7f4032279740 1 -- 172.21.15.77:0/2167082451 wait complete. 2024-04-25T01:39:53.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.968+0000 7f4032279740 1 -- start start 2024-04-25T01:39:53.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.968+0000 7f4032279740 1 Processor -- start 2024-04-25T01:39:53.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.969+0000 7f4032279740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576525e7800 0x55765260c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:53.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.969+0000 7f4032279740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55765260d510 0x55765263fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:53.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.969+0000 7f4032279740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557652629ad0 0x557652698aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:53.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.969+0000 7f4032279740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5576526384f0 con 0x557652629ad0 2024-04-25T01:39:53.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.969+0000 7f4032279740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55765261f490 con 0x5576525e7800 2024-04-25T01:39:53.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.969+0000 7f4032279740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x5576525e97b0 con 0x55765260d510 2024-04-25T01:39:53.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.969+0000 7f4032279740 10 client.0 _ll_register_callbacks cb 0x7f401800c9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T01:39:53.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.969+0000 7f402db00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557652629ad0 0x557652698aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:53.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.969+0000 7f402db00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557652629ad0 0x557652698aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45214/0 (socket says 172.21.15.77:45214) 2024-04-25T01:39:53.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.969+0000 7f402db00640 1 -- 172.21.15.77:0/2886736306 learned_addr learned my addr 172.21.15.77:0/2886736306 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:53.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.969+0000 7f402cafe640 1 --2- 172.21.15.77:0/2886736306 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55765260d510 0x55765263fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:53.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.969+0000 7f402d2ff640 1 --2- 172.21.15.77:0/2886736306 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576525e7800 0x55765260c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:53.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.969+0000 7f402db00640 1 -- 172.21.15.77:0/2886736306 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55765260d510 msgr2=0x55765263fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:53.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.969+0000 7f402db00640 1 --2- 172.21.15.77:0/2886736306 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55765260d510 0x55765263fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.969+0000 7f402db00640 1 -- 172.21.15.77:0/2886736306 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576525e7800 msgr2=0x55765260c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.969+0000 7f402db00640 1 --2- 172.21.15.77:0/2886736306 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576525e7800 0x55765260c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.969+0000 7f402db00640 1 -- 172.21.15.77:0/2886736306 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55765261e390 con 0x557652629ad0 2024-04-25T01:39:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.969+0000 7f402d2ff640 1 --2- 172.21.15.77:0/2886736306 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576525e7800 0x55765260c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.969+0000 7f402db00640 1 --2- 172.21.15.77:0/2886736306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557652629ad0 0x557652698aa0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f40200098c0 tx=0x7f4020032530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f26f9bcf31d5d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.969+0000 7f4007fff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-04-25T01:39:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.970+0000 7f4007fff640 1 -- 172.21.15.77:0/2886736306 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4020040020 con 0x557652629ad0 2024-04-25T01:39:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.970+0000 7f4007fff640 1 -- 172.21.15.77:0/2886736306 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f4020032b70 con 0x557652629ad0 2024-04-25T01:39:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.970+0000 7f4032279740 1 -- 172.21.15.77:0/2886736306 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4018022070 con 0x557652629ad0 2024-04-25T01:39:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.970+0000 7f4007fff640 1 -- 172.21.15.77:0/2886736306 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7f402004a050 con 0x557652629ad0 2024-04-25T01:39:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.970+0000 7f4032279740 10 client.4929 fetch_fsmap learned FSMap version 12 2024-04-25T01:39:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.970+0000 7f4032279740 1 -- 172.21.15.77:0/2886736306 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) -- 0x55765260b750 con 0x557652629ad0 2024-04-25T01:39:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.970+0000 7f4007fff640 1 -- 172.21.15.77:0/2886736306 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4018022070 con 0x557652629ad0 2024-04-25T01:39:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.970+0000 7f4007fff640 1 -- 172.21.15.77:0/2886736306 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 12) ==== 4128+0+0 (secure 0 0 0) 0x7f402004d020 con 0x557652629ad0 2024-04-25T01:39:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.970+0000 7f4032279740 10 client.4929 fetch_fsmap finished waiting for FSMap version 12 2024-04-25T01:39:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.970+0000 7f4032279740 10 client.4929 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T01:39:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.970+0000 7f4032279740 20 client.4929 populate_metadata read hostname 'smithi077' 2024-04-25T01:39:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.970+0000 7f4032279740 1 --2- 172.21.15.77:0/2886736306 >> [v2:172.21.15.77:6836/3454203695,v1:172.21.15.77:6837/3454203695] conn(0x55765262b250 0x55765262b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.970+0000 7f4032279740 4 client.4929 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T01:39:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.970+0000 7f4032279740 1 -- 172.21.15.77:0/2886736306 --> [v2:172.21.15.77:6836/3454203695,v1:172.21.15.77:6837/3454203695] -- command(tid 0: {"prefix": "status"}) -- 0x557652556790 con 0x55765262b250 2024-04-25T01:39:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.970+0000 7f402d2ff640 1 --2- 172.21.15.77:0/2886736306 >> [v2:172.21.15.77:6836/3454203695,v1:172.21.15.77:6837/3454203695] conn(0x55765262b250 0x55765262b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.970+0000 7f4007fff640 10 client.4929 ms_handle_connect on v2:172.21.15.77:6836/3454203695 2024-04-25T01:39:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.970+0000 7f402d2ff640 1 --2- 172.21.15.77:0/2886736306 >> [v2:172.21.15.77:6836/3454203695,v1:172.21.15.77:6837/3454203695] conn(0x55765262b250 0x55765262b630 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cabf4d327fd0888e server_cookie=bc7d569b9f8faba1 in_seq=0 out_seq=0 2024-04-25T01:39:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.971+0000 7f4007fff640 1 -- 172.21.15.77:0/2886736306 <== mds.0 v2:172.21.15.77:6836/3454203695 1 ==== command_reply(tid 0: 0 ) ==== 8+0+320 (crc 0 0 0) 0x557652556790 con 0x55765262b250 2024-04-25T01:39:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.971+0000 7f4007fff640 10 client.4929 handle_command_reply: tid=0 2024-04-25T01:39:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.971+0000 7f4032279740 1 client.4929 shutdown 2024-04-25T01:39:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.971+0000 7f4032279740 1 -- 172.21.15.77:0/2886736306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557652629ad0 msgr2=0x557652698aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.971+0000 7f4032279740 1 --2- 172.21.15.77:0/2886736306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557652629ad0 0x557652698aa0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f40200098c0 tx=0x7f4020032530 comp rx=0 tx=0).stop 2024-04-25T01:39:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.971+0000 7f4032279740 1 -- 172.21.15.77:0/2886736306 shutdown_connections 2024-04-25T01:39:53.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.971+0000 7f4032279740 1 --2- 172.21.15.77:0/2886736306 >> [v2:172.21.15.77:6836/3454203695,v1:172.21.15.77:6837/3454203695] conn(0x55765262b250 0x55765262b630 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.971+0000 7f4032279740 1 --2- 172.21.15.77:0/2886736306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557652629ad0 0x557652698aa0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.971+0000 7f4032279740 1 --2- 172.21.15.77:0/2886736306 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55765260d510 0x55765263fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.971+0000 7f4007fff640 0 client.4929 ms_handle_reset on v2:172.21.15.77:6836/3454203695 2024-04-25T01:39:53.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.971+0000 7f4032279740 1 --2- 172.21.15.77:0/2886736306 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576525e7800 0x55765260c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.971+0000 7f4032279740 1 -- 172.21.15.77:0/2886736306 >> 172.21.15.77:0/2886736306 conn(0x5576525ec8e0 msgr2=0x5576526413f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:53.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.971+0000 7f4032279740 1 -- 172.21.15.77:0/2886736306 shutdown_connections 2024-04-25T01:39:53.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.971+0000 7f4032279740 1 -- 172.21.15.77:0/2886736306 wait complete. 2024-04-25T01:39:53.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.971+0000 7f4032279740 20 client.4929 trim_cache size 0 max 16384 2024-04-25T01:39:53.961 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T01:39:53.961 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "70f1c0d7-4e08-4883-a8bd-1451a32d9af1", 2024-04-25T01:39:53.962 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2024-04-25T01:39:53.962 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 4278, 2024-04-25T01:39:53.962 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2024-04-25T01:39:53.962 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2024-04-25T01:39:53.962 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "b", 2024-04-25T01:39:53.962 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 20.558359604, 2024-04-25T01:39:53.962 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 12, 2024-04-25T01:39:53.962 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 24, 2024-04-25T01:39:53.962 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 24, 2024-04-25T01:39:53.962 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 36.764394686999999 2024-04-25T01:39:53.962 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T01:39:53.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.971+0000 7f402f563640 1 -- 172.21.15.77:0/1690373503 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f400c06be30 msgr2=0x7f400c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:53.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.971+0000 7f402f563640 1 --2- 172.21.15.77:0/1690373503 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f400c06be30 0x7f400c06e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4018006fd0 tx=0x7f4018008040 comp rx=0 tx=0).stop 2024-04-25T01:39:53.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.971+0000 7f402f563640 1 -- 172.21.15.77:0/1690373503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4028072820 msgr2=0x7f40281eeee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:53.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.971+0000 7f402f563640 1 --2- 172.21.15.77:0/1690373503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4028072820 0x7f40281eeee0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f402400c7c0 tx=0x7f402400cc80 comp rx=0 tx=0).stop 2024-04-25T01:39:53.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.972+0000 7f402f563640 1 -- 172.21.15.77:0/1690373503 shutdown_connections 2024-04-25T01:39:53.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.972+0000 7f402f563640 1 --2- 172.21.15.77:0/1690373503 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f400c06be30 0x7f400c06e2f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.972+0000 7f402f563640 1 --2- 172.21.15.77:0/1690373503 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4028153820 0x7f402814bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.972+0000 7f402f563640 1 --2- 172.21.15.77:0/1690373503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40280c2be0 0x7f40281ef420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.972+0000 7f402f563640 1 --2- 172.21.15.77:0/1690373503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4028072820 0x7f40281eeee0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:53.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.972+0000 7f402f563640 1 -- 172.21.15.77:0/1690373503 >> 172.21.15.77:0/1690373503 conn(0x7f4028067780 msgr2=0x7f40280c7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:53.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.972+0000 7f402f563640 1 -- 172.21.15.77:0/1690373503 shutdown_connections 2024-04-25T01:39:53.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:53.972+0000 7f402f563640 1 -- 172.21.15.77:0/1690373503 wait complete. 2024-04-25T01:39:53.966 INFO:teuthology.run_tasks:Running task sequential... 2024-04-25T01:39:53.975 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-25T01:39:53.975 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-25T01:39:53.976 INFO:teuthology.task.print:Enabling mgr modules 2024-04-25T01:39:53.976 INFO:teuthology.run_tasks:Running task kclient... 2024-04-25T01:39:53.998 INFO:tasks.kclient:Mounting kernel clients... 2024-04-25T01:39:53.998 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-04-25T01:39:53.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T01:39:53.998 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2024-04-25T01:39:54.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T01:39:54.014 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link delete ceph-brx 2024-04-25T01:39:54.079 INFO:teuthology.orchestra.run.smithi077.stderr:Cannot find device "ceph-brx" 2024-04-25T01:39:54.080 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T01:39:54.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T01:39:54.080 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-04-25T01:39:54.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T01:39:54.099 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link delete ceph-brx 2024-04-25T01:39:54.170 INFO:teuthology.orchestra.run.smithi121.stderr:Cannot find device "ceph-brx" 2024-04-25T01:39:54.171 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T01:39:54.172 INFO:tasks.kclient:client.0 config is {'syntax': 'v1', 'cephfs_name': 'a'} 2024-04-25T01:39:54.172 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T01:39:54.172 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T01:39:54.172 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T01:39:54.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.286+0000 7f2ed7763640 1 Processor -- start 2024-04-25T01:39:54.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.287+0000 7f2ed7763640 1 -- start start 2024-04-25T01:39:54.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.287+0000 7f2ed7763640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2ed0150090 0x7f2ed0156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:54.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.287+0000 7f2ed7763640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2ed006c280 0x7f2ed00c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:54.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.287+0000 7f2ed7763640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ed00c89c0 con 0x7f2ed00c8200 2024-04-25T01:39:54.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.287+0000 7f2ed7763640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f2ed006b830 con 0x7f2ed0150090 2024-04-25T01:39:54.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.287+0000 7f2ed7763640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f2ed00c8ca0 con 0x7f2ed006c280 2024-04-25T01:39:54.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.287+0000 7f2ed54ff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2ed0150090 0x7f2ed0156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:54.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.287+0000 7f2ed54ff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2ed0150090 0x7f2ed0156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45218/0 (socket says 172.21.15.77:45218) 2024-04-25T01:39:54.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.287+0000 7f2ed54ff640 1 -- 172.21.15.77:0/3514563543 learned_addr learned my addr 172.21.15.77:0/3514563543 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:54.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.288+0000 7f2ed5d00640 1 --2- 172.21.15.77:0/3514563543 >> v2:172.21.15.121:3300/0 conn(0x7f2ed006c280 0x7f2ed00c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:54.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.288+0000 7f2ed54ff640 1 -- 172.21.15.77:0/3514563543 >> v2:172.21.15.121:3300/0 conn(0x7f2ed006c280 msgr2=0x7f2ed00c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:54.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.288+0000 7f2ed54ff640 1 --2- 172.21.15.77:0/3514563543 >> v2:172.21.15.121:3300/0 conn(0x7f2ed006c280 0x7f2ed00c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:54.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.288+0000 7f2ed54ff640 1 -- 172.21.15.77:0/3514563543 >> v1:172.21.15.121:6789/0 conn(0x7f2ed00c8200 legacy=0x7f2ed00c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:54.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.288+0000 7f2ed54ff640 1 -- 172.21.15.77:0/3514563543 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ed006ba80 con 0x7f2ed0150090 2024-04-25T01:39:54.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.288+0000 7f2ed54ff640 1 --2- 172.21.15.77:0/3514563543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ed0150090 0x7f2ed0156c80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00cb860 tx=0x7f2ec802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=292469e206b5eed4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:54.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.289+0000 7f2ec7fff640 1 -- 172.21.15.77:0/3514563543 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8036070 con 0x7f2ed0150090 2024-04-25T01:39:54.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.289+0000 7f2ec7fff640 1 -- 172.21.15.77:0/3514563543 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ec8031600 con 0x7f2ed0150090 2024-04-25T01:39:54.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.289+0000 7f2ec7fff640 1 -- 172.21.15.77:0/3514563543 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec80319d0 con 0x7f2ed0150090 2024-04-25T01:39:54.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.289+0000 7f2ed7763640 1 -- 172.21.15.77:0/3514563543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ed0150090 msgr2=0x7f2ed0156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:54.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.289+0000 7f2ed7763640 1 --2- 172.21.15.77:0/3514563543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ed0150090 0x7f2ed0156c80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00cb860 tx=0x7f2ec802a730 comp rx=0 tx=0).stop 2024-04-25T01:39:54.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.289+0000 7f2ed7763640 1 -- 172.21.15.77:0/3514563543 shutdown_connections 2024-04-25T01:39:54.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.289+0000 7f2ed7763640 1 --2- 172.21.15.77:0/3514563543 >> v2:172.21.15.121:3300/0 conn(0x7f2ed006c280 0x7f2ed00c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:54.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.289+0000 7f2ed7763640 1 --2- 172.21.15.77:0/3514563543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ed0150090 0x7f2ed0156c80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:54.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.289+0000 7f2ed7763640 1 -- 172.21.15.77:0/3514563543 >> 172.21.15.77:0/3514563543 conn(0x7f2ed00ad4d0 msgr2=0x7f2ed00ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:54.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.289+0000 7f2ed7763640 1 -- 172.21.15.77:0/3514563543 shutdown_connections 2024-04-25T01:39:54.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.289+0000 7f2ed7763640 1 -- 172.21.15.77:0/3514563543 wait complete. 2024-04-25T01:39:54.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.290+0000 7f2ed7763640 1 Processor -- start 2024-04-25T01:39:54.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.290+0000 7f2ed7763640 1 -- start start 2024-04-25T01:39:54.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.291+0000 7f2ed7763640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ed006c280 0x7f2ed00bf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:54.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.291+0000 7f2ed7763640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2ed00c8200 0x7f2ed01ec350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:54.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.291+0000 7f2ed7763640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ed0150090 0x7f2ed0149740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:54.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.291+0000 7f2ed7763640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed006c690 con 0x7f2ed006c280 2024-04-25T01:39:54.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.291+0000 7f2ed7763640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed00c86b0 con 0x7f2ed0150090 2024-04-25T01:39:54.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.291+0000 7f2ed7763640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f2ed006c810 con 0x7f2ed00c8200 2024-04-25T01:39:54.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.291+0000 7f2ed54ff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ed006c280 0x7f2ed00bf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:54.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.291+0000 7f2ed54ff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ed006c280 0x7f2ed00bf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45222/0 (socket says 172.21.15.77:45222) 2024-04-25T01:39:54.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.291+0000 7f2ed54ff640 1 -- 172.21.15.77:0/4282501723 learned_addr learned my addr 172.21.15.77:0/4282501723 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:54.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.291+0000 7f2ed5d00640 1 --2- 172.21.15.77:0/4282501723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ed0150090 0x7f2ed0149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:54.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.291+0000 7f2ed4cfe640 1 --2- 172.21.15.77:0/4282501723 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2ed00c8200 0x7f2ed01ec350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:54.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.291+0000 7f2ed54ff640 1 -- 172.21.15.77:0/4282501723 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2ed00c8200 msgr2=0x7f2ed01ec350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:54.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.291+0000 7f2ed54ff640 1 --2- 172.21.15.77:0/4282501723 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2ed00c8200 0x7f2ed01ec350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:54.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.291+0000 7f2ed54ff640 1 -- 172.21.15.77:0/4282501723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ed0150090 msgr2=0x7f2ed0149740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:54.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.291+0000 7f2ed54ff640 1 --2- 172.21.15.77:0/4282501723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ed0150090 0x7f2ed0149740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:54.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.291+0000 7f2ed54ff640 1 -- 172.21.15.77:0/4282501723 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ed00bfa10 con 0x7f2ed006c280 2024-04-25T01:39:54.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.291+0000 7f2ed54ff640 1 --2- 172.21.15.77:0/4282501723 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ed006c280 0x7f2ed00bf4d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8034040 tx=0x7f2ec8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:54.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.291+0000 7f2ec5ffb640 1 -- 172.21.15.77:0/4282501723 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8036050 con 0x7f2ed006c280 2024-04-25T01:39:54.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.291+0000 7f2ec5ffb640 1 -- 172.21.15.77:0/4282501723 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ec8042070 con 0x7f2ed006c280 2024-04-25T01:39:54.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.291+0000 7f2ed7763640 1 -- 172.21.15.77:0/4282501723 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ed01ef950 con 0x7f2ed006c280 2024-04-25T01:39:54.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.291+0000 7f2ec5ffb640 1 -- 172.21.15.77:0/4282501723 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8009510 con 0x7f2ed006c280 2024-04-25T01:39:54.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.292+0000 7f2ed7763640 1 -- 172.21.15.77:0/4282501723 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ed01efbd0 con 0x7f2ed006c280 2024-04-25T01:39:54.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.293+0000 7f2ed7763640 1 -- 172.21.15.77:0/4282501723 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ed004f500 con 0x7f2ed006c280 2024-04-25T01:39:54.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.293+0000 7f2ec5ffb640 1 -- 172.21.15.77:0/4282501723 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2ec8007c50 con 0x7f2ed006c280 2024-04-25T01:39:54.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.293+0000 7f2ec5ffb640 1 --2- 172.21.15.77:0/4282501723 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2eb406be60 0x7f2eb406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:54.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.293+0000 7f2ec5ffb640 1 -- 172.21.15.77:0/4282501723 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f2ec80abf90 con 0x7f2ed006c280 2024-04-25T01:39:54.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.293+0000 7f2ed4cfe640 1 --2- 172.21.15.77:0/4282501723 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2eb406be60 0x7f2eb406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:54.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.294+0000 7f2ed4cfe640 1 --2- 172.21.15.77:0/4282501723 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2eb406be60 0x7f2eb406e320 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0155f10 tx=0x7f2ec0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:54.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.298+0000 7f2ec5ffb640 1 -- 172.21.15.77:0/4282501723 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2ed01ef950 con 0x7f2ed006c280 2024-04-25T01:39:54.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.507+0000 7f2ed7763640 1 -- 172.21.15.77:0/4282501723 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2ed006cec0 con 0x7f2ed006c280 2024-04-25T01:39:54.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.507+0000 7f2ec5ffb640 1 -- 172.21.15.77:0/4282501723 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) ==== 53+0+116 (secure 0 0 0) 0x7f2ec807a6a0 con 0x7f2ed006c280 2024-04-25T01:39:54.491 INFO:teuthology.orchestra.run.smithi077.stdout:name: a, metadata pool: a_metadata, data pools: [a_data ] 2024-04-25T01:39:54.491 INFO:teuthology.orchestra.run.smithi077.stdout:name: b, metadata pool: b_metadata, data pools: [b_data ] 2024-04-25T01:39:54.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.509+0000 7f2ed7763640 1 -- 172.21.15.77:0/4282501723 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2eb406be60 msgr2=0x7f2eb406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:54.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.509+0000 7f2ed7763640 1 --2- 172.21.15.77:0/4282501723 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2eb406be60 0x7f2eb406e320 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0155f10 tx=0x7f2ec0009040 comp rx=0 tx=0).stop 2024-04-25T01:39:54.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.509+0000 7f2ed7763640 1 -- 172.21.15.77:0/4282501723 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ed006c280 msgr2=0x7f2ed00bf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:54.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.509+0000 7f2ed7763640 1 --2- 172.21.15.77:0/4282501723 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ed006c280 0x7f2ed00bf4d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8034040 tx=0x7f2ec8004a40 comp rx=0 tx=0).stop 2024-04-25T01:39:54.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.509+0000 7f2ed7763640 1 -- 172.21.15.77:0/4282501723 shutdown_connections 2024-04-25T01:39:54.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.509+0000 7f2ed7763640 1 --2- 172.21.15.77:0/4282501723 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2eb406be60 0x7f2eb406e320 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:54.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.509+0000 7f2ed7763640 1 --2- 172.21.15.77:0/4282501723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ed0150090 0x7f2ed0149740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:54.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.509+0000 7f2ed7763640 1 --2- 172.21.15.77:0/4282501723 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2ed00c8200 0x7f2ed01ec350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:54.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.509+0000 7f2ed7763640 1 --2- 172.21.15.77:0/4282501723 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ed006c280 0x7f2ed00bf4d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:54.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.509+0000 7f2ed7763640 1 -- 172.21.15.77:0/4282501723 >> 172.21.15.77:0/4282501723 conn(0x7f2ed00ad4d0 msgr2=0x7f2ed0154610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:54.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.509+0000 7f2ed7763640 1 -- 172.21.15.77:0/4282501723 shutdown_connections 2024-04-25T01:39:54.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54.509+0000 7f2ed7763640 1 -- 172.21.15.77:0/4282501723 wait complete. 2024-04-25T01:39:54.504 INFO:tasks.cephfs.mount:Mounting Ceph FS a; just confirmed its presence on cluster 2024-04-25T01:39:54.504 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T01:39:54.504 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2024-04-25T01:39:54.504 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T01:39:54.504 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T01:39:54.504 INFO:tasks.cephfs.mount:self.cephfs_name = a 2024-04-25T01:39:54.504 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T01:39:54.505 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T01:39:54.505 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T01:39:54.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T01:39:54.505 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2024-04-25T01:39:54.520 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T01:39:54.520 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T01:39:54.520 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T01:39:54.520 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-04-25T01:39:54.520 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2024-04-25T01:39:54.520 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-04-25T01:39:54.520 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T01:39:54.520 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2024-04-25T01:39:54.520 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2024-04-25T01:39:54.520 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T01:39:54.521 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2024-04-25T01:39:54.521 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2024-04-25T01:39:54.521 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T01:39:54.521 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2024-04-25T01:39:54.521 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T01:39:54.521 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2024-04-25T01:39:54.521 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T01:39:54.521 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42585sec preferred_lft 42585sec 2024-04-25T01:39:54.521 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::699f:a26c:e69b:d16f/64 scope link noprefixroute 2024-04-25T01:39:54.521 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-04-25T01:39:54.522 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T01:39:54.522 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T01:39:54.522 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-04-25T01:39:54.522 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add name ceph-brx type bridge 2024-04-25T01:39:54.522 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr flush dev ceph-brx 2024-04-25T01:39:54.522 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set ceph-brx up 2024-04-25T01:39:54.522 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T01:39:54.522 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-04-25T01:39:54.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T01:39:54.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T01:39:54.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T01:39:54.695 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T01:39:54.718 INFO:teuthology.orchestra.run.smithi077.stdout:1 2024-04-25T01:39:54.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T01:39:54.719 DEBUG:teuthology.orchestra.run.smithi077:> route 2024-04-25T01:39:54.793 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2024-04-25T01:39:54.793 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T01:39:54.793 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T01:39:54.793 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T01:39:54.793 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T01:39:54.794 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T01:39:54.794 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-04-25T01:39:54.794 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T01:39:54.794 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T01:39:54.794 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T01:39:54.794 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-04-25T01:39:54.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T01:39:55.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T01:39:55.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T01:39:55.043 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2024-04-25T01:39:55.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T01:39:55.059 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list-id 2024-04-25T01:39:55.113 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T01:39:55.113 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-04-25T01:39:55.113 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T01:39:55.113 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T01:39:55.113 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-04-25T01:39:55.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T01:39:55.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T01:39:55.228 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T01:39:55.228 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T01:39:55.228 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-04-25T01:39:55.228 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T01:39:55.228 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T01:39:55.228 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T01:39:55.228 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T01:39:55.228 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T01:39:55.229 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-04-25T01:39:55.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T01:39:55.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T01:39:55.349 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T01:39:55.349 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-04-25T01:39:55.349 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2024-04-25T01:39:55.349 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T01:39:55.350 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-04-25T01:39:55.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T01:39:55.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T01:39:55.423 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T01:39:55.424 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T01:39:55.438 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T01:39:55.438 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T01:39:55.439 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T01:39:55.493 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T01:39:55.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T01:39:55.493 DEBUG:teuthology.orchestra.run.smithi077:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=a 2024-04-25T01:39:55.581 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=a 2024-04-25T01:39:55.582 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=a". 2024-04-25T01:39:55.582 INFO:teuthology.orchestra.run.smithi077.stdout:invalid new device string format 2024-04-25T01:39:55.683 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=a 2024-04-25T01:39:55.683 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=a". 2024-04-25T01:39:55.683 INFO:teuthology.orchestra.run.smithi077.stdout:invalid new device string format 2024-04-25T01:39:55.683 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.121:3300,172.21.15.121:3301" 2024-04-25T01:39:55.683 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T01:39:55.689 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=a 2024-04-25T01:39:55.689 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=a". 2024-04-25T01:39:55.689 INFO:teuthology.orchestra.run.smithi077.stdout:invalid new device string format 2024-04-25T01:39:55.689 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.121:3300,172.21.15.121:3301" 2024-04-25T01:39:55.689 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T01:39:55.689 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: resolved to: "172.21.15.77:6789,172.21.15.121:6789,172.21.15.121:6790" 2024-04-25T01:39:55.689 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.77:6789,172.21.15.121:6789,172.21.15.121:6790:/ 2024-04-25T01:39:55.689 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=a,key=0,fsid=70f1c0d7-4e08-4883-a8bd-1451a32d9af1" will pass to kernel 2024-04-25T01:39:55.690 INFO:teuthology.orchestra.run.smithi077.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T01:39:55.690 INFO:teuthology.orchestra.run.smithi077.stdout: You just mounted a file system that supports labels which does not 2024-04-25T01:39:55.690 INFO:teuthology.orchestra.run.smithi077.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T01:39:55.690 INFO:teuthology.orchestra.run.smithi077.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T01:39:55.690 INFO:teuthology.orchestra.run.smithi077.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T01:39:55.692 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T01:39:55.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T01:39:55.692 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T01:39:55.716 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T01:39:55.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T01:39:55.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T01:39:55.818 INFO:teuthology.orchestra.run.smithi077.stdout:client4777 2024-04-25T01:39:55.819 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:39:55.819 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T01:39:55.834 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T01:39:55.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T01:39:55.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T01:39:55.935 INFO:teuthology.orchestra.run.smithi077.stdout:client4777 2024-04-25T01:39:55.936 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T01:39:55.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T01:39:55.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T01:39:55.996 INFO:teuthology.orchestra.run.smithi077.stdout:client4777 2024-04-25T01:39:55.997 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/70f1c0d7-4e08-4883-a8bd-1451a32d9af1.client4777/status') 2024-04-25T01:39:56.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T01:39:56.058 INFO:teuthology.orchestra.run.smithi077.stdout:instance: client.4777 (3)172.21.15.77:0/3758141429 2024-04-25T01:39:56.058 INFO:teuthology.orchestra.run.smithi077.stdout:blocklisted: false 2024-04-25T01:39:56.058 INFO:teuthology.orchestra.run.smithi077.stderr:0+1 records in 2024-04-25T01:39:56.058 INFO:teuthology.orchestra.run.smithi077.stderr:0+1 records out 2024-04-25T01:39:56.058 INFO:teuthology.orchestra.run.smithi077.stderr:70 bytes copied, 2.1297e-05 s, 3.3 MB/s 2024-04-25T01:39:56.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T01:39:56.065 INFO:tasks.kclient:client.1 config is {'syntax': 'v1', 'cephfs_name': 'b'} 2024-04-25T01:39:56.065 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T01:39:56.065 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T01:39:56.065 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T01:39:56.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.178+0000 7ff02481c640 1 Processor -- start 2024-04-25T01:39:56.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.178+0000 7ff02481c640 1 -- start start 2024-04-25T01:39:56.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.179+0000 7ff02481c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff0200ac840 0x7ff0200acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:56.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.179+0000 7ff02481c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff0201558f0 0x7ff02015e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:56.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.179+0000 7ff02481c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff020155d60 con 0x7ff020153cf0 2024-04-25T01:39:56.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.179+0000 7ff02481c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff020151780 con 0x7ff0200ac840 2024-04-25T01:39:56.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.179+0000 7ff02481c640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7ff02006d0a0 con 0x7ff0201558f0 2024-04-25T01:39:56.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.179+0000 7ff01e59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff0200ac840 0x7ff0200acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:56.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.179+0000 7ff017fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff020153cf0 0x7ff0201551e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:38012/0 (socket says 172.21.15.77:38012) 2024-04-25T01:39:56.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.179+0000 7ff017fff640 1 -- 172.21.15.77:0/3978150834 learned_addr learned my addr 172.21.15.77:0/3978150834 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:56.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.179+0000 7ff01ed9d640 1 --2- 172.21.15.77:0/3978150834 >> v2:172.21.15.121:3300/0 conn(0x7ff0201558f0 0x7ff02015e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:56.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.179+0000 7ff01e59c640 1 -- 172.21.15.77:0/3978150834 >> v2:172.21.15.121:3300/0 conn(0x7ff0201558f0 msgr2=0x7ff02015e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:56.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.179+0000 7ff01e59c640 1 --2- 172.21.15.77:0/3978150834 >> v2:172.21.15.121:3300/0 conn(0x7ff0201558f0 0x7ff02015e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:56.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.179+0000 7ff01e59c640 1 -- 172.21.15.77:0/3978150834 >> v1:172.21.15.77:6789/0 conn(0x7ff020153cf0 legacy=0x7ff0201551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:56.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.179+0000 7ff01e59c640 1 -- 172.21.15.77:0/3978150834 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff02006b480 con 0x7ff0200ac840 2024-04-25T01:39:56.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.180+0000 7ff01e59c640 1 --2- 172.21.15.77:0/3978150834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0200ac840 0x7ff0200acc20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff020070c10 tx=0x7ff01002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4b99b5e182ab954 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:56.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.180+0000 7ff01dd9b640 1 -- 172.21.15.77:0/3978150834 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff010037070 con 0x7ff0200ac840 2024-04-25T01:39:56.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.180+0000 7ff01dd9b640 1 -- 172.21.15.77:0/3978150834 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff010032440 con 0x7ff0200ac840 2024-04-25T01:39:56.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.180+0000 7ff01dd9b640 1 -- 172.21.15.77:0/3978150834 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01002ae60 con 0x7ff0200ac840 2024-04-25T01:39:56.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.180+0000 7ff02481c640 1 -- 172.21.15.77:0/3978150834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0200ac840 msgr2=0x7ff0200acc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:56.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.180+0000 7ff02481c640 1 --2- 172.21.15.77:0/3978150834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0200ac840 0x7ff0200acc20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff020070c10 tx=0x7ff01002a110 comp rx=0 tx=0).stop 2024-04-25T01:39:56.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.180+0000 7ff02481c640 1 -- 172.21.15.77:0/3978150834 shutdown_connections 2024-04-25T01:39:56.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.180+0000 7ff02481c640 1 --2- 172.21.15.77:0/3978150834 >> v2:172.21.15.121:3300/0 conn(0x7ff0201558f0 0x7ff02015e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:56.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.180+0000 7ff02481c640 1 --2- 172.21.15.77:0/3978150834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0200ac840 0x7ff0200acc20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:56.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.180+0000 7ff02481c640 1 -- 172.21.15.77:0/3978150834 >> 172.21.15.77:0/3978150834 conn(0x7ff0200c3f80 msgr2=0x7ff0200c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:56.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.180+0000 7ff02481c640 1 -- 172.21.15.77:0/3978150834 shutdown_connections 2024-04-25T01:39:56.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.180+0000 7ff02481c640 1 -- 172.21.15.77:0/3978150834 wait complete. 2024-04-25T01:39:56.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.182+0000 7ff02481c640 1 Processor -- start 2024-04-25T01:39:56.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.182+0000 7ff02481c640 1 -- start start 2024-04-25T01:39:56.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.182+0000 7ff02481c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff0200ac840 0x7ff0201ef5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:56.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.182+0000 7ff02481c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff020153cf0 0x7ff0201453c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:56.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.182+0000 7ff02481c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0201558f0 0x7ff0201421f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:56.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.182+0000 7ff02481c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff02006d5d0 con 0x7ff020153cf0 2024-04-25T01:39:56.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.182+0000 7ff02481c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff02006dc20 con 0x7ff0201558f0 2024-04-25T01:39:56.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.182+0000 7ff02481c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff02006d8b0 con 0x7ff0200ac840 2024-04-25T01:39:56.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.183+0000 7ff017fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff020153cf0 0x7ff0201453c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:56.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.183+0000 7ff017fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff020153cf0 0x7ff0201453c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45250/0 (socket says 172.21.15.77:45250) 2024-04-25T01:39:56.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.183+0000 7ff017fff640 1 -- 172.21.15.77:0/1283650357 learned_addr learned my addr 172.21.15.77:0/1283650357 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:56.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.183+0000 7ff01ed9d640 1 --2- 172.21.15.77:0/1283650357 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0201558f0 0x7ff0201421f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:56.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.183+0000 7ff01e59c640 1 --2- 172.21.15.77:0/1283650357 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff0200ac840 0x7ff0201ef5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:56.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.183+0000 7ff017fff640 1 -- 172.21.15.77:0/1283650357 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff0200ac840 msgr2=0x7ff0201ef5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:56.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.183+0000 7ff017fff640 1 --2- 172.21.15.77:0/1283650357 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff0200ac840 0x7ff0201ef5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:56.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.183+0000 7ff017fff640 1 -- 172.21.15.77:0/1283650357 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0201558f0 msgr2=0x7ff0201421f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:56.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.183+0000 7ff017fff640 1 --2- 172.21.15.77:0/1283650357 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0201558f0 0x7ff0201421f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:56.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.183+0000 7ff017fff640 1 -- 172.21.15.77:0/1283650357 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0201efba0 con 0x7ff020153cf0 2024-04-25T01:39:56.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.183+0000 7ff017fff640 1 --2- 172.21.15.77:0/1283650357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff020153cf0 0x7ff0201453c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff00800c400 tx=0x7ff00800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:56.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.183+0000 7ff016ffd640 1 -- 172.21.15.77:0/1283650357 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff008017070 con 0x7ff020153cf0 2024-04-25T01:39:56.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.183+0000 7ff016ffd640 1 -- 172.21.15.77:0/1283650357 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff008005ce0 con 0x7ff020153cf0 2024-04-25T01:39:56.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.183+0000 7ff02481c640 1 -- 172.21.15.77:0/1283650357 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0201efe80 con 0x7ff020153cf0 2024-04-25T01:39:56.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.183+0000 7ff016ffd640 1 -- 172.21.15.77:0/1283650357 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0080072f0 con 0x7ff020153cf0 2024-04-25T01:39:56.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.183+0000 7ff02481c640 1 -- 172.21.15.77:0/1283650357 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0201f0440 con 0x7ff020153cf0 2024-04-25T01:39:56.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.184+0000 7ff02481c640 1 -- 172.21.15.77:0/1283650357 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff02014f980 con 0x7ff020153cf0 2024-04-25T01:39:56.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.185+0000 7ff016ffd640 1 -- 172.21.15.77:0/1283650357 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff00801a070 con 0x7ff020153cf0 2024-04-25T01:39:56.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.185+0000 7ff016ffd640 1 --2- 172.21.15.77:0/1283650357 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff00006be30 0x7ff00006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:56.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.185+0000 7ff016ffd640 1 -- 172.21.15.77:0/1283650357 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7ff00808a530 con 0x7ff020153cf0 2024-04-25T01:39:56.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.185+0000 7ff01e59c640 1 --2- 172.21.15.77:0/1283650357 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff00006be30 0x7ff00006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:56.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.185+0000 7ff01e59c640 1 --2- 172.21.15.77:0/1283650357 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff00006be30 0x7ff00006e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff010034000 tx=0x7ff01002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:56.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.189+0000 7ff016ffd640 1 -- 172.21.15.77:0/1283650357 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff02014f980 con 0x7ff020153cf0 2024-04-25T01:39:56.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.400+0000 7ff02481c640 1 -- 172.21.15.77:0/1283650357 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff02004f500 con 0x7ff020153cf0 2024-04-25T01:39:56.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.400+0000 7ff016ffd640 1 -- 172.21.15.77:0/1283650357 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) ==== 53+0+116 (secure 0 0 0) 0x7ff020155d60 con 0x7ff020153cf0 2024-04-25T01:39:56.384 INFO:teuthology.orchestra.run.smithi077.stdout:name: a, metadata pool: a_metadata, data pools: [a_data ] 2024-04-25T01:39:56.385 INFO:teuthology.orchestra.run.smithi077.stdout:name: b, metadata pool: b_metadata, data pools: [b_data ] 2024-04-25T01:39:56.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.402+0000 7ff02481c640 1 -- 172.21.15.77:0/1283650357 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff00006be30 msgr2=0x7ff00006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:56.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.402+0000 7ff02481c640 1 --2- 172.21.15.77:0/1283650357 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff00006be30 0x7ff00006e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff010034000 tx=0x7ff01002e000 comp rx=0 tx=0).stop 2024-04-25T01:39:56.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.402+0000 7ff02481c640 1 -- 172.21.15.77:0/1283650357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff020153cf0 msgr2=0x7ff0201453c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:56.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.402+0000 7ff02481c640 1 --2- 172.21.15.77:0/1283650357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff020153cf0 0x7ff0201453c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff00800c400 tx=0x7ff00800c8c0 comp rx=0 tx=0).stop 2024-04-25T01:39:56.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.402+0000 7ff02481c640 1 -- 172.21.15.77:0/1283650357 shutdown_connections 2024-04-25T01:39:56.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.402+0000 7ff02481c640 1 --2- 172.21.15.77:0/1283650357 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff00006be30 0x7ff00006e2f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:56.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.402+0000 7ff02481c640 1 --2- 172.21.15.77:0/1283650357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff020153cf0 0x7ff0201453c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:56.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.402+0000 7ff02481c640 1 --2- 172.21.15.77:0/1283650357 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0201558f0 0x7ff0201421f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:56.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.402+0000 7ff02481c640 1 --2- 172.21.15.77:0/1283650357 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff0200ac840 0x7ff0201ef5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:56.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.402+0000 7ff02481c640 1 -- 172.21.15.77:0/1283650357 >> 172.21.15.77:0/1283650357 conn(0x7ff0200c3f80 msgr2=0x7ff02014ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:56.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.402+0000 7ff02481c640 1 -- 172.21.15.77:0/1283650357 shutdown_connections 2024-04-25T01:39:56.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:56.403+0000 7ff02481c640 1 -- 172.21.15.77:0/1283650357 wait complete. 2024-04-25T01:39:56.397 INFO:tasks.cephfs.mount:Mounting Ceph FS b; just confirmed its presence on cluster 2024-04-25T01:39:56.397 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T01:39:56.397 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-04-25T01:39:56.397 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-25T01:39:56.397 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T01:39:56.397 INFO:tasks.cephfs.mount:self.cephfs_name = b 2024-04-25T01:39:56.397 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T01:39:56.397 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T01:39:56.397 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T01:39:56.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T01:39:56.398 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-04-25T01:39:56.417 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T01:39:56.417 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T01:39:56.417 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T01:39:56.417 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-04-25T01:39:56.417 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-04-25T01:39:56.417 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-04-25T01:39:56.417 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T01:39:56.417 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-04-25T01:39:56.417 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-04-25T01:39:56.418 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T01:39:56.418 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-04-25T01:39:56.418 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-04-25T01:39:56.418 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T01:39:56.418 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-04-25T01:39:56.418 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T01:39:56.418 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-04-25T01:39:56.418 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T01:39:56.418 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42581sec preferred_lft 42581sec 2024-04-25T01:39:56.418 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::1599:7e24:ff1c:57cf/64 scope link noprefixroute 2024-04-25T01:39:56.418 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-04-25T01:39:56.418 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T01:39:56.419 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T01:39:56.419 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-04-25T01:39:56.419 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link add name ceph-brx type bridge 2024-04-25T01:39:56.419 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip addr flush dev ceph-brx 2024-04-25T01:39:56.419 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set ceph-brx up 2024-04-25T01:39:56.419 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T01:39:56.419 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-04-25T01:39:56.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T01:39:56.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T01:39:56.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T01:39:56.675 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T01:39:56.700 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-04-25T01:39:56.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T01:39:56.702 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-04-25T01:39:56.768 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-04-25T01:39:56.768 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T01:39:56.768 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T01:39:56.768 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T01:39:56.768 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T01:39:56.769 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T01:39:56.769 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-04-25T01:39:56.769 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T01:39:56.769 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T01:39:56.769 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T01:39:56.769 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-04-25T01:39:56.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T01:39:57.024 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T01:39:57.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T01:39:57.030 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-04-25T01:39:57.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T01:39:57.044 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list-id 2024-04-25T01:39:57.099 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T01:39:57.099 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-04-25T01:39:57.099 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T01:39:57.099 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-25T01:39:57.100 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-04-25T01:39:57.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T01:39:57.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T01:39:57.216 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-25T01:39:57.216 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T01:39:57.216 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-04-25T01:39:57.216 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-25T01:39:57.216 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T01:39:57.216 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-25T01:39:57.216 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-25T01:39:57.217 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-25T01:39:57.217 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-04-25T01:39:57.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T01:39:57.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T01:39:57.345 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T01:39:57.345 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-04-25T01:39:57.345 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.0 up 2024-04-25T01:39:57.345 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T01:39:57.345 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-04-25T01:39:57.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T01:39:57.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T01:39:57.419 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T01:39:57.419 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-25T01:39:57.434 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-25T01:39:57.434 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T01:39:57.434 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-25T01:39:57.489 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T01:39:57.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T01:39:57.490 DEBUG:teuthology.orchestra.run.smithi121:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=b 2024-04-25T01:39:57.580 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=b 2024-04-25T01:39:57.580 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=b". 2024-04-25T01:39:57.580 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-04-25T01:39:57.689 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=b 2024-04-25T01:39:57.689 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=b". 2024-04-25T01:39:57.689 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-04-25T01:39:57.689 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.121:3300,172.21.15.121:3301" 2024-04-25T01:39:57.689 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T01:39:57.965 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=b 2024-04-25T01:39:57.965 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=b". 2024-04-25T01:39:57.965 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-04-25T01:39:57.965 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.121:3300,172.21.15.121:3301" 2024-04-25T01:39:57.965 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T01:39:57.965 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.77:6789,172.21.15.121:6789,172.21.15.121:6790" 2024-04-25T01:39:57.965 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.77:6789,172.21.15.121:6789,172.21.15.121:6790:/ 2024-04-25T01:39:57.966 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=b,key=1,fsid=70f1c0d7-4e08-4883-a8bd-1451a32d9af1" will pass to kernel 2024-04-25T01:39:57.966 INFO:teuthology.orchestra.run.smithi121.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-25T01:39:57.966 INFO:teuthology.orchestra.run.smithi121.stdout: You just mounted a file system that supports labels which does not 2024-04-25T01:39:57.966 INFO:teuthology.orchestra.run.smithi121.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T01:39:57.966 INFO:teuthology.orchestra.run.smithi121.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T01:39:57.966 INFO:teuthology.orchestra.run.smithi121.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T01:39:57.967 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T01:39:57.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T01:39:57.968 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-25T01:39:57.992 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T01:39:58.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T01:39:58.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T01:39:58.094 INFO:teuthology.orchestra.run.smithi121.stdout:client4786 2024-04-25T01:39:58.094 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-25T01:39:58.094 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T01:39:58.109 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T01:39:58.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T01:39:58.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T01:39:58.210 INFO:teuthology.orchestra.run.smithi121.stdout:client4786 2024-04-25T01:39:58.210 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T01:39:58.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T01:39:58.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T01:39:58.271 INFO:teuthology.orchestra.run.smithi121.stdout:client4786 2024-04-25T01:39:58.271 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/70f1c0d7-4e08-4883-a8bd-1451a32d9af1.client4786/status') 2024-04-25T01:39:58.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T01:39:58.334 INFO:teuthology.orchestra.run.smithi121.stdout:instance: client.4786 (3)192.168.0.1:0/2459563734 2024-04-25T01:39:58.334 INFO:teuthology.orchestra.run.smithi121.stdout:blocklisted: false 2024-04-25T01:39:58.334 INFO:teuthology.orchestra.run.smithi121.stderr:0+1 records in 2024-04-25T01:39:58.334 INFO:teuthology.orchestra.run.smithi121.stderr:0+1 records out 2024-04-25T01:39:58.334 INFO:teuthology.orchestra.run.smithi121.stderr:69 bytes copied, 3.7904e-05 s, 1.8 MB/s 2024-04-25T01:39:58.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-04-25T01:39:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T01:39:58.341 INFO:teuthology.run_tasks:Running task mds_thrash... 2024-04-25T01:39:58.353 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T01:39:58.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.477+0000 7f6a17cee640 1 Processor -- start 2024-04-25T01:39:58.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.477+0000 7f6a17cee640 1 -- start start 2024-04-25T01:39:58.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.478+0000 7f6a17cee640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6a10153cf0 0x7f6a100acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:58.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.478+0000 7f6a17cee640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6a101558f0 0x7f6a1015e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:58.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.478+0000 7f6a17cee640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a10155d60 con 0x7f6a100ac840 2024-04-25T01:39:58.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.478+0000 7f6a17cee640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f6a10151780 con 0x7f6a10153cf0 2024-04-25T01:39:58.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.478+0000 7f6a17cee640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f6a1006d0a0 con 0x7f6a101558f0 2024-04-25T01:39:58.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.478+0000 7f6a15289640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6a10153cf0 0x7f6a100acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:58.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.478+0000 7f6a15289640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6a10153cf0 0x7f6a100acc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38760/0 (socket says 172.21.15.77:38760) 2024-04-25T01:39:58.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.478+0000 7f6a15289640 1 -- 172.21.15.77:0/221392782 learned_addr learned my addr 172.21.15.77:0/221392782 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:58.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.478+0000 7f6a15a8a640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6a100ac840 0x7f6a101551e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59376/0 (socket says 172.21.15.77:59376) 2024-04-25T01:39:58.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.478+0000 7f6a1628b640 1 --2- 172.21.15.77:0/221392782 >> v2:172.21.15.121:3300/0 conn(0x7f6a101558f0 0x7f6a1015e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:58.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.479+0000 7f6a15289640 1 -- 172.21.15.77:0/221392782 >> v2:172.21.15.121:3300/0 conn(0x7f6a101558f0 msgr2=0x7f6a1015e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:58.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.479+0000 7f6a15289640 1 --2- 172.21.15.77:0/221392782 >> v2:172.21.15.121:3300/0 conn(0x7f6a101558f0 0x7f6a1015e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:58.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.479+0000 7f6a15289640 1 -- 172.21.15.77:0/221392782 >> v1:172.21.15.77:6789/0 conn(0x7f6a100ac840 legacy=0x7f6a101551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:58.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.479+0000 7f6a15289640 1 -- 172.21.15.77:0/221392782 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a1006b480 con 0x7f6a10153cf0 2024-04-25T01:39:58.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.479+0000 7f6a1628b640 1 --2- 172.21.15.77:0/221392782 >> v2:172.21.15.121:3300/0 conn(0x7f6a101558f0 0x7f6a1015e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:58.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.479+0000 7f6a15289640 1 --2- 172.21.15.77:0/221392782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a10153cf0 0x7f6a100acc20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6a10070c10 tx=0x7f6a0002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=160cdec7f5b91615 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:58.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.479+0000 7f6a14a88640 1 -- 172.21.15.77:0/221392782 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a00037070 con 0x7f6a10153cf0 2024-04-25T01:39:58.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.479+0000 7f6a14a88640 1 -- 172.21.15.77:0/221392782 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a0002ad90 con 0x7f6a10153cf0 2024-04-25T01:39:58.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.479+0000 7f6a14a88640 1 -- 172.21.15.77:0/221392782 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a00032660 con 0x7f6a10153cf0 2024-04-25T01:39:58.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.480+0000 7f6a17cee640 1 -- 172.21.15.77:0/221392782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a10153cf0 msgr2=0x7f6a100acc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:58.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.480+0000 7f6a17cee640 1 --2- 172.21.15.77:0/221392782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a10153cf0 0x7f6a100acc20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6a10070c10 tx=0x7f6a0002a100 comp rx=0 tx=0).stop 2024-04-25T01:39:58.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.480+0000 7f6a17cee640 1 -- 172.21.15.77:0/221392782 shutdown_connections 2024-04-25T01:39:58.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.480+0000 7f6a17cee640 1 --2- 172.21.15.77:0/221392782 >> v2:172.21.15.121:3300/0 conn(0x7f6a101558f0 0x7f6a1015e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:58.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.480+0000 7f6a17cee640 1 --2- 172.21.15.77:0/221392782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a10153cf0 0x7f6a100acc20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:58.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.480+0000 7f6a17cee640 1 -- 172.21.15.77:0/221392782 >> 172.21.15.77:0/221392782 conn(0x7f6a100c3f80 msgr2=0x7f6a100c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:58.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.480+0000 7f6a17cee640 1 -- 172.21.15.77:0/221392782 shutdown_connections 2024-04-25T01:39:58.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.480+0000 7f6a17cee640 1 -- 172.21.15.77:0/221392782 wait complete. 2024-04-25T01:39:58.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.481+0000 7f6a17cee640 1 Processor -- start 2024-04-25T01:39:58.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.481+0000 7f6a17cee640 1 -- start start 2024-04-25T01:39:58.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.482+0000 7f6a17cee640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a100ac840 0x7f6a1014a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:58.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.482+0000 7f6a17cee640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6a10153cf0 0x7f6a100c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:58.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.482+0000 7f6a17cee640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a101558f0 0x7f6a101566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:58.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.482+0000 7f6a17cee640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1006d5d0 con 0x7f6a101558f0 2024-04-25T01:39:58.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.482+0000 7f6a17cee640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1006dc20 con 0x7f6a100ac840 2024-04-25T01:39:58.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.482+0000 7f6a17cee640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f6a1006d8b0 con 0x7f6a10153cf0 2024-04-25T01:39:58.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.482+0000 7f6a1628b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a101558f0 0x7f6a101566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:58.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.482+0000 7f6a1628b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a101558f0 0x7f6a101566b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38772/0 (socket says 172.21.15.77:38772) 2024-04-25T01:39:58.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.482+0000 7f6a1628b640 1 -- 172.21.15.77:0/2263940596 learned_addr learned my addr 172.21.15.77:0/2263940596 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:58.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.482+0000 7f6a15a8a640 1 --2- 172.21.15.77:0/2263940596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a100ac840 0x7f6a1014a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:58.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.482+0000 7f6a15289640 1 --2- 172.21.15.77:0/2263940596 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6a10153cf0 0x7f6a100c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:58.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.482+0000 7f6a1628b640 1 -- 172.21.15.77:0/2263940596 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6a10153cf0 msgr2=0x7f6a100c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:58.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.482+0000 7f6a1628b640 1 --2- 172.21.15.77:0/2263940596 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6a10153cf0 0x7f6a100c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:58.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.482+0000 7f6a1628b640 1 -- 172.21.15.77:0/2263940596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a100ac840 msgr2=0x7f6a1014a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:58.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.482+0000 7f6a1628b640 1 --2- 172.21.15.77:0/2263940596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a100ac840 0x7f6a1014a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:58.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.482+0000 7f6a1628b640 1 -- 172.21.15.77:0/2263940596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a100724b0 con 0x7f6a101558f0 2024-04-25T01:39:58.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.483+0000 7f6a1628b640 1 --2- 172.21.15.77:0/2263940596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a101558f0 0x7f6a101566b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6a08007f20 tx=0x7f6a0800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:58.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.483+0000 7f6a067fc640 1 -- 172.21.15.77:0/2263940596 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0801a070 con 0x7f6a101558f0 2024-04-25T01:39:58.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.483+0000 7f6a067fc640 1 -- 172.21.15.77:0/2263940596 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a08003b90 con 0x7f6a101558f0 2024-04-25T01:39:58.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.483+0000 7f6a17cee640 1 -- 172.21.15.77:0/2263940596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a10072790 con 0x7f6a101558f0 2024-04-25T01:39:58.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.483+0000 7f6a067fc640 1 -- 172.21.15.77:0/2263940596 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a08004030 con 0x7f6a101558f0 2024-04-25T01:39:58.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.483+0000 7f6a17cee640 1 -- 172.21.15.77:0/2263940596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a10071610 con 0x7f6a101558f0 2024-04-25T01:39:58.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.484+0000 7f6a17cee640 1 -- 172.21.15.77:0/2263940596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a1004f500 con 0x7f6a101558f0 2024-04-25T01:39:58.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.484+0000 7f6a067fc640 1 -- 172.21.15.77:0/2263940596 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a0801d070 con 0x7f6a101558f0 2024-04-25T01:39:58.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.485+0000 7f6a067fc640 1 --2- 172.21.15.77:0/2263940596 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f69f406be30 0x7f69f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:58.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.485+0000 7f6a067fc640 1 -- 172.21.15.77:0/2263940596 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f6a0808b380 con 0x7f6a101558f0 2024-04-25T01:39:58.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.485+0000 7f6a15a8a640 1 --2- 172.21.15.77:0/2263940596 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f69f406be30 0x7f69f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:58.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.485+0000 7f6a15a8a640 1 --2- 172.21.15.77:0/2263940596 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f69f406be30 0x7f69f406e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c000f60 tx=0x7f6a0c007e20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:58.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.489+0000 7f6a067fc640 1 -- 172.21.15.77:0/2263940596 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6a08010070 con 0x7f6a101558f0 2024-04-25T01:39:58.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.662+0000 7f6a17cee640 1 -- 172.21.15.77:0/2263940596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a1006b6e0 con 0x7f6a101558f0 2024-04-25T01:39:58.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.664+0000 7f6a067fc640 1 -- 172.21.15.77:0/2263940596 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20331 (secure 0 0 0) 0x7f6a08059440 con 0x7f6a101558f0 2024-04-25T01:39:58.648 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:39:58.648 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:39:34.425701+0000","last_up_change":"2024-04-25T01:39:10.729600+0000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T01:39:11.681151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T01:39:21.606752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T01:39:22.677664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T01:39:30.501700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T01:39:31.740717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6811","nonce":3366980158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6817","nonce":3366980158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6828","nonce":3366980158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6825","nonce":3366980158}]},"public_addr":"172.21.15.77:6811/3366980158","cluster_addr":"172.21.15.77:6817/3366980158","heartbeat_back_addr":"172.21.15.77:6828/3366980158","heartbeat_front_addr":"172.21.15.77:6825/3366980158","state":["exists","up"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6801","nonce":3971619298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6803","nonce":3971619298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6807","nonce":3971619298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6805","nonce":3971619298}]},"public_addr":"172.21.15.77:6801/3971619298","cluster_addr":"172.21.15.77:6803/3971619298","heartbeat_back_addr":"172.21.15.77:6807/3971619298","heartbeat_front_addr":"172.21.15.77:6805/3971619298","state":["exists","up"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6810","nonce":4103452689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6813","nonce":4103452689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6823","nonce":4103452689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6818","nonce":4103452689}]},"public_addr":"172.21.15.77:6810/4103452689","cluster_addr":"172.21.15.77:6813/4103452689","heartbeat_back_addr":"172.21.15.77:6823/4103452689","heartbeat_front_addr":"172.21.15.77:6818/4103452689","state":["exists","up"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6819","nonce":217398906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6824","nonce":217398906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6831","nonce":217398906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6829","nonce":217398906}]},"public_addr":"172.21.15.77:6819/217398906","cluster_addr":"172.21.15.77:6824/217398906","heartbeat_back_addr":"172.21.15.77:6831/217398906","heartbeat_front_addr":"172.21.15.77:6829/217398906","state":["exists","up"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6801","nonce":2565483070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6803","nonce":2565483070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6810","nonce":2565483070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6806","nonce":2565483070}]},"public_addr":"172.21.15.121:6801/2565483070","cluster_addr":"172.21.15.121:6803/2565483070","heartbeat_back_addr":"172.21.15.121:6810/2565483070","heartbeat_front_addr":"172.21.15.121:6806/2565483070","state":["exists","up"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6807","nonce":2785294752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6809","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6811","nonce":2785294752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6815","nonce":2785294752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6813","nonce":2785294752}]},"public_addr":"172.21.15.121:6807/2785294752","cluster_addr":"172.21.15.121:6811/2785294752","heartbeat_back_addr":"172.21.15.121:6815/2785294752","heartbeat_front_addr":"172.21.15.121:6813/2785294752","state":["exists","up"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6820","nonce":523906818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6824","nonce":523906818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6831","nonce":523906818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6828","nonce":523906818}]},"public_addr":"172.21.15.121:6820/523906818","cluster_addr":"172.21.15.121:6824/523906818","heartbeat_back_addr":"172.21.15.121:6831/523906818","heartbeat_front_addr":"172.21.15.121:6828/523906818","state":["exists","up"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6817","nonce":1683602459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6819","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6821","nonce":1683602459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6829","nonce":1683602459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6823","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6825","nonce":1683602459}]},"public_addr":"172.21.15.121:6817/1683602459","cluster_addr":"172.21.15.121:6821/1683602459","heartbeat_back_addr":"172.21.15.121:6829/1683602459","heartbeat_front_addr":"172.21.15.121:6825/1683602459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.839443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.818842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.776243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.793085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.822396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.907311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.918374+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.848430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:39:58.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.665+0000 7f6a17cee640 1 -- 172.21.15.77:0/2263940596 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f69f406be30 msgr2=0x7f69f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:58.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.665+0000 7f6a17cee640 1 --2- 172.21.15.77:0/2263940596 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f69f406be30 0x7f69f406e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c000f60 tx=0x7f6a0c007e20 comp rx=0 tx=0).stop 2024-04-25T01:39:58.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.665+0000 7f6a17cee640 1 -- 172.21.15.77:0/2263940596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a101558f0 msgr2=0x7f6a101566b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:58.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.665+0000 7f6a17cee640 1 --2- 172.21.15.77:0/2263940596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a101558f0 0x7f6a101566b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6a08007f20 tx=0x7f6a0800d560 comp rx=0 tx=0).stop 2024-04-25T01:39:58.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.666+0000 7f6a17cee640 1 -- 172.21.15.77:0/2263940596 shutdown_connections 2024-04-25T01:39:58.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.666+0000 7f6a17cee640 1 --2- 172.21.15.77:0/2263940596 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f69f406be30 0x7f69f406e2f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:58.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.666+0000 7f6a17cee640 1 --2- 172.21.15.77:0/2263940596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a101558f0 0x7f6a101566b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:58.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.666+0000 7f6a17cee640 1 --2- 172.21.15.77:0/2263940596 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6a10153cf0 0x7f6a100c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:58.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.666+0000 7f6a17cee640 1 --2- 172.21.15.77:0/2263940596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a100ac840 0x7f6a1014a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:58.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.666+0000 7f6a17cee640 1 -- 172.21.15.77:0/2263940596 >> 172.21.15.77:0/2263940596 conn(0x7f6a100c3f80 msgr2=0x7f6a10150560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:58.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.666+0000 7f6a17cee640 1 -- 172.21.15.77:0/2263940596 shutdown_connections 2024-04-25T01:39:58.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.666+0000 7f6a17cee640 1 -- 172.21.15.77:0/2263940596 wait complete. 2024-04-25T01:39:58.660 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T01:39:11.681151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-25T01:39:21.606752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-25T01:39:22.677664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-25T01:39:30.501700+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-25T01:39:31.740717+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T01:39:58.661 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T01:39:58.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.776+0000 7f00a3de9640 1 Processor -- start 2024-04-25T01:39:58.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.776+0000 7f00a3de9640 1 -- start start 2024-04-25T01:39:58.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.777+0000 7f00a3de9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f009c0c4280 0x7f009c1538f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:58.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.777+0000 7f00a3de9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f009c073450 0x7f009c153e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:58.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.777+0000 7f00a3de9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f009c0c7040 con 0x7f009c0c4cb0 2024-04-25T01:39:58.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.777+0000 7f00a3de9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f009c0c1cd0 con 0x7f009c0c4280 2024-04-25T01:39:58.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.777+0000 7f00a3de9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f009c0ac010 con 0x7f009c073450 2024-04-25T01:39:58.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.777+0000 7f00a1b85640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f009c0c4280 0x7f009c1538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:58.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.777+0000 7f00a2386640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f009c0c4cb0 0x7f009c0c5480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59392/0 (socket says 172.21.15.77:59392) 2024-04-25T01:39:58.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.777+0000 7f00a2386640 1 -- 172.21.15.77:0/869084288 learned_addr learned my addr 172.21.15.77:0/869084288 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:58.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.777+0000 7f00a1384640 1 --2- 172.21.15.77:0/869084288 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f009c073450 0x7f009c153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:58.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.777+0000 7f00a1b85640 1 -- 172.21.15.77:0/869084288 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f009c073450 msgr2=0x7f009c153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:58.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.777+0000 7f00a1b85640 1 --2- 172.21.15.77:0/869084288 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f009c073450 0x7f009c153e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:58.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.777+0000 7f00a1b85640 1 -- 172.21.15.77:0/869084288 >> v1:172.21.15.77:6789/0 conn(0x7f009c0c4cb0 legacy=0x7f009c0c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:58.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.777+0000 7f00a1b85640 1 -- 172.21.15.77:0/869084288 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f009c0ac2f0 con 0x7f009c0c4280 2024-04-25T01:39:58.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.777+0000 7f00a0b83640 1 -- 172.21.15.77:0/869084288 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1372161309 0 0) 0x7f009c0c7040 con 0x7f009c0c4cb0 2024-04-25T01:39:58.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.778+0000 7f00a1b85640 1 --2- 172.21.15.77:0/869084288 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f009c0c4280 0x7f009c1538f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0098009d90 tx=0x7f009802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b3f5caeacd470f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:58.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.778+0000 7f00a0b83640 1 -- 172.21.15.77:0/869084288 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0098007740 con 0x7f009c0c4280 2024-04-25T01:39:58.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.778+0000 7f00a0b83640 1 -- 172.21.15.77:0/869084288 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00980078e0 con 0x7f009c0c4280 2024-04-25T01:39:58.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.778+0000 7f00a0b83640 1 -- 172.21.15.77:0/869084288 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0098007cb0 con 0x7f009c0c4280 2024-04-25T01:39:58.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.779+0000 7f00a3de9640 1 -- 172.21.15.77:0/869084288 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f009c0c4280 msgr2=0x7f009c1538f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:58.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.779+0000 7f00a3de9640 1 --2- 172.21.15.77:0/869084288 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f009c0c4280 0x7f009c1538f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0098009d90 tx=0x7f009802a660 comp rx=0 tx=0).stop 2024-04-25T01:39:58.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.779+0000 7f00a3de9640 1 -- 172.21.15.77:0/869084288 shutdown_connections 2024-04-25T01:39:58.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.779+0000 7f00a3de9640 1 --2- 172.21.15.77:0/869084288 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f009c073450 0x7f009c153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:58.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.779+0000 7f00a3de9640 1 --2- 172.21.15.77:0/869084288 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f009c0c4280 0x7f009c1538f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:58.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.779+0000 7f00a3de9640 1 -- 172.21.15.77:0/869084288 >> 172.21.15.77:0/869084288 conn(0x7f009c0c7580 msgr2=0x7f009c0c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:58.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.779+0000 7f00a3de9640 1 -- 172.21.15.77:0/869084288 shutdown_connections 2024-04-25T01:39:58.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.779+0000 7f00a3de9640 1 -- 172.21.15.77:0/869084288 wait complete. 2024-04-25T01:39:58.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.780+0000 7f00a3de9640 1 Processor -- start 2024-04-25T01:39:58.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.780+0000 7f00a3de9640 1 -- start start 2024-04-25T01:39:58.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.780+0000 7f00a3de9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f009c073450 0x7f009c1543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:58.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.780+0000 7f00a3de9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f009c0c4280 0x7f009c1497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:58.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.780+0000 7f00a3de9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f009c0c4cb0 0x7f009c149d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:58.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.781+0000 7f00a3de9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f009c0c1a90 con 0x7f009c0c4280 2024-04-25T01:39:58.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.781+0000 7f00a3de9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f009c0c1910 con 0x7f009c073450 2024-04-25T01:39:58.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.781+0000 7f00a3de9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f009c0c4660 con 0x7f009c0c4cb0 2024-04-25T01:39:58.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.781+0000 7f00a1384640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f009c0c4280 0x7f009c1497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:58.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.781+0000 7f00a1384640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f009c0c4280 0x7f009c1497e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38788/0 (socket says 172.21.15.77:38788) 2024-04-25T01:39:58.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.781+0000 7f00a1384640 1 -- 172.21.15.77:0/4161115512 learned_addr learned my addr 172.21.15.77:0/4161115512 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:58.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.781+0000 7f00a1b85640 1 --2- 172.21.15.77:0/4161115512 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f009c073450 0x7f009c1543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:58.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.781+0000 7f00a2386640 1 --2- 172.21.15.77:0/4161115512 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f009c0c4cb0 0x7f009c149d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:58.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.781+0000 7f00a1384640 1 -- 172.21.15.77:0/4161115512 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f009c0c4cb0 msgr2=0x7f009c149d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:58.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.781+0000 7f00a1384640 1 --2- 172.21.15.77:0/4161115512 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f009c0c4cb0 0x7f009c149d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:58.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.781+0000 7f00a1384640 1 -- 172.21.15.77:0/4161115512 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f009c073450 msgr2=0x7f009c1543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:58.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.781+0000 7f00a1384640 1 --2- 172.21.15.77:0/4161115512 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f009c073450 0x7f009c1543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:58.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.781+0000 7f00a1384640 1 -- 172.21.15.77:0/4161115512 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f009c0a7c50 con 0x7f009c0c4280 2024-04-25T01:39:58.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.781+0000 7f00a1384640 1 --2- 172.21.15.77:0/4161115512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f009c0c4280 0x7f009c1497e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f008c00c7f0 tx=0x7f008c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:58.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.781+0000 7f00927fc640 1 -- 172.21.15.77:0/4161115512 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008c015070 con 0x7f009c0c4280 2024-04-25T01:39:58.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.781+0000 7f00927fc640 1 -- 172.21.15.77:0/4161115512 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f008c007820 con 0x7f009c0c4280 2024-04-25T01:39:58.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.781+0000 7f00927fc640 1 -- 172.21.15.77:0/4161115512 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008c007bd0 con 0x7f009c0c4280 2024-04-25T01:39:58.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.781+0000 7f00a3de9640 1 -- 172.21.15.77:0/4161115512 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f009c14a4b0 con 0x7f009c0c4280 2024-04-25T01:39:58.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.781+0000 7f00a3de9640 1 -- 172.21.15.77:0/4161115512 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f009c1e9a30 con 0x7f009c0c4280 2024-04-25T01:39:58.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.782+0000 7f00a3de9640 1 -- 172.21.15.77:0/4161115512 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f009c04f500 con 0x7f009c0c4280 2024-04-25T01:39:58.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.783+0000 7f00927fc640 1 -- 172.21.15.77:0/4161115512 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f008c018070 con 0x7f009c0c4280 2024-04-25T01:39:58.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.783+0000 7f00927fc640 1 --2- 172.21.15.77:0/4161115512 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f008006be30 0x7f008006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:58.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.783+0000 7f00927fc640 1 -- 172.21.15.77:0/4161115512 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f008c08ad40 con 0x7f009c0c4280 2024-04-25T01:39:58.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.783+0000 7f00a1b85640 1 --2- 172.21.15.77:0/4161115512 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f008006be30 0x7f008006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:58.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.783+0000 7f00a1b85640 1 --2- 172.21.15.77:0/4161115512 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f008006be30 0x7f008006e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0098034000 tx=0x7f009802f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:58.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.787+0000 7f00927fc640 1 -- 172.21.15.77:0/4161115512 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f008c058e00 con 0x7f009c0c4280 2024-04-25T01:39:58.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.961+0000 7f00a3de9640 1 -- 172.21.15.77:0/4161115512 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f009c0c6bf0 con 0x7f009c0c4280 2024-04-25T01:39:58.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.961+0000 7f00927fc640 1 -- 172.21.15.77:0/4161115512 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f008c05d100 con 0x7f009c0c4280 2024-04-25T01:39:58.945 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-25T01:39:58.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.963+0000 7f00a3de9640 1 -- 172.21.15.77:0/4161115512 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f008006be30 msgr2=0x7f008006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:58.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.963+0000 7f00a3de9640 1 --2- 172.21.15.77:0/4161115512 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f008006be30 0x7f008006e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0098034000 tx=0x7f009802f000 comp rx=0 tx=0).stop 2024-04-25T01:39:58.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.963+0000 7f00a3de9640 1 -- 172.21.15.77:0/4161115512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f009c0c4280 msgr2=0x7f009c1497e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:58.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.963+0000 7f00a3de9640 1 --2- 172.21.15.77:0/4161115512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f009c0c4280 0x7f009c1497e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f008c00c7f0 tx=0x7f008c00ccb0 comp rx=0 tx=0).stop 2024-04-25T01:39:58.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.963+0000 7f00a3de9640 1 -- 172.21.15.77:0/4161115512 shutdown_connections 2024-04-25T01:39:58.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.963+0000 7f00a3de9640 1 --2- 172.21.15.77:0/4161115512 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f008006be30 0x7f008006e2f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:58.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.963+0000 7f00a3de9640 1 --2- 172.21.15.77:0/4161115512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f009c0c4280 0x7f009c1497e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:58.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.963+0000 7f00a3de9640 1 --2- 172.21.15.77:0/4161115512 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f009c0c4cb0 0x7f009c149d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:58.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.963+0000 7f00a3de9640 1 --2- 172.21.15.77:0/4161115512 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f009c073450 0x7f009c1543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:58.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.963+0000 7f00a3de9640 1 -- 172.21.15.77:0/4161115512 >> 172.21.15.77:0/4161115512 conn(0x7f009c0c7580 msgr2=0x7f009c151fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:58.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.963+0000 7f00a3de9640 1 -- 172.21.15.77:0/4161115512 shutdown_connections 2024-04-25T01:39:58.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:58.963+0000 7f00a3de9640 1 -- 172.21.15.77:0/4161115512 wait complete. 2024-04-25T01:39:58.957 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-25T01:39:59.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.073+0000 7fd82cd22640 1 Processor -- start 2024-04-25T01:39:59.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.073+0000 7fd82cd22640 1 -- start start 2024-04-25T01:39:59.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.074+0000 7fd82cd22640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd828073450 0x7fd8280c5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:59.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.074+0000 7fd82cd22640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8280c7040 con 0x7fd8280c4280 2024-04-25T01:39:59.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.074+0000 7fd82cd22640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8280ac010 con 0x7fd8280c4cb0 2024-04-25T01:39:59.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.074+0000 7fd82cd22640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd8280c1cd0 con 0x7fd828073450 2024-04-25T01:39:59.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.074+0000 7fd82659c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd8280c4280 0x7fd8281538f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59400/0 (socket says 172.21.15.77:59400) 2024-04-25T01:39:59.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.074+0000 7fd82659c640 1 -- 172.21.15.77:0/3712834509 learned_addr learned my addr 172.21.15.77:0/3712834509 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:59.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.074+0000 7fd81ffff640 1 --2- 172.21.15.77:0/3712834509 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd828073450 0x7fd8280c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:59.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.074+0000 7fd825d9b640 1 -- 172.21.15.77:0/3712834509 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3075219607 0 0) 0x7fd8280c7040 con 0x7fd8280c4280 2024-04-25T01:39:59.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.074+0000 7fd825d9b640 1 -- 172.21.15.77:0/3712834509 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd814003520 con 0x7fd8280c4280 2024-04-25T01:39:59.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.074+0000 7fd81ffff640 1 -- 172.21.15.77:0/3712834509 >> v1:172.21.15.121:6789/0 conn(0x7fd8280c4cb0 legacy=0x7fd82815d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:59.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.074+0000 7fd825d9b640 1 -- 172.21.15.77:0/3712834509 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1231094915 0 0) 0x7fd8280ac010 con 0x7fd8280c4cb0 2024-04-25T01:39:59.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.074+0000 7fd81ffff640 1 -- 172.21.15.77:0/3712834509 >> v1:172.21.15.77:6789/0 conn(0x7fd8280c4280 legacy=0x7fd8281538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:59.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.074+0000 7fd81ffff640 1 -- 172.21.15.77:0/3712834509 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8280ac2f0 con 0x7fd828073450 2024-04-25T01:39:59.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.075+0000 7fd81ffff640 1 --2- 172.21.15.77:0/3712834509 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd828073450 0x7fd8280c5480 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd8100097d0 tx=0x7fd81002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1897ef46db93799 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:59.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.075+0000 7fd825d9b640 1 -- 172.21.15.77:0/3712834509 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd810037070 con 0x7fd828073450 2024-04-25T01:39:59.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.075+0000 7fd825d9b640 1 -- 172.21.15.77:0/3712834509 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd810032440 con 0x7fd828073450 2024-04-25T01:39:59.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.075+0000 7fd825d9b640 1 -- 172.21.15.77:0/3712834509 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd810032810 con 0x7fd828073450 2024-04-25T01:39:59.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.075+0000 7fd82cd22640 1 -- 172.21.15.77:0/3712834509 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd828073450 msgr2=0x7fd8280c5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:59.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.075+0000 7fd82cd22640 1 --2- 172.21.15.77:0/3712834509 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd828073450 0x7fd8280c5480 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd8100097d0 tx=0x7fd81002a210 comp rx=0 tx=0).stop 2024-04-25T01:39:59.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.076+0000 7fd82cd22640 1 -- 172.21.15.77:0/3712834509 shutdown_connections 2024-04-25T01:39:59.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.076+0000 7fd82cd22640 1 --2- 172.21.15.77:0/3712834509 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd828073450 0x7fd8280c5480 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.076+0000 7fd82cd22640 1 -- 172.21.15.77:0/3712834509 >> 172.21.15.77:0/3712834509 conn(0x7fd8280c7580 msgr2=0x7fd8280c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:59.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.076+0000 7fd82cd22640 1 -- 172.21.15.77:0/3712834509 shutdown_connections 2024-04-25T01:39:59.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.076+0000 7fd82cd22640 1 -- 172.21.15.77:0/3712834509 wait complete. 2024-04-25T01:39:59.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.077+0000 7fd82cd22640 1 Processor -- start 2024-04-25T01:39:59.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.077+0000 7fd82cd22640 1 -- start start 2024-04-25T01:39:59.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.077+0000 7fd82cd22640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd828073450 0x7fd828149300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:59.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.077+0000 7fd82cd22640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8280c4280 0x7fd8280a8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:59.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.077+0000 7fd82cd22640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd8280c4cb0 0x7fd8281e8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:59.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.077+0000 7fd82cd22640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd8280c1a90 con 0x7fd8280c4280 2024-04-25T01:39:59.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.077+0000 7fd82cd22640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd8280c1910 con 0x7fd828073450 2024-04-25T01:39:59.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.077+0000 7fd82cd22640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd828154000 con 0x7fd8280c4cb0 2024-04-25T01:39:59.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.078+0000 7fd81ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8280c4280 0x7fd8280a8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:59.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.078+0000 7fd81ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8280c4280 0x7fd8280a8e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38804/0 (socket says 172.21.15.77:38804) 2024-04-25T01:39:59.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.078+0000 7fd81ffff640 1 -- 172.21.15.77:0/349969029 learned_addr learned my addr 172.21.15.77:0/349969029 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:59.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.078+0000 7fd82659c640 1 --2- 172.21.15.77:0/349969029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd828073450 0x7fd828149300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:59.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.078+0000 7fd826d9d640 1 --2- 172.21.15.77:0/349969029 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd8280c4cb0 0x7fd8281e8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:59.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.078+0000 7fd81ffff640 1 -- 172.21.15.77:0/349969029 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd8280c4cb0 msgr2=0x7fd8281e8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:59.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.078+0000 7fd81ffff640 1 --2- 172.21.15.77:0/349969029 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd8280c4cb0 0x7fd8281e8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.078+0000 7fd81ffff640 1 -- 172.21.15.77:0/349969029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd828073450 msgr2=0x7fd828149300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:59.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.078+0000 7fd81ffff640 1 --2- 172.21.15.77:0/349969029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd828073450 0x7fd828149300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.078+0000 7fd81ffff640 1 -- 172.21.15.77:0/349969029 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8281eca90 con 0x7fd8280c4280 2024-04-25T01:39:59.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.078+0000 7fd81ffff640 1 --2- 172.21.15.77:0/349969029 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8280c4280 0x7fd8280a8e90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd810035040 tx=0x7fd8100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:59.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.078+0000 7fd81effd640 1 -- 172.21.15.77:0/349969029 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81003f070 con 0x7fd8280c4280 2024-04-25T01:39:59.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.078+0000 7fd81effd640 1 -- 172.21.15.77:0/349969029 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd810004220 con 0x7fd8280c4280 2024-04-25T01:39:59.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.078+0000 7fd82cd22640 1 -- 172.21.15.77:0/349969029 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8281ecd70 con 0x7fd8280c4280 2024-04-25T01:39:59.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.078+0000 7fd81effd640 1 -- 172.21.15.77:0/349969029 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd810003610 con 0x7fd8280c4280 2024-04-25T01:39:59.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.078+0000 7fd82cd22640 1 -- 172.21.15.77:0/349969029 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd828154a00 con 0x7fd8280c4280 2024-04-25T01:39:59.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.079+0000 7fd82cd22640 1 -- 172.21.15.77:0/349969029 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd828154c40 con 0x7fd8280c4280 2024-04-25T01:39:59.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.080+0000 7fd81effd640 1 -- 172.21.15.77:0/349969029 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd8100037b0 con 0x7fd8280c4280 2024-04-25T01:39:59.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.080+0000 7fd81effd640 1 --2- 172.21.15.77:0/349969029 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd80806be30 0x7fd80806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:59.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.080+0000 7fd81effd640 1 -- 172.21.15.77:0/349969029 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fd8100acea0 con 0x7fd8280c4280 2024-04-25T01:39:59.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.080+0000 7fd82659c640 1 --2- 172.21.15.77:0/349969029 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd80806be30 0x7fd80806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:59.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.081+0000 7fd82659c640 1 --2- 172.21.15.77:0/349969029 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd80806be30 0x7fd80806e2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd818005880 tx=0x7fd818009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:59.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.084+0000 7fd81effd640 1 -- 172.21.15.77:0/349969029 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd828154c40 con 0x7fd8280c4280 2024-04-25T01:39:59.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.258+0000 7fd82cd22640 1 -- 172.21.15.77:0/349969029 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7fd82804f500 con 0x7fd8280c4280 2024-04-25T01:39:59.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.258+0000 7fd81effd640 1 -- 172.21.15.77:0/349969029 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v24) ==== 99+0+11 (secure 0 0 0) 0x7fd81007af60 con 0x7fd8280c4280 2024-04-25T01:39:59.242 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T01:39:59.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.260+0000 7fd82cd22640 1 -- 172.21.15.77:0/349969029 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd80806be30 msgr2=0x7fd80806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:59.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.260+0000 7fd82cd22640 1 --2- 172.21.15.77:0/349969029 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd80806be30 0x7fd80806e2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd818005880 tx=0x7fd818009040 comp rx=0 tx=0).stop 2024-04-25T01:39:59.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.260+0000 7fd82cd22640 1 -- 172.21.15.77:0/349969029 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8280c4280 msgr2=0x7fd8280a8e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:59.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.260+0000 7fd82cd22640 1 --2- 172.21.15.77:0/349969029 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8280c4280 0x7fd8280a8e90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd810035040 tx=0x7fd8100046c0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.260+0000 7fd82cd22640 1 -- 172.21.15.77:0/349969029 shutdown_connections 2024-04-25T01:39:59.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.260+0000 7fd82cd22640 1 --2- 172.21.15.77:0/349969029 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd80806be30 0x7fd80806e2f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.260+0000 7fd82cd22640 1 --2- 172.21.15.77:0/349969029 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8280c4280 0x7fd8280a8e90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.260+0000 7fd82cd22640 1 --2- 172.21.15.77:0/349969029 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd8280c4cb0 0x7fd8281e8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.260+0000 7fd82cd22640 1 --2- 172.21.15.77:0/349969029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd828073450 0x7fd828149300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.260+0000 7fd82cd22640 1 -- 172.21.15.77:0/349969029 >> 172.21.15.77:0/349969029 conn(0x7fd8280c7580 msgr2=0x7fd828152d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:59.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.261+0000 7fd82cd22640 1 -- 172.21.15.77:0/349969029 shutdown_connections 2024-04-25T01:39:59.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.261+0000 7fd82cd22640 1 -- 172.21.15.77:0/349969029 wait complete. 2024-04-25T01:39:59.255 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-25T01:39:59.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.371+0000 7f9dac864640 1 Processor -- start 2024-04-25T01:39:59.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.371+0000 7f9dac864640 1 -- start start 2024-04-25T01:39:59.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.372+0000 7f9dac864640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9da80c6c50 0x7f9da80abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:59.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.372+0000 7f9dac864640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9da80acf70 con 0x7f9da80c4d10 2024-04-25T01:39:59.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.372+0000 7f9dac864640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9da8153120 con 0x7f9da806d470 2024-04-25T01:39:59.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.372+0000 7f9dac864640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9da80acd20 con 0x7f9da80c6c50 2024-04-25T01:39:59.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.372+0000 7f9d9ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9da80c6c50 0x7f9da80abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:59.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.372+0000 7f9da6d9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9da80c4d10 0x7f9da80c2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59414/0 (socket says 172.21.15.77:59414) 2024-04-25T01:39:59.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.372+0000 7f9da6d9d640 1 -- 172.21.15.77:0/3886979838 learned_addr learned my addr 172.21.15.77:0/3886979838 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:59.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.372+0000 7f9d9ffff640 1 -- 172.21.15.77:0/3886979838 >> v1:172.21.15.121:6789/0 conn(0x7f9da806d470 legacy=0x7f9da806d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:59.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.372+0000 7f9d9ffff640 1 -- 172.21.15.77:0/3886979838 >> v1:172.21.15.77:6789/0 conn(0x7f9da80c4d10 legacy=0x7f9da80c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:59.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.372+0000 7f9d9ffff640 1 -- 172.21.15.77:0/3886979838 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da8153400 con 0x7f9da80c6c50 2024-04-25T01:39:59.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.373+0000 7f9d9ffff640 1 --2- 172.21.15.77:0/3886979838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9da80c6c50 0x7f9da80abf90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9d9000a940 tx=0x7f9d9002b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76d0303560db1215 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:59.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.373+0000 7f9da5d9b640 1 -- 172.21.15.77:0/3886979838 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9000b040 con 0x7f9da80c6c50 2024-04-25T01:39:59.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.373+0000 7f9da5d9b640 1 -- 172.21.15.77:0/3886979838 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d90030710 con 0x7f9da80c6c50 2024-04-25T01:39:59.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.373+0000 7f9da5d9b640 1 -- 172.21.15.77:0/3886979838 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d90030ae0 con 0x7f9da80c6c50 2024-04-25T01:39:59.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.373+0000 7f9dac864640 1 -- 172.21.15.77:0/3886979838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9da80c6c50 msgr2=0x7f9da80abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:59.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.373+0000 7f9dac864640 1 --2- 172.21.15.77:0/3886979838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9da80c6c50 0x7f9da80abf90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9d9000a940 tx=0x7f9d9002b4c0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.373+0000 7f9dac864640 1 -- 172.21.15.77:0/3886979838 shutdown_connections 2024-04-25T01:39:59.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.373+0000 7f9dac864640 1 --2- 172.21.15.77:0/3886979838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9da80c6c50 0x7f9da80abf90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.373+0000 7f9dac864640 1 -- 172.21.15.77:0/3886979838 >> 172.21.15.77:0/3886979838 conn(0x7f9da80c7580 msgr2=0x7f9da80c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:59.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.373+0000 7f9dac864640 1 -- 172.21.15.77:0/3886979838 shutdown_connections 2024-04-25T01:39:59.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.373+0000 7f9dac864640 1 -- 172.21.15.77:0/3886979838 wait complete. 2024-04-25T01:39:59.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.375+0000 7f9dac864640 1 Processor -- start 2024-04-25T01:39:59.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.375+0000 7f9dac864640 1 -- start start 2024-04-25T01:39:59.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.375+0000 7f9dac864640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9da806d470 0x7f9da80c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:59.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.375+0000 7f9dac864640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9da80c4d10 0x7f9da814d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:59.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.375+0000 7f9dac864640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9da80c6c50 0x7f9da81eb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:59.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.375+0000 7f9dac864640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9da80ac860 con 0x7f9da806d470 2024-04-25T01:39:59.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.375+0000 7f9dac864640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9da80ac6e0 con 0x7f9da80c6c50 2024-04-25T01:39:59.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.375+0000 7f9dac864640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9da80c2a50 con 0x7f9da80c4d10 2024-04-25T01:39:59.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.375+0000 7f9da659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9da806d470 0x7f9da80c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:59.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.375+0000 7f9da659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9da806d470 0x7f9da80c0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38820/0 (socket says 172.21.15.77:38820) 2024-04-25T01:39:59.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.375+0000 7f9da659c640 1 -- 172.21.15.77:0/3940990638 learned_addr learned my addr 172.21.15.77:0/3940990638 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:59.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.376+0000 7f9da6d9d640 1 --2- 172.21.15.77:0/3940990638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9da80c6c50 0x7f9da81eb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:59.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.376+0000 7f9d9ffff640 1 --2- 172.21.15.77:0/3940990638 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9da80c4d10 0x7f9da814d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:59.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.376+0000 7f9da659c640 1 -- 172.21.15.77:0/3940990638 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9da80c4d10 msgr2=0x7f9da814d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:59.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.376+0000 7f9da659c640 1 --2- 172.21.15.77:0/3940990638 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9da80c4d10 0x7f9da814d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.376+0000 7f9da659c640 1 -- 172.21.15.77:0/3940990638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9da80c6c50 msgr2=0x7f9da81eb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:59.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.376+0000 7f9da659c640 1 --2- 172.21.15.77:0/3940990638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9da80c6c50 0x7f9da81eb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.376+0000 7f9da659c640 1 -- 172.21.15.77:0/3940990638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da81de3f0 con 0x7f9da806d470 2024-04-25T01:39:59.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.376+0000 7f9da6d9d640 1 --2- 172.21.15.77:0/3940990638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9da80c6c50 0x7f9da81eb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:59.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.376+0000 7f9d9ffff640 1 --2- 172.21.15.77:0/3940990638 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9da80c4d10 0x7f9da814d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:59.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.376+0000 7f9da659c640 1 --2- 172.21.15.77:0/3940990638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9da806d470 0x7f9da80c0c20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9d9800c450 tx=0x7f9d9800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:59.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.376+0000 7f9d9effd640 1 -- 172.21.15.77:0/3940990638 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d980052d0 con 0x7f9da806d470 2024-04-25T01:39:59.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.376+0000 7f9d9effd640 1 -- 172.21.15.77:0/3940990638 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d98005470 con 0x7f9da806d470 2024-04-25T01:39:59.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.376+0000 7f9dac864640 1 -- 172.21.15.77:0/3940990638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9da81de6d0 con 0x7f9da806d470 2024-04-25T01:39:59.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.376+0000 7f9d9effd640 1 -- 172.21.15.77:0/3940990638 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d98012870 con 0x7f9da806d470 2024-04-25T01:39:59.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.376+0000 7f9dac864640 1 -- 172.21.15.77:0/3940990638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9da81dbec0 con 0x7f9da806d470 2024-04-25T01:39:59.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.377+0000 7f9dac864640 1 -- 172.21.15.77:0/3940990638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9da804f500 con 0x7f9da806d470 2024-04-25T01:39:59.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.377+0000 7f9d9effd640 1 -- 172.21.15.77:0/3940990638 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9d98012a10 con 0x7f9da806d470 2024-04-25T01:39:59.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.378+0000 7f9d9effd640 1 --2- 172.21.15.77:0/3940990638 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9d8806be30 0x7f9d8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:59.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.378+0000 7f9d9effd640 1 -- 172.21.15.77:0/3940990638 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f9d9808acf0 con 0x7f9da806d470 2024-04-25T01:39:59.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.378+0000 7f9d9ffff640 1 --2- 172.21.15.77:0/3940990638 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9d8806be30 0x7f9d8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:59.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.378+0000 7f9d9ffff640 1 --2- 172.21.15.77:0/3940990638 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9d8806be30 0x7f9d8806e2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9d90035000 tx=0x7f9d9000c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:59.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.382+0000 7f9d9effd640 1 -- 172.21.15.77:0/3940990638 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9d9808f070 con 0x7f9da806d470 2024-04-25T01:39:59.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.558+0000 7f9dac864640 1 -- 172.21.15.77:0/3940990638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7f9da80c1160 con 0x7f9da806d470 2024-04-25T01:39:59.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.558+0000 7f9d9effd640 1 -- 172.21.15.77:0/3940990638 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v24) ==== 95+0+11 (secure 0 0 0) 0x7f9d98059400 con 0x7f9da806d470 2024-04-25T01:39:59.542 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-25T01:39:59.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.560+0000 7f9dac864640 1 -- 172.21.15.77:0/3940990638 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9d8806be30 msgr2=0x7f9d8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:59.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.560+0000 7f9dac864640 1 --2- 172.21.15.77:0/3940990638 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9d8806be30 0x7f9d8806e2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9d90035000 tx=0x7f9d9000c040 comp rx=0 tx=0).stop 2024-04-25T01:39:59.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.560+0000 7f9dac864640 1 -- 172.21.15.77:0/3940990638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9da806d470 msgr2=0x7f9da80c0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:59.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.560+0000 7f9dac864640 1 --2- 172.21.15.77:0/3940990638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9da806d470 0x7f9da80c0c20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9d9800c450 tx=0x7f9d9800c910 comp rx=0 tx=0).stop 2024-04-25T01:39:59.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.560+0000 7f9dac864640 1 -- 172.21.15.77:0/3940990638 shutdown_connections 2024-04-25T01:39:59.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.560+0000 7f9dac864640 1 --2- 172.21.15.77:0/3940990638 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9d8806be30 0x7f9d8806e2f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.560+0000 7f9dac864640 1 --2- 172.21.15.77:0/3940990638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9da80c6c50 0x7f9da81eb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.560+0000 7f9dac864640 1 --2- 172.21.15.77:0/3940990638 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9da80c4d10 0x7f9da814d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.560+0000 7f9dac864640 1 --2- 172.21.15.77:0/3940990638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9da806d470 0x7f9da80c0c20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.560+0000 7f9dac864640 1 -- 172.21.15.77:0/3940990638 >> 172.21.15.77:0/3940990638 conn(0x7f9da80c7580 msgr2=0x7f9da80c64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:59.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.560+0000 7f9dac864640 1 -- 172.21.15.77:0/3940990638 shutdown_connections 2024-04-25T01:39:59.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.560+0000 7f9dac864640 1 -- 172.21.15.77:0/3940990638 wait complete. 2024-04-25T01:39:59.555 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-25T01:39:59.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.670+0000 7f5c092a5640 1 Processor -- start 2024-04-25T01:39:59.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.670+0000 7f5c092a5640 1 -- start start 2024-04-25T01:39:59.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.671+0000 7f5c092a5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5c04153530 0x7f5c040c6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:59.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.671+0000 7f5c092a5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c040c97c0 0x7f5c04159d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:59.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.671+0000 7f5c092a5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c0406d110 con 0x7f5c040bef50 2024-04-25T01:39:59.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.671+0000 7f5c092a5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f5c04153910 con 0x7f5c04153530 2024-04-25T01:39:59.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.671+0000 7f5c092a5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f5c04156980 con 0x7f5c040c97c0 2024-04-25T01:39:59.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.671+0000 7f5c02ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5c04153530 0x7f5c040c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:59.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.671+0000 7f5c027fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f5c040bef50 0x7f5c041595f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59424/0 (socket says 172.21.15.77:59424) 2024-04-25T01:39:59.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.671+0000 7f5c027fc640 1 -- 172.21.15.77:0/3897081078 learned_addr learned my addr 172.21.15.77:0/3897081078 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:59.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.671+0000 7f5c01ffb640 1 -- 172.21.15.77:0/3897081078 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2887479352 0 0) 0x7f5c0406d110 con 0x7f5c040bef50 2024-04-25T01:39:59.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.671+0000 7f5c037fe640 1 --2- 172.21.15.77:0/3897081078 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c040c97c0 0x7f5c04159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:59.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.671+0000 7f5c01ffb640 1 -- 172.21.15.77:0/3897081078 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bec003520 con 0x7f5c040bef50 2024-04-25T01:39:59.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.671+0000 7f5c02ffd640 1 -- 172.21.15.77:0/3897081078 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c040c97c0 msgr2=0x7f5c04159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:59.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.671+0000 7f5c02ffd640 1 --2- 172.21.15.77:0/3897081078 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c040c97c0 0x7f5c04159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.671+0000 7f5c02ffd640 1 -- 172.21.15.77:0/3897081078 >> v1:172.21.15.77:6789/0 conn(0x7f5c040bef50 legacy=0x7f5c041595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:59.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.671+0000 7f5c02ffd640 1 -- 172.21.15.77:0/3897081078 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c04156c60 con 0x7f5c04153530 2024-04-25T01:39:59.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.671+0000 7f5c037fe640 1 --2- 172.21.15.77:0/3897081078 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c040c97c0 0x7f5c04159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:59.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.672+0000 7f5c02ffd640 1 --2- 172.21.15.77:0/3897081078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c04153530 0x7f5c040c6240 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5bf40097a0 tx=0x7f5bf402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c8ea91c61d91c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:59.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.672+0000 7f5c01ffb640 1 -- 172.21.15.77:0/3897081078 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4037070 con 0x7f5c04153530 2024-04-25T01:39:59.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.672+0000 7f5c01ffb640 1 -- 172.21.15.77:0/3897081078 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf402ae50 con 0x7f5c04153530 2024-04-25T01:39:59.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.672+0000 7f5c01ffb640 1 -- 172.21.15.77:0/3897081078 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4032660 con 0x7f5c04153530 2024-04-25T01:39:59.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.673+0000 7f5c092a5640 1 -- 172.21.15.77:0/3897081078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c04153530 msgr2=0x7f5c040c6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:59.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.673+0000 7f5c092a5640 1 --2- 172.21.15.77:0/3897081078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c04153530 0x7f5c040c6240 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5bf40097a0 tx=0x7f5bf402a100 comp rx=0 tx=0).stop 2024-04-25T01:39:59.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.673+0000 7f5c092a5640 1 -- 172.21.15.77:0/3897081078 shutdown_connections 2024-04-25T01:39:59.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.673+0000 7f5c092a5640 1 --2- 172.21.15.77:0/3897081078 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c040c97c0 0x7f5c04159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.673+0000 7f5c092a5640 1 --2- 172.21.15.77:0/3897081078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c04153530 0x7f5c040c6240 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.673+0000 7f5c092a5640 1 -- 172.21.15.77:0/3897081078 >> 172.21.15.77:0/3897081078 conn(0x7f5c040672c0 msgr2=0x7f5c040676d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:59.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.673+0000 7f5c092a5640 1 -- 172.21.15.77:0/3897081078 shutdown_connections 2024-04-25T01:39:59.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.673+0000 7f5c092a5640 1 -- 172.21.15.77:0/3897081078 wait complete. 2024-04-25T01:39:59.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.674+0000 7f5c092a5640 1 Processor -- start 2024-04-25T01:39:59.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.674+0000 7f5c092a5640 1 -- start start 2024-04-25T01:39:59.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.675+0000 7f5c092a5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c040bef50 0x7f5c041ec390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:59.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.675+0000 7f5c092a5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c040c97c0 0x7f5c040c5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:59.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.675+0000 7f5c092a5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c04153530 0x7f5c04157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:59.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.675+0000 7f5c092a5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0415a240 con 0x7f5c04153530 2024-04-25T01:39:59.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.675+0000 7f5c092a5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5c040cc250 con 0x7f5c040c97c0 2024-04-25T01:39:59.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.675+0000 7f5c092a5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f5c040c6780 con 0x7f5c040bef50 2024-04-25T01:39:59.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.675+0000 7f5c037fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c04153530 0x7f5c04157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:59.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.675+0000 7f5c037fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c04153530 0x7f5c04157830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38844/0 (socket says 172.21.15.77:38844) 2024-04-25T01:39:59.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.675+0000 7f5c037fe640 1 -- 172.21.15.77:0/586521091 learned_addr learned my addr 172.21.15.77:0/586521091 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:59.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.675+0000 7f5c02ffd640 1 --2- 172.21.15.77:0/586521091 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c040bef50 0x7f5c041ec390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:59.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.675+0000 7f5c027fc640 1 --2- 172.21.15.77:0/586521091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c040c97c0 0x7f5c040c5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:59.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.675+0000 7f5c037fe640 1 -- 172.21.15.77:0/586521091 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c040bef50 msgr2=0x7f5c041ec390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:59.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.675+0000 7f5c037fe640 1 --2- 172.21.15.77:0/586521091 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c040bef50 0x7f5c041ec390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.675+0000 7f5c037fe640 1 -- 172.21.15.77:0/586521091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c040c97c0 msgr2=0x7f5c040c5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:59.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.675+0000 7f5c037fe640 1 --2- 172.21.15.77:0/586521091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c040c97c0 0x7f5c040c5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.675+0000 7f5c037fe640 1 -- 172.21.15.77:0/586521091 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c040c2fc0 con 0x7f5c04153530 2024-04-25T01:39:59.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.675+0000 7f5c02ffd640 1 --2- 172.21.15.77:0/586521091 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c040bef50 0x7f5c041ec390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:59.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.675+0000 7f5c027fc640 1 --2- 172.21.15.77:0/586521091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c040c97c0 0x7f5c040c5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:39:59.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.675+0000 7f5c037fe640 1 --2- 172.21.15.77:0/586521091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c04153530 0x7f5c04157830 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc00cef0 tx=0x7f5bfc00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:59.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.675+0000 7f5beb7fe640 1 -- 172.21.15.77:0/586521091 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc01a070 con 0x7f5c04153530 2024-04-25T01:39:59.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.675+0000 7f5beb7fe640 1 -- 172.21.15.77:0/586521091 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bfc00d860 con 0x7f5c04153530 2024-04-25T01:39:59.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.675+0000 7f5c092a5640 1 -- 172.21.15.77:0/586521091 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c040c32a0 con 0x7f5c04153530 2024-04-25T01:39:59.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.675+0000 7f5beb7fe640 1 -- 172.21.15.77:0/586521091 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc00dc50 con 0x7f5c04153530 2024-04-25T01:39:59.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.675+0000 7f5c092a5640 1 -- 172.21.15.77:0/586521091 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c04159360 con 0x7f5c04153530 2024-04-25T01:39:59.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.676+0000 7f5c092a5640 1 -- 172.21.15.77:0/586521091 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c0404f500 con 0x7f5c04153530 2024-04-25T01:39:59.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.677+0000 7f5beb7fe640 1 -- 172.21.15.77:0/586521091 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5bfc01d070 con 0x7f5c04153530 2024-04-25T01:39:59.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.677+0000 7f5beb7fe640 1 --2- 172.21.15.77:0/586521091 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5bf006be30 0x7f5bf006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:59.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.677+0000 7f5c02ffd640 1 --2- 172.21.15.77:0/586521091 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5bf006be30 0x7f5bf006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:59.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.678+0000 7f5beb7fe640 1 -- 172.21.15.77:0/586521091 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f5bfc08b940 con 0x7f5c04153530 2024-04-25T01:39:59.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.678+0000 7f5c02ffd640 1 --2- 172.21.15.77:0/586521091 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5bf006be30 0x7f5bf006e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4034000 tx=0x7f5bf402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:59.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.682+0000 7f5beb7fe640 1 -- 172.21.15.77:0/586521091 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5bfc05a050 con 0x7f5c04153530 2024-04-25T01:39:59.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.853+0000 7f5c092a5640 1 -- 172.21.15.77:0/586521091 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7f5c040c61e0 con 0x7f5c04153530 2024-04-25T01:39:59.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.853+0000 7f5beb7fe640 1 -- 172.21.15.77:0/586521091 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v24) ==== 99+0+11 (secure 0 0 0) 0x7f5bfc059950 con 0x7f5c04153530 2024-04-25T01:39:59.837 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T01:39:59.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.855+0000 7f5c092a5640 1 -- 172.21.15.77:0/586521091 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5bf006be30 msgr2=0x7f5bf006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:59.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.855+0000 7f5c092a5640 1 --2- 172.21.15.77:0/586521091 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5bf006be30 0x7f5bf006e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4034000 tx=0x7f5bf402e000 comp rx=0 tx=0).stop 2024-04-25T01:39:59.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.855+0000 7f5c092a5640 1 -- 172.21.15.77:0/586521091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c04153530 msgr2=0x7f5c04157830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:59.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.855+0000 7f5c092a5640 1 --2- 172.21.15.77:0/586521091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c04153530 0x7f5c04157830 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc00cef0 tx=0x7f5bfc00a710 comp rx=0 tx=0).stop 2024-04-25T01:39:59.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.855+0000 7f5c092a5640 1 -- 172.21.15.77:0/586521091 shutdown_connections 2024-04-25T01:39:59.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.855+0000 7f5c092a5640 1 --2- 172.21.15.77:0/586521091 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5bf006be30 0x7f5bf006e2f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.855+0000 7f5c092a5640 1 --2- 172.21.15.77:0/586521091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c04153530 0x7f5c04157830 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.855+0000 7f5c092a5640 1 --2- 172.21.15.77:0/586521091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c040c97c0 0x7f5c040c5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.855+0000 7f5c092a5640 1 --2- 172.21.15.77:0/586521091 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c040bef50 0x7f5c041ec390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.855+0000 7f5c092a5640 1 -- 172.21.15.77:0/586521091 >> 172.21.15.77:0/586521091 conn(0x7f5c040672c0 msgr2=0x7f5c040ca6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:59.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.855+0000 7f5c092a5640 1 -- 172.21.15.77:0/586521091 shutdown_connections 2024-04-25T01:39:59.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.855+0000 7f5c092a5640 1 -- 172.21.15.77:0/586521091 wait complete. 2024-04-25T01:39:59.850 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-25T01:39:59.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.965+0000 7f3956faf640 1 Processor -- start 2024-04-25T01:39:59.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.965+0000 7f3956faf640 1 -- start start 2024-04-25T01:39:59.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.966+0000 7f3956faf640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f39500c4280 0x7f3950153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:59.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.966+0000 7f3956faf640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f39500aca40 0x7f39501511f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:59.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.966+0000 7f3956faf640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3950154430 con 0x7f3950151730 2024-04-25T01:39:59.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.966+0000 7f3956faf640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f3950151b40 con 0x7f39500c4280 2024-04-25T01:39:59.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.966+0000 7f3956faf640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f39501546b0 con 0x7f39500aca40 2024-04-25T01:39:59.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.966+0000 7f3954d4b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f39500c4280 0x7f3950153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:59.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.966+0000 7f395554c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3950151730 0x7f395006d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59426/0 (socket says 172.21.15.77:59426) 2024-04-25T01:39:59.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.966+0000 7f395554c640 1 -- 172.21.15.77:0/1076786363 learned_addr learned my addr 172.21.15.77:0/1076786363 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:39:59.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.966+0000 7f394ffff640 1 --2- 172.21.15.77:0/1076786363 >> v2:172.21.15.121:3300/0 conn(0x7f39500aca40 0x7f39501511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:59.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.966+0000 7f3954d4b640 1 -- 172.21.15.77:0/1076786363 >> v2:172.21.15.121:3300/0 conn(0x7f39500aca40 msgr2=0x7f39501511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:39:59.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.966+0000 7f3954d4b640 1 --2- 172.21.15.77:0/1076786363 >> v2:172.21.15.121:3300/0 conn(0x7f39500aca40 0x7f39501511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.966+0000 7f394f7fe640 1 -- 172.21.15.77:0/1076786363 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1509532688 0 0) 0x7f3948001490 con 0x7f3950151730 2024-04-25T01:39:59.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.966+0000 7f3954d4b640 1 -- 172.21.15.77:0/1076786363 >> v1:172.21.15.77:6789/0 conn(0x7f3950151730 legacy=0x7f395006d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:59.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.966+0000 7f3954d4b640 1 -- 172.21.15.77:0/1076786363 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3950154990 con 0x7f39500c4280 2024-04-25T01:39:59.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.966+0000 7f394ffff640 1 --2- 172.21.15.77:0/1076786363 >> v2:172.21.15.121:3300/0 conn(0x7f39500aca40 0x7f39501511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:39:59.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.967+0000 7f3954d4b640 1 --2- 172.21.15.77:0/1076786363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39500c4280 0x7f3950153ef0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f39500c7530 tx=0x7f394002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c59accc955938fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:59.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.967+0000 7f394f7fe640 1 -- 172.21.15.77:0/1076786363 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3940037070 con 0x7f39500c4280 2024-04-25T01:39:59.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.967+0000 7f394f7fe640 1 -- 172.21.15.77:0/1076786363 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3940032440 con 0x7f39500c4280 2024-04-25T01:39:59.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.967+0000 7f394f7fe640 1 -- 172.21.15.77:0/1076786363 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394002ae60 con 0x7f39500c4280 2024-04-25T01:39:59.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.968+0000 7f3956faf640 1 -- 172.21.15.77:0/1076786363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39500c4280 msgr2=0x7f3950153ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:59.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.968+0000 7f3956faf640 1 --2- 172.21.15.77:0/1076786363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39500c4280 0x7f3950153ef0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f39500c7530 tx=0x7f394002a110 comp rx=0 tx=0).stop 2024-04-25T01:39:59.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.968+0000 7f3956faf640 1 -- 172.21.15.77:0/1076786363 shutdown_connections 2024-04-25T01:39:59.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.968+0000 7f3956faf640 1 --2- 172.21.15.77:0/1076786363 >> v2:172.21.15.121:3300/0 conn(0x7f39500aca40 0x7f39501511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.968+0000 7f3956faf640 1 --2- 172.21.15.77:0/1076786363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39500c4280 0x7f3950153ef0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.968+0000 7f3956faf640 1 -- 172.21.15.77:0/1076786363 >> 172.21.15.77:0/1076786363 conn(0x7f39500c7580 msgr2=0x7f39500c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:39:59.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.968+0000 7f3956faf640 1 -- 172.21.15.77:0/1076786363 shutdown_connections 2024-04-25T01:39:59.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.968+0000 7f3956faf640 1 -- 172.21.15.77:0/1076786363 wait complete. 2024-04-25T01:39:59.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.969+0000 7f3956faf640 1 Processor -- start 2024-04-25T01:39:59.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.969+0000 7f3956faf640 1 -- start start 2024-04-25T01:39:59.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.970+0000 7f3956faf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39500aca40 0x7f39501ebe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:59.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.970+0000 7f3956faf640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f39500c4280 0x7f39500ab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:59.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.970+0000 7f3956faf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3950151730 0x7f39501efc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:59.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.970+0000 7f3956faf640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f39500c4660 con 0x7f39500aca40 2024-04-25T01:39:59.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.970+0000 7f3956faf640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f395006d3a0 con 0x7f3950151730 2024-04-25T01:39:59.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.970+0000 7f3956faf640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f39500c47e0 con 0x7f39500c4280 2024-04-25T01:39:59.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.970+0000 7f3954d4b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39500aca40 0x7f39501ebe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:59.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.970+0000 7f3954d4b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39500aca40 0x7f39501ebe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38858/0 (socket says 172.21.15.77:38858) 2024-04-25T01:39:59.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.970+0000 7f3954d4b640 1 -- 172.21.15.77:0/2086938346 learned_addr learned my addr 172.21.15.77:0/2086938346 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:39:59.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.970+0000 7f3954d4b640 1 -- 172.21.15.77:0/2086938346 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f39500c4280 msgr2=0x7f39500ab9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:59.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.970+0000 7f3954d4b640 1 --2- 172.21.15.77:0/2086938346 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f39500c4280 0x7f39500ab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.970+0000 7f3954d4b640 1 -- 172.21.15.77:0/2086938346 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3950151730 msgr2=0x7f39501efc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:39:59.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.970+0000 7f3954d4b640 1 --2- 172.21.15.77:0/2086938346 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3950151730 0x7f39501efc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:39:59.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.970+0000 7f3954d4b640 1 -- 172.21.15.77:0/2086938346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3950153720 con 0x7f39500aca40 2024-04-25T01:39:59.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.970+0000 7f3954d4b640 1 --2- 172.21.15.77:0/2086938346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39500aca40 0x7f39501ebe40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3940000c00 tx=0x7f39400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:59.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.970+0000 7f394d7fa640 1 -- 172.21.15.77:0/2086938346 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3940037040 con 0x7f39500aca40 2024-04-25T01:39:59.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.970+0000 7f394d7fa640 1 -- 172.21.15.77:0/2086938346 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3940042070 con 0x7f39500aca40 2024-04-25T01:39:59.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.970+0000 7f3956faf640 1 -- 172.21.15.77:0/2086938346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3950153a00 con 0x7f39500aca40 2024-04-25T01:39:59.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.970+0000 7f394d7fa640 1 -- 172.21.15.77:0/2086938346 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3940030a50 con 0x7f39500aca40 2024-04-25T01:39:59.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.970+0000 7f3956faf640 1 -- 172.21.15.77:0/2086938346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39501ef450 con 0x7f39500aca40 2024-04-25T01:39:59.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.971+0000 7f3956faf640 1 -- 172.21.15.77:0/2086938346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f395014d5f0 con 0x7f39500aca40 2024-04-25T01:39:59.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.972+0000 7f394d7fa640 1 -- 172.21.15.77:0/2086938346 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3940030bf0 con 0x7f39500aca40 2024-04-25T01:39:59.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.972+0000 7f394d7fa640 1 --2- 172.21.15.77:0/2086938346 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f393c06be60 0x7f393c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:39:59.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.972+0000 7f394d7fa640 1 -- 172.21.15.77:0/2086938346 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f39400abb80 con 0x7f39500aca40 2024-04-25T01:39:59.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.972+0000 7f394ffff640 1 --2- 172.21.15.77:0/2086938346 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f393c06be60 0x7f393c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:39:59.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.973+0000 7f394ffff640 1 --2- 172.21.15.77:0/2086938346 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f393c06be60 0x7f393c06e320 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3944006fd0 tx=0x7f3944008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:39:59.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:39:59.976+0000 7f394d7fa640 1 -- 172.21.15.77:0/2086938346 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f395014d5f0 con 0x7f39500aca40 2024-04-25T01:40:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.149+0000 7f3956faf640 1 -- 172.21.15.77:0/2086938346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7f395014ffa0 con 0x7f39500aca40 2024-04-25T01:40:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.149+0000 7f394d7fa640 1 -- 172.21.15.77:0/2086938346 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v24) ==== 95+0+11 (secure 0 0 0) 0x7f3940045360 con 0x7f39500aca40 2024-04-25T01:40:00.133 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-25T01:40:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.151+0000 7f3956faf640 1 -- 172.21.15.77:0/2086938346 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f393c06be60 msgr2=0x7f393c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.151+0000 7f3956faf640 1 --2- 172.21.15.77:0/2086938346 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f393c06be60 0x7f393c06e320 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3944006fd0 tx=0x7f3944008040 comp rx=0 tx=0).stop 2024-04-25T01:40:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.151+0000 7f3956faf640 1 -- 172.21.15.77:0/2086938346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39500aca40 msgr2=0x7f39501ebe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.151+0000 7f3956faf640 1 --2- 172.21.15.77:0/2086938346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39500aca40 0x7f39501ebe40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3940000c00 tx=0x7f39400046c0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.151+0000 7f3956faf640 1 -- 172.21.15.77:0/2086938346 shutdown_connections 2024-04-25T01:40:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.151+0000 7f3956faf640 1 --2- 172.21.15.77:0/2086938346 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f393c06be60 0x7f393c06e320 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.151+0000 7f3956faf640 1 --2- 172.21.15.77:0/2086938346 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3950151730 0x7f39501efc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.151+0000 7f3956faf640 1 --2- 172.21.15.77:0/2086938346 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f39500c4280 0x7f39500ab9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.151+0000 7f3956faf640 1 --2- 172.21.15.77:0/2086938346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39500aca40 0x7f39501ebe40 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.151+0000 7f3956faf640 1 -- 172.21.15.77:0/2086938346 >> 172.21.15.77:0/2086938346 conn(0x7f39500c7580 msgr2=0x7f39500c7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.151+0000 7f3956faf640 1 -- 172.21.15.77:0/2086938346 shutdown_connections 2024-04-25T01:40:00.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.151+0000 7f3956faf640 1 -- 172.21.15.77:0/2086938346 wait complete. 2024-04-25T01:40:00.146 INFO:tasks.mds_thrash:mds thrasher using random seed: 1714009200 2024-04-25T01:40:00.146 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T01:40:00.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.262+0000 7f761949a640 1 Processor -- start 2024-04-25T01:40:00.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.262+0000 7f761949a640 1 -- start start 2024-04-25T01:40:00.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.263+0000 7f761949a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7614156c80 0x7f76140c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:00.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.263+0000 7f761949a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f761406c280 0x7f76140c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:00.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.263+0000 7f761949a640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7614157130 con 0x7f7614150090 2024-04-25T01:40:00.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.263+0000 7f761949a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f761406b830 con 0x7f761406c280 2024-04-25T01:40:00.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.263+0000 7f761949a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f76140c9de0 con 0x7f7614156c80 2024-04-25T01:40:00.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.263+0000 7f76137fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f761406c280 0x7f76140c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:00.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.263+0000 7f76137fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f761406c280 0x7f76140c6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38862/0 (socket says 172.21.15.77:38862) 2024-04-25T01:40:00.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.263+0000 7f76137fe640 1 -- 172.21.15.77:0/2164226037 learned_addr learned my addr 172.21.15.77:0/2164226037 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:00.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.263+0000 7f76137fe640 1 -- 172.21.15.77:0/2164226037 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7614156c80 msgr2=0x7f76140c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:00.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.263+0000 7f76137fe640 1 --2- 172.21.15.77:0/2164226037 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7614156c80 0x7f76140c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.263+0000 7f76137fe640 1 -- 172.21.15.77:0/2164226037 >> v1:172.21.15.121:6789/0 conn(0x7f7614150090 legacy=0x7f76140c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:00.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.263+0000 7f76137fe640 1 -- 172.21.15.77:0/2164226037 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76140c89c0 con 0x7f761406c280 2024-04-25T01:40:00.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.264+0000 7f76137fe640 1 --2- 172.21.15.77:0/2164226037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f761406c280 0x7f76140c6320 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7604009870 tx=0x7f760402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c3032ff701333e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:00.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.264+0000 7f7611ffb640 1 -- 172.21.15.77:0/2164226037 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7604037070 con 0x7f761406c280 2024-04-25T01:40:00.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.264+0000 7f7611ffb640 1 -- 172.21.15.77:0/2164226037 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7604032440 con 0x7f761406c280 2024-04-25T01:40:00.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.264+0000 7f7611ffb640 1 -- 172.21.15.77:0/2164226037 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7604032810 con 0x7f761406c280 2024-04-25T01:40:00.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.264+0000 7f761949a640 1 -- 172.21.15.77:0/2164226037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f761406c280 msgr2=0x7f76140c6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:00.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.264+0000 7f761949a640 1 --2- 172.21.15.77:0/2164226037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f761406c280 0x7f76140c6320 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7604009870 tx=0x7f760402a210 comp rx=0 tx=0).stop 2024-04-25T01:40:00.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.264+0000 7f761949a640 1 -- 172.21.15.77:0/2164226037 shutdown_connections 2024-04-25T01:40:00.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.264+0000 7f761949a640 1 --2- 172.21.15.77:0/2164226037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f761406c280 0x7f76140c6320 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.264+0000 7f761949a640 1 --2- 172.21.15.77:0/2164226037 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7614156c80 0x7f76140c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.264+0000 7f761949a640 1 -- 172.21.15.77:0/2164226037 >> 172.21.15.77:0/2164226037 conn(0x7f76140ad4d0 msgr2=0x7f76140ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:00.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.264+0000 7f761949a640 1 -- 172.21.15.77:0/2164226037 shutdown_connections 2024-04-25T01:40:00.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.264+0000 7f761949a640 1 -- 172.21.15.77:0/2164226037 wait complete. 2024-04-25T01:40:00.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.266+0000 7f761949a640 1 Processor -- start 2024-04-25T01:40:00.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.266+0000 7f761949a640 1 -- start start 2024-04-25T01:40:00.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.266+0000 7f761949a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f761406c280 0x7f76141ebf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:00.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.266+0000 7f761949a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7614150090 0x7f76141597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:00.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.266+0000 7f761949a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7614156c80 0x7f76140c4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:00.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.266+0000 7f761949a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f761406bd60 con 0x7f7614156c80 2024-04-25T01:40:00.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.266+0000 7f761949a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f761406ba80 con 0x7f7614150090 2024-04-25T01:40:00.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.266+0000 7f761949a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f761406c6d0 con 0x7f761406c280 2024-04-25T01:40:00.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.266+0000 7f76137fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7614156c80 0x7f76140c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:00.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.266+0000 7f76137fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7614156c80 0x7f76140c4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38872/0 (socket says 172.21.15.77:38872) 2024-04-25T01:40:00.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.266+0000 7f76137fe640 1 -- 172.21.15.77:0/932462496 learned_addr learned my addr 172.21.15.77:0/932462496 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:00.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.267+0000 7f76137fe640 1 -- 172.21.15.77:0/932462496 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f761406c280 msgr2=0x7f76141ebf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:00.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.267+0000 7f76137fe640 1 --2- 172.21.15.77:0/932462496 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f761406c280 0x7f76141ebf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.267+0000 7f76137fe640 1 -- 172.21.15.77:0/932462496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7614150090 msgr2=0x7f76141597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:00.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.267+0000 7f76137fe640 1 --2- 172.21.15.77:0/932462496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7614150090 0x7f76141597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.267+0000 7f76137fe640 1 -- 172.21.15.77:0/932462496 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7614155ef0 con 0x7f7614156c80 2024-04-25T01:40:00.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.267+0000 7f76137fe640 1 --2- 172.21.15.77:0/932462496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7614156c80 0x7f76140c4180 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f760402a250 tx=0x7f76040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:00.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.267+0000 7f75fb7fe640 1 -- 172.21.15.77:0/932462496 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7604037040 con 0x7f7614156c80 2024-04-25T01:40:00.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.267+0000 7f75fb7fe640 1 -- 172.21.15.77:0/932462496 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7604042070 con 0x7f7614156c80 2024-04-25T01:40:00.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.267+0000 7f75fb7fe640 1 -- 172.21.15.77:0/932462496 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7604030c90 con 0x7f7614156c80 2024-04-25T01:40:00.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.267+0000 7f761949a640 1 -- 172.21.15.77:0/932462496 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76141ec6e0 con 0x7f7614156c80 2024-04-25T01:40:00.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.267+0000 7f761949a640 1 -- 172.21.15.77:0/932462496 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76141ecca0 con 0x7f7614156c80 2024-04-25T01:40:00.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.268+0000 7f761949a640 1 -- 172.21.15.77:0/932462496 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f761404f500 con 0x7f7614156c80 2024-04-25T01:40:00.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.268+0000 7f75fb7fe640 1 -- 172.21.15.77:0/932462496 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7604047460 con 0x7f7614156c80 2024-04-25T01:40:00.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.269+0000 7f75fb7fe640 1 --2- 172.21.15.77:0/932462496 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f760006be60 0x7f760006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:00.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.269+0000 7f75fb7fe640 1 -- 172.21.15.77:0/932462496 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f76040abd50 con 0x7f7614156c80 2024-04-25T01:40:00.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.269+0000 7f7612ffd640 1 --2- 172.21.15.77:0/932462496 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f760006be60 0x7f760006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:00.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.269+0000 7f7612ffd640 1 --2- 172.21.15.77:0/932462496 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f760006be60 0x7f760006e320 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f760c001c60 tx=0x7f760c007d10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:00.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.273+0000 7f75fb7fe640 1 -- 172.21.15.77:0/932462496 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f76040af030 con 0x7f7614156c80 2024-04-25T01:40:00.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.446+0000 7f761949a640 1 -- 172.21.15.77:0/932462496 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76140c3ac0 con 0x7f7614156c80 2024-04-25T01:40:00.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.447+0000 7f75fb7fe640 1 -- 172.21.15.77:0/932462496 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20331 (secure 0 0 0) 0x7f7614157130 con 0x7f7614156c80 2024-04-25T01:40:00.431 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:40:00.432 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:39:34.425701+0000","last_up_change":"2024-04-25T01:39:10.729600+0000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T01:39:11.681151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T01:39:21.606752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T01:39:22.677664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T01:39:30.501700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T01:39:31.740717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6811","nonce":3366980158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6817","nonce":3366980158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6828","nonce":3366980158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6825","nonce":3366980158}]},"public_addr":"172.21.15.77:6811/3366980158","cluster_addr":"172.21.15.77:6817/3366980158","heartbeat_back_addr":"172.21.15.77:6828/3366980158","heartbeat_front_addr":"172.21.15.77:6825/3366980158","state":["exists","up"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6801","nonce":3971619298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6803","nonce":3971619298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6807","nonce":3971619298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6805","nonce":3971619298}]},"public_addr":"172.21.15.77:6801/3971619298","cluster_addr":"172.21.15.77:6803/3971619298","heartbeat_back_addr":"172.21.15.77:6807/3971619298","heartbeat_front_addr":"172.21.15.77:6805/3971619298","state":["exists","up"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6810","nonce":4103452689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6813","nonce":4103452689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6823","nonce":4103452689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6818","nonce":4103452689}]},"public_addr":"172.21.15.77:6810/4103452689","cluster_addr":"172.21.15.77:6813/4103452689","heartbeat_back_addr":"172.21.15.77:6823/4103452689","heartbeat_front_addr":"172.21.15.77:6818/4103452689","state":["exists","up"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6819","nonce":217398906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6824","nonce":217398906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6831","nonce":217398906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6829","nonce":217398906}]},"public_addr":"172.21.15.77:6819/217398906","cluster_addr":"172.21.15.77:6824/217398906","heartbeat_back_addr":"172.21.15.77:6831/217398906","heartbeat_front_addr":"172.21.15.77:6829/217398906","state":["exists","up"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6801","nonce":2565483070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6803","nonce":2565483070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6810","nonce":2565483070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6806","nonce":2565483070}]},"public_addr":"172.21.15.121:6801/2565483070","cluster_addr":"172.21.15.121:6803/2565483070","heartbeat_back_addr":"172.21.15.121:6810/2565483070","heartbeat_front_addr":"172.21.15.121:6806/2565483070","state":["exists","up"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6807","nonce":2785294752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6809","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6811","nonce":2785294752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6815","nonce":2785294752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6813","nonce":2785294752}]},"public_addr":"172.21.15.121:6807/2785294752","cluster_addr":"172.21.15.121:6811/2785294752","heartbeat_back_addr":"172.21.15.121:6815/2785294752","heartbeat_front_addr":"172.21.15.121:6813/2785294752","state":["exists","up"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6820","nonce":523906818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6824","nonce":523906818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6831","nonce":523906818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6828","nonce":523906818}]},"public_addr":"172.21.15.121:6820/523906818","cluster_addr":"172.21.15.121:6824/523906818","heartbeat_back_addr":"172.21.15.121:6831/523906818","heartbeat_front_addr":"172.21.15.121:6828/523906818","state":["exists","up"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6817","nonce":1683602459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6819","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6821","nonce":1683602459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6829","nonce":1683602459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6823","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6825","nonce":1683602459}]},"public_addr":"172.21.15.121:6817/1683602459","cluster_addr":"172.21.15.121:6821/1683602459","heartbeat_back_addr":"172.21.15.121:6829/1683602459","heartbeat_front_addr":"172.21.15.121:6825/1683602459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.839443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.818842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.776243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.793085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.822396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.907311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.918374+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.848430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:40:00.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.449+0000 7f761949a640 1 -- 172.21.15.77:0/932462496 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f760006be60 msgr2=0x7f760006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:00.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.449+0000 7f761949a640 1 --2- 172.21.15.77:0/932462496 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f760006be60 0x7f760006e320 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f760c001c60 tx=0x7f760c007d10 comp rx=0 tx=0).stop 2024-04-25T01:40:00.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.449+0000 7f761949a640 1 -- 172.21.15.77:0/932462496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7614156c80 msgr2=0x7f76140c4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:00.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.449+0000 7f761949a640 1 --2- 172.21.15.77:0/932462496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7614156c80 0x7f76140c4180 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f760402a250 tx=0x7f76040046c0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.449+0000 7f761949a640 1 -- 172.21.15.77:0/932462496 shutdown_connections 2024-04-25T01:40:00.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.449+0000 7f761949a640 1 --2- 172.21.15.77:0/932462496 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f760006be60 0x7f760006e320 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.449+0000 7f761949a640 1 --2- 172.21.15.77:0/932462496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7614156c80 0x7f76140c4180 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.449+0000 7f761949a640 1 --2- 172.21.15.77:0/932462496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7614150090 0x7f76141597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.449+0000 7f761949a640 1 --2- 172.21.15.77:0/932462496 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f761406c280 0x7f76141ebf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.449+0000 7f761949a640 1 -- 172.21.15.77:0/932462496 >> 172.21.15.77:0/932462496 conn(0x7f76140ad4d0 msgr2=0x7f76140c6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:00.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.449+0000 7f761949a640 1 -- 172.21.15.77:0/932462496 shutdown_connections 2024-04-25T01:40:00.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.449+0000 7f761949a640 1 -- 172.21.15.77:0/932462496 wait complete. 2024-04-25T01:40:00.444 INFO:tasks.mds_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T01:39:11.681151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-25T01:39:21.606752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-25T01:39:22.677664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-25T01:39:30.501700+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-25T01:39:31.740717+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T01:40:00.445 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T01:40:00.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.564+0000 7f41bbd14640 1 Processor -- start 2024-04-25T01:40:00.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.564+0000 7f41bbd14640 1 -- start start 2024-04-25T01:40:00.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.565+0000 7f41bbd14640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f41b40c4280 0x7f41b4153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:00.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.565+0000 7f41bbd14640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41b4151900 0x7f41b406d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:00.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.565+0000 7f41bbd14640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41b4154430 con 0x7f41b40aca40 2024-04-25T01:40:00.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.565+0000 7f41bbd14640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f41b41546b0 con 0x7f41b40c4280 2024-04-25T01:40:00.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.565+0000 7f41bbd14640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f41b4154990 con 0x7f41b4151900 2024-04-25T01:40:00.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.565+0000 7f41b9ab0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f41b40c4280 0x7f41b4153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:00.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.565+0000 7f41b92af640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f41b40aca40 0x7f41b41511f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59430/0 (socket says 172.21.15.77:59430) 2024-04-25T01:40:00.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.565+0000 7f41b92af640 1 -- 172.21.15.77:0/3898780738 learned_addr learned my addr 172.21.15.77:0/3898780738 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:40:00.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.565+0000 7f41b9ab0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f41b40c4280 0x7f41b4153ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38880/0 (socket says 172.21.15.77:38880) 2024-04-25T01:40:00.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.565+0000 7f41b9ab0640 1 -- 172.21.15.77:0/3898780738 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41b4151900 msgr2=0x7f41b406d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:00.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.565+0000 7f41b9ab0640 1 --2- 172.21.15.77:0/3898780738 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41b4151900 0x7f41b406d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.565+0000 7f41b9ab0640 1 -- 172.21.15.77:0/3898780738 >> v1:172.21.15.77:6789/0 conn(0x7f41b40aca40 legacy=0x7f41b41511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:00.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.565+0000 7f41b8aae640 1 -- 172.21.15.77:0/3898780738 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2317988287 0 0) 0x7f41a4001110 con 0x7f41b40aca40 2024-04-25T01:40:00.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.565+0000 7f41b9ab0640 1 -- 172.21.15.77:0/3898780738 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b4154c70 con 0x7f41b40c4280 2024-04-25T01:40:00.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.566+0000 7f41b9ab0640 1 --2- 172.21.15.77:0/3898780738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41b40c4280 0x7f41b4153ef0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f41b00097a0 tx=0x7f41b002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5514b6583431b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:00.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.566+0000 7f41b8aae640 1 -- 172.21.15.77:0/3898780738 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b0037070 con 0x7f41b40c4280 2024-04-25T01:40:00.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.566+0000 7f41b8aae640 1 -- 172.21.15.77:0/3898780738 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41b002ae50 con 0x7f41b40c4280 2024-04-25T01:40:00.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.566+0000 7f41b8aae640 1 -- 172.21.15.77:0/3898780738 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b0032660 con 0x7f41b40c4280 2024-04-25T01:40:00.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.566+0000 7f41bbd14640 1 -- 172.21.15.77:0/3898780738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41b40c4280 msgr2=0x7f41b4153ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:00.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.566+0000 7f41bbd14640 1 --2- 172.21.15.77:0/3898780738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41b40c4280 0x7f41b4153ef0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f41b00097a0 tx=0x7f41b002a100 comp rx=0 tx=0).stop 2024-04-25T01:40:00.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.566+0000 7f41bbd14640 1 -- 172.21.15.77:0/3898780738 shutdown_connections 2024-04-25T01:40:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.566+0000 7f41bbd14640 1 --2- 172.21.15.77:0/3898780738 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41b4151900 0x7f41b406d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.566+0000 7f41bbd14640 1 --2- 172.21.15.77:0/3898780738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41b40c4280 0x7f41b4153ef0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.566+0000 7f41bbd14640 1 -- 172.21.15.77:0/3898780738 >> 172.21.15.77:0/3898780738 conn(0x7f41b40c7580 msgr2=0x7f41b40c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.566+0000 7f41bbd14640 1 -- 172.21.15.77:0/3898780738 shutdown_connections 2024-04-25T01:40:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.566+0000 7f41bbd14640 1 -- 172.21.15.77:0/3898780738 wait complete. 2024-04-25T01:40:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.567+0000 7f41bbd14640 1 Processor -- start 2024-04-25T01:40:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.568+0000 7f41bbd14640 1 -- start start 2024-04-25T01:40:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.568+0000 7f41bbd14640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41b40aca40 0x7f41b4072370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.568+0000 7f41bbd14640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41b40c4280 0x7f41b4071a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.568+0000 7f41bbd14640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41b4151900 0x7f41b4153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.568+0000 7f41bbd14640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f41b40c47e0 con 0x7f41b40c4280 2024-04-25T01:40:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.568+0000 7f41bbd14640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f41b40c4660 con 0x7f41b4151900 2024-04-25T01:40:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.568+0000 7f41bbd14640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f41b406de00 con 0x7f41b40aca40 2024-04-25T01:40:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.568+0000 7f41b92af640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41b40c4280 0x7f41b4071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.568+0000 7f41b92af640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41b40c4280 0x7f41b4071a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38894/0 (socket says 172.21.15.77:38894) 2024-04-25T01:40:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.568+0000 7f41b92af640 1 -- 172.21.15.77:0/3038779927 learned_addr learned my addr 172.21.15.77:0/3038779927 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.568+0000 7f41b9ab0640 1 --2- 172.21.15.77:0/3038779927 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41b40aca40 0x7f41b4072370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.568+0000 7f41ba2b1640 1 --2- 172.21.15.77:0/3038779927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41b4151900 0x7f41b4153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.569+0000 7f41b92af640 1 -- 172.21.15.77:0/3038779927 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41b40aca40 msgr2=0x7f41b4072370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.569+0000 7f41b92af640 1 --2- 172.21.15.77:0/3038779927 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41b40aca40 0x7f41b4072370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.569+0000 7f41b92af640 1 -- 172.21.15.77:0/3038779927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41b4151900 msgr2=0x7f41b4153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.569+0000 7f41b92af640 1 --2- 172.21.15.77:0/3038779927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41b4151900 0x7f41b4153020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.569+0000 7f41b92af640 1 -- 172.21.15.77:0/3038779927 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b4157f70 con 0x7f41b40c4280 2024-04-25T01:40:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.569+0000 7f41ba2b1640 1 --2- 172.21.15.77:0/3038779927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41b4151900 0x7f41b4153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:40:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.569+0000 7f41b92af640 1 --2- 172.21.15.77:0/3038779927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41b40c4280 0x7f41b4071a70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f41a400c780 tx=0x7f41a400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.569+0000 7f41aa7fc640 1 -- 172.21.15.77:0/3038779927 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a4018070 con 0x7f41b40c4280 2024-04-25T01:40:00.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.569+0000 7f41aa7fc640 1 -- 172.21.15.77:0/3038779927 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41a40072d0 con 0x7f41b40c4280 2024-04-25T01:40:00.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.569+0000 7f41bbd14640 1 -- 172.21.15.77:0/3038779927 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41b41e9660 con 0x7f41b40c4280 2024-04-25T01:40:00.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.569+0000 7f41aa7fc640 1 -- 172.21.15.77:0/3038779927 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a40047e0 con 0x7f41b40c4280 2024-04-25T01:40:00.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.569+0000 7f41bbd14640 1 -- 172.21.15.77:0/3038779927 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41b4158230 con 0x7f41b40c4280 2024-04-25T01:40:00.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.570+0000 7f41bbd14640 1 -- 172.21.15.77:0/3038779927 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41b404f500 con 0x7f41b40c4280 2024-04-25T01:40:00.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.570+0000 7f41aa7fc640 1 -- 172.21.15.77:0/3038779927 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f41a401b070 con 0x7f41b40c4280 2024-04-25T01:40:00.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.571+0000 7f41aa7fc640 1 --2- 172.21.15.77:0/3038779927 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f419806be30 0x7f419806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:00.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.571+0000 7f41b9ab0640 1 --2- 172.21.15.77:0/3038779927 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f419806be30 0x7f419806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:00.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.571+0000 7f41aa7fc640 1 -- 172.21.15.77:0/3038779927 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f41a408a430 con 0x7f41b40c4280 2024-04-25T01:40:00.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.571+0000 7f41b9ab0640 1 --2- 172.21.15.77:0/3038779927 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f419806be30 0x7f419806e2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f41b0034000 tx=0x7f41b002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:00.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.575+0000 7f41aa7fc640 1 -- 172.21.15.77:0/3038779927 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f41b4154430 con 0x7f41b40c4280 2024-04-25T01:40:00.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.749+0000 7f41bbd14640 1 -- 172.21.15.77:0/3038779927 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f41b40c1c60 con 0x7f41b40c4280 2024-04-25T01:40:00.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.749+0000 7f41aa7fc640 1 -- 172.21.15.77:0/3038779927 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f41a4058b40 con 0x7f41b40c4280 2024-04-25T01:40:00.733 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-25T01:40:00.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.751+0000 7f41bbd14640 1 -- 172.21.15.77:0/3038779927 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f419806be30 msgr2=0x7f419806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:00.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.751+0000 7f41bbd14640 1 --2- 172.21.15.77:0/3038779927 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f419806be30 0x7f419806e2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f41b0034000 tx=0x7f41b002e000 comp rx=0 tx=0).stop 2024-04-25T01:40:00.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.751+0000 7f41bbd14640 1 -- 172.21.15.77:0/3038779927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41b40c4280 msgr2=0x7f41b4071a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:00.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.751+0000 7f41bbd14640 1 --2- 172.21.15.77:0/3038779927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41b40c4280 0x7f41b4071a70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f41a400c780 tx=0x7f41a400cc40 comp rx=0 tx=0).stop 2024-04-25T01:40:00.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.751+0000 7f41bbd14640 1 -- 172.21.15.77:0/3038779927 shutdown_connections 2024-04-25T01:40:00.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.751+0000 7f41bbd14640 1 --2- 172.21.15.77:0/3038779927 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f419806be30 0x7f419806e2f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.751+0000 7f41bbd14640 1 --2- 172.21.15.77:0/3038779927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41b40c4280 0x7f41b4071a70 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.751+0000 7f41bbd14640 1 --2- 172.21.15.77:0/3038779927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41b4151900 0x7f41b4153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.751+0000 7f41bbd14640 1 --2- 172.21.15.77:0/3038779927 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41b40aca40 0x7f41b4072370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.751+0000 7f41bbd14640 1 -- 172.21.15.77:0/3038779927 >> 172.21.15.77:0/3038779927 conn(0x7f41b40c7580 msgr2=0x7f41b40a8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:00.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.751+0000 7f41bbd14640 1 -- 172.21.15.77:0/3038779927 shutdown_connections 2024-04-25T01:40:00.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.751+0000 7f41bbd14640 1 -- 172.21.15.77:0/3038779927 wait complete. 2024-04-25T01:40:00.746 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-25T01:40:00.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.862+0000 7f4a4e0a5640 1 Processor -- start 2024-04-25T01:40:00.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.863+0000 7f4a4e0a5640 1 -- start start 2024-04-25T01:40:00.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.863+0000 7f4a4e0a5640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4a48153530 0x7f4a480c6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:00.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.863+0000 7f4a4e0a5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4a480bef50 0x7f4a481595f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:00.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.863+0000 7f4a4e0a5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a4806d110 con 0x7f4a480c97c0 2024-04-25T01:40:00.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.863+0000 7f4a4e0a5640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f4a48153910 con 0x7f4a48153530 2024-04-25T01:40:00.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.863+0000 7f4a4e0a5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f4a48156980 con 0x7f4a480bef50 2024-04-25T01:40:00.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.863+0000 7f4a47fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4a480c97c0 0x7f4a48159b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59446/0 (socket says 172.21.15.77:59446) 2024-04-25T01:40:00.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.863+0000 7f4a47fff640 1 -- 172.21.15.77:0/1457716266 learned_addr learned my addr 172.21.15.77:0/1457716266 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:40:00.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.864+0000 7f4a477fe640 1 --2- 172.21.15.77:0/1457716266 >> v2:172.21.15.121:3300/0 conn(0x7f4a48153530 0x7f4a480c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:00.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.864+0000 7f4a46ffd640 1 --2- 172.21.15.77:0/1457716266 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4a480bef50 0x7f4a481595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:00.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.864+0000 7f4a467fc640 1 -- 172.21.15.77:0/1457716266 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2094559893 0 0) 0x7f4a4806d110 con 0x7f4a480c97c0 2024-04-25T01:40:00.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.864+0000 7f4a467fc640 1 -- 172.21.15.77:0/1457716266 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a30003520 con 0x7f4a480c97c0 2024-04-25T01:40:00.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.864+0000 7f4a467fc640 1 -- 172.21.15.77:0/1457716266 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2151592776 0 0) 0x7f4a30003520 con 0x7f4a480c97c0 2024-04-25T01:40:00.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.864+0000 7f4a467fc640 1 -- 172.21.15.77:0/1457716266 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4a480bef50 msgr2=0x7f4a481595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:00.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.864+0000 7f4a467fc640 1 --2- 172.21.15.77:0/1457716266 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4a480bef50 0x7f4a481595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.864+0000 7f4a467fc640 1 -- 172.21.15.77:0/1457716266 >> v2:172.21.15.121:3300/0 conn(0x7f4a48153530 msgr2=0x7f4a480c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:00.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.864+0000 7f4a467fc640 1 --2- 172.21.15.77:0/1457716266 >> v2:172.21.15.121:3300/0 conn(0x7f4a48153530 0x7f4a480c6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.864+0000 7f4a467fc640 1 -- 172.21.15.77:0/1457716266 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a48156c60 con 0x7f4a480c97c0 2024-04-25T01:40:00.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.864+0000 7f4a467fc640 1 -- 172.21.15.77:0/1457716266 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7f4a400019f0 con 0x7f4a480c97c0 2024-04-25T01:40:00.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.864+0000 7f4a467fc640 1 -- 172.21.15.77:0/1457716266 >> v1:172.21.15.77:6789/0 conn(0x7f4a480c97c0 legacy=0x7f4a48159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:00.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.864+0000 7f4a467fc640 1 --2- 172.21.15.77:0/1457716266 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4a480bef50 0x7f4a300039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:00.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.864+0000 7f4a467fc640 1 --2- 172.21.15.77:0/1457716266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a30003f30 0x7f4a30004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:00.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.864+0000 7f4a467fc640 1 --2- 172.21.15.77:0/1457716266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a30004d40 0x7f4a300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:00.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.864+0000 7f4a467fc640 1 -- 172.21.15.77:0/1457716266 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4a48153910 con 0x7f4a30004d40 2024-04-25T01:40:00.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.864+0000 7f4a467fc640 1 -- 172.21.15.77:0/1457716266 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4a48156980 con 0x7f4a30003f30 2024-04-25T01:40:00.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.864+0000 7f4a467fc640 1 -- 172.21.15.77:0/1457716266 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f4a3000ba10 con 0x7f4a480bef50 2024-04-25T01:40:00.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.864+0000 7f4a47fff640 1 --2- 172.21.15.77:0/1457716266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a30004d40 0x7f4a300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:00.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.864+0000 7f4a477fe640 1 --2- 172.21.15.77:0/1457716266 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4a480bef50 0x7f4a300039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:00.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.864+0000 7f4a46ffd640 1 --2- 172.21.15.77:0/1457716266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a30003f30 0x7f4a30004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:00.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.864+0000 7f4a47fff640 1 -- 172.21.15.77:0/1457716266 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4a480bef50 msgr2=0x7f4a300039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:00.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.864+0000 7f4a47fff640 1 --2- 172.21.15.77:0/1457716266 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4a480bef50 0x7f4a300039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.864+0000 7f4a47fff640 1 -- 172.21.15.77:0/1457716266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a30003f30 msgr2=0x7f4a30004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:00.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.864+0000 7f4a47fff640 1 --2- 172.21.15.77:0/1457716266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a30003f30 0x7f4a30004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.864+0000 7f4a47fff640 1 -- 172.21.15.77:0/1457716266 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a30003520 con 0x7f4a30004d40 2024-04-25T01:40:00.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.864+0000 7f4a46ffd640 1 --2- 172.21.15.77:0/1457716266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a30003f30 0x7f4a30004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:40:00.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.865+0000 7f4a47fff640 1 --2- 172.21.15.77:0/1457716266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a30004d40 0x7f4a300051c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4a4000a8b0 tx=0x7f4a30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e0d33bdd177dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:00.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.865+0000 7f4a467fc640 1 -- 172.21.15.77:0/1457716266 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4000a4a0 con 0x7f4a30004d40 2024-04-25T01:40:00.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.865+0000 7f4a467fc640 1 -- 172.21.15.77:0/1457716266 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a4002f070 con 0x7f4a30004d40 2024-04-25T01:40:00.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.865+0000 7f4a467fc640 1 -- 172.21.15.77:0/1457716266 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4002bd50 con 0x7f4a30004d40 2024-04-25T01:40:00.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.866+0000 7f4a4e0a5640 1 -- 172.21.15.77:0/1457716266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a30004d40 msgr2=0x7f4a300051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:00.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.866+0000 7f4a4e0a5640 1 --2- 172.21.15.77:0/1457716266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a30004d40 0x7f4a300051c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4a4000a8b0 tx=0x7f4a30005830 comp rx=0 tx=0).stop 2024-04-25T01:40:00.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.866+0000 7f4a47fff640 1 -- 172.21.15.77:0/1457716266 reap_dead start 2024-04-25T01:40:00.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.866+0000 7f4a4e0a5640 1 -- 172.21.15.77:0/1457716266 shutdown_connections 2024-04-25T01:40:00.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.866+0000 7f4a4e0a5640 1 -- 172.21.15.77:0/1457716266 >> 172.21.15.77:0/1457716266 conn(0x7f4a480672c0 msgr2=0x7f4a480676d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:00.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.866+0000 7f4a4e0a5640 1 -- 172.21.15.77:0/1457716266 shutdown_connections 2024-04-25T01:40:00.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.866+0000 7f4a4e0a5640 1 -- 172.21.15.77:0/1457716266 wait complete. 2024-04-25T01:40:00.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.867+0000 7f4a4e0a5640 1 Processor -- start 2024-04-25T01:40:00.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.867+0000 7f4a4e0a5640 1 -- start start 2024-04-25T01:40:00.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.868+0000 7f4a4e0a5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4a481ef210 0x7f4a48147a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:00.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.868+0000 7f4a4e0a5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a481ef5f0 0x7f4a480abc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:00.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.868+0000 7f4a4e0a5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a480ac1d0 0x7f4a48146a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:00.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.868+0000 7f4a4e0a5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4a4815a240 con 0x7f4a481ef5f0 2024-04-25T01:40:00.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.868+0000 7f4a4e0a5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4a480cc250 con 0x7f4a480ac1d0 2024-04-25T01:40:00.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.868+0000 7f4a4e0a5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f4a480c6780 con 0x7f4a481ef210 2024-04-25T01:40:00.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.868+0000 7f4a46ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a481ef5f0 0x7f4a480abc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:00.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.868+0000 7f4a46ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a481ef5f0 0x7f4a480abc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38918/0 (socket says 172.21.15.77:38918) 2024-04-25T01:40:00.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.868+0000 7f4a46ffd640 1 -- 172.21.15.77:0/3329960096 learned_addr learned my addr 172.21.15.77:0/3329960096 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:00.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.868+0000 7f4a477fe640 1 --2- 172.21.15.77:0/3329960096 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4a481ef210 0x7f4a48147a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:00.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.868+0000 7f4a47fff640 1 --2- 172.21.15.77:0/3329960096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a480ac1d0 0x7f4a48146a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:00.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.868+0000 7f4a46ffd640 1 -- 172.21.15.77:0/3329960096 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4a481ef210 msgr2=0x7f4a48147a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:00.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.868+0000 7f4a46ffd640 1 --2- 172.21.15.77:0/3329960096 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4a481ef210 0x7f4a48147a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.868+0000 7f4a46ffd640 1 -- 172.21.15.77:0/3329960096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a480ac1d0 msgr2=0x7f4a48146a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:00.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.868+0000 7f4a46ffd640 1 --2- 172.21.15.77:0/3329960096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a480ac1d0 0x7f4a48146a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:00.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.868+0000 7f4a46ffd640 1 -- 172.21.15.77:0/3329960096 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a48147790 con 0x7f4a481ef5f0 2024-04-25T01:40:00.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.868+0000 7f4a46ffd640 1 --2- 172.21.15.77:0/3329960096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a481ef5f0 0x7f4a480abc90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c006ba0 tx=0x7f4a3c0119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:00.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.868+0000 7f4a2ffff640 1 -- 172.21.15.77:0/3329960096 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c019070 con 0x7f4a481ef5f0 2024-04-25T01:40:00.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.868+0000 7f4a2ffff640 1 -- 172.21.15.77:0/3329960096 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a3c005da0 con 0x7f4a481ef5f0 2024-04-25T01:40:00.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.868+0000 7f4a2ffff640 1 -- 172.21.15.77:0/3329960096 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c004240 con 0x7f4a481ef5f0 2024-04-25T01:40:00.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.868+0000 7f4a4e0a5640 1 -- 172.21.15.77:0/3329960096 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a481efae0 con 0x7f4a481ef5f0 2024-04-25T01:40:00.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.868+0000 7f4a4e0a5640 1 -- 172.21.15.77:0/3329960096 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a48148190 con 0x7f4a481ef5f0 2024-04-25T01:40:00.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.869+0000 7f4a4e0a5640 1 -- 172.21.15.77:0/3329960096 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a4804f500 con 0x7f4a481ef5f0 2024-04-25T01:40:00.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.870+0000 7f4a2ffff640 1 -- 172.21.15.77:0/3329960096 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4a3c003610 con 0x7f4a481ef5f0 2024-04-25T01:40:00.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.870+0000 7f4a2ffff640 1 --2- 172.21.15.77:0/3329960096 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4a3406be30 0x7f4a3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:00.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.870+0000 7f4a2ffff640 1 -- 172.21.15.77:0/3329960096 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f4a3c08b450 con 0x7f4a481ef5f0 2024-04-25T01:40:00.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.870+0000 7f4a477fe640 1 --2- 172.21.15.77:0/3329960096 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4a3406be30 0x7f4a3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:00.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.871+0000 7f4a477fe640 1 --2- 172.21.15.77:0/3329960096 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4a3406be30 0x7f4a3406e2f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4a38009a60 tx=0x7f4a38008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:00.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:00.874+0000 7f4a2ffff640 1 -- 172.21.15.77:0/3329960096 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4a3c059b60 con 0x7f4a481ef5f0 2024-04-25T01:40:01.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.047+0000 7f4a4e0a5640 1 -- 172.21.15.77:0/3329960096 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7f4a4806cac0 con 0x7f4a481ef5f0 2024-04-25T01:40:01.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.048+0000 7f4a2ffff640 1 -- 172.21.15.77:0/3329960096 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v24) ==== 99+0+11 (secure 0 0 0) 0x7f4a3c059460 con 0x7f4a481ef5f0 2024-04-25T01:40:01.032 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T01:40:01.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.049+0000 7f4a4e0a5640 1 -- 172.21.15.77:0/3329960096 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4a3406be30 msgr2=0x7f4a3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:01.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.049+0000 7f4a4e0a5640 1 --2- 172.21.15.77:0/3329960096 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4a3406be30 0x7f4a3406e2f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4a38009a60 tx=0x7f4a38008040 comp rx=0 tx=0).stop 2024-04-25T01:40:01.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.049+0000 7f4a4e0a5640 1 -- 172.21.15.77:0/3329960096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a481ef5f0 msgr2=0x7f4a480abc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:01.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.049+0000 7f4a4e0a5640 1 --2- 172.21.15.77:0/3329960096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a481ef5f0 0x7f4a480abc90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c006ba0 tx=0x7f4a3c0119a0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.049+0000 7f4a4e0a5640 1 -- 172.21.15.77:0/3329960096 shutdown_connections 2024-04-25T01:40:01.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.050+0000 7f4a4e0a5640 1 --2- 172.21.15.77:0/3329960096 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4a3406be30 0x7f4a3406e2f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.050+0000 7f4a4e0a5640 1 --2- 172.21.15.77:0/3329960096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a481ef5f0 0x7f4a480abc90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.050+0000 7f4a4e0a5640 1 --2- 172.21.15.77:0/3329960096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a480ac1d0 0x7f4a48146a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.050+0000 7f4a4e0a5640 1 --2- 172.21.15.77:0/3329960096 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4a481ef210 0x7f4a48147a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.050+0000 7f4a4e0a5640 1 -- 172.21.15.77:0/3329960096 >> 172.21.15.77:0/3329960096 conn(0x7f4a480672c0 msgr2=0x7f4a480cad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:01.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.050+0000 7f4a4e0a5640 1 -- 172.21.15.77:0/3329960096 shutdown_connections 2024-04-25T01:40:01.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.050+0000 7f4a4e0a5640 1 -- 172.21.15.77:0/3329960096 wait complete. 2024-04-25T01:40:01.044 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-25T01:40:01.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.160+0000 7f072f14f640 1 Processor -- start 2024-04-25T01:40:01.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.160+0000 7f072f14f640 1 -- start start 2024-04-25T01:40:01.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.161+0000 7f072f14f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f07280aca40 0x7f07281511f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:01.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.161+0000 7f072f14f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07281546b0 con 0x7f0728151730 2024-04-25T01:40:01.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.161+0000 7f072f14f640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0728154990 con 0x7f07280c4280 2024-04-25T01:40:01.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.161+0000 7f072f14f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f0728151ba0 con 0x7f07280aca40 2024-04-25T01:40:01.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.161+0000 7f072d6ec640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0728151730 0x7f072806d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59458/0 (socket says 172.21.15.77:59458) 2024-04-25T01:40:01.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.161+0000 7f072d6ec640 1 -- 172.21.15.77:0/3411812682 learned_addr learned my addr 172.21.15.77:0/3411812682 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:40:01.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.161+0000 7f0727fff640 1 --2- 172.21.15.77:0/3411812682 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f07280aca40 0x7f07281511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:01.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.161+0000 7f07277fe640 1 -- 172.21.15.77:0/3411812682 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1128749517 0 0) 0x7f07281546b0 con 0x7f0728151730 2024-04-25T01:40:01.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.161+0000 7f07277fe640 1 -- 172.21.15.77:0/3411812682 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0718003520 con 0x7f0728151730 2024-04-25T01:40:01.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.161+0000 7f07277fe640 1 -- 172.21.15.77:0/3411812682 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3496112006 0 0) 0x7f0728154990 con 0x7f07280c4280 2024-04-25T01:40:01.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.161+0000 7f07277fe640 1 -- 172.21.15.77:0/3411812682 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07281546b0 con 0x7f07280c4280 2024-04-25T01:40:01.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.161+0000 7f07277fe640 1 -- 172.21.15.77:0/3411812682 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1991924301 0 0) 0x7f0718003520 con 0x7f0728151730 2024-04-25T01:40:01.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.161+0000 7f0727fff640 1 -- 172.21.15.77:0/3411812682 >> v1:172.21.15.121:6789/0 conn(0x7f07280c4280 legacy=0x7f0728153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:01.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.161+0000 7f0727fff640 1 -- 172.21.15.77:0/3411812682 >> v1:172.21.15.77:6789/0 conn(0x7f0728151730 legacy=0x7f072806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:01.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.161+0000 7f0727fff640 1 -- 172.21.15.77:0/3411812682 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0728154c70 con 0x7f07280aca40 2024-04-25T01:40:01.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.162+0000 7f0727fff640 1 --2- 172.21.15.77:0/3411812682 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f07280aca40 0x7f07281511f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f07140097d0 tx=0x7f071402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b42b469539a3adb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:01.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.162+0000 7f07277fe640 1 -- 172.21.15.77:0/3411812682 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0714037070 con 0x7f07280aca40 2024-04-25T01:40:01.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.162+0000 7f07277fe640 1 -- 172.21.15.77:0/3411812682 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f071402ab90 con 0x7f07280aca40 2024-04-25T01:40:01.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.162+0000 7f07277fe640 1 -- 172.21.15.77:0/3411812682 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07200019f0 con 0x7f07280aca40 2024-04-25T01:40:01.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.163+0000 7f072f14f640 1 -- 172.21.15.77:0/3411812682 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f07280aca40 msgr2=0x7f07281511f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:01.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.163+0000 7f072f14f640 1 --2- 172.21.15.77:0/3411812682 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f07280aca40 0x7f07281511f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f07140097d0 tx=0x7f071402a100 comp rx=0 tx=0).stop 2024-04-25T01:40:01.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.163+0000 7f072f14f640 1 -- 172.21.15.77:0/3411812682 shutdown_connections 2024-04-25T01:40:01.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.163+0000 7f072f14f640 1 --2- 172.21.15.77:0/3411812682 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f07280aca40 0x7f07281511f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.163+0000 7f072f14f640 1 -- 172.21.15.77:0/3411812682 >> 172.21.15.77:0/3411812682 conn(0x7f07280c7580 msgr2=0x7f07280c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:01.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.163+0000 7f072f14f640 1 -- 172.21.15.77:0/3411812682 shutdown_connections 2024-04-25T01:40:01.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.163+0000 7f072f14f640 1 -- 172.21.15.77:0/3411812682 wait complete. 2024-04-25T01:40:01.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.164+0000 7f072f14f640 1 Processor -- start 2024-04-25T01:40:01.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.164+0000 7f072f14f640 1 -- start start 2024-04-25T01:40:01.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.165+0000 7f072f14f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07280aca40 0x7f07281eb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:01.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.165+0000 7f072f14f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f07280c4280 0x7f07281535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:01.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.165+0000 7f072f14f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0728151730 0x7f07281dfa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:01.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.165+0000 7f072f14f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f07280c47e0 con 0x7f07280aca40 2024-04-25T01:40:01.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.165+0000 7f072f14f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f07280c4660 con 0x7f0728151730 2024-04-25T01:40:01.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.165+0000 7f072f14f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f072806dfd0 con 0x7f07280c4280 2024-04-25T01:40:01.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.165+0000 7f072ceeb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07280aca40 0x7f07281eb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:01.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.165+0000 7f072ceeb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07280aca40 0x7f07281eb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38920/0 (socket says 172.21.15.77:38920) 2024-04-25T01:40:01.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.165+0000 7f072ceeb640 1 -- 172.21.15.77:0/1732735555 learned_addr learned my addr 172.21.15.77:0/1732735555 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:01.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.165+0000 7f0727fff640 1 --2- 172.21.15.77:0/1732735555 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f07280c4280 0x7f07281535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:01.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.165+0000 7f072d6ec640 1 --2- 172.21.15.77:0/1732735555 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0728151730 0x7f07281dfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:01.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.165+0000 7f072ceeb640 1 -- 172.21.15.77:0/1732735555 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f07280c4280 msgr2=0x7f07281535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:01.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.165+0000 7f072ceeb640 1 --2- 172.21.15.77:0/1732735555 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f07280c4280 0x7f07281535c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.165+0000 7f072ceeb640 1 -- 172.21.15.77:0/1732735555 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0728151730 msgr2=0x7f07281dfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:01.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.165+0000 7f072ceeb640 1 --2- 172.21.15.77:0/1732735555 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0728151730 0x7f07281dfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.165+0000 7f072ceeb640 1 -- 172.21.15.77:0/1732735555 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07281dde10 con 0x7f07280aca40 2024-04-25T01:40:01.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.165+0000 7f072ceeb640 1 --2- 172.21.15.77:0/1732735555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07280aca40 0x7f07281eb9d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f071c00c490 tx=0x7f071c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:01.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.165+0000 7f07257fa640 1 -- 172.21.15.77:0/1732735555 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071c0052d0 con 0x7f07280aca40 2024-04-25T01:40:01.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.165+0000 7f07257fa640 1 -- 172.21.15.77:0/1732735555 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f071c005470 con 0x7f07280aca40 2024-04-25T01:40:01.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.165+0000 7f07257fa640 1 -- 172.21.15.77:0/1732735555 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071c012850 con 0x7f07280aca40 2024-04-25T01:40:01.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.165+0000 7f072f14f640 1 -- 172.21.15.77:0/1732735555 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07281dd570 con 0x7f07280aca40 2024-04-25T01:40:01.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.166+0000 7f072f14f640 1 -- 172.21.15.77:0/1732735555 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07281ddb30 con 0x7f07280aca40 2024-04-25T01:40:01.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.166+0000 7f072f14f640 1 -- 172.21.15.77:0/1732735555 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f072804f500 con 0x7f07280aca40 2024-04-25T01:40:01.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.167+0000 7f07257fa640 1 -- 172.21.15.77:0/1732735555 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f071c0129f0 con 0x7f07280aca40 2024-04-25T01:40:01.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.167+0000 7f07257fa640 1 --2- 172.21.15.77:0/1732735555 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f070c06be60 0x7f070c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:01.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.167+0000 7f0727fff640 1 --2- 172.21.15.77:0/1732735555 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f070c06be60 0x7f070c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:01.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.167+0000 7f07257fa640 1 -- 172.21.15.77:0/1732735555 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f071c08ad80 con 0x7f07280aca40 2024-04-25T01:40:01.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.168+0000 7f0727fff640 1 --2- 172.21.15.77:0/1732735555 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f070c06be60 0x7f070c06e320 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0714034000 tx=0x7f071402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:01.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.171+0000 7f07257fa640 1 -- 172.21.15.77:0/1732735555 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f071c059490 con 0x7f07280aca40 2024-04-25T01:40:01.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.343+0000 7f072f14f640 1 -- 172.21.15.77:0/1732735555 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7f072814fa70 con 0x7f07280aca40 2024-04-25T01:40:01.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.344+0000 7f07257fa640 1 -- 172.21.15.77:0/1732735555 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v24) ==== 95+0+11 (secure 0 0 0) 0x7f071c058d90 con 0x7f07280aca40 2024-04-25T01:40:01.328 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-25T01:40:01.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.346+0000 7f072f14f640 1 -- 172.21.15.77:0/1732735555 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f070c06be60 msgr2=0x7f070c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:01.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.346+0000 7f072f14f640 1 --2- 172.21.15.77:0/1732735555 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f070c06be60 0x7f070c06e320 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0714034000 tx=0x7f071402e000 comp rx=0 tx=0).stop 2024-04-25T01:40:01.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.346+0000 7f072f14f640 1 -- 172.21.15.77:0/1732735555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07280aca40 msgr2=0x7f07281eb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:01.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.346+0000 7f072f14f640 1 --2- 172.21.15.77:0/1732735555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07280aca40 0x7f07281eb9d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f071c00c490 tx=0x7f071c00c950 comp rx=0 tx=0).stop 2024-04-25T01:40:01.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.346+0000 7f072f14f640 1 -- 172.21.15.77:0/1732735555 shutdown_connections 2024-04-25T01:40:01.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.346+0000 7f072f14f640 1 --2- 172.21.15.77:0/1732735555 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f070c06be60 0x7f070c06e320 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.346+0000 7f072f14f640 1 --2- 172.21.15.77:0/1732735555 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0728151730 0x7f07281dfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.346+0000 7f072f14f640 1 --2- 172.21.15.77:0/1732735555 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f07280c4280 0x7f07281535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.346+0000 7f072f14f640 1 --2- 172.21.15.77:0/1732735555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07280aca40 0x7f07281eb9d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.346+0000 7f072f14f640 1 -- 172.21.15.77:0/1732735555 >> 172.21.15.77:0/1732735555 conn(0x7f07280c7580 msgr2=0x7f072814fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:01.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.346+0000 7f072f14f640 1 -- 172.21.15.77:0/1732735555 shutdown_connections 2024-04-25T01:40:01.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.346+0000 7f072f14f640 1 -- 172.21.15.77:0/1732735555 wait complete. 2024-04-25T01:40:01.340 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-25T01:40:01.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.456+0000 7f4d25763640 1 Processor -- start 2024-04-25T01:40:01.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.456+0000 7f4d25763640 1 -- start start 2024-04-25T01:40:01.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.457+0000 7f4d25763640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4d20153530 0x7f4d200c6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:01.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.457+0000 7f4d25763640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4d200c97c0 0x7f4d20159d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:01.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.457+0000 7f4d25763640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d2006d110 con 0x7f4d200bef50 2024-04-25T01:40:01.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.457+0000 7f4d25763640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f4d20153910 con 0x7f4d200c97c0 2024-04-25T01:40:01.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.457+0000 7f4d25763640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f4d20156980 con 0x7f4d20153530 2024-04-25T01:40:01.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.457+0000 7f4d1f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4d200c97c0 0x7f4d20159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:01.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.457+0000 7f4d1f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4d200c97c0 0x7f4d20159d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38928/0 (socket says 172.21.15.77:38928) 2024-04-25T01:40:01.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.457+0000 7f4d1f7fe640 1 -- 172.21.15.77:0/633938090 learned_addr learned my addr 172.21.15.77:0/633938090 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:01.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.457+0000 7f4d1effd640 1 --2- 172.21.15.77:0/633938090 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4d20153530 0x7f4d200c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:01.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.457+0000 7f4d1f7fe640 1 -- 172.21.15.77:0/633938090 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4d20153530 msgr2=0x7f4d200c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:01.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.457+0000 7f4d1f7fe640 1 --2- 172.21.15.77:0/633938090 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4d20153530 0x7f4d200c6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.457+0000 7f4d1f7fe640 1 -- 172.21.15.77:0/633938090 >> v1:172.21.15.121:6789/0 conn(0x7f4d200bef50 legacy=0x7f4d201595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:01.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.457+0000 7f4d1f7fe640 1 -- 172.21.15.77:0/633938090 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d20156c60 con 0x7f4d200c97c0 2024-04-25T01:40:01.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.458+0000 7f4d1f7fe640 1 --2- 172.21.15.77:0/633938090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d200c97c0 0x7f4d20159d00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4d18009e50 tx=0x7f4d1802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ebd21820ae0245 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:01.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.458+0000 7f4d1e7fc640 1 -- 172.21.15.77:0/633938090 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d18036070 con 0x7f4d200c97c0 2024-04-25T01:40:01.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.458+0000 7f4d1e7fc640 1 -- 172.21.15.77:0/633938090 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d18031600 con 0x7f4d200c97c0 2024-04-25T01:40:01.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.458+0000 7f4d1e7fc640 1 -- 172.21.15.77:0/633938090 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d180319d0 con 0x7f4d200c97c0 2024-04-25T01:40:01.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.459+0000 7f4d25763640 1 -- 172.21.15.77:0/633938090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d200c97c0 msgr2=0x7f4d20159d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:01.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.459+0000 7f4d25763640 1 --2- 172.21.15.77:0/633938090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d200c97c0 0x7f4d20159d00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4d18009e50 tx=0x7f4d1802a680 comp rx=0 tx=0).stop 2024-04-25T01:40:01.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.459+0000 7f4d25763640 1 -- 172.21.15.77:0/633938090 shutdown_connections 2024-04-25T01:40:01.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.459+0000 7f4d25763640 1 --2- 172.21.15.77:0/633938090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d200c97c0 0x7f4d20159d00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.459+0000 7f4d25763640 1 --2- 172.21.15.77:0/633938090 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4d20153530 0x7f4d200c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.459+0000 7f4d25763640 1 -- 172.21.15.77:0/633938090 >> 172.21.15.77:0/633938090 conn(0x7f4d200672c0 msgr2=0x7f4d200676d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:01.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.459+0000 7f4d25763640 1 -- 172.21.15.77:0/633938090 shutdown_connections 2024-04-25T01:40:01.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.459+0000 7f4d25763640 1 -- 172.21.15.77:0/633938090 wait complete. 2024-04-25T01:40:01.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.460+0000 7f4d25763640 1 Processor -- start 2024-04-25T01:40:01.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.460+0000 7f4d25763640 1 -- start start 2024-04-25T01:40:01.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.460+0000 7f4d25763640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4d200bef50 0x7f4d20150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:01.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.460+0000 7f4d25763640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d200c97c0 0x7f4d20148650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:01.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.460+0000 7f4d25763640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d20153530 0x7f4d20148b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:01.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.460+0000 7f4d25763640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2015a240 con 0x7f4d200c97c0 2024-04-25T01:40:01.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.460+0000 7f4d25763640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4d200cc250 con 0x7f4d20153530 2024-04-25T01:40:01.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.460+0000 7f4d25763640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f4d200c6780 con 0x7f4d200bef50 2024-04-25T01:40:01.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.461+0000 7f4d17fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d200c97c0 0x7f4d20148650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:01.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.461+0000 7f4d17fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d200c97c0 0x7f4d20148650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38938/0 (socket says 172.21.15.77:38938) 2024-04-25T01:40:01.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.461+0000 7f4d17fff640 1 -- 172.21.15.77:0/2079037690 learned_addr learned my addr 172.21.15.77:0/2079037690 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:01.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.461+0000 7f4d1f7fe640 1 --2- 172.21.15.77:0/2079037690 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d20153530 0x7f4d20148b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:01.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.461+0000 7f4d1effd640 1 --2- 172.21.15.77:0/2079037690 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4d200bef50 0x7f4d20150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:01.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.461+0000 7f4d17fff640 1 -- 172.21.15.77:0/2079037690 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4d200bef50 msgr2=0x7f4d20150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:01.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.461+0000 7f4d17fff640 1 --2- 172.21.15.77:0/2079037690 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4d200bef50 0x7f4d20150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.461+0000 7f4d17fff640 1 -- 172.21.15.77:0/2079037690 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d20153530 msgr2=0x7f4d20148b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:01.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.461+0000 7f4d17fff640 1 --2- 172.21.15.77:0/2079037690 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d20153530 0x7f4d20148b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.461+0000 7f4d17fff640 1 -- 172.21.15.77:0/2079037690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d200cb120 con 0x7f4d200c97c0 2024-04-25T01:40:01.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.461+0000 7f4d17fff640 1 --2- 172.21.15.77:0/2079037690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d200c97c0 0x7f4d20148650 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4d0800c3f0 tx=0x7f4d0800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:01.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.461+0000 7f4d177fe640 1 -- 172.21.15.77:0/2079037690 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d080052d0 con 0x7f4d200c97c0 2024-04-25T01:40:01.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.461+0000 7f4d177fe640 1 -- 172.21.15.77:0/2079037690 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d08005490 con 0x7f4d200c97c0 2024-04-25T01:40:01.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.461+0000 7f4d25763640 1 -- 172.21.15.77:0/2079037690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d201ef720 con 0x7f4d200c97c0 2024-04-25T01:40:01.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.461+0000 7f4d177fe640 1 -- 172.21.15.77:0/2079037690 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d08006a60 con 0x7f4d200c97c0 2024-04-25T01:40:01.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.461+0000 7f4d25763640 1 -- 172.21.15.77:0/2079037690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d200aba30 con 0x7f4d200c97c0 2024-04-25T01:40:01.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.462+0000 7f4d25763640 1 -- 172.21.15.77:0/2079037690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d2004f500 con 0x7f4d200c97c0 2024-04-25T01:40:01.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.463+0000 7f4d177fe640 1 -- 172.21.15.77:0/2079037690 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d08003640 con 0x7f4d200c97c0 2024-04-25T01:40:01.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.463+0000 7f4d177fe640 1 --2- 172.21.15.77:0/2079037690 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4d0006be30 0x7f4d0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:01.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.463+0000 7f4d1effd640 1 --2- 172.21.15.77:0/2079037690 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4d0006be30 0x7f4d0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:01.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.463+0000 7f4d177fe640 1 -- 172.21.15.77:0/2079037690 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f4d0808a5f0 con 0x7f4d200c97c0 2024-04-25T01:40:01.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.464+0000 7f4d1effd640 1 --2- 172.21.15.77:0/2079037690 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4d0006be30 0x7f4d0006e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4d10009a30 tx=0x7f4d10008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:01.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.468+0000 7f4d177fe640 1 -- 172.21.15.77:0/2079037690 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4d08058d00 con 0x7f4d200c97c0 2024-04-25T01:40:01.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.643+0000 7f4d25763640 1 -- 172.21.15.77:0/2079037690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7f4d2006cac0 con 0x7f4d200c97c0 2024-04-25T01:40:01.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.644+0000 7f4d177fe640 1 -- 172.21.15.77:0/2079037690 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v24) ==== 99+0+11 (secure 0 0 0) 0x7f4d08058600 con 0x7f4d200c97c0 2024-04-25T01:40:01.628 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T01:40:01.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.645+0000 7f4d25763640 1 -- 172.21.15.77:0/2079037690 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4d0006be30 msgr2=0x7f4d0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:01.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.645+0000 7f4d25763640 1 --2- 172.21.15.77:0/2079037690 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4d0006be30 0x7f4d0006e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4d10009a30 tx=0x7f4d10008040 comp rx=0 tx=0).stop 2024-04-25T01:40:01.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.645+0000 7f4d25763640 1 -- 172.21.15.77:0/2079037690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d200c97c0 msgr2=0x7f4d20148650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:01.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.645+0000 7f4d25763640 1 --2- 172.21.15.77:0/2079037690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d200c97c0 0x7f4d20148650 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4d0800c3f0 tx=0x7f4d0800c8b0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.645+0000 7f4d25763640 1 -- 172.21.15.77:0/2079037690 shutdown_connections 2024-04-25T01:40:01.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.645+0000 7f4d25763640 1 --2- 172.21.15.77:0/2079037690 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4d0006be30 0x7f4d0006e2f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.645+0000 7f4d25763640 1 --2- 172.21.15.77:0/2079037690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d200c97c0 0x7f4d20148650 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.645+0000 7f4d25763640 1 --2- 172.21.15.77:0/2079037690 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d20153530 0x7f4d20148b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.645+0000 7f4d25763640 1 --2- 172.21.15.77:0/2079037690 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4d200bef50 0x7f4d20150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.645+0000 7f4d25763640 1 -- 172.21.15.77:0/2079037690 >> 172.21.15.77:0/2079037690 conn(0x7f4d200672c0 msgr2=0x7f4d201e27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:01.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.645+0000 7f4d25763640 1 -- 172.21.15.77:0/2079037690 shutdown_connections 2024-04-25T01:40:01.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.645+0000 7f4d25763640 1 -- 172.21.15.77:0/2079037690 wait complete. 2024-04-25T01:40:01.640 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-25T01:40:01.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.755+0000 7f15d4729640 1 Processor -- start 2024-04-25T01:40:01.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.755+0000 7f15d4729640 1 -- start start 2024-04-25T01:40:01.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.756+0000 7f15d4729640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f15cc153530 0x7f15cc0c6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:01.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.756+0000 7f15d4729640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15cc0bef50 0x7f15cc1595f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:01.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.756+0000 7f15d4729640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15cc06d110 con 0x7f15cc0c97c0 2024-04-25T01:40:01.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.756+0000 7f15d4729640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f15cc153910 con 0x7f15cc153530 2024-04-25T01:40:01.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.756+0000 7f15d4729640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f15cc156980 con 0x7f15cc0bef50 2024-04-25T01:40:01.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.756+0000 7f15d24c5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f15cc153530 0x7f15cc0c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:01.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.756+0000 7f15d2cc6640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f15cc0c97c0 0x7f15cc159b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59468/0 (socket says 172.21.15.77:59468) 2024-04-25T01:40:01.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.756+0000 7f15d2cc6640 1 -- 172.21.15.77:0/745457657 learned_addr learned my addr 172.21.15.77:0/745457657 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:40:01.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.757+0000 7f15d1cc4640 1 --2- 172.21.15.77:0/745457657 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15cc0bef50 0x7f15cc1595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:01.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.757+0000 7f15d24c5640 1 -- 172.21.15.77:0/745457657 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15cc0bef50 msgr2=0x7f15cc1595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:01.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.757+0000 7f15d24c5640 1 --2- 172.21.15.77:0/745457657 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15cc0bef50 0x7f15cc1595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.757+0000 7f15d24c5640 1 -- 172.21.15.77:0/745457657 >> v1:172.21.15.77:6789/0 conn(0x7f15cc0c97c0 legacy=0x7f15cc159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:01.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.757+0000 7f15d24c5640 1 -- 172.21.15.77:0/745457657 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15cc156c60 con 0x7f15cc153530 2024-04-25T01:40:01.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.757+0000 7f15d14c3640 1 -- 172.21.15.77:0/745457657 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 572681262 0 0) 0x7f15cc06d110 con 0x7f15cc0c97c0 2024-04-25T01:40:01.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.757+0000 7f15d1cc4640 1 --2- 172.21.15.77:0/745457657 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15cc0bef50 0x7f15cc1595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:40:01.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.757+0000 7f15d24c5640 1 --2- 172.21.15.77:0/745457657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15cc153530 0x7f15cc0c6240 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f15c80097a0 tx=0x7f15c802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76f429ab541ff47 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:01.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.757+0000 7f15d14c3640 1 -- 172.21.15.77:0/745457657 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8037070 con 0x7f15cc153530 2024-04-25T01:40:01.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.758+0000 7f15d14c3640 1 -- 172.21.15.77:0/745457657 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15c802ae50 con 0x7f15cc153530 2024-04-25T01:40:01.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.758+0000 7f15d14c3640 1 -- 172.21.15.77:0/745457657 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8032660 con 0x7f15cc153530 2024-04-25T01:40:01.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.758+0000 7f15d4729640 1 -- 172.21.15.77:0/745457657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15cc153530 msgr2=0x7f15cc0c6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:01.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.758+0000 7f15d4729640 1 --2- 172.21.15.77:0/745457657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15cc153530 0x7f15cc0c6240 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f15c80097a0 tx=0x7f15c802a100 comp rx=0 tx=0).stop 2024-04-25T01:40:01.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.758+0000 7f15d4729640 1 -- 172.21.15.77:0/745457657 shutdown_connections 2024-04-25T01:40:01.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.758+0000 7f15d4729640 1 --2- 172.21.15.77:0/745457657 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15cc0bef50 0x7f15cc1595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.758+0000 7f15d4729640 1 --2- 172.21.15.77:0/745457657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15cc153530 0x7f15cc0c6240 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.758+0000 7f15d4729640 1 -- 172.21.15.77:0/745457657 >> 172.21.15.77:0/745457657 conn(0x7f15cc0672c0 msgr2=0x7f15cc0676d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:01.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.758+0000 7f15d4729640 1 -- 172.21.15.77:0/745457657 shutdown_connections 2024-04-25T01:40:01.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.758+0000 7f15d4729640 1 -- 172.21.15.77:0/745457657 wait complete. 2024-04-25T01:40:01.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.759+0000 7f15d4729640 1 Processor -- start 2024-04-25T01:40:01.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.759+0000 7f15d4729640 1 -- start start 2024-04-25T01:40:01.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.760+0000 7f15d4729640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15cc0bef50 0x7f15cc155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:01.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.760+0000 7f15d4729640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15cc0c97c0 0x7f15cc0c1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:01.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.760+0000 7f15d4729640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15cc153530 0x7f15cc0c1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:01.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.760+0000 7f15d4729640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f15cc15a240 con 0x7f15cc0c97c0 2024-04-25T01:40:01.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.760+0000 7f15d4729640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f15cc0cc250 con 0x7f15cc0bef50 2024-04-25T01:40:01.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.760+0000 7f15d4729640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f15cc0c6780 con 0x7f15cc153530 2024-04-25T01:40:01.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.760+0000 7f15d1cc4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15cc0c97c0 0x7f15cc0c1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:01.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.760+0000 7f15d1cc4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15cc0c97c0 0x7f15cc0c1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38952/0 (socket says 172.21.15.77:38952) 2024-04-25T01:40:01.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.760+0000 7f15d1cc4640 1 -- 172.21.15.77:0/3316114930 learned_addr learned my addr 172.21.15.77:0/3316114930 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:01.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.760+0000 7f15d24c5640 1 --2- 172.21.15.77:0/3316114930 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15cc0bef50 0x7f15cc155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:01.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.760+0000 7f15d2cc6640 1 --2- 172.21.15.77:0/3316114930 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15cc153530 0x7f15cc0c1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:01.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.760+0000 7f15d1cc4640 1 -- 172.21.15.77:0/3316114930 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15cc153530 msgr2=0x7f15cc0c1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:01.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.760+0000 7f15d1cc4640 1 --2- 172.21.15.77:0/3316114930 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15cc153530 0x7f15cc0c1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.760+0000 7f15d1cc4640 1 -- 172.21.15.77:0/3316114930 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15cc0bef50 msgr2=0x7f15cc155660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:01.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.760+0000 7f15d1cc4640 1 --2- 172.21.15.77:0/3316114930 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15cc0bef50 0x7f15cc155660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.760+0000 7f15d1cc4640 1 -- 172.21.15.77:0/3316114930 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15cc1540b0 con 0x7f15cc0c97c0 2024-04-25T01:40:01.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.760+0000 7f15d2cc6640 1 --2- 172.21.15.77:0/3316114930 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15cc153530 0x7f15cc0c1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:40:01.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.760+0000 7f15d1cc4640 1 --2- 172.21.15.77:0/3316114930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15cc0c97c0 0x7f15cc0c1a40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00c7f0 tx=0x7f15bc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:01.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.761+0000 7f15c2ffd640 1 -- 172.21.15.77:0/3316114930 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc005b90 con 0x7f15cc0c97c0 2024-04-25T01:40:01.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.761+0000 7f15c2ffd640 1 -- 172.21.15.77:0/3316114930 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15bc005d30 con 0x7f15cc0c97c0 2024-04-25T01:40:01.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.761+0000 7f15c2ffd640 1 -- 172.21.15.77:0/3316114930 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc007a50 con 0x7f15cc0c97c0 2024-04-25T01:40:01.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.761+0000 7f15d4729640 1 -- 172.21.15.77:0/3316114930 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15cc154390 con 0x7f15cc0c97c0 2024-04-25T01:40:01.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.761+0000 7f15d4729640 1 -- 172.21.15.77:0/3316114930 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15cc154950 con 0x7f15cc0c97c0 2024-04-25T01:40:01.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.762+0000 7f15d4729640 1 -- 172.21.15.77:0/3316114930 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15cc04f500 con 0x7f15cc0c97c0 2024-04-25T01:40:01.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.762+0000 7f15c2ffd640 1 -- 172.21.15.77:0/3316114930 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f15bc007bf0 con 0x7f15cc0c97c0 2024-04-25T01:40:01.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.762+0000 7f15c2ffd640 1 --2- 172.21.15.77:0/3316114930 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f15b006be60 0x7f15b006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:01.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.763+0000 7f15d24c5640 1 --2- 172.21.15.77:0/3316114930 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f15b006be60 0x7f15b006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:01.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.763+0000 7f15c2ffd640 1 -- 172.21.15.77:0/3316114930 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f15bc08b160 con 0x7f15cc0c97c0 2024-04-25T01:40:01.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.763+0000 7f15d24c5640 1 --2- 172.21.15.77:0/3316114930 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f15b006be60 0x7f15b006e320 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f15c8034000 tx=0x7f15c802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:01.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.767+0000 7f15c2ffd640 1 -- 172.21.15.77:0/3316114930 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f15bc015020 con 0x7f15cc0c97c0 2024-04-25T01:40:01.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.938+0000 7f15d4729640 1 -- 172.21.15.77:0/3316114930 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7f15cc06cac0 con 0x7f15cc0c97c0 2024-04-25T01:40:01.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.939+0000 7f15c2ffd640 1 -- 172.21.15.77:0/3316114930 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v24) ==== 95+0+11 (secure 0 0 0) 0x7f15bc059870 con 0x7f15cc0c97c0 2024-04-25T01:40:01.923 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-25T01:40:01.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.940+0000 7f15d4729640 1 -- 172.21.15.77:0/3316114930 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f15b006be60 msgr2=0x7f15b006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:01.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.940+0000 7f15d4729640 1 --2- 172.21.15.77:0/3316114930 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f15b006be60 0x7f15b006e320 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f15c8034000 tx=0x7f15c802e000 comp rx=0 tx=0).stop 2024-04-25T01:40:01.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.940+0000 7f15d4729640 1 -- 172.21.15.77:0/3316114930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15cc0c97c0 msgr2=0x7f15cc0c1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:01.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.940+0000 7f15d4729640 1 --2- 172.21.15.77:0/3316114930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15cc0c97c0 0x7f15cc0c1a40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00c7f0 tx=0x7f15bc00ccb0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.940+0000 7f15d4729640 1 -- 172.21.15.77:0/3316114930 shutdown_connections 2024-04-25T01:40:01.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.940+0000 7f15d4729640 1 --2- 172.21.15.77:0/3316114930 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f15b006be60 0x7f15b006e320 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.940+0000 7f15d4729640 1 --2- 172.21.15.77:0/3316114930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15cc0c97c0 0x7f15cc0c1a40 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.940+0000 7f15d4729640 1 --2- 172.21.15.77:0/3316114930 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15cc153530 0x7f15cc0c1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.940+0000 7f15d4729640 1 --2- 172.21.15.77:0/3316114930 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15cc0bef50 0x7f15cc155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:01.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.940+0000 7f15d4729640 1 -- 172.21.15.77:0/3316114930 >> 172.21.15.77:0/3316114930 conn(0x7f15cc0672c0 msgr2=0x7f15cc1595f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:01.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.941+0000 7f15d4729640 1 -- 172.21.15.77:0/3316114930 shutdown_connections 2024-04-25T01:40:01.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:01.941+0000 7f15d4729640 1 -- 172.21.15.77:0/3316114930 wait complete. 2024-04-25T01:40:01.935 INFO:tasks.mds_thrash:Wait for all MDSs to reach steady state... 2024-04-25T01:40:01.935 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:40:02.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.048+0000 7fa5f8eb3640 1 Processor -- start 2024-04-25T01:40:02.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.048+0000 7fa5f8eb3640 1 -- start start 2024-04-25T01:40:02.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.049+0000 7fa5f8eb3640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa5f4150090 0x7fa5f4156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:02.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.049+0000 7fa5f8eb3640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa5f40c8200 0x7fa5f40c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:02.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.049+0000 7fa5f8eb3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa5f406c280 0x7fa5f40c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:02.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.049+0000 7fa5f8eb3640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa5f406b830 con 0x7fa5f40c8200 2024-04-25T01:40:02.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.049+0000 7fa5f8eb3640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fa5f40c9de0 con 0x7fa5f4150090 2024-04-25T01:40:02.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.049+0000 7fa5f8eb3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fa5f40c89c0 con 0x7fa5f406c280 2024-04-25T01:40:02.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.049+0000 7fa5f1d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa5f40c8200 0x7fa5f40c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:02.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.049+0000 7fa5f1d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa5f40c8200 0x7fa5f40c98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38958/0 (socket says 172.21.15.77:38958) 2024-04-25T01:40:02.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.049+0000 7fa5f1d9b640 1 -- 172.21.15.77:0/2258910191 learned_addr learned my addr 172.21.15.77:0/2258910191 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:02.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.050+0000 7fa5f1d9b640 1 -- 172.21.15.77:0/2258910191 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa5f406c280 msgr2=0x7fa5f40c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:02.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.050+0000 7fa5f1d9b640 1 --2- 172.21.15.77:0/2258910191 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa5f406c280 0x7fa5f40c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.050+0000 7fa5f1d9b640 1 -- 172.21.15.77:0/2258910191 >> v2:172.21.15.121:3300/0 conn(0x7fa5f4150090 msgr2=0x7fa5f4156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:02.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.050+0000 7fa5f1d9b640 1 --2- 172.21.15.77:0/2258910191 >> v2:172.21.15.121:3300/0 conn(0x7fa5f4150090 0x7fa5f4156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.050+0000 7fa5f1d9b640 1 -- 172.21.15.77:0/2258910191 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f40c8ca0 con 0x7fa5f40c8200 2024-04-25T01:40:02.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.050+0000 7fa5f1d9b640 1 --2- 172.21.15.77:0/2258910191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5f40c8200 0x7fa5f40c98a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa5f40ae020 tx=0x7fa5e802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93164f26eef638b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:02.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.050+0000 7fa5f159a640 1 -- 172.21.15.77:0/2258910191 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8037070 con 0x7fa5f40c8200 2024-04-25T01:40:02.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.050+0000 7fa5f159a640 1 -- 172.21.15.77:0/2258910191 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5e8032440 con 0x7fa5f40c8200 2024-04-25T01:40:02.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.050+0000 7fa5f159a640 1 -- 172.21.15.77:0/2258910191 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8032810 con 0x7fa5f40c8200 2024-04-25T01:40:02.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.051+0000 7fa5f8eb3640 1 -- 172.21.15.77:0/2258910191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5f40c8200 msgr2=0x7fa5f40c98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:02.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.051+0000 7fa5f8eb3640 1 --2- 172.21.15.77:0/2258910191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5f40c8200 0x7fa5f40c98a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa5f40ae020 tx=0x7fa5e802a1e0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.051+0000 7fa5f8eb3640 1 -- 172.21.15.77:0/2258910191 shutdown_connections 2024-04-25T01:40:02.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.051+0000 7fa5f8eb3640 1 --2- 172.21.15.77:0/2258910191 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa5f406c280 0x7fa5f40c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.051+0000 7fa5f8eb3640 1 --2- 172.21.15.77:0/2258910191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5f40c8200 0x7fa5f40c98a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.051+0000 7fa5f8eb3640 1 --2- 172.21.15.77:0/2258910191 >> v2:172.21.15.121:3300/0 conn(0x7fa5f4150090 0x7fa5f4156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.051+0000 7fa5f8eb3640 1 -- 172.21.15.77:0/2258910191 >> 172.21.15.77:0/2258910191 conn(0x7fa5f40ad4d0 msgr2=0x7fa5f40ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:02.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.051+0000 7fa5f8eb3640 1 -- 172.21.15.77:0/2258910191 shutdown_connections 2024-04-25T01:40:02.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.051+0000 7fa5f8eb3640 1 -- 172.21.15.77:0/2258910191 wait complete. 2024-04-25T01:40:02.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.052+0000 7fa5f8eb3640 1 Processor -- start 2024-04-25T01:40:02.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.052+0000 7fa5f8eb3640 1 -- start start 2024-04-25T01:40:02.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.053+0000 7fa5f8eb3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5f406c280 0x7fa5f41585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:02.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.053+0000 7fa5f8eb3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa5f40c8200 0x7fa5f41ef2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:02.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.053+0000 7fa5f8eb3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5f4150090 0x7fa5f41ef830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:02.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.053+0000 7fa5f8eb3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f40c86b0 con 0x7fa5f4150090 2024-04-25T01:40:02.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.053+0000 7fa5f8eb3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f406bd60 con 0x7fa5f406c280 2024-04-25T01:40:02.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.053+0000 7fa5f8eb3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fa5f406c690 con 0x7fa5f40c8200 2024-04-25T01:40:02.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.053+0000 7fa5f2d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5f4150090 0x7fa5f41ef830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:02.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.053+0000 7fa5f2d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5f4150090 0x7fa5f41ef830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38974/0 (socket says 172.21.15.77:38974) 2024-04-25T01:40:02.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.053+0000 7fa5f2d9d640 1 -- 172.21.15.77:0/791434707 learned_addr learned my addr 172.21.15.77:0/791434707 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:02.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.053+0000 7fa5f1d9b640 1 --2- 172.21.15.77:0/791434707 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa5f40c8200 0x7fa5f41ef2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:02.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.053+0000 7fa5f259c640 1 --2- 172.21.15.77:0/791434707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5f406c280 0x7fa5f41585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:02.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.053+0000 7fa5f2d9d640 1 -- 172.21.15.77:0/791434707 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa5f40c8200 msgr2=0x7fa5f41ef2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:02.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.053+0000 7fa5f2d9d640 1 --2- 172.21.15.77:0/791434707 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa5f40c8200 0x7fa5f41ef2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.053+0000 7fa5f2d9d640 1 -- 172.21.15.77:0/791434707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5f406c280 msgr2=0x7fa5f41585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:02.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.053+0000 7fa5f2d9d640 1 --2- 172.21.15.77:0/791434707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5f406c280 0x7fa5f41585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.053+0000 7fa5f2d9d640 1 -- 172.21.15.77:0/791434707 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f40bf600 con 0x7fa5f4150090 2024-04-25T01:40:02.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.053+0000 7fa5f2d9d640 1 --2- 172.21.15.77:0/791434707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5f4150090 0x7fa5f41ef830 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec00b410 tx=0x7fa5ec00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:02.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.054+0000 7fa5e2ffd640 1 -- 172.21.15.77:0/791434707 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec015020 con 0x7fa5f4150090 2024-04-25T01:40:02.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.054+0000 7fa5e2ffd640 1 -- 172.21.15.77:0/791434707 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5ec011850 con 0x7fa5f4150090 2024-04-25T01:40:02.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.054+0000 7fa5f8eb3640 1 -- 172.21.15.77:0/791434707 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5f40bf940 con 0x7fa5f4150090 2024-04-25T01:40:02.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.054+0000 7fa5e2ffd640 1 -- 172.21.15.77:0/791434707 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec011c40 con 0x7fa5f4150090 2024-04-25T01:40:02.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.054+0000 7fa5f8eb3640 1 -- 172.21.15.77:0/791434707 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5f41efd70 con 0x7fa5f4150090 2024-04-25T01:40:02.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.055+0000 7fa5f8eb3640 1 -- 172.21.15.77:0/791434707 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5f40c1ca0 con 0x7fa5f4150090 2024-04-25T01:40:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.055+0000 7fa5e2ffd640 1 -- 172.21.15.77:0/791434707 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa5ec018020 con 0x7fa5f4150090 2024-04-25T01:40:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.055+0000 7fa5e2ffd640 1 --2- 172.21.15.77:0/791434707 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa5d406be30 0x7fa5d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.055+0000 7fa5e2ffd640 1 -- 172.21.15.77:0/791434707 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fa5ec08aef0 con 0x7fa5f4150090 2024-04-25T01:40:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.055+0000 7fa5f259c640 1 --2- 172.21.15.77:0/791434707 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa5d406be30 0x7fa5d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.056+0000 7fa5f259c640 1 --2- 172.21.15.77:0/791434707 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa5d406be30 0x7fa5d406e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa5e400a400 tx=0x7fa5e400d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:02.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.060+0000 7fa5e2ffd640 1 -- 172.21.15.77:0/791434707 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa5f40c1ca0 con 0x7fa5f4150090 2024-04-25T01:40:02.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.268+0000 7fa5f8eb3640 1 -- 172.21.15.77:0/791434707 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5f404f500 con 0x7fa5f4150090 2024-04-25T01:40:02.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.269+0000 7fa5e2ffd640 1 -- 172.21.15.77:0/791434707 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6488 (secure 0 0 0) 0x7fa5ec01f020 con 0x7fa5f4150090 2024-04-25T01:40:02.253 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:40:02.253 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:39:36.787357+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6837/3454203695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3454203695},{"type":"v1","addr":"172.21.15.77:6837","nonce":3454203695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-04-25T01:40:02.254 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 12 2024-04-25T01:40:02.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.271+0000 7fa5f8eb3640 1 -- 172.21.15.77:0/791434707 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa5d406be30 msgr2=0x7fa5d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:02.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.271+0000 7fa5f8eb3640 1 --2- 172.21.15.77:0/791434707 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa5d406be30 0x7fa5d406e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa5e400a400 tx=0x7fa5e400d040 comp rx=0 tx=0).stop 2024-04-25T01:40:02.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.271+0000 7fa5f8eb3640 1 -- 172.21.15.77:0/791434707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5f4150090 msgr2=0x7fa5f41ef830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:02.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.271+0000 7fa5f8eb3640 1 --2- 172.21.15.77:0/791434707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5f4150090 0x7fa5f41ef830 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec00b410 tx=0x7fa5ec00b8d0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.271+0000 7fa5f8eb3640 1 -- 172.21.15.77:0/791434707 shutdown_connections 2024-04-25T01:40:02.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.271+0000 7fa5f8eb3640 1 --2- 172.21.15.77:0/791434707 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa5d406be30 0x7fa5d406e2f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.271+0000 7fa5f8eb3640 1 --2- 172.21.15.77:0/791434707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5f4150090 0x7fa5f41ef830 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.271+0000 7fa5f8eb3640 1 --2- 172.21.15.77:0/791434707 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa5f40c8200 0x7fa5f41ef2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.271+0000 7fa5f8eb3640 1 --2- 172.21.15.77:0/791434707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5f406c280 0x7fa5f41585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.271+0000 7fa5f8eb3640 1 -- 172.21.15.77:0/791434707 >> 172.21.15.77:0/791434707 conn(0x7fa5f40ad4d0 msgr2=0x7fa5f41548b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:02.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.271+0000 7fa5f8eb3640 1 -- 172.21.15.77:0/791434707 shutdown_connections 2024-04-25T01:40:02.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.271+0000 7fa5f8eb3640 1 -- 172.21.15.77:0/791434707 wait complete. 2024-04-25T01:40:02.266 INFO:tasks.mds_thrash:Ready to start thrashing 2024-04-25T01:40:02.266 INFO:tasks.mds_thrash.ceph_manager:waiting for clean 2024-04-25T01:40:02.266 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T01:40:02.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.379+0000 7f4dee1e9640 1 Processor -- start 2024-04-25T01:40:02.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.379+0000 7f4dee1e9640 1 -- start start 2024-04-25T01:40:02.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.380+0000 7f4dee1e9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4de80acc20 0x7f4de81558f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:02.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.380+0000 7f4dee1e9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4de806b480 con 0x7f4de8153cf0 2024-04-25T01:40:02.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.380+0000 7f4dee1e9640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4de806d2f0 con 0x7f4de80ac840 2024-04-25T01:40:02.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.380+0000 7f4dee1e9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f4de8151780 con 0x7f4de80acc20 2024-04-25T01:40:02.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.380+0000 7f4de7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4de80acc20 0x7f4de81558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:02.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.380+0000 7f4de7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4de80acc20 0x7f4de81558f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38990/0 (socket says 172.21.15.77:38990) 2024-04-25T01:40:02.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.380+0000 7f4de7fff640 1 -- 172.21.15.77:0/3595085046 learned_addr learned my addr 172.21.15.77:0/3595085046 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:02.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.380+0000 7f4de7fff640 1 -- 172.21.15.77:0/3595085046 >> v1:172.21.15.121:6789/0 conn(0x7f4de80ac840 legacy=0x7f4de81551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:02.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.380+0000 7f4de7fff640 1 -- 172.21.15.77:0/3595085046 >> v1:172.21.15.77:6789/0 conn(0x7f4de8153cf0 legacy=0x7f4de815c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:02.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.380+0000 7f4de67fc640 1 -- 172.21.15.77:0/3595085046 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3368196122 0 0) 0x7f4de806b480 con 0x7f4de8153cf0 2024-04-25T01:40:02.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.380+0000 7f4de7fff640 1 -- 172.21.15.77:0/3595085046 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de806d5d0 con 0x7f4de80acc20 2024-04-25T01:40:02.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.381+0000 7f4de7fff640 1 --2- 172.21.15.77:0/3595085046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4de80acc20 0x7f4de81558f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009e50 tx=0x7f4de002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b77777112b2be6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:02.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.381+0000 7f4de67fc640 1 -- 172.21.15.77:0/3595085046 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de0036070 con 0x7f4de80acc20 2024-04-25T01:40:02.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.381+0000 7f4de67fc640 1 -- 172.21.15.77:0/3595085046 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4de0031600 con 0x7f4de80acc20 2024-04-25T01:40:02.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.381+0000 7f4de67fc640 1 -- 172.21.15.77:0/3595085046 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de00319d0 con 0x7f4de80acc20 2024-04-25T01:40:02.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.381+0000 7f4dee1e9640 1 -- 172.21.15.77:0/3595085046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4de80acc20 msgr2=0x7f4de81558f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:02.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.381+0000 7f4dee1e9640 1 --2- 172.21.15.77:0/3595085046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4de80acc20 0x7f4de81558f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009e50 tx=0x7f4de002a730 comp rx=0 tx=0).stop 2024-04-25T01:40:02.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.382+0000 7f4dee1e9640 1 -- 172.21.15.77:0/3595085046 shutdown_connections 2024-04-25T01:40:02.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.382+0000 7f4dee1e9640 1 --2- 172.21.15.77:0/3595085046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4de80acc20 0x7f4de81558f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.382+0000 7f4dee1e9640 1 -- 172.21.15.77:0/3595085046 >> 172.21.15.77:0/3595085046 conn(0x7f4de80c3f80 msgr2=0x7f4de80c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:02.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.382+0000 7f4dee1e9640 1 -- 172.21.15.77:0/3595085046 shutdown_connections 2024-04-25T01:40:02.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.382+0000 7f4dee1e9640 1 -- 172.21.15.77:0/3595085046 wait complete. 2024-04-25T01:40:02.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.383+0000 7f4dee1e9640 1 Processor -- start 2024-04-25T01:40:02.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.383+0000 7f4dee1e9640 1 -- start start 2024-04-25T01:40:02.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.383+0000 7f4dee1e9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4de80ac840 0x7f4de8148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:02.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.383+0000 7f4dee1e9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4de80acc20 0x7f4de8156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:02.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.384+0000 7f4dee1e9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4de8153cf0 0x7f4de81e9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:02.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.384+0000 7f4dee1e9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4de806dc20 con 0x7f4de8153cf0 2024-04-25T01:40:02.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.384+0000 7f4dee1e9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4de806d0a0 con 0x7f4de80acc20 2024-04-25T01:40:02.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.384+0000 7f4dee1e9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f4de80ad090 con 0x7f4de80ac840 2024-04-25T01:40:02.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.384+0000 7f4de7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4de8153cf0 0x7f4de81e9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:02.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.384+0000 7f4de7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4de8153cf0 0x7f4de81e9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39004/0 (socket says 172.21.15.77:39004) 2024-04-25T01:40:02.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.384+0000 7f4de7fff640 1 -- 172.21.15.77:0/4225697892 learned_addr learned my addr 172.21.15.77:0/4225697892 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:02.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.384+0000 7f4de7fff640 1 -- 172.21.15.77:0/4225697892 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4de80ac840 msgr2=0x7f4de8148bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:02.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.384+0000 7f4de77fe640 1 --2- 172.21.15.77:0/4225697892 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4de80ac840 0x7f4de8148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:02.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.384+0000 7f4de6ffd640 1 --2- 172.21.15.77:0/4225697892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4de80acc20 0x7f4de8156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:02.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.384+0000 7f4de7fff640 1 --2- 172.21.15.77:0/4225697892 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4de80ac840 0x7f4de8148bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.384+0000 7f4de7fff640 1 -- 172.21.15.77:0/4225697892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4de80acc20 msgr2=0x7f4de8156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:02.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.384+0000 7f4de7fff640 1 --2- 172.21.15.77:0/4225697892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4de80acc20 0x7f4de8156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.384+0000 7f4de7fff640 1 -- 172.21.15.77:0/4225697892 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de81571e0 con 0x7f4de8153cf0 2024-04-25T01:40:02.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.384+0000 7f4de77fe640 1 --2- 172.21.15.77:0/4225697892 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4de80ac840 0x7f4de8148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:40:02.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.384+0000 7f4de6ffd640 1 --2- 172.21.15.77:0/4225697892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4de80acc20 0x7f4de8156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:40:02.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.384+0000 7f4de7fff640 1 --2- 172.21.15.77:0/4225697892 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4de8153cf0 0x7f4de81e9f70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009f70 tx=0x7f4de0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:02.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.384+0000 7f4dcffff640 1 -- 172.21.15.77:0/4225697892 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de0036050 con 0x7f4de8153cf0 2024-04-25T01:40:02.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.384+0000 7f4dcffff640 1 -- 172.21.15.77:0/4225697892 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4de0042070 con 0x7f4de8153cf0 2024-04-25T01:40:02.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.384+0000 7f4dee1e9640 1 -- 172.21.15.77:0/4225697892 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4de81ddd00 con 0x7f4de8153cf0 2024-04-25T01:40:02.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.384+0000 7f4dcffff640 1 -- 172.21.15.77:0/4225697892 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de0009510 con 0x7f4de8153cf0 2024-04-25T01:40:02.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.384+0000 7f4dee1e9640 1 -- 172.21.15.77:0/4225697892 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4de81dd350 con 0x7f4de8153cf0 2024-04-25T01:40:02.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.385+0000 7f4dee1e9640 1 -- 172.21.15.77:0/4225697892 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4de804f500 con 0x7f4de8153cf0 2024-04-25T01:40:02.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.386+0000 7f4dcffff640 1 -- 172.21.15.77:0/4225697892 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4de0007bf0 con 0x7f4de8153cf0 2024-04-25T01:40:02.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.386+0000 7f4dcffff640 1 --2- 172.21.15.77:0/4225697892 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4dd406be60 0x7f4dd406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:02.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.386+0000 7f4dcffff640 1 -- 172.21.15.77:0/4225697892 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f4de00abfc0 con 0x7f4de8153cf0 2024-04-25T01:40:02.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.386+0000 7f4de77fe640 1 --2- 172.21.15.77:0/4225697892 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4dd406be60 0x7f4dd406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:02.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.387+0000 7f4de77fe640 1 --2- 172.21.15.77:0/4225697892 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4dd406be60 0x7f4dd406e320 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4de8148630 tx=0x7f4dd8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:02.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.390+0000 7f4dcffff640 1 -- 172.21.15.77:0/4225697892 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4de0045360 con 0x7f4de8153cf0 2024-04-25T01:40:02.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.560+0000 7f4dee1e9640 1 -- 172.21.15.77:0/4225697892 --> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4de8156f90 con 0x7f4dd406be60 2024-04-25T01:40:02.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.571+0000 7f4dcffff640 1 -- 172.21.15.77:0/4225697892 <== mgr.4098 v2:172.21.15.77:6832/4208232183 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490299 (secure 0 0 0) 0x7f4de8156f90 con 0x7f4dd406be60 2024-04-25T01:40:02.560 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:40:02.563 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-25T01:40:02.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.575+0000 7f4dee1e9640 1 -- 172.21.15.77:0/4225697892 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4dd406be60 msgr2=0x7f4dd406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:02.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.575+0000 7f4dee1e9640 1 --2- 172.21.15.77:0/4225697892 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4dd406be60 0x7f4dd406e320 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4de8148630 tx=0x7f4dd8009040 comp rx=0 tx=0).stop 2024-04-25T01:40:02.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.575+0000 7f4dee1e9640 1 -- 172.21.15.77:0/4225697892 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4de8153cf0 msgr2=0x7f4de81e9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:02.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.575+0000 7f4dee1e9640 1 --2- 172.21.15.77:0/4225697892 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4de8153cf0 0x7f4de81e9f70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009f70 tx=0x7f4de0004a40 comp rx=0 tx=0).stop 2024-04-25T01:40:02.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.575+0000 7f4dee1e9640 1 -- 172.21.15.77:0/4225697892 shutdown_connections 2024-04-25T01:40:02.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.575+0000 7f4dee1e9640 1 --2- 172.21.15.77:0/4225697892 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4dd406be60 0x7f4dd406e320 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.575+0000 7f4dee1e9640 1 --2- 172.21.15.77:0/4225697892 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4de8153cf0 0x7f4de81e9f70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.575+0000 7f4dee1e9640 1 --2- 172.21.15.77:0/4225697892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4de80acc20 0x7f4de8156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.575+0000 7f4dee1e9640 1 --2- 172.21.15.77:0/4225697892 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4de80ac840 0x7f4de8148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.575+0000 7f4dee1e9640 1 -- 172.21.15.77:0/4225697892 >> 172.21.15.77:0/4225697892 conn(0x7f4de80c3f80 msgr2=0x7f4de80c4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:02.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.575+0000 7f4dee1e9640 1 -- 172.21.15.77:0/4225697892 shutdown_connections 2024-04-25T01:40:02.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.575+0000 7f4dee1e9640 1 -- 172.21.15.77:0/4225697892 wait complete. 2024-04-25T01:40:02.570 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-04-25T01:40:01.659550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595444,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219444,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755276,"statfs":{"total":773094113280,"available":772869402624,"internally_reserved":0,"allocated":3350528,"data_stored":1984976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":256,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002726"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197412+0000","last_change":"2024-04-25T01:39:33.445614+0000","last_active":"2024-04-25T01:39:35.197412+0000","last_peered":"2024-04-25T01:39:35.197412+0000","last_clean":"2024-04-25T01:39:35.197412+0000","last_became_active":"2024-04-25T01:39:33.445090+0000","last_became_peered":"2024-04-25T01:39:33.445090+0000","last_unstale":"2024-04-25T01:39:35.197412+0000","last_undegraded":"2024-04-25T01:39:35.197412+0000","last_fullsized":"2024-04-25T01:39:35.197412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:50.951488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559582+0000","last_change":"2024-04-25T01:39:23.377096+0000","last_active":"2024-04-25T01:39:34.559582+0000","last_peered":"2024-04-25T01:39:34.559582+0000","last_clean":"2024-04-25T01:39:34.559582+0000","last_became_active":"2024-04-25T01:39:23.376811+0000","last_became_peered":"2024-04-25T01:39:23.376811+0000","last_unstale":"2024-04-25T01:39:34.559582+0000","last_undegraded":"2024-04-25T01:39:34.559582+0000","last_fullsized":"2024-04-25T01:39:34.559582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:26.888605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430280+0000","last_change":"2024-04-25T01:39:24.394317+0000","last_active":"2024-04-25T01:39:34.430280+0000","last_peered":"2024-04-25T01:39:34.430280+0000","last_clean":"2024-04-25T01:39:34.430280+0000","last_became_active":"2024-04-25T01:39:24.394032+0000","last_became_peered":"2024-04-25T01:39:24.394032+0000","last_unstale":"2024-04-25T01:39:34.430280+0000","last_undegraded":"2024-04-25T01:39:34.430280+0000","last_fullsized":"2024-04-25T01:39:34.430280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:11.795443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429310+0000","last_change":"2024-04-25T01:39:32.421607+0000","last_active":"2024-04-25T01:39:34.429310+0000","last_peered":"2024-04-25T01:39:34.429310+0000","last_clean":"2024-04-25T01:39:34.429310+0000","last_became_active":"2024-04-25T01:39:32.421355+0000","last_became_peered":"2024-04-25T01:39:32.421355+0000","last_unstale":"2024-04-25T01:39:34.429310+0000","last_undegraded":"2024-04-25T01:39:34.429310+0000","last_fullsized":"2024-04-25T01:39:34.429310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:12:14.019262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198433+0000","last_change":"2024-04-25T01:39:33.436651+0000","last_active":"2024-04-25T01:39:35.198433+0000","last_peered":"2024-04-25T01:39:35.198433+0000","last_clean":"2024-04-25T01:39:35.198433+0000","last_became_active":"2024-04-25T01:39:33.436370+0000","last_became_peered":"2024-04-25T01:39:33.436370+0000","last_unstale":"2024-04-25T01:39:35.198433+0000","last_undegraded":"2024-04-25T01:39:35.198433+0000","last_fullsized":"2024-04-25T01:39:35.198433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:57:10.341738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430287+0000","last_change":"2024-04-25T01:39:23.369400+0000","last_active":"2024-04-25T01:39:34.430287+0000","last_peered":"2024-04-25T01:39:34.430287+0000","last_clean":"2024-04-25T01:39:34.430287+0000","last_became_active":"2024-04-25T01:39:23.368726+0000","last_became_peered":"2024-04-25T01:39:23.368726+0000","last_unstale":"2024-04-25T01:39:34.430287+0000","last_undegraded":"2024-04-25T01:39:34.430287+0000","last_fullsized":"2024-04-25T01:39:34.430287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:35:42.971179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559440+0000","last_change":"2024-04-25T01:39:24.403873+0000","last_active":"2024-04-25T01:39:34.559440+0000","last_peered":"2024-04-25T01:39:34.559440+0000","last_clean":"2024-04-25T01:39:34.559440+0000","last_became_active":"2024-04-25T01:39:24.403623+0000","last_became_peered":"2024-04-25T01:39:24.403623+0000","last_unstale":"2024-04-25T01:39:34.559440+0000","last_undegraded":"2024-04-25T01:39:34.559440+0000","last_fullsized":"2024-04-25T01:39:34.559440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:49.360933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197343+0000","last_change":"2024-04-25T01:39:32.430985+0000","last_active":"2024-04-25T01:39:35.197343+0000","last_peered":"2024-04-25T01:39:35.197343+0000","last_clean":"2024-04-25T01:39:35.197343+0000","last_became_active":"2024-04-25T01:39:32.430617+0000","last_became_peered":"2024-04-25T01:39:32.430617+0000","last_unstale":"2024-04-25T01:39:35.197343+0000","last_undegraded":"2024-04-25T01:39:35.197343+0000","last_fullsized":"2024-04-25T01:39:35.197343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:13.938619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199408+0000","last_change":"2024-04-25T01:39:33.444043+0000","last_active":"2024-04-25T01:39:35.199408+0000","last_peered":"2024-04-25T01:39:35.199408+0000","last_clean":"2024-04-25T01:39:35.199408+0000","last_became_active":"2024-04-25T01:39:33.443737+0000","last_became_peered":"2024-04-25T01:39:33.443737+0000","last_unstale":"2024-04-25T01:39:35.199408+0000","last_undegraded":"2024-04-25T01:39:35.199408+0000","last_fullsized":"2024-04-25T01:39:35.199408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:02:50.401910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199857+0000","last_change":"2024-04-25T01:39:23.377963+0000","last_active":"2024-04-25T01:39:35.199857+0000","last_peered":"2024-04-25T01:39:35.199857+0000","last_clean":"2024-04-25T01:39:35.199857+0000","last_became_active":"2024-04-25T01:39:23.377402+0000","last_became_peered":"2024-04-25T01:39:23.377402+0000","last_unstale":"2024-04-25T01:39:35.199857+0000","last_undegraded":"2024-04-25T01:39:35.199857+0000","last_fullsized":"2024-04-25T01:39:35.199857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:15.873450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199352+0000","last_change":"2024-04-25T01:39:24.394512+0000","last_active":"2024-04-25T01:39:35.199352+0000","last_peered":"2024-04-25T01:39:35.199352+0000","last_clean":"2024-04-25T01:39:35.199352+0000","last_became_active":"2024-04-25T01:39:24.393954+0000","last_became_peered":"2024-04-25T01:39:24.393954+0000","last_unstale":"2024-04-25T01:39:35.199352+0000","last_undegraded":"2024-04-25T01:39:35.199352+0000","last_fullsized":"2024-04-25T01:39:35.199352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:30.534400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197850+0000","last_change":"2024-04-25T01:39:32.428198+0000","last_active":"2024-04-25T01:39:35.197850+0000","last_peered":"2024-04-25T01:39:35.197850+0000","last_clean":"2024-04-25T01:39:35.197850+0000","last_became_active":"2024-04-25T01:39:32.427955+0000","last_became_peered":"2024-04-25T01:39:32.427955+0000","last_unstale":"2024-04-25T01:39:35.197850+0000","last_undegraded":"2024-04-25T01:39:35.197850+0000","last_fullsized":"2024-04-25T01:39:35.197850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:07.684150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198064+0000","last_change":"2024-04-25T01:39:33.439854+0000","last_active":"2024-04-25T01:39:35.198064+0000","last_peered":"2024-04-25T01:39:35.198064+0000","last_clean":"2024-04-25T01:39:35.198064+0000","last_became_active":"2024-04-25T01:39:33.439555+0000","last_became_peered":"2024-04-25T01:39:33.439555+0000","last_unstale":"2024-04-25T01:39:35.198064+0000","last_undegraded":"2024-04-25T01:39:35.198064+0000","last_fullsized":"2024-04-25T01:39:35.198064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:50.250748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198904+0000","last_change":"2024-04-25T01:39:23.377093+0000","last_active":"2024-04-25T01:39:35.198904+0000","last_peered":"2024-04-25T01:39:35.198904+0000","last_clean":"2024-04-25T01:39:35.198904+0000","last_became_active":"2024-04-25T01:39:23.376744+0000","last_became_peered":"2024-04-25T01:39:23.376744+0000","last_unstale":"2024-04-25T01:39:35.198904+0000","last_undegraded":"2024-04-25T01:39:35.198904+0000","last_fullsized":"2024-04-25T01:39:35.198904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:43.529618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200129+0000","last_change":"2024-04-25T01:39:24.393293+0000","last_active":"2024-04-25T01:39:35.200129+0000","last_peered":"2024-04-25T01:39:35.200129+0000","last_clean":"2024-04-25T01:39:35.200129+0000","last_became_active":"2024-04-25T01:39:24.393005+0000","last_became_peered":"2024-04-25T01:39:24.393005+0000","last_unstale":"2024-04-25T01:39:35.200129+0000","last_undegraded":"2024-04-25T01:39:35.200129+0000","last_fullsized":"2024-04-25T01:39:35.200129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:32.070747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197654+0000","last_change":"2024-04-25T01:39:32.428956+0000","last_active":"2024-04-25T01:39:35.197654+0000","last_peered":"2024-04-25T01:39:35.197654+0000","last_clean":"2024-04-25T01:39:35.197654+0000","last_became_active":"2024-04-25T01:39:32.428705+0000","last_became_peered":"2024-04-25T01:39:32.428705+0000","last_unstale":"2024-04-25T01:39:35.197654+0000","last_undegraded":"2024-04-25T01:39:35.197654+0000","last_fullsized":"2024-04-25T01:39:35.197654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:06:22.998986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198197+0000","last_change":"2024-04-25T01:39:33.446571+0000","last_active":"2024-04-25T01:39:35.198197+0000","last_peered":"2024-04-25T01:39:35.198197+0000","last_clean":"2024-04-25T01:39:35.198197+0000","last_became_active":"2024-04-25T01:39:33.446234+0000","last_became_peered":"2024-04-25T01:39:33.446234+0000","last_unstale":"2024-04-25T01:39:35.198197+0000","last_undegraded":"2024-04-25T01:39:35.198197+0000","last_fullsized":"2024-04-25T01:39:35.198197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:12.742092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434733+0000","last_change":"2024-04-25T01:39:24.398859+0000","last_active":"2024-04-25T01:39:34.434733+0000","last_peered":"2024-04-25T01:39:34.434733+0000","last_clean":"2024-04-25T01:39:34.434733+0000","last_became_active":"2024-04-25T01:39:24.398618+0000","last_became_peered":"2024-04-25T01:39:24.398618+0000","last_unstale":"2024-04-25T01:39:34.434733+0000","last_undegraded":"2024-04-25T01:39:34.434733+0000","last_fullsized":"2024-04-25T01:39:34.434733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:15.278376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199208+0000","last_change":"2024-04-25T01:39:23.377717+0000","last_active":"2024-04-25T01:39:35.199208+0000","last_peered":"2024-04-25T01:39:35.199208+0000","last_clean":"2024-04-25T01:39:35.199208+0000","last_became_active":"2024-04-25T01:39:23.377291+0000","last_became_peered":"2024-04-25T01:39:23.377291+0000","last_unstale":"2024-04-25T01:39:35.199208+0000","last_undegraded":"2024-04-25T01:39:35.199208+0000","last_fullsized":"2024-04-25T01:39:35.199208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:06.402745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197947+0000","last_change":"2024-04-25T01:39:32.426840+0000","last_active":"2024-04-25T01:39:35.197947+0000","last_peered":"2024-04-25T01:39:35.197947+0000","last_clean":"2024-04-25T01:39:35.197947+0000","last_became_active":"2024-04-25T01:39:32.426529+0000","last_became_peered":"2024-04-25T01:39:32.426529+0000","last_unstale":"2024-04-25T01:39:35.197947+0000","last_undegraded":"2024-04-25T01:39:35.197947+0000","last_fullsized":"2024-04-25T01:39:35.197947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:57.097685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198092+0000","last_change":"2024-04-25T01:39:33.437767+0000","last_active":"2024-04-25T01:39:35.198092+0000","last_peered":"2024-04-25T01:39:35.198092+0000","last_clean":"2024-04-25T01:39:35.198092+0000","last_became_active":"2024-04-25T01:39:33.437483+0000","last_became_peered":"2024-04-25T01:39:33.437483+0000","last_unstale":"2024-04-25T01:39:35.198092+0000","last_undegraded":"2024-04-25T01:39:35.198092+0000","last_fullsized":"2024-04-25T01:39:35.198092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:44.321779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429750+0000","last_change":"2024-04-25T01:39:24.387100+0000","last_active":"2024-04-25T01:39:34.429750+0000","last_peered":"2024-04-25T01:39:34.429750+0000","last_clean":"2024-04-25T01:39:34.429750+0000","last_became_active":"2024-04-25T01:39:24.386782+0000","last_became_peered":"2024-04-25T01:39:24.386782+0000","last_unstale":"2024-04-25T01:39:34.429750+0000","last_undegraded":"2024-04-25T01:39:34.429750+0000","last_fullsized":"2024-04-25T01:39:34.429750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:48.789139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198800+0000","last_change":"2024-04-25T01:39:23.368446+0000","last_active":"2024-04-25T01:39:35.198800+0000","last_peered":"2024-04-25T01:39:35.198800+0000","last_clean":"2024-04-25T01:39:35.198800+0000","last_became_active":"2024-04-25T01:39:23.368183+0000","last_became_peered":"2024-04-25T01:39:23.368183+0000","last_unstale":"2024-04-25T01:39:35.198800+0000","last_undegraded":"2024-04-25T01:39:35.198800+0000","last_fullsized":"2024-04-25T01:39:35.198800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:13.738756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198383+0000","last_change":"2024-04-25T01:39:32.427589+0000","last_active":"2024-04-25T01:39:35.198383+0000","last_peered":"2024-04-25T01:39:35.198383+0000","last_clean":"2024-04-25T01:39:35.198383+0000","last_became_active":"2024-04-25T01:39:32.427328+0000","last_became_peered":"2024-04-25T01:39:32.427328+0000","last_unstale":"2024-04-25T01:39:35.198383+0000","last_undegraded":"2024-04-25T01:39:35.198383+0000","last_fullsized":"2024-04-25T01:39:35.198383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:12.328303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199145+0000","last_change":"2024-04-25T01:39:33.447634+0000","last_active":"2024-04-25T01:39:35.199145+0000","last_peered":"2024-04-25T01:39:35.199145+0000","last_clean":"2024-04-25T01:39:35.199145+0000","last_became_active":"2024-04-25T01:39:33.445908+0000","last_became_peered":"2024-04-25T01:39:33.445908+0000","last_unstale":"2024-04-25T01:39:35.199145+0000","last_undegraded":"2024-04-25T01:39:35.199145+0000","last_fullsized":"2024-04-25T01:39:35.199145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:13.586396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429559+0000","last_change":"2024-04-25T01:39:24.373600+0000","last_active":"2024-04-25T01:39:34.429559+0000","last_peered":"2024-04-25T01:39:34.429559+0000","last_clean":"2024-04-25T01:39:34.429559+0000","last_became_active":"2024-04-25T01:39:24.373311+0000","last_became_peered":"2024-04-25T01:39:24.373311+0000","last_unstale":"2024-04-25T01:39:34.429559+0000","last_undegraded":"2024-04-25T01:39:34.429559+0000","last_fullsized":"2024-04-25T01:39:34.429559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:46.338959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197953+0000","last_change":"2024-04-25T01:39:23.377103+0000","last_active":"2024-04-25T01:39:35.197953+0000","last_peered":"2024-04-25T01:39:35.197953+0000","last_clean":"2024-04-25T01:39:35.197953+0000","last_became_active":"2024-04-25T01:39:23.376826+0000","last_became_peered":"2024-04-25T01:39:23.376826+0000","last_unstale":"2024-04-25T01:39:35.197953+0000","last_undegraded":"2024-04-25T01:39:35.197953+0000","last_fullsized":"2024-04-25T01:39:35.197953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:46.663754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198643+0000","last_change":"2024-04-25T01:39:32.426839+0000","last_active":"2024-04-25T01:39:35.198643+0000","last_peered":"2024-04-25T01:39:35.198643+0000","last_clean":"2024-04-25T01:39:35.198643+0000","last_became_active":"2024-04-25T01:39:32.426545+0000","last_became_peered":"2024-04-25T01:39:32.426545+0000","last_unstale":"2024-04-25T01:39:35.198643+0000","last_undegraded":"2024-04-25T01:39:35.198643+0000","last_fullsized":"2024-04-25T01:39:35.198643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:22.161839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199023+0000","last_change":"2024-04-25T01:39:33.444616+0000","last_active":"2024-04-25T01:39:35.199023+0000","last_peered":"2024-04-25T01:39:35.199023+0000","last_clean":"2024-04-25T01:39:35.199023+0000","last_became_active":"2024-04-25T01:39:33.444350+0000","last_became_peered":"2024-04-25T01:39:33.444350+0000","last_unstale":"2024-04-25T01:39:35.199023+0000","last_undegraded":"2024-04-25T01:39:35.199023+0000","last_fullsized":"2024-04-25T01:39:35.199023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:47:15.686320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198460+0000","last_change":"2024-04-25T01:39:24.386969+0000","last_active":"2024-04-25T01:39:35.198460+0000","last_peered":"2024-04-25T01:39:35.198460+0000","last_clean":"2024-04-25T01:39:35.198460+0000","last_became_active":"2024-04-25T01:39:24.386376+0000","last_became_peered":"2024-04-25T01:39:24.386376+0000","last_unstale":"2024-04-25T01:39:35.198460+0000","last_undegraded":"2024-04-25T01:39:35.198460+0000","last_fullsized":"2024-04-25T01:39:35.198460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:13:31.585462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198150+0000","last_change":"2024-04-25T01:39:23.378993+0000","last_active":"2024-04-25T01:39:35.198150+0000","last_peered":"2024-04-25T01:39:35.198150+0000","last_clean":"2024-04-25T01:39:35.198150+0000","last_became_active":"2024-04-25T01:39:23.376908+0000","last_became_peered":"2024-04-25T01:39:23.376908+0000","last_unstale":"2024-04-25T01:39:35.198150+0000","last_undegraded":"2024-04-25T01:39:35.198150+0000","last_fullsized":"2024-04-25T01:39:35.198150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:13:18.370559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199153+0000","last_change":"2024-04-25T01:39:32.433597+0000","last_active":"2024-04-25T01:39:35.199153+0000","last_peered":"2024-04-25T01:39:35.199153+0000","last_clean":"2024-04-25T01:39:35.199153+0000","last_became_active":"2024-04-25T01:39:32.433307+0000","last_became_peered":"2024-04-25T01:39:32.433307+0000","last_unstale":"2024-04-25T01:39:35.199153+0000","last_undegraded":"2024-04-25T01:39:35.199153+0000","last_fullsized":"2024-04-25T01:39:35.199153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:20.784385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429204+0000","last_change":"2024-04-25T01:39:33.427297+0000","last_active":"2024-04-25T01:39:34.429204+0000","last_peered":"2024-04-25T01:39:34.429204+0000","last_clean":"2024-04-25T01:39:34.429204+0000","last_became_active":"2024-04-25T01:39:33.426132+0000","last_became_peered":"2024-04-25T01:39:33.426132+0000","last_unstale":"2024-04-25T01:39:34.429204+0000","last_undegraded":"2024-04-25T01:39:34.429204+0000","last_fullsized":"2024-04-25T01:39:34.429204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:04.147341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559652+0000","last_change":"2024-04-25T01:39:24.393003+0000","last_active":"2024-04-25T01:39:34.559652+0000","last_peered":"2024-04-25T01:39:34.559652+0000","last_clean":"2024-04-25T01:39:34.559652+0000","last_became_active":"2024-04-25T01:39:24.392209+0000","last_became_peered":"2024-04-25T01:39:24.392209+0000","last_unstale":"2024-04-25T01:39:34.559652+0000","last_undegraded":"2024-04-25T01:39:34.559652+0000","last_fullsized":"2024-04-25T01:39:34.559652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:44:58.432859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434880+0000","last_change":"2024-04-25T01:39:23.379804+0000","last_active":"2024-04-25T01:39:34.434880+0000","last_peered":"2024-04-25T01:39:34.434880+0000","last_clean":"2024-04-25T01:39:34.434880+0000","last_became_active":"2024-04-25T01:39:23.379430+0000","last_became_peered":"2024-04-25T01:39:23.379430+0000","last_unstale":"2024-04-25T01:39:34.434880+0000","last_undegraded":"2024-04-25T01:39:34.434880+0000","last_fullsized":"2024-04-25T01:39:34.434880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:42:23.254767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198196+0000","last_change":"2024-04-25T01:39:32.432763+0000","last_active":"2024-04-25T01:39:35.198196+0000","last_peered":"2024-04-25T01:39:35.198196+0000","last_clean":"2024-04-25T01:39:35.198196+0000","last_became_active":"2024-04-25T01:39:32.432482+0000","last_became_peered":"2024-04-25T01:39:32.432482+0000","last_unstale":"2024-04-25T01:39:35.198196+0000","last_undegraded":"2024-04-25T01:39:35.198196+0000","last_fullsized":"2024-04-25T01:39:35.198196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:04.848726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197990+0000","last_change":"2024-04-25T01:39:33.445800+0000","last_active":"2024-04-25T01:39:35.197990+0000","last_peered":"2024-04-25T01:39:35.197990+0000","last_clean":"2024-04-25T01:39:35.197990+0000","last_became_active":"2024-04-25T01:39:33.445500+0000","last_became_peered":"2024-04-25T01:39:33.445500+0000","last_unstale":"2024-04-25T01:39:35.197990+0000","last_undegraded":"2024-04-25T01:39:35.197990+0000","last_fullsized":"2024-04-25T01:39:35.197990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:06:36.800043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430196+0000","last_change":"2024-04-25T01:39:24.375811+0000","last_active":"2024-04-25T01:39:34.430196+0000","last_peered":"2024-04-25T01:39:34.430196+0000","last_clean":"2024-04-25T01:39:34.430196+0000","last_became_active":"2024-04-25T01:39:24.375603+0000","last_became_peered":"2024-04-25T01:39:24.375603+0000","last_unstale":"2024-04-25T01:39:34.430196+0000","last_undegraded":"2024-04-25T01:39:34.430196+0000","last_fullsized":"2024-04-25T01:39:34.430196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:10:26.247501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198161+0000","last_change":"2024-04-25T01:39:23.377687+0000","last_active":"2024-04-25T01:39:35.198161+0000","last_peered":"2024-04-25T01:39:35.198161+0000","last_clean":"2024-04-25T01:39:35.198161+0000","last_became_active":"2024-04-25T01:39:23.377372+0000","last_became_peered":"2024-04-25T01:39:23.377372+0000","last_unstale":"2024-04-25T01:39:35.198161+0000","last_undegraded":"2024-04-25T01:39:35.198161+0000","last_fullsized":"2024-04-25T01:39:35.198161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:51.983659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429145+0000","last_change":"2024-04-25T01:39:32.430816+0000","last_active":"2024-04-25T01:39:34.429145+0000","last_peered":"2024-04-25T01:39:34.429145+0000","last_clean":"2024-04-25T01:39:34.429145+0000","last_became_active":"2024-04-25T01:39:32.430537+0000","last_became_peered":"2024-04-25T01:39:32.430537+0000","last_unstale":"2024-04-25T01:39:34.429145+0000","last_undegraded":"2024-04-25T01:39:34.429145+0000","last_fullsized":"2024-04-25T01:39:34.429145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:58.939453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434436+0000","last_change":"2024-04-25T01:39:33.440287+0000","last_active":"2024-04-25T01:39:34.434436+0000","last_peered":"2024-04-25T01:39:34.434436+0000","last_clean":"2024-04-25T01:39:34.434436+0000","last_became_active":"2024-04-25T01:39:33.439796+0000","last_became_peered":"2024-04-25T01:39:33.439796+0000","last_unstale":"2024-04-25T01:39:34.434436+0000","last_undegraded":"2024-04-25T01:39:34.434436+0000","last_fullsized":"2024-04-25T01:39:34.434436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:08.515401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198342+0000","last_change":"2024-04-25T01:39:24.376933+0000","last_active":"2024-04-25T01:39:35.198342+0000","last_peered":"2024-04-25T01:39:35.198342+0000","last_clean":"2024-04-25T01:39:35.198342+0000","last_became_active":"2024-04-25T01:39:24.376612+0000","last_became_peered":"2024-04-25T01:39:24.376612+0000","last_unstale":"2024-04-25T01:39:35.198342+0000","last_undegraded":"2024-04-25T01:39:35.198342+0000","last_fullsized":"2024-04-25T01:39:35.198342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:56:55.534200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199969+0000","last_change":"2024-04-25T01:39:23.378190+0000","last_active":"2024-04-25T01:39:35.199969+0000","last_peered":"2024-04-25T01:39:35.199969+0000","last_clean":"2024-04-25T01:39:35.199969+0000","last_became_active":"2024-04-25T01:39:23.377677+0000","last_became_peered":"2024-04-25T01:39:23.377677+0000","last_unstale":"2024-04-25T01:39:35.199969+0000","last_undegraded":"2024-04-25T01:39:35.199969+0000","last_fullsized":"2024-04-25T01:39:35.199969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:09.516058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559452+0000","last_change":"2024-04-25T01:39:32.431542+0000","last_active":"2024-04-25T01:39:34.559452+0000","last_peered":"2024-04-25T01:39:34.559452+0000","last_clean":"2024-04-25T01:39:34.559452+0000","last_became_active":"2024-04-25T01:39:32.431253+0000","last_became_peered":"2024-04-25T01:39:32.431253+0000","last_unstale":"2024-04-25T01:39:34.559452+0000","last_undegraded":"2024-04-25T01:39:34.559452+0000","last_fullsized":"2024-04-25T01:39:34.559452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:36.723239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559765+0000","last_change":"2024-04-25T01:39:33.448529+0000","last_active":"2024-04-25T01:39:34.559765+0000","last_peered":"2024-04-25T01:39:34.559765+0000","last_clean":"2024-04-25T01:39:34.559765+0000","last_became_active":"2024-04-25T01:39:33.448266+0000","last_became_peered":"2024-04-25T01:39:33.448266+0000","last_unstale":"2024-04-25T01:39:34.559765+0000","last_undegraded":"2024-04-25T01:39:34.559765+0000","last_fullsized":"2024-04-25T01:39:34.559765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:18.788470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200112+0000","last_change":"2024-04-25T01:39:24.390844+0000","last_active":"2024-04-25T01:39:35.200112+0000","last_peered":"2024-04-25T01:39:35.200112+0000","last_clean":"2024-04-25T01:39:35.200112+0000","last_became_active":"2024-04-25T01:39:24.390543+0000","last_became_peered":"2024-04-25T01:39:24.390543+0000","last_unstale":"2024-04-25T01:39:35.200112+0000","last_undegraded":"2024-04-25T01:39:35.200112+0000","last_fullsized":"2024-04-25T01:39:35.200112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:01:03.804058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198467+0000","last_change":"2024-04-25T01:39:23.368562+0000","last_active":"2024-04-25T01:39:35.198467+0000","last_peered":"2024-04-25T01:39:35.198467+0000","last_clean":"2024-04-25T01:39:35.198467+0000","last_became_active":"2024-04-25T01:39:23.368272+0000","last_became_peered":"2024-04-25T01:39:23.368272+0000","last_unstale":"2024-04-25T01:39:35.198467+0000","last_undegraded":"2024-04-25T01:39:35.198467+0000","last_fullsized":"2024-04-25T01:39:35.198467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:15.464993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198483+0000","last_change":"2024-04-25T01:39:32.430196+0000","last_active":"2024-04-25T01:39:35.198483+0000","last_peered":"2024-04-25T01:39:35.198483+0000","last_clean":"2024-04-25T01:39:35.198483+0000","last_became_active":"2024-04-25T01:39:32.429759+0000","last_became_peered":"2024-04-25T01:39:32.429759+0000","last_unstale":"2024-04-25T01:39:35.198483+0000","last_undegraded":"2024-04-25T01:39:35.198483+0000","last_fullsized":"2024-04-25T01:39:35.198483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:58:09.299194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559415+0000","last_change":"2024-04-25T01:39:33.440935+0000","last_active":"2024-04-25T01:39:34.559415+0000","last_peered":"2024-04-25T01:39:34.559415+0000","last_clean":"2024-04-25T01:39:34.559415+0000","last_became_active":"2024-04-25T01:39:33.439344+0000","last_became_peered":"2024-04-25T01:39:33.439344+0000","last_unstale":"2024-04-25T01:39:34.559415+0000","last_undegraded":"2024-04-25T01:39:34.559415+0000","last_fullsized":"2024-04-25T01:39:34.559415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:23.928991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199059+0000","last_change":"2024-04-25T01:39:24.389203+0000","last_active":"2024-04-25T01:39:35.199059+0000","last_peered":"2024-04-25T01:39:35.199059+0000","last_clean":"2024-04-25T01:39:35.199059+0000","last_became_active":"2024-04-25T01:39:24.388306+0000","last_became_peered":"2024-04-25T01:39:24.388306+0000","last_unstale":"2024-04-25T01:39:35.199059+0000","last_undegraded":"2024-04-25T01:39:35.199059+0000","last_fullsized":"2024-04-25T01:39:35.199059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:59:33.951161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198256+0000","last_change":"2024-04-25T01:39:23.375729+0000","last_active":"2024-04-25T01:39:35.198256+0000","last_peered":"2024-04-25T01:39:35.198256+0000","last_clean":"2024-04-25T01:39:35.198256+0000","last_became_active":"2024-04-25T01:39:23.375488+0000","last_became_peered":"2024-04-25T01:39:23.375488+0000","last_unstale":"2024-04-25T01:39:35.198256+0000","last_undegraded":"2024-04-25T01:39:35.198256+0000","last_fullsized":"2024-04-25T01:39:35.198256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:00.039083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198302+0000","last_change":"2024-04-25T01:39:32.427586+0000","last_active":"2024-04-25T01:39:35.198302+0000","last_peered":"2024-04-25T01:39:35.198302+0000","last_clean":"2024-04-25T01:39:35.198302+0000","last_became_active":"2024-04-25T01:39:32.427282+0000","last_became_peered":"2024-04-25T01:39:32.427282+0000","last_unstale":"2024-04-25T01:39:35.198302+0000","last_undegraded":"2024-04-25T01:39:35.198302+0000","last_fullsized":"2024-04-25T01:39:35.198302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:35.956279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197828+0000","last_change":"2024-04-25T01:39:33.438949+0000","last_active":"2024-04-25T01:39:35.197828+0000","last_peered":"2024-04-25T01:39:35.197828+0000","last_clean":"2024-04-25T01:39:35.197828+0000","last_became_active":"2024-04-25T01:39:33.438669+0000","last_became_peered":"2024-04-25T01:39:33.438669+0000","last_unstale":"2024-04-25T01:39:35.197828+0000","last_undegraded":"2024-04-25T01:39:35.197828+0000","last_fullsized":"2024-04-25T01:39:35.197828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:07.849060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197529+0000","last_change":"2024-04-25T01:39:24.377438+0000","last_active":"2024-04-25T01:39:35.197529+0000","last_peered":"2024-04-25T01:39:35.197529+0000","last_clean":"2024-04-25T01:39:35.197529+0000","last_became_active":"2024-04-25T01:39:24.377146+0000","last_became_peered":"2024-04-25T01:39:24.377146+0000","last_unstale":"2024-04-25T01:39:35.197529+0000","last_undegraded":"2024-04-25T01:39:35.197529+0000","last_fullsized":"2024-04-25T01:39:35.197529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:54:17.698561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198084+0000","last_change":"2024-04-25T01:39:23.371019+0000","last_active":"2024-04-25T01:39:35.198084+0000","last_peered":"2024-04-25T01:39:35.198084+0000","last_clean":"2024-04-25T01:39:35.198084+0000","last_became_active":"2024-04-25T01:39:23.370727+0000","last_became_peered":"2024-04-25T01:39:23.370727+0000","last_unstale":"2024-04-25T01:39:35.198084+0000","last_undegraded":"2024-04-25T01:39:35.198084+0000","last_fullsized":"2024-04-25T01:39:35.198084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:10.714475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198753+0000","last_change":"2024-04-25T01:39:32.431610+0000","last_active":"2024-04-25T01:39:35.198753+0000","last_peered":"2024-04-25T01:39:35.198753+0000","last_clean":"2024-04-25T01:39:35.198753+0000","last_became_active":"2024-04-25T01:39:32.431335+0000","last_became_peered":"2024-04-25T01:39:32.431335+0000","last_unstale":"2024-04-25T01:39:35.198753+0000","last_undegraded":"2024-04-25T01:39:35.198753+0000","last_fullsized":"2024-04-25T01:39:35.198753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:54.882078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199183+0000","last_change":"2024-04-25T01:39:33.438896+0000","last_active":"2024-04-25T01:39:35.199183+0000","last_peered":"2024-04-25T01:39:35.199183+0000","last_clean":"2024-04-25T01:39:35.199183+0000","last_became_active":"2024-04-25T01:39:33.438622+0000","last_became_peered":"2024-04-25T01:39:33.438622+0000","last_unstale":"2024-04-25T01:39:35.199183+0000","last_undegraded":"2024-04-25T01:39:35.199183+0000","last_fullsized":"2024-04-25T01:39:35.199183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:40:47.408809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559149+0000","last_change":"2024-04-25T01:39:24.391366+0000","last_active":"2024-04-25T01:39:34.559149+0000","last_peered":"2024-04-25T01:39:34.559149+0000","last_clean":"2024-04-25T01:39:34.559149+0000","last_became_active":"2024-04-25T01:39:24.391093+0000","last_became_peered":"2024-04-25T01:39:24.391093+0000","last_unstale":"2024-04-25T01:39:34.559149+0000","last_undegraded":"2024-04-25T01:39:34.559149+0000","last_fullsized":"2024-04-25T01:39:34.559149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:10.906935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198243+0000","last_change":"2024-04-25T01:39:23.379767+0000","last_active":"2024-04-25T01:39:35.198243+0000","last_peered":"2024-04-25T01:39:35.198243+0000","last_clean":"2024-04-25T01:39:35.198243+0000","last_became_active":"2024-04-25T01:39:23.379294+0000","last_became_peered":"2024-04-25T01:39:23.379294+0000","last_unstale":"2024-04-25T01:39:35.198243+0000","last_undegraded":"2024-04-25T01:39:35.198243+0000","last_fullsized":"2024-04-25T01:39:35.198243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:36:37.823796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559671+0000","last_change":"2024-04-25T01:39:32.429452+0000","last_active":"2024-04-25T01:39:34.559671+0000","last_peered":"2024-04-25T01:39:34.559671+0000","last_clean":"2024-04-25T01:39:34.559671+0000","last_became_active":"2024-04-25T01:39:32.429189+0000","last_became_peered":"2024-04-25T01:39:32.429189+0000","last_unstale":"2024-04-25T01:39:34.559671+0000","last_undegraded":"2024-04-25T01:39:34.559671+0000","last_fullsized":"2024-04-25T01:39:34.559671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:58:02.723851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198704+0000","last_change":"2024-04-25T01:39:33.438945+0000","last_active":"2024-04-25T01:39:35.198704+0000","last_peered":"2024-04-25T01:39:35.198704+0000","last_clean":"2024-04-25T01:39:35.198704+0000","last_became_active":"2024-04-25T01:39:33.438233+0000","last_became_peered":"2024-04-25T01:39:33.438233+0000","last_unstale":"2024-04-25T01:39:35.198704+0000","last_undegraded":"2024-04-25T01:39:35.198704+0000","last_fullsized":"2024-04-25T01:39:35.198704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:50.545311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429728+0000","last_change":"2024-04-25T01:39:24.401208+0000","last_active":"2024-04-25T01:39:34.429728+0000","last_peered":"2024-04-25T01:39:34.429728+0000","last_clean":"2024-04-25T01:39:34.429728+0000","last_became_active":"2024-04-25T01:39:24.400502+0000","last_became_peered":"2024-04-25T01:39:24.400502+0000","last_unstale":"2024-04-25T01:39:34.429728+0000","last_undegraded":"2024-04-25T01:39:34.429728+0000","last_fullsized":"2024-04-25T01:39:34.429728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:55:09.076617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198391+0000","last_change":"2024-04-25T01:39:23.367826+0000","last_active":"2024-04-25T01:39:35.198391+0000","last_peered":"2024-04-25T01:39:35.198391+0000","last_clean":"2024-04-25T01:39:35.198391+0000","last_became_active":"2024-04-25T01:39:23.367520+0000","last_became_peered":"2024-04-25T01:39:23.367520+0000","last_unstale":"2024-04-25T01:39:35.198391+0000","last_undegraded":"2024-04-25T01:39:35.198391+0000","last_fullsized":"2024-04-25T01:39:35.198391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:05.997166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199929+0000","last_change":"2024-04-25T01:39:12.918495+0000","last_active":"2024-04-25T01:39:35.199929+0000","last_peered":"2024-04-25T01:39:35.199929+0000","last_clean":"2024-04-25T01:39:35.199929+0000","last_became_active":"2024-04-25T01:39:12.917330+0000","last_became_peered":"2024-04-25T01:39:12.917330+0000","last_unstale":"2024-04-25T01:39:35.199929+0000","last_undegraded":"2024-04-25T01:39:35.199929+0000","last_fullsized":"2024-04-25T01:39:35.199929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:11.731178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:11.731178+0000","last_clean_scrub_stamp":"2024-04-25T01:39:11.731178+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:26:14.153244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434088+0000","last_change":"2024-04-25T01:39:32.431797+0000","last_active":"2024-04-25T01:39:34.434088+0000","last_peered":"2024-04-25T01:39:34.434088+0000","last_clean":"2024-04-25T01:39:34.434088+0000","last_became_active":"2024-04-25T01:39:32.431523+0000","last_became_peered":"2024-04-25T01:39:32.431523+0000","last_unstale":"2024-04-25T01:39:34.434088+0000","last_undegraded":"2024-04-25T01:39:34.434088+0000","last_fullsized":"2024-04-25T01:39:34.434088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:45.752128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198056+0000","last_change":"2024-04-25T01:39:33.440488+0000","last_active":"2024-04-25T01:39:35.198056+0000","last_peered":"2024-04-25T01:39:35.198056+0000","last_clean":"2024-04-25T01:39:35.198056+0000","last_became_active":"2024-04-25T01:39:33.440161+0000","last_became_peered":"2024-04-25T01:39:33.440161+0000","last_unstale":"2024-04-25T01:39:35.198056+0000","last_undegraded":"2024-04-25T01:39:35.198056+0000","last_fullsized":"2024-04-25T01:39:35.198056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:45.542876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199802+0000","last_change":"2024-04-25T01:39:24.394350+0000","last_active":"2024-04-25T01:39:35.199802+0000","last_peered":"2024-04-25T01:39:35.199802+0000","last_clean":"2024-04-25T01:39:35.199802+0000","last_became_active":"2024-04-25T01:39:24.393235+0000","last_became_peered":"2024-04-25T01:39:24.393235+0000","last_unstale":"2024-04-25T01:39:35.199802+0000","last_undegraded":"2024-04-25T01:39:35.199802+0000","last_fullsized":"2024-04-25T01:39:35.199802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:00:48.588700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198113+0000","last_change":"2024-04-25T01:39:23.368352+0000","last_active":"2024-04-25T01:39:35.198113+0000","last_peered":"2024-04-25T01:39:35.198113+0000","last_clean":"2024-04-25T01:39:35.198113+0000","last_became_active":"2024-04-25T01:39:23.368075+0000","last_became_peered":"2024-04-25T01:39:23.368075+0000","last_unstale":"2024-04-25T01:39:35.198113+0000","last_undegraded":"2024-04-25T01:39:35.198113+0000","last_fullsized":"2024-04-25T01:39:35.198113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:11.300091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434486+0000","last_change":"2024-04-25T01:39:32.430007+0000","last_active":"2024-04-25T01:39:34.434486+0000","last_peered":"2024-04-25T01:39:34.434486+0000","last_clean":"2024-04-25T01:39:34.434486+0000","last_became_active":"2024-04-25T01:39:32.429721+0000","last_became_peered":"2024-04-25T01:39:32.429721+0000","last_unstale":"2024-04-25T01:39:34.434486+0000","last_undegraded":"2024-04-25T01:39:34.434486+0000","last_fullsized":"2024-04-25T01:39:34.434486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:47.409375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197603+0000","last_change":"2024-04-25T01:39:33.447230+0000","last_active":"2024-04-25T01:39:35.197603+0000","last_peered":"2024-04-25T01:39:35.197603+0000","last_clean":"2024-04-25T01:39:35.197603+0000","last_became_active":"2024-04-25T01:39:33.446930+0000","last_became_peered":"2024-04-25T01:39:33.446930+0000","last_unstale":"2024-04-25T01:39:35.197603+0000","last_undegraded":"2024-04-25T01:39:35.197603+0000","last_fullsized":"2024-04-25T01:39:35.197603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:51:40.920560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199534+0000","last_change":"2024-04-25T01:39:24.394286+0000","last_active":"2024-04-25T01:39:35.199534+0000","last_peered":"2024-04-25T01:39:35.199534+0000","last_clean":"2024-04-25T01:39:35.199534+0000","last_became_active":"2024-04-25T01:39:24.393558+0000","last_became_peered":"2024-04-25T01:39:24.393558+0000","last_unstale":"2024-04-25T01:39:35.199534+0000","last_undegraded":"2024-04-25T01:39:35.199534+0000","last_fullsized":"2024-04-25T01:39:35.199534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:59.100947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198699+0000","last_change":"2024-04-25T01:39:23.370690+0000","last_active":"2024-04-25T01:39:35.198699+0000","last_peered":"2024-04-25T01:39:35.198699+0000","last_clean":"2024-04-25T01:39:35.198699+0000","last_became_active":"2024-04-25T01:39:23.370391+0000","last_became_peered":"2024-04-25T01:39:23.370391+0000","last_unstale":"2024-04-25T01:39:35.198699+0000","last_undegraded":"2024-04-25T01:39:35.198699+0000","last_fullsized":"2024-04-25T01:39:35.198699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:29.647636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559440+0000","last_change":"2024-04-25T01:39:32.429412+0000","last_active":"2024-04-25T01:39:34.559440+0000","last_peered":"2024-04-25T01:39:34.559440+0000","last_clean":"2024-04-25T01:39:34.559440+0000","last_became_active":"2024-04-25T01:39:32.429143+0000","last_became_peered":"2024-04-25T01:39:32.429143+0000","last_unstale":"2024-04-25T01:39:34.559440+0000","last_undegraded":"2024-04-25T01:39:34.559440+0000","last_fullsized":"2024-04-25T01:39:34.559440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:53.637245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198532+0000","last_change":"2024-04-25T01:39:33.437128+0000","last_active":"2024-04-25T01:39:35.198532+0000","last_peered":"2024-04-25T01:39:35.198532+0000","last_clean":"2024-04-25T01:39:35.198532+0000","last_became_active":"2024-04-25T01:39:33.436861+0000","last_became_peered":"2024-04-25T01:39:33.436861+0000","last_unstale":"2024-04-25T01:39:35.198532+0000","last_undegraded":"2024-04-25T01:39:35.198532+0000","last_fullsized":"2024-04-25T01:39:35.198532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:41.746373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200378+0000","last_change":"2024-04-25T01:39:24.392170+0000","last_active":"2024-04-25T01:39:35.200378+0000","last_peered":"2024-04-25T01:39:35.200378+0000","last_clean":"2024-04-25T01:39:35.200378+0000","last_became_active":"2024-04-25T01:39:24.391811+0000","last_became_peered":"2024-04-25T01:39:24.391811+0000","last_unstale":"2024-04-25T01:39:35.200378+0000","last_undegraded":"2024-04-25T01:39:35.200378+0000","last_fullsized":"2024-04-25T01:39:35.200378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:32.859676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197996+0000","last_change":"2024-04-25T01:39:23.369872+0000","last_active":"2024-04-25T01:39:35.197996+0000","last_peered":"2024-04-25T01:39:35.197996+0000","last_clean":"2024-04-25T01:39:35.197996+0000","last_became_active":"2024-04-25T01:39:23.369314+0000","last_became_peered":"2024-04-25T01:39:23.369314+0000","last_unstale":"2024-04-25T01:39:35.197996+0000","last_undegraded":"2024-04-25T01:39:35.197996+0000","last_fullsized":"2024-04-25T01:39:35.197996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:14.571148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197245+0000","last_change":"2024-04-25T01:39:32.429664+0000","last_active":"2024-04-25T01:39:35.197245+0000","last_peered":"2024-04-25T01:39:35.197245+0000","last_clean":"2024-04-25T01:39:35.197245+0000","last_became_active":"2024-04-25T01:39:32.429358+0000","last_became_peered":"2024-04-25T01:39:32.429358+0000","last_unstale":"2024-04-25T01:39:35.197245+0000","last_undegraded":"2024-04-25T01:39:35.197245+0000","last_fullsized":"2024-04-25T01:39:35.197245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:57:10.913056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197472+0000","last_change":"2024-04-25T01:39:33.440419+0000","last_active":"2024-04-25T01:39:35.197472+0000","last_peered":"2024-04-25T01:39:35.197472+0000","last_clean":"2024-04-25T01:39:35.197472+0000","last_became_active":"2024-04-25T01:39:33.440054+0000","last_became_peered":"2024-04-25T01:39:33.440054+0000","last_unstale":"2024-04-25T01:39:35.197472+0000","last_undegraded":"2024-04-25T01:39:35.197472+0000","last_fullsized":"2024-04-25T01:39:35.197472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:42.321235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199726+0000","last_change":"2024-04-25T01:39:24.391240+0000","last_active":"2024-04-25T01:39:35.199726+0000","last_peered":"2024-04-25T01:39:35.199726+0000","last_clean":"2024-04-25T01:39:35.199726+0000","last_became_active":"2024-04-25T01:39:24.390948+0000","last_became_peered":"2024-04-25T01:39:24.390948+0000","last_unstale":"2024-04-25T01:39:35.199726+0000","last_undegraded":"2024-04-25T01:39:35.199726+0000","last_fullsized":"2024-04-25T01:39:35.199726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:41:30.579190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198161+0000","last_change":"2024-04-25T01:39:23.367322+0000","last_active":"2024-04-25T01:39:35.198161+0000","last_peered":"2024-04-25T01:39:35.198161+0000","last_clean":"2024-04-25T01:39:35.198161+0000","last_became_active":"2024-04-25T01:39:23.367054+0000","last_became_peered":"2024-04-25T01:39:23.367054+0000","last_unstale":"2024-04-25T01:39:35.198161+0000","last_undegraded":"2024-04-25T01:39:35.198161+0000","last_fullsized":"2024-04-25T01:39:35.198161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:10.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197919+0000","last_change":"2024-04-25T01:39:32.426874+0000","last_active":"2024-04-25T01:39:35.197919+0000","last_peered":"2024-04-25T01:39:35.197919+0000","last_clean":"2024-04-25T01:39:35.197919+0000","last_became_active":"2024-04-25T01:39:32.426599+0000","last_became_peered":"2024-04-25T01:39:32.426599+0000","last_unstale":"2024-04-25T01:39:35.197919+0000","last_undegraded":"2024-04-25T01:39:35.197919+0000","last_fullsized":"2024-04-25T01:39:35.197919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:27.672277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430134+0000","last_change":"2024-04-25T01:39:33.428909+0000","last_active":"2024-04-25T01:39:34.430134+0000","last_peered":"2024-04-25T01:39:34.430134+0000","last_clean":"2024-04-25T01:39:34.430134+0000","last_became_active":"2024-04-25T01:39:33.428626+0000","last_became_peered":"2024-04-25T01:39:33.428626+0000","last_unstale":"2024-04-25T01:39:34.430134+0000","last_undegraded":"2024-04-25T01:39:34.430134+0000","last_fullsized":"2024-04-25T01:39:34.430134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:21.188264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199068+0000","last_change":"2024-04-25T01:39:24.389946+0000","last_active":"2024-04-25T01:39:35.199068+0000","last_peered":"2024-04-25T01:39:35.199068+0000","last_clean":"2024-04-25T01:39:35.199068+0000","last_became_active":"2024-04-25T01:39:24.389656+0000","last_became_peered":"2024-04-25T01:39:24.389656+0000","last_unstale":"2024-04-25T01:39:35.199068+0000","last_undegraded":"2024-04-25T01:39:35.199068+0000","last_fullsized":"2024-04-25T01:39:35.199068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:55.943639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197475+0000","last_change":"2024-04-25T01:39:23.373599+0000","last_active":"2024-04-25T01:39:35.197475+0000","last_peered":"2024-04-25T01:39:35.197475+0000","last_clean":"2024-04-25T01:39:35.197475+0000","last_became_active":"2024-04-25T01:39:23.373281+0000","last_became_peered":"2024-04-25T01:39:23.373281+0000","last_unstale":"2024-04-25T01:39:35.197475+0000","last_undegraded":"2024-04-25T01:39:35.197475+0000","last_fullsized":"2024-04-25T01:39:35.197475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:40.850925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559604+0000","last_change":"2024-04-25T01:39:32.427502+0000","last_active":"2024-04-25T01:39:34.559604+0000","last_peered":"2024-04-25T01:39:34.559604+0000","last_clean":"2024-04-25T01:39:34.559604+0000","last_became_active":"2024-04-25T01:39:32.426499+0000","last_became_peered":"2024-04-25T01:39:32.426499+0000","last_unstale":"2024-04-25T01:39:34.559604+0000","last_undegraded":"2024-04-25T01:39:34.559604+0000","last_fullsized":"2024-04-25T01:39:34.559604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:26.977416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198695+0000","last_change":"2024-04-25T01:39:33.436901+0000","last_active":"2024-04-25T01:39:35.198695+0000","last_peered":"2024-04-25T01:39:35.198695+0000","last_clean":"2024-04-25T01:39:35.198695+0000","last_became_active":"2024-04-25T01:39:33.436001+0000","last_became_peered":"2024-04-25T01:39:33.436001+0000","last_unstale":"2024-04-25T01:39:35.198695+0000","last_undegraded":"2024-04-25T01:39:35.198695+0000","last_fullsized":"2024-04-25T01:39:35.198695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:34:41.678663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.433897+0000","last_change":"2024-04-25T01:39:24.394248+0000","last_active":"2024-04-25T01:39:34.433897+0000","last_peered":"2024-04-25T01:39:34.433897+0000","last_clean":"2024-04-25T01:39:34.433897+0000","last_became_active":"2024-04-25T01:39:24.393958+0000","last_became_peered":"2024-04-25T01:39:24.393958+0000","last_unstale":"2024-04-25T01:39:34.433897+0000","last_undegraded":"2024-04-25T01:39:34.433897+0000","last_fullsized":"2024-04-25T01:39:34.433897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:35.087577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434426+0000","last_change":"2024-04-25T01:39:23.372939+0000","last_active":"2024-04-25T01:39:34.434426+0000","last_peered":"2024-04-25T01:39:34.434426+0000","last_clean":"2024-04-25T01:39:34.434426+0000","last_became_active":"2024-04-25T01:39:23.372648+0000","last_became_peered":"2024-04-25T01:39:23.372648+0000","last_unstale":"2024-04-25T01:39:34.434426+0000","last_undegraded":"2024-04-25T01:39:34.434426+0000","last_fullsized":"2024-04-25T01:39:34.434426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:02:13.283096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430096+0000","last_change":"2024-04-25T01:39:32.432218+0000","last_active":"2024-04-25T01:39:34.430096+0000","last_peered":"2024-04-25T01:39:34.430096+0000","last_clean":"2024-04-25T01:39:34.430096+0000","last_became_active":"2024-04-25T01:39:32.431938+0000","last_became_peered":"2024-04-25T01:39:32.431938+0000","last_unstale":"2024-04-25T01:39:34.430096+0000","last_undegraded":"2024-04-25T01:39:34.430096+0000","last_fullsized":"2024-04-25T01:39:34.430096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:56:15.053817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199747+0000","last_change":"2024-04-25T01:39:33.441342+0000","last_active":"2024-04-25T01:39:35.199747+0000","last_peered":"2024-04-25T01:39:35.199747+0000","last_clean":"2024-04-25T01:39:35.199747+0000","last_became_active":"2024-04-25T01:39:33.441074+0000","last_became_peered":"2024-04-25T01:39:33.441074+0000","last_unstale":"2024-04-25T01:39:35.199747+0000","last_undegraded":"2024-04-25T01:39:35.199747+0000","last_fullsized":"2024-04-25T01:39:35.199747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:22:43.000112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199029+0000","last_change":"2024-04-25T01:39:24.390114+0000","last_active":"2024-04-25T01:39:35.199029+0000","last_peered":"2024-04-25T01:39:35.199029+0000","last_clean":"2024-04-25T01:39:35.199029+0000","last_became_active":"2024-04-25T01:39:24.389841+0000","last_became_peered":"2024-04-25T01:39:24.389841+0000","last_unstale":"2024-04-25T01:39:35.199029+0000","last_undegraded":"2024-04-25T01:39:35.199029+0000","last_fullsized":"2024-04-25T01:39:35.199029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:34.950624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198167+0000","last_change":"2024-04-25T01:39:23.369440+0000","last_active":"2024-04-25T01:39:35.198167+0000","last_peered":"2024-04-25T01:39:35.198167+0000","last_clean":"2024-04-25T01:39:35.198167+0000","last_became_active":"2024-04-25T01:39:23.369151+0000","last_became_peered":"2024-04-25T01:39:23.369151+0000","last_unstale":"2024-04-25T01:39:35.198167+0000","last_undegraded":"2024-04-25T01:39:35.198167+0000","last_fullsized":"2024-04-25T01:39:35.198167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:31:46.921287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"23'6","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429666+0000","last_change":"2024-04-25T01:39:32.430701+0000","last_active":"2024-04-25T01:39:34.429666+0000","last_peered":"2024-04-25T01:39:34.429666+0000","last_clean":"2024-04-25T01:39:34.429666+0000","last_became_active":"2024-04-25T01:39:32.430187+0000","last_became_peered":"2024-04-25T01:39:32.430187+0000","last_unstale":"2024-04-25T01:39:34.429666+0000","last_undegraded":"2024-04-25T01:39:34.429666+0000","last_fullsized":"2024-04-25T01:39:34.429666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:57.148375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429767+0000","last_change":"2024-04-25T01:39:33.427429+0000","last_active":"2024-04-25T01:39:34.429767+0000","last_peered":"2024-04-25T01:39:34.429767+0000","last_clean":"2024-04-25T01:39:34.429767+0000","last_became_active":"2024-04-25T01:39:33.427164+0000","last_became_peered":"2024-04-25T01:39:33.427164+0000","last_unstale":"2024-04-25T01:39:34.429767+0000","last_undegraded":"2024-04-25T01:39:34.429767+0000","last_fullsized":"2024-04-25T01:39:34.429767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:33:59.664252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559246+0000","last_change":"2024-04-25T01:39:24.388852+0000","last_active":"2024-04-25T01:39:34.559246+0000","last_peered":"2024-04-25T01:39:34.559246+0000","last_clean":"2024-04-25T01:39:34.559246+0000","last_became_active":"2024-04-25T01:39:24.388594+0000","last_became_peered":"2024-04-25T01:39:24.388594+0000","last_unstale":"2024-04-25T01:39:34.559246+0000","last_undegraded":"2024-04-25T01:39:34.559246+0000","last_fullsized":"2024-04-25T01:39:34.559246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:46:49.718182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559847+0000","last_change":"2024-04-25T01:39:23.372903+0000","last_active":"2024-04-25T01:39:34.559847+0000","last_peered":"2024-04-25T01:39:34.559847+0000","last_clean":"2024-04-25T01:39:34.559847+0000","last_became_active":"2024-04-25T01:39:23.372617+0000","last_became_peered":"2024-04-25T01:39:23.372617+0000","last_unstale":"2024-04-25T01:39:34.559847+0000","last_undegraded":"2024-04-25T01:39:34.559847+0000","last_fullsized":"2024-04-25T01:39:34.559847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:54:58.506432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199994+0000","last_change":"2024-04-25T01:39:32.430218+0000","last_active":"2024-04-25T01:39:35.199994+0000","last_peered":"2024-04-25T01:39:35.199994+0000","last_clean":"2024-04-25T01:39:35.199994+0000","last_became_active":"2024-04-25T01:39:32.429900+0000","last_became_peered":"2024-04-25T01:39:32.429900+0000","last_unstale":"2024-04-25T01:39:35.199994+0000","last_undegraded":"2024-04-25T01:39:35.199994+0000","last_fullsized":"2024-04-25T01:39:35.199994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:52.253045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429707+0000","last_change":"2024-04-25T01:39:33.440325+0000","last_active":"2024-04-25T01:39:34.429707+0000","last_peered":"2024-04-25T01:39:34.429707+0000","last_clean":"2024-04-25T01:39:34.429707+0000","last_became_active":"2024-04-25T01:39:33.439961+0000","last_became_peered":"2024-04-25T01:39:33.439961+0000","last_unstale":"2024-04-25T01:39:34.429707+0000","last_undegraded":"2024-04-25T01:39:34.429707+0000","last_fullsized":"2024-04-25T01:39:34.429707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:01.846576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199750+0000","last_change":"2024-04-25T01:39:24.380617+0000","last_active":"2024-04-25T01:39:35.199750+0000","last_peered":"2024-04-25T01:39:35.199750+0000","last_clean":"2024-04-25T01:39:35.199750+0000","last_became_active":"2024-04-25T01:39:24.380330+0000","last_became_peered":"2024-04-25T01:39:24.380330+0000","last_unstale":"2024-04-25T01:39:35.199750+0000","last_undegraded":"2024-04-25T01:39:35.199750+0000","last_fullsized":"2024-04-25T01:39:35.199750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:24.010569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:55.705604+0000","last_change":"2024-04-25T01:39:23.373295+0000","last_active":"2024-04-25T01:39:55.705604+0000","last_peered":"2024-04-25T01:39:55.705604+0000","last_clean":"2024-04-25T01:39:55.705604+0000","last_became_active":"2024-04-25T01:39:23.372984+0000","last_became_peered":"2024-04-25T01:39:23.372984+0000","last_unstale":"2024-04-25T01:39:55.705604+0000","last_undegraded":"2024-04-25T01:39:55.705604+0000","last_fullsized":"2024-04-25T01:39:55.705604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:10.854190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1868,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198248+0000","last_change":"2024-04-25T01:39:32.433589+0000","last_active":"2024-04-25T01:39:35.198248+0000","last_peered":"2024-04-25T01:39:35.198248+0000","last_clean":"2024-04-25T01:39:35.198248+0000","last_became_active":"2024-04-25T01:39:32.433408+0000","last_became_peered":"2024-04-25T01:39:32.433408+0000","last_unstale":"2024-04-25T01:39:35.198248+0000","last_undegraded":"2024-04-25T01:39:35.198248+0000","last_fullsized":"2024-04-25T01:39:35.198248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:25.789951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198708+0000","last_change":"2024-04-25T01:39:33.433449+0000","last_active":"2024-04-25T01:39:35.198708+0000","last_peered":"2024-04-25T01:39:35.198708+0000","last_clean":"2024-04-25T01:39:35.198708+0000","last_became_active":"2024-04-25T01:39:33.432690+0000","last_became_peered":"2024-04-25T01:39:33.432690+0000","last_unstale":"2024-04-25T01:39:35.198708+0000","last_undegraded":"2024-04-25T01:39:35.198708+0000","last_fullsized":"2024-04-25T01:39:35.198708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:30.046453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198838+0000","last_change":"2024-04-25T01:39:24.391245+0000","last_active":"2024-04-25T01:39:35.198838+0000","last_peered":"2024-04-25T01:39:35.198838+0000","last_clean":"2024-04-25T01:39:35.198838+0000","last_became_active":"2024-04-25T01:39:24.390941+0000","last_became_peered":"2024-04-25T01:39:24.390941+0000","last_unstale":"2024-04-25T01:39:35.198838+0000","last_undegraded":"2024-04-25T01:39:35.198838+0000","last_fullsized":"2024-04-25T01:39:35.198838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:55.182405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198689+0000","last_change":"2024-04-25T01:39:23.369043+0000","last_active":"2024-04-25T01:39:35.198689+0000","last_peered":"2024-04-25T01:39:35.198689+0000","last_clean":"2024-04-25T01:39:35.198689+0000","last_became_active":"2024-04-25T01:39:23.368778+0000","last_became_peered":"2024-04-25T01:39:23.368778+0000","last_unstale":"2024-04-25T01:39:35.198689+0000","last_undegraded":"2024-04-25T01:39:35.198689+0000","last_fullsized":"2024-04-25T01:39:35.198689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:59.501724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198230+0000","last_change":"2024-04-25T01:39:32.431530+0000","last_active":"2024-04-25T01:39:35.198230+0000","last_peered":"2024-04-25T01:39:35.198230+0000","last_clean":"2024-04-25T01:39:35.198230+0000","last_became_active":"2024-04-25T01:39:32.431247+0000","last_became_peered":"2024-04-25T01:39:32.431247+0000","last_unstale":"2024-04-25T01:39:35.198230+0000","last_undegraded":"2024-04-25T01:39:35.198230+0000","last_fullsized":"2024-04-25T01:39:35.198230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:46:02.014508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434136+0000","last_change":"2024-04-25T01:39:33.446545+0000","last_active":"2024-04-25T01:39:34.434136+0000","last_peered":"2024-04-25T01:39:34.434136+0000","last_clean":"2024-04-25T01:39:34.434136+0000","last_became_active":"2024-04-25T01:39:33.446263+0000","last_became_peered":"2024-04-25T01:39:33.446263+0000","last_unstale":"2024-04-25T01:39:34.434136+0000","last_undegraded":"2024-04-25T01:39:34.434136+0000","last_fullsized":"2024-04-25T01:39:34.434136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:27.026460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559482+0000","last_change":"2024-04-25T01:39:24.403875+0000","last_active":"2024-04-25T01:39:34.559482+0000","last_peered":"2024-04-25T01:39:34.559482+0000","last_clean":"2024-04-25T01:39:34.559482+0000","last_became_active":"2024-04-25T01:39:24.403591+0000","last_became_peered":"2024-04-25T01:39:24.403591+0000","last_unstale":"2024-04-25T01:39:34.559482+0000","last_undegraded":"2024-04-25T01:39:34.559482+0000","last_fullsized":"2024-04-25T01:39:34.559482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:45.276173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198758+0000","last_change":"2024-04-25T01:39:23.378968+0000","last_active":"2024-04-25T01:39:35.198758+0000","last_peered":"2024-04-25T01:39:35.198758+0000","last_clean":"2024-04-25T01:39:35.198758+0000","last_became_active":"2024-04-25T01:39:23.378635+0000","last_became_peered":"2024-04-25T01:39:23.378635+0000","last_unstale":"2024-04-25T01:39:35.198758+0000","last_undegraded":"2024-04-25T01:39:35.198758+0000","last_fullsized":"2024-04-25T01:39:35.198758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:39.780544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429477+0000","last_change":"2024-04-25T01:39:32.427357+0000","last_active":"2024-04-25T01:39:34.429477+0000","last_peered":"2024-04-25T01:39:34.429477+0000","last_clean":"2024-04-25T01:39:34.429477+0000","last_became_active":"2024-04-25T01:39:32.427105+0000","last_became_peered":"2024-04-25T01:39:32.427105+0000","last_unstale":"2024-04-25T01:39:34.429477+0000","last_undegraded":"2024-04-25T01:39:34.429477+0000","last_fullsized":"2024-04-25T01:39:34.429477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:04.848726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197844+0000","last_change":"2024-04-25T01:39:33.444814+0000","last_active":"2024-04-25T01:39:35.197844+0000","last_peered":"2024-04-25T01:39:35.197844+0000","last_clean":"2024-04-25T01:39:35.197844+0000","last_became_active":"2024-04-25T01:39:33.444489+0000","last_became_peered":"2024-04-25T01:39:33.444489+0000","last_unstale":"2024-04-25T01:39:35.197844+0000","last_undegraded":"2024-04-25T01:39:35.197844+0000","last_fullsized":"2024-04-25T01:39:35.197844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:06.718940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198707+0000","last_change":"2024-04-25T01:39:24.392642+0000","last_active":"2024-04-25T01:39:35.198707+0000","last_peered":"2024-04-25T01:39:35.198707+0000","last_clean":"2024-04-25T01:39:35.198707+0000","last_became_active":"2024-04-25T01:39:24.391605+0000","last_became_peered":"2024-04-25T01:39:24.391605+0000","last_unstale":"2024-04-25T01:39:35.198707+0000","last_undegraded":"2024-04-25T01:39:35.198707+0000","last_fullsized":"2024-04-25T01:39:35.198707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:01:23.217074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434798+0000","last_change":"2024-04-25T01:39:23.377236+0000","last_active":"2024-04-25T01:39:34.434798+0000","last_peered":"2024-04-25T01:39:34.434798+0000","last_clean":"2024-04-25T01:39:34.434798+0000","last_became_active":"2024-04-25T01:39:23.376727+0000","last_became_peered":"2024-04-25T01:39:23.376727+0000","last_unstale":"2024-04-25T01:39:34.434798+0000","last_undegraded":"2024-04-25T01:39:34.434798+0000","last_fullsized":"2024-04-25T01:39:34.434798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:08.103707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429200+0000","last_change":"2024-04-25T01:39:32.424457+0000","last_active":"2024-04-25T01:39:34.429200+0000","last_peered":"2024-04-25T01:39:34.429200+0000","last_clean":"2024-04-25T01:39:34.429200+0000","last_became_active":"2024-04-25T01:39:32.424203+0000","last_became_peered":"2024-04-25T01:39:32.424203+0000","last_unstale":"2024-04-25T01:39:34.429200+0000","last_undegraded":"2024-04-25T01:39:34.429200+0000","last_fullsized":"2024-04-25T01:39:34.429200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:12:20.824070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434672+0000","last_change":"2024-04-25T01:39:33.445948+0000","last_active":"2024-04-25T01:39:34.434672+0000","last_peered":"2024-04-25T01:39:34.434672+0000","last_clean":"2024-04-25T01:39:34.434672+0000","last_became_active":"2024-04-25T01:39:33.445654+0000","last_became_peered":"2024-04-25T01:39:33.445654+0000","last_unstale":"2024-04-25T01:39:34.434672+0000","last_undegraded":"2024-04-25T01:39:34.434672+0000","last_fullsized":"2024-04-25T01:39:34.434672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:51.323909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559508+0000","last_change":"2024-04-25T01:39:32.430484+0000","last_active":"2024-04-25T01:39:34.559508+0000","last_peered":"2024-04-25T01:39:34.559508+0000","last_clean":"2024-04-25T01:39:34.559508+0000","last_became_active":"2024-04-25T01:39:32.430220+0000","last_became_peered":"2024-04-25T01:39:32.430220+0000","last_unstale":"2024-04-25T01:39:34.559508+0000","last_undegraded":"2024-04-25T01:39:34.559508+0000","last_fullsized":"2024-04-25T01:39:34.559508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:36:53.152442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197722+0000","last_change":"2024-04-25T01:39:24.375457+0000","last_active":"2024-04-25T01:39:35.197722+0000","last_peered":"2024-04-25T01:39:35.197722+0000","last_clean":"2024-04-25T01:39:35.197722+0000","last_became_active":"2024-04-25T01:39:24.375178+0000","last_became_peered":"2024-04-25T01:39:24.375178+0000","last_unstale":"2024-04-25T01:39:35.197722+0000","last_undegraded":"2024-04-25T01:39:35.197722+0000","last_fullsized":"2024-04-25T01:39:35.197722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:58:15.640882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197478+0000","last_change":"2024-04-25T01:39:23.369998+0000","last_active":"2024-04-25T01:39:35.197478+0000","last_peered":"2024-04-25T01:39:35.197478+0000","last_clean":"2024-04-25T01:39:35.197478+0000","last_became_active":"2024-04-25T01:39:23.369710+0000","last_became_peered":"2024-04-25T01:39:23.369710+0000","last_unstale":"2024-04-25T01:39:35.197478+0000","last_undegraded":"2024-04-25T01:39:35.197478+0000","last_fullsized":"2024-04-25T01:39:35.197478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:32:34.329452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559536+0000","last_change":"2024-04-25T01:39:33.447666+0000","last_active":"2024-04-25T01:39:34.559536+0000","last_peered":"2024-04-25T01:39:34.559536+0000","last_clean":"2024-04-25T01:39:34.559536+0000","last_became_active":"2024-04-25T01:39:33.447436+0000","last_became_peered":"2024-04-25T01:39:33.447436+0000","last_unstale":"2024-04-25T01:39:34.559536+0000","last_undegraded":"2024-04-25T01:39:34.559536+0000","last_fullsized":"2024-04-25T01:39:34.559536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:25:20.440422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434733+0000","last_change":"2024-04-25T01:39:32.436300+0000","last_active":"2024-04-25T01:39:34.434733+0000","last_peered":"2024-04-25T01:39:34.434733+0000","last_clean":"2024-04-25T01:39:34.434733+0000","last_became_active":"2024-04-25T01:39:32.436000+0000","last_became_peered":"2024-04-25T01:39:32.436000+0000","last_unstale":"2024-04-25T01:39:34.434733+0000","last_undegraded":"2024-04-25T01:39:34.434733+0000","last_fullsized":"2024-04-25T01:39:34.434733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:38.044992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429461+0000","last_change":"2024-04-25T01:39:24.387708+0000","last_active":"2024-04-25T01:39:34.429461+0000","last_peered":"2024-04-25T01:39:34.429461+0000","last_clean":"2024-04-25T01:39:34.429461+0000","last_became_active":"2024-04-25T01:39:24.387433+0000","last_became_peered":"2024-04-25T01:39:24.387433+0000","last_unstale":"2024-04-25T01:39:34.429461+0000","last_undegraded":"2024-04-25T01:39:34.429461+0000","last_fullsized":"2024-04-25T01:39:34.429461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:34.312066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429418+0000","last_change":"2024-04-25T01:39:23.377487+0000","last_active":"2024-04-25T01:39:34.429418+0000","last_peered":"2024-04-25T01:39:34.429418+0000","last_clean":"2024-04-25T01:39:34.429418+0000","last_became_active":"2024-04-25T01:39:23.377181+0000","last_became_peered":"2024-04-25T01:39:23.377181+0000","last_unstale":"2024-04-25T01:39:34.429418+0000","last_undegraded":"2024-04-25T01:39:34.429418+0000","last_fullsized":"2024-04-25T01:39:34.429418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:17.434141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198602+0000","last_change":"2024-04-25T01:39:33.444973+0000","last_active":"2024-04-25T01:39:35.198602+0000","last_peered":"2024-04-25T01:39:35.198602+0000","last_clean":"2024-04-25T01:39:35.198602+0000","last_became_active":"2024-04-25T01:39:33.444673+0000","last_became_peered":"2024-04-25T01:39:33.444673+0000","last_unstale":"2024-04-25T01:39:35.198602+0000","last_undegraded":"2024-04-25T01:39:35.198602+0000","last_fullsized":"2024-04-25T01:39:35.198602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:08.372714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434713+0000","last_change":"2024-04-25T01:39:23.372975+0000","last_active":"2024-04-25T01:39:34.434713+0000","last_peered":"2024-04-25T01:39:34.434713+0000","last_clean":"2024-04-25T01:39:34.434713+0000","last_became_active":"2024-04-25T01:39:23.372688+0000","last_became_peered":"2024-04-25T01:39:23.372688+0000","last_unstale":"2024-04-25T01:39:34.434713+0000","last_undegraded":"2024-04-25T01:39:34.434713+0000","last_fullsized":"2024-04-25T01:39:34.434713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:42:57.195844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559766+0000","last_change":"2024-04-25T01:39:24.388095+0000","last_active":"2024-04-25T01:39:34.559766+0000","last_peered":"2024-04-25T01:39:34.559766+0000","last_clean":"2024-04-25T01:39:34.559766+0000","last_became_active":"2024-04-25T01:39:24.387797+0000","last_became_peered":"2024-04-25T01:39:24.387797+0000","last_unstale":"2024-04-25T01:39:34.559766+0000","last_undegraded":"2024-04-25T01:39:34.559766+0000","last_fullsized":"2024-04-25T01:39:34.559766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:43:16.385957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197731+0000","last_change":"2024-04-25T01:39:32.427081+0000","last_active":"2024-04-25T01:39:35.197731+0000","last_peered":"2024-04-25T01:39:35.197731+0000","last_clean":"2024-04-25T01:39:35.197731+0000","last_became_active":"2024-04-25T01:39:32.426626+0000","last_became_peered":"2024-04-25T01:39:32.426626+0000","last_unstale":"2024-04-25T01:39:35.197731+0000","last_undegraded":"2024-04-25T01:39:35.197731+0000","last_fullsized":"2024-04-25T01:39:35.197731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:45.358400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198937+0000","last_change":"2024-04-25T01:39:33.446301+0000","last_active":"2024-04-25T01:39:35.198937+0000","last_peered":"2024-04-25T01:39:35.198937+0000","last_clean":"2024-04-25T01:39:35.198937+0000","last_became_active":"2024-04-25T01:39:33.445158+0000","last_became_peered":"2024-04-25T01:39:33.445158+0000","last_unstale":"2024-04-25T01:39:35.198937+0000","last_undegraded":"2024-04-25T01:39:35.198937+0000","last_fullsized":"2024-04-25T01:39:35.198937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:53:26.017968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429884+0000","last_change":"2024-04-25T01:39:23.371716+0000","last_active":"2024-04-25T01:39:34.429884+0000","last_peered":"2024-04-25T01:39:34.429884+0000","last_clean":"2024-04-25T01:39:34.429884+0000","last_became_active":"2024-04-25T01:39:23.371475+0000","last_became_peered":"2024-04-25T01:39:23.371475+0000","last_unstale":"2024-04-25T01:39:34.429884+0000","last_undegraded":"2024-04-25T01:39:34.429884+0000","last_fullsized":"2024-04-25T01:39:34.429884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:10.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198751+0000","last_change":"2024-04-25T01:39:24.388083+0000","last_active":"2024-04-25T01:39:35.198751+0000","last_peered":"2024-04-25T01:39:35.198751+0000","last_clean":"2024-04-25T01:39:35.198751+0000","last_became_active":"2024-04-25T01:39:24.387789+0000","last_became_peered":"2024-04-25T01:39:24.387789+0000","last_unstale":"2024-04-25T01:39:35.198751+0000","last_undegraded":"2024-04-25T01:39:35.198751+0000","last_fullsized":"2024-04-25T01:39:35.198751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:31.760631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429824+0000","last_change":"2024-04-25T01:39:32.429613+0000","last_active":"2024-04-25T01:39:34.429824+0000","last_peered":"2024-04-25T01:39:34.429824+0000","last_clean":"2024-04-25T01:39:34.429824+0000","last_became_active":"2024-04-25T01:39:32.429361+0000","last_became_peered":"2024-04-25T01:39:32.429361+0000","last_unstale":"2024-04-25T01:39:34.429824+0000","last_undegraded":"2024-04-25T01:39:34.429824+0000","last_fullsized":"2024-04-25T01:39:34.429824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:04:59.928602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430227+0000","last_change":"2024-04-25T01:39:33.426384+0000","last_active":"2024-04-25T01:39:34.430227+0000","last_peered":"2024-04-25T01:39:34.430227+0000","last_clean":"2024-04-25T01:39:34.430227+0000","last_became_active":"2024-04-25T01:39:33.426101+0000","last_became_peered":"2024-04-25T01:39:33.426101+0000","last_unstale":"2024-04-25T01:39:34.430227+0000","last_undegraded":"2024-04-25T01:39:34.430227+0000","last_fullsized":"2024-04-25T01:39:34.430227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:36.820458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.433902+0000","last_change":"2024-04-25T01:39:24.395618+0000","last_active":"2024-04-25T01:39:34.433902+0000","last_peered":"2024-04-25T01:39:34.433902+0000","last_clean":"2024-04-25T01:39:34.433902+0000","last_became_active":"2024-04-25T01:39:24.394816+0000","last_became_peered":"2024-04-25T01:39:24.394816+0000","last_unstale":"2024-04-25T01:39:34.433902+0000","last_undegraded":"2024-04-25T01:39:34.433902+0000","last_fullsized":"2024-04-25T01:39:34.433902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:01.025135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198676+0000","last_change":"2024-04-25T01:39:33.432537+0000","last_active":"2024-04-25T01:39:35.198676+0000","last_peered":"2024-04-25T01:39:35.198676+0000","last_clean":"2024-04-25T01:39:35.198676+0000","last_became_active":"2024-04-25T01:39:33.432266+0000","last_became_peered":"2024-04-25T01:39:33.432266+0000","last_unstale":"2024-04-25T01:39:35.198676+0000","last_undegraded":"2024-04-25T01:39:35.198676+0000","last_fullsized":"2024-04-25T01:39:35.198676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:31.703689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197383+0000","last_change":"2024-04-25T01:39:24.390981+0000","last_active":"2024-04-25T01:39:35.197383+0000","last_peered":"2024-04-25T01:39:35.197383+0000","last_clean":"2024-04-25T01:39:35.197383+0000","last_became_active":"2024-04-25T01:39:24.390716+0000","last_became_peered":"2024-04-25T01:39:24.390716+0000","last_unstale":"2024-04-25T01:39:35.197383+0000","last_undegraded":"2024-04-25T01:39:35.197383+0000","last_fullsized":"2024-04-25T01:39:35.197383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:08.458504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199057+0000","last_change":"2024-04-25T01:39:33.439086+0000","last_active":"2024-04-25T01:39:35.199057+0000","last_peered":"2024-04-25T01:39:35.199057+0000","last_clean":"2024-04-25T01:39:35.199057+0000","last_became_active":"2024-04-25T01:39:33.438811+0000","last_became_peered":"2024-04-25T01:39:33.438811+0000","last_unstale":"2024-04-25T01:39:35.199057+0000","last_undegraded":"2024-04-25T01:39:35.199057+0000","last_fullsized":"2024-04-25T01:39:35.199057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:49:23.604749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198076+0000","last_change":"2024-04-25T01:39:24.399738+0000","last_active":"2024-04-25T01:39:35.198076+0000","last_peered":"2024-04-25T01:39:35.198076+0000","last_clean":"2024-04-25T01:39:35.198076+0000","last_became_active":"2024-04-25T01:39:24.399499+0000","last_became_peered":"2024-04-25T01:39:24.399499+0000","last_unstale":"2024-04-25T01:39:35.198076+0000","last_undegraded":"2024-04-25T01:39:35.198076+0000","last_fullsized":"2024-04-25T01:39:35.198076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:58.646669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198407+0000","last_change":"2024-04-25T01:39:33.444074+0000","last_active":"2024-04-25T01:39:35.198407+0000","last_peered":"2024-04-25T01:39:35.198407+0000","last_clean":"2024-04-25T01:39:35.198407+0000","last_became_active":"2024-04-25T01:39:33.443796+0000","last_became_peered":"2024-04-25T01:39:33.443796+0000","last_unstale":"2024-04-25T01:39:35.198407+0000","last_undegraded":"2024-04-25T01:39:35.198407+0000","last_fullsized":"2024-04-25T01:39:35.198407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:56.379211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559685+0000","last_change":"2024-04-25T01:39:24.390631+0000","last_active":"2024-04-25T01:39:34.559685+0000","last_peered":"2024-04-25T01:39:34.559685+0000","last_clean":"2024-04-25T01:39:34.559685+0000","last_became_active":"2024-04-25T01:39:24.390363+0000","last_became_peered":"2024-04-25T01:39:24.390363+0000","last_unstale":"2024-04-25T01:39:34.559685+0000","last_undegraded":"2024-04-25T01:39:34.559685+0000","last_fullsized":"2024-04-25T01:39:34.559685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:48.830416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199245+0000","last_change":"2024-04-25T01:39:33.437787+0000","last_active":"2024-04-25T01:39:35.199245+0000","last_peered":"2024-04-25T01:39:35.199245+0000","last_clean":"2024-04-25T01:39:35.199245+0000","last_became_active":"2024-04-25T01:39:33.436131+0000","last_became_peered":"2024-04-25T01:39:33.436131+0000","last_unstale":"2024-04-25T01:39:35.199245+0000","last_undegraded":"2024-04-25T01:39:35.199245+0000","last_fullsized":"2024-04-25T01:39:35.199245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:29:13.213643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429883+0000","last_change":"2024-04-25T01:39:24.389645+0000","last_active":"2024-04-25T01:39:34.429883+0000","last_peered":"2024-04-25T01:39:34.429883+0000","last_clean":"2024-04-25T01:39:34.429883+0000","last_became_active":"2024-04-25T01:39:24.389375+0000","last_became_peered":"2024-04-25T01:39:24.389375+0000","last_unstale":"2024-04-25T01:39:34.429883+0000","last_undegraded":"2024-04-25T01:39:34.429883+0000","last_fullsized":"2024-04-25T01:39:34.429883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:13:12.753893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197777+0000","last_change":"2024-04-25T01:39:33.448177+0000","last_active":"2024-04-25T01:39:35.197777+0000","last_peered":"2024-04-25T01:39:35.197777+0000","last_clean":"2024-04-25T01:39:35.197777+0000","last_became_active":"2024-04-25T01:39:33.447588+0000","last_became_peered":"2024-04-25T01:39:33.447588+0000","last_unstale":"2024-04-25T01:39:35.197777+0000","last_undegraded":"2024-04-25T01:39:35.197777+0000","last_fullsized":"2024-04-25T01:39:35.197777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:11:20.466189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198572+0000","last_change":"2024-04-25T01:39:24.374082+0000","last_active":"2024-04-25T01:39:35.198572+0000","last_peered":"2024-04-25T01:39:35.198572+0000","last_clean":"2024-04-25T01:39:35.198572+0000","last_became_active":"2024-04-25T01:39:24.373731+0000","last_became_peered":"2024-04-25T01:39:24.373731+0000","last_unstale":"2024-04-25T01:39:35.198572+0000","last_undegraded":"2024-04-25T01:39:35.198572+0000","last_fullsized":"2024-04-25T01:39:35.198572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:45.817483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197536+0000","last_change":"2024-04-25T01:39:33.446992+0000","last_active":"2024-04-25T01:39:35.197536+0000","last_peered":"2024-04-25T01:39:35.197536+0000","last_clean":"2024-04-25T01:39:35.197536+0000","last_became_active":"2024-04-25T01:39:33.446652+0000","last_became_peered":"2024-04-25T01:39:33.446652+0000","last_unstale":"2024-04-25T01:39:35.197536+0000","last_undegraded":"2024-04-25T01:39:35.197536+0000","last_fullsized":"2024-04-25T01:39:35.197536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:43:52.959274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434529+0000","last_change":"2024-04-25T01:39:24.398614+0000","last_active":"2024-04-25T01:39:34.434529+0000","last_peered":"2024-04-25T01:39:34.434529+0000","last_clean":"2024-04-25T01:39:34.434529+0000","last_became_active":"2024-04-25T01:39:24.398299+0000","last_became_peered":"2024-04-25T01:39:24.398299+0000","last_unstale":"2024-04-25T01:39:34.434529+0000","last_undegraded":"2024-04-25T01:39:34.434529+0000","last_fullsized":"2024-04-25T01:39:34.434529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:54:51.191225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434363+0000","last_change":"2024-04-25T01:39:33.441401+0000","last_active":"2024-04-25T01:39:34.434363+0000","last_peered":"2024-04-25T01:39:34.434363+0000","last_clean":"2024-04-25T01:39:34.434363+0000","last_became_active":"2024-04-25T01:39:33.441104+0000","last_became_peered":"2024-04-25T01:39:33.441104+0000","last_unstale":"2024-04-25T01:39:34.434363+0000","last_undegraded":"2024-04-25T01:39:34.434363+0000","last_fullsized":"2024-04-25T01:39:34.434363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:51.503340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430186+0000","last_change":"2024-04-25T01:39:24.390352+0000","last_active":"2024-04-25T01:39:34.430186+0000","last_peered":"2024-04-25T01:39:34.430186+0000","last_clean":"2024-04-25T01:39:34.430186+0000","last_became_active":"2024-04-25T01:39:24.389809+0000","last_became_peered":"2024-04-25T01:39:24.389809+0000","last_unstale":"2024-04-25T01:39:34.430186+0000","last_undegraded":"2024-04-25T01:39:34.430186+0000","last_fullsized":"2024-04-25T01:39:34.430186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:22:44.221898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430089+0000","last_change":"2024-04-25T01:39:33.426710+0000","last_active":"2024-04-25T01:39:34.430089+0000","last_peered":"2024-04-25T01:39:34.430089+0000","last_clean":"2024-04-25T01:39:34.430089+0000","last_became_active":"2024-04-25T01:39:33.426056+0000","last_became_peered":"2024-04-25T01:39:33.426056+0000","last_unstale":"2024-04-25T01:39:34.430089+0000","last_undegraded":"2024-04-25T01:39:34.430089+0000","last_fullsized":"2024-04-25T01:39:34.430089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:53:41.174851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197416+0000","last_change":"2024-04-25T01:39:24.387093+0000","last_active":"2024-04-25T01:39:35.197416+0000","last_peered":"2024-04-25T01:39:35.197416+0000","last_clean":"2024-04-25T01:39:35.197416+0000","last_became_active":"2024-04-25T01:39:24.386809+0000","last_became_peered":"2024-04-25T01:39:24.386809+0000","last_unstale":"2024-04-25T01:39:35.197416+0000","last_undegraded":"2024-04-25T01:39:35.197416+0000","last_fullsized":"2024-04-25T01:39:35.197416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:46:05.313828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200264+0000","last_change":"2024-04-25T01:39:33.436499+0000","last_active":"2024-04-25T01:39:35.200264+0000","last_peered":"2024-04-25T01:39:35.200264+0000","last_clean":"2024-04-25T01:39:35.200264+0000","last_became_active":"2024-04-25T01:39:33.436017+0000","last_became_peered":"2024-04-25T01:39:33.436017+0000","last_unstale":"2024-04-25T01:39:35.200264+0000","last_undegraded":"2024-04-25T01:39:35.200264+0000","last_fullsized":"2024-04-25T01:39:35.200264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:46:09.302012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429495+0000","last_change":"2024-04-25T01:39:24.389039+0000","last_active":"2024-04-25T01:39:34.429495+0000","last_peered":"2024-04-25T01:39:34.429495+0000","last_clean":"2024-04-25T01:39:34.429495+0000","last_became_active":"2024-04-25T01:39:24.388793+0000","last_became_peered":"2024-04-25T01:39:24.388793+0000","last_unstale":"2024-04-25T01:39:34.429495+0000","last_undegraded":"2024-04-25T01:39:34.429495+0000","last_fullsized":"2024-04-25T01:39:34.429495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:13.093550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197668+0000","last_change":"2024-04-25T01:39:33.441122+0000","last_active":"2024-04-25T01:39:35.197668+0000","last_peered":"2024-04-25T01:39:35.197668+0000","last_clean":"2024-04-25T01:39:35.197668+0000","last_became_active":"2024-04-25T01:39:33.440760+0000","last_became_peered":"2024-04-25T01:39:33.440760+0000","last_unstale":"2024-04-25T01:39:35.197668+0000","last_undegraded":"2024-04-25T01:39:35.197668+0000","last_fullsized":"2024-04-25T01:39:35.197668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:30:12.603789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197981+0000","last_change":"2024-04-25T01:39:24.390884+0000","last_active":"2024-04-25T01:39:35.197981+0000","last_peered":"2024-04-25T01:39:35.197981+0000","last_clean":"2024-04-25T01:39:35.197981+0000","last_became_active":"2024-04-25T01:39:24.390591+0000","last_became_peered":"2024-04-25T01:39:24.390591+0000","last_unstale":"2024-04-25T01:39:35.197981+0000","last_undegraded":"2024-04-25T01:39:35.197981+0000","last_fullsized":"2024-04-25T01:39:35.197981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:51.274363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429740+0000","last_change":"2024-04-25T01:39:33.429482+0000","last_active":"2024-04-25T01:39:34.429740+0000","last_peered":"2024-04-25T01:39:34.429740+0000","last_clean":"2024-04-25T01:39:34.429740+0000","last_became_active":"2024-04-25T01:39:33.429158+0000","last_became_peered":"2024-04-25T01:39:33.429158+0000","last_unstale":"2024-04-25T01:39:34.429740+0000","last_undegraded":"2024-04-25T01:39:34.429740+0000","last_fullsized":"2024-04-25T01:39:34.429740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:58:07.372868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559599+0000","last_change":"2024-04-25T01:39:24.388891+0000","last_active":"2024-04-25T01:39:34.559599+0000","last_peered":"2024-04-25T01:39:34.559599+0000","last_clean":"2024-04-25T01:39:34.559599+0000","last_became_active":"2024-04-25T01:39:24.388619+0000","last_became_peered":"2024-04-25T01:39:24.388619+0000","last_unstale":"2024-04-25T01:39:34.559599+0000","last_undegraded":"2024-04-25T01:39:34.559599+0000","last_fullsized":"2024-04-25T01:39:34.559599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:05.176386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198216+0000","last_change":"2024-04-25T01:39:33.443534+0000","last_active":"2024-04-25T01:39:35.198216+0000","last_peered":"2024-04-25T01:39:35.198216+0000","last_clean":"2024-04-25T01:39:35.198216+0000","last_became_active":"2024-04-25T01:39:33.443257+0000","last_became_peered":"2024-04-25T01:39:33.443257+0000","last_unstale":"2024-04-25T01:39:35.198216+0000","last_undegraded":"2024-04-25T01:39:35.198216+0000","last_fullsized":"2024-04-25T01:39:35.198216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:44:30.154519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434181+0000","last_change":"2024-04-25T01:39:24.395109+0000","last_active":"2024-04-25T01:39:34.434181+0000","last_peered":"2024-04-25T01:39:34.434181+0000","last_clean":"2024-04-25T01:39:34.434181+0000","last_became_active":"2024-04-25T01:39:24.394784+0000","last_became_peered":"2024-04-25T01:39:24.394784+0000","last_unstale":"2024-04-25T01:39:34.434181+0000","last_undegraded":"2024-04-25T01:39:34.434181+0000","last_fullsized":"2024-04-25T01:39:34.434181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:44:09.102603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197600+0000","last_change":"2024-04-25T01:39:33.446683+0000","last_active":"2024-04-25T01:39:35.197600+0000","last_peered":"2024-04-25T01:39:35.197600+0000","last_clean":"2024-04-25T01:39:35.197600+0000","last_became_active":"2024-04-25T01:39:33.445949+0000","last_became_peered":"2024-04-25T01:39:33.445949+0000","last_unstale":"2024-04-25T01:39:35.197600+0000","last_undegraded":"2024-04-25T01:39:35.197600+0000","last_fullsized":"2024-04-25T01:39:35.197600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:28.864821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199913+0000","last_change":"2024-04-25T01:39:24.380199+0000","last_active":"2024-04-25T01:39:35.199913+0000","last_peered":"2024-04-25T01:39:35.199913+0000","last_clean":"2024-04-25T01:39:35.199913+0000","last_became_active":"2024-04-25T01:39:24.379591+0000","last_became_peered":"2024-04-25T01:39:24.379591+0000","last_unstale":"2024-04-25T01:39:35.199913+0000","last_undegraded":"2024-04-25T01:39:35.199913+0000","last_fullsized":"2024-04-25T01:39:35.199913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:54.534683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197349+0000","last_change":"2024-04-25T01:39:33.439702+0000","last_active":"2024-04-25T01:39:35.197349+0000","last_peered":"2024-04-25T01:39:35.197349+0000","last_clean":"2024-04-25T01:39:35.197349+0000","last_became_active":"2024-04-25T01:39:33.439424+0000","last_became_peered":"2024-04-25T01:39:33.439424+0000","last_unstale":"2024-04-25T01:39:35.197349+0000","last_undegraded":"2024-04-25T01:39:35.197349+0000","last_fullsized":"2024-04-25T01:39:35.197349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:31.528140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197883+0000","last_change":"2024-04-25T01:39:24.395125+0000","last_active":"2024-04-25T01:39:35.197883+0000","last_peered":"2024-04-25T01:39:35.197883+0000","last_clean":"2024-04-25T01:39:35.197883+0000","last_became_active":"2024-04-25T01:39:24.392605+0000","last_became_peered":"2024-04-25T01:39:24.392605+0000","last_unstale":"2024-04-25T01:39:35.197883+0000","last_undegraded":"2024-04-25T01:39:35.197883+0000","last_fullsized":"2024-04-25T01:39:35.197883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:53.333616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559178+0000","last_change":"2024-04-25T01:39:33.438104+0000","last_active":"2024-04-25T01:39:34.559178+0000","last_peered":"2024-04-25T01:39:34.559178+0000","last_clean":"2024-04-25T01:39:34.559178+0000","last_became_active":"2024-04-25T01:39:33.437795+0000","last_became_peered":"2024-04-25T01:39:33.437795+0000","last_unstale":"2024-04-25T01:39:34.559178+0000","last_undegraded":"2024-04-25T01:39:34.559178+0000","last_fullsized":"2024-04-25T01:39:34.559178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:32.294104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199422+0000","last_change":"2024-04-25T01:39:24.391312+0000","last_active":"2024-04-25T01:39:35.199422+0000","last_peered":"2024-04-25T01:39:35.199422+0000","last_clean":"2024-04-25T01:39:35.199422+0000","last_became_active":"2024-04-25T01:39:24.390978+0000","last_became_peered":"2024-04-25T01:39:24.390978+0000","last_unstale":"2024-04-25T01:39:35.199422+0000","last_undegraded":"2024-04-25T01:39:35.199422+0000","last_fullsized":"2024-04-25T01:39:35.199422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:38:25.637031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197875+0000","last_change":"2024-04-25T01:39:33.431262+0000","last_active":"2024-04-25T01:39:35.197875+0000","last_peered":"2024-04-25T01:39:35.197875+0000","last_clean":"2024-04-25T01:39:35.197875+0000","last_became_active":"2024-04-25T01:39:33.430982+0000","last_became_peered":"2024-04-25T01:39:33.430982+0000","last_unstale":"2024-04-25T01:39:35.197875+0000","last_undegraded":"2024-04-25T01:39:35.197875+0000","last_fullsized":"2024-04-25T01:39:35.197875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:11.821542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197372+0000","last_change":"2024-04-25T01:39:24.399270+0000","last_active":"2024-04-25T01:39:35.197372+0000","last_peered":"2024-04-25T01:39:35.197372+0000","last_clean":"2024-04-25T01:39:35.197372+0000","last_became_active":"2024-04-25T01:39:24.399011+0000","last_became_peered":"2024-04-25T01:39:24.399011+0000","last_unstale":"2024-04-25T01:39:35.197372+0000","last_undegraded":"2024-04-25T01:39:35.197372+0000","last_fullsized":"2024-04-25T01:39:35.197372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:00.987674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197770+0000","last_change":"2024-04-25T01:39:33.443939+0000","last_active":"2024-04-25T01:39:35.197770+0000","last_peered":"2024-04-25T01:39:35.197770+0000","last_clean":"2024-04-25T01:39:35.197770+0000","last_became_active":"2024-04-25T01:39:33.443608+0000","last_became_peered":"2024-04-25T01:39:33.443608+0000","last_unstale":"2024-04-25T01:39:35.197770+0000","last_undegraded":"2024-04-25T01:39:35.197770+0000","last_fullsized":"2024-04-25T01:39:35.197770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:35.561173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197831+0000","last_change":"2024-04-25T01:39:24.388943+0000","last_active":"2024-04-25T01:39:35.197831+0000","last_peered":"2024-04-25T01:39:35.197831+0000","last_clean":"2024-04-25T01:39:35.197831+0000","last_became_active":"2024-04-25T01:39:24.388690+0000","last_became_peered":"2024-04-25T01:39:24.388690+0000","last_unstale":"2024-04-25T01:39:35.197831+0000","last_undegraded":"2024-04-25T01:39:35.197831+0000","last_fullsized":"2024-04-25T01:39:35.197831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:42:18.260701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198911+0000","last_change":"2024-04-25T01:39:33.438460+0000","last_active":"2024-04-25T01:39:35.198911+0000","last_peered":"2024-04-25T01:39:35.198911+0000","last_clean":"2024-04-25T01:39:35.198911+0000","last_became_active":"2024-04-25T01:39:33.436581+0000","last_became_peered":"2024-04-25T01:39:33.436581+0000","last_unstale":"2024-04-25T01:39:35.198911+0000","last_undegraded":"2024-04-25T01:39:35.198911+0000","last_fullsized":"2024-04-25T01:39:35.198911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:03:27.382925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559241+0000","last_change":"2024-04-25T01:39:24.389556+0000","last_active":"2024-04-25T01:39:34.559241+0000","last_peered":"2024-04-25T01:39:34.559241+0000","last_clean":"2024-04-25T01:39:34.559241+0000","last_became_active":"2024-04-25T01:39:24.389254+0000","last_became_peered":"2024-04-25T01:39:24.389254+0000","last_unstale":"2024-04-25T01:39:34.559241+0000","last_undegraded":"2024-04-25T01:39:34.559241+0000","last_fullsized":"2024-04-25T01:39:34.559241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:56.208172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199719+0000","last_change":"2024-04-25T01:39:33.433893+0000","last_active":"2024-04-25T01:39:35.199719+0000","last_peered":"2024-04-25T01:39:35.199719+0000","last_clean":"2024-04-25T01:39:35.199719+0000","last_became_active":"2024-04-25T01:39:33.433577+0000","last_became_peered":"2024-04-25T01:39:33.433577+0000","last_unstale":"2024-04-25T01:39:35.199719+0000","last_undegraded":"2024-04-25T01:39:35.199719+0000","last_fullsized":"2024-04-25T01:39:35.199719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:16.371837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429725+0000","last_change":"2024-04-25T01:39:24.392021+0000","last_active":"2024-04-25T01:39:34.429725+0000","last_peered":"2024-04-25T01:39:34.429725+0000","last_clean":"2024-04-25T01:39:34.429725+0000","last_became_active":"2024-04-25T01:39:24.391352+0000","last_became_peered":"2024-04-25T01:39:24.391352+0000","last_unstale":"2024-04-25T01:39:34.429725+0000","last_undegraded":"2024-04-25T01:39:34.429725+0000","last_fullsized":"2024-04-25T01:39:34.429725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:44.434749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429972+0000","last_change":"2024-04-25T01:39:33.436641+0000","last_active":"2024-04-25T01:39:34.429972+0000","last_peered":"2024-04-25T01:39:34.429972+0000","last_clean":"2024-04-25T01:39:34.429972+0000","last_became_active":"2024-04-25T01:39:33.436389+0000","last_became_peered":"2024-04-25T01:39:33.436389+0000","last_unstale":"2024-04-25T01:39:34.429972+0000","last_undegraded":"2024-04-25T01:39:34.429972+0000","last_fullsized":"2024-04-25T01:39:34.429972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:19:51.940088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198744+0000","last_change":"2024-04-25T01:39:24.396300+0000","last_active":"2024-04-25T01:39:35.198744+0000","last_peered":"2024-04-25T01:39:35.198744+0000","last_clean":"2024-04-25T01:39:35.198744+0000","last_became_active":"2024-04-25T01:39:24.396023+0000","last_became_peered":"2024-04-25T01:39:24.396023+0000","last_unstale":"2024-04-25T01:39:35.198744+0000","last_undegraded":"2024-04-25T01:39:35.198744+0000","last_fullsized":"2024-04-25T01:39:35.198744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:21.500721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197770+0000","last_change":"2024-04-25T01:39:33.443419+0000","last_active":"2024-04-25T01:39:35.197770+0000","last_peered":"2024-04-25T01:39:35.197770+0000","last_clean":"2024-04-25T01:39:35.197770+0000","last_became_active":"2024-04-25T01:39:33.443163+0000","last_became_peered":"2024-04-25T01:39:33.443163+0000","last_unstale":"2024-04-25T01:39:35.197770+0000","last_undegraded":"2024-04-25T01:39:35.197770+0000","last_fullsized":"2024-04-25T01:39:35.197770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:22.156410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434366+0000","last_change":"2024-04-25T01:39:24.404047+0000","last_active":"2024-04-25T01:39:34.434366+0000","last_peered":"2024-04-25T01:39:34.434366+0000","last_clean":"2024-04-25T01:39:34.434366+0000","last_became_active":"2024-04-25T01:39:24.403700+0000","last_became_peered":"2024-04-25T01:39:24.403700+0000","last_unstale":"2024-04-25T01:39:34.434366+0000","last_undegraded":"2024-04-25T01:39:34.434366+0000","last_fullsized":"2024-04-25T01:39:34.434366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:53.123061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199905+0000","last_change":"2024-04-25T01:39:33.435520+0000","last_active":"2024-04-25T01:39:35.199905+0000","last_peered":"2024-04-25T01:39:35.199905+0000","last_clean":"2024-04-25T01:39:35.199905+0000","last_became_active":"2024-04-25T01:39:33.434446+0000","last_became_peered":"2024-04-25T01:39:33.434446+0000","last_unstale":"2024-04-25T01:39:35.199905+0000","last_undegraded":"2024-04-25T01:39:35.199905+0000","last_fullsized":"2024-04-25T01:39:35.199905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:59.696009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434467+0000","last_change":"2024-04-25T01:39:24.406158+0000","last_active":"2024-04-25T01:39:34.434467+0000","last_peered":"2024-04-25T01:39:34.434467+0000","last_clean":"2024-04-25T01:39:34.434467+0000","last_became_active":"2024-04-25T01:39:24.405876+0000","last_became_peered":"2024-04-25T01:39:24.405876+0000","last_unstale":"2024-04-25T01:39:34.434467+0000","last_undegraded":"2024-04-25T01:39:34.434467+0000","last_fullsized":"2024-04-25T01:39:34.434467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:18:19.895651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198497+0000","last_change":"2024-04-25T01:39:33.436479+0000","last_active":"2024-04-25T01:39:35.198497+0000","last_peered":"2024-04-25T01:39:35.198497+0000","last_clean":"2024-04-25T01:39:35.198497+0000","last_became_active":"2024-04-25T01:39:33.436193+0000","last_became_peered":"2024-04-25T01:39:33.436193+0000","last_unstale":"2024-04-25T01:39:35.198497+0000","last_undegraded":"2024-04-25T01:39:35.198497+0000","last_fullsized":"2024-04-25T01:39:35.198497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:20:03.455536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200363+0000","last_change":"2024-04-25T01:39:24.393362+0000","last_active":"2024-04-25T01:39:35.200363+0000","last_peered":"2024-04-25T01:39:35.200363+0000","last_clean":"2024-04-25T01:39:35.200363+0000","last_became_active":"2024-04-25T01:39:24.392836+0000","last_became_peered":"2024-04-25T01:39:24.392836+0000","last_unstale":"2024-04-25T01:39:35.200363+0000","last_undegraded":"2024-04-25T01:39:35.200363+0000","last_fullsized":"2024-04-25T01:39:35.200363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:58.871777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430064+0000","last_change":"2024-04-25T01:39:33.440164+0000","last_active":"2024-04-25T01:39:34.430064+0000","last_peered":"2024-04-25T01:39:34.430064+0000","last_clean":"2024-04-25T01:39:34.430064+0000","last_became_active":"2024-04-25T01:39:33.439878+0000","last_became_peered":"2024-04-25T01:39:33.439878+0000","last_unstale":"2024-04-25T01:39:34.430064+0000","last_undegraded":"2024-04-25T01:39:34.430064+0000","last_fullsized":"2024-04-25T01:39:34.430064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:44:52.817169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429296+0000","last_change":"2024-04-25T01:39:24.401765+0000","last_active":"2024-04-25T01:39:34.429296+0000","last_peered":"2024-04-25T01:39:34.429296+0000","last_clean":"2024-04-25T01:39:34.429296+0000","last_became_active":"2024-04-25T01:39:24.400509+0000","last_became_peered":"2024-04-25T01:39:24.400509+0000","last_unstale":"2024-04-25T01:39:34.429296+0000","last_undegraded":"2024-04-25T01:39:34.429296+0000","last_fullsized":"2024-04-25T01:39:34.429296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:25.031622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434669+0000","last_change":"2024-04-25T01:39:33.439353+0000","last_active":"2024-04-25T01:39:34.434669+0000","last_peered":"2024-04-25T01:39:34.434669+0000","last_clean":"2024-04-25T01:39:34.434669+0000","last_became_active":"2024-04-25T01:39:33.438915+0000","last_became_peered":"2024-04-25T01:39:33.438915+0000","last_unstale":"2024-04-25T01:39:34.434669+0000","last_undegraded":"2024-04-25T01:39:34.434669+0000","last_fullsized":"2024-04-25T01:39:34.434669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:19.180919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198881+0000","last_change":"2024-04-25T01:39:24.387941+0000","last_active":"2024-04-25T01:39:35.198881+0000","last_peered":"2024-04-25T01:39:35.198881+0000","last_clean":"2024-04-25T01:39:35.198881+0000","last_became_active":"2024-04-25T01:39:24.387674+0000","last_became_peered":"2024-04-25T01:39:24.387674+0000","last_unstale":"2024-04-25T01:39:35.198881+0000","last_undegraded":"2024-04-25T01:39:35.198881+0000","last_fullsized":"2024-04-25T01:39:35.198881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:05.676143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197803+0000","last_change":"2024-04-25T01:39:33.444917+0000","last_active":"2024-04-25T01:39:35.197803+0000","last_peered":"2024-04-25T01:39:35.197803+0000","last_clean":"2024-04-25T01:39:35.197803+0000","last_became_active":"2024-04-25T01:39:33.444636+0000","last_became_peered":"2024-04-25T01:39:33.444636+0000","last_unstale":"2024-04-25T01:39:35.197803+0000","last_undegraded":"2024-04-25T01:39:35.197803+0000","last_fullsized":"2024-04-25T01:39:35.197803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:31.531502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197880+0000","last_change":"2024-04-25T01:39:24.399950+0000","last_active":"2024-04-25T01:39:35.197880+0000","last_peered":"2024-04-25T01:39:35.197880+0000","last_clean":"2024-04-25T01:39:35.197880+0000","last_became_active":"2024-04-25T01:39:24.399701+0000","last_became_peered":"2024-04-25T01:39:24.399701+0000","last_unstale":"2024-04-25T01:39:35.197880+0000","last_undegraded":"2024-04-25T01:39:35.197880+0000","last_fullsized":"2024-04-25T01:39:35.197880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:49.618370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200035+0000","last_change":"2024-04-25T01:39:33.440936+0000","last_active":"2024-04-25T01:39:35.200035+0000","last_peered":"2024-04-25T01:39:35.200035+0000","last_clean":"2024-04-25T01:39:35.200035+0000","last_became_active":"2024-04-25T01:39:33.440679+0000","last_became_peered":"2024-04-25T01:39:33.440679+0000","last_unstale":"2024-04-25T01:39:35.200035+0000","last_undegraded":"2024-04-25T01:39:35.200035+0000","last_fullsized":"2024-04-25T01:39:35.200035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:08:53.629572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198222+0000","last_change":"2024-04-25T01:39:24.380318+0000","last_active":"2024-04-25T01:39:35.198222+0000","last_peered":"2024-04-25T01:39:35.198222+0000","last_clean":"2024-04-25T01:39:35.198222+0000","last_became_active":"2024-04-25T01:39:24.379573+0000","last_became_peered":"2024-04-25T01:39:24.379573+0000","last_unstale":"2024-04-25T01:39:35.198222+0000","last_undegraded":"2024-04-25T01:39:35.198222+0000","last_fullsized":"2024-04-25T01:39:35.198222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:12.089917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429399+0000","last_change":"2024-04-25T01:39:33.426380+0000","last_active":"2024-04-25T01:39:34.429399+0000","last_peered":"2024-04-25T01:39:34.429399+0000","last_clean":"2024-04-25T01:39:34.429399+0000","last_became_active":"2024-04-25T01:39:33.426090+0000","last_became_peered":"2024-04-25T01:39:33.426090+0000","last_unstale":"2024-04-25T01:39:34.429399+0000","last_undegraded":"2024-04-25T01:39:34.429399+0000","last_fullsized":"2024-04-25T01:39:34.429399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:34.329217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199243+0000","last_change":"2024-04-25T01:39:24.398726+0000","last_active":"2024-04-25T01:39:35.199243+0000","last_peered":"2024-04-25T01:39:35.199243+0000","last_clean":"2024-04-25T01:39:35.199243+0000","last_became_active":"2024-04-25T01:39:24.398449+0000","last_became_peered":"2024-04-25T01:39:24.398449+0000","last_unstale":"2024-04-25T01:39:35.199243+0000","last_undegraded":"2024-04-25T01:39:35.199243+0000","last_fullsized":"2024-04-25T01:39:35.199243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:41:38.230939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197750+0000","last_change":"2024-04-25T01:39:33.436488+0000","last_active":"2024-04-25T01:39:35.197750+0000","last_peered":"2024-04-25T01:39:35.197750+0000","last_clean":"2024-04-25T01:39:35.197750+0000","last_became_active":"2024-04-25T01:39:33.436224+0000","last_became_peered":"2024-04-25T01:39:33.436224+0000","last_unstale":"2024-04-25T01:39:35.197750+0000","last_undegraded":"2024-04-25T01:39:35.197750+0000","last_fullsized":"2024-04-25T01:39:35.197750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:38.227206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559398+0000","last_change":"2024-04-25T01:39:24.386909+0000","last_active":"2024-04-25T01:39:34.559398+0000","last_peered":"2024-04-25T01:39:34.559398+0000","last_clean":"2024-04-25T01:39:34.559398+0000","last_became_active":"2024-04-25T01:39:24.386568+0000","last_became_peered":"2024-04-25T01:39:24.386568+0000","last_unstale":"2024-04-25T01:39:34.559398+0000","last_undegraded":"2024-04-25T01:39:34.559398+0000","last_fullsized":"2024-04-25T01:39:34.559398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:29.904064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197979+0000","last_change":"2024-04-25T01:39:33.440753+0000","last_active":"2024-04-25T01:39:35.197979+0000","last_peered":"2024-04-25T01:39:35.197979+0000","last_clean":"2024-04-25T01:39:35.197979+0000","last_became_active":"2024-04-25T01:39:33.440480+0000","last_became_peered":"2024-04-25T01:39:33.440480+0000","last_unstale":"2024-04-25T01:39:35.197979+0000","last_undegraded":"2024-04-25T01:39:35.197979+0000","last_fullsized":"2024-04-25T01:39:35.197979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:18.113293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197980+0000","last_change":"2024-04-25T01:39:24.386803+0000","last_active":"2024-04-25T01:39:35.197980+0000","last_peered":"2024-04-25T01:39:35.197980+0000","last_clean":"2024-04-25T01:39:35.197980+0000","last_became_active":"2024-04-25T01:39:24.386531+0000","last_became_peered":"2024-04-25T01:39:24.386531+0000","last_unstale":"2024-04-25T01:39:35.197980+0000","last_undegraded":"2024-04-25T01:39:35.197980+0000","last_fullsized":"2024-04-25T01:39:35.197980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:19.160345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198690+0000","last_change":"2024-04-25T01:39:33.436433+0000","last_active":"2024-04-25T01:39:35.198690+0000","last_peered":"2024-04-25T01:39:35.198690+0000","last_clean":"2024-04-25T01:39:35.198690+0000","last_became_active":"2024-04-25T01:39:33.436134+0000","last_became_peered":"2024-04-25T01:39:33.436134+0000","last_unstale":"2024-04-25T01:39:35.198690+0000","last_undegraded":"2024-04-25T01:39:35.198690+0000","last_fullsized":"2024-04-25T01:39:35.198690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:08:30.641790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200300+0000","last_change":"2024-04-25T01:39:24.396231+0000","last_active":"2024-04-25T01:39:35.200300+0000","last_peered":"2024-04-25T01:39:35.200300+0000","last_clean":"2024-04-25T01:39:35.200300+0000","last_became_active":"2024-04-25T01:39:24.395958+0000","last_became_peered":"2024-04-25T01:39:24.395958+0000","last_unstale":"2024-04-25T01:39:35.200300+0000","last_undegraded":"2024-04-25T01:39:35.200300+0000","last_fullsized":"2024-04-25T01:39:35.200300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:54.898765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2666,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":690301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":101745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":99491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":102763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":101055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T01:40:02.577 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T01:40:02.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.722+0000 7fba7ceba640 1 Processor -- start 2024-04-25T01:40:02.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.722+0000 7fba7ceba640 1 -- start start 2024-04-25T01:40:02.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.723+0000 7fba7ceba640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fba78150090 0x7fba78156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:02.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.723+0000 7fba7ceba640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fba7806c280 0x7fba780c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:02.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.723+0000 7fba7ceba640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba780c89c0 con 0x7fba780c8200 2024-04-25T01:40:02.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.723+0000 7fba7ceba640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fba7806b830 con 0x7fba78150090 2024-04-25T01:40:02.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.723+0000 7fba7ceba640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fba780c8ca0 con 0x7fba7806c280 2024-04-25T01:40:02.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.723+0000 7fba7659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fba78150090 0x7fba78156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:02.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.723+0000 7fba7659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fba78150090 0x7fba78156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39014/0 (socket says 172.21.15.77:39014) 2024-04-25T01:40:02.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.723+0000 7fba7659c640 1 -- 172.21.15.77:0/799757063 learned_addr learned my addr 172.21.15.77:0/799757063 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:02.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.724+0000 7fba76d9d640 1 --2- 172.21.15.77:0/799757063 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fba7806c280 0x7fba780c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:02.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.724+0000 7fba7659c640 1 -- 172.21.15.77:0/799757063 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fba7806c280 msgr2=0x7fba780c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:02.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.724+0000 7fba7659c640 1 --2- 172.21.15.77:0/799757063 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fba7806c280 0x7fba780c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.724+0000 7fba7659c640 1 -- 172.21.15.77:0/799757063 >> v1:172.21.15.121:6789/0 conn(0x7fba780c8200 legacy=0x7fba780c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:02.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.724+0000 7fba7659c640 1 -- 172.21.15.77:0/799757063 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba7806ba80 con 0x7fba78150090 2024-04-25T01:40:02.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.724+0000 7fba7659c640 1 --2- 172.21.15.77:0/799757063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba78150090 0x7fba78156c80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fba70009e50 tx=0x7fba7002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6fac7b398b25373 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:02.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.725+0000 7fba7559a640 1 -- 172.21.15.77:0/799757063 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba70036070 con 0x7fba78150090 2024-04-25T01:40:02.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.725+0000 7fba7559a640 1 -- 172.21.15.77:0/799757063 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba70031600 con 0x7fba78150090 2024-04-25T01:40:02.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.725+0000 7fba7559a640 1 -- 172.21.15.77:0/799757063 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba700319d0 con 0x7fba78150090 2024-04-25T01:40:02.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.725+0000 7fba7ceba640 1 -- 172.21.15.77:0/799757063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba78150090 msgr2=0x7fba78156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:02.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.725+0000 7fba7ceba640 1 --2- 172.21.15.77:0/799757063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba78150090 0x7fba78156c80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fba70009e50 tx=0x7fba7002a710 comp rx=0 tx=0).stop 2024-04-25T01:40:02.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.725+0000 7fba7ceba640 1 -- 172.21.15.77:0/799757063 shutdown_connections 2024-04-25T01:40:02.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.725+0000 7fba7ceba640 1 --2- 172.21.15.77:0/799757063 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fba7806c280 0x7fba780c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.725+0000 7fba7ceba640 1 --2- 172.21.15.77:0/799757063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba78150090 0x7fba78156c80 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.725+0000 7fba7ceba640 1 -- 172.21.15.77:0/799757063 >> 172.21.15.77:0/799757063 conn(0x7fba780ad4d0 msgr2=0x7fba780ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:02.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.725+0000 7fba7ceba640 1 -- 172.21.15.77:0/799757063 shutdown_connections 2024-04-25T01:40:02.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.725+0000 7fba7ceba640 1 -- 172.21.15.77:0/799757063 wait complete. 2024-04-25T01:40:02.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.726+0000 7fba7ceba640 1 Processor -- start 2024-04-25T01:40:02.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.726+0000 7fba7ceba640 1 -- start start 2024-04-25T01:40:02.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.727+0000 7fba7ceba640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba7806c280 0x7fba78150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:02.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.727+0000 7fba7ceba640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fba780c8200 0x7fba781ec350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:02.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.727+0000 7fba7ceba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba78150090 0x7fba780abc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:02.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.727+0000 7fba7ceba640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fba7806c6b0 con 0x7fba78150090 2024-04-25T01:40:02.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.727+0000 7fba7ceba640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fba780c86b0 con 0x7fba7806c280 2024-04-25T01:40:02.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.727+0000 7fba7ceba640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fba7806c830 con 0x7fba780c8200 2024-04-25T01:40:02.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.727+0000 7fba76d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba78150090 0x7fba780abc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:02.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.727+0000 7fba76d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba78150090 0x7fba780abc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39024/0 (socket says 172.21.15.77:39024) 2024-04-25T01:40:02.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.727+0000 7fba76d9d640 1 -- 172.21.15.77:0/3671800325 learned_addr learned my addr 172.21.15.77:0/3671800325 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:02.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.727+0000 7fba7659c640 1 --2- 172.21.15.77:0/3671800325 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba7806c280 0x7fba78150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:02.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.727+0000 7fba75d9b640 1 --2- 172.21.15.77:0/3671800325 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fba780c8200 0x7fba781ec350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:02.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.727+0000 7fba76d9d640 1 -- 172.21.15.77:0/3671800325 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fba780c8200 msgr2=0x7fba781ec350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:02.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.727+0000 7fba76d9d640 1 --2- 172.21.15.77:0/3671800325 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fba780c8200 0x7fba781ec350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.727+0000 7fba76d9d640 1 -- 172.21.15.77:0/3671800325 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba7806c280 msgr2=0x7fba78150470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:02.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.727+0000 7fba76d9d640 1 --2- 172.21.15.77:0/3671800325 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba7806c280 0x7fba78150470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.727+0000 7fba76d9d640 1 -- 172.21.15.77:0/3671800325 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba780c4890 con 0x7fba78150090 2024-04-25T01:40:02.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.728+0000 7fba76d9d640 1 --2- 172.21.15.77:0/3671800325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba78150090 0x7fba780abc30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fba6800e930 tx=0x7fba6800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:02.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.728+0000 7fba66ffd640 1 -- 172.21.15.77:0/3671800325 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba68017070 con 0x7fba78150090 2024-04-25T01:40:02.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.728+0000 7fba66ffd640 1 -- 172.21.15.77:0/3671800325 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba6800c980 con 0x7fba78150090 2024-04-25T01:40:02.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.728+0000 7fba66ffd640 1 -- 172.21.15.77:0/3671800325 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6800cd70 con 0x7fba78150090 2024-04-25T01:40:02.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.728+0000 7fba7ceba640 1 -- 172.21.15.77:0/3671800325 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba780c4b70 con 0x7fba78150090 2024-04-25T01:40:02.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.728+0000 7fba7ceba640 1 -- 172.21.15.77:0/3671800325 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba781ef110 con 0x7fba78150090 2024-04-25T01:40:02.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.729+0000 7fba7ceba640 1 -- 172.21.15.77:0/3671800325 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba781ef310 con 0x7fba78150090 2024-04-25T01:40:02.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.729+0000 7fba66ffd640 1 -- 172.21.15.77:0/3671800325 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba6801a070 con 0x7fba78150090 2024-04-25T01:40:02.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.729+0000 7fba66ffd640 1 --2- 172.21.15.77:0/3671800325 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fba5806be30 0x7fba5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:02.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.730+0000 7fba66ffd640 1 -- 172.21.15.77:0/3671800325 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fba6808b440 con 0x7fba78150090 2024-04-25T01:40:02.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.730+0000 7fba7659c640 1 --2- 172.21.15.77:0/3671800325 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fba5806be30 0x7fba5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:02.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.730+0000 7fba7659c640 1 --2- 172.21.15.77:0/3671800325 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fba5806be30 0x7fba5806e2f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fba70033000 tx=0x7fba70009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:02.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.734+0000 7fba66ffd640 1 -- 172.21.15.77:0/3671800325 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fba781ef310 con 0x7fba78150090 2024-04-25T01:40:02.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.903+0000 7fba7ceba640 1 -- 172.21.15.77:0/3671800325 --> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fba7804f500 con 0x7fba5806be30 2024-04-25T01:40:02.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.914+0000 7fba66ffd640 1 -- 172.21.15.77:0/3671800325 <== mgr.4098 v2:172.21.15.77:6832/4208232183 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490299 (secure 0 0 0) 0x7fba7804f500 con 0x7fba5806be30 2024-04-25T01:40:02.903 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:40:02.907 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-25T01:40:02.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.918+0000 7fba7ceba640 1 -- 172.21.15.77:0/3671800325 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fba5806be30 msgr2=0x7fba5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:02.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.918+0000 7fba7ceba640 1 --2- 172.21.15.77:0/3671800325 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fba5806be30 0x7fba5806e2f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fba70033000 tx=0x7fba70009000 comp rx=0 tx=0).stop 2024-04-25T01:40:02.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.918+0000 7fba7ceba640 1 -- 172.21.15.77:0/3671800325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba78150090 msgr2=0x7fba780abc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:02.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.918+0000 7fba7ceba640 1 --2- 172.21.15.77:0/3671800325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba78150090 0x7fba780abc30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fba6800e930 tx=0x7fba6800edf0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.918+0000 7fba7ceba640 1 -- 172.21.15.77:0/3671800325 shutdown_connections 2024-04-25T01:40:02.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.918+0000 7fba7ceba640 1 --2- 172.21.15.77:0/3671800325 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fba5806be30 0x7fba5806e2f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.918+0000 7fba7ceba640 1 --2- 172.21.15.77:0/3671800325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba78150090 0x7fba780abc30 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.918+0000 7fba7ceba640 1 --2- 172.21.15.77:0/3671800325 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fba780c8200 0x7fba781ec350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.918+0000 7fba7ceba640 1 --2- 172.21.15.77:0/3671800325 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba7806c280 0x7fba78150470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:02.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.918+0000 7fba7ceba640 1 -- 172.21.15.77:0/3671800325 >> 172.21.15.77:0/3671800325 conn(0x7fba780ad4d0 msgr2=0x7fba780c6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:02.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.918+0000 7fba7ceba640 1 -- 172.21.15.77:0/3671800325 shutdown_connections 2024-04-25T01:40:02.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:02.918+0000 7fba7ceba640 1 -- 172.21.15.77:0/3671800325 wait complete. 2024-04-25T01:40:02.913 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-04-25T01:40:01.659550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595444,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219444,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755276,"statfs":{"total":773094113280,"available":772869402624,"internally_reserved":0,"allocated":3350528,"data_stored":1984976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":256,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002726"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197412+0000","last_change":"2024-04-25T01:39:33.445614+0000","last_active":"2024-04-25T01:39:35.197412+0000","last_peered":"2024-04-25T01:39:35.197412+0000","last_clean":"2024-04-25T01:39:35.197412+0000","last_became_active":"2024-04-25T01:39:33.445090+0000","last_became_peered":"2024-04-25T01:39:33.445090+0000","last_unstale":"2024-04-25T01:39:35.197412+0000","last_undegraded":"2024-04-25T01:39:35.197412+0000","last_fullsized":"2024-04-25T01:39:35.197412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:50.951488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559582+0000","last_change":"2024-04-25T01:39:23.377096+0000","last_active":"2024-04-25T01:39:34.559582+0000","last_peered":"2024-04-25T01:39:34.559582+0000","last_clean":"2024-04-25T01:39:34.559582+0000","last_became_active":"2024-04-25T01:39:23.376811+0000","last_became_peered":"2024-04-25T01:39:23.376811+0000","last_unstale":"2024-04-25T01:39:34.559582+0000","last_undegraded":"2024-04-25T01:39:34.559582+0000","last_fullsized":"2024-04-25T01:39:34.559582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:26.888605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430280+0000","last_change":"2024-04-25T01:39:24.394317+0000","last_active":"2024-04-25T01:39:34.430280+0000","last_peered":"2024-04-25T01:39:34.430280+0000","last_clean":"2024-04-25T01:39:34.430280+0000","last_became_active":"2024-04-25T01:39:24.394032+0000","last_became_peered":"2024-04-25T01:39:24.394032+0000","last_unstale":"2024-04-25T01:39:34.430280+0000","last_undegraded":"2024-04-25T01:39:34.430280+0000","last_fullsized":"2024-04-25T01:39:34.430280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:11.795443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429310+0000","last_change":"2024-04-25T01:39:32.421607+0000","last_active":"2024-04-25T01:39:34.429310+0000","last_peered":"2024-04-25T01:39:34.429310+0000","last_clean":"2024-04-25T01:39:34.429310+0000","last_became_active":"2024-04-25T01:39:32.421355+0000","last_became_peered":"2024-04-25T01:39:32.421355+0000","last_unstale":"2024-04-25T01:39:34.429310+0000","last_undegraded":"2024-04-25T01:39:34.429310+0000","last_fullsized":"2024-04-25T01:39:34.429310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:12:14.019262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198433+0000","last_change":"2024-04-25T01:39:33.436651+0000","last_active":"2024-04-25T01:39:35.198433+0000","last_peered":"2024-04-25T01:39:35.198433+0000","last_clean":"2024-04-25T01:39:35.198433+0000","last_became_active":"2024-04-25T01:39:33.436370+0000","last_became_peered":"2024-04-25T01:39:33.436370+0000","last_unstale":"2024-04-25T01:39:35.198433+0000","last_undegraded":"2024-04-25T01:39:35.198433+0000","last_fullsized":"2024-04-25T01:39:35.198433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:57:10.341738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430287+0000","last_change":"2024-04-25T01:39:23.369400+0000","last_active":"2024-04-25T01:39:34.430287+0000","last_peered":"2024-04-25T01:39:34.430287+0000","last_clean":"2024-04-25T01:39:34.430287+0000","last_became_active":"2024-04-25T01:39:23.368726+0000","last_became_peered":"2024-04-25T01:39:23.368726+0000","last_unstale":"2024-04-25T01:39:34.430287+0000","last_undegraded":"2024-04-25T01:39:34.430287+0000","last_fullsized":"2024-04-25T01:39:34.430287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:35:42.971179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559440+0000","last_change":"2024-04-25T01:39:24.403873+0000","last_active":"2024-04-25T01:39:34.559440+0000","last_peered":"2024-04-25T01:39:34.559440+0000","last_clean":"2024-04-25T01:39:34.559440+0000","last_became_active":"2024-04-25T01:39:24.403623+0000","last_became_peered":"2024-04-25T01:39:24.403623+0000","last_unstale":"2024-04-25T01:39:34.559440+0000","last_undegraded":"2024-04-25T01:39:34.559440+0000","last_fullsized":"2024-04-25T01:39:34.559440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:49.360933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197343+0000","last_change":"2024-04-25T01:39:32.430985+0000","last_active":"2024-04-25T01:39:35.197343+0000","last_peered":"2024-04-25T01:39:35.197343+0000","last_clean":"2024-04-25T01:39:35.197343+0000","last_became_active":"2024-04-25T01:39:32.430617+0000","last_became_peered":"2024-04-25T01:39:32.430617+0000","last_unstale":"2024-04-25T01:39:35.197343+0000","last_undegraded":"2024-04-25T01:39:35.197343+0000","last_fullsized":"2024-04-25T01:39:35.197343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:13.938619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199408+0000","last_change":"2024-04-25T01:39:33.444043+0000","last_active":"2024-04-25T01:39:35.199408+0000","last_peered":"2024-04-25T01:39:35.199408+0000","last_clean":"2024-04-25T01:39:35.199408+0000","last_became_active":"2024-04-25T01:39:33.443737+0000","last_became_peered":"2024-04-25T01:39:33.443737+0000","last_unstale":"2024-04-25T01:39:35.199408+0000","last_undegraded":"2024-04-25T01:39:35.199408+0000","last_fullsized":"2024-04-25T01:39:35.199408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:02:50.401910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199857+0000","last_change":"2024-04-25T01:39:23.377963+0000","last_active":"2024-04-25T01:39:35.199857+0000","last_peered":"2024-04-25T01:39:35.199857+0000","last_clean":"2024-04-25T01:39:35.199857+0000","last_became_active":"2024-04-25T01:39:23.377402+0000","last_became_peered":"2024-04-25T01:39:23.377402+0000","last_unstale":"2024-04-25T01:39:35.199857+0000","last_undegraded":"2024-04-25T01:39:35.199857+0000","last_fullsized":"2024-04-25T01:39:35.199857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:15.873450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199352+0000","last_change":"2024-04-25T01:39:24.394512+0000","last_active":"2024-04-25T01:39:35.199352+0000","last_peered":"2024-04-25T01:39:35.199352+0000","last_clean":"2024-04-25T01:39:35.199352+0000","last_became_active":"2024-04-25T01:39:24.393954+0000","last_became_peered":"2024-04-25T01:39:24.393954+0000","last_unstale":"2024-04-25T01:39:35.199352+0000","last_undegraded":"2024-04-25T01:39:35.199352+0000","last_fullsized":"2024-04-25T01:39:35.199352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:30.534400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197850+0000","last_change":"2024-04-25T01:39:32.428198+0000","last_active":"2024-04-25T01:39:35.197850+0000","last_peered":"2024-04-25T01:39:35.197850+0000","last_clean":"2024-04-25T01:39:35.197850+0000","last_became_active":"2024-04-25T01:39:32.427955+0000","last_became_peered":"2024-04-25T01:39:32.427955+0000","last_unstale":"2024-04-25T01:39:35.197850+0000","last_undegraded":"2024-04-25T01:39:35.197850+0000","last_fullsized":"2024-04-25T01:39:35.197850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:07.684150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198064+0000","last_change":"2024-04-25T01:39:33.439854+0000","last_active":"2024-04-25T01:39:35.198064+0000","last_peered":"2024-04-25T01:39:35.198064+0000","last_clean":"2024-04-25T01:39:35.198064+0000","last_became_active":"2024-04-25T01:39:33.439555+0000","last_became_peered":"2024-04-25T01:39:33.439555+0000","last_unstale":"2024-04-25T01:39:35.198064+0000","last_undegraded":"2024-04-25T01:39:35.198064+0000","last_fullsized":"2024-04-25T01:39:35.198064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:50.250748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198904+0000","last_change":"2024-04-25T01:39:23.377093+0000","last_active":"2024-04-25T01:39:35.198904+0000","last_peered":"2024-04-25T01:39:35.198904+0000","last_clean":"2024-04-25T01:39:35.198904+0000","last_became_active":"2024-04-25T01:39:23.376744+0000","last_became_peered":"2024-04-25T01:39:23.376744+0000","last_unstale":"2024-04-25T01:39:35.198904+0000","last_undegraded":"2024-04-25T01:39:35.198904+0000","last_fullsized":"2024-04-25T01:39:35.198904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:43.529618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200129+0000","last_change":"2024-04-25T01:39:24.393293+0000","last_active":"2024-04-25T01:39:35.200129+0000","last_peered":"2024-04-25T01:39:35.200129+0000","last_clean":"2024-04-25T01:39:35.200129+0000","last_became_active":"2024-04-25T01:39:24.393005+0000","last_became_peered":"2024-04-25T01:39:24.393005+0000","last_unstale":"2024-04-25T01:39:35.200129+0000","last_undegraded":"2024-04-25T01:39:35.200129+0000","last_fullsized":"2024-04-25T01:39:35.200129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:32.070747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197654+0000","last_change":"2024-04-25T01:39:32.428956+0000","last_active":"2024-04-25T01:39:35.197654+0000","last_peered":"2024-04-25T01:39:35.197654+0000","last_clean":"2024-04-25T01:39:35.197654+0000","last_became_active":"2024-04-25T01:39:32.428705+0000","last_became_peered":"2024-04-25T01:39:32.428705+0000","last_unstale":"2024-04-25T01:39:35.197654+0000","last_undegraded":"2024-04-25T01:39:35.197654+0000","last_fullsized":"2024-04-25T01:39:35.197654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:06:22.998986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198197+0000","last_change":"2024-04-25T01:39:33.446571+0000","last_active":"2024-04-25T01:39:35.198197+0000","last_peered":"2024-04-25T01:39:35.198197+0000","last_clean":"2024-04-25T01:39:35.198197+0000","last_became_active":"2024-04-25T01:39:33.446234+0000","last_became_peered":"2024-04-25T01:39:33.446234+0000","last_unstale":"2024-04-25T01:39:35.198197+0000","last_undegraded":"2024-04-25T01:39:35.198197+0000","last_fullsized":"2024-04-25T01:39:35.198197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:12.742092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434733+0000","last_change":"2024-04-25T01:39:24.398859+0000","last_active":"2024-04-25T01:39:34.434733+0000","last_peered":"2024-04-25T01:39:34.434733+0000","last_clean":"2024-04-25T01:39:34.434733+0000","last_became_active":"2024-04-25T01:39:24.398618+0000","last_became_peered":"2024-04-25T01:39:24.398618+0000","last_unstale":"2024-04-25T01:39:34.434733+0000","last_undegraded":"2024-04-25T01:39:34.434733+0000","last_fullsized":"2024-04-25T01:39:34.434733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:15.278376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199208+0000","last_change":"2024-04-25T01:39:23.377717+0000","last_active":"2024-04-25T01:39:35.199208+0000","last_peered":"2024-04-25T01:39:35.199208+0000","last_clean":"2024-04-25T01:39:35.199208+0000","last_became_active":"2024-04-25T01:39:23.377291+0000","last_became_peered":"2024-04-25T01:39:23.377291+0000","last_unstale":"2024-04-25T01:39:35.199208+0000","last_undegraded":"2024-04-25T01:39:35.199208+0000","last_fullsized":"2024-04-25T01:39:35.199208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:06.402745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197947+0000","last_change":"2024-04-25T01:39:32.426840+0000","last_active":"2024-04-25T01:39:35.197947+0000","last_peered":"2024-04-25T01:39:35.197947+0000","last_clean":"2024-04-25T01:39:35.197947+0000","last_became_active":"2024-04-25T01:39:32.426529+0000","last_became_peered":"2024-04-25T01:39:32.426529+0000","last_unstale":"2024-04-25T01:39:35.197947+0000","last_undegraded":"2024-04-25T01:39:35.197947+0000","last_fullsized":"2024-04-25T01:39:35.197947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:57.097685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198092+0000","last_change":"2024-04-25T01:39:33.437767+0000","last_active":"2024-04-25T01:39:35.198092+0000","last_peered":"2024-04-25T01:39:35.198092+0000","last_clean":"2024-04-25T01:39:35.198092+0000","last_became_active":"2024-04-25T01:39:33.437483+0000","last_became_peered":"2024-04-25T01:39:33.437483+0000","last_unstale":"2024-04-25T01:39:35.198092+0000","last_undegraded":"2024-04-25T01:39:35.198092+0000","last_fullsized":"2024-04-25T01:39:35.198092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:44.321779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429750+0000","last_change":"2024-04-25T01:39:24.387100+0000","last_active":"2024-04-25T01:39:34.429750+0000","last_peered":"2024-04-25T01:39:34.429750+0000","last_clean":"2024-04-25T01:39:34.429750+0000","last_became_active":"2024-04-25T01:39:24.386782+0000","last_became_peered":"2024-04-25T01:39:24.386782+0000","last_unstale":"2024-04-25T01:39:34.429750+0000","last_undegraded":"2024-04-25T01:39:34.429750+0000","last_fullsized":"2024-04-25T01:39:34.429750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:48.789139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198800+0000","last_change":"2024-04-25T01:39:23.368446+0000","last_active":"2024-04-25T01:39:35.198800+0000","last_peered":"2024-04-25T01:39:35.198800+0000","last_clean":"2024-04-25T01:39:35.198800+0000","last_became_active":"2024-04-25T01:39:23.368183+0000","last_became_peered":"2024-04-25T01:39:23.368183+0000","last_unstale":"2024-04-25T01:39:35.198800+0000","last_undegraded":"2024-04-25T01:39:35.198800+0000","last_fullsized":"2024-04-25T01:39:35.198800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:13.738756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198383+0000","last_change":"2024-04-25T01:39:32.427589+0000","last_active":"2024-04-25T01:39:35.198383+0000","last_peered":"2024-04-25T01:39:35.198383+0000","last_clean":"2024-04-25T01:39:35.198383+0000","last_became_active":"2024-04-25T01:39:32.427328+0000","last_became_peered":"2024-04-25T01:39:32.427328+0000","last_unstale":"2024-04-25T01:39:35.198383+0000","last_undegraded":"2024-04-25T01:39:35.198383+0000","last_fullsized":"2024-04-25T01:39:35.198383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:12.328303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199145+0000","last_change":"2024-04-25T01:39:33.447634+0000","last_active":"2024-04-25T01:39:35.199145+0000","last_peered":"2024-04-25T01:39:35.199145+0000","last_clean":"2024-04-25T01:39:35.199145+0000","last_became_active":"2024-04-25T01:39:33.445908+0000","last_became_peered":"2024-04-25T01:39:33.445908+0000","last_unstale":"2024-04-25T01:39:35.199145+0000","last_undegraded":"2024-04-25T01:39:35.199145+0000","last_fullsized":"2024-04-25T01:39:35.199145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:13.586396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429559+0000","last_change":"2024-04-25T01:39:24.373600+0000","last_active":"2024-04-25T01:39:34.429559+0000","last_peered":"2024-04-25T01:39:34.429559+0000","last_clean":"2024-04-25T01:39:34.429559+0000","last_became_active":"2024-04-25T01:39:24.373311+0000","last_became_peered":"2024-04-25T01:39:24.373311+0000","last_unstale":"2024-04-25T01:39:34.429559+0000","last_undegraded":"2024-04-25T01:39:34.429559+0000","last_fullsized":"2024-04-25T01:39:34.429559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:46.338959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197953+0000","last_change":"2024-04-25T01:39:23.377103+0000","last_active":"2024-04-25T01:39:35.197953+0000","last_peered":"2024-04-25T01:39:35.197953+0000","last_clean":"2024-04-25T01:39:35.197953+0000","last_became_active":"2024-04-25T01:39:23.376826+0000","last_became_peered":"2024-04-25T01:39:23.376826+0000","last_unstale":"2024-04-25T01:39:35.197953+0000","last_undegraded":"2024-04-25T01:39:35.197953+0000","last_fullsized":"2024-04-25T01:39:35.197953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:46.663754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198643+0000","last_change":"2024-04-25T01:39:32.426839+0000","last_active":"2024-04-25T01:39:35.198643+0000","last_peered":"2024-04-25T01:39:35.198643+0000","last_clean":"2024-04-25T01:39:35.198643+0000","last_became_active":"2024-04-25T01:39:32.426545+0000","last_became_peered":"2024-04-25T01:39:32.426545+0000","last_unstale":"2024-04-25T01:39:35.198643+0000","last_undegraded":"2024-04-25T01:39:35.198643+0000","last_fullsized":"2024-04-25T01:39:35.198643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:22.161839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199023+0000","last_change":"2024-04-25T01:39:33.444616+0000","last_active":"2024-04-25T01:39:35.199023+0000","last_peered":"2024-04-25T01:39:35.199023+0000","last_clean":"2024-04-25T01:39:35.199023+0000","last_became_active":"2024-04-25T01:39:33.444350+0000","last_became_peered":"2024-04-25T01:39:33.444350+0000","last_unstale":"2024-04-25T01:39:35.199023+0000","last_undegraded":"2024-04-25T01:39:35.199023+0000","last_fullsized":"2024-04-25T01:39:35.199023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:47:15.686320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198460+0000","last_change":"2024-04-25T01:39:24.386969+0000","last_active":"2024-04-25T01:39:35.198460+0000","last_peered":"2024-04-25T01:39:35.198460+0000","last_clean":"2024-04-25T01:39:35.198460+0000","last_became_active":"2024-04-25T01:39:24.386376+0000","last_became_peered":"2024-04-25T01:39:24.386376+0000","last_unstale":"2024-04-25T01:39:35.198460+0000","last_undegraded":"2024-04-25T01:39:35.198460+0000","last_fullsized":"2024-04-25T01:39:35.198460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:13:31.585462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198150+0000","last_change":"2024-04-25T01:39:23.378993+0000","last_active":"2024-04-25T01:39:35.198150+0000","last_peered":"2024-04-25T01:39:35.198150+0000","last_clean":"2024-04-25T01:39:35.198150+0000","last_became_active":"2024-04-25T01:39:23.376908+0000","last_became_peered":"2024-04-25T01:39:23.376908+0000","last_unstale":"2024-04-25T01:39:35.198150+0000","last_undegraded":"2024-04-25T01:39:35.198150+0000","last_fullsized":"2024-04-25T01:39:35.198150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:13:18.370559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199153+0000","last_change":"2024-04-25T01:39:32.433597+0000","last_active":"2024-04-25T01:39:35.199153+0000","last_peered":"2024-04-25T01:39:35.199153+0000","last_clean":"2024-04-25T01:39:35.199153+0000","last_became_active":"2024-04-25T01:39:32.433307+0000","last_became_peered":"2024-04-25T01:39:32.433307+0000","last_unstale":"2024-04-25T01:39:35.199153+0000","last_undegraded":"2024-04-25T01:39:35.199153+0000","last_fullsized":"2024-04-25T01:39:35.199153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:20.784385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429204+0000","last_change":"2024-04-25T01:39:33.427297+0000","last_active":"2024-04-25T01:39:34.429204+0000","last_peered":"2024-04-25T01:39:34.429204+0000","last_clean":"2024-04-25T01:39:34.429204+0000","last_became_active":"2024-04-25T01:39:33.426132+0000","last_became_peered":"2024-04-25T01:39:33.426132+0000","last_unstale":"2024-04-25T01:39:34.429204+0000","last_undegraded":"2024-04-25T01:39:34.429204+0000","last_fullsized":"2024-04-25T01:39:34.429204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:04.147341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559652+0000","last_change":"2024-04-25T01:39:24.393003+0000","last_active":"2024-04-25T01:39:34.559652+0000","last_peered":"2024-04-25T01:39:34.559652+0000","last_clean":"2024-04-25T01:39:34.559652+0000","last_became_active":"2024-04-25T01:39:24.392209+0000","last_became_peered":"2024-04-25T01:39:24.392209+0000","last_unstale":"2024-04-25T01:39:34.559652+0000","last_undegraded":"2024-04-25T01:39:34.559652+0000","last_fullsized":"2024-04-25T01:39:34.559652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:44:58.432859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434880+0000","last_change":"2024-04-25T01:39:23.379804+0000","last_active":"2024-04-25T01:39:34.434880+0000","last_peered":"2024-04-25T01:39:34.434880+0000","last_clean":"2024-04-25T01:39:34.434880+0000","last_became_active":"2024-04-25T01:39:23.379430+0000","last_became_peered":"2024-04-25T01:39:23.379430+0000","last_unstale":"2024-04-25T01:39:34.434880+0000","last_undegraded":"2024-04-25T01:39:34.434880+0000","last_fullsized":"2024-04-25T01:39:34.434880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:42:23.254767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198196+0000","last_change":"2024-04-25T01:39:32.432763+0000","last_active":"2024-04-25T01:39:35.198196+0000","last_peered":"2024-04-25T01:39:35.198196+0000","last_clean":"2024-04-25T01:39:35.198196+0000","last_became_active":"2024-04-25T01:39:32.432482+0000","last_became_peered":"2024-04-25T01:39:32.432482+0000","last_unstale":"2024-04-25T01:39:35.198196+0000","last_undegraded":"2024-04-25T01:39:35.198196+0000","last_fullsized":"2024-04-25T01:39:35.198196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:04.848726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197990+0000","last_change":"2024-04-25T01:39:33.445800+0000","last_active":"2024-04-25T01:39:35.197990+0000","last_peered":"2024-04-25T01:39:35.197990+0000","last_clean":"2024-04-25T01:39:35.197990+0000","last_became_active":"2024-04-25T01:39:33.445500+0000","last_became_peered":"2024-04-25T01:39:33.445500+0000","last_unstale":"2024-04-25T01:39:35.197990+0000","last_undegraded":"2024-04-25T01:39:35.197990+0000","last_fullsized":"2024-04-25T01:39:35.197990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:06:36.800043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430196+0000","last_change":"2024-04-25T01:39:24.375811+0000","last_active":"2024-04-25T01:39:34.430196+0000","last_peered":"2024-04-25T01:39:34.430196+0000","last_clean":"2024-04-25T01:39:34.430196+0000","last_became_active":"2024-04-25T01:39:24.375603+0000","last_became_peered":"2024-04-25T01:39:24.375603+0000","last_unstale":"2024-04-25T01:39:34.430196+0000","last_undegraded":"2024-04-25T01:39:34.430196+0000","last_fullsized":"2024-04-25T01:39:34.430196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:10:26.247501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198161+0000","last_change":"2024-04-25T01:39:23.377687+0000","last_active":"2024-04-25T01:39:35.198161+0000","last_peered":"2024-04-25T01:39:35.198161+0000","last_clean":"2024-04-25T01:39:35.198161+0000","last_became_active":"2024-04-25T01:39:23.377372+0000","last_became_peered":"2024-04-25T01:39:23.377372+0000","last_unstale":"2024-04-25T01:39:35.198161+0000","last_undegraded":"2024-04-25T01:39:35.198161+0000","last_fullsized":"2024-04-25T01:39:35.198161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:51.983659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429145+0000","last_change":"2024-04-25T01:39:32.430816+0000","last_active":"2024-04-25T01:39:34.429145+0000","last_peered":"2024-04-25T01:39:34.429145+0000","last_clean":"2024-04-25T01:39:34.429145+0000","last_became_active":"2024-04-25T01:39:32.430537+0000","last_became_peered":"2024-04-25T01:39:32.430537+0000","last_unstale":"2024-04-25T01:39:34.429145+0000","last_undegraded":"2024-04-25T01:39:34.429145+0000","last_fullsized":"2024-04-25T01:39:34.429145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:58.939453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434436+0000","last_change":"2024-04-25T01:39:33.440287+0000","last_active":"2024-04-25T01:39:34.434436+0000","last_peered":"2024-04-25T01:39:34.434436+0000","last_clean":"2024-04-25T01:39:34.434436+0000","last_became_active":"2024-04-25T01:39:33.439796+0000","last_became_peered":"2024-04-25T01:39:33.439796+0000","last_unstale":"2024-04-25T01:39:34.434436+0000","last_undegraded":"2024-04-25T01:39:34.434436+0000","last_fullsized":"2024-04-25T01:39:34.434436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:08.515401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198342+0000","last_change":"2024-04-25T01:39:24.376933+0000","last_active":"2024-04-25T01:39:35.198342+0000","last_peered":"2024-04-25T01:39:35.198342+0000","last_clean":"2024-04-25T01:39:35.198342+0000","last_became_active":"2024-04-25T01:39:24.376612+0000","last_became_peered":"2024-04-25T01:39:24.376612+0000","last_unstale":"2024-04-25T01:39:35.198342+0000","last_undegraded":"2024-04-25T01:39:35.198342+0000","last_fullsized":"2024-04-25T01:39:35.198342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:56:55.534200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199969+0000","last_change":"2024-04-25T01:39:23.378190+0000","last_active":"2024-04-25T01:39:35.199969+0000","last_peered":"2024-04-25T01:39:35.199969+0000","last_clean":"2024-04-25T01:39:35.199969+0000","last_became_active":"2024-04-25T01:39:23.377677+0000","last_became_peered":"2024-04-25T01:39:23.377677+0000","last_unstale":"2024-04-25T01:39:35.199969+0000","last_undegraded":"2024-04-25T01:39:35.199969+0000","last_fullsized":"2024-04-25T01:39:35.199969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:09.516058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559452+0000","last_change":"2024-04-25T01:39:32.431542+0000","last_active":"2024-04-25T01:39:34.559452+0000","last_peered":"2024-04-25T01:39:34.559452+0000","last_clean":"2024-04-25T01:39:34.559452+0000","last_became_active":"2024-04-25T01:39:32.431253+0000","last_became_peered":"2024-04-25T01:39:32.431253+0000","last_unstale":"2024-04-25T01:39:34.559452+0000","last_undegraded":"2024-04-25T01:39:34.559452+0000","last_fullsized":"2024-04-25T01:39:34.559452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:36.723239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559765+0000","last_change":"2024-04-25T01:39:33.448529+0000","last_active":"2024-04-25T01:39:34.559765+0000","last_peered":"2024-04-25T01:39:34.559765+0000","last_clean":"2024-04-25T01:39:34.559765+0000","last_became_active":"2024-04-25T01:39:33.448266+0000","last_became_peered":"2024-04-25T01:39:33.448266+0000","last_unstale":"2024-04-25T01:39:34.559765+0000","last_undegraded":"2024-04-25T01:39:34.559765+0000","last_fullsized":"2024-04-25T01:39:34.559765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:18.788470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200112+0000","last_change":"2024-04-25T01:39:24.390844+0000","last_active":"2024-04-25T01:39:35.200112+0000","last_peered":"2024-04-25T01:39:35.200112+0000","last_clean":"2024-04-25T01:39:35.200112+0000","last_became_active":"2024-04-25T01:39:24.390543+0000","last_became_peered":"2024-04-25T01:39:24.390543+0000","last_unstale":"2024-04-25T01:39:35.200112+0000","last_undegraded":"2024-04-25T01:39:35.200112+0000","last_fullsized":"2024-04-25T01:39:35.200112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:01:03.804058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198467+0000","last_change":"2024-04-25T01:39:23.368562+0000","last_active":"2024-04-25T01:39:35.198467+0000","last_peered":"2024-04-25T01:39:35.198467+0000","last_clean":"2024-04-25T01:39:35.198467+0000","last_became_active":"2024-04-25T01:39:23.368272+0000","last_became_peered":"2024-04-25T01:39:23.368272+0000","last_unstale":"2024-04-25T01:39:35.198467+0000","last_undegraded":"2024-04-25T01:39:35.198467+0000","last_fullsized":"2024-04-25T01:39:35.198467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:15.464993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198483+0000","last_change":"2024-04-25T01:39:32.430196+0000","last_active":"2024-04-25T01:39:35.198483+0000","last_peered":"2024-04-25T01:39:35.198483+0000","last_clean":"2024-04-25T01:39:35.198483+0000","last_became_active":"2024-04-25T01:39:32.429759+0000","last_became_peered":"2024-04-25T01:39:32.429759+0000","last_unstale":"2024-04-25T01:39:35.198483+0000","last_undegraded":"2024-04-25T01:39:35.198483+0000","last_fullsized":"2024-04-25T01:39:35.198483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:58:09.299194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559415+0000","last_change":"2024-04-25T01:39:33.440935+0000","last_active":"2024-04-25T01:39:34.559415+0000","last_peered":"2024-04-25T01:39:34.559415+0000","last_clean":"2024-04-25T01:39:34.559415+0000","last_became_active":"2024-04-25T01:39:33.439344+0000","last_became_peered":"2024-04-25T01:39:33.439344+0000","last_unstale":"2024-04-25T01:39:34.559415+0000","last_undegraded":"2024-04-25T01:39:34.559415+0000","last_fullsized":"2024-04-25T01:39:34.559415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:23.928991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199059+0000","last_change":"2024-04-25T01:39:24.389203+0000","last_active":"2024-04-25T01:39:35.199059+0000","last_peered":"2024-04-25T01:39:35.199059+0000","last_clean":"2024-04-25T01:39:35.199059+0000","last_became_active":"2024-04-25T01:39:24.388306+0000","last_became_peered":"2024-04-25T01:39:24.388306+0000","last_unstale":"2024-04-25T01:39:35.199059+0000","last_undegraded":"2024-04-25T01:39:35.199059+0000","last_fullsized":"2024-04-25T01:39:35.199059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:59:33.951161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198256+0000","last_change":"2024-04-25T01:39:23.375729+0000","last_active":"2024-04-25T01:39:35.198256+0000","last_peered":"2024-04-25T01:39:35.198256+0000","last_clean":"2024-04-25T01:39:35.198256+0000","last_became_active":"2024-04-25T01:39:23.375488+0000","last_became_peered":"2024-04-25T01:39:23.375488+0000","last_unstale":"2024-04-25T01:39:35.198256+0000","last_undegraded":"2024-04-25T01:39:35.198256+0000","last_fullsized":"2024-04-25T01:39:35.198256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:00.039083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198302+0000","last_change":"2024-04-25T01:39:32.427586+0000","last_active":"2024-04-25T01:39:35.198302+0000","last_peered":"2024-04-25T01:39:35.198302+0000","last_clean":"2024-04-25T01:39:35.198302+0000","last_became_active":"2024-04-25T01:39:32.427282+0000","last_became_peered":"2024-04-25T01:39:32.427282+0000","last_unstale":"2024-04-25T01:39:35.198302+0000","last_undegraded":"2024-04-25T01:39:35.198302+0000","last_fullsized":"2024-04-25T01:39:35.198302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:35.956279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197828+0000","last_change":"2024-04-25T01:39:33.438949+0000","last_active":"2024-04-25T01:39:35.197828+0000","last_peered":"2024-04-25T01:39:35.197828+0000","last_clean":"2024-04-25T01:39:35.197828+0000","last_became_active":"2024-04-25T01:39:33.438669+0000","last_became_peered":"2024-04-25T01:39:33.438669+0000","last_unstale":"2024-04-25T01:39:35.197828+0000","last_undegraded":"2024-04-25T01:39:35.197828+0000","last_fullsized":"2024-04-25T01:39:35.197828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:07.849060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197529+0000","last_change":"2024-04-25T01:39:24.377438+0000","last_active":"2024-04-25T01:39:35.197529+0000","last_peered":"2024-04-25T01:39:35.197529+0000","last_clean":"2024-04-25T01:39:35.197529+0000","last_became_active":"2024-04-25T01:39:24.377146+0000","last_became_peered":"2024-04-25T01:39:24.377146+0000","last_unstale":"2024-04-25T01:39:35.197529+0000","last_undegraded":"2024-04-25T01:39:35.197529+0000","last_fullsized":"2024-04-25T01:39:35.197529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:54:17.698561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198084+0000","last_change":"2024-04-25T01:39:23.371019+0000","last_active":"2024-04-25T01:39:35.198084+0000","last_peered":"2024-04-25T01:39:35.198084+0000","last_clean":"2024-04-25T01:39:35.198084+0000","last_became_active":"2024-04-25T01:39:23.370727+0000","last_became_peered":"2024-04-25T01:39:23.370727+0000","last_unstale":"2024-04-25T01:39:35.198084+0000","last_undegraded":"2024-04-25T01:39:35.198084+0000","last_fullsized":"2024-04-25T01:39:35.198084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:10.714475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198753+0000","last_change":"2024-04-25T01:39:32.431610+0000","last_active":"2024-04-25T01:39:35.198753+0000","last_peered":"2024-04-25T01:39:35.198753+0000","last_clean":"2024-04-25T01:39:35.198753+0000","last_became_active":"2024-04-25T01:39:32.431335+0000","last_became_peered":"2024-04-25T01:39:32.431335+0000","last_unstale":"2024-04-25T01:39:35.198753+0000","last_undegraded":"2024-04-25T01:39:35.198753+0000","last_fullsized":"2024-04-25T01:39:35.198753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:54.882078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199183+0000","last_change":"2024-04-25T01:39:33.438896+0000","last_active":"2024-04-25T01:39:35.199183+0000","last_peered":"2024-04-25T01:39:35.199183+0000","last_clean":"2024-04-25T01:39:35.199183+0000","last_became_active":"2024-04-25T01:39:33.438622+0000","last_became_peered":"2024-04-25T01:39:33.438622+0000","last_unstale":"2024-04-25T01:39:35.199183+0000","last_undegraded":"2024-04-25T01:39:35.199183+0000","last_fullsized":"2024-04-25T01:39:35.199183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:40:47.408809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559149+0000","last_change":"2024-04-25T01:39:24.391366+0000","last_active":"2024-04-25T01:39:34.559149+0000","last_peered":"2024-04-25T01:39:34.559149+0000","last_clean":"2024-04-25T01:39:34.559149+0000","last_became_active":"2024-04-25T01:39:24.391093+0000","last_became_peered":"2024-04-25T01:39:24.391093+0000","last_unstale":"2024-04-25T01:39:34.559149+0000","last_undegraded":"2024-04-25T01:39:34.559149+0000","last_fullsized":"2024-04-25T01:39:34.559149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:10.906935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198243+0000","last_change":"2024-04-25T01:39:23.379767+0000","last_active":"2024-04-25T01:39:35.198243+0000","last_peered":"2024-04-25T01:39:35.198243+0000","last_clean":"2024-04-25T01:39:35.198243+0000","last_became_active":"2024-04-25T01:39:23.379294+0000","last_became_peered":"2024-04-25T01:39:23.379294+0000","last_unstale":"2024-04-25T01:39:35.198243+0000","last_undegraded":"2024-04-25T01:39:35.198243+0000","last_fullsized":"2024-04-25T01:39:35.198243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:36:37.823796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559671+0000","last_change":"2024-04-25T01:39:32.429452+0000","last_active":"2024-04-25T01:39:34.559671+0000","last_peered":"2024-04-25T01:39:34.559671+0000","last_clean":"2024-04-25T01:39:34.559671+0000","last_became_active":"2024-04-25T01:39:32.429189+0000","last_became_peered":"2024-04-25T01:39:32.429189+0000","last_unstale":"2024-04-25T01:39:34.559671+0000","last_undegraded":"2024-04-25T01:39:34.559671+0000","last_fullsized":"2024-04-25T01:39:34.559671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:58:02.723851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198704+0000","last_change":"2024-04-25T01:39:33.438945+0000","last_active":"2024-04-25T01:39:35.198704+0000","last_peered":"2024-04-25T01:39:35.198704+0000","last_clean":"2024-04-25T01:39:35.198704+0000","last_became_active":"2024-04-25T01:39:33.438233+0000","last_became_peered":"2024-04-25T01:39:33.438233+0000","last_unstale":"2024-04-25T01:39:35.198704+0000","last_undegraded":"2024-04-25T01:39:35.198704+0000","last_fullsized":"2024-04-25T01:39:35.198704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:50.545311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429728+0000","last_change":"2024-04-25T01:39:24.401208+0000","last_active":"2024-04-25T01:39:34.429728+0000","last_peered":"2024-04-25T01:39:34.429728+0000","last_clean":"2024-04-25T01:39:34.429728+0000","last_became_active":"2024-04-25T01:39:24.400502+0000","last_became_peered":"2024-04-25T01:39:24.400502+0000","last_unstale":"2024-04-25T01:39:34.429728+0000","last_undegraded":"2024-04-25T01:39:34.429728+0000","last_fullsized":"2024-04-25T01:39:34.429728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:55:09.076617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198391+0000","last_change":"2024-04-25T01:39:23.367826+0000","last_active":"2024-04-25T01:39:35.198391+0000","last_peered":"2024-04-25T01:39:35.198391+0000","last_clean":"2024-04-25T01:39:35.198391+0000","last_became_active":"2024-04-25T01:39:23.367520+0000","last_became_peered":"2024-04-25T01:39:23.367520+0000","last_unstale":"2024-04-25T01:39:35.198391+0000","last_undegraded":"2024-04-25T01:39:35.198391+0000","last_fullsized":"2024-04-25T01:39:35.198391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:05.997166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199929+0000","last_change":"2024-04-25T01:39:12.918495+0000","last_active":"2024-04-25T01:39:35.199929+0000","last_peered":"2024-04-25T01:39:35.199929+0000","last_clean":"2024-04-25T01:39:35.199929+0000","last_became_active":"2024-04-25T01:39:12.917330+0000","last_became_peered":"2024-04-25T01:39:12.917330+0000","last_unstale":"2024-04-25T01:39:35.199929+0000","last_undegraded":"2024-04-25T01:39:35.199929+0000","last_fullsized":"2024-04-25T01:39:35.199929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:11.731178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:11.731178+0000","last_clean_scrub_stamp":"2024-04-25T01:39:11.731178+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:26:14.153244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434088+0000","last_change":"2024-04-25T01:39:32.431797+0000","last_active":"2024-04-25T01:39:34.434088+0000","last_peered":"2024-04-25T01:39:34.434088+0000","last_clean":"2024-04-25T01:39:34.434088+0000","last_became_active":"2024-04-25T01:39:32.431523+0000","last_became_peered":"2024-04-25T01:39:32.431523+0000","last_unstale":"2024-04-25T01:39:34.434088+0000","last_undegraded":"2024-04-25T01:39:34.434088+0000","last_fullsized":"2024-04-25T01:39:34.434088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:45.752128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198056+0000","last_change":"2024-04-25T01:39:33.440488+0000","last_active":"2024-04-25T01:39:35.198056+0000","last_peered":"2024-04-25T01:39:35.198056+0000","last_clean":"2024-04-25T01:39:35.198056+0000","last_became_active":"2024-04-25T01:39:33.440161+0000","last_became_peered":"2024-04-25T01:39:33.440161+0000","last_unstale":"2024-04-25T01:39:35.198056+0000","last_undegraded":"2024-04-25T01:39:35.198056+0000","last_fullsized":"2024-04-25T01:39:35.198056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:45.542876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199802+0000","last_change":"2024-04-25T01:39:24.394350+0000","last_active":"2024-04-25T01:39:35.199802+0000","last_peered":"2024-04-25T01:39:35.199802+0000","last_clean":"2024-04-25T01:39:35.199802+0000","last_became_active":"2024-04-25T01:39:24.393235+0000","last_became_peered":"2024-04-25T01:39:24.393235+0000","last_unstale":"2024-04-25T01:39:35.199802+0000","last_undegraded":"2024-04-25T01:39:35.199802+0000","last_fullsized":"2024-04-25T01:39:35.199802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:00:48.588700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198113+0000","last_change":"2024-04-25T01:39:23.368352+0000","last_active":"2024-04-25T01:39:35.198113+0000","last_peered":"2024-04-25T01:39:35.198113+0000","last_clean":"2024-04-25T01:39:35.198113+0000","last_became_active":"2024-04-25T01:39:23.368075+0000","last_became_peered":"2024-04-25T01:39:23.368075+0000","last_unstale":"2024-04-25T01:39:35.198113+0000","last_undegraded":"2024-04-25T01:39:35.198113+0000","last_fullsized":"2024-04-25T01:39:35.198113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:11.300091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434486+0000","last_change":"2024-04-25T01:39:32.430007+0000","last_active":"2024-04-25T01:39:34.434486+0000","last_peered":"2024-04-25T01:39:34.434486+0000","last_clean":"2024-04-25T01:39:34.434486+0000","last_became_active":"2024-04-25T01:39:32.429721+0000","last_became_peered":"2024-04-25T01:39:32.429721+0000","last_unstale":"2024-04-25T01:39:34.434486+0000","last_undegraded":"2024-04-25T01:39:34.434486+0000","last_fullsized":"2024-04-25T01:39:34.434486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:47.409375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197603+0000","last_change":"2024-04-25T01:39:33.447230+0000","last_active":"2024-04-25T01:39:35.197603+0000","last_peered":"2024-04-25T01:39:35.197603+0000","last_clean":"2024-04-25T01:39:35.197603+0000","last_became_active":"2024-04-25T01:39:33.446930+0000","last_became_peered":"2024-04-25T01:39:33.446930+0000","last_unstale":"2024-04-25T01:39:35.197603+0000","last_undegraded":"2024-04-25T01:39:35.197603+0000","last_fullsized":"2024-04-25T01:39:35.197603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:51:40.920560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199534+0000","last_change":"2024-04-25T01:39:24.394286+0000","last_active":"2024-04-25T01:39:35.199534+0000","last_peered":"2024-04-25T01:39:35.199534+0000","last_clean":"2024-04-25T01:39:35.199534+0000","last_became_active":"2024-04-25T01:39:24.393558+0000","last_became_peered":"2024-04-25T01:39:24.393558+0000","last_unstale":"2024-04-25T01:39:35.199534+0000","last_undegraded":"2024-04-25T01:39:35.199534+0000","last_fullsized":"2024-04-25T01:39:35.199534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:59.100947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198699+0000","last_change":"2024-04-25T01:39:23.370690+0000","last_active":"2024-04-25T01:39:35.198699+0000","last_peered":"2024-04-25T01:39:35.198699+0000","last_clean":"2024-04-25T01:39:35.198699+0000","last_became_active":"2024-04-25T01:39:23.370391+0000","last_became_peered":"2024-04-25T01:39:23.370391+0000","last_unstale":"2024-04-25T01:39:35.198699+0000","last_undegraded":"2024-04-25T01:39:35.198699+0000","last_fullsized":"2024-04-25T01:39:35.198699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:29.647636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559440+0000","last_change":"2024-04-25T01:39:32.429412+0000","last_active":"2024-04-25T01:39:34.559440+0000","last_peered":"2024-04-25T01:39:34.559440+0000","last_clean":"2024-04-25T01:39:34.559440+0000","last_became_active":"2024-04-25T01:39:32.429143+0000","last_became_peered":"2024-04-25T01:39:32.429143+0000","last_unstale":"2024-04-25T01:39:34.559440+0000","last_undegraded":"2024-04-25T01:39:34.559440+0000","last_fullsized":"2024-04-25T01:39:34.559440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:53.637245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198532+0000","last_change":"2024-04-25T01:39:33.437128+0000","last_active":"2024-04-25T01:39:35.198532+0000","last_peered":"2024-04-25T01:39:35.198532+0000","last_clean":"2024-04-25T01:39:35.198532+0000","last_became_active":"2024-04-25T01:39:33.436861+0000","last_became_peered":"2024-04-25T01:39:33.436861+0000","last_unstale":"2024-04-25T01:39:35.198532+0000","last_undegraded":"2024-04-25T01:39:35.198532+0000","last_fullsized":"2024-04-25T01:39:35.198532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:41.746373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200378+0000","last_change":"2024-04-25T01:39:24.392170+0000","last_active":"2024-04-25T01:39:35.200378+0000","last_peered":"2024-04-25T01:39:35.200378+0000","last_clean":"2024-04-25T01:39:35.200378+0000","last_became_active":"2024-04-25T01:39:24.391811+0000","last_became_peered":"2024-04-25T01:39:24.391811+0000","last_unstale":"2024-04-25T01:39:35.200378+0000","last_undegraded":"2024-04-25T01:39:35.200378+0000","last_fullsized":"2024-04-25T01:39:35.200378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:32.859676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197996+0000","last_change":"2024-04-25T01:39:23.369872+0000","last_active":"2024-04-25T01:39:35.197996+0000","last_peered":"2024-04-25T01:39:35.197996+0000","last_clean":"2024-04-25T01:39:35.197996+0000","last_became_active":"2024-04-25T01:39:23.369314+0000","last_became_peered":"2024-04-25T01:39:23.369314+0000","last_unstale":"2024-04-25T01:39:35.197996+0000","last_undegraded":"2024-04-25T01:39:35.197996+0000","last_fullsized":"2024-04-25T01:39:35.197996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:14.571148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197245+0000","last_change":"2024-04-25T01:39:32.429664+0000","last_active":"2024-04-25T01:39:35.197245+0000","last_peered":"2024-04-25T01:39:35.197245+0000","last_clean":"2024-04-25T01:39:35.197245+0000","last_became_active":"2024-04-25T01:39:32.429358+0000","last_became_peered":"2024-04-25T01:39:32.429358+0000","last_unstale":"2024-04-25T01:39:35.197245+0000","last_undegraded":"2024-04-25T01:39:35.197245+0000","last_fullsized":"2024-04-25T01:39:35.197245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:57:10.913056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197472+0000","last_change":"2024-04-25T01:39:33.440419+0000","last_active":"2024-04-25T01:39:35.197472+0000","last_peered":"2024-04-25T01:39:35.197472+0000","last_clean":"2024-04-25T01:39:35.197472+0000","last_became_active":"2024-04-25T01:39:33.440054+0000","last_became_peered":"2024-04-25T01:39:33.440054+0000","last_unstale":"2024-04-25T01:39:35.197472+0000","last_undegraded":"2024-04-25T01:39:35.197472+0000","last_fullsized":"2024-04-25T01:39:35.197472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:42.321235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199726+0000","last_change":"2024-04-25T01:39:24.391240+0000","last_active":"2024-04-25T01:39:35.199726+0000","last_peered":"2024-04-25T01:39:35.199726+0000","last_clean":"2024-04-25T01:39:35.199726+0000","last_became_active":"2024-04-25T01:39:24.390948+0000","last_became_peered":"2024-04-25T01:39:24.390948+0000","last_unstale":"2024-04-25T01:39:35.199726+0000","last_undegraded":"2024-04-25T01:39:35.199726+0000","last_fullsized":"2024-04-25T01:39:35.199726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:41:30.579190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198161+0000","last_change":"2024-04-25T01:39:23.367322+0000","last_active":"2024-04-25T01:39:35.198161+0000","last_peered":"2024-04-25T01:39:35.198161+0000","last_clean":"2024-04-25T01:39:35.198161+0000","last_became_active":"2024-04-25T01:39:23.367054+0000","last_became_peered":"2024-04-25T01:39:23.367054+0000","last_unstale":"2024-04-25T01:39:35.198161+0000","last_undegraded":"2024-04-25T01:39:35.198161+0000","last_fullsized":"2024-04-25T01:39:35.198161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:10.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197919+0000","last_change":"2024-04-25T01:39:32.426874+0000","last_active":"2024-04-25T01:39:35.197919+0000","last_peered":"2024-04-25T01:39:35.197919+0000","last_clean":"2024-04-25T01:39:35.197919+0000","last_became_active":"2024-04-25T01:39:32.426599+0000","last_became_peered":"2024-04-25T01:39:32.426599+0000","last_unstale":"2024-04-25T01:39:35.197919+0000","last_undegraded":"2024-04-25T01:39:35.197919+0000","last_fullsized":"2024-04-25T01:39:35.197919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:27.672277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430134+0000","last_change":"2024-04-25T01:39:33.428909+0000","last_active":"2024-04-25T01:39:34.430134+0000","last_peered":"2024-04-25T01:39:34.430134+0000","last_clean":"2024-04-25T01:39:34.430134+0000","last_became_active":"2024-04-25T01:39:33.428626+0000","last_became_peered":"2024-04-25T01:39:33.428626+0000","last_unstale":"2024-04-25T01:39:34.430134+0000","last_undegraded":"2024-04-25T01:39:34.430134+0000","last_fullsized":"2024-04-25T01:39:34.430134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:21.188264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199068+0000","last_change":"2024-04-25T01:39:24.389946+0000","last_active":"2024-04-25T01:39:35.199068+0000","last_peered":"2024-04-25T01:39:35.199068+0000","last_clean":"2024-04-25T01:39:35.199068+0000","last_became_active":"2024-04-25T01:39:24.389656+0000","last_became_peered":"2024-04-25T01:39:24.389656+0000","last_unstale":"2024-04-25T01:39:35.199068+0000","last_undegraded":"2024-04-25T01:39:35.199068+0000","last_fullsized":"2024-04-25T01:39:35.199068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:55.943639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197475+0000","last_change":"2024-04-25T01:39:23.373599+0000","last_active":"2024-04-25T01:39:35.197475+0000","last_peered":"2024-04-25T01:39:35.197475+0000","last_clean":"2024-04-25T01:39:35.197475+0000","last_became_active":"2024-04-25T01:39:23.373281+0000","last_became_peered":"2024-04-25T01:39:23.373281+0000","last_unstale":"2024-04-25T01:39:35.197475+0000","last_undegraded":"2024-04-25T01:39:35.197475+0000","last_fullsized":"2024-04-25T01:39:35.197475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:40.850925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559604+0000","last_change":"2024-04-25T01:39:32.427502+0000","last_active":"2024-04-25T01:39:34.559604+0000","last_peered":"2024-04-25T01:39:34.559604+0000","last_clean":"2024-04-25T01:39:34.559604+0000","last_became_active":"2024-04-25T01:39:32.426499+0000","last_became_peered":"2024-04-25T01:39:32.426499+0000","last_unstale":"2024-04-25T01:39:34.559604+0000","last_undegraded":"2024-04-25T01:39:34.559604+0000","last_fullsized":"2024-04-25T01:39:34.559604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:26.977416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198695+0000","last_change":"2024-04-25T01:39:33.436901+0000","last_active":"2024-04-25T01:39:35.198695+0000","last_peered":"2024-04-25T01:39:35.198695+0000","last_clean":"2024-04-25T01:39:35.198695+0000","last_became_active":"2024-04-25T01:39:33.436001+0000","last_became_peered":"2024-04-25T01:39:33.436001+0000","last_unstale":"2024-04-25T01:39:35.198695+0000","last_undegraded":"2024-04-25T01:39:35.198695+0000","last_fullsized":"2024-04-25T01:39:35.198695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:34:41.678663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.433897+0000","last_change":"2024-04-25T01:39:24.394248+0000","last_active":"2024-04-25T01:39:34.433897+0000","last_peered":"2024-04-25T01:39:34.433897+0000","last_clean":"2024-04-25T01:39:34.433897+0000","last_became_active":"2024-04-25T01:39:24.393958+0000","last_became_peered":"2024-04-25T01:39:24.393958+0000","last_unstale":"2024-04-25T01:39:34.433897+0000","last_undegraded":"2024-04-25T01:39:34.433897+0000","last_fullsized":"2024-04-25T01:39:34.433897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:35.087577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434426+0000","last_change":"2024-04-25T01:39:23.372939+0000","last_active":"2024-04-25T01:39:34.434426+0000","last_peered":"2024-04-25T01:39:34.434426+0000","last_clean":"2024-04-25T01:39:34.434426+0000","last_became_active":"2024-04-25T01:39:23.372648+0000","last_became_peered":"2024-04-25T01:39:23.372648+0000","last_unstale":"2024-04-25T01:39:34.434426+0000","last_undegraded":"2024-04-25T01:39:34.434426+0000","last_fullsized":"2024-04-25T01:39:34.434426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:02:13.283096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430096+0000","last_change":"2024-04-25T01:39:32.432218+0000","last_active":"2024-04-25T01:39:34.430096+0000","last_peered":"2024-04-25T01:39:34.430096+0000","last_clean":"2024-04-25T01:39:34.430096+0000","last_became_active":"2024-04-25T01:39:32.431938+0000","last_became_peered":"2024-04-25T01:39:32.431938+0000","last_unstale":"2024-04-25T01:39:34.430096+0000","last_undegraded":"2024-04-25T01:39:34.430096+0000","last_fullsized":"2024-04-25T01:39:34.430096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:56:15.053817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199747+0000","last_change":"2024-04-25T01:39:33.441342+0000","last_active":"2024-04-25T01:39:35.199747+0000","last_peered":"2024-04-25T01:39:35.199747+0000","last_clean":"2024-04-25T01:39:35.199747+0000","last_became_active":"2024-04-25T01:39:33.441074+0000","last_became_peered":"2024-04-25T01:39:33.441074+0000","last_unstale":"2024-04-25T01:39:35.199747+0000","last_undegraded":"2024-04-25T01:39:35.199747+0000","last_fullsized":"2024-04-25T01:39:35.199747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:22:43.000112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199029+0000","last_change":"2024-04-25T01:39:24.390114+0000","last_active":"2024-04-25T01:39:35.199029+0000","last_peered":"2024-04-25T01:39:35.199029+0000","last_clean":"2024-04-25T01:39:35.199029+0000","last_became_active":"2024-04-25T01:39:24.389841+0000","last_became_peered":"2024-04-25T01:39:24.389841+0000","last_unstale":"2024-04-25T01:39:35.199029+0000","last_undegraded":"2024-04-25T01:39:35.199029+0000","last_fullsized":"2024-04-25T01:39:35.199029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:34.950624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198167+0000","last_change":"2024-04-25T01:39:23.369440+0000","last_active":"2024-04-25T01:39:35.198167+0000","last_peered":"2024-04-25T01:39:35.198167+0000","last_clean":"2024-04-25T01:39:35.198167+0000","last_became_active":"2024-04-25T01:39:23.369151+0000","last_became_peered":"2024-04-25T01:39:23.369151+0000","last_unstale":"2024-04-25T01:39:35.198167+0000","last_undegraded":"2024-04-25T01:39:35.198167+0000","last_fullsized":"2024-04-25T01:39:35.198167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:31:46.921287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"23'6","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429666+0000","last_change":"2024-04-25T01:39:32.430701+0000","last_active":"2024-04-25T01:39:34.429666+0000","last_peered":"2024-04-25T01:39:34.429666+0000","last_clean":"2024-04-25T01:39:34.429666+0000","last_became_active":"2024-04-25T01:39:32.430187+0000","last_became_peered":"2024-04-25T01:39:32.430187+0000","last_unstale":"2024-04-25T01:39:34.429666+0000","last_undegraded":"2024-04-25T01:39:34.429666+0000","last_fullsized":"2024-04-25T01:39:34.429666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:57.148375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429767+0000","last_change":"2024-04-25T01:39:33.427429+0000","last_active":"2024-04-25T01:39:34.429767+0000","last_peered":"2024-04-25T01:39:34.429767+0000","last_clean":"2024-04-25T01:39:34.429767+0000","last_became_active":"2024-04-25T01:39:33.427164+0000","last_became_peered":"2024-04-25T01:39:33.427164+0000","last_unstale":"2024-04-25T01:39:34.429767+0000","last_undegraded":"2024-04-25T01:39:34.429767+0000","last_fullsized":"2024-04-25T01:39:34.429767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:33:59.664252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559246+0000","last_change":"2024-04-25T01:39:24.388852+0000","last_active":"2024-04-25T01:39:34.559246+0000","last_peered":"2024-04-25T01:39:34.559246+0000","last_clean":"2024-04-25T01:39:34.559246+0000","last_became_active":"2024-04-25T01:39:24.388594+0000","last_became_peered":"2024-04-25T01:39:24.388594+0000","last_unstale":"2024-04-25T01:39:34.559246+0000","last_undegraded":"2024-04-25T01:39:34.559246+0000","last_fullsized":"2024-04-25T01:39:34.559246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:46:49.718182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559847+0000","last_change":"2024-04-25T01:39:23.372903+0000","last_active":"2024-04-25T01:39:34.559847+0000","last_peered":"2024-04-25T01:39:34.559847+0000","last_clean":"2024-04-25T01:39:34.559847+0000","last_became_active":"2024-04-25T01:39:23.372617+0000","last_became_peered":"2024-04-25T01:39:23.372617+0000","last_unstale":"2024-04-25T01:39:34.559847+0000","last_undegraded":"2024-04-25T01:39:34.559847+0000","last_fullsized":"2024-04-25T01:39:34.559847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:54:58.506432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199994+0000","last_change":"2024-04-25T01:39:32.430218+0000","last_active":"2024-04-25T01:39:35.199994+0000","last_peered":"2024-04-25T01:39:35.199994+0000","last_clean":"2024-04-25T01:39:35.199994+0000","last_became_active":"2024-04-25T01:39:32.429900+0000","last_became_peered":"2024-04-25T01:39:32.429900+0000","last_unstale":"2024-04-25T01:39:35.199994+0000","last_undegraded":"2024-04-25T01:39:35.199994+0000","last_fullsized":"2024-04-25T01:39:35.199994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:52.253045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429707+0000","last_change":"2024-04-25T01:39:33.440325+0000","last_active":"2024-04-25T01:39:34.429707+0000","last_peered":"2024-04-25T01:39:34.429707+0000","last_clean":"2024-04-25T01:39:34.429707+0000","last_became_active":"2024-04-25T01:39:33.439961+0000","last_became_peered":"2024-04-25T01:39:33.439961+0000","last_unstale":"2024-04-25T01:39:34.429707+0000","last_undegraded":"2024-04-25T01:39:34.429707+0000","last_fullsized":"2024-04-25T01:39:34.429707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:01.846576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199750+0000","last_change":"2024-04-25T01:39:24.380617+0000","last_active":"2024-04-25T01:39:35.199750+0000","last_peered":"2024-04-25T01:39:35.199750+0000","last_clean":"2024-04-25T01:39:35.199750+0000","last_became_active":"2024-04-25T01:39:24.380330+0000","last_became_peered":"2024-04-25T01:39:24.380330+0000","last_unstale":"2024-04-25T01:39:35.199750+0000","last_undegraded":"2024-04-25T01:39:35.199750+0000","last_fullsized":"2024-04-25T01:39:35.199750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:24.010569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:55.705604+0000","last_change":"2024-04-25T01:39:23.373295+0000","last_active":"2024-04-25T01:39:55.705604+0000","last_peered":"2024-04-25T01:39:55.705604+0000","last_clean":"2024-04-25T01:39:55.705604+0000","last_became_active":"2024-04-25T01:39:23.372984+0000","last_became_peered":"2024-04-25T01:39:23.372984+0000","last_unstale":"2024-04-25T01:39:55.705604+0000","last_undegraded":"2024-04-25T01:39:55.705604+0000","last_fullsized":"2024-04-25T01:39:55.705604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:10.854190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1868,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198248+0000","last_change":"2024-04-25T01:39:32.433589+0000","last_active":"2024-04-25T01:39:35.198248+0000","last_peered":"2024-04-25T01:39:35.198248+0000","last_clean":"2024-04-25T01:39:35.198248+0000","last_became_active":"2024-04-25T01:39:32.433408+0000","last_became_peered":"2024-04-25T01:39:32.433408+0000","last_unstale":"2024-04-25T01:39:35.198248+0000","last_undegraded":"2024-04-25T01:39:35.198248+0000","last_fullsized":"2024-04-25T01:39:35.198248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:25.789951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198708+0000","last_change":"2024-04-25T01:39:33.433449+0000","last_active":"2024-04-25T01:39:35.198708+0000","last_peered":"2024-04-25T01:39:35.198708+0000","last_clean":"2024-04-25T01:39:35.198708+0000","last_became_active":"2024-04-25T01:39:33.432690+0000","last_became_peered":"2024-04-25T01:39:33.432690+0000","last_unstale":"2024-04-25T01:39:35.198708+0000","last_undegraded":"2024-04-25T01:39:35.198708+0000","last_fullsized":"2024-04-25T01:39:35.198708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:30.046453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198838+0000","last_change":"2024-04-25T01:39:24.391245+0000","last_active":"2024-04-25T01:39:35.198838+0000","last_peered":"2024-04-25T01:39:35.198838+0000","last_clean":"2024-04-25T01:39:35.198838+0000","last_became_active":"2024-04-25T01:39:24.390941+0000","last_became_peered":"2024-04-25T01:39:24.390941+0000","last_unstale":"2024-04-25T01:39:35.198838+0000","last_undegraded":"2024-04-25T01:39:35.198838+0000","last_fullsized":"2024-04-25T01:39:35.198838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:55.182405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198689+0000","last_change":"2024-04-25T01:39:23.369043+0000","last_active":"2024-04-25T01:39:35.198689+0000","last_peered":"2024-04-25T01:39:35.198689+0000","last_clean":"2024-04-25T01:39:35.198689+0000","last_became_active":"2024-04-25T01:39:23.368778+0000","last_became_peered":"2024-04-25T01:39:23.368778+0000","last_unstale":"2024-04-25T01:39:35.198689+0000","last_undegraded":"2024-04-25T01:39:35.198689+0000","last_fullsized":"2024-04-25T01:39:35.198689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:59.501724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198230+0000","last_change":"2024-04-25T01:39:32.431530+0000","last_active":"2024-04-25T01:39:35.198230+0000","last_peered":"2024-04-25T01:39:35.198230+0000","last_clean":"2024-04-25T01:39:35.198230+0000","last_became_active":"2024-04-25T01:39:32.431247+0000","last_became_peered":"2024-04-25T01:39:32.431247+0000","last_unstale":"2024-04-25T01:39:35.198230+0000","last_undegraded":"2024-04-25T01:39:35.198230+0000","last_fullsized":"2024-04-25T01:39:35.198230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:46:02.014508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434136+0000","last_change":"2024-04-25T01:39:33.446545+0000","last_active":"2024-04-25T01:39:34.434136+0000","last_peered":"2024-04-25T01:39:34.434136+0000","last_clean":"2024-04-25T01:39:34.434136+0000","last_became_active":"2024-04-25T01:39:33.446263+0000","last_became_peered":"2024-04-25T01:39:33.446263+0000","last_unstale":"2024-04-25T01:39:34.434136+0000","last_undegraded":"2024-04-25T01:39:34.434136+0000","last_fullsized":"2024-04-25T01:39:34.434136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:27.026460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559482+0000","last_change":"2024-04-25T01:39:24.403875+0000","last_active":"2024-04-25T01:39:34.559482+0000","last_peered":"2024-04-25T01:39:34.559482+0000","last_clean":"2024-04-25T01:39:34.559482+0000","last_became_active":"2024-04-25T01:39:24.403591+0000","last_became_peered":"2024-04-25T01:39:24.403591+0000","last_unstale":"2024-04-25T01:39:34.559482+0000","last_undegraded":"2024-04-25T01:39:34.559482+0000","last_fullsized":"2024-04-25T01:39:34.559482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:45.276173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198758+0000","last_change":"2024-04-25T01:39:23.378968+0000","last_active":"2024-04-25T01:39:35.198758+0000","last_peered":"2024-04-25T01:39:35.198758+0000","last_clean":"2024-04-25T01:39:35.198758+0000","last_became_active":"2024-04-25T01:39:23.378635+0000","last_became_peered":"2024-04-25T01:39:23.378635+0000","last_unstale":"2024-04-25T01:39:35.198758+0000","last_undegraded":"2024-04-25T01:39:35.198758+0000","last_fullsized":"2024-04-25T01:39:35.198758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:39.780544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429477+0000","last_change":"2024-04-25T01:39:32.427357+0000","last_active":"2024-04-25T01:39:34.429477+0000","last_peered":"2024-04-25T01:39:34.429477+0000","last_clean":"2024-04-25T01:39:34.429477+0000","last_became_active":"2024-04-25T01:39:32.427105+0000","last_became_peered":"2024-04-25T01:39:32.427105+0000","last_unstale":"2024-04-25T01:39:34.429477+0000","last_undegraded":"2024-04-25T01:39:34.429477+0000","last_fullsized":"2024-04-25T01:39:34.429477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:04.848726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197844+0000","last_change":"2024-04-25T01:39:33.444814+0000","last_active":"2024-04-25T01:39:35.197844+0000","last_peered":"2024-04-25T01:39:35.197844+0000","last_clean":"2024-04-25T01:39:35.197844+0000","last_became_active":"2024-04-25T01:39:33.444489+0000","last_became_peered":"2024-04-25T01:39:33.444489+0000","last_unstale":"2024-04-25T01:39:35.197844+0000","last_undegraded":"2024-04-25T01:39:35.197844+0000","last_fullsized":"2024-04-25T01:39:35.197844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:06.718940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198707+0000","last_change":"2024-04-25T01:39:24.392642+0000","last_active":"2024-04-25T01:39:35.198707+0000","last_peered":"2024-04-25T01:39:35.198707+0000","last_clean":"2024-04-25T01:39:35.198707+0000","last_became_active":"2024-04-25T01:39:24.391605+0000","last_became_peered":"2024-04-25T01:39:24.391605+0000","last_unstale":"2024-04-25T01:39:35.198707+0000","last_undegraded":"2024-04-25T01:39:35.198707+0000","last_fullsized":"2024-04-25T01:39:35.198707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:01:23.217074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434798+0000","last_change":"2024-04-25T01:39:23.377236+0000","last_active":"2024-04-25T01:39:34.434798+0000","last_peered":"2024-04-25T01:39:34.434798+0000","last_clean":"2024-04-25T01:39:34.434798+0000","last_became_active":"2024-04-25T01:39:23.376727+0000","last_became_peered":"2024-04-25T01:39:23.376727+0000","last_unstale":"2024-04-25T01:39:34.434798+0000","last_undegraded":"2024-04-25T01:39:34.434798+0000","last_fullsized":"2024-04-25T01:39:34.434798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:08.103707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429200+0000","last_change":"2024-04-25T01:39:32.424457+0000","last_active":"2024-04-25T01:39:34.429200+0000","last_peered":"2024-04-25T01:39:34.429200+0000","last_clean":"2024-04-25T01:39:34.429200+0000","last_became_active":"2024-04-25T01:39:32.424203+0000","last_became_peered":"2024-04-25T01:39:32.424203+0000","last_unstale":"2024-04-25T01:39:34.429200+0000","last_undegraded":"2024-04-25T01:39:34.429200+0000","last_fullsized":"2024-04-25T01:39:34.429200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:12:20.824070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434672+0000","last_change":"2024-04-25T01:39:33.445948+0000","last_active":"2024-04-25T01:39:34.434672+0000","last_peered":"2024-04-25T01:39:34.434672+0000","last_clean":"2024-04-25T01:39:34.434672+0000","last_became_active":"2024-04-25T01:39:33.445654+0000","last_became_peered":"2024-04-25T01:39:33.445654+0000","last_unstale":"2024-04-25T01:39:34.434672+0000","last_undegraded":"2024-04-25T01:39:34.434672+0000","last_fullsized":"2024-04-25T01:39:34.434672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:51.323909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559508+0000","last_change":"2024-04-25T01:39:32.430484+0000","last_active":"2024-04-25T01:39:34.559508+0000","last_peered":"2024-04-25T01:39:34.559508+0000","last_clean":"2024-04-25T01:39:34.559508+0000","last_became_active":"2024-04-25T01:39:32.430220+0000","last_became_peered":"2024-04-25T01:39:32.430220+0000","last_unstale":"2024-04-25T01:39:34.559508+0000","last_undegraded":"2024-04-25T01:39:34.559508+0000","last_fullsized":"2024-04-25T01:39:34.559508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:36:53.152442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197722+0000","last_change":"2024-04-25T01:39:24.375457+0000","last_active":"2024-04-25T01:39:35.197722+0000","last_peered":"2024-04-25T01:39:35.197722+0000","last_clean":"2024-04-25T01:39:35.197722+0000","last_became_active":"2024-04-25T01:39:24.375178+0000","last_became_peered":"2024-04-25T01:39:24.375178+0000","last_unstale":"2024-04-25T01:39:35.197722+0000","last_undegraded":"2024-04-25T01:39:35.197722+0000","last_fullsized":"2024-04-25T01:39:35.197722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:58:15.640882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197478+0000","last_change":"2024-04-25T01:39:23.369998+0000","last_active":"2024-04-25T01:39:35.197478+0000","last_peered":"2024-04-25T01:39:35.197478+0000","last_clean":"2024-04-25T01:39:35.197478+0000","last_became_active":"2024-04-25T01:39:23.369710+0000","last_became_peered":"2024-04-25T01:39:23.369710+0000","last_unstale":"2024-04-25T01:39:35.197478+0000","last_undegraded":"2024-04-25T01:39:35.197478+0000","last_fullsized":"2024-04-25T01:39:35.197478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:32:34.329452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559536+0000","last_change":"2024-04-25T01:39:33.447666+0000","last_active":"2024-04-25T01:39:34.559536+0000","last_peered":"2024-04-25T01:39:34.559536+0000","last_clean":"2024-04-25T01:39:34.559536+0000","last_became_active":"2024-04-25T01:39:33.447436+0000","last_became_peered":"2024-04-25T01:39:33.447436+0000","last_unstale":"2024-04-25T01:39:34.559536+0000","last_undegraded":"2024-04-25T01:39:34.559536+0000","last_fullsized":"2024-04-25T01:39:34.559536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:25:20.440422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434733+0000","last_change":"2024-04-25T01:39:32.436300+0000","last_active":"2024-04-25T01:39:34.434733+0000","last_peered":"2024-04-25T01:39:34.434733+0000","last_clean":"2024-04-25T01:39:34.434733+0000","last_became_active":"2024-04-25T01:39:32.436000+0000","last_became_peered":"2024-04-25T01:39:32.436000+0000","last_unstale":"2024-04-25T01:39:34.434733+0000","last_undegraded":"2024-04-25T01:39:34.434733+0000","last_fullsized":"2024-04-25T01:39:34.434733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:38.044992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429461+0000","last_change":"2024-04-25T01:39:24.387708+0000","last_active":"2024-04-25T01:39:34.429461+0000","last_peered":"2024-04-25T01:39:34.429461+0000","last_clean":"2024-04-25T01:39:34.429461+0000","last_became_active":"2024-04-25T01:39:24.387433+0000","last_became_peered":"2024-04-25T01:39:24.387433+0000","last_unstale":"2024-04-25T01:39:34.429461+0000","last_undegraded":"2024-04-25T01:39:34.429461+0000","last_fullsized":"2024-04-25T01:39:34.429461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:34.312066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429418+0000","last_change":"2024-04-25T01:39:23.377487+0000","last_active":"2024-04-25T01:39:34.429418+0000","last_peered":"2024-04-25T01:39:34.429418+0000","last_clean":"2024-04-25T01:39:34.429418+0000","last_became_active":"2024-04-25T01:39:23.377181+0000","last_became_peered":"2024-04-25T01:39:23.377181+0000","last_unstale":"2024-04-25T01:39:34.429418+0000","last_undegraded":"2024-04-25T01:39:34.429418+0000","last_fullsized":"2024-04-25T01:39:34.429418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:17.434141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198602+0000","last_change":"2024-04-25T01:39:33.444973+0000","last_active":"2024-04-25T01:39:35.198602+0000","last_peered":"2024-04-25T01:39:35.198602+0000","last_clean":"2024-04-25T01:39:35.198602+0000","last_became_active":"2024-04-25T01:39:33.444673+0000","last_became_peered":"2024-04-25T01:39:33.444673+0000","last_unstale":"2024-04-25T01:39:35.198602+0000","last_undegraded":"2024-04-25T01:39:35.198602+0000","last_fullsized":"2024-04-25T01:39:35.198602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:08.372714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434713+0000","last_change":"2024-04-25T01:39:23.372975+0000","last_active":"2024-04-25T01:39:34.434713+0000","last_peered":"2024-04-25T01:39:34.434713+0000","last_clean":"2024-04-25T01:39:34.434713+0000","last_became_active":"2024-04-25T01:39:23.372688+0000","last_became_peered":"2024-04-25T01:39:23.372688+0000","last_unstale":"2024-04-25T01:39:34.434713+0000","last_undegraded":"2024-04-25T01:39:34.434713+0000","last_fullsized":"2024-04-25T01:39:34.434713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:42:57.195844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559766+0000","last_change":"2024-04-25T01:39:24.388095+0000","last_active":"2024-04-25T01:39:34.559766+0000","last_peered":"2024-04-25T01:39:34.559766+0000","last_clean":"2024-04-25T01:39:34.559766+0000","last_became_active":"2024-04-25T01:39:24.387797+0000","last_became_peered":"2024-04-25T01:39:24.387797+0000","last_unstale":"2024-04-25T01:39:34.559766+0000","last_undegraded":"2024-04-25T01:39:34.559766+0000","last_fullsized":"2024-04-25T01:39:34.559766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:43:16.385957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197731+0000","last_change":"2024-04-25T01:39:32.427081+0000","last_active":"2024-04-25T01:39:35.197731+0000","last_peered":"2024-04-25T01:39:35.197731+0000","last_clean":"2024-04-25T01:39:35.197731+0000","last_became_active":"2024-04-25T01:39:32.426626+0000","last_became_peered":"2024-04-25T01:39:32.426626+0000","last_unstale":"2024-04-25T01:39:35.197731+0000","last_undegraded":"2024-04-25T01:39:35.197731+0000","last_fullsized":"2024-04-25T01:39:35.197731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:45.358400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198937+0000","last_change":"2024-04-25T01:39:33.446301+0000","last_active":"2024-04-25T01:39:35.198937+0000","last_peered":"2024-04-25T01:39:35.198937+0000","last_clean":"2024-04-25T01:39:35.198937+0000","last_became_active":"2024-04-25T01:39:33.445158+0000","last_became_peered":"2024-04-25T01:39:33.445158+0000","last_unstale":"2024-04-25T01:39:35.198937+0000","last_undegraded":"2024-04-25T01:39:35.198937+0000","last_fullsized":"2024-04-25T01:39:35.198937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:53:26.017968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429884+0000","last_change":"2024-04-25T01:39:23.371716+0000","last_active":"2024-04-25T01:39:34.429884+0000","last_peered":"2024-04-25T01:39:34.429884+0000","last_clean":"2024-04-25T01:39:34.429884+0000","last_became_active":"2024-04-25T01:39:23.371475+0000","last_became_peered":"2024-04-25T01:39:23.371475+0000","last_unstale":"2024-04-25T01:39:34.429884+0000","last_undegraded":"2024-04-25T01:39:34.429884+0000","last_fullsized":"2024-04-25T01:39:34.429884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:10.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198751+0000","last_change":"2024-04-25T01:39:24.388083+0000","last_active":"2024-04-25T01:39:35.198751+0000","last_peered":"2024-04-25T01:39:35.198751+0000","last_clean":"2024-04-25T01:39:35.198751+0000","last_became_active":"2024-04-25T01:39:24.387789+0000","last_became_peered":"2024-04-25T01:39:24.387789+0000","last_unstale":"2024-04-25T01:39:35.198751+0000","last_undegraded":"2024-04-25T01:39:35.198751+0000","last_fullsized":"2024-04-25T01:39:35.198751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:31.760631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429824+0000","last_change":"2024-04-25T01:39:32.429613+0000","last_active":"2024-04-25T01:39:34.429824+0000","last_peered":"2024-04-25T01:39:34.429824+0000","last_clean":"2024-04-25T01:39:34.429824+0000","last_became_active":"2024-04-25T01:39:32.429361+0000","last_became_peered":"2024-04-25T01:39:32.429361+0000","last_unstale":"2024-04-25T01:39:34.429824+0000","last_undegraded":"2024-04-25T01:39:34.429824+0000","last_fullsized":"2024-04-25T01:39:34.429824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:04:59.928602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430227+0000","last_change":"2024-04-25T01:39:33.426384+0000","last_active":"2024-04-25T01:39:34.430227+0000","last_peered":"2024-04-25T01:39:34.430227+0000","last_clean":"2024-04-25T01:39:34.430227+0000","last_became_active":"2024-04-25T01:39:33.426101+0000","last_became_peered":"2024-04-25T01:39:33.426101+0000","last_unstale":"2024-04-25T01:39:34.430227+0000","last_undegraded":"2024-04-25T01:39:34.430227+0000","last_fullsized":"2024-04-25T01:39:34.430227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:36.820458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.433902+0000","last_change":"2024-04-25T01:39:24.395618+0000","last_active":"2024-04-25T01:39:34.433902+0000","last_peered":"2024-04-25T01:39:34.433902+0000","last_clean":"2024-04-25T01:39:34.433902+0000","last_became_active":"2024-04-25T01:39:24.394816+0000","last_became_peered":"2024-04-25T01:39:24.394816+0000","last_unstale":"2024-04-25T01:39:34.433902+0000","last_undegraded":"2024-04-25T01:39:34.433902+0000","last_fullsized":"2024-04-25T01:39:34.433902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:01.025135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198676+0000","last_change":"2024-04-25T01:39:33.432537+0000","last_active":"2024-04-25T01:39:35.198676+0000","last_peered":"2024-04-25T01:39:35.198676+0000","last_clean":"2024-04-25T01:39:35.198676+0000","last_became_active":"2024-04-25T01:39:33.432266+0000","last_became_peered":"2024-04-25T01:39:33.432266+0000","last_unstale":"2024-04-25T01:39:35.198676+0000","last_undegraded":"2024-04-25T01:39:35.198676+0000","last_fullsized":"2024-04-25T01:39:35.198676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:31.703689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197383+0000","last_change":"2024-04-25T01:39:24.390981+0000","last_active":"2024-04-25T01:39:35.197383+0000","last_peered":"2024-04-25T01:39:35.197383+0000","last_clean":"2024-04-25T01:39:35.197383+0000","last_became_active":"2024-04-25T01:39:24.390716+0000","last_became_peered":"2024-04-25T01:39:24.390716+0000","last_unstale":"2024-04-25T01:39:35.197383+0000","last_undegraded":"2024-04-25T01:39:35.197383+0000","last_fullsized":"2024-04-25T01:39:35.197383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:08.458504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199057+0000","last_change":"2024-04-25T01:39:33.439086+0000","last_active":"2024-04-25T01:39:35.199057+0000","last_peered":"2024-04-25T01:39:35.199057+0000","last_clean":"2024-04-25T01:39:35.199057+0000","last_became_active":"2024-04-25T01:39:33.438811+0000","last_became_peered":"2024-04-25T01:39:33.438811+0000","last_unstale":"2024-04-25T01:39:35.199057+0000","last_undegraded":"2024-04-25T01:39:35.199057+0000","last_fullsized":"2024-04-25T01:39:35.199057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:49:23.604749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198076+0000","last_change":"2024-04-25T01:39:24.399738+0000","last_active":"2024-04-25T01:39:35.198076+0000","last_peered":"2024-04-25T01:39:35.198076+0000","last_clean":"2024-04-25T01:39:35.198076+0000","last_became_active":"2024-04-25T01:39:24.399499+0000","last_became_peered":"2024-04-25T01:39:24.399499+0000","last_unstale":"2024-04-25T01:39:35.198076+0000","last_undegraded":"2024-04-25T01:39:35.198076+0000","last_fullsized":"2024-04-25T01:39:35.198076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:58.646669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198407+0000","last_change":"2024-04-25T01:39:33.444074+0000","last_active":"2024-04-25T01:39:35.198407+0000","last_peered":"2024-04-25T01:39:35.198407+0000","last_clean":"2024-04-25T01:39:35.198407+0000","last_became_active":"2024-04-25T01:39:33.443796+0000","last_became_peered":"2024-04-25T01:39:33.443796+0000","last_unstale":"2024-04-25T01:39:35.198407+0000","last_undegraded":"2024-04-25T01:39:35.198407+0000","last_fullsized":"2024-04-25T01:39:35.198407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:56.379211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559685+0000","last_change":"2024-04-25T01:39:24.390631+0000","last_active":"2024-04-25T01:39:34.559685+0000","last_peered":"2024-04-25T01:39:34.559685+0000","last_clean":"2024-04-25T01:39:34.559685+0000","last_became_active":"2024-04-25T01:39:24.390363+0000","last_became_peered":"2024-04-25T01:39:24.390363+0000","last_unstale":"2024-04-25T01:39:34.559685+0000","last_undegraded":"2024-04-25T01:39:34.559685+0000","last_fullsized":"2024-04-25T01:39:34.559685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:48.830416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199245+0000","last_change":"2024-04-25T01:39:33.437787+0000","last_active":"2024-04-25T01:39:35.199245+0000","last_peered":"2024-04-25T01:39:35.199245+0000","last_clean":"2024-04-25T01:39:35.199245+0000","last_became_active":"2024-04-25T01:39:33.436131+0000","last_became_peered":"2024-04-25T01:39:33.436131+0000","last_unstale":"2024-04-25T01:39:35.199245+0000","last_undegraded":"2024-04-25T01:39:35.199245+0000","last_fullsized":"2024-04-25T01:39:35.199245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:29:13.213643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429883+0000","last_change":"2024-04-25T01:39:24.389645+0000","last_active":"2024-04-25T01:39:34.429883+0000","last_peered":"2024-04-25T01:39:34.429883+0000","last_clean":"2024-04-25T01:39:34.429883+0000","last_became_active":"2024-04-25T01:39:24.389375+0000","last_became_peered":"2024-04-25T01:39:24.389375+0000","last_unstale":"2024-04-25T01:39:34.429883+0000","last_undegraded":"2024-04-25T01:39:34.429883+0000","last_fullsized":"2024-04-25T01:39:34.429883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:13:12.753893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197777+0000","last_change":"2024-04-25T01:39:33.448177+0000","last_active":"2024-04-25T01:39:35.197777+0000","last_peered":"2024-04-25T01:39:35.197777+0000","last_clean":"2024-04-25T01:39:35.197777+0000","last_became_active":"2024-04-25T01:39:33.447588+0000","last_became_peered":"2024-04-25T01:39:33.447588+0000","last_unstale":"2024-04-25T01:39:35.197777+0000","last_undegraded":"2024-04-25T01:39:35.197777+0000","last_fullsized":"2024-04-25T01:39:35.197777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:11:20.466189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198572+0000","last_change":"2024-04-25T01:39:24.374082+0000","last_active":"2024-04-25T01:39:35.198572+0000","last_peered":"2024-04-25T01:39:35.198572+0000","last_clean":"2024-04-25T01:39:35.198572+0000","last_became_active":"2024-04-25T01:39:24.373731+0000","last_became_peered":"2024-04-25T01:39:24.373731+0000","last_unstale":"2024-04-25T01:39:35.198572+0000","last_undegraded":"2024-04-25T01:39:35.198572+0000","last_fullsized":"2024-04-25T01:39:35.198572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:45.817483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197536+0000","last_change":"2024-04-25T01:39:33.446992+0000","last_active":"2024-04-25T01:39:35.197536+0000","last_peered":"2024-04-25T01:39:35.197536+0000","last_clean":"2024-04-25T01:39:35.197536+0000","last_became_active":"2024-04-25T01:39:33.446652+0000","last_became_peered":"2024-04-25T01:39:33.446652+0000","last_unstale":"2024-04-25T01:39:35.197536+0000","last_undegraded":"2024-04-25T01:39:35.197536+0000","last_fullsized":"2024-04-25T01:39:35.197536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:43:52.959274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434529+0000","last_change":"2024-04-25T01:39:24.398614+0000","last_active":"2024-04-25T01:39:34.434529+0000","last_peered":"2024-04-25T01:39:34.434529+0000","last_clean":"2024-04-25T01:39:34.434529+0000","last_became_active":"2024-04-25T01:39:24.398299+0000","last_became_peered":"2024-04-25T01:39:24.398299+0000","last_unstale":"2024-04-25T01:39:34.434529+0000","last_undegraded":"2024-04-25T01:39:34.434529+0000","last_fullsized":"2024-04-25T01:39:34.434529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:54:51.191225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434363+0000","last_change":"2024-04-25T01:39:33.441401+0000","last_active":"2024-04-25T01:39:34.434363+0000","last_peered":"2024-04-25T01:39:34.434363+0000","last_clean":"2024-04-25T01:39:34.434363+0000","last_became_active":"2024-04-25T01:39:33.441104+0000","last_became_peered":"2024-04-25T01:39:33.441104+0000","last_unstale":"2024-04-25T01:39:34.434363+0000","last_undegraded":"2024-04-25T01:39:34.434363+0000","last_fullsized":"2024-04-25T01:39:34.434363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:51.503340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430186+0000","last_change":"2024-04-25T01:39:24.390352+0000","last_active":"2024-04-25T01:39:34.430186+0000","last_peered":"2024-04-25T01:39:34.430186+0000","last_clean":"2024-04-25T01:39:34.430186+0000","last_became_active":"2024-04-25T01:39:24.389809+0000","last_became_peered":"2024-04-25T01:39:24.389809+0000","last_unstale":"2024-04-25T01:39:34.430186+0000","last_undegraded":"2024-04-25T01:39:34.430186+0000","last_fullsized":"2024-04-25T01:39:34.430186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:22:44.221898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430089+0000","last_change":"2024-04-25T01:39:33.426710+0000","last_active":"2024-04-25T01:39:34.430089+0000","last_peered":"2024-04-25T01:39:34.430089+0000","last_clean":"2024-04-25T01:39:34.430089+0000","last_became_active":"2024-04-25T01:39:33.426056+0000","last_became_peered":"2024-04-25T01:39:33.426056+0000","last_unstale":"2024-04-25T01:39:34.430089+0000","last_undegraded":"2024-04-25T01:39:34.430089+0000","last_fullsized":"2024-04-25T01:39:34.430089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:53:41.174851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197416+0000","last_change":"2024-04-25T01:39:24.387093+0000","last_active":"2024-04-25T01:39:35.197416+0000","last_peered":"2024-04-25T01:39:35.197416+0000","last_clean":"2024-04-25T01:39:35.197416+0000","last_became_active":"2024-04-25T01:39:24.386809+0000","last_became_peered":"2024-04-25T01:39:24.386809+0000","last_unstale":"2024-04-25T01:39:35.197416+0000","last_undegraded":"2024-04-25T01:39:35.197416+0000","last_fullsized":"2024-04-25T01:39:35.197416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:46:05.313828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200264+0000","last_change":"2024-04-25T01:39:33.436499+0000","last_active":"2024-04-25T01:39:35.200264+0000","last_peered":"2024-04-25T01:39:35.200264+0000","last_clean":"2024-04-25T01:39:35.200264+0000","last_became_active":"2024-04-25T01:39:33.436017+0000","last_became_peered":"2024-04-25T01:39:33.436017+0000","last_unstale":"2024-04-25T01:39:35.200264+0000","last_undegraded":"2024-04-25T01:39:35.200264+0000","last_fullsized":"2024-04-25T01:39:35.200264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:46:09.302012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429495+0000","last_change":"2024-04-25T01:39:24.389039+0000","last_active":"2024-04-25T01:39:34.429495+0000","last_peered":"2024-04-25T01:39:34.429495+0000","last_clean":"2024-04-25T01:39:34.429495+0000","last_became_active":"2024-04-25T01:39:24.388793+0000","last_became_peered":"2024-04-25T01:39:24.388793+0000","last_unstale":"2024-04-25T01:39:34.429495+0000","last_undegraded":"2024-04-25T01:39:34.429495+0000","last_fullsized":"2024-04-25T01:39:34.429495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:13.093550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197668+0000","last_change":"2024-04-25T01:39:33.441122+0000","last_active":"2024-04-25T01:39:35.197668+0000","last_peered":"2024-04-25T01:39:35.197668+0000","last_clean":"2024-04-25T01:39:35.197668+0000","last_became_active":"2024-04-25T01:39:33.440760+0000","last_became_peered":"2024-04-25T01:39:33.440760+0000","last_unstale":"2024-04-25T01:39:35.197668+0000","last_undegraded":"2024-04-25T01:39:35.197668+0000","last_fullsized":"2024-04-25T01:39:35.197668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:30:12.603789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197981+0000","last_change":"2024-04-25T01:39:24.390884+0000","last_active":"2024-04-25T01:39:35.197981+0000","last_peered":"2024-04-25T01:39:35.197981+0000","last_clean":"2024-04-25T01:39:35.197981+0000","last_became_active":"2024-04-25T01:39:24.390591+0000","last_became_peered":"2024-04-25T01:39:24.390591+0000","last_unstale":"2024-04-25T01:39:35.197981+0000","last_undegraded":"2024-04-25T01:39:35.197981+0000","last_fullsized":"2024-04-25T01:39:35.197981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:51.274363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429740+0000","last_change":"2024-04-25T01:39:33.429482+0000","last_active":"2024-04-25T01:39:34.429740+0000","last_peered":"2024-04-25T01:39:34.429740+0000","last_clean":"2024-04-25T01:39:34.429740+0000","last_became_active":"2024-04-25T01:39:33.429158+0000","last_became_peered":"2024-04-25T01:39:33.429158+0000","last_unstale":"2024-04-25T01:39:34.429740+0000","last_undegraded":"2024-04-25T01:39:34.429740+0000","last_fullsized":"2024-04-25T01:39:34.429740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:58:07.372868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559599+0000","last_change":"2024-04-25T01:39:24.388891+0000","last_active":"2024-04-25T01:39:34.559599+0000","last_peered":"2024-04-25T01:39:34.559599+0000","last_clean":"2024-04-25T01:39:34.559599+0000","last_became_active":"2024-04-25T01:39:24.388619+0000","last_became_peered":"2024-04-25T01:39:24.388619+0000","last_unstale":"2024-04-25T01:39:34.559599+0000","last_undegraded":"2024-04-25T01:39:34.559599+0000","last_fullsized":"2024-04-25T01:39:34.559599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:05.176386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198216+0000","last_change":"2024-04-25T01:39:33.443534+0000","last_active":"2024-04-25T01:39:35.198216+0000","last_peered":"2024-04-25T01:39:35.198216+0000","last_clean":"2024-04-25T01:39:35.198216+0000","last_became_active":"2024-04-25T01:39:33.443257+0000","last_became_peered":"2024-04-25T01:39:33.443257+0000","last_unstale":"2024-04-25T01:39:35.198216+0000","last_undegraded":"2024-04-25T01:39:35.198216+0000","last_fullsized":"2024-04-25T01:39:35.198216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:44:30.154519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434181+0000","last_change":"2024-04-25T01:39:24.395109+0000","last_active":"2024-04-25T01:39:34.434181+0000","last_peered":"2024-04-25T01:39:34.434181+0000","last_clean":"2024-04-25T01:39:34.434181+0000","last_became_active":"2024-04-25T01:39:24.394784+0000","last_became_peered":"2024-04-25T01:39:24.394784+0000","last_unstale":"2024-04-25T01:39:34.434181+0000","last_undegraded":"2024-04-25T01:39:34.434181+0000","last_fullsized":"2024-04-25T01:39:34.434181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:44:09.102603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197600+0000","last_change":"2024-04-25T01:39:33.446683+0000","last_active":"2024-04-25T01:39:35.197600+0000","last_peered":"2024-04-25T01:39:35.197600+0000","last_clean":"2024-04-25T01:39:35.197600+0000","last_became_active":"2024-04-25T01:39:33.445949+0000","last_became_peered":"2024-04-25T01:39:33.445949+0000","last_unstale":"2024-04-25T01:39:35.197600+0000","last_undegraded":"2024-04-25T01:39:35.197600+0000","last_fullsized":"2024-04-25T01:39:35.197600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:28.864821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199913+0000","last_change":"2024-04-25T01:39:24.380199+0000","last_active":"2024-04-25T01:39:35.199913+0000","last_peered":"2024-04-25T01:39:35.199913+0000","last_clean":"2024-04-25T01:39:35.199913+0000","last_became_active":"2024-04-25T01:39:24.379591+0000","last_became_peered":"2024-04-25T01:39:24.379591+0000","last_unstale":"2024-04-25T01:39:35.199913+0000","last_undegraded":"2024-04-25T01:39:35.199913+0000","last_fullsized":"2024-04-25T01:39:35.199913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:54.534683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197349+0000","last_change":"2024-04-25T01:39:33.439702+0000","last_active":"2024-04-25T01:39:35.197349+0000","last_peered":"2024-04-25T01:39:35.197349+0000","last_clean":"2024-04-25T01:39:35.197349+0000","last_became_active":"2024-04-25T01:39:33.439424+0000","last_became_peered":"2024-04-25T01:39:33.439424+0000","last_unstale":"2024-04-25T01:39:35.197349+0000","last_undegraded":"2024-04-25T01:39:35.197349+0000","last_fullsized":"2024-04-25T01:39:35.197349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:31.528140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197883+0000","last_change":"2024-04-25T01:39:24.395125+0000","last_active":"2024-04-25T01:39:35.197883+0000","last_peered":"2024-04-25T01:39:35.197883+0000","last_clean":"2024-04-25T01:39:35.197883+0000","last_became_active":"2024-04-25T01:39:24.392605+0000","last_became_peered":"2024-04-25T01:39:24.392605+0000","last_unstale":"2024-04-25T01:39:35.197883+0000","last_undegraded":"2024-04-25T01:39:35.197883+0000","last_fullsized":"2024-04-25T01:39:35.197883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:53.333616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559178+0000","last_change":"2024-04-25T01:39:33.438104+0000","last_active":"2024-04-25T01:39:34.559178+0000","last_peered":"2024-04-25T01:39:34.559178+0000","last_clean":"2024-04-25T01:39:34.559178+0000","last_became_active":"2024-04-25T01:39:33.437795+0000","last_became_peered":"2024-04-25T01:39:33.437795+0000","last_unstale":"2024-04-25T01:39:34.559178+0000","last_undegraded":"2024-04-25T01:39:34.559178+0000","last_fullsized":"2024-04-25T01:39:34.559178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:32.294104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199422+0000","last_change":"2024-04-25T01:39:24.391312+0000","last_active":"2024-04-25T01:39:35.199422+0000","last_peered":"2024-04-25T01:39:35.199422+0000","last_clean":"2024-04-25T01:39:35.199422+0000","last_became_active":"2024-04-25T01:39:24.390978+0000","last_became_peered":"2024-04-25T01:39:24.390978+0000","last_unstale":"2024-04-25T01:39:35.199422+0000","last_undegraded":"2024-04-25T01:39:35.199422+0000","last_fullsized":"2024-04-25T01:39:35.199422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:38:25.637031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197875+0000","last_change":"2024-04-25T01:39:33.431262+0000","last_active":"2024-04-25T01:39:35.197875+0000","last_peered":"2024-04-25T01:39:35.197875+0000","last_clean":"2024-04-25T01:39:35.197875+0000","last_became_active":"2024-04-25T01:39:33.430982+0000","last_became_peered":"2024-04-25T01:39:33.430982+0000","last_unstale":"2024-04-25T01:39:35.197875+0000","last_undegraded":"2024-04-25T01:39:35.197875+0000","last_fullsized":"2024-04-25T01:39:35.197875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:11.821542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197372+0000","last_change":"2024-04-25T01:39:24.399270+0000","last_active":"2024-04-25T01:39:35.197372+0000","last_peered":"2024-04-25T01:39:35.197372+0000","last_clean":"2024-04-25T01:39:35.197372+0000","last_became_active":"2024-04-25T01:39:24.399011+0000","last_became_peered":"2024-04-25T01:39:24.399011+0000","last_unstale":"2024-04-25T01:39:35.197372+0000","last_undegraded":"2024-04-25T01:39:35.197372+0000","last_fullsized":"2024-04-25T01:39:35.197372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:00.987674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197770+0000","last_change":"2024-04-25T01:39:33.443939+0000","last_active":"2024-04-25T01:39:35.197770+0000","last_peered":"2024-04-25T01:39:35.197770+0000","last_clean":"2024-04-25T01:39:35.197770+0000","last_became_active":"2024-04-25T01:39:33.443608+0000","last_became_peered":"2024-04-25T01:39:33.443608+0000","last_unstale":"2024-04-25T01:39:35.197770+0000","last_undegraded":"2024-04-25T01:39:35.197770+0000","last_fullsized":"2024-04-25T01:39:35.197770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:35.561173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197831+0000","last_change":"2024-04-25T01:39:24.388943+0000","last_active":"2024-04-25T01:39:35.197831+0000","last_peered":"2024-04-25T01:39:35.197831+0000","last_clean":"2024-04-25T01:39:35.197831+0000","last_became_active":"2024-04-25T01:39:24.388690+0000","last_became_peered":"2024-04-25T01:39:24.388690+0000","last_unstale":"2024-04-25T01:39:35.197831+0000","last_undegraded":"2024-04-25T01:39:35.197831+0000","last_fullsized":"2024-04-25T01:39:35.197831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:42:18.260701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198911+0000","last_change":"2024-04-25T01:39:33.438460+0000","last_active":"2024-04-25T01:39:35.198911+0000","last_peered":"2024-04-25T01:39:35.198911+0000","last_clean":"2024-04-25T01:39:35.198911+0000","last_became_active":"2024-04-25T01:39:33.436581+0000","last_became_peered":"2024-04-25T01:39:33.436581+0000","last_unstale":"2024-04-25T01:39:35.198911+0000","last_undegraded":"2024-04-25T01:39:35.198911+0000","last_fullsized":"2024-04-25T01:39:35.198911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:03:27.382925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559241+0000","last_change":"2024-04-25T01:39:24.389556+0000","last_active":"2024-04-25T01:39:34.559241+0000","last_peered":"2024-04-25T01:39:34.559241+0000","last_clean":"2024-04-25T01:39:34.559241+0000","last_became_active":"2024-04-25T01:39:24.389254+0000","last_became_peered":"2024-04-25T01:39:24.389254+0000","last_unstale":"2024-04-25T01:39:34.559241+0000","last_undegraded":"2024-04-25T01:39:34.559241+0000","last_fullsized":"2024-04-25T01:39:34.559241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:56.208172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199719+0000","last_change":"2024-04-25T01:39:33.433893+0000","last_active":"2024-04-25T01:39:35.199719+0000","last_peered":"2024-04-25T01:39:35.199719+0000","last_clean":"2024-04-25T01:39:35.199719+0000","last_became_active":"2024-04-25T01:39:33.433577+0000","last_became_peered":"2024-04-25T01:39:33.433577+0000","last_unstale":"2024-04-25T01:39:35.199719+0000","last_undegraded":"2024-04-25T01:39:35.199719+0000","last_fullsized":"2024-04-25T01:39:35.199719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:16.371837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429725+0000","last_change":"2024-04-25T01:39:24.392021+0000","last_active":"2024-04-25T01:39:34.429725+0000","last_peered":"2024-04-25T01:39:34.429725+0000","last_clean":"2024-04-25T01:39:34.429725+0000","last_became_active":"2024-04-25T01:39:24.391352+0000","last_became_peered":"2024-04-25T01:39:24.391352+0000","last_unstale":"2024-04-25T01:39:34.429725+0000","last_undegraded":"2024-04-25T01:39:34.429725+0000","last_fullsized":"2024-04-25T01:39:34.429725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:44.434749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429972+0000","last_change":"2024-04-25T01:39:33.436641+0000","last_active":"2024-04-25T01:39:34.429972+0000","last_peered":"2024-04-25T01:39:34.429972+0000","last_clean":"2024-04-25T01:39:34.429972+0000","last_became_active":"2024-04-25T01:39:33.436389+0000","last_became_peered":"2024-04-25T01:39:33.436389+0000","last_unstale":"2024-04-25T01:39:34.429972+0000","last_undegraded":"2024-04-25T01:39:34.429972+0000","last_fullsized":"2024-04-25T01:39:34.429972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:19:51.940088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198744+0000","last_change":"2024-04-25T01:39:24.396300+0000","last_active":"2024-04-25T01:39:35.198744+0000","last_peered":"2024-04-25T01:39:35.198744+0000","last_clean":"2024-04-25T01:39:35.198744+0000","last_became_active":"2024-04-25T01:39:24.396023+0000","last_became_peered":"2024-04-25T01:39:24.396023+0000","last_unstale":"2024-04-25T01:39:35.198744+0000","last_undegraded":"2024-04-25T01:39:35.198744+0000","last_fullsized":"2024-04-25T01:39:35.198744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:21.500721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197770+0000","last_change":"2024-04-25T01:39:33.443419+0000","last_active":"2024-04-25T01:39:35.197770+0000","last_peered":"2024-04-25T01:39:35.197770+0000","last_clean":"2024-04-25T01:39:35.197770+0000","last_became_active":"2024-04-25T01:39:33.443163+0000","last_became_peered":"2024-04-25T01:39:33.443163+0000","last_unstale":"2024-04-25T01:39:35.197770+0000","last_undegraded":"2024-04-25T01:39:35.197770+0000","last_fullsized":"2024-04-25T01:39:35.197770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:22.156410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434366+0000","last_change":"2024-04-25T01:39:24.404047+0000","last_active":"2024-04-25T01:39:34.434366+0000","last_peered":"2024-04-25T01:39:34.434366+0000","last_clean":"2024-04-25T01:39:34.434366+0000","last_became_active":"2024-04-25T01:39:24.403700+0000","last_became_peered":"2024-04-25T01:39:24.403700+0000","last_unstale":"2024-04-25T01:39:34.434366+0000","last_undegraded":"2024-04-25T01:39:34.434366+0000","last_fullsized":"2024-04-25T01:39:34.434366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:53.123061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199905+0000","last_change":"2024-04-25T01:39:33.435520+0000","last_active":"2024-04-25T01:39:35.199905+0000","last_peered":"2024-04-25T01:39:35.199905+0000","last_clean":"2024-04-25T01:39:35.199905+0000","last_became_active":"2024-04-25T01:39:33.434446+0000","last_became_peered":"2024-04-25T01:39:33.434446+0000","last_unstale":"2024-04-25T01:39:35.199905+0000","last_undegraded":"2024-04-25T01:39:35.199905+0000","last_fullsized":"2024-04-25T01:39:35.199905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:59.696009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434467+0000","last_change":"2024-04-25T01:39:24.406158+0000","last_active":"2024-04-25T01:39:34.434467+0000","last_peered":"2024-04-25T01:39:34.434467+0000","last_clean":"2024-04-25T01:39:34.434467+0000","last_became_active":"2024-04-25T01:39:24.405876+0000","last_became_peered":"2024-04-25T01:39:24.405876+0000","last_unstale":"2024-04-25T01:39:34.434467+0000","last_undegraded":"2024-04-25T01:39:34.434467+0000","last_fullsized":"2024-04-25T01:39:34.434467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:18:19.895651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198497+0000","last_change":"2024-04-25T01:39:33.436479+0000","last_active":"2024-04-25T01:39:35.198497+0000","last_peered":"2024-04-25T01:39:35.198497+0000","last_clean":"2024-04-25T01:39:35.198497+0000","last_became_active":"2024-04-25T01:39:33.436193+0000","last_became_peered":"2024-04-25T01:39:33.436193+0000","last_unstale":"2024-04-25T01:39:35.198497+0000","last_undegraded":"2024-04-25T01:39:35.198497+0000","last_fullsized":"2024-04-25T01:39:35.198497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:20:03.455536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200363+0000","last_change":"2024-04-25T01:39:24.393362+0000","last_active":"2024-04-25T01:39:35.200363+0000","last_peered":"2024-04-25T01:39:35.200363+0000","last_clean":"2024-04-25T01:39:35.200363+0000","last_became_active":"2024-04-25T01:39:24.392836+0000","last_became_peered":"2024-04-25T01:39:24.392836+0000","last_unstale":"2024-04-25T01:39:35.200363+0000","last_undegraded":"2024-04-25T01:39:35.200363+0000","last_fullsized":"2024-04-25T01:39:35.200363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:58.871777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430064+0000","last_change":"2024-04-25T01:39:33.440164+0000","last_active":"2024-04-25T01:39:34.430064+0000","last_peered":"2024-04-25T01:39:34.430064+0000","last_clean":"2024-04-25T01:39:34.430064+0000","last_became_active":"2024-04-25T01:39:33.439878+0000","last_became_peered":"2024-04-25T01:39:33.439878+0000","last_unstale":"2024-04-25T01:39:34.430064+0000","last_undegraded":"2024-04-25T01:39:34.430064+0000","last_fullsized":"2024-04-25T01:39:34.430064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:44:52.817169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429296+0000","last_change":"2024-04-25T01:39:24.401765+0000","last_active":"2024-04-25T01:39:34.429296+0000","last_peered":"2024-04-25T01:39:34.429296+0000","last_clean":"2024-04-25T01:39:34.429296+0000","last_became_active":"2024-04-25T01:39:24.400509+0000","last_became_peered":"2024-04-25T01:39:24.400509+0000","last_unstale":"2024-04-25T01:39:34.429296+0000","last_undegraded":"2024-04-25T01:39:34.429296+0000","last_fullsized":"2024-04-25T01:39:34.429296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:25.031622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434669+0000","last_change":"2024-04-25T01:39:33.439353+0000","last_active":"2024-04-25T01:39:34.434669+0000","last_peered":"2024-04-25T01:39:34.434669+0000","last_clean":"2024-04-25T01:39:34.434669+0000","last_became_active":"2024-04-25T01:39:33.438915+0000","last_became_peered":"2024-04-25T01:39:33.438915+0000","last_unstale":"2024-04-25T01:39:34.434669+0000","last_undegraded":"2024-04-25T01:39:34.434669+0000","last_fullsized":"2024-04-25T01:39:34.434669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:19.180919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198881+0000","last_change":"2024-04-25T01:39:24.387941+0000","last_active":"2024-04-25T01:39:35.198881+0000","last_peered":"2024-04-25T01:39:35.198881+0000","last_clean":"2024-04-25T01:39:35.198881+0000","last_became_active":"2024-04-25T01:39:24.387674+0000","last_became_peered":"2024-04-25T01:39:24.387674+0000","last_unstale":"2024-04-25T01:39:35.198881+0000","last_undegraded":"2024-04-25T01:39:35.198881+0000","last_fullsized":"2024-04-25T01:39:35.198881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:05.676143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197803+0000","last_change":"2024-04-25T01:39:33.444917+0000","last_active":"2024-04-25T01:39:35.197803+0000","last_peered":"2024-04-25T01:39:35.197803+0000","last_clean":"2024-04-25T01:39:35.197803+0000","last_became_active":"2024-04-25T01:39:33.444636+0000","last_became_peered":"2024-04-25T01:39:33.444636+0000","last_unstale":"2024-04-25T01:39:35.197803+0000","last_undegraded":"2024-04-25T01:39:35.197803+0000","last_fullsized":"2024-04-25T01:39:35.197803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:31.531502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197880+0000","last_change":"2024-04-25T01:39:24.399950+0000","last_active":"2024-04-25T01:39:35.197880+0000","last_peered":"2024-04-25T01:39:35.197880+0000","last_clean":"2024-04-25T01:39:35.197880+0000","last_became_active":"2024-04-25T01:39:24.399701+0000","last_became_peered":"2024-04-25T01:39:24.399701+0000","last_unstale":"2024-04-25T01:39:35.197880+0000","last_undegraded":"2024-04-25T01:39:35.197880+0000","last_fullsized":"2024-04-25T01:39:35.197880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:49.618370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200035+0000","last_change":"2024-04-25T01:39:33.440936+0000","last_active":"2024-04-25T01:39:35.200035+0000","last_peered":"2024-04-25T01:39:35.200035+0000","last_clean":"2024-04-25T01:39:35.200035+0000","last_became_active":"2024-04-25T01:39:33.440679+0000","last_became_peered":"2024-04-25T01:39:33.440679+0000","last_unstale":"2024-04-25T01:39:35.200035+0000","last_undegraded":"2024-04-25T01:39:35.200035+0000","last_fullsized":"2024-04-25T01:39:35.200035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:08:53.629572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198222+0000","last_change":"2024-04-25T01:39:24.380318+0000","last_active":"2024-04-25T01:39:35.198222+0000","last_peered":"2024-04-25T01:39:35.198222+0000","last_clean":"2024-04-25T01:39:35.198222+0000","last_became_active":"2024-04-25T01:39:24.379573+0000","last_became_peered":"2024-04-25T01:39:24.379573+0000","last_unstale":"2024-04-25T01:39:35.198222+0000","last_undegraded":"2024-04-25T01:39:35.198222+0000","last_fullsized":"2024-04-25T01:39:35.198222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:12.089917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429399+0000","last_change":"2024-04-25T01:39:33.426380+0000","last_active":"2024-04-25T01:39:34.429399+0000","last_peered":"2024-04-25T01:39:34.429399+0000","last_clean":"2024-04-25T01:39:34.429399+0000","last_became_active":"2024-04-25T01:39:33.426090+0000","last_became_peered":"2024-04-25T01:39:33.426090+0000","last_unstale":"2024-04-25T01:39:34.429399+0000","last_undegraded":"2024-04-25T01:39:34.429399+0000","last_fullsized":"2024-04-25T01:39:34.429399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:34.329217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199243+0000","last_change":"2024-04-25T01:39:24.398726+0000","last_active":"2024-04-25T01:39:35.199243+0000","last_peered":"2024-04-25T01:39:35.199243+0000","last_clean":"2024-04-25T01:39:35.199243+0000","last_became_active":"2024-04-25T01:39:24.398449+0000","last_became_peered":"2024-04-25T01:39:24.398449+0000","last_unstale":"2024-04-25T01:39:35.199243+0000","last_undegraded":"2024-04-25T01:39:35.199243+0000","last_fullsized":"2024-04-25T01:39:35.199243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:41:38.230939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197750+0000","last_change":"2024-04-25T01:39:33.436488+0000","last_active":"2024-04-25T01:39:35.197750+0000","last_peered":"2024-04-25T01:39:35.197750+0000","last_clean":"2024-04-25T01:39:35.197750+0000","last_became_active":"2024-04-25T01:39:33.436224+0000","last_became_peered":"2024-04-25T01:39:33.436224+0000","last_unstale":"2024-04-25T01:39:35.197750+0000","last_undegraded":"2024-04-25T01:39:35.197750+0000","last_fullsized":"2024-04-25T01:39:35.197750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:38.227206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559398+0000","last_change":"2024-04-25T01:39:24.386909+0000","last_active":"2024-04-25T01:39:34.559398+0000","last_peered":"2024-04-25T01:39:34.559398+0000","last_clean":"2024-04-25T01:39:34.559398+0000","last_became_active":"2024-04-25T01:39:24.386568+0000","last_became_peered":"2024-04-25T01:39:24.386568+0000","last_unstale":"2024-04-25T01:39:34.559398+0000","last_undegraded":"2024-04-25T01:39:34.559398+0000","last_fullsized":"2024-04-25T01:39:34.559398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:29.904064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197979+0000","last_change":"2024-04-25T01:39:33.440753+0000","last_active":"2024-04-25T01:39:35.197979+0000","last_peered":"2024-04-25T01:39:35.197979+0000","last_clean":"2024-04-25T01:39:35.197979+0000","last_became_active":"2024-04-25T01:39:33.440480+0000","last_became_peered":"2024-04-25T01:39:33.440480+0000","last_unstale":"2024-04-25T01:39:35.197979+0000","last_undegraded":"2024-04-25T01:39:35.197979+0000","last_fullsized":"2024-04-25T01:39:35.197979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:18.113293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197980+0000","last_change":"2024-04-25T01:39:24.386803+0000","last_active":"2024-04-25T01:39:35.197980+0000","last_peered":"2024-04-25T01:39:35.197980+0000","last_clean":"2024-04-25T01:39:35.197980+0000","last_became_active":"2024-04-25T01:39:24.386531+0000","last_became_peered":"2024-04-25T01:39:24.386531+0000","last_unstale":"2024-04-25T01:39:35.197980+0000","last_undegraded":"2024-04-25T01:39:35.197980+0000","last_fullsized":"2024-04-25T01:39:35.197980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:19.160345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198690+0000","last_change":"2024-04-25T01:39:33.436433+0000","last_active":"2024-04-25T01:39:35.198690+0000","last_peered":"2024-04-25T01:39:35.198690+0000","last_clean":"2024-04-25T01:39:35.198690+0000","last_became_active":"2024-04-25T01:39:33.436134+0000","last_became_peered":"2024-04-25T01:39:33.436134+0000","last_unstale":"2024-04-25T01:39:35.198690+0000","last_undegraded":"2024-04-25T01:39:35.198690+0000","last_fullsized":"2024-04-25T01:39:35.198690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:08:30.641790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200300+0000","last_change":"2024-04-25T01:39:24.396231+0000","last_active":"2024-04-25T01:39:35.200300+0000","last_peered":"2024-04-25T01:39:35.200300+0000","last_clean":"2024-04-25T01:39:35.200300+0000","last_became_active":"2024-04-25T01:39:24.395958+0000","last_became_peered":"2024-04-25T01:39:24.395958+0000","last_unstale":"2024-04-25T01:39:35.200300+0000","last_undegraded":"2024-04-25T01:39:35.200300+0000","last_fullsized":"2024-04-25T01:39:35.200300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:54.898765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2666,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":690301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":101745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":99491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":102763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":101055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T01:40:02.920 INFO:tasks.mds_thrash.ceph_manager:clean! 2024-04-25T01:40:02.920 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T01:40:03.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.065+0000 7fb327529640 1 Processor -- start 2024-04-25T01:40:03.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.066+0000 7fb327529640 1 -- start start 2024-04-25T01:40:03.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.066+0000 7fb327529640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb320150090 0x7fb320156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:03.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.066+0000 7fb327529640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3200c8200 0x7fb3200c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:03.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.066+0000 7fb327529640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb32006c280 0x7fb3200c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:03.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.066+0000 7fb327529640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb32006b830 con 0x7fb320150090 2024-04-25T01:40:03.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.066+0000 7fb327529640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fb3200c9de0 con 0x7fb32006c280 2024-04-25T01:40:03.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.066+0000 7fb327529640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb3200c89c0 con 0x7fb3200c8200 2024-04-25T01:40:03.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.066+0000 7fb3252c5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb320150090 0x7fb320156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:03.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.067+0000 7fb3252c5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb320150090 0x7fb320156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39034/0 (socket says 172.21.15.77:39034) 2024-04-25T01:40:03.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.067+0000 7fb3252c5640 1 -- 172.21.15.77:0/3999542869 learned_addr learned my addr 172.21.15.77:0/3999542869 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:03.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.067+0000 7fb324ac4640 1 --2- 172.21.15.77:0/3999542869 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3200c8200 0x7fb3200c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:03.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.067+0000 7fb325ac6640 1 --2- 172.21.15.77:0/3999542869 >> v2:172.21.15.121:3300/0 conn(0x7fb32006c280 0x7fb3200c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:03.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.067+0000 7fb3252c5640 1 -- 172.21.15.77:0/3999542869 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3200c8200 msgr2=0x7fb3200c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:03.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.067+0000 7fb3252c5640 1 --2- 172.21.15.77:0/3999542869 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3200c8200 0x7fb3200c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.067+0000 7fb3252c5640 1 -- 172.21.15.77:0/3999542869 >> v2:172.21.15.121:3300/0 conn(0x7fb32006c280 msgr2=0x7fb3200c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:03.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.067+0000 7fb3252c5640 1 --2- 172.21.15.77:0/3999542869 >> v2:172.21.15.121:3300/0 conn(0x7fb32006c280 0x7fb3200c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.067+0000 7fb3252c5640 1 -- 172.21.15.77:0/3999542869 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3200c8ca0 con 0x7fb320150090 2024-04-25T01:40:03.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.067+0000 7fb3252c5640 1 --2- 172.21.15.77:0/3999542869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb320150090 0x7fb320156c80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb3200ab3d0 tx=0x7fb31402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=229c1ee564f0c3fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:03.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.068+0000 7fb313fff640 1 -- 172.21.15.77:0/3999542869 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb314037070 con 0x7fb320150090 2024-04-25T01:40:03.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.068+0000 7fb313fff640 1 -- 172.21.15.77:0/3999542869 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb314032440 con 0x7fb320150090 2024-04-25T01:40:03.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.068+0000 7fb313fff640 1 -- 172.21.15.77:0/3999542869 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb314032810 con 0x7fb320150090 2024-04-25T01:40:03.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.068+0000 7fb327529640 1 -- 172.21.15.77:0/3999542869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb320150090 msgr2=0x7fb320156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:03.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.068+0000 7fb327529640 1 --2- 172.21.15.77:0/3999542869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb320150090 0x7fb320156c80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb3200ab3d0 tx=0x7fb31402a1e0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.068+0000 7fb327529640 1 -- 172.21.15.77:0/3999542869 shutdown_connections 2024-04-25T01:40:03.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.068+0000 7fb327529640 1 --2- 172.21.15.77:0/3999542869 >> v2:172.21.15.121:3300/0 conn(0x7fb32006c280 0x7fb3200c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.068+0000 7fb327529640 1 --2- 172.21.15.77:0/3999542869 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3200c8200 0x7fb3200c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.068+0000 7fb327529640 1 --2- 172.21.15.77:0/3999542869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb320150090 0x7fb320156c80 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.068+0000 7fb327529640 1 -- 172.21.15.77:0/3999542869 >> 172.21.15.77:0/3999542869 conn(0x7fb3200ad4d0 msgr2=0x7fb3200ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:03.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.068+0000 7fb327529640 1 -- 172.21.15.77:0/3999542869 shutdown_connections 2024-04-25T01:40:03.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.068+0000 7fb327529640 1 -- 172.21.15.77:0/3999542869 wait complete. 2024-04-25T01:40:03.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.069+0000 7fb327529640 1 Processor -- start 2024-04-25T01:40:03.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.069+0000 7fb327529640 1 -- start start 2024-04-25T01:40:03.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.070+0000 7fb327529640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb32006c280 0x7fb3200c2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:03.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.070+0000 7fb327529640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3200c8200 0x7fb3201e8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:03.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.070+0000 7fb327529640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb320150090 0x7fb3201e9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:03.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.070+0000 7fb327529640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb3200c86b0 con 0x7fb32006c280 2024-04-25T01:40:03.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.070+0000 7fb327529640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb32006bd60 con 0x7fb320150090 2024-04-25T01:40:03.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.070+0000 7fb327529640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb32006c6d0 con 0x7fb3200c8200 2024-04-25T01:40:03.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.070+0000 7fb3252c5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb32006c280 0x7fb3200c2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:03.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.070+0000 7fb3252c5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb32006c280 0x7fb3200c2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39048/0 (socket says 172.21.15.77:39048) 2024-04-25T01:40:03.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.070+0000 7fb3252c5640 1 -- 172.21.15.77:0/2402497327 learned_addr learned my addr 172.21.15.77:0/2402497327 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:03.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.070+0000 7fb324ac4640 1 --2- 172.21.15.77:0/2402497327 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3200c8200 0x7fb3201e8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:03.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.070+0000 7fb325ac6640 1 --2- 172.21.15.77:0/2402497327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb320150090 0x7fb3201e9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:03.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.070+0000 7fb3252c5640 1 -- 172.21.15.77:0/2402497327 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3200c8200 msgr2=0x7fb3201e8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:03.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.070+0000 7fb3252c5640 1 --2- 172.21.15.77:0/2402497327 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3200c8200 0x7fb3201e8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.070+0000 7fb3252c5640 1 -- 172.21.15.77:0/2402497327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb320150090 msgr2=0x7fb3201e9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:03.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.070+0000 7fb3252c5640 1 --2- 172.21.15.77:0/2402497327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb320150090 0x7fb3201e9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.070+0000 7fb3252c5640 1 -- 172.21.15.77:0/2402497327 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3201eef00 con 0x7fb32006c280 2024-04-25T01:40:03.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.071+0000 7fb3252c5640 1 --2- 172.21.15.77:0/2402497327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb32006c280 0x7fb3200c2ce0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb31402a220 tx=0x7fb3140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:03.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.071+0000 7fb311ffb640 1 -- 172.21.15.77:0/2402497327 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb314041020 con 0x7fb32006c280 2024-04-25T01:40:03.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.071+0000 7fb311ffb640 1 -- 172.21.15.77:0/2402497327 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3140306c0 con 0x7fb32006c280 2024-04-25T01:40:03.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.071+0000 7fb311ffb640 1 -- 172.21.15.77:0/2402497327 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb314037040 con 0x7fb32006c280 2024-04-25T01:40:03.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.071+0000 7fb327529640 1 -- 172.21.15.77:0/2402497327 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3201ef1e0 con 0x7fb32006c280 2024-04-25T01:40:03.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.071+0000 7fb327529640 1 -- 172.21.15.77:0/2402497327 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3201ef7a0 con 0x7fb32006c280 2024-04-25T01:40:03.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.072+0000 7fb327529640 1 -- 172.21.15.77:0/2402497327 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb32004f500 con 0x7fb32006c280 2024-04-25T01:40:03.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.072+0000 7fb311ffb640 1 -- 172.21.15.77:0/2402497327 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb314044020 con 0x7fb32006c280 2024-04-25T01:40:03.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.073+0000 7fb311ffb640 1 --2- 172.21.15.77:0/2402497327 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb30406be30 0x7fb30406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:03.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.073+0000 7fb311ffb640 1 -- 172.21.15.77:0/2402497327 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fb3140ab760 con 0x7fb32006c280 2024-04-25T01:40:03.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.073+0000 7fb324ac4640 1 --2- 172.21.15.77:0/2402497327 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb30406be30 0x7fb30406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:03.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.073+0000 7fb324ac4640 1 --2- 172.21.15.77:0/2402497327 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb30406be30 0x7fb30406e2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb320154ad0 tx=0x7fb31c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:03.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.077+0000 7fb311ffb640 1 -- 172.21.15.77:0/2402497327 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb31404b030 con 0x7fb32006c280 2024-04-25T01:40:03.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.247+0000 7fb327529640 1 -- 172.21.15.77:0/2402497327 --> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb32006cec0 con 0x7fb30406be30 2024-04-25T01:40:03.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.257+0000 7fb311ffb640 1 -- 172.21.15.77:0/2402497327 <== mgr.4098 v2:172.21.15.77:6832/4208232183 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490299 (secure 0 0 0) 0x7fb32006cec0 con 0x7fb30406be30 2024-04-25T01:40:03.246 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:40:03.250 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-25T01:40:03.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.261+0000 7fb327529640 1 -- 172.21.15.77:0/2402497327 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb30406be30 msgr2=0x7fb30406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:03.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.261+0000 7fb327529640 1 --2- 172.21.15.77:0/2402497327 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb30406be30 0x7fb30406e2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb320154ad0 tx=0x7fb31c008040 comp rx=0 tx=0).stop 2024-04-25T01:40:03.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.261+0000 7fb327529640 1 -- 172.21.15.77:0/2402497327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb32006c280 msgr2=0x7fb3200c2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:03.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.261+0000 7fb327529640 1 --2- 172.21.15.77:0/2402497327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb32006c280 0x7fb3200c2ce0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb31402a220 tx=0x7fb3140046c0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.261+0000 7fb327529640 1 -- 172.21.15.77:0/2402497327 shutdown_connections 2024-04-25T01:40:03.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.261+0000 7fb327529640 1 --2- 172.21.15.77:0/2402497327 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb30406be30 0x7fb30406e2f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.261+0000 7fb327529640 1 --2- 172.21.15.77:0/2402497327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb320150090 0x7fb3201e9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.261+0000 7fb327529640 1 --2- 172.21.15.77:0/2402497327 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3200c8200 0x7fb3201e8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.261+0000 7fb327529640 1 --2- 172.21.15.77:0/2402497327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb32006c280 0x7fb3200c2ce0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.261+0000 7fb327529640 1 -- 172.21.15.77:0/2402497327 >> 172.21.15.77:0/2402497327 conn(0x7fb3200ad4d0 msgr2=0x7fb320154b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:03.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.261+0000 7fb327529640 1 -- 172.21.15.77:0/2402497327 shutdown_connections 2024-04-25T01:40:03.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.261+0000 7fb327529640 1 -- 172.21.15.77:0/2402497327 wait complete. 2024-04-25T01:40:03.256 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-04-25T01:40:01.659550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595444,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219444,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755276,"statfs":{"total":773094113280,"available":772869402624,"internally_reserved":0,"allocated":3350528,"data_stored":1984976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":256,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002726"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197412+0000","last_change":"2024-04-25T01:39:33.445614+0000","last_active":"2024-04-25T01:39:35.197412+0000","last_peered":"2024-04-25T01:39:35.197412+0000","last_clean":"2024-04-25T01:39:35.197412+0000","last_became_active":"2024-04-25T01:39:33.445090+0000","last_became_peered":"2024-04-25T01:39:33.445090+0000","last_unstale":"2024-04-25T01:39:35.197412+0000","last_undegraded":"2024-04-25T01:39:35.197412+0000","last_fullsized":"2024-04-25T01:39:35.197412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:50.951488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559582+0000","last_change":"2024-04-25T01:39:23.377096+0000","last_active":"2024-04-25T01:39:34.559582+0000","last_peered":"2024-04-25T01:39:34.559582+0000","last_clean":"2024-04-25T01:39:34.559582+0000","last_became_active":"2024-04-25T01:39:23.376811+0000","last_became_peered":"2024-04-25T01:39:23.376811+0000","last_unstale":"2024-04-25T01:39:34.559582+0000","last_undegraded":"2024-04-25T01:39:34.559582+0000","last_fullsized":"2024-04-25T01:39:34.559582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:26.888605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430280+0000","last_change":"2024-04-25T01:39:24.394317+0000","last_active":"2024-04-25T01:39:34.430280+0000","last_peered":"2024-04-25T01:39:34.430280+0000","last_clean":"2024-04-25T01:39:34.430280+0000","last_became_active":"2024-04-25T01:39:24.394032+0000","last_became_peered":"2024-04-25T01:39:24.394032+0000","last_unstale":"2024-04-25T01:39:34.430280+0000","last_undegraded":"2024-04-25T01:39:34.430280+0000","last_fullsized":"2024-04-25T01:39:34.430280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:11.795443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429310+0000","last_change":"2024-04-25T01:39:32.421607+0000","last_active":"2024-04-25T01:39:34.429310+0000","last_peered":"2024-04-25T01:39:34.429310+0000","last_clean":"2024-04-25T01:39:34.429310+0000","last_became_active":"2024-04-25T01:39:32.421355+0000","last_became_peered":"2024-04-25T01:39:32.421355+0000","last_unstale":"2024-04-25T01:39:34.429310+0000","last_undegraded":"2024-04-25T01:39:34.429310+0000","last_fullsized":"2024-04-25T01:39:34.429310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:12:14.019262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198433+0000","last_change":"2024-04-25T01:39:33.436651+0000","last_active":"2024-04-25T01:39:35.198433+0000","last_peered":"2024-04-25T01:39:35.198433+0000","last_clean":"2024-04-25T01:39:35.198433+0000","last_became_active":"2024-04-25T01:39:33.436370+0000","last_became_peered":"2024-04-25T01:39:33.436370+0000","last_unstale":"2024-04-25T01:39:35.198433+0000","last_undegraded":"2024-04-25T01:39:35.198433+0000","last_fullsized":"2024-04-25T01:39:35.198433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:57:10.341738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430287+0000","last_change":"2024-04-25T01:39:23.369400+0000","last_active":"2024-04-25T01:39:34.430287+0000","last_peered":"2024-04-25T01:39:34.430287+0000","last_clean":"2024-04-25T01:39:34.430287+0000","last_became_active":"2024-04-25T01:39:23.368726+0000","last_became_peered":"2024-04-25T01:39:23.368726+0000","last_unstale":"2024-04-25T01:39:34.430287+0000","last_undegraded":"2024-04-25T01:39:34.430287+0000","last_fullsized":"2024-04-25T01:39:34.430287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:35:42.971179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559440+0000","last_change":"2024-04-25T01:39:24.403873+0000","last_active":"2024-04-25T01:39:34.559440+0000","last_peered":"2024-04-25T01:39:34.559440+0000","last_clean":"2024-04-25T01:39:34.559440+0000","last_became_active":"2024-04-25T01:39:24.403623+0000","last_became_peered":"2024-04-25T01:39:24.403623+0000","last_unstale":"2024-04-25T01:39:34.559440+0000","last_undegraded":"2024-04-25T01:39:34.559440+0000","last_fullsized":"2024-04-25T01:39:34.559440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:49.360933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197343+0000","last_change":"2024-04-25T01:39:32.430985+0000","last_active":"2024-04-25T01:39:35.197343+0000","last_peered":"2024-04-25T01:39:35.197343+0000","last_clean":"2024-04-25T01:39:35.197343+0000","last_became_active":"2024-04-25T01:39:32.430617+0000","last_became_peered":"2024-04-25T01:39:32.430617+0000","last_unstale":"2024-04-25T01:39:35.197343+0000","last_undegraded":"2024-04-25T01:39:35.197343+0000","last_fullsized":"2024-04-25T01:39:35.197343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:13.938619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199408+0000","last_change":"2024-04-25T01:39:33.444043+0000","last_active":"2024-04-25T01:39:35.199408+0000","last_peered":"2024-04-25T01:39:35.199408+0000","last_clean":"2024-04-25T01:39:35.199408+0000","last_became_active":"2024-04-25T01:39:33.443737+0000","last_became_peered":"2024-04-25T01:39:33.443737+0000","last_unstale":"2024-04-25T01:39:35.199408+0000","last_undegraded":"2024-04-25T01:39:35.199408+0000","last_fullsized":"2024-04-25T01:39:35.199408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:02:50.401910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199857+0000","last_change":"2024-04-25T01:39:23.377963+0000","last_active":"2024-04-25T01:39:35.199857+0000","last_peered":"2024-04-25T01:39:35.199857+0000","last_clean":"2024-04-25T01:39:35.199857+0000","last_became_active":"2024-04-25T01:39:23.377402+0000","last_became_peered":"2024-04-25T01:39:23.377402+0000","last_unstale":"2024-04-25T01:39:35.199857+0000","last_undegraded":"2024-04-25T01:39:35.199857+0000","last_fullsized":"2024-04-25T01:39:35.199857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:15.873450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199352+0000","last_change":"2024-04-25T01:39:24.394512+0000","last_active":"2024-04-25T01:39:35.199352+0000","last_peered":"2024-04-25T01:39:35.199352+0000","last_clean":"2024-04-25T01:39:35.199352+0000","last_became_active":"2024-04-25T01:39:24.393954+0000","last_became_peered":"2024-04-25T01:39:24.393954+0000","last_unstale":"2024-04-25T01:39:35.199352+0000","last_undegraded":"2024-04-25T01:39:35.199352+0000","last_fullsized":"2024-04-25T01:39:35.199352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:30.534400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197850+0000","last_change":"2024-04-25T01:39:32.428198+0000","last_active":"2024-04-25T01:39:35.197850+0000","last_peered":"2024-04-25T01:39:35.197850+0000","last_clean":"2024-04-25T01:39:35.197850+0000","last_became_active":"2024-04-25T01:39:32.427955+0000","last_became_peered":"2024-04-25T01:39:32.427955+0000","last_unstale":"2024-04-25T01:39:35.197850+0000","last_undegraded":"2024-04-25T01:39:35.197850+0000","last_fullsized":"2024-04-25T01:39:35.197850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:07.684150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198064+0000","last_change":"2024-04-25T01:39:33.439854+0000","last_active":"2024-04-25T01:39:35.198064+0000","last_peered":"2024-04-25T01:39:35.198064+0000","last_clean":"2024-04-25T01:39:35.198064+0000","last_became_active":"2024-04-25T01:39:33.439555+0000","last_became_peered":"2024-04-25T01:39:33.439555+0000","last_unstale":"2024-04-25T01:39:35.198064+0000","last_undegraded":"2024-04-25T01:39:35.198064+0000","last_fullsized":"2024-04-25T01:39:35.198064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:50.250748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198904+0000","last_change":"2024-04-25T01:39:23.377093+0000","last_active":"2024-04-25T01:39:35.198904+0000","last_peered":"2024-04-25T01:39:35.198904+0000","last_clean":"2024-04-25T01:39:35.198904+0000","last_became_active":"2024-04-25T01:39:23.376744+0000","last_became_peered":"2024-04-25T01:39:23.376744+0000","last_unstale":"2024-04-25T01:39:35.198904+0000","last_undegraded":"2024-04-25T01:39:35.198904+0000","last_fullsized":"2024-04-25T01:39:35.198904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:43.529618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200129+0000","last_change":"2024-04-25T01:39:24.393293+0000","last_active":"2024-04-25T01:39:35.200129+0000","last_peered":"2024-04-25T01:39:35.200129+0000","last_clean":"2024-04-25T01:39:35.200129+0000","last_became_active":"2024-04-25T01:39:24.393005+0000","last_became_peered":"2024-04-25T01:39:24.393005+0000","last_unstale":"2024-04-25T01:39:35.200129+0000","last_undegraded":"2024-04-25T01:39:35.200129+0000","last_fullsized":"2024-04-25T01:39:35.200129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:32.070747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197654+0000","last_change":"2024-04-25T01:39:32.428956+0000","last_active":"2024-04-25T01:39:35.197654+0000","last_peered":"2024-04-25T01:39:35.197654+0000","last_clean":"2024-04-25T01:39:35.197654+0000","last_became_active":"2024-04-25T01:39:32.428705+0000","last_became_peered":"2024-04-25T01:39:32.428705+0000","last_unstale":"2024-04-25T01:39:35.197654+0000","last_undegraded":"2024-04-25T01:39:35.197654+0000","last_fullsized":"2024-04-25T01:39:35.197654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:06:22.998986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198197+0000","last_change":"2024-04-25T01:39:33.446571+0000","last_active":"2024-04-25T01:39:35.198197+0000","last_peered":"2024-04-25T01:39:35.198197+0000","last_clean":"2024-04-25T01:39:35.198197+0000","last_became_active":"2024-04-25T01:39:33.446234+0000","last_became_peered":"2024-04-25T01:39:33.446234+0000","last_unstale":"2024-04-25T01:39:35.198197+0000","last_undegraded":"2024-04-25T01:39:35.198197+0000","last_fullsized":"2024-04-25T01:39:35.198197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:12.742092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434733+0000","last_change":"2024-04-25T01:39:24.398859+0000","last_active":"2024-04-25T01:39:34.434733+0000","last_peered":"2024-04-25T01:39:34.434733+0000","last_clean":"2024-04-25T01:39:34.434733+0000","last_became_active":"2024-04-25T01:39:24.398618+0000","last_became_peered":"2024-04-25T01:39:24.398618+0000","last_unstale":"2024-04-25T01:39:34.434733+0000","last_undegraded":"2024-04-25T01:39:34.434733+0000","last_fullsized":"2024-04-25T01:39:34.434733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:15.278376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199208+0000","last_change":"2024-04-25T01:39:23.377717+0000","last_active":"2024-04-25T01:39:35.199208+0000","last_peered":"2024-04-25T01:39:35.199208+0000","last_clean":"2024-04-25T01:39:35.199208+0000","last_became_active":"2024-04-25T01:39:23.377291+0000","last_became_peered":"2024-04-25T01:39:23.377291+0000","last_unstale":"2024-04-25T01:39:35.199208+0000","last_undegraded":"2024-04-25T01:39:35.199208+0000","last_fullsized":"2024-04-25T01:39:35.199208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:06.402745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197947+0000","last_change":"2024-04-25T01:39:32.426840+0000","last_active":"2024-04-25T01:39:35.197947+0000","last_peered":"2024-04-25T01:39:35.197947+0000","last_clean":"2024-04-25T01:39:35.197947+0000","last_became_active":"2024-04-25T01:39:32.426529+0000","last_became_peered":"2024-04-25T01:39:32.426529+0000","last_unstale":"2024-04-25T01:39:35.197947+0000","last_undegraded":"2024-04-25T01:39:35.197947+0000","last_fullsized":"2024-04-25T01:39:35.197947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:57.097685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198092+0000","last_change":"2024-04-25T01:39:33.437767+0000","last_active":"2024-04-25T01:39:35.198092+0000","last_peered":"2024-04-25T01:39:35.198092+0000","last_clean":"2024-04-25T01:39:35.198092+0000","last_became_active":"2024-04-25T01:39:33.437483+0000","last_became_peered":"2024-04-25T01:39:33.437483+0000","last_unstale":"2024-04-25T01:39:35.198092+0000","last_undegraded":"2024-04-25T01:39:35.198092+0000","last_fullsized":"2024-04-25T01:39:35.198092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:44.321779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429750+0000","last_change":"2024-04-25T01:39:24.387100+0000","last_active":"2024-04-25T01:39:34.429750+0000","last_peered":"2024-04-25T01:39:34.429750+0000","last_clean":"2024-04-25T01:39:34.429750+0000","last_became_active":"2024-04-25T01:39:24.386782+0000","last_became_peered":"2024-04-25T01:39:24.386782+0000","last_unstale":"2024-04-25T01:39:34.429750+0000","last_undegraded":"2024-04-25T01:39:34.429750+0000","last_fullsized":"2024-04-25T01:39:34.429750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:48.789139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198800+0000","last_change":"2024-04-25T01:39:23.368446+0000","last_active":"2024-04-25T01:39:35.198800+0000","last_peered":"2024-04-25T01:39:35.198800+0000","last_clean":"2024-04-25T01:39:35.198800+0000","last_became_active":"2024-04-25T01:39:23.368183+0000","last_became_peered":"2024-04-25T01:39:23.368183+0000","last_unstale":"2024-04-25T01:39:35.198800+0000","last_undegraded":"2024-04-25T01:39:35.198800+0000","last_fullsized":"2024-04-25T01:39:35.198800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:13.738756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198383+0000","last_change":"2024-04-25T01:39:32.427589+0000","last_active":"2024-04-25T01:39:35.198383+0000","last_peered":"2024-04-25T01:39:35.198383+0000","last_clean":"2024-04-25T01:39:35.198383+0000","last_became_active":"2024-04-25T01:39:32.427328+0000","last_became_peered":"2024-04-25T01:39:32.427328+0000","last_unstale":"2024-04-25T01:39:35.198383+0000","last_undegraded":"2024-04-25T01:39:35.198383+0000","last_fullsized":"2024-04-25T01:39:35.198383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:12.328303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199145+0000","last_change":"2024-04-25T01:39:33.447634+0000","last_active":"2024-04-25T01:39:35.199145+0000","last_peered":"2024-04-25T01:39:35.199145+0000","last_clean":"2024-04-25T01:39:35.199145+0000","last_became_active":"2024-04-25T01:39:33.445908+0000","last_became_peered":"2024-04-25T01:39:33.445908+0000","last_unstale":"2024-04-25T01:39:35.199145+0000","last_undegraded":"2024-04-25T01:39:35.199145+0000","last_fullsized":"2024-04-25T01:39:35.199145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:13.586396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429559+0000","last_change":"2024-04-25T01:39:24.373600+0000","last_active":"2024-04-25T01:39:34.429559+0000","last_peered":"2024-04-25T01:39:34.429559+0000","last_clean":"2024-04-25T01:39:34.429559+0000","last_became_active":"2024-04-25T01:39:24.373311+0000","last_became_peered":"2024-04-25T01:39:24.373311+0000","last_unstale":"2024-04-25T01:39:34.429559+0000","last_undegraded":"2024-04-25T01:39:34.429559+0000","last_fullsized":"2024-04-25T01:39:34.429559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:46.338959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197953+0000","last_change":"2024-04-25T01:39:23.377103+0000","last_active":"2024-04-25T01:39:35.197953+0000","last_peered":"2024-04-25T01:39:35.197953+0000","last_clean":"2024-04-25T01:39:35.197953+0000","last_became_active":"2024-04-25T01:39:23.376826+0000","last_became_peered":"2024-04-25T01:39:23.376826+0000","last_unstale":"2024-04-25T01:39:35.197953+0000","last_undegraded":"2024-04-25T01:39:35.197953+0000","last_fullsized":"2024-04-25T01:39:35.197953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:46.663754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198643+0000","last_change":"2024-04-25T01:39:32.426839+0000","last_active":"2024-04-25T01:39:35.198643+0000","last_peered":"2024-04-25T01:39:35.198643+0000","last_clean":"2024-04-25T01:39:35.198643+0000","last_became_active":"2024-04-25T01:39:32.426545+0000","last_became_peered":"2024-04-25T01:39:32.426545+0000","last_unstale":"2024-04-25T01:39:35.198643+0000","last_undegraded":"2024-04-25T01:39:35.198643+0000","last_fullsized":"2024-04-25T01:39:35.198643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:22.161839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199023+0000","last_change":"2024-04-25T01:39:33.444616+0000","last_active":"2024-04-25T01:39:35.199023+0000","last_peered":"2024-04-25T01:39:35.199023+0000","last_clean":"2024-04-25T01:39:35.199023+0000","last_became_active":"2024-04-25T01:39:33.444350+0000","last_became_peered":"2024-04-25T01:39:33.444350+0000","last_unstale":"2024-04-25T01:39:35.199023+0000","last_undegraded":"2024-04-25T01:39:35.199023+0000","last_fullsized":"2024-04-25T01:39:35.199023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:47:15.686320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198460+0000","last_change":"2024-04-25T01:39:24.386969+0000","last_active":"2024-04-25T01:39:35.198460+0000","last_peered":"2024-04-25T01:39:35.198460+0000","last_clean":"2024-04-25T01:39:35.198460+0000","last_became_active":"2024-04-25T01:39:24.386376+0000","last_became_peered":"2024-04-25T01:39:24.386376+0000","last_unstale":"2024-04-25T01:39:35.198460+0000","last_undegraded":"2024-04-25T01:39:35.198460+0000","last_fullsized":"2024-04-25T01:39:35.198460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:13:31.585462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198150+0000","last_change":"2024-04-25T01:39:23.378993+0000","last_active":"2024-04-25T01:39:35.198150+0000","last_peered":"2024-04-25T01:39:35.198150+0000","last_clean":"2024-04-25T01:39:35.198150+0000","last_became_active":"2024-04-25T01:39:23.376908+0000","last_became_peered":"2024-04-25T01:39:23.376908+0000","last_unstale":"2024-04-25T01:39:35.198150+0000","last_undegraded":"2024-04-25T01:39:35.198150+0000","last_fullsized":"2024-04-25T01:39:35.198150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:13:18.370559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199153+0000","last_change":"2024-04-25T01:39:32.433597+0000","last_active":"2024-04-25T01:39:35.199153+0000","last_peered":"2024-04-25T01:39:35.199153+0000","last_clean":"2024-04-25T01:39:35.199153+0000","last_became_active":"2024-04-25T01:39:32.433307+0000","last_became_peered":"2024-04-25T01:39:32.433307+0000","last_unstale":"2024-04-25T01:39:35.199153+0000","last_undegraded":"2024-04-25T01:39:35.199153+0000","last_fullsized":"2024-04-25T01:39:35.199153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:20.784385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429204+0000","last_change":"2024-04-25T01:39:33.427297+0000","last_active":"2024-04-25T01:39:34.429204+0000","last_peered":"2024-04-25T01:39:34.429204+0000","last_clean":"2024-04-25T01:39:34.429204+0000","last_became_active":"2024-04-25T01:39:33.426132+0000","last_became_peered":"2024-04-25T01:39:33.426132+0000","last_unstale":"2024-04-25T01:39:34.429204+0000","last_undegraded":"2024-04-25T01:39:34.429204+0000","last_fullsized":"2024-04-25T01:39:34.429204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:04.147341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559652+0000","last_change":"2024-04-25T01:39:24.393003+0000","last_active":"2024-04-25T01:39:34.559652+0000","last_peered":"2024-04-25T01:39:34.559652+0000","last_clean":"2024-04-25T01:39:34.559652+0000","last_became_active":"2024-04-25T01:39:24.392209+0000","last_became_peered":"2024-04-25T01:39:24.392209+0000","last_unstale":"2024-04-25T01:39:34.559652+0000","last_undegraded":"2024-04-25T01:39:34.559652+0000","last_fullsized":"2024-04-25T01:39:34.559652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:44:58.432859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434880+0000","last_change":"2024-04-25T01:39:23.379804+0000","last_active":"2024-04-25T01:39:34.434880+0000","last_peered":"2024-04-25T01:39:34.434880+0000","last_clean":"2024-04-25T01:39:34.434880+0000","last_became_active":"2024-04-25T01:39:23.379430+0000","last_became_peered":"2024-04-25T01:39:23.379430+0000","last_unstale":"2024-04-25T01:39:34.434880+0000","last_undegraded":"2024-04-25T01:39:34.434880+0000","last_fullsized":"2024-04-25T01:39:34.434880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:42:23.254767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198196+0000","last_change":"2024-04-25T01:39:32.432763+0000","last_active":"2024-04-25T01:39:35.198196+0000","last_peered":"2024-04-25T01:39:35.198196+0000","last_clean":"2024-04-25T01:39:35.198196+0000","last_became_active":"2024-04-25T01:39:32.432482+0000","last_became_peered":"2024-04-25T01:39:32.432482+0000","last_unstale":"2024-04-25T01:39:35.198196+0000","last_undegraded":"2024-04-25T01:39:35.198196+0000","last_fullsized":"2024-04-25T01:39:35.198196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:04.848726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197990+0000","last_change":"2024-04-25T01:39:33.445800+0000","last_active":"2024-04-25T01:39:35.197990+0000","last_peered":"2024-04-25T01:39:35.197990+0000","last_clean":"2024-04-25T01:39:35.197990+0000","last_became_active":"2024-04-25T01:39:33.445500+0000","last_became_peered":"2024-04-25T01:39:33.445500+0000","last_unstale":"2024-04-25T01:39:35.197990+0000","last_undegraded":"2024-04-25T01:39:35.197990+0000","last_fullsized":"2024-04-25T01:39:35.197990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:06:36.800043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430196+0000","last_change":"2024-04-25T01:39:24.375811+0000","last_active":"2024-04-25T01:39:34.430196+0000","last_peered":"2024-04-25T01:39:34.430196+0000","last_clean":"2024-04-25T01:39:34.430196+0000","last_became_active":"2024-04-25T01:39:24.375603+0000","last_became_peered":"2024-04-25T01:39:24.375603+0000","last_unstale":"2024-04-25T01:39:34.430196+0000","last_undegraded":"2024-04-25T01:39:34.430196+0000","last_fullsized":"2024-04-25T01:39:34.430196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:10:26.247501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198161+0000","last_change":"2024-04-25T01:39:23.377687+0000","last_active":"2024-04-25T01:39:35.198161+0000","last_peered":"2024-04-25T01:39:35.198161+0000","last_clean":"2024-04-25T01:39:35.198161+0000","last_became_active":"2024-04-25T01:39:23.377372+0000","last_became_peered":"2024-04-25T01:39:23.377372+0000","last_unstale":"2024-04-25T01:39:35.198161+0000","last_undegraded":"2024-04-25T01:39:35.198161+0000","last_fullsized":"2024-04-25T01:39:35.198161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:51.983659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429145+0000","last_change":"2024-04-25T01:39:32.430816+0000","last_active":"2024-04-25T01:39:34.429145+0000","last_peered":"2024-04-25T01:39:34.429145+0000","last_clean":"2024-04-25T01:39:34.429145+0000","last_became_active":"2024-04-25T01:39:32.430537+0000","last_became_peered":"2024-04-25T01:39:32.430537+0000","last_unstale":"2024-04-25T01:39:34.429145+0000","last_undegraded":"2024-04-25T01:39:34.429145+0000","last_fullsized":"2024-04-25T01:39:34.429145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:58.939453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434436+0000","last_change":"2024-04-25T01:39:33.440287+0000","last_active":"2024-04-25T01:39:34.434436+0000","last_peered":"2024-04-25T01:39:34.434436+0000","last_clean":"2024-04-25T01:39:34.434436+0000","last_became_active":"2024-04-25T01:39:33.439796+0000","last_became_peered":"2024-04-25T01:39:33.439796+0000","last_unstale":"2024-04-25T01:39:34.434436+0000","last_undegraded":"2024-04-25T01:39:34.434436+0000","last_fullsized":"2024-04-25T01:39:34.434436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:08.515401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198342+0000","last_change":"2024-04-25T01:39:24.376933+0000","last_active":"2024-04-25T01:39:35.198342+0000","last_peered":"2024-04-25T01:39:35.198342+0000","last_clean":"2024-04-25T01:39:35.198342+0000","last_became_active":"2024-04-25T01:39:24.376612+0000","last_became_peered":"2024-04-25T01:39:24.376612+0000","last_unstale":"2024-04-25T01:39:35.198342+0000","last_undegraded":"2024-04-25T01:39:35.198342+0000","last_fullsized":"2024-04-25T01:39:35.198342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:56:55.534200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199969+0000","last_change":"2024-04-25T01:39:23.378190+0000","last_active":"2024-04-25T01:39:35.199969+0000","last_peered":"2024-04-25T01:39:35.199969+0000","last_clean":"2024-04-25T01:39:35.199969+0000","last_became_active":"2024-04-25T01:39:23.377677+0000","last_became_peered":"2024-04-25T01:39:23.377677+0000","last_unstale":"2024-04-25T01:39:35.199969+0000","last_undegraded":"2024-04-25T01:39:35.199969+0000","last_fullsized":"2024-04-25T01:39:35.199969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:09.516058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559452+0000","last_change":"2024-04-25T01:39:32.431542+0000","last_active":"2024-04-25T01:39:34.559452+0000","last_peered":"2024-04-25T01:39:34.559452+0000","last_clean":"2024-04-25T01:39:34.559452+0000","last_became_active":"2024-04-25T01:39:32.431253+0000","last_became_peered":"2024-04-25T01:39:32.431253+0000","last_unstale":"2024-04-25T01:39:34.559452+0000","last_undegraded":"2024-04-25T01:39:34.559452+0000","last_fullsized":"2024-04-25T01:39:34.559452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:36.723239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559765+0000","last_change":"2024-04-25T01:39:33.448529+0000","last_active":"2024-04-25T01:39:34.559765+0000","last_peered":"2024-04-25T01:39:34.559765+0000","last_clean":"2024-04-25T01:39:34.559765+0000","last_became_active":"2024-04-25T01:39:33.448266+0000","last_became_peered":"2024-04-25T01:39:33.448266+0000","last_unstale":"2024-04-25T01:39:34.559765+0000","last_undegraded":"2024-04-25T01:39:34.559765+0000","last_fullsized":"2024-04-25T01:39:34.559765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:18.788470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200112+0000","last_change":"2024-04-25T01:39:24.390844+0000","last_active":"2024-04-25T01:39:35.200112+0000","last_peered":"2024-04-25T01:39:35.200112+0000","last_clean":"2024-04-25T01:39:35.200112+0000","last_became_active":"2024-04-25T01:39:24.390543+0000","last_became_peered":"2024-04-25T01:39:24.390543+0000","last_unstale":"2024-04-25T01:39:35.200112+0000","last_undegraded":"2024-04-25T01:39:35.200112+0000","last_fullsized":"2024-04-25T01:39:35.200112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:01:03.804058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198467+0000","last_change":"2024-04-25T01:39:23.368562+0000","last_active":"2024-04-25T01:39:35.198467+0000","last_peered":"2024-04-25T01:39:35.198467+0000","last_clean":"2024-04-25T01:39:35.198467+0000","last_became_active":"2024-04-25T01:39:23.368272+0000","last_became_peered":"2024-04-25T01:39:23.368272+0000","last_unstale":"2024-04-25T01:39:35.198467+0000","last_undegraded":"2024-04-25T01:39:35.198467+0000","last_fullsized":"2024-04-25T01:39:35.198467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:15.464993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198483+0000","last_change":"2024-04-25T01:39:32.430196+0000","last_active":"2024-04-25T01:39:35.198483+0000","last_peered":"2024-04-25T01:39:35.198483+0000","last_clean":"2024-04-25T01:39:35.198483+0000","last_became_active":"2024-04-25T01:39:32.429759+0000","last_became_peered":"2024-04-25T01:39:32.429759+0000","last_unstale":"2024-04-25T01:39:35.198483+0000","last_undegraded":"2024-04-25T01:39:35.198483+0000","last_fullsized":"2024-04-25T01:39:35.198483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:58:09.299194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559415+0000","last_change":"2024-04-25T01:39:33.440935+0000","last_active":"2024-04-25T01:39:34.559415+0000","last_peered":"2024-04-25T01:39:34.559415+0000","last_clean":"2024-04-25T01:39:34.559415+0000","last_became_active":"2024-04-25T01:39:33.439344+0000","last_became_peered":"2024-04-25T01:39:33.439344+0000","last_unstale":"2024-04-25T01:39:34.559415+0000","last_undegraded":"2024-04-25T01:39:34.559415+0000","last_fullsized":"2024-04-25T01:39:34.559415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:23.928991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199059+0000","last_change":"2024-04-25T01:39:24.389203+0000","last_active":"2024-04-25T01:39:35.199059+0000","last_peered":"2024-04-25T01:39:35.199059+0000","last_clean":"2024-04-25T01:39:35.199059+0000","last_became_active":"2024-04-25T01:39:24.388306+0000","last_became_peered":"2024-04-25T01:39:24.388306+0000","last_unstale":"2024-04-25T01:39:35.199059+0000","last_undegraded":"2024-04-25T01:39:35.199059+0000","last_fullsized":"2024-04-25T01:39:35.199059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:59:33.951161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198256+0000","last_change":"2024-04-25T01:39:23.375729+0000","last_active":"2024-04-25T01:39:35.198256+0000","last_peered":"2024-04-25T01:39:35.198256+0000","last_clean":"2024-04-25T01:39:35.198256+0000","last_became_active":"2024-04-25T01:39:23.375488+0000","last_became_peered":"2024-04-25T01:39:23.375488+0000","last_unstale":"2024-04-25T01:39:35.198256+0000","last_undegraded":"2024-04-25T01:39:35.198256+0000","last_fullsized":"2024-04-25T01:39:35.198256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:00.039083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198302+0000","last_change":"2024-04-25T01:39:32.427586+0000","last_active":"2024-04-25T01:39:35.198302+0000","last_peered":"2024-04-25T01:39:35.198302+0000","last_clean":"2024-04-25T01:39:35.198302+0000","last_became_active":"2024-04-25T01:39:32.427282+0000","last_became_peered":"2024-04-25T01:39:32.427282+0000","last_unstale":"2024-04-25T01:39:35.198302+0000","last_undegraded":"2024-04-25T01:39:35.198302+0000","last_fullsized":"2024-04-25T01:39:35.198302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:35.956279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197828+0000","last_change":"2024-04-25T01:39:33.438949+0000","last_active":"2024-04-25T01:39:35.197828+0000","last_peered":"2024-04-25T01:39:35.197828+0000","last_clean":"2024-04-25T01:39:35.197828+0000","last_became_active":"2024-04-25T01:39:33.438669+0000","last_became_peered":"2024-04-25T01:39:33.438669+0000","last_unstale":"2024-04-25T01:39:35.197828+0000","last_undegraded":"2024-04-25T01:39:35.197828+0000","last_fullsized":"2024-04-25T01:39:35.197828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:07.849060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197529+0000","last_change":"2024-04-25T01:39:24.377438+0000","last_active":"2024-04-25T01:39:35.197529+0000","last_peered":"2024-04-25T01:39:35.197529+0000","last_clean":"2024-04-25T01:39:35.197529+0000","last_became_active":"2024-04-25T01:39:24.377146+0000","last_became_peered":"2024-04-25T01:39:24.377146+0000","last_unstale":"2024-04-25T01:39:35.197529+0000","last_undegraded":"2024-04-25T01:39:35.197529+0000","last_fullsized":"2024-04-25T01:39:35.197529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:54:17.698561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198084+0000","last_change":"2024-04-25T01:39:23.371019+0000","last_active":"2024-04-25T01:39:35.198084+0000","last_peered":"2024-04-25T01:39:35.198084+0000","last_clean":"2024-04-25T01:39:35.198084+0000","last_became_active":"2024-04-25T01:39:23.370727+0000","last_became_peered":"2024-04-25T01:39:23.370727+0000","last_unstale":"2024-04-25T01:39:35.198084+0000","last_undegraded":"2024-04-25T01:39:35.198084+0000","last_fullsized":"2024-04-25T01:39:35.198084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:10.714475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198753+0000","last_change":"2024-04-25T01:39:32.431610+0000","last_active":"2024-04-25T01:39:35.198753+0000","last_peered":"2024-04-25T01:39:35.198753+0000","last_clean":"2024-04-25T01:39:35.198753+0000","last_became_active":"2024-04-25T01:39:32.431335+0000","last_became_peered":"2024-04-25T01:39:32.431335+0000","last_unstale":"2024-04-25T01:39:35.198753+0000","last_undegraded":"2024-04-25T01:39:35.198753+0000","last_fullsized":"2024-04-25T01:39:35.198753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:54.882078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199183+0000","last_change":"2024-04-25T01:39:33.438896+0000","last_active":"2024-04-25T01:39:35.199183+0000","last_peered":"2024-04-25T01:39:35.199183+0000","last_clean":"2024-04-25T01:39:35.199183+0000","last_became_active":"2024-04-25T01:39:33.438622+0000","last_became_peered":"2024-04-25T01:39:33.438622+0000","last_unstale":"2024-04-25T01:39:35.199183+0000","last_undegraded":"2024-04-25T01:39:35.199183+0000","last_fullsized":"2024-04-25T01:39:35.199183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:40:47.408809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559149+0000","last_change":"2024-04-25T01:39:24.391366+0000","last_active":"2024-04-25T01:39:34.559149+0000","last_peered":"2024-04-25T01:39:34.559149+0000","last_clean":"2024-04-25T01:39:34.559149+0000","last_became_active":"2024-04-25T01:39:24.391093+0000","last_became_peered":"2024-04-25T01:39:24.391093+0000","last_unstale":"2024-04-25T01:39:34.559149+0000","last_undegraded":"2024-04-25T01:39:34.559149+0000","last_fullsized":"2024-04-25T01:39:34.559149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:10.906935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198243+0000","last_change":"2024-04-25T01:39:23.379767+0000","last_active":"2024-04-25T01:39:35.198243+0000","last_peered":"2024-04-25T01:39:35.198243+0000","last_clean":"2024-04-25T01:39:35.198243+0000","last_became_active":"2024-04-25T01:39:23.379294+0000","last_became_peered":"2024-04-25T01:39:23.379294+0000","last_unstale":"2024-04-25T01:39:35.198243+0000","last_undegraded":"2024-04-25T01:39:35.198243+0000","last_fullsized":"2024-04-25T01:39:35.198243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:36:37.823796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559671+0000","last_change":"2024-04-25T01:39:32.429452+0000","last_active":"2024-04-25T01:39:34.559671+0000","last_peered":"2024-04-25T01:39:34.559671+0000","last_clean":"2024-04-25T01:39:34.559671+0000","last_became_active":"2024-04-25T01:39:32.429189+0000","last_became_peered":"2024-04-25T01:39:32.429189+0000","last_unstale":"2024-04-25T01:39:34.559671+0000","last_undegraded":"2024-04-25T01:39:34.559671+0000","last_fullsized":"2024-04-25T01:39:34.559671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:58:02.723851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198704+0000","last_change":"2024-04-25T01:39:33.438945+0000","last_active":"2024-04-25T01:39:35.198704+0000","last_peered":"2024-04-25T01:39:35.198704+0000","last_clean":"2024-04-25T01:39:35.198704+0000","last_became_active":"2024-04-25T01:39:33.438233+0000","last_became_peered":"2024-04-25T01:39:33.438233+0000","last_unstale":"2024-04-25T01:39:35.198704+0000","last_undegraded":"2024-04-25T01:39:35.198704+0000","last_fullsized":"2024-04-25T01:39:35.198704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:50.545311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429728+0000","last_change":"2024-04-25T01:39:24.401208+0000","last_active":"2024-04-25T01:39:34.429728+0000","last_peered":"2024-04-25T01:39:34.429728+0000","last_clean":"2024-04-25T01:39:34.429728+0000","last_became_active":"2024-04-25T01:39:24.400502+0000","last_became_peered":"2024-04-25T01:39:24.400502+0000","last_unstale":"2024-04-25T01:39:34.429728+0000","last_undegraded":"2024-04-25T01:39:34.429728+0000","last_fullsized":"2024-04-25T01:39:34.429728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:55:09.076617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198391+0000","last_change":"2024-04-25T01:39:23.367826+0000","last_active":"2024-04-25T01:39:35.198391+0000","last_peered":"2024-04-25T01:39:35.198391+0000","last_clean":"2024-04-25T01:39:35.198391+0000","last_became_active":"2024-04-25T01:39:23.367520+0000","last_became_peered":"2024-04-25T01:39:23.367520+0000","last_unstale":"2024-04-25T01:39:35.198391+0000","last_undegraded":"2024-04-25T01:39:35.198391+0000","last_fullsized":"2024-04-25T01:39:35.198391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:05.997166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199929+0000","last_change":"2024-04-25T01:39:12.918495+0000","last_active":"2024-04-25T01:39:35.199929+0000","last_peered":"2024-04-25T01:39:35.199929+0000","last_clean":"2024-04-25T01:39:35.199929+0000","last_became_active":"2024-04-25T01:39:12.917330+0000","last_became_peered":"2024-04-25T01:39:12.917330+0000","last_unstale":"2024-04-25T01:39:35.199929+0000","last_undegraded":"2024-04-25T01:39:35.199929+0000","last_fullsized":"2024-04-25T01:39:35.199929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:11.731178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:11.731178+0000","last_clean_scrub_stamp":"2024-04-25T01:39:11.731178+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:26:14.153244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434088+0000","last_change":"2024-04-25T01:39:32.431797+0000","last_active":"2024-04-25T01:39:34.434088+0000","last_peered":"2024-04-25T01:39:34.434088+0000","last_clean":"2024-04-25T01:39:34.434088+0000","last_became_active":"2024-04-25T01:39:32.431523+0000","last_became_peered":"2024-04-25T01:39:32.431523+0000","last_unstale":"2024-04-25T01:39:34.434088+0000","last_undegraded":"2024-04-25T01:39:34.434088+0000","last_fullsized":"2024-04-25T01:39:34.434088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:45.752128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198056+0000","last_change":"2024-04-25T01:39:33.440488+0000","last_active":"2024-04-25T01:39:35.198056+0000","last_peered":"2024-04-25T01:39:35.198056+0000","last_clean":"2024-04-25T01:39:35.198056+0000","last_became_active":"2024-04-25T01:39:33.440161+0000","last_became_peered":"2024-04-25T01:39:33.440161+0000","last_unstale":"2024-04-25T01:39:35.198056+0000","last_undegraded":"2024-04-25T01:39:35.198056+0000","last_fullsized":"2024-04-25T01:39:35.198056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:45.542876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199802+0000","last_change":"2024-04-25T01:39:24.394350+0000","last_active":"2024-04-25T01:39:35.199802+0000","last_peered":"2024-04-25T01:39:35.199802+0000","last_clean":"2024-04-25T01:39:35.199802+0000","last_became_active":"2024-04-25T01:39:24.393235+0000","last_became_peered":"2024-04-25T01:39:24.393235+0000","last_unstale":"2024-04-25T01:39:35.199802+0000","last_undegraded":"2024-04-25T01:39:35.199802+0000","last_fullsized":"2024-04-25T01:39:35.199802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:00:48.588700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198113+0000","last_change":"2024-04-25T01:39:23.368352+0000","last_active":"2024-04-25T01:39:35.198113+0000","last_peered":"2024-04-25T01:39:35.198113+0000","last_clean":"2024-04-25T01:39:35.198113+0000","last_became_active":"2024-04-25T01:39:23.368075+0000","last_became_peered":"2024-04-25T01:39:23.368075+0000","last_unstale":"2024-04-25T01:39:35.198113+0000","last_undegraded":"2024-04-25T01:39:35.198113+0000","last_fullsized":"2024-04-25T01:39:35.198113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:11.300091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434486+0000","last_change":"2024-04-25T01:39:32.430007+0000","last_active":"2024-04-25T01:39:34.434486+0000","last_peered":"2024-04-25T01:39:34.434486+0000","last_clean":"2024-04-25T01:39:34.434486+0000","last_became_active":"2024-04-25T01:39:32.429721+0000","last_became_peered":"2024-04-25T01:39:32.429721+0000","last_unstale":"2024-04-25T01:39:34.434486+0000","last_undegraded":"2024-04-25T01:39:34.434486+0000","last_fullsized":"2024-04-25T01:39:34.434486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:47.409375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197603+0000","last_change":"2024-04-25T01:39:33.447230+0000","last_active":"2024-04-25T01:39:35.197603+0000","last_peered":"2024-04-25T01:39:35.197603+0000","last_clean":"2024-04-25T01:39:35.197603+0000","last_became_active":"2024-04-25T01:39:33.446930+0000","last_became_peered":"2024-04-25T01:39:33.446930+0000","last_unstale":"2024-04-25T01:39:35.197603+0000","last_undegraded":"2024-04-25T01:39:35.197603+0000","last_fullsized":"2024-04-25T01:39:35.197603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:51:40.920560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199534+0000","last_change":"2024-04-25T01:39:24.394286+0000","last_active":"2024-04-25T01:39:35.199534+0000","last_peered":"2024-04-25T01:39:35.199534+0000","last_clean":"2024-04-25T01:39:35.199534+0000","last_became_active":"2024-04-25T01:39:24.393558+0000","last_became_peered":"2024-04-25T01:39:24.393558+0000","last_unstale":"2024-04-25T01:39:35.199534+0000","last_undegraded":"2024-04-25T01:39:35.199534+0000","last_fullsized":"2024-04-25T01:39:35.199534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:59.100947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198699+0000","last_change":"2024-04-25T01:39:23.370690+0000","last_active":"2024-04-25T01:39:35.198699+0000","last_peered":"2024-04-25T01:39:35.198699+0000","last_clean":"2024-04-25T01:39:35.198699+0000","last_became_active":"2024-04-25T01:39:23.370391+0000","last_became_peered":"2024-04-25T01:39:23.370391+0000","last_unstale":"2024-04-25T01:39:35.198699+0000","last_undegraded":"2024-04-25T01:39:35.198699+0000","last_fullsized":"2024-04-25T01:39:35.198699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:29.647636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559440+0000","last_change":"2024-04-25T01:39:32.429412+0000","last_active":"2024-04-25T01:39:34.559440+0000","last_peered":"2024-04-25T01:39:34.559440+0000","last_clean":"2024-04-25T01:39:34.559440+0000","last_became_active":"2024-04-25T01:39:32.429143+0000","last_became_peered":"2024-04-25T01:39:32.429143+0000","last_unstale":"2024-04-25T01:39:34.559440+0000","last_undegraded":"2024-04-25T01:39:34.559440+0000","last_fullsized":"2024-04-25T01:39:34.559440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:53.637245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198532+0000","last_change":"2024-04-25T01:39:33.437128+0000","last_active":"2024-04-25T01:39:35.198532+0000","last_peered":"2024-04-25T01:39:35.198532+0000","last_clean":"2024-04-25T01:39:35.198532+0000","last_became_active":"2024-04-25T01:39:33.436861+0000","last_became_peered":"2024-04-25T01:39:33.436861+0000","last_unstale":"2024-04-25T01:39:35.198532+0000","last_undegraded":"2024-04-25T01:39:35.198532+0000","last_fullsized":"2024-04-25T01:39:35.198532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:41.746373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200378+0000","last_change":"2024-04-25T01:39:24.392170+0000","last_active":"2024-04-25T01:39:35.200378+0000","last_peered":"2024-04-25T01:39:35.200378+0000","last_clean":"2024-04-25T01:39:35.200378+0000","last_became_active":"2024-04-25T01:39:24.391811+0000","last_became_peered":"2024-04-25T01:39:24.391811+0000","last_unstale":"2024-04-25T01:39:35.200378+0000","last_undegraded":"2024-04-25T01:39:35.200378+0000","last_fullsized":"2024-04-25T01:39:35.200378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:32.859676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197996+0000","last_change":"2024-04-25T01:39:23.369872+0000","last_active":"2024-04-25T01:39:35.197996+0000","last_peered":"2024-04-25T01:39:35.197996+0000","last_clean":"2024-04-25T01:39:35.197996+0000","last_became_active":"2024-04-25T01:39:23.369314+0000","last_became_peered":"2024-04-25T01:39:23.369314+0000","last_unstale":"2024-04-25T01:39:35.197996+0000","last_undegraded":"2024-04-25T01:39:35.197996+0000","last_fullsized":"2024-04-25T01:39:35.197996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:14.571148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197245+0000","last_change":"2024-04-25T01:39:32.429664+0000","last_active":"2024-04-25T01:39:35.197245+0000","last_peered":"2024-04-25T01:39:35.197245+0000","last_clean":"2024-04-25T01:39:35.197245+0000","last_became_active":"2024-04-25T01:39:32.429358+0000","last_became_peered":"2024-04-25T01:39:32.429358+0000","last_unstale":"2024-04-25T01:39:35.197245+0000","last_undegraded":"2024-04-25T01:39:35.197245+0000","last_fullsized":"2024-04-25T01:39:35.197245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:57:10.913056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197472+0000","last_change":"2024-04-25T01:39:33.440419+0000","last_active":"2024-04-25T01:39:35.197472+0000","last_peered":"2024-04-25T01:39:35.197472+0000","last_clean":"2024-04-25T01:39:35.197472+0000","last_became_active":"2024-04-25T01:39:33.440054+0000","last_became_peered":"2024-04-25T01:39:33.440054+0000","last_unstale":"2024-04-25T01:39:35.197472+0000","last_undegraded":"2024-04-25T01:39:35.197472+0000","last_fullsized":"2024-04-25T01:39:35.197472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:42.321235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199726+0000","last_change":"2024-04-25T01:39:24.391240+0000","last_active":"2024-04-25T01:39:35.199726+0000","last_peered":"2024-04-25T01:39:35.199726+0000","last_clean":"2024-04-25T01:39:35.199726+0000","last_became_active":"2024-04-25T01:39:24.390948+0000","last_became_peered":"2024-04-25T01:39:24.390948+0000","last_unstale":"2024-04-25T01:39:35.199726+0000","last_undegraded":"2024-04-25T01:39:35.199726+0000","last_fullsized":"2024-04-25T01:39:35.199726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:41:30.579190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198161+0000","last_change":"2024-04-25T01:39:23.367322+0000","last_active":"2024-04-25T01:39:35.198161+0000","last_peered":"2024-04-25T01:39:35.198161+0000","last_clean":"2024-04-25T01:39:35.198161+0000","last_became_active":"2024-04-25T01:39:23.367054+0000","last_became_peered":"2024-04-25T01:39:23.367054+0000","last_unstale":"2024-04-25T01:39:35.198161+0000","last_undegraded":"2024-04-25T01:39:35.198161+0000","last_fullsized":"2024-04-25T01:39:35.198161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:10.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197919+0000","last_change":"2024-04-25T01:39:32.426874+0000","last_active":"2024-04-25T01:39:35.197919+0000","last_peered":"2024-04-25T01:39:35.197919+0000","last_clean":"2024-04-25T01:39:35.197919+0000","last_became_active":"2024-04-25T01:39:32.426599+0000","last_became_peered":"2024-04-25T01:39:32.426599+0000","last_unstale":"2024-04-25T01:39:35.197919+0000","last_undegraded":"2024-04-25T01:39:35.197919+0000","last_fullsized":"2024-04-25T01:39:35.197919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:27.672277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430134+0000","last_change":"2024-04-25T01:39:33.428909+0000","last_active":"2024-04-25T01:39:34.430134+0000","last_peered":"2024-04-25T01:39:34.430134+0000","last_clean":"2024-04-25T01:39:34.430134+0000","last_became_active":"2024-04-25T01:39:33.428626+0000","last_became_peered":"2024-04-25T01:39:33.428626+0000","last_unstale":"2024-04-25T01:39:34.430134+0000","last_undegraded":"2024-04-25T01:39:34.430134+0000","last_fullsized":"2024-04-25T01:39:34.430134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:21.188264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199068+0000","last_change":"2024-04-25T01:39:24.389946+0000","last_active":"2024-04-25T01:39:35.199068+0000","last_peered":"2024-04-25T01:39:35.199068+0000","last_clean":"2024-04-25T01:39:35.199068+0000","last_became_active":"2024-04-25T01:39:24.389656+0000","last_became_peered":"2024-04-25T01:39:24.389656+0000","last_unstale":"2024-04-25T01:39:35.199068+0000","last_undegraded":"2024-04-25T01:39:35.199068+0000","last_fullsized":"2024-04-25T01:39:35.199068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:55.943639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197475+0000","last_change":"2024-04-25T01:39:23.373599+0000","last_active":"2024-04-25T01:39:35.197475+0000","last_peered":"2024-04-25T01:39:35.197475+0000","last_clean":"2024-04-25T01:39:35.197475+0000","last_became_active":"2024-04-25T01:39:23.373281+0000","last_became_peered":"2024-04-25T01:39:23.373281+0000","last_unstale":"2024-04-25T01:39:35.197475+0000","last_undegraded":"2024-04-25T01:39:35.197475+0000","last_fullsized":"2024-04-25T01:39:35.197475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:40.850925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559604+0000","last_change":"2024-04-25T01:39:32.427502+0000","last_active":"2024-04-25T01:39:34.559604+0000","last_peered":"2024-04-25T01:39:34.559604+0000","last_clean":"2024-04-25T01:39:34.559604+0000","last_became_active":"2024-04-25T01:39:32.426499+0000","last_became_peered":"2024-04-25T01:39:32.426499+0000","last_unstale":"2024-04-25T01:39:34.559604+0000","last_undegraded":"2024-04-25T01:39:34.559604+0000","last_fullsized":"2024-04-25T01:39:34.559604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:26.977416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198695+0000","last_change":"2024-04-25T01:39:33.436901+0000","last_active":"2024-04-25T01:39:35.198695+0000","last_peered":"2024-04-25T01:39:35.198695+0000","last_clean":"2024-04-25T01:39:35.198695+0000","last_became_active":"2024-04-25T01:39:33.436001+0000","last_became_peered":"2024-04-25T01:39:33.436001+0000","last_unstale":"2024-04-25T01:39:35.198695+0000","last_undegraded":"2024-04-25T01:39:35.198695+0000","last_fullsized":"2024-04-25T01:39:35.198695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:34:41.678663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.433897+0000","last_change":"2024-04-25T01:39:24.394248+0000","last_active":"2024-04-25T01:39:34.433897+0000","last_peered":"2024-04-25T01:39:34.433897+0000","last_clean":"2024-04-25T01:39:34.433897+0000","last_became_active":"2024-04-25T01:39:24.393958+0000","last_became_peered":"2024-04-25T01:39:24.393958+0000","last_unstale":"2024-04-25T01:39:34.433897+0000","last_undegraded":"2024-04-25T01:39:34.433897+0000","last_fullsized":"2024-04-25T01:39:34.433897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:35.087577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434426+0000","last_change":"2024-04-25T01:39:23.372939+0000","last_active":"2024-04-25T01:39:34.434426+0000","last_peered":"2024-04-25T01:39:34.434426+0000","last_clean":"2024-04-25T01:39:34.434426+0000","last_became_active":"2024-04-25T01:39:23.372648+0000","last_became_peered":"2024-04-25T01:39:23.372648+0000","last_unstale":"2024-04-25T01:39:34.434426+0000","last_undegraded":"2024-04-25T01:39:34.434426+0000","last_fullsized":"2024-04-25T01:39:34.434426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:02:13.283096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430096+0000","last_change":"2024-04-25T01:39:32.432218+0000","last_active":"2024-04-25T01:39:34.430096+0000","last_peered":"2024-04-25T01:39:34.430096+0000","last_clean":"2024-04-25T01:39:34.430096+0000","last_became_active":"2024-04-25T01:39:32.431938+0000","last_became_peered":"2024-04-25T01:39:32.431938+0000","last_unstale":"2024-04-25T01:39:34.430096+0000","last_undegraded":"2024-04-25T01:39:34.430096+0000","last_fullsized":"2024-04-25T01:39:34.430096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:56:15.053817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199747+0000","last_change":"2024-04-25T01:39:33.441342+0000","last_active":"2024-04-25T01:39:35.199747+0000","last_peered":"2024-04-25T01:39:35.199747+0000","last_clean":"2024-04-25T01:39:35.199747+0000","last_became_active":"2024-04-25T01:39:33.441074+0000","last_became_peered":"2024-04-25T01:39:33.441074+0000","last_unstale":"2024-04-25T01:39:35.199747+0000","last_undegraded":"2024-04-25T01:39:35.199747+0000","last_fullsized":"2024-04-25T01:39:35.199747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:22:43.000112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199029+0000","last_change":"2024-04-25T01:39:24.390114+0000","last_active":"2024-04-25T01:39:35.199029+0000","last_peered":"2024-04-25T01:39:35.199029+0000","last_clean":"2024-04-25T01:39:35.199029+0000","last_became_active":"2024-04-25T01:39:24.389841+0000","last_became_peered":"2024-04-25T01:39:24.389841+0000","last_unstale":"2024-04-25T01:39:35.199029+0000","last_undegraded":"2024-04-25T01:39:35.199029+0000","last_fullsized":"2024-04-25T01:39:35.199029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:34.950624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198167+0000","last_change":"2024-04-25T01:39:23.369440+0000","last_active":"2024-04-25T01:39:35.198167+0000","last_peered":"2024-04-25T01:39:35.198167+0000","last_clean":"2024-04-25T01:39:35.198167+0000","last_became_active":"2024-04-25T01:39:23.369151+0000","last_became_peered":"2024-04-25T01:39:23.369151+0000","last_unstale":"2024-04-25T01:39:35.198167+0000","last_undegraded":"2024-04-25T01:39:35.198167+0000","last_fullsized":"2024-04-25T01:39:35.198167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:31:46.921287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"23'6","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429666+0000","last_change":"2024-04-25T01:39:32.430701+0000","last_active":"2024-04-25T01:39:34.429666+0000","last_peered":"2024-04-25T01:39:34.429666+0000","last_clean":"2024-04-25T01:39:34.429666+0000","last_became_active":"2024-04-25T01:39:32.430187+0000","last_became_peered":"2024-04-25T01:39:32.430187+0000","last_unstale":"2024-04-25T01:39:34.429666+0000","last_undegraded":"2024-04-25T01:39:34.429666+0000","last_fullsized":"2024-04-25T01:39:34.429666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:57.148375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429767+0000","last_change":"2024-04-25T01:39:33.427429+0000","last_active":"2024-04-25T01:39:34.429767+0000","last_peered":"2024-04-25T01:39:34.429767+0000","last_clean":"2024-04-25T01:39:34.429767+0000","last_became_active":"2024-04-25T01:39:33.427164+0000","last_became_peered":"2024-04-25T01:39:33.427164+0000","last_unstale":"2024-04-25T01:39:34.429767+0000","last_undegraded":"2024-04-25T01:39:34.429767+0000","last_fullsized":"2024-04-25T01:39:34.429767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:33:59.664252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559246+0000","last_change":"2024-04-25T01:39:24.388852+0000","last_active":"2024-04-25T01:39:34.559246+0000","last_peered":"2024-04-25T01:39:34.559246+0000","last_clean":"2024-04-25T01:39:34.559246+0000","last_became_active":"2024-04-25T01:39:24.388594+0000","last_became_peered":"2024-04-25T01:39:24.388594+0000","last_unstale":"2024-04-25T01:39:34.559246+0000","last_undegraded":"2024-04-25T01:39:34.559246+0000","last_fullsized":"2024-04-25T01:39:34.559246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:46:49.718182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559847+0000","last_change":"2024-04-25T01:39:23.372903+0000","last_active":"2024-04-25T01:39:34.559847+0000","last_peered":"2024-04-25T01:39:34.559847+0000","last_clean":"2024-04-25T01:39:34.559847+0000","last_became_active":"2024-04-25T01:39:23.372617+0000","last_became_peered":"2024-04-25T01:39:23.372617+0000","last_unstale":"2024-04-25T01:39:34.559847+0000","last_undegraded":"2024-04-25T01:39:34.559847+0000","last_fullsized":"2024-04-25T01:39:34.559847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:54:58.506432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199994+0000","last_change":"2024-04-25T01:39:32.430218+0000","last_active":"2024-04-25T01:39:35.199994+0000","last_peered":"2024-04-25T01:39:35.199994+0000","last_clean":"2024-04-25T01:39:35.199994+0000","last_became_active":"2024-04-25T01:39:32.429900+0000","last_became_peered":"2024-04-25T01:39:32.429900+0000","last_unstale":"2024-04-25T01:39:35.199994+0000","last_undegraded":"2024-04-25T01:39:35.199994+0000","last_fullsized":"2024-04-25T01:39:35.199994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:52.253045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429707+0000","last_change":"2024-04-25T01:39:33.440325+0000","last_active":"2024-04-25T01:39:34.429707+0000","last_peered":"2024-04-25T01:39:34.429707+0000","last_clean":"2024-04-25T01:39:34.429707+0000","last_became_active":"2024-04-25T01:39:33.439961+0000","last_became_peered":"2024-04-25T01:39:33.439961+0000","last_unstale":"2024-04-25T01:39:34.429707+0000","last_undegraded":"2024-04-25T01:39:34.429707+0000","last_fullsized":"2024-04-25T01:39:34.429707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:01.846576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199750+0000","last_change":"2024-04-25T01:39:24.380617+0000","last_active":"2024-04-25T01:39:35.199750+0000","last_peered":"2024-04-25T01:39:35.199750+0000","last_clean":"2024-04-25T01:39:35.199750+0000","last_became_active":"2024-04-25T01:39:24.380330+0000","last_became_peered":"2024-04-25T01:39:24.380330+0000","last_unstale":"2024-04-25T01:39:35.199750+0000","last_undegraded":"2024-04-25T01:39:35.199750+0000","last_fullsized":"2024-04-25T01:39:35.199750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:24.010569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:55.705604+0000","last_change":"2024-04-25T01:39:23.373295+0000","last_active":"2024-04-25T01:39:55.705604+0000","last_peered":"2024-04-25T01:39:55.705604+0000","last_clean":"2024-04-25T01:39:55.705604+0000","last_became_active":"2024-04-25T01:39:23.372984+0000","last_became_peered":"2024-04-25T01:39:23.372984+0000","last_unstale":"2024-04-25T01:39:55.705604+0000","last_undegraded":"2024-04-25T01:39:55.705604+0000","last_fullsized":"2024-04-25T01:39:55.705604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:10.854190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1868,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198248+0000","last_change":"2024-04-25T01:39:32.433589+0000","last_active":"2024-04-25T01:39:35.198248+0000","last_peered":"2024-04-25T01:39:35.198248+0000","last_clean":"2024-04-25T01:39:35.198248+0000","last_became_active":"2024-04-25T01:39:32.433408+0000","last_became_peered":"2024-04-25T01:39:32.433408+0000","last_unstale":"2024-04-25T01:39:35.198248+0000","last_undegraded":"2024-04-25T01:39:35.198248+0000","last_fullsized":"2024-04-25T01:39:35.198248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:25.789951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198708+0000","last_change":"2024-04-25T01:39:33.433449+0000","last_active":"2024-04-25T01:39:35.198708+0000","last_peered":"2024-04-25T01:39:35.198708+0000","last_clean":"2024-04-25T01:39:35.198708+0000","last_became_active":"2024-04-25T01:39:33.432690+0000","last_became_peered":"2024-04-25T01:39:33.432690+0000","last_unstale":"2024-04-25T01:39:35.198708+0000","last_undegraded":"2024-04-25T01:39:35.198708+0000","last_fullsized":"2024-04-25T01:39:35.198708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:30.046453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198838+0000","last_change":"2024-04-25T01:39:24.391245+0000","last_active":"2024-04-25T01:39:35.198838+0000","last_peered":"2024-04-25T01:39:35.198838+0000","last_clean":"2024-04-25T01:39:35.198838+0000","last_became_active":"2024-04-25T01:39:24.390941+0000","last_became_peered":"2024-04-25T01:39:24.390941+0000","last_unstale":"2024-04-25T01:39:35.198838+0000","last_undegraded":"2024-04-25T01:39:35.198838+0000","last_fullsized":"2024-04-25T01:39:35.198838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:55.182405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198689+0000","last_change":"2024-04-25T01:39:23.369043+0000","last_active":"2024-04-25T01:39:35.198689+0000","last_peered":"2024-04-25T01:39:35.198689+0000","last_clean":"2024-04-25T01:39:35.198689+0000","last_became_active":"2024-04-25T01:39:23.368778+0000","last_became_peered":"2024-04-25T01:39:23.368778+0000","last_unstale":"2024-04-25T01:39:35.198689+0000","last_undegraded":"2024-04-25T01:39:35.198689+0000","last_fullsized":"2024-04-25T01:39:35.198689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:59.501724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198230+0000","last_change":"2024-04-25T01:39:32.431530+0000","last_active":"2024-04-25T01:39:35.198230+0000","last_peered":"2024-04-25T01:39:35.198230+0000","last_clean":"2024-04-25T01:39:35.198230+0000","last_became_active":"2024-04-25T01:39:32.431247+0000","last_became_peered":"2024-04-25T01:39:32.431247+0000","last_unstale":"2024-04-25T01:39:35.198230+0000","last_undegraded":"2024-04-25T01:39:35.198230+0000","last_fullsized":"2024-04-25T01:39:35.198230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:46:02.014508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434136+0000","last_change":"2024-04-25T01:39:33.446545+0000","last_active":"2024-04-25T01:39:34.434136+0000","last_peered":"2024-04-25T01:39:34.434136+0000","last_clean":"2024-04-25T01:39:34.434136+0000","last_became_active":"2024-04-25T01:39:33.446263+0000","last_became_peered":"2024-04-25T01:39:33.446263+0000","last_unstale":"2024-04-25T01:39:34.434136+0000","last_undegraded":"2024-04-25T01:39:34.434136+0000","last_fullsized":"2024-04-25T01:39:34.434136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:27.026460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559482+0000","last_change":"2024-04-25T01:39:24.403875+0000","last_active":"2024-04-25T01:39:34.559482+0000","last_peered":"2024-04-25T01:39:34.559482+0000","last_clean":"2024-04-25T01:39:34.559482+0000","last_became_active":"2024-04-25T01:39:24.403591+0000","last_became_peered":"2024-04-25T01:39:24.403591+0000","last_unstale":"2024-04-25T01:39:34.559482+0000","last_undegraded":"2024-04-25T01:39:34.559482+0000","last_fullsized":"2024-04-25T01:39:34.559482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:45.276173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198758+0000","last_change":"2024-04-25T01:39:23.378968+0000","last_active":"2024-04-25T01:39:35.198758+0000","last_peered":"2024-04-25T01:39:35.198758+0000","last_clean":"2024-04-25T01:39:35.198758+0000","last_became_active":"2024-04-25T01:39:23.378635+0000","last_became_peered":"2024-04-25T01:39:23.378635+0000","last_unstale":"2024-04-25T01:39:35.198758+0000","last_undegraded":"2024-04-25T01:39:35.198758+0000","last_fullsized":"2024-04-25T01:39:35.198758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:39.780544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429477+0000","last_change":"2024-04-25T01:39:32.427357+0000","last_active":"2024-04-25T01:39:34.429477+0000","last_peered":"2024-04-25T01:39:34.429477+0000","last_clean":"2024-04-25T01:39:34.429477+0000","last_became_active":"2024-04-25T01:39:32.427105+0000","last_became_peered":"2024-04-25T01:39:32.427105+0000","last_unstale":"2024-04-25T01:39:34.429477+0000","last_undegraded":"2024-04-25T01:39:34.429477+0000","last_fullsized":"2024-04-25T01:39:34.429477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:04.848726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197844+0000","last_change":"2024-04-25T01:39:33.444814+0000","last_active":"2024-04-25T01:39:35.197844+0000","last_peered":"2024-04-25T01:39:35.197844+0000","last_clean":"2024-04-25T01:39:35.197844+0000","last_became_active":"2024-04-25T01:39:33.444489+0000","last_became_peered":"2024-04-25T01:39:33.444489+0000","last_unstale":"2024-04-25T01:39:35.197844+0000","last_undegraded":"2024-04-25T01:39:35.197844+0000","last_fullsized":"2024-04-25T01:39:35.197844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:06.718940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198707+0000","last_change":"2024-04-25T01:39:24.392642+0000","last_active":"2024-04-25T01:39:35.198707+0000","last_peered":"2024-04-25T01:39:35.198707+0000","last_clean":"2024-04-25T01:39:35.198707+0000","last_became_active":"2024-04-25T01:39:24.391605+0000","last_became_peered":"2024-04-25T01:39:24.391605+0000","last_unstale":"2024-04-25T01:39:35.198707+0000","last_undegraded":"2024-04-25T01:39:35.198707+0000","last_fullsized":"2024-04-25T01:39:35.198707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:01:23.217074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434798+0000","last_change":"2024-04-25T01:39:23.377236+0000","last_active":"2024-04-25T01:39:34.434798+0000","last_peered":"2024-04-25T01:39:34.434798+0000","last_clean":"2024-04-25T01:39:34.434798+0000","last_became_active":"2024-04-25T01:39:23.376727+0000","last_became_peered":"2024-04-25T01:39:23.376727+0000","last_unstale":"2024-04-25T01:39:34.434798+0000","last_undegraded":"2024-04-25T01:39:34.434798+0000","last_fullsized":"2024-04-25T01:39:34.434798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:08.103707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429200+0000","last_change":"2024-04-25T01:39:32.424457+0000","last_active":"2024-04-25T01:39:34.429200+0000","last_peered":"2024-04-25T01:39:34.429200+0000","last_clean":"2024-04-25T01:39:34.429200+0000","last_became_active":"2024-04-25T01:39:32.424203+0000","last_became_peered":"2024-04-25T01:39:32.424203+0000","last_unstale":"2024-04-25T01:39:34.429200+0000","last_undegraded":"2024-04-25T01:39:34.429200+0000","last_fullsized":"2024-04-25T01:39:34.429200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:12:20.824070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434672+0000","last_change":"2024-04-25T01:39:33.445948+0000","last_active":"2024-04-25T01:39:34.434672+0000","last_peered":"2024-04-25T01:39:34.434672+0000","last_clean":"2024-04-25T01:39:34.434672+0000","last_became_active":"2024-04-25T01:39:33.445654+0000","last_became_peered":"2024-04-25T01:39:33.445654+0000","last_unstale":"2024-04-25T01:39:34.434672+0000","last_undegraded":"2024-04-25T01:39:34.434672+0000","last_fullsized":"2024-04-25T01:39:34.434672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:51.323909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559508+0000","last_change":"2024-04-25T01:39:32.430484+0000","last_active":"2024-04-25T01:39:34.559508+0000","last_peered":"2024-04-25T01:39:34.559508+0000","last_clean":"2024-04-25T01:39:34.559508+0000","last_became_active":"2024-04-25T01:39:32.430220+0000","last_became_peered":"2024-04-25T01:39:32.430220+0000","last_unstale":"2024-04-25T01:39:34.559508+0000","last_undegraded":"2024-04-25T01:39:34.559508+0000","last_fullsized":"2024-04-25T01:39:34.559508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:36:53.152442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197722+0000","last_change":"2024-04-25T01:39:24.375457+0000","last_active":"2024-04-25T01:39:35.197722+0000","last_peered":"2024-04-25T01:39:35.197722+0000","last_clean":"2024-04-25T01:39:35.197722+0000","last_became_active":"2024-04-25T01:39:24.375178+0000","last_became_peered":"2024-04-25T01:39:24.375178+0000","last_unstale":"2024-04-25T01:39:35.197722+0000","last_undegraded":"2024-04-25T01:39:35.197722+0000","last_fullsized":"2024-04-25T01:39:35.197722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:58:15.640882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197478+0000","last_change":"2024-04-25T01:39:23.369998+0000","last_active":"2024-04-25T01:39:35.197478+0000","last_peered":"2024-04-25T01:39:35.197478+0000","last_clean":"2024-04-25T01:39:35.197478+0000","last_became_active":"2024-04-25T01:39:23.369710+0000","last_became_peered":"2024-04-25T01:39:23.369710+0000","last_unstale":"2024-04-25T01:39:35.197478+0000","last_undegraded":"2024-04-25T01:39:35.197478+0000","last_fullsized":"2024-04-25T01:39:35.197478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:32:34.329452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559536+0000","last_change":"2024-04-25T01:39:33.447666+0000","last_active":"2024-04-25T01:39:34.559536+0000","last_peered":"2024-04-25T01:39:34.559536+0000","last_clean":"2024-04-25T01:39:34.559536+0000","last_became_active":"2024-04-25T01:39:33.447436+0000","last_became_peered":"2024-04-25T01:39:33.447436+0000","last_unstale":"2024-04-25T01:39:34.559536+0000","last_undegraded":"2024-04-25T01:39:34.559536+0000","last_fullsized":"2024-04-25T01:39:34.559536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:25:20.440422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434733+0000","last_change":"2024-04-25T01:39:32.436300+0000","last_active":"2024-04-25T01:39:34.434733+0000","last_peered":"2024-04-25T01:39:34.434733+0000","last_clean":"2024-04-25T01:39:34.434733+0000","last_became_active":"2024-04-25T01:39:32.436000+0000","last_became_peered":"2024-04-25T01:39:32.436000+0000","last_unstale":"2024-04-25T01:39:34.434733+0000","last_undegraded":"2024-04-25T01:39:34.434733+0000","last_fullsized":"2024-04-25T01:39:34.434733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:38.044992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429461+0000","last_change":"2024-04-25T01:39:24.387708+0000","last_active":"2024-04-25T01:39:34.429461+0000","last_peered":"2024-04-25T01:39:34.429461+0000","last_clean":"2024-04-25T01:39:34.429461+0000","last_became_active":"2024-04-25T01:39:24.387433+0000","last_became_peered":"2024-04-25T01:39:24.387433+0000","last_unstale":"2024-04-25T01:39:34.429461+0000","last_undegraded":"2024-04-25T01:39:34.429461+0000","last_fullsized":"2024-04-25T01:39:34.429461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:34.312066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429418+0000","last_change":"2024-04-25T01:39:23.377487+0000","last_active":"2024-04-25T01:39:34.429418+0000","last_peered":"2024-04-25T01:39:34.429418+0000","last_clean":"2024-04-25T01:39:34.429418+0000","last_became_active":"2024-04-25T01:39:23.377181+0000","last_became_peered":"2024-04-25T01:39:23.377181+0000","last_unstale":"2024-04-25T01:39:34.429418+0000","last_undegraded":"2024-04-25T01:39:34.429418+0000","last_fullsized":"2024-04-25T01:39:34.429418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:17.434141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198602+0000","last_change":"2024-04-25T01:39:33.444973+0000","last_active":"2024-04-25T01:39:35.198602+0000","last_peered":"2024-04-25T01:39:35.198602+0000","last_clean":"2024-04-25T01:39:35.198602+0000","last_became_active":"2024-04-25T01:39:33.444673+0000","last_became_peered":"2024-04-25T01:39:33.444673+0000","last_unstale":"2024-04-25T01:39:35.198602+0000","last_undegraded":"2024-04-25T01:39:35.198602+0000","last_fullsized":"2024-04-25T01:39:35.198602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:08.372714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434713+0000","last_change":"2024-04-25T01:39:23.372975+0000","last_active":"2024-04-25T01:39:34.434713+0000","last_peered":"2024-04-25T01:39:34.434713+0000","last_clean":"2024-04-25T01:39:34.434713+0000","last_became_active":"2024-04-25T01:39:23.372688+0000","last_became_peered":"2024-04-25T01:39:23.372688+0000","last_unstale":"2024-04-25T01:39:34.434713+0000","last_undegraded":"2024-04-25T01:39:34.434713+0000","last_fullsized":"2024-04-25T01:39:34.434713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:42:57.195844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559766+0000","last_change":"2024-04-25T01:39:24.388095+0000","last_active":"2024-04-25T01:39:34.559766+0000","last_peered":"2024-04-25T01:39:34.559766+0000","last_clean":"2024-04-25T01:39:34.559766+0000","last_became_active":"2024-04-25T01:39:24.387797+0000","last_became_peered":"2024-04-25T01:39:24.387797+0000","last_unstale":"2024-04-25T01:39:34.559766+0000","last_undegraded":"2024-04-25T01:39:34.559766+0000","last_fullsized":"2024-04-25T01:39:34.559766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:43:16.385957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197731+0000","last_change":"2024-04-25T01:39:32.427081+0000","last_active":"2024-04-25T01:39:35.197731+0000","last_peered":"2024-04-25T01:39:35.197731+0000","last_clean":"2024-04-25T01:39:35.197731+0000","last_became_active":"2024-04-25T01:39:32.426626+0000","last_became_peered":"2024-04-25T01:39:32.426626+0000","last_unstale":"2024-04-25T01:39:35.197731+0000","last_undegraded":"2024-04-25T01:39:35.197731+0000","last_fullsized":"2024-04-25T01:39:35.197731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:45.358400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198937+0000","last_change":"2024-04-25T01:39:33.446301+0000","last_active":"2024-04-25T01:39:35.198937+0000","last_peered":"2024-04-25T01:39:35.198937+0000","last_clean":"2024-04-25T01:39:35.198937+0000","last_became_active":"2024-04-25T01:39:33.445158+0000","last_became_peered":"2024-04-25T01:39:33.445158+0000","last_unstale":"2024-04-25T01:39:35.198937+0000","last_undegraded":"2024-04-25T01:39:35.198937+0000","last_fullsized":"2024-04-25T01:39:35.198937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:53:26.017968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429884+0000","last_change":"2024-04-25T01:39:23.371716+0000","last_active":"2024-04-25T01:39:34.429884+0000","last_peered":"2024-04-25T01:39:34.429884+0000","last_clean":"2024-04-25T01:39:34.429884+0000","last_became_active":"2024-04-25T01:39:23.371475+0000","last_became_peered":"2024-04-25T01:39:23.371475+0000","last_unstale":"2024-04-25T01:39:34.429884+0000","last_undegraded":"2024-04-25T01:39:34.429884+0000","last_fullsized":"2024-04-25T01:39:34.429884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:10.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198751+0000","last_change":"2024-04-25T01:39:24.388083+0000","last_active":"2024-04-25T01:39:35.198751+0000","last_peered":"2024-04-25T01:39:35.198751+0000","last_clean":"2024-04-25T01:39:35.198751+0000","last_became_active":"2024-04-25T01:39:24.387789+0000","last_became_peered":"2024-04-25T01:39:24.387789+0000","last_unstale":"2024-04-25T01:39:35.198751+0000","last_undegraded":"2024-04-25T01:39:35.198751+0000","last_fullsized":"2024-04-25T01:39:35.198751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:31.760631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429824+0000","last_change":"2024-04-25T01:39:32.429613+0000","last_active":"2024-04-25T01:39:34.429824+0000","last_peered":"2024-04-25T01:39:34.429824+0000","last_clean":"2024-04-25T01:39:34.429824+0000","last_became_active":"2024-04-25T01:39:32.429361+0000","last_became_peered":"2024-04-25T01:39:32.429361+0000","last_unstale":"2024-04-25T01:39:34.429824+0000","last_undegraded":"2024-04-25T01:39:34.429824+0000","last_fullsized":"2024-04-25T01:39:34.429824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:04:59.928602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430227+0000","last_change":"2024-04-25T01:39:33.426384+0000","last_active":"2024-04-25T01:39:34.430227+0000","last_peered":"2024-04-25T01:39:34.430227+0000","last_clean":"2024-04-25T01:39:34.430227+0000","last_became_active":"2024-04-25T01:39:33.426101+0000","last_became_peered":"2024-04-25T01:39:33.426101+0000","last_unstale":"2024-04-25T01:39:34.430227+0000","last_undegraded":"2024-04-25T01:39:34.430227+0000","last_fullsized":"2024-04-25T01:39:34.430227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:36.820458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.433902+0000","last_change":"2024-04-25T01:39:24.395618+0000","last_active":"2024-04-25T01:39:34.433902+0000","last_peered":"2024-04-25T01:39:34.433902+0000","last_clean":"2024-04-25T01:39:34.433902+0000","last_became_active":"2024-04-25T01:39:24.394816+0000","last_became_peered":"2024-04-25T01:39:24.394816+0000","last_unstale":"2024-04-25T01:39:34.433902+0000","last_undegraded":"2024-04-25T01:39:34.433902+0000","last_fullsized":"2024-04-25T01:39:34.433902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:01.025135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198676+0000","last_change":"2024-04-25T01:39:33.432537+0000","last_active":"2024-04-25T01:39:35.198676+0000","last_peered":"2024-04-25T01:39:35.198676+0000","last_clean":"2024-04-25T01:39:35.198676+0000","last_became_active":"2024-04-25T01:39:33.432266+0000","last_became_peered":"2024-04-25T01:39:33.432266+0000","last_unstale":"2024-04-25T01:39:35.198676+0000","last_undegraded":"2024-04-25T01:39:35.198676+0000","last_fullsized":"2024-04-25T01:39:35.198676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:31.703689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197383+0000","last_change":"2024-04-25T01:39:24.390981+0000","last_active":"2024-04-25T01:39:35.197383+0000","last_peered":"2024-04-25T01:39:35.197383+0000","last_clean":"2024-04-25T01:39:35.197383+0000","last_became_active":"2024-04-25T01:39:24.390716+0000","last_became_peered":"2024-04-25T01:39:24.390716+0000","last_unstale":"2024-04-25T01:39:35.197383+0000","last_undegraded":"2024-04-25T01:39:35.197383+0000","last_fullsized":"2024-04-25T01:39:35.197383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:08.458504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199057+0000","last_change":"2024-04-25T01:39:33.439086+0000","last_active":"2024-04-25T01:39:35.199057+0000","last_peered":"2024-04-25T01:39:35.199057+0000","last_clean":"2024-04-25T01:39:35.199057+0000","last_became_active":"2024-04-25T01:39:33.438811+0000","last_became_peered":"2024-04-25T01:39:33.438811+0000","last_unstale":"2024-04-25T01:39:35.199057+0000","last_undegraded":"2024-04-25T01:39:35.199057+0000","last_fullsized":"2024-04-25T01:39:35.199057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:49:23.604749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198076+0000","last_change":"2024-04-25T01:39:24.399738+0000","last_active":"2024-04-25T01:39:35.198076+0000","last_peered":"2024-04-25T01:39:35.198076+0000","last_clean":"2024-04-25T01:39:35.198076+0000","last_became_active":"2024-04-25T01:39:24.399499+0000","last_became_peered":"2024-04-25T01:39:24.399499+0000","last_unstale":"2024-04-25T01:39:35.198076+0000","last_undegraded":"2024-04-25T01:39:35.198076+0000","last_fullsized":"2024-04-25T01:39:35.198076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:58.646669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198407+0000","last_change":"2024-04-25T01:39:33.444074+0000","last_active":"2024-04-25T01:39:35.198407+0000","last_peered":"2024-04-25T01:39:35.198407+0000","last_clean":"2024-04-25T01:39:35.198407+0000","last_became_active":"2024-04-25T01:39:33.443796+0000","last_became_peered":"2024-04-25T01:39:33.443796+0000","last_unstale":"2024-04-25T01:39:35.198407+0000","last_undegraded":"2024-04-25T01:39:35.198407+0000","last_fullsized":"2024-04-25T01:39:35.198407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:56.379211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559685+0000","last_change":"2024-04-25T01:39:24.390631+0000","last_active":"2024-04-25T01:39:34.559685+0000","last_peered":"2024-04-25T01:39:34.559685+0000","last_clean":"2024-04-25T01:39:34.559685+0000","last_became_active":"2024-04-25T01:39:24.390363+0000","last_became_peered":"2024-04-25T01:39:24.390363+0000","last_unstale":"2024-04-25T01:39:34.559685+0000","last_undegraded":"2024-04-25T01:39:34.559685+0000","last_fullsized":"2024-04-25T01:39:34.559685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:48.830416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199245+0000","last_change":"2024-04-25T01:39:33.437787+0000","last_active":"2024-04-25T01:39:35.199245+0000","last_peered":"2024-04-25T01:39:35.199245+0000","last_clean":"2024-04-25T01:39:35.199245+0000","last_became_active":"2024-04-25T01:39:33.436131+0000","last_became_peered":"2024-04-25T01:39:33.436131+0000","last_unstale":"2024-04-25T01:39:35.199245+0000","last_undegraded":"2024-04-25T01:39:35.199245+0000","last_fullsized":"2024-04-25T01:39:35.199245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:29:13.213643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429883+0000","last_change":"2024-04-25T01:39:24.389645+0000","last_active":"2024-04-25T01:39:34.429883+0000","last_peered":"2024-04-25T01:39:34.429883+0000","last_clean":"2024-04-25T01:39:34.429883+0000","last_became_active":"2024-04-25T01:39:24.389375+0000","last_became_peered":"2024-04-25T01:39:24.389375+0000","last_unstale":"2024-04-25T01:39:34.429883+0000","last_undegraded":"2024-04-25T01:39:34.429883+0000","last_fullsized":"2024-04-25T01:39:34.429883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:13:12.753893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197777+0000","last_change":"2024-04-25T01:39:33.448177+0000","last_active":"2024-04-25T01:39:35.197777+0000","last_peered":"2024-04-25T01:39:35.197777+0000","last_clean":"2024-04-25T01:39:35.197777+0000","last_became_active":"2024-04-25T01:39:33.447588+0000","last_became_peered":"2024-04-25T01:39:33.447588+0000","last_unstale":"2024-04-25T01:39:35.197777+0000","last_undegraded":"2024-04-25T01:39:35.197777+0000","last_fullsized":"2024-04-25T01:39:35.197777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:11:20.466189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198572+0000","last_change":"2024-04-25T01:39:24.374082+0000","last_active":"2024-04-25T01:39:35.198572+0000","last_peered":"2024-04-25T01:39:35.198572+0000","last_clean":"2024-04-25T01:39:35.198572+0000","last_became_active":"2024-04-25T01:39:24.373731+0000","last_became_peered":"2024-04-25T01:39:24.373731+0000","last_unstale":"2024-04-25T01:39:35.198572+0000","last_undegraded":"2024-04-25T01:39:35.198572+0000","last_fullsized":"2024-04-25T01:39:35.198572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:45.817483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197536+0000","last_change":"2024-04-25T01:39:33.446992+0000","last_active":"2024-04-25T01:39:35.197536+0000","last_peered":"2024-04-25T01:39:35.197536+0000","last_clean":"2024-04-25T01:39:35.197536+0000","last_became_active":"2024-04-25T01:39:33.446652+0000","last_became_peered":"2024-04-25T01:39:33.446652+0000","last_unstale":"2024-04-25T01:39:35.197536+0000","last_undegraded":"2024-04-25T01:39:35.197536+0000","last_fullsized":"2024-04-25T01:39:35.197536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:43:52.959274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434529+0000","last_change":"2024-04-25T01:39:24.398614+0000","last_active":"2024-04-25T01:39:34.434529+0000","last_peered":"2024-04-25T01:39:34.434529+0000","last_clean":"2024-04-25T01:39:34.434529+0000","last_became_active":"2024-04-25T01:39:24.398299+0000","last_became_peered":"2024-04-25T01:39:24.398299+0000","last_unstale":"2024-04-25T01:39:34.434529+0000","last_undegraded":"2024-04-25T01:39:34.434529+0000","last_fullsized":"2024-04-25T01:39:34.434529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:54:51.191225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434363+0000","last_change":"2024-04-25T01:39:33.441401+0000","last_active":"2024-04-25T01:39:34.434363+0000","last_peered":"2024-04-25T01:39:34.434363+0000","last_clean":"2024-04-25T01:39:34.434363+0000","last_became_active":"2024-04-25T01:39:33.441104+0000","last_became_peered":"2024-04-25T01:39:33.441104+0000","last_unstale":"2024-04-25T01:39:34.434363+0000","last_undegraded":"2024-04-25T01:39:34.434363+0000","last_fullsized":"2024-04-25T01:39:34.434363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:51.503340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430186+0000","last_change":"2024-04-25T01:39:24.390352+0000","last_active":"2024-04-25T01:39:34.430186+0000","last_peered":"2024-04-25T01:39:34.430186+0000","last_clean":"2024-04-25T01:39:34.430186+0000","last_became_active":"2024-04-25T01:39:24.389809+0000","last_became_peered":"2024-04-25T01:39:24.389809+0000","last_unstale":"2024-04-25T01:39:34.430186+0000","last_undegraded":"2024-04-25T01:39:34.430186+0000","last_fullsized":"2024-04-25T01:39:34.430186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:22:44.221898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430089+0000","last_change":"2024-04-25T01:39:33.426710+0000","last_active":"2024-04-25T01:39:34.430089+0000","last_peered":"2024-04-25T01:39:34.430089+0000","last_clean":"2024-04-25T01:39:34.430089+0000","last_became_active":"2024-04-25T01:39:33.426056+0000","last_became_peered":"2024-04-25T01:39:33.426056+0000","last_unstale":"2024-04-25T01:39:34.430089+0000","last_undegraded":"2024-04-25T01:39:34.430089+0000","last_fullsized":"2024-04-25T01:39:34.430089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:53:41.174851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197416+0000","last_change":"2024-04-25T01:39:24.387093+0000","last_active":"2024-04-25T01:39:35.197416+0000","last_peered":"2024-04-25T01:39:35.197416+0000","last_clean":"2024-04-25T01:39:35.197416+0000","last_became_active":"2024-04-25T01:39:24.386809+0000","last_became_peered":"2024-04-25T01:39:24.386809+0000","last_unstale":"2024-04-25T01:39:35.197416+0000","last_undegraded":"2024-04-25T01:39:35.197416+0000","last_fullsized":"2024-04-25T01:39:35.197416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:46:05.313828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200264+0000","last_change":"2024-04-25T01:39:33.436499+0000","last_active":"2024-04-25T01:39:35.200264+0000","last_peered":"2024-04-25T01:39:35.200264+0000","last_clean":"2024-04-25T01:39:35.200264+0000","last_became_active":"2024-04-25T01:39:33.436017+0000","last_became_peered":"2024-04-25T01:39:33.436017+0000","last_unstale":"2024-04-25T01:39:35.200264+0000","last_undegraded":"2024-04-25T01:39:35.200264+0000","last_fullsized":"2024-04-25T01:39:35.200264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:46:09.302012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429495+0000","last_change":"2024-04-25T01:39:24.389039+0000","last_active":"2024-04-25T01:39:34.429495+0000","last_peered":"2024-04-25T01:39:34.429495+0000","last_clean":"2024-04-25T01:39:34.429495+0000","last_became_active":"2024-04-25T01:39:24.388793+0000","last_became_peered":"2024-04-25T01:39:24.388793+0000","last_unstale":"2024-04-25T01:39:34.429495+0000","last_undegraded":"2024-04-25T01:39:34.429495+0000","last_fullsized":"2024-04-25T01:39:34.429495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:13.093550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197668+0000","last_change":"2024-04-25T01:39:33.441122+0000","last_active":"2024-04-25T01:39:35.197668+0000","last_peered":"2024-04-25T01:39:35.197668+0000","last_clean":"2024-04-25T01:39:35.197668+0000","last_became_active":"2024-04-25T01:39:33.440760+0000","last_became_peered":"2024-04-25T01:39:33.440760+0000","last_unstale":"2024-04-25T01:39:35.197668+0000","last_undegraded":"2024-04-25T01:39:35.197668+0000","last_fullsized":"2024-04-25T01:39:35.197668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:30:12.603789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197981+0000","last_change":"2024-04-25T01:39:24.390884+0000","last_active":"2024-04-25T01:39:35.197981+0000","last_peered":"2024-04-25T01:39:35.197981+0000","last_clean":"2024-04-25T01:39:35.197981+0000","last_became_active":"2024-04-25T01:39:24.390591+0000","last_became_peered":"2024-04-25T01:39:24.390591+0000","last_unstale":"2024-04-25T01:39:35.197981+0000","last_undegraded":"2024-04-25T01:39:35.197981+0000","last_fullsized":"2024-04-25T01:39:35.197981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:51.274363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429740+0000","last_change":"2024-04-25T01:39:33.429482+0000","last_active":"2024-04-25T01:39:34.429740+0000","last_peered":"2024-04-25T01:39:34.429740+0000","last_clean":"2024-04-25T01:39:34.429740+0000","last_became_active":"2024-04-25T01:39:33.429158+0000","last_became_peered":"2024-04-25T01:39:33.429158+0000","last_unstale":"2024-04-25T01:39:34.429740+0000","last_undegraded":"2024-04-25T01:39:34.429740+0000","last_fullsized":"2024-04-25T01:39:34.429740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:58:07.372868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559599+0000","last_change":"2024-04-25T01:39:24.388891+0000","last_active":"2024-04-25T01:39:34.559599+0000","last_peered":"2024-04-25T01:39:34.559599+0000","last_clean":"2024-04-25T01:39:34.559599+0000","last_became_active":"2024-04-25T01:39:24.388619+0000","last_became_peered":"2024-04-25T01:39:24.388619+0000","last_unstale":"2024-04-25T01:39:34.559599+0000","last_undegraded":"2024-04-25T01:39:34.559599+0000","last_fullsized":"2024-04-25T01:39:34.559599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:05.176386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198216+0000","last_change":"2024-04-25T01:39:33.443534+0000","last_active":"2024-04-25T01:39:35.198216+0000","last_peered":"2024-04-25T01:39:35.198216+0000","last_clean":"2024-04-25T01:39:35.198216+0000","last_became_active":"2024-04-25T01:39:33.443257+0000","last_became_peered":"2024-04-25T01:39:33.443257+0000","last_unstale":"2024-04-25T01:39:35.198216+0000","last_undegraded":"2024-04-25T01:39:35.198216+0000","last_fullsized":"2024-04-25T01:39:35.198216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:44:30.154519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434181+0000","last_change":"2024-04-25T01:39:24.395109+0000","last_active":"2024-04-25T01:39:34.434181+0000","last_peered":"2024-04-25T01:39:34.434181+0000","last_clean":"2024-04-25T01:39:34.434181+0000","last_became_active":"2024-04-25T01:39:24.394784+0000","last_became_peered":"2024-04-25T01:39:24.394784+0000","last_unstale":"2024-04-25T01:39:34.434181+0000","last_undegraded":"2024-04-25T01:39:34.434181+0000","last_fullsized":"2024-04-25T01:39:34.434181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:44:09.102603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197600+0000","last_change":"2024-04-25T01:39:33.446683+0000","last_active":"2024-04-25T01:39:35.197600+0000","last_peered":"2024-04-25T01:39:35.197600+0000","last_clean":"2024-04-25T01:39:35.197600+0000","last_became_active":"2024-04-25T01:39:33.445949+0000","last_became_peered":"2024-04-25T01:39:33.445949+0000","last_unstale":"2024-04-25T01:39:35.197600+0000","last_undegraded":"2024-04-25T01:39:35.197600+0000","last_fullsized":"2024-04-25T01:39:35.197600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:28.864821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199913+0000","last_change":"2024-04-25T01:39:24.380199+0000","last_active":"2024-04-25T01:39:35.199913+0000","last_peered":"2024-04-25T01:39:35.199913+0000","last_clean":"2024-04-25T01:39:35.199913+0000","last_became_active":"2024-04-25T01:39:24.379591+0000","last_became_peered":"2024-04-25T01:39:24.379591+0000","last_unstale":"2024-04-25T01:39:35.199913+0000","last_undegraded":"2024-04-25T01:39:35.199913+0000","last_fullsized":"2024-04-25T01:39:35.199913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:54.534683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197349+0000","last_change":"2024-04-25T01:39:33.439702+0000","last_active":"2024-04-25T01:39:35.197349+0000","last_peered":"2024-04-25T01:39:35.197349+0000","last_clean":"2024-04-25T01:39:35.197349+0000","last_became_active":"2024-04-25T01:39:33.439424+0000","last_became_peered":"2024-04-25T01:39:33.439424+0000","last_unstale":"2024-04-25T01:39:35.197349+0000","last_undegraded":"2024-04-25T01:39:35.197349+0000","last_fullsized":"2024-04-25T01:39:35.197349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:31.528140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197883+0000","last_change":"2024-04-25T01:39:24.395125+0000","last_active":"2024-04-25T01:39:35.197883+0000","last_peered":"2024-04-25T01:39:35.197883+0000","last_clean":"2024-04-25T01:39:35.197883+0000","last_became_active":"2024-04-25T01:39:24.392605+0000","last_became_peered":"2024-04-25T01:39:24.392605+0000","last_unstale":"2024-04-25T01:39:35.197883+0000","last_undegraded":"2024-04-25T01:39:35.197883+0000","last_fullsized":"2024-04-25T01:39:35.197883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:53.333616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559178+0000","last_change":"2024-04-25T01:39:33.438104+0000","last_active":"2024-04-25T01:39:34.559178+0000","last_peered":"2024-04-25T01:39:34.559178+0000","last_clean":"2024-04-25T01:39:34.559178+0000","last_became_active":"2024-04-25T01:39:33.437795+0000","last_became_peered":"2024-04-25T01:39:33.437795+0000","last_unstale":"2024-04-25T01:39:34.559178+0000","last_undegraded":"2024-04-25T01:39:34.559178+0000","last_fullsized":"2024-04-25T01:39:34.559178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:32.294104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199422+0000","last_change":"2024-04-25T01:39:24.391312+0000","last_active":"2024-04-25T01:39:35.199422+0000","last_peered":"2024-04-25T01:39:35.199422+0000","last_clean":"2024-04-25T01:39:35.199422+0000","last_became_active":"2024-04-25T01:39:24.390978+0000","last_became_peered":"2024-04-25T01:39:24.390978+0000","last_unstale":"2024-04-25T01:39:35.199422+0000","last_undegraded":"2024-04-25T01:39:35.199422+0000","last_fullsized":"2024-04-25T01:39:35.199422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:38:25.637031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197875+0000","last_change":"2024-04-25T01:39:33.431262+0000","last_active":"2024-04-25T01:39:35.197875+0000","last_peered":"2024-04-25T01:39:35.197875+0000","last_clean":"2024-04-25T01:39:35.197875+0000","last_became_active":"2024-04-25T01:39:33.430982+0000","last_became_peered":"2024-04-25T01:39:33.430982+0000","last_unstale":"2024-04-25T01:39:35.197875+0000","last_undegraded":"2024-04-25T01:39:35.197875+0000","last_fullsized":"2024-04-25T01:39:35.197875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:11.821542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197372+0000","last_change":"2024-04-25T01:39:24.399270+0000","last_active":"2024-04-25T01:39:35.197372+0000","last_peered":"2024-04-25T01:39:35.197372+0000","last_clean":"2024-04-25T01:39:35.197372+0000","last_became_active":"2024-04-25T01:39:24.399011+0000","last_became_peered":"2024-04-25T01:39:24.399011+0000","last_unstale":"2024-04-25T01:39:35.197372+0000","last_undegraded":"2024-04-25T01:39:35.197372+0000","last_fullsized":"2024-04-25T01:39:35.197372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:00.987674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197770+0000","last_change":"2024-04-25T01:39:33.443939+0000","last_active":"2024-04-25T01:39:35.197770+0000","last_peered":"2024-04-25T01:39:35.197770+0000","last_clean":"2024-04-25T01:39:35.197770+0000","last_became_active":"2024-04-25T01:39:33.443608+0000","last_became_peered":"2024-04-25T01:39:33.443608+0000","last_unstale":"2024-04-25T01:39:35.197770+0000","last_undegraded":"2024-04-25T01:39:35.197770+0000","last_fullsized":"2024-04-25T01:39:35.197770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:35.561173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197831+0000","last_change":"2024-04-25T01:39:24.388943+0000","last_active":"2024-04-25T01:39:35.197831+0000","last_peered":"2024-04-25T01:39:35.197831+0000","last_clean":"2024-04-25T01:39:35.197831+0000","last_became_active":"2024-04-25T01:39:24.388690+0000","last_became_peered":"2024-04-25T01:39:24.388690+0000","last_unstale":"2024-04-25T01:39:35.197831+0000","last_undegraded":"2024-04-25T01:39:35.197831+0000","last_fullsized":"2024-04-25T01:39:35.197831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:42:18.260701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198911+0000","last_change":"2024-04-25T01:39:33.438460+0000","last_active":"2024-04-25T01:39:35.198911+0000","last_peered":"2024-04-25T01:39:35.198911+0000","last_clean":"2024-04-25T01:39:35.198911+0000","last_became_active":"2024-04-25T01:39:33.436581+0000","last_became_peered":"2024-04-25T01:39:33.436581+0000","last_unstale":"2024-04-25T01:39:35.198911+0000","last_undegraded":"2024-04-25T01:39:35.198911+0000","last_fullsized":"2024-04-25T01:39:35.198911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:03:27.382925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559241+0000","last_change":"2024-04-25T01:39:24.389556+0000","last_active":"2024-04-25T01:39:34.559241+0000","last_peered":"2024-04-25T01:39:34.559241+0000","last_clean":"2024-04-25T01:39:34.559241+0000","last_became_active":"2024-04-25T01:39:24.389254+0000","last_became_peered":"2024-04-25T01:39:24.389254+0000","last_unstale":"2024-04-25T01:39:34.559241+0000","last_undegraded":"2024-04-25T01:39:34.559241+0000","last_fullsized":"2024-04-25T01:39:34.559241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:56.208172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199719+0000","last_change":"2024-04-25T01:39:33.433893+0000","last_active":"2024-04-25T01:39:35.199719+0000","last_peered":"2024-04-25T01:39:35.199719+0000","last_clean":"2024-04-25T01:39:35.199719+0000","last_became_active":"2024-04-25T01:39:33.433577+0000","last_became_peered":"2024-04-25T01:39:33.433577+0000","last_unstale":"2024-04-25T01:39:35.199719+0000","last_undegraded":"2024-04-25T01:39:35.199719+0000","last_fullsized":"2024-04-25T01:39:35.199719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:16.371837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429725+0000","last_change":"2024-04-25T01:39:24.392021+0000","last_active":"2024-04-25T01:39:34.429725+0000","last_peered":"2024-04-25T01:39:34.429725+0000","last_clean":"2024-04-25T01:39:34.429725+0000","last_became_active":"2024-04-25T01:39:24.391352+0000","last_became_peered":"2024-04-25T01:39:24.391352+0000","last_unstale":"2024-04-25T01:39:34.429725+0000","last_undegraded":"2024-04-25T01:39:34.429725+0000","last_fullsized":"2024-04-25T01:39:34.429725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:44.434749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429972+0000","last_change":"2024-04-25T01:39:33.436641+0000","last_active":"2024-04-25T01:39:34.429972+0000","last_peered":"2024-04-25T01:39:34.429972+0000","last_clean":"2024-04-25T01:39:34.429972+0000","last_became_active":"2024-04-25T01:39:33.436389+0000","last_became_peered":"2024-04-25T01:39:33.436389+0000","last_unstale":"2024-04-25T01:39:34.429972+0000","last_undegraded":"2024-04-25T01:39:34.429972+0000","last_fullsized":"2024-04-25T01:39:34.429972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:19:51.940088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198744+0000","last_change":"2024-04-25T01:39:24.396300+0000","last_active":"2024-04-25T01:39:35.198744+0000","last_peered":"2024-04-25T01:39:35.198744+0000","last_clean":"2024-04-25T01:39:35.198744+0000","last_became_active":"2024-04-25T01:39:24.396023+0000","last_became_peered":"2024-04-25T01:39:24.396023+0000","last_unstale":"2024-04-25T01:39:35.198744+0000","last_undegraded":"2024-04-25T01:39:35.198744+0000","last_fullsized":"2024-04-25T01:39:35.198744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:21.500721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197770+0000","last_change":"2024-04-25T01:39:33.443419+0000","last_active":"2024-04-25T01:39:35.197770+0000","last_peered":"2024-04-25T01:39:35.197770+0000","last_clean":"2024-04-25T01:39:35.197770+0000","last_became_active":"2024-04-25T01:39:33.443163+0000","last_became_peered":"2024-04-25T01:39:33.443163+0000","last_unstale":"2024-04-25T01:39:35.197770+0000","last_undegraded":"2024-04-25T01:39:35.197770+0000","last_fullsized":"2024-04-25T01:39:35.197770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:22.156410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434366+0000","last_change":"2024-04-25T01:39:24.404047+0000","last_active":"2024-04-25T01:39:34.434366+0000","last_peered":"2024-04-25T01:39:34.434366+0000","last_clean":"2024-04-25T01:39:34.434366+0000","last_became_active":"2024-04-25T01:39:24.403700+0000","last_became_peered":"2024-04-25T01:39:24.403700+0000","last_unstale":"2024-04-25T01:39:34.434366+0000","last_undegraded":"2024-04-25T01:39:34.434366+0000","last_fullsized":"2024-04-25T01:39:34.434366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:53.123061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199905+0000","last_change":"2024-04-25T01:39:33.435520+0000","last_active":"2024-04-25T01:39:35.199905+0000","last_peered":"2024-04-25T01:39:35.199905+0000","last_clean":"2024-04-25T01:39:35.199905+0000","last_became_active":"2024-04-25T01:39:33.434446+0000","last_became_peered":"2024-04-25T01:39:33.434446+0000","last_unstale":"2024-04-25T01:39:35.199905+0000","last_undegraded":"2024-04-25T01:39:35.199905+0000","last_fullsized":"2024-04-25T01:39:35.199905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:59.696009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434467+0000","last_change":"2024-04-25T01:39:24.406158+0000","last_active":"2024-04-25T01:39:34.434467+0000","last_peered":"2024-04-25T01:39:34.434467+0000","last_clean":"2024-04-25T01:39:34.434467+0000","last_became_active":"2024-04-25T01:39:24.405876+0000","last_became_peered":"2024-04-25T01:39:24.405876+0000","last_unstale":"2024-04-25T01:39:34.434467+0000","last_undegraded":"2024-04-25T01:39:34.434467+0000","last_fullsized":"2024-04-25T01:39:34.434467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:18:19.895651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198497+0000","last_change":"2024-04-25T01:39:33.436479+0000","last_active":"2024-04-25T01:39:35.198497+0000","last_peered":"2024-04-25T01:39:35.198497+0000","last_clean":"2024-04-25T01:39:35.198497+0000","last_became_active":"2024-04-25T01:39:33.436193+0000","last_became_peered":"2024-04-25T01:39:33.436193+0000","last_unstale":"2024-04-25T01:39:35.198497+0000","last_undegraded":"2024-04-25T01:39:35.198497+0000","last_fullsized":"2024-04-25T01:39:35.198497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:20:03.455536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200363+0000","last_change":"2024-04-25T01:39:24.393362+0000","last_active":"2024-04-25T01:39:35.200363+0000","last_peered":"2024-04-25T01:39:35.200363+0000","last_clean":"2024-04-25T01:39:35.200363+0000","last_became_active":"2024-04-25T01:39:24.392836+0000","last_became_peered":"2024-04-25T01:39:24.392836+0000","last_unstale":"2024-04-25T01:39:35.200363+0000","last_undegraded":"2024-04-25T01:39:35.200363+0000","last_fullsized":"2024-04-25T01:39:35.200363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:58.871777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.430064+0000","last_change":"2024-04-25T01:39:33.440164+0000","last_active":"2024-04-25T01:39:34.430064+0000","last_peered":"2024-04-25T01:39:34.430064+0000","last_clean":"2024-04-25T01:39:34.430064+0000","last_became_active":"2024-04-25T01:39:33.439878+0000","last_became_peered":"2024-04-25T01:39:33.439878+0000","last_unstale":"2024-04-25T01:39:34.430064+0000","last_undegraded":"2024-04-25T01:39:34.430064+0000","last_fullsized":"2024-04-25T01:39:34.430064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:44:52.817169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429296+0000","last_change":"2024-04-25T01:39:24.401765+0000","last_active":"2024-04-25T01:39:34.429296+0000","last_peered":"2024-04-25T01:39:34.429296+0000","last_clean":"2024-04-25T01:39:34.429296+0000","last_became_active":"2024-04-25T01:39:24.400509+0000","last_became_peered":"2024-04-25T01:39:24.400509+0000","last_unstale":"2024-04-25T01:39:34.429296+0000","last_undegraded":"2024-04-25T01:39:34.429296+0000","last_fullsized":"2024-04-25T01:39:34.429296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:25.031622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.434669+0000","last_change":"2024-04-25T01:39:33.439353+0000","last_active":"2024-04-25T01:39:34.434669+0000","last_peered":"2024-04-25T01:39:34.434669+0000","last_clean":"2024-04-25T01:39:34.434669+0000","last_became_active":"2024-04-25T01:39:33.438915+0000","last_became_peered":"2024-04-25T01:39:33.438915+0000","last_unstale":"2024-04-25T01:39:34.434669+0000","last_undegraded":"2024-04-25T01:39:34.434669+0000","last_fullsized":"2024-04-25T01:39:34.434669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:19.180919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198881+0000","last_change":"2024-04-25T01:39:24.387941+0000","last_active":"2024-04-25T01:39:35.198881+0000","last_peered":"2024-04-25T01:39:35.198881+0000","last_clean":"2024-04-25T01:39:35.198881+0000","last_became_active":"2024-04-25T01:39:24.387674+0000","last_became_peered":"2024-04-25T01:39:24.387674+0000","last_unstale":"2024-04-25T01:39:35.198881+0000","last_undegraded":"2024-04-25T01:39:35.198881+0000","last_fullsized":"2024-04-25T01:39:35.198881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:05.676143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197803+0000","last_change":"2024-04-25T01:39:33.444917+0000","last_active":"2024-04-25T01:39:35.197803+0000","last_peered":"2024-04-25T01:39:35.197803+0000","last_clean":"2024-04-25T01:39:35.197803+0000","last_became_active":"2024-04-25T01:39:33.444636+0000","last_became_peered":"2024-04-25T01:39:33.444636+0000","last_unstale":"2024-04-25T01:39:35.197803+0000","last_undegraded":"2024-04-25T01:39:35.197803+0000","last_fullsized":"2024-04-25T01:39:35.197803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:31.531502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197880+0000","last_change":"2024-04-25T01:39:24.399950+0000","last_active":"2024-04-25T01:39:35.197880+0000","last_peered":"2024-04-25T01:39:35.197880+0000","last_clean":"2024-04-25T01:39:35.197880+0000","last_became_active":"2024-04-25T01:39:24.399701+0000","last_became_peered":"2024-04-25T01:39:24.399701+0000","last_unstale":"2024-04-25T01:39:35.197880+0000","last_undegraded":"2024-04-25T01:39:35.197880+0000","last_fullsized":"2024-04-25T01:39:35.197880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:49.618370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200035+0000","last_change":"2024-04-25T01:39:33.440936+0000","last_active":"2024-04-25T01:39:35.200035+0000","last_peered":"2024-04-25T01:39:35.200035+0000","last_clean":"2024-04-25T01:39:35.200035+0000","last_became_active":"2024-04-25T01:39:33.440679+0000","last_became_peered":"2024-04-25T01:39:33.440679+0000","last_unstale":"2024-04-25T01:39:35.200035+0000","last_undegraded":"2024-04-25T01:39:35.200035+0000","last_fullsized":"2024-04-25T01:39:35.200035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:08:53.629572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198222+0000","last_change":"2024-04-25T01:39:24.380318+0000","last_active":"2024-04-25T01:39:35.198222+0000","last_peered":"2024-04-25T01:39:35.198222+0000","last_clean":"2024-04-25T01:39:35.198222+0000","last_became_active":"2024-04-25T01:39:24.379573+0000","last_became_peered":"2024-04-25T01:39:24.379573+0000","last_unstale":"2024-04-25T01:39:35.198222+0000","last_undegraded":"2024-04-25T01:39:35.198222+0000","last_fullsized":"2024-04-25T01:39:35.198222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:12.089917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.429399+0000","last_change":"2024-04-25T01:39:33.426380+0000","last_active":"2024-04-25T01:39:34.429399+0000","last_peered":"2024-04-25T01:39:34.429399+0000","last_clean":"2024-04-25T01:39:34.429399+0000","last_became_active":"2024-04-25T01:39:33.426090+0000","last_became_peered":"2024-04-25T01:39:33.426090+0000","last_unstale":"2024-04-25T01:39:34.429399+0000","last_undegraded":"2024-04-25T01:39:34.429399+0000","last_fullsized":"2024-04-25T01:39:34.429399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:34.329217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.199243+0000","last_change":"2024-04-25T01:39:24.398726+0000","last_active":"2024-04-25T01:39:35.199243+0000","last_peered":"2024-04-25T01:39:35.199243+0000","last_clean":"2024-04-25T01:39:35.199243+0000","last_became_active":"2024-04-25T01:39:24.398449+0000","last_became_peered":"2024-04-25T01:39:24.398449+0000","last_unstale":"2024-04-25T01:39:35.199243+0000","last_undegraded":"2024-04-25T01:39:35.199243+0000","last_fullsized":"2024-04-25T01:39:35.199243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:41:38.230939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197750+0000","last_change":"2024-04-25T01:39:33.436488+0000","last_active":"2024-04-25T01:39:35.197750+0000","last_peered":"2024-04-25T01:39:35.197750+0000","last_clean":"2024-04-25T01:39:35.197750+0000","last_became_active":"2024-04-25T01:39:33.436224+0000","last_became_peered":"2024-04-25T01:39:33.436224+0000","last_unstale":"2024-04-25T01:39:35.197750+0000","last_undegraded":"2024-04-25T01:39:35.197750+0000","last_fullsized":"2024-04-25T01:39:35.197750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:38.227206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:34.559398+0000","last_change":"2024-04-25T01:39:24.386909+0000","last_active":"2024-04-25T01:39:34.559398+0000","last_peered":"2024-04-25T01:39:34.559398+0000","last_clean":"2024-04-25T01:39:34.559398+0000","last_became_active":"2024-04-25T01:39:24.386568+0000","last_became_peered":"2024-04-25T01:39:24.386568+0000","last_unstale":"2024-04-25T01:39:34.559398+0000","last_undegraded":"2024-04-25T01:39:34.559398+0000","last_fullsized":"2024-04-25T01:39:34.559398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:29.904064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197979+0000","last_change":"2024-04-25T01:39:33.440753+0000","last_active":"2024-04-25T01:39:35.197979+0000","last_peered":"2024-04-25T01:39:35.197979+0000","last_clean":"2024-04-25T01:39:35.197979+0000","last_became_active":"2024-04-25T01:39:33.440480+0000","last_became_peered":"2024-04-25T01:39:33.440480+0000","last_unstale":"2024-04-25T01:39:35.197979+0000","last_undegraded":"2024-04-25T01:39:35.197979+0000","last_fullsized":"2024-04-25T01:39:35.197979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:18.113293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.197980+0000","last_change":"2024-04-25T01:39:24.386803+0000","last_active":"2024-04-25T01:39:35.197980+0000","last_peered":"2024-04-25T01:39:35.197980+0000","last_clean":"2024-04-25T01:39:35.197980+0000","last_became_active":"2024-04-25T01:39:24.386531+0000","last_became_peered":"2024-04-25T01:39:24.386531+0000","last_unstale":"2024-04-25T01:39:35.197980+0000","last_undegraded":"2024-04-25T01:39:35.197980+0000","last_fullsized":"2024-04-25T01:39:35.197980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:19.160345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.198690+0000","last_change":"2024-04-25T01:39:33.436433+0000","last_active":"2024-04-25T01:39:35.198690+0000","last_peered":"2024-04-25T01:39:35.198690+0000","last_clean":"2024-04-25T01:39:35.198690+0000","last_became_active":"2024-04-25T01:39:33.436134+0000","last_became_peered":"2024-04-25T01:39:33.436134+0000","last_unstale":"2024-04-25T01:39:35.198690+0000","last_undegraded":"2024-04-25T01:39:35.198690+0000","last_fullsized":"2024-04-25T01:39:35.198690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:08:30.641790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T01:39:35.200300+0000","last_change":"2024-04-25T01:39:24.396231+0000","last_active":"2024-04-25T01:39:35.200300+0000","last_peered":"2024-04-25T01:39:35.200300+0000","last_clean":"2024-04-25T01:39:35.200300+0000","last_became_active":"2024-04-25T01:39:24.395958+0000","last_became_peered":"2024-04-25T01:39:24.395958+0000","last_unstale":"2024-04-25T01:39:35.200300+0000","last_undegraded":"2024-04-25T01:39:35.200300+0000","last_fullsized":"2024-04-25T01:39:35.200300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:54.898765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2666,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":690301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":101745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":99491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":102763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":101055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T01:40:03.264 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T01:40:03.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.411+0000 7f5ae2b42640 1 Processor -- start 2024-04-25T01:40:03.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.411+0000 7f5ae2b42640 1 -- start start 2024-04-25T01:40:03.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.412+0000 7f5ae2b42640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5adc150320 0x7f5adc156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:03.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.412+0000 7f5ae2b42640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5adc06d4e0 0x7f5adc154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:03.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.412+0000 7f5ae2b42640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5adc153be0 con 0x7f5adc06d0a0 2024-04-25T01:40:03.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.412+0000 7f5ae2b42640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f5adc152fd0 con 0x7f5adc06d4e0 2024-04-25T01:40:03.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.412+0000 7f5ae2b42640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f5adc1532b0 con 0x7f5adc150320 2024-04-25T01:40:03.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.412+0000 7f5adbfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f5adc06d0a0 0x7f5adc154380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59478/0 (socket says 172.21.15.77:59478) 2024-04-25T01:40:03.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.412+0000 7f5adbfff640 1 -- 172.21.15.77:0/2660003286 learned_addr learned my addr 172.21.15.77:0/2660003286 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:40:03.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.412+0000 7f5ae10df640 1 --2- 172.21.15.77:0/2660003286 >> v2:172.21.15.77:3300/0 conn(0x7f5adc06d4e0 0x7f5adc154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:03.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.412+0000 7f5adb7fe640 1 -- 172.21.15.77:0/2660003286 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3900281086 0 0) 0x7f5adc153be0 con 0x7f5adc06d0a0 2024-04-25T01:40:03.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.412+0000 7f5adb7fe640 1 -- 172.21.15.77:0/2660003286 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5acc003520 con 0x7f5adc06d0a0 2024-04-25T01:40:03.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.412+0000 7f5ae08de640 1 --2- 172.21.15.77:0/2660003286 >> v2:172.21.15.121:3300/0 conn(0x7f5adc150320 0x7f5adc156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:03.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.412+0000 7f5ae10df640 1 -- 172.21.15.77:0/2660003286 >> v2:172.21.15.121:3300/0 conn(0x7f5adc150320 msgr2=0x7f5adc156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:03.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.412+0000 7f5ae10df640 1 --2- 172.21.15.77:0/2660003286 >> v2:172.21.15.121:3300/0 conn(0x7f5adc150320 0x7f5adc156bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.412+0000 7f5ae10df640 1 -- 172.21.15.77:0/2660003286 >> v1:172.21.15.77:6789/0 conn(0x7f5adc06d0a0 legacy=0x7f5adc154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:03.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.412+0000 7f5ae10df640 1 -- 172.21.15.77:0/2660003286 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5adc157100 con 0x7f5adc06d4e0 2024-04-25T01:40:03.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.413+0000 7f5ae10df640 1 --2- 172.21.15.77:0/2660003286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5adc06d4e0 0x7f5adc154a90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5adc06db60 tx=0x7f5ad402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69dd8c32f8ca5494 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:03.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.413+0000 7f5adb7fe640 1 -- 172.21.15.77:0/2660003286 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4007740 con 0x7f5adc06d4e0 2024-04-25T01:40:03.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.413+0000 7f5adb7fe640 1 -- 172.21.15.77:0/2660003286 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ad40078e0 con 0x7f5adc06d4e0 2024-04-25T01:40:03.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.413+0000 7f5adb7fe640 1 -- 172.21.15.77:0/2660003286 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4007cb0 con 0x7f5adc06d4e0 2024-04-25T01:40:03.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.413+0000 7f5ae2b42640 1 -- 172.21.15.77:0/2660003286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5adc06d4e0 msgr2=0x7f5adc154a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:03.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.413+0000 7f5ae2b42640 1 --2- 172.21.15.77:0/2660003286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5adc06d4e0 0x7f5adc154a90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5adc06db60 tx=0x7f5ad402a680 comp rx=0 tx=0).stop 2024-04-25T01:40:03.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.414+0000 7f5ae2b42640 1 -- 172.21.15.77:0/2660003286 shutdown_connections 2024-04-25T01:40:03.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.414+0000 7f5ae2b42640 1 --2- 172.21.15.77:0/2660003286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5adc06d4e0 0x7f5adc154a90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.414+0000 7f5ae2b42640 1 --2- 172.21.15.77:0/2660003286 >> v2:172.21.15.121:3300/0 conn(0x7f5adc150320 0x7f5adc156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.414+0000 7f5ae2b42640 1 -- 172.21.15.77:0/2660003286 >> 172.21.15.77:0/2660003286 conn(0x7f5adc0c3f80 msgr2=0x7f5adc0c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:03.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.414+0000 7f5ae2b42640 1 -- 172.21.15.77:0/2660003286 shutdown_connections 2024-04-25T01:40:03.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.414+0000 7f5ae2b42640 1 -- 172.21.15.77:0/2660003286 wait complete. 2024-04-25T01:40:03.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.415+0000 7f5ae2b42640 1 Processor -- start 2024-04-25T01:40:03.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.415+0000 7f5ae2b42640 1 -- start start 2024-04-25T01:40:03.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.415+0000 7f5ae2b42640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5adc06d0a0 0x7f5adc0ab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:03.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.415+0000 7f5ae2b42640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5adc06d4e0 0x7f5adc13d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:03.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.415+0000 7f5ae2b42640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5adc150320 0x7f5adc13db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:03.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.415+0000 7f5ae2b42640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5adc154fd0 con 0x7f5adc150320 2024-04-25T01:40:03.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.415+0000 7f5ae2b42640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5adc153870 con 0x7f5adc06d4e0 2024-04-25T01:40:03.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.415+0000 7f5ae2b42640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f5adc152bf0 con 0x7f5adc06d0a0 2024-04-25T01:40:03.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.416+0000 7f5ae10df640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5adc150320 0x7f5adc13db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:03.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.416+0000 7f5ae10df640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5adc150320 0x7f5adc13db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39070/0 (socket says 172.21.15.77:39070) 2024-04-25T01:40:03.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.416+0000 7f5ae10df640 1 -- 172.21.15.77:0/3716802305 learned_addr learned my addr 172.21.15.77:0/3716802305 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:03.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.416+0000 7f5ae08de640 1 --2- 172.21.15.77:0/3716802305 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5adc06d0a0 0x7f5adc0ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:03.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.416+0000 7f5adbfff640 1 --2- 172.21.15.77:0/3716802305 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5adc06d4e0 0x7f5adc13d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:03.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.416+0000 7f5ae10df640 1 -- 172.21.15.77:0/3716802305 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5adc06d0a0 msgr2=0x7f5adc0ab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:03.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.416+0000 7f5ae10df640 1 --2- 172.21.15.77:0/3716802305 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5adc06d0a0 0x7f5adc0ab7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.416+0000 7f5ae10df640 1 -- 172.21.15.77:0/3716802305 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5adc06d4e0 msgr2=0x7f5adc13d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:03.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.416+0000 7f5ae10df640 1 --2- 172.21.15.77:0/3716802305 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5adc06d4e0 0x7f5adc13d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.416+0000 7f5ae10df640 1 -- 172.21.15.77:0/3716802305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5adc14bd30 con 0x7f5adc150320 2024-04-25T01:40:03.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.416+0000 7f5ae10df640 1 --2- 172.21.15.77:0/3716802305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5adc150320 0x7f5adc13db20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5ad402ac70 tx=0x7f5ad4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:03.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.416+0000 7f5ad97fa640 1 -- 172.21.15.77:0/3716802305 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad403f070 con 0x7f5adc150320 2024-04-25T01:40:03.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.416+0000 7f5ad97fa640 1 -- 172.21.15.77:0/3716802305 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ad4031bc0 con 0x7f5adc150320 2024-04-25T01:40:03.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.416+0000 7f5ad97fa640 1 -- 172.21.15.77:0/3716802305 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4009450 con 0x7f5adc150320 2024-04-25T01:40:03.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.416+0000 7f5ae2b42640 1 -- 172.21.15.77:0/3716802305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5adc14c010 con 0x7f5adc150320 2024-04-25T01:40:03.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.416+0000 7f5ae2b42640 1 -- 172.21.15.77:0/3716802305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5adc0abd30 con 0x7f5adc150320 2024-04-25T01:40:03.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.417+0000 7f5ae2b42640 1 -- 172.21.15.77:0/3716802305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5adc04f500 con 0x7f5adc150320 2024-04-25T01:40:03.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.418+0000 7f5ad97fa640 1 -- 172.21.15.77:0/3716802305 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5ad403b410 con 0x7f5adc150320 2024-04-25T01:40:03.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.418+0000 7f5ad97fa640 1 --2- 172.21.15.77:0/3716802305 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5ac006be30 0x7f5ac006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:03.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.418+0000 7f5ae08de640 1 --2- 172.21.15.77:0/3716802305 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5ac006be30 0x7f5ac006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:03.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.418+0000 7f5ad97fa640 1 -- 172.21.15.77:0/3716802305 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f5ad40ac850 con 0x7f5adc150320 2024-04-25T01:40:03.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.419+0000 7f5ae08de640 1 --2- 172.21.15.77:0/3716802305 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5ac006be30 0x7f5ac006e2f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0006fd0 tx=0x7f5ad0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:03.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.422+0000 7f5ad97fa640 1 -- 172.21.15.77:0/3716802305 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5ad407a910 con 0x7f5adc150320 2024-04-25T01:40:03.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.597+0000 7f5ae2b42640 1 -- 172.21.15.77:0/3716802305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5adc073750 con 0x7f5adc150320 2024-04-25T01:40:03.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.598+0000 7f5ad97fa640 1 -- 172.21.15.77:0/3716802305 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20331 (secure 0 0 0) 0x7f5ad407ec10 con 0x7f5adc150320 2024-04-25T01:40:03.582 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:40:03.582 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:39:34.425701+0000","last_up_change":"2024-04-25T01:39:10.729600+0000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T01:39:11.681151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T01:39:21.606752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T01:39:22.677664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T01:39:30.501700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T01:39:31.740717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6811","nonce":3366980158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6817","nonce":3366980158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6828","nonce":3366980158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6825","nonce":3366980158}]},"public_addr":"172.21.15.77:6811/3366980158","cluster_addr":"172.21.15.77:6817/3366980158","heartbeat_back_addr":"172.21.15.77:6828/3366980158","heartbeat_front_addr":"172.21.15.77:6825/3366980158","state":["exists","up"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6801","nonce":3971619298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6803","nonce":3971619298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6807","nonce":3971619298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6805","nonce":3971619298}]},"public_addr":"172.21.15.77:6801/3971619298","cluster_addr":"172.21.15.77:6803/3971619298","heartbeat_back_addr":"172.21.15.77:6807/3971619298","heartbeat_front_addr":"172.21.15.77:6805/3971619298","state":["exists","up"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6810","nonce":4103452689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6813","nonce":4103452689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6823","nonce":4103452689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6818","nonce":4103452689}]},"public_addr":"172.21.15.77:6810/4103452689","cluster_addr":"172.21.15.77:6813/4103452689","heartbeat_back_addr":"172.21.15.77:6823/4103452689","heartbeat_front_addr":"172.21.15.77:6818/4103452689","state":["exists","up"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6819","nonce":217398906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6824","nonce":217398906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6831","nonce":217398906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6829","nonce":217398906}]},"public_addr":"172.21.15.77:6819/217398906","cluster_addr":"172.21.15.77:6824/217398906","heartbeat_back_addr":"172.21.15.77:6831/217398906","heartbeat_front_addr":"172.21.15.77:6829/217398906","state":["exists","up"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6801","nonce":2565483070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6803","nonce":2565483070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6810","nonce":2565483070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6806","nonce":2565483070}]},"public_addr":"172.21.15.121:6801/2565483070","cluster_addr":"172.21.15.121:6803/2565483070","heartbeat_back_addr":"172.21.15.121:6810/2565483070","heartbeat_front_addr":"172.21.15.121:6806/2565483070","state":["exists","up"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6807","nonce":2785294752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6809","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6811","nonce":2785294752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6815","nonce":2785294752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6813","nonce":2785294752}]},"public_addr":"172.21.15.121:6807/2785294752","cluster_addr":"172.21.15.121:6811/2785294752","heartbeat_back_addr":"172.21.15.121:6815/2785294752","heartbeat_front_addr":"172.21.15.121:6813/2785294752","state":["exists","up"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6820","nonce":523906818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6824","nonce":523906818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6831","nonce":523906818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6828","nonce":523906818}]},"public_addr":"172.21.15.121:6820/523906818","cluster_addr":"172.21.15.121:6824/523906818","heartbeat_back_addr":"172.21.15.121:6831/523906818","heartbeat_front_addr":"172.21.15.121:6828/523906818","state":["exists","up"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6817","nonce":1683602459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6819","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6821","nonce":1683602459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6829","nonce":1683602459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6823","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6825","nonce":1683602459}]},"public_addr":"172.21.15.121:6817/1683602459","cluster_addr":"172.21.15.121:6821/1683602459","heartbeat_back_addr":"172.21.15.121:6829/1683602459","heartbeat_front_addr":"172.21.15.121:6825/1683602459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.839443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.818842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.776243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.793085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.822396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.907311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.918374+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.848430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:40:03.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.600+0000 7f5ae2b42640 1 -- 172.21.15.77:0/3716802305 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5ac006be30 msgr2=0x7f5ac006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:03.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.600+0000 7f5ae2b42640 1 --2- 172.21.15.77:0/3716802305 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5ac006be30 0x7f5ac006e2f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0006fd0 tx=0x7f5ad0008040 comp rx=0 tx=0).stop 2024-04-25T01:40:03.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.600+0000 7f5ae2b42640 1 -- 172.21.15.77:0/3716802305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5adc150320 msgr2=0x7f5adc13db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:03.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.600+0000 7f5ae2b42640 1 --2- 172.21.15.77:0/3716802305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5adc150320 0x7f5adc13db20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5ad402ac70 tx=0x7f5ad4004a40 comp rx=0 tx=0).stop 2024-04-25T01:40:03.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.600+0000 7f5ae2b42640 1 -- 172.21.15.77:0/3716802305 shutdown_connections 2024-04-25T01:40:03.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.600+0000 7f5ae2b42640 1 --2- 172.21.15.77:0/3716802305 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5ac006be30 0x7f5ac006e2f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.600+0000 7f5ae2b42640 1 --2- 172.21.15.77:0/3716802305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5adc150320 0x7f5adc13db20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.600+0000 7f5ae2b42640 1 --2- 172.21.15.77:0/3716802305 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5adc06d4e0 0x7f5adc13d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.600+0000 7f5ae2b42640 1 --2- 172.21.15.77:0/3716802305 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5adc06d0a0 0x7f5adc0ab7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.600+0000 7f5ae2b42640 1 -- 172.21.15.77:0/3716802305 >> 172.21.15.77:0/3716802305 conn(0x7f5adc0c3f80 msgr2=0x7f5adc140690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:03.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.600+0000 7f5ae2b42640 1 -- 172.21.15.77:0/3716802305 shutdown_connections 2024-04-25T01:40:03.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.600+0000 7f5ae2b42640 1 -- 172.21.15.77:0/3716802305 wait complete. 2024-04-25T01:40:03.595 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T01:39:11.681151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-25T01:39:21.606752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-25T01:39:22.677664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-25T01:39:30.501700+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-25T01:39:31.740717+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T01:40:03.596 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T01:40:03.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.713+0000 7f1b02d1d640 1 Processor -- start 2024-04-25T01:40:03.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.713+0000 7f1b02d1d640 1 -- start start 2024-04-25T01:40:03.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.713+0000 7f1b02d1d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1afc0c4280 0x7f1afc153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:03.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.713+0000 7f1b02d1d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1afc0aca40 0x7f1afc1511f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:03.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.713+0000 7f1b02d1d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1afc151730 0x7f1afc06d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:03.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.713+0000 7f1b02d1d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f1afc151ba0 con 0x7f1afc0c4280 2024-04-25T01:40:03.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.713+0000 7f1b02d1d640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f1afc154430 con 0x7f1afc151730 2024-04-25T01:40:03.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.713+0000 7f1b02d1d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f1afc1546b0 con 0x7f1afc0aca40 2024-04-25T01:40:03.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.713+0000 7f1b00ab9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1afc0c4280 0x7f1afc153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:03.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.713+0000 7f1b00ab9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1afc0c4280 0x7f1afc153ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39080/0 (socket says 172.21.15.77:39080) 2024-04-25T01:40:03.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.714+0000 7f1b00ab9640 1 -- 172.21.15.77:0/507278732 learned_addr learned my addr 172.21.15.77:0/507278732 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:03.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.714+0000 7f1b00ab9640 1 -- 172.21.15.77:0/507278732 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1afc0aca40 msgr2=0x7f1afc1511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:03.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.714+0000 7f1b00ab9640 1 --2- 172.21.15.77:0/507278732 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1afc0aca40 0x7f1afc1511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.714+0000 7f1b012ba640 1 --2- 172.21.15.77:0/507278732 >> v2:172.21.15.121:3300/0 conn(0x7f1afc151730 0x7f1afc06d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:03.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.714+0000 7f1b00ab9640 1 -- 172.21.15.77:0/507278732 >> v2:172.21.15.121:3300/0 conn(0x7f1afc151730 msgr2=0x7f1afc06d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:03.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.714+0000 7f1b00ab9640 1 --2- 172.21.15.77:0/507278732 >> v2:172.21.15.121:3300/0 conn(0x7f1afc151730 0x7f1afc06d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.714+0000 7f1b00ab9640 1 -- 172.21.15.77:0/507278732 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1afc154990 con 0x7f1afc0c4280 2024-04-25T01:40:03.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.714+0000 7f1b012ba640 1 --2- 172.21.15.77:0/507278732 >> v2:172.21.15.121:3300/0 conn(0x7f1afc151730 0x7f1afc06d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:40:03.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.714+0000 7f1b00ab9640 1 --2- 172.21.15.77:0/507278732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1afc0c4280 0x7f1afc153ef0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1afc070110 tx=0x7f1af002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e504675ff42fbecd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:03.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.715+0000 7f1afb7fe640 1 -- 172.21.15.77:0/507278732 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af0037070 con 0x7f1afc0c4280 2024-04-25T01:40:03.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.715+0000 7f1afb7fe640 1 -- 172.21.15.77:0/507278732 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1af0032440 con 0x7f1afc0c4280 2024-04-25T01:40:03.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.715+0000 7f1afb7fe640 1 -- 172.21.15.77:0/507278732 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af0032810 con 0x7f1afc0c4280 2024-04-25T01:40:03.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.715+0000 7f1b02d1d640 1 -- 172.21.15.77:0/507278732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1afc0c4280 msgr2=0x7f1afc153ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:03.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.715+0000 7f1b02d1d640 1 --2- 172.21.15.77:0/507278732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1afc0c4280 0x7f1afc153ef0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1afc070110 tx=0x7f1af002a140 comp rx=0 tx=0).stop 2024-04-25T01:40:03.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.715+0000 7f1b02d1d640 1 -- 172.21.15.77:0/507278732 shutdown_connections 2024-04-25T01:40:03.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.715+0000 7f1b02d1d640 1 --2- 172.21.15.77:0/507278732 >> v2:172.21.15.121:3300/0 conn(0x7f1afc151730 0x7f1afc06d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.715+0000 7f1b02d1d640 1 --2- 172.21.15.77:0/507278732 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1afc0aca40 0x7f1afc1511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.715+0000 7f1b02d1d640 1 --2- 172.21.15.77:0/507278732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1afc0c4280 0x7f1afc153ef0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.715+0000 7f1b02d1d640 1 -- 172.21.15.77:0/507278732 >> 172.21.15.77:0/507278732 conn(0x7f1afc0c7580 msgr2=0x7f1afc0c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:03.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.715+0000 7f1b02d1d640 1 -- 172.21.15.77:0/507278732 shutdown_connections 2024-04-25T01:40:03.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.715+0000 7f1b02d1d640 1 -- 172.21.15.77:0/507278732 wait complete. 2024-04-25T01:40:03.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.716+0000 7f1b02d1d640 1 Processor -- start 2024-04-25T01:40:03.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.716+0000 7f1b02d1d640 1 -- start start 2024-04-25T01:40:03.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.717+0000 7f1b02d1d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1afc0aca40 0x7f1afc1ed7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:03.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.717+0000 7f1b02d1d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1afc0c4280 0x7f1afc1492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:03.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.717+0000 7f1b02d1d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1afc151730 0x7f1afc1e98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:03.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.717+0000 7f1b02d1d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1afc0c4660 con 0x7f1afc151730 2024-04-25T01:40:03.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.717+0000 7f1b02d1d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1afc06d3a0 con 0x7f1afc0aca40 2024-04-25T01:40:03.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.717+0000 7f1b02d1d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f1afc0c47e0 con 0x7f1afc0c4280 2024-04-25T01:40:03.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.717+0000 7f1b012ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1afc151730 0x7f1afc1e98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:03.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.717+0000 7f1b012ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1afc151730 0x7f1afc1e98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39086/0 (socket says 172.21.15.77:39086) 2024-04-25T01:40:03.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.717+0000 7f1b012ba640 1 -- 172.21.15.77:0/2532945566 learned_addr learned my addr 172.21.15.77:0/2532945566 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:03.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.717+0000 7f1afbfff640 1 --2- 172.21.15.77:0/2532945566 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1afc0c4280 0x7f1afc1492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:03.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.717+0000 7f1b00ab9640 1 --2- 172.21.15.77:0/2532945566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1afc0aca40 0x7f1afc1ed7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:03.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.717+0000 7f1b012ba640 1 -- 172.21.15.77:0/2532945566 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1afc0c4280 msgr2=0x7f1afc1492d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:03.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.717+0000 7f1b012ba640 1 --2- 172.21.15.77:0/2532945566 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1afc0c4280 0x7f1afc1492d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.717+0000 7f1b012ba640 1 -- 172.21.15.77:0/2532945566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1afc0aca40 msgr2=0x7f1afc1ed7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:03.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.717+0000 7f1b012ba640 1 --2- 172.21.15.77:0/2532945566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1afc0aca40 0x7f1afc1ed7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.717+0000 7f1b012ba640 1 -- 172.21.15.77:0/2532945566 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1afc1edd00 con 0x7f1afc151730 2024-04-25T01:40:03.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.718+0000 7f1b012ba640 1 --2- 172.21.15.77:0/2532945566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1afc151730 0x7f1afc1e98b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1af400cef0 tx=0x7f1af400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:03.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.718+0000 7f1af97fa640 1 -- 172.21.15.77:0/2532945566 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af401a070 con 0x7f1afc151730 2024-04-25T01:40:03.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.718+0000 7f1af97fa640 1 -- 172.21.15.77:0/2532945566 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1af400d860 con 0x7f1afc151730 2024-04-25T01:40:03.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.718+0000 7f1af97fa640 1 -- 172.21.15.77:0/2532945566 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af400dc50 con 0x7f1afc151730 2024-04-25T01:40:03.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.718+0000 7f1b02d1d640 1 -- 172.21.15.77:0/2532945566 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1afc154eb0 con 0x7f1afc151730 2024-04-25T01:40:03.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.718+0000 7f1b02d1d640 1 -- 172.21.15.77:0/2532945566 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1afc1ecfc0 con 0x7f1afc151730 2024-04-25T01:40:03.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.719+0000 7f1b02d1d640 1 -- 172.21.15.77:0/2532945566 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1afc1553d0 con 0x7f1afc151730 2024-04-25T01:40:03.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.719+0000 7f1af97fa640 1 -- 172.21.15.77:0/2532945566 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1af401d070 con 0x7f1afc151730 2024-04-25T01:40:03.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.720+0000 7f1af97fa640 1 --2- 172.21.15.77:0/2532945566 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1ae006be30 0x7f1ae006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:03.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.720+0000 7f1af97fa640 1 -- 172.21.15.77:0/2532945566 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f1af408b930 con 0x7f1afc151730 2024-04-25T01:40:03.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.720+0000 7f1b00ab9640 1 --2- 172.21.15.77:0/2532945566 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1ae006be30 0x7f1ae006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:03.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.720+0000 7f1b00ab9640 1 --2- 172.21.15.77:0/2532945566 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1ae006be30 0x7f1ae006e2f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1af0034000 tx=0x7f1af002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:03.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.724+0000 7f1af97fa640 1 -- 172.21.15.77:0/2532945566 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1afc1553d0 con 0x7f1afc151730 2024-04-25T01:40:03.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.896+0000 7f1b02d1d640 1 -- 172.21.15.77:0/2532945566 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1afc04f500 con 0x7f1afc151730 2024-04-25T01:40:03.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.896+0000 7f1af97fa640 1 -- 172.21.15.77:0/2532945566 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f1af4059ab0 con 0x7f1afc151730 2024-04-25T01:40:03.880 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-25T01:40:03.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.898+0000 7f1b02d1d640 1 -- 172.21.15.77:0/2532945566 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1ae006be30 msgr2=0x7f1ae006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:03.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.898+0000 7f1b02d1d640 1 --2- 172.21.15.77:0/2532945566 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1ae006be30 0x7f1ae006e2f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1af0034000 tx=0x7f1af002e000 comp rx=0 tx=0).stop 2024-04-25T01:40:03.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.898+0000 7f1b02d1d640 1 -- 172.21.15.77:0/2532945566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1afc151730 msgr2=0x7f1afc1e98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:03.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.898+0000 7f1b02d1d640 1 --2- 172.21.15.77:0/2532945566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1afc151730 0x7f1afc1e98b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1af400cef0 tx=0x7f1af400a710 comp rx=0 tx=0).stop 2024-04-25T01:40:03.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.898+0000 7f1b02d1d640 1 -- 172.21.15.77:0/2532945566 shutdown_connections 2024-04-25T01:40:03.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.898+0000 7f1b02d1d640 1 --2- 172.21.15.77:0/2532945566 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1ae006be30 0x7f1ae006e2f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.898+0000 7f1b02d1d640 1 --2- 172.21.15.77:0/2532945566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1afc151730 0x7f1afc1e98b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.898+0000 7f1b02d1d640 1 --2- 172.21.15.77:0/2532945566 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1afc0c4280 0x7f1afc1492d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.898+0000 7f1b02d1d640 1 --2- 172.21.15.77:0/2532945566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1afc0aca40 0x7f1afc1ed7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.898+0000 7f1b02d1d640 1 -- 172.21.15.77:0/2532945566 >> 172.21.15.77:0/2532945566 conn(0x7f1afc0c7580 msgr2=0x7f1afc14ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:03.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.898+0000 7f1b02d1d640 1 -- 172.21.15.77:0/2532945566 shutdown_connections 2024-04-25T01:40:03.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:03.898+0000 7f1b02d1d640 1 -- 172.21.15.77:0/2532945566 wait complete. 2024-04-25T01:40:03.893 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-25T01:40:03.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.007+0000 7f0a40541640 1 Processor -- start 2024-04-25T01:40:03.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.007+0000 7f0a40541640 1 -- start start 2024-04-25T01:40:03.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.008+0000 7f0a40541640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0a38153530 0x7f0a380c6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:03.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.008+0000 7f0a40541640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0a380c97c0 0x7f0a38159d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:03.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.008+0000 7f0a40541640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a3806d110 con 0x7f0a380bef50 2024-04-25T01:40:03.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.008+0000 7f0a40541640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f0a38153910 con 0x7f0a380c97c0 2024-04-25T01:40:03.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.008+0000 7f0a40541640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f0a38156980 con 0x7f0a38153530 2024-04-25T01:40:03.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.008+0000 7f0a3dadc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0a380bef50 0x7f0a381595f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59490/0 (socket says 172.21.15.77:59490) 2024-04-25T01:40:03.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.008+0000 7f0a3dadc640 1 -- 172.21.15.77:0/1255050494 learned_addr learned my addr 172.21.15.77:0/1255050494 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:40:03.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.008+0000 7f0a3e2dd640 1 --2- 172.21.15.77:0/1255050494 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0a38153530 0x7f0a380c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:03.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.008+0000 7f0a3eade640 1 --2- 172.21.15.77:0/1255050494 >> v2:172.21.15.121:3300/0 conn(0x7f0a380c97c0 0x7f0a38159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:03.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.009+0000 7f0a3d2db640 1 -- 172.21.15.77:0/1255050494 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1205994792 0 0) 0x7f0a3806d110 con 0x7f0a380bef50 2024-04-25T01:40:03.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.009+0000 7f0a3d2db640 1 -- 172.21.15.77:0/1255050494 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a24003520 con 0x7f0a380bef50 2024-04-25T01:40:03.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.009+0000 7f0a3e2dd640 1 -- 172.21.15.77:0/1255050494 >> v2:172.21.15.121:3300/0 conn(0x7f0a380c97c0 msgr2=0x7f0a38159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:03.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.009+0000 7f0a3e2dd640 1 --2- 172.21.15.77:0/1255050494 >> v2:172.21.15.121:3300/0 conn(0x7f0a380c97c0 0x7f0a38159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.009+0000 7f0a3e2dd640 1 -- 172.21.15.77:0/1255050494 >> v1:172.21.15.77:6789/0 conn(0x7f0a380bef50 legacy=0x7f0a381595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:03.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.009+0000 7f0a3e2dd640 1 -- 172.21.15.77:0/1255050494 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a38156c60 con 0x7f0a38153530 2024-04-25T01:40:03.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.010+0000 7f0a3e2dd640 1 --2- 172.21.15.77:0/1255050494 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0a38153530 0x7f0a380c6240 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009d90 tx=0x7f0a3402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25530c99c974da74 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:03.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.010+0000 7f0a3d2db640 1 -- 172.21.15.77:0/1255050494 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a34031600 con 0x7f0a38153530 2024-04-25T01:40:03.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.010+0000 7f0a3d2db640 1 -- 172.21.15.77:0/1255050494 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a340317a0 con 0x7f0a38153530 2024-04-25T01:40:03.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.010+0000 7f0a3d2db640 1 -- 172.21.15.77:0/1255050494 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a34031b50 con 0x7f0a38153530 2024-04-25T01:40:03.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.010+0000 7f0a40541640 1 -- 172.21.15.77:0/1255050494 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0a38153530 msgr2=0x7f0a380c6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:03.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.010+0000 7f0a40541640 1 --2- 172.21.15.77:0/1255050494 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0a38153530 0x7f0a380c6240 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009d90 tx=0x7f0a3402a5d0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.010+0000 7f0a40541640 1 -- 172.21.15.77:0/1255050494 shutdown_connections 2024-04-25T01:40:03.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.010+0000 7f0a40541640 1 --2- 172.21.15.77:0/1255050494 >> v2:172.21.15.121:3300/0 conn(0x7f0a380c97c0 0x7f0a38159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.010+0000 7f0a40541640 1 --2- 172.21.15.77:0/1255050494 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0a38153530 0x7f0a380c6240 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.010+0000 7f0a40541640 1 -- 172.21.15.77:0/1255050494 >> 172.21.15.77:0/1255050494 conn(0x7f0a380672c0 msgr2=0x7f0a380676d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:03.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.010+0000 7f0a40541640 1 -- 172.21.15.77:0/1255050494 shutdown_connections 2024-04-25T01:40:03.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.010+0000 7f0a40541640 1 -- 172.21.15.77:0/1255050494 wait complete. 2024-04-25T01:40:03.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.011+0000 7f0a40541640 1 Processor -- start 2024-04-25T01:40:03.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.011+0000 7f0a40541640 1 -- start start 2024-04-25T01:40:03.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.012+0000 7f0a40541640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a380bef50 0x7f0a380ca750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:03.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.012+0000 7f0a40541640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0a380c97c0 0x7f0a3814e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:03.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.012+0000 7f0a40541640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0a38153530 0x7f0a3814ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:03.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.012+0000 7f0a40541640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3815a240 con 0x7f0a380bef50 2024-04-25T01:40:03.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.012+0000 7f0a40541640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0a380cc250 con 0x7f0a380c97c0 2024-04-25T01:40:03.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.012+0000 7f0a40541640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f0a380c6780 con 0x7f0a38153530 2024-04-25T01:40:03.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.012+0000 7f0a3e2dd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a380bef50 0x7f0a380ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:03.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.012+0000 7f0a3e2dd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a380bef50 0x7f0a380ca750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39102/0 (socket says 172.21.15.77:39102) 2024-04-25T01:40:03.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.012+0000 7f0a3e2dd640 1 -- 172.21.15.77:0/2387741996 learned_addr learned my addr 172.21.15.77:0/2387741996 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:03.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.012+0000 7f0a3dadc640 1 --2- 172.21.15.77:0/2387741996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0a380c97c0 0x7f0a3814e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:03.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.012+0000 7f0a3eade640 1 --2- 172.21.15.77:0/2387741996 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0a38153530 0x7f0a3814ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:03.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.012+0000 7f0a3e2dd640 1 -- 172.21.15.77:0/2387741996 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0a38153530 msgr2=0x7f0a3814ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:03.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.012+0000 7f0a3e2dd640 1 --2- 172.21.15.77:0/2387741996 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0a38153530 0x7f0a3814ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.012+0000 7f0a3e2dd640 1 -- 172.21.15.77:0/2387741996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0a380c97c0 msgr2=0x7f0a3814e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:03.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.012+0000 7f0a3e2dd640 1 --2- 172.21.15.77:0/2387741996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0a380c97c0 0x7f0a3814e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:03.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.012+0000 7f0a3e2dd640 1 -- 172.21.15.77:0/2387741996 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a381eef40 con 0x7f0a380bef50 2024-04-25T01:40:04.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.013+0000 7f0a3e2dd640 1 --2- 172.21.15.77:0/2387741996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a380bef50 0x7f0a380ca750 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009eb0 tx=0x7f0a34004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:04.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.013+0000 7f0a2effd640 1 -- 172.21.15.77:0/2387741996 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a3403f070 con 0x7f0a380bef50 2024-04-25T01:40:04.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.013+0000 7f0a2effd640 1 -- 172.21.15.77:0/2387741996 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a34030830 con 0x7f0a380bef50 2024-04-25T01:40:04.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.013+0000 7f0a2effd640 1 -- 172.21.15.77:0/2387741996 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a34030c00 con 0x7f0a380bef50 2024-04-25T01:40:04.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.013+0000 7f0a40541640 1 -- 172.21.15.77:0/2387741996 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a381ef220 con 0x7f0a380bef50 2024-04-25T01:40:04.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.013+0000 7f0a40541640 1 -- 172.21.15.77:0/2387741996 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a381ef7e0 con 0x7f0a380bef50 2024-04-25T01:40:04.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.014+0000 7f0a40541640 1 -- 172.21.15.77:0/2387741996 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a3804f500 con 0x7f0a380bef50 2024-04-25T01:40:04.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.014+0000 7f0a2effd640 1 -- 172.21.15.77:0/2387741996 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0a3403b410 con 0x7f0a380bef50 2024-04-25T01:40:04.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.015+0000 7f0a2effd640 1 --2- 172.21.15.77:0/2387741996 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0a1c06be60 0x7f0a1c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:04.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.015+0000 7f0a2effd640 1 -- 172.21.15.77:0/2387741996 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f0a340ac5b0 con 0x7f0a380bef50 2024-04-25T01:40:04.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.015+0000 7f0a3dadc640 1 --2- 172.21.15.77:0/2387741996 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0a1c06be60 0x7f0a1c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:04.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.015+0000 7f0a3dadc640 1 --2- 172.21.15.77:0/2387741996 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0a1c06be60 0x7f0a1c06e320 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0a28005880 tx=0x7f0a28009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:04.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.019+0000 7f0a2effd640 1 -- 172.21.15.77:0/2387741996 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0a3407acc0 con 0x7f0a380bef50 2024-04-25T01:40:04.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.191+0000 7f0a40541640 1 -- 172.21.15.77:0/2387741996 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7f0a3806cd20 con 0x7f0a380bef50 2024-04-25T01:40:04.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.191+0000 7f0a2effd640 1 -- 172.21.15.77:0/2387741996 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v24) ==== 99+0+11 (secure 0 0 0) 0x7f0a3404ce30 con 0x7f0a380bef50 2024-04-25T01:40:04.175 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T01:40:04.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.193+0000 7f0a40541640 1 -- 172.21.15.77:0/2387741996 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0a1c06be60 msgr2=0x7f0a1c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:04.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.193+0000 7f0a40541640 1 --2- 172.21.15.77:0/2387741996 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0a1c06be60 0x7f0a1c06e320 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0a28005880 tx=0x7f0a28009040 comp rx=0 tx=0).stop 2024-04-25T01:40:04.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.193+0000 7f0a40541640 1 -- 172.21.15.77:0/2387741996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a380bef50 msgr2=0x7f0a380ca750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:04.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.193+0000 7f0a40541640 1 --2- 172.21.15.77:0/2387741996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a380bef50 0x7f0a380ca750 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009eb0 tx=0x7f0a34004a40 comp rx=0 tx=0).stop 2024-04-25T01:40:04.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.193+0000 7f0a40541640 1 -- 172.21.15.77:0/2387741996 shutdown_connections 2024-04-25T01:40:04.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.193+0000 7f0a40541640 1 --2- 172.21.15.77:0/2387741996 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0a1c06be60 0x7f0a1c06e320 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:04.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.193+0000 7f0a40541640 1 --2- 172.21.15.77:0/2387741996 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0a38153530 0x7f0a3814ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:04.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.193+0000 7f0a40541640 1 --2- 172.21.15.77:0/2387741996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0a380c97c0 0x7f0a3814e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:04.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.193+0000 7f0a40541640 1 --2- 172.21.15.77:0/2387741996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a380bef50 0x7f0a380ca750 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:04.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.193+0000 7f0a40541640 1 -- 172.21.15.77:0/2387741996 >> 172.21.15.77:0/2387741996 conn(0x7f0a380672c0 msgr2=0x7f0a380c82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:04.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.193+0000 7f0a40541640 1 -- 172.21.15.77:0/2387741996 shutdown_connections 2024-04-25T01:40:04.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.193+0000 7f0a40541640 1 -- 172.21.15.77:0/2387741996 wait complete. 2024-04-25T01:40:04.188 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-25T01:40:04.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.303+0000 7f68a4aa5640 1 Processor -- start 2024-04-25T01:40:04.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.303+0000 7f68a4aa5640 1 -- start start 2024-04-25T01:40:04.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.304+0000 7f68a4aa5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f68a0153530 0x7f68a00c6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:04.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.304+0000 7f68a4aa5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68a006d110 con 0x7f68a00c97c0 2024-04-25T01:40:04.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.304+0000 7f68a4aa5640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68a0153910 con 0x7f68a00bef50 2024-04-25T01:40:04.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.304+0000 7f68a4aa5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f68a0156980 con 0x7f68a0153530 2024-04-25T01:40:04.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.304+0000 7f689e59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f68a0153530 0x7f68a00c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:04.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.304+0000 7f689ed9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f68a00c97c0 0x7f68a0159d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59504/0 (socket says 172.21.15.77:59504) 2024-04-25T01:40:04.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.304+0000 7f689ed9d640 1 -- 172.21.15.77:0/791808720 learned_addr learned my addr 172.21.15.77:0/791808720 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:40:04.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.305+0000 7f689e59c640 1 -- 172.21.15.77:0/791808720 >> v1:172.21.15.121:6789/0 conn(0x7f68a00bef50 legacy=0x7f68a01595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:04.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.305+0000 7f689e59c640 1 -- 172.21.15.77:0/791808720 >> v1:172.21.15.77:6789/0 conn(0x7f68a00c97c0 legacy=0x7f68a0159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:04.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.305+0000 7f689e59c640 1 -- 172.21.15.77:0/791808720 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a0156c60 con 0x7f68a0153530 2024-04-25T01:40:04.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.305+0000 7f689d59a640 1 -- 172.21.15.77:0/791808720 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3950213974 0 0) 0x7f68a006d110 con 0x7f68a00c97c0 2024-04-25T01:40:04.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.305+0000 7f689e59c640 1 --2- 172.21.15.77:0/791808720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68a0153530 0x7f68a00c6240 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6890009d90 tx=0x7f689002a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8768cce3c525fab3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:04.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.305+0000 7f689d59a640 1 -- 172.21.15.77:0/791808720 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6890007740 con 0x7f68a0153530 2024-04-25T01:40:04.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.305+0000 7f689d59a640 1 -- 172.21.15.77:0/791808720 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68900078e0 con 0x7f68a0153530 2024-04-25T01:40:04.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.305+0000 7f689d59a640 1 -- 172.21.15.77:0/791808720 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6890007cb0 con 0x7f68a0153530 2024-04-25T01:40:04.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.306+0000 7f68a4aa5640 1 -- 172.21.15.77:0/791808720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68a0153530 msgr2=0x7f68a00c6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:04.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.306+0000 7f68a4aa5640 1 --2- 172.21.15.77:0/791808720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68a0153530 0x7f68a00c6240 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6890009d90 tx=0x7f689002a580 comp rx=0 tx=0).stop 2024-04-25T01:40:04.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.306+0000 7f68a4aa5640 1 -- 172.21.15.77:0/791808720 shutdown_connections 2024-04-25T01:40:04.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.306+0000 7f68a4aa5640 1 --2- 172.21.15.77:0/791808720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68a0153530 0x7f68a00c6240 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:04.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.306+0000 7f68a4aa5640 1 -- 172.21.15.77:0/791808720 >> 172.21.15.77:0/791808720 conn(0x7f68a00672c0 msgr2=0x7f68a00676d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:04.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.306+0000 7f68a4aa5640 1 -- 172.21.15.77:0/791808720 shutdown_connections 2024-04-25T01:40:04.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.306+0000 7f68a4aa5640 1 -- 172.21.15.77:0/791808720 wait complete. 2024-04-25T01:40:04.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.307+0000 7f68a4aa5640 1 Processor -- start 2024-04-25T01:40:04.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.307+0000 7f68a4aa5640 1 -- start start 2024-04-25T01:40:04.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.308+0000 7f68a4aa5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68a00bef50 0x7f68a014aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:04.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.308+0000 7f68a4aa5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68a00c97c0 0x7f68a014af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:04.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.308+0000 7f68a4aa5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f68a0153530 0x7f68a00c0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:04.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.308+0000 7f68a4aa5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f68a00c6780 con 0x7f68a00bef50 2024-04-25T01:40:04.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.308+0000 7f68a4aa5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f68a00cc250 con 0x7f68a00c97c0 2024-04-25T01:40:04.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.308+0000 7f68a4aa5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f68a00c6900 con 0x7f68a0153530 2024-04-25T01:40:04.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.308+0000 7f689e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68a00bef50 0x7f68a014aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:04.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.308+0000 7f689e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68a00bef50 0x7f68a014aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39124/0 (socket says 172.21.15.77:39124) 2024-04-25T01:40:04.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.308+0000 7f689e59c640 1 -- 172.21.15.77:0/985276070 learned_addr learned my addr 172.21.15.77:0/985276070 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:04.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.308+0000 7f689ed9d640 1 --2- 172.21.15.77:0/985276070 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f68a0153530 0x7f68a00c0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:04.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.308+0000 7f689dd9b640 1 --2- 172.21.15.77:0/985276070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68a00c97c0 0x7f68a014af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:04.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.308+0000 7f689e59c640 1 -- 172.21.15.77:0/985276070 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f68a0153530 msgr2=0x7f68a00c0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:04.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.308+0000 7f689e59c640 1 --2- 172.21.15.77:0/985276070 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f68a0153530 0x7f68a00c0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:04.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.308+0000 7f689e59c640 1 -- 172.21.15.77:0/985276070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68a00c97c0 msgr2=0x7f68a014af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:04.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.308+0000 7f689e59c640 1 --2- 172.21.15.77:0/985276070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68a00c97c0 0x7f68a014af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:04.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.308+0000 7f689e59c640 1 -- 172.21.15.77:0/985276070 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a00c05f0 con 0x7f68a00bef50 2024-04-25T01:40:04.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.308+0000 7f689dd9b640 1 --2- 172.21.15.77:0/985276070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68a00c97c0 0x7f68a014af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:40:04.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.309+0000 7f689e59c640 1 --2- 172.21.15.77:0/985276070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68a00bef50 0x7f68a014aa30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6890009eb0 tx=0x7f6890004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:04.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.309+0000 7f688effd640 1 -- 172.21.15.77:0/985276070 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6890040070 con 0x7f68a00bef50 2024-04-25T01:40:04.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.309+0000 7f688effd640 1 -- 172.21.15.77:0/985276070 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6890031c40 con 0x7f68a00bef50 2024-04-25T01:40:04.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.309+0000 7f68a4aa5640 1 -- 172.21.15.77:0/985276070 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68a0157f50 con 0x7f68a00bef50 2024-04-25T01:40:04.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.309+0000 7f688effd640 1 -- 172.21.15.77:0/985276070 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689003c420 con 0x7f68a00bef50 2024-04-25T01:40:04.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.309+0000 7f68a4aa5640 1 -- 172.21.15.77:0/985276070 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68a0158510 con 0x7f68a00bef50 2024-04-25T01:40:04.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.310+0000 7f68a4aa5640 1 -- 172.21.15.77:0/985276070 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68a0156e30 con 0x7f68a00bef50 2024-04-25T01:40:04.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.310+0000 7f688effd640 1 -- 172.21.15.77:0/985276070 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6890039040 con 0x7f68a00bef50 2024-04-25T01:40:04.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.310+0000 7f688effd640 1 --2- 172.21.15.77:0/985276070 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f688006be60 0x7f688006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:04.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.310+0000 7f688effd640 1 -- 172.21.15.77:0/985276070 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f68900ac7a0 con 0x7f68a00bef50 2024-04-25T01:40:04.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.311+0000 7f689dd9b640 1 --2- 172.21.15.77:0/985276070 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f688006be60 0x7f688006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:04.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.311+0000 7f689dd9b640 1 --2- 172.21.15.77:0/985276070 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f688006be60 0x7f688006e320 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f68a0154e80 tx=0x7f6894009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:04.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.315+0000 7f688effd640 1 -- 172.21.15.77:0/985276070 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f68a0156e30 con 0x7f68a00bef50 2024-04-25T01:40:04.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.494+0000 7f68a4aa5640 1 -- 172.21.15.77:0/985276070 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7f68a004f500 con 0x7f68a00bef50 2024-04-25T01:40:04.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.494+0000 7f688effd640 1 -- 172.21.15.77:0/985276070 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v24) ==== 95+0+11 (secure 0 0 0) 0x7f689007ae20 con 0x7f68a00bef50 2024-04-25T01:40:04.478 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-25T01:40:04.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.496+0000 7f68a4aa5640 1 -- 172.21.15.77:0/985276070 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f688006be60 msgr2=0x7f688006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:04.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.496+0000 7f68a4aa5640 1 --2- 172.21.15.77:0/985276070 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f688006be60 0x7f688006e320 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f68a0154e80 tx=0x7f6894009040 comp rx=0 tx=0).stop 2024-04-25T01:40:04.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.496+0000 7f68a4aa5640 1 -- 172.21.15.77:0/985276070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68a00bef50 msgr2=0x7f68a014aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:04.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.496+0000 7f68a4aa5640 1 --2- 172.21.15.77:0/985276070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68a00bef50 0x7f68a014aa30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6890009eb0 tx=0x7f6890004a40 comp rx=0 tx=0).stop 2024-04-25T01:40:04.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.496+0000 7f68a4aa5640 1 -- 172.21.15.77:0/985276070 shutdown_connections 2024-04-25T01:40:04.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.496+0000 7f68a4aa5640 1 --2- 172.21.15.77:0/985276070 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f688006be60 0x7f688006e320 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:04.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.496+0000 7f68a4aa5640 1 --2- 172.21.15.77:0/985276070 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f68a0153530 0x7f68a00c0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:04.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.496+0000 7f68a4aa5640 1 --2- 172.21.15.77:0/985276070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68a00c97c0 0x7f68a014af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:04.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.496+0000 7f68a4aa5640 1 --2- 172.21.15.77:0/985276070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68a00bef50 0x7f68a014aa30 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:04.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.496+0000 7f68a4aa5640 1 -- 172.21.15.77:0/985276070 >> 172.21.15.77:0/985276070 conn(0x7f68a00672c0 msgr2=0x7f68a0155f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:04.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.496+0000 7f68a4aa5640 1 -- 172.21.15.77:0/985276070 shutdown_connections 2024-04-25T01:40:04.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.496+0000 7f68a4aa5640 1 -- 172.21.15.77:0/985276070 wait complete. 2024-04-25T01:40:04.491 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-25T01:40:04.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.612+0000 7f5d417d5640 1 Processor -- start 2024-04-25T01:40:04.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.612+0000 7f5d417d5640 1 -- start start 2024-04-25T01:40:04.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.612+0000 7f5d417d5640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5d3c06b380 0x7f5d3c06e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:04.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.612+0000 7f5d417d5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5d3c06bd50 0x7f5d3c0c2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:04.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.612+0000 7f5d417d5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5d3c155fc0 0x7f5d3c06f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:04.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.612+0000 7f5d417d5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f5d3c156ef0 con 0x7f5d3c155fc0 2024-04-25T01:40:04.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.612+0000 7f5d417d5640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f5d3c06ed30 con 0x7f5d3c06b380 2024-04-25T01:40:04.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.612+0000 7f5d417d5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f5d3c156930 con 0x7f5d3c06bd50 2024-04-25T01:40:04.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.613+0000 7f5d3b7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5d3c155fc0 0x7f5d3c06f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:04.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.613+0000 7f5d3b7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5d3c155fc0 0x7f5d3c06f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39130/0 (socket says 172.21.15.77:39130) 2024-04-25T01:40:04.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.613+0000 7f5d3b7fe640 1 -- 172.21.15.77:0/610525105 learned_addr learned my addr 172.21.15.77:0/610525105 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:04.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.613+0000 7f5d33fff640 1 --2- 172.21.15.77:0/610525105 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5d3c06bd50 0x7f5d3c0c2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:04.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.613+0000 7f5d3affd640 1 --2- 172.21.15.77:0/610525105 >> v2:172.21.15.121:3300/0 conn(0x7f5d3c06b380 0x7f5d3c06e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:04.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.613+0000 7f5d3b7fe640 1 -- 172.21.15.77:0/610525105 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5d3c06bd50 msgr2=0x7f5d3c0c2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:04.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.613+0000 7f5d3b7fe640 1 --2- 172.21.15.77:0/610525105 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5d3c06bd50 0x7f5d3c0c2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:04.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.613+0000 7f5d3b7fe640 1 -- 172.21.15.77:0/610525105 >> v2:172.21.15.121:3300/0 conn(0x7f5d3c06b380 msgr2=0x7f5d3c06e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:04.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.613+0000 7f5d3b7fe640 1 --2- 172.21.15.77:0/610525105 >> v2:172.21.15.121:3300/0 conn(0x7f5d3c06b380 0x7f5d3c06e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:04.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.613+0000 7f5d3b7fe640 1 -- 172.21.15.77:0/610525105 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3c156c10 con 0x7f5d3c155fc0 2024-04-25T01:40:04.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.614+0000 7f5d3b7fe640 1 --2- 172.21.15.77:0/610525105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d3c155fc0 0x7f5d3c06f2c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c06d210 tx=0x7f5d3402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1586f8364a07fafd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:04.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.614+0000 7f5d3a7fc640 1 -- 172.21.15.77:0/610525105 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d34036070 con 0x7f5d3c155fc0 2024-04-25T01:40:04.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.614+0000 7f5d3a7fc640 1 -- 172.21.15.77:0/610525105 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d34031600 con 0x7f5d3c155fc0 2024-04-25T01:40:04.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.614+0000 7f5d3a7fc640 1 -- 172.21.15.77:0/610525105 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d340319d0 con 0x7f5d3c155fc0 2024-04-25T01:40:04.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.614+0000 7f5d417d5640 1 -- 172.21.15.77:0/610525105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d3c155fc0 msgr2=0x7f5d3c06f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:04.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.614+0000 7f5d417d5640 1 --2- 172.21.15.77:0/610525105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d3c155fc0 0x7f5d3c06f2c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c06d210 tx=0x7f5d3402a610 comp rx=0 tx=0).stop 2024-04-25T01:40:04.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.614+0000 7f5d417d5640 1 -- 172.21.15.77:0/610525105 shutdown_connections 2024-04-25T01:40:04.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.614+0000 7f5d417d5640 1 --2- 172.21.15.77:0/610525105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d3c155fc0 0x7f5d3c06f2c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:04.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.614+0000 7f5d417d5640 1 --2- 172.21.15.77:0/610525105 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5d3c06bd50 0x7f5d3c0c2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:04.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.614+0000 7f5d417d5640 1 --2- 172.21.15.77:0/610525105 >> v2:172.21.15.121:3300/0 conn(0x7f5d3c06b380 0x7f5d3c06e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:04.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.614+0000 7f5d417d5640 1 -- 172.21.15.77:0/610525105 >> 172.21.15.77:0/610525105 conn(0x7f5d3c0c8630 msgr2=0x7f5d3c0c8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:04.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.614+0000 7f5d417d5640 1 -- 172.21.15.77:0/610525105 shutdown_connections 2024-04-25T01:40:04.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.614+0000 7f5d417d5640 1 -- 172.21.15.77:0/610525105 wait complete. 2024-04-25T01:40:04.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.615+0000 7f5d417d5640 1 Processor -- start 2024-04-25T01:40:04.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.615+0000 7f5d417d5640 1 -- start start 2024-04-25T01:40:04.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.616+0000 7f5d417d5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d3c06b380 0x7f5d3c1e1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:04.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.616+0000 7f5d417d5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d3c06bd50 0x7f5d3c154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:04.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.616+0000 7f5d417d5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5d3c155fc0 0x7f5d3c1597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:04.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.616+0000 7f5d417d5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c0c28d0 con 0x7f5d3c06b380 2024-04-25T01:40:04.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.616+0000 7f5d417d5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c0c1e70 con 0x7f5d3c06bd50 2024-04-25T01:40:04.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.616+0000 7f5d417d5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f5d3c06b760 con 0x7f5d3c155fc0 2024-04-25T01:40:04.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.616+0000 7f5d3affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d3c06b380 0x7f5d3c1e1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:04.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.616+0000 7f5d3affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d3c06b380 0x7f5d3c1e1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39132/0 (socket says 172.21.15.77:39132) 2024-04-25T01:40:04.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.616+0000 7f5d3affd640 1 -- 172.21.15.77:0/248309828 learned_addr learned my addr 172.21.15.77:0/248309828 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:04.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.616+0000 7f5d3b7fe640 1 --2- 172.21.15.77:0/248309828 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5d3c155fc0 0x7f5d3c1597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:04.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.616+0000 7f5d33fff640 1 --2- 172.21.15.77:0/248309828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d3c06bd50 0x7f5d3c154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:04.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.616+0000 7f5d3affd640 1 -- 172.21.15.77:0/248309828 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5d3c155fc0 msgr2=0x7f5d3c1597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:04.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.616+0000 7f5d3affd640 1 --2- 172.21.15.77:0/248309828 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5d3c155fc0 0x7f5d3c1597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:04.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.616+0000 7f5d3affd640 1 -- 172.21.15.77:0/248309828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d3c06bd50 msgr2=0x7f5d3c154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:04.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.616+0000 7f5d3affd640 1 --2- 172.21.15.77:0/248309828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d3c06bd50 0x7f5d3c154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:04.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.616+0000 7f5d3affd640 1 -- 172.21.15.77:0/248309828 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3c1e0940 con 0x7f5d3c06b380 2024-04-25T01:40:04.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.616+0000 7f5d3b7fe640 1 --2- 172.21.15.77:0/248309828 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5d3c155fc0 0x7f5d3c1597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:40:04.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.616+0000 7f5d33fff640 1 --2- 172.21.15.77:0/248309828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d3c06bd50 0x7f5d3c154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:40:04.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.617+0000 7f5d3affd640 1 --2- 172.21.15.77:0/248309828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d3c06b380 0x7f5d3c1e1b80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c00d800 tx=0x7f5d2c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:04.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.617+0000 7f5d337fe640 1 -- 172.21.15.77:0/248309828 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c018020 con 0x7f5d3c06b380 2024-04-25T01:40:04.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.617+0000 7f5d337fe640 1 -- 172.21.15.77:0/248309828 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d2c0096a0 con 0x7f5d3c06b380 2024-04-25T01:40:04.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.617+0000 7f5d337fe640 1 -- 172.21.15.77:0/248309828 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c009a70 con 0x7f5d3c06b380 2024-04-25T01:40:04.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.617+0000 7f5d417d5640 1 -- 172.21.15.77:0/248309828 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d3c1e0c20 con 0x7f5d3c06b380 2024-04-25T01:40:04.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.617+0000 7f5d417d5640 1 -- 172.21.15.77:0/248309828 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d3c0ae4b0 con 0x7f5d3c06b380 2024-04-25T01:40:04.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.618+0000 7f5d417d5640 1 -- 172.21.15.77:0/248309828 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d3c04f500 con 0x7f5d3c06b380 2024-04-25T01:40:04.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.618+0000 7f5d337fe640 1 -- 172.21.15.77:0/248309828 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d2c01b020 con 0x7f5d3c06b380 2024-04-25T01:40:04.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.619+0000 7f5d337fe640 1 --2- 172.21.15.77:0/248309828 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5d1c06be60 0x7f5d1c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:04.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.619+0000 7f5d337fe640 1 -- 172.21.15.77:0/248309828 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6637+0+0 (secure 0 0 0) 0x7f5d2c08b350 con 0x7f5d3c06b380 2024-04-25T01:40:04.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.619+0000 7f5d33fff640 1 --2- 172.21.15.77:0/248309828 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5d1c06be60 0x7f5d1c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:04.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.619+0000 7f5d33fff640 1 --2- 172.21.15.77:0/248309828 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5d1c06be60 0x7f5d1c06e320 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0ade20 tx=0x7f5d24008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:04.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.623+0000 7f5d337fe640 1 -- 172.21.15.77:0/248309828 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5d2c022030 con 0x7f5d3c06b380 2024-04-25T01:40:04.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.795+0000 7f5d417d5640 1 -- 172.21.15.77:0/248309828 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7f5d3c0c3080 con 0x7f5d3c06b380 2024-04-25T01:40:04.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.795+0000 7f5d337fe640 1 -- 172.21.15.77:0/248309828 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v25) ==== 99+0+11 (secure 0 0 0) 0x7f5d2c0599f0 con 0x7f5d3c06b380 2024-04-25T01:40:04.779 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T01:40:04.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.797+0000 7f5d417d5640 1 -- 172.21.15.77:0/248309828 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5d1c06be60 msgr2=0x7f5d1c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:04.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.797+0000 7f5d417d5640 1 --2- 172.21.15.77:0/248309828 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5d1c06be60 0x7f5d1c06e320 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0ade20 tx=0x7f5d24008040 comp rx=0 tx=0).stop 2024-04-25T01:40:04.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.797+0000 7f5d417d5640 1 -- 172.21.15.77:0/248309828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d3c06b380 msgr2=0x7f5d3c1e1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:04.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.797+0000 7f5d417d5640 1 --2- 172.21.15.77:0/248309828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d3c06b380 0x7f5d3c1e1b80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c00d800 tx=0x7f5d2c00dcc0 comp rx=0 tx=0).stop 2024-04-25T01:40:04.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.797+0000 7f5d417d5640 1 -- 172.21.15.77:0/248309828 shutdown_connections 2024-04-25T01:40:04.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.797+0000 7f5d417d5640 1 --2- 172.21.15.77:0/248309828 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5d1c06be60 0x7f5d1c06e320 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:04.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.797+0000 7f5d417d5640 1 --2- 172.21.15.77:0/248309828 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5d3c155fc0 0x7f5d3c1597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:04.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.797+0000 7f5d417d5640 1 --2- 172.21.15.77:0/248309828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d3c06bd50 0x7f5d3c154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:04.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.797+0000 7f5d417d5640 1 --2- 172.21.15.77:0/248309828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d3c06b380 0x7f5d3c1e1b80 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:04.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.797+0000 7f5d417d5640 1 -- 172.21.15.77:0/248309828 >> 172.21.15.77:0/248309828 conn(0x7f5d3c0c8630 msgr2=0x7f5d3c0c7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:04.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.797+0000 7f5d417d5640 1 -- 172.21.15.77:0/248309828 shutdown_connections 2024-04-25T01:40:04.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.797+0000 7f5d417d5640 1 -- 172.21.15.77:0/248309828 wait complete. 2024-04-25T01:40:04.792 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-25T01:40:04.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.908+0000 7f11eec2c640 1 Processor -- start 2024-04-25T01:40:04.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.908+0000 7f11eec2c640 1 -- start start 2024-04-25T01:40:04.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.909+0000 7f11eec2c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f11e80c1990 0x7f11e8157d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:04.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.909+0000 7f11eec2c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f11e80c1f80 0x7f11e80c6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:04.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.909+0000 7f11eec2c640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11e815a5f0 con 0x7f11e80c56f0 2024-04-25T01:40:04.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.909+0000 7f11eec2c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f11e815a8d0 con 0x7f11e80c1f80 2024-04-25T01:40:04.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.909+0000 7f11eec2c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f11e815abb0 con 0x7f11e80c1990 2024-04-25T01:40:04.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.909+0000 7f11ed1c9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f11e80c1f80 0x7f11e80c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:04.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.909+0000 7f11ed1c9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f11e80c1f80 0x7f11e80c6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39142/0 (socket says 172.21.15.77:39142) 2024-04-25T01:40:04.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.909+0000 7f11ed1c9640 1 -- 172.21.15.77:0/3903723855 learned_addr learned my addr 172.21.15.77:0/3903723855 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:04.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.909+0000 7f11ed1c9640 1 -- 172.21.15.77:0/3903723855 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f11e80c1990 msgr2=0x7f11e8157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:04.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.909+0000 7f11e7fff640 1 --2- 172.21.15.77:0/3903723855 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f11e80c1990 0x7f11e8157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:04.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.909+0000 7f11ed1c9640 1 --2- 172.21.15.77:0/3903723855 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f11e80c1990 0x7f11e8157d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:04.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.909+0000 7f11ed1c9640 1 -- 172.21.15.77:0/3903723855 >> v1:172.21.15.121:6789/0 conn(0x7f11e80c56f0 legacy=0x7f11e8157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:04.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.909+0000 7f11ed1c9640 1 -- 172.21.15.77:0/3903723855 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e815ae90 con 0x7f11e80c1f80 2024-04-25T01:40:04.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.909+0000 7f11e7fff640 1 --2- 172.21.15.77:0/3903723855 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f11e80c1990 0x7f11e8157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:40:04.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.910+0000 7f11ed1c9640 1 --2- 172.21.15.77:0/3903723855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11e80c1f80 0x7f11e80c6030 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f11e0009e50 tx=0x7f11e002a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b148e5698c970a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:04.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.910+0000 7f11e77fe640 1 -- 172.21.15.77:0/3903723855 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e0036070 con 0x7f11e80c1f80 2024-04-25T01:40:04.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.910+0000 7f11e77fe640 1 -- 172.21.15.77:0/3903723855 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11e0031600 con 0x7f11e80c1f80 2024-04-25T01:40:04.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.910+0000 7f11e77fe640 1 -- 172.21.15.77:0/3903723855 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e00319d0 con 0x7f11e80c1f80 2024-04-25T01:40:04.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.910+0000 7f11eec2c640 1 -- 172.21.15.77:0/3903723855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11e80c1f80 msgr2=0x7f11e80c6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:04.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.910+0000 7f11eec2c640 1 --2- 172.21.15.77:0/3903723855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11e80c1f80 0x7f11e80c6030 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f11e0009e50 tx=0x7f11e002a630 comp rx=0 tx=0).stop 2024-04-25T01:40:04.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.910+0000 7f11eec2c640 1 -- 172.21.15.77:0/3903723855 shutdown_connections 2024-04-25T01:40:04.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.910+0000 7f11eec2c640 1 --2- 172.21.15.77:0/3903723855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11e80c1f80 0x7f11e80c6030 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:04.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.910+0000 7f11eec2c640 1 --2- 172.21.15.77:0/3903723855 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f11e80c1990 0x7f11e8157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:04.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.910+0000 7f11eec2c640 1 -- 172.21.15.77:0/3903723855 >> 172.21.15.77:0/3903723855 conn(0x7f11e80c7580 msgr2=0x7f11e80c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:04.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.910+0000 7f11eec2c640 1 -- 172.21.15.77:0/3903723855 shutdown_connections 2024-04-25T01:40:04.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.910+0000 7f11eec2c640 1 -- 172.21.15.77:0/3903723855 wait complete. 2024-04-25T01:40:04.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.911+0000 7f11eec2c640 1 Processor -- start 2024-04-25T01:40:04.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.911+0000 7f11eec2c640 1 -- start start 2024-04-25T01:40:04.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.912+0000 7f11eec2c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11e80c1990 0x7f11e815d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:04.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.912+0000 7f11eec2c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11e80c1f80 0x7f11e814ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:04.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.912+0000 7f11eec2c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f11e80c56f0 0x7f11e815ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:04.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.912+0000 7f11eec2c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f11e80c5ad0 con 0x7f11e80c1990 2024-04-25T01:40:04.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.912+0000 7f11eec2c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f11e80c47e0 con 0x7f11e80c1f80 2024-04-25T01:40:04.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.912+0000 7f11eec2c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f11e80c5c50 con 0x7f11e80c56f0 2024-04-25T01:40:04.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.912+0000 7f11ec9c8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11e80c1990 0x7f11e815d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:04.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.912+0000 7f11ec9c8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11e80c1990 0x7f11e815d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39156/0 (socket says 172.21.15.77:39156) 2024-04-25T01:40:04.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.912+0000 7f11ec9c8640 1 -- 172.21.15.77:0/274935933 learned_addr learned my addr 172.21.15.77:0/274935933 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:04.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.913+0000 7f11ec9c8640 1 -- 172.21.15.77:0/274935933 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f11e80c56f0 msgr2=0x7f11e815ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:04.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.913+0000 7f11ec9c8640 1 --2- 172.21.15.77:0/274935933 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f11e80c56f0 0x7f11e815ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:04.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.913+0000 7f11ec9c8640 1 -- 172.21.15.77:0/274935933 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11e80c1f80 msgr2=0x7f11e814ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:04.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.913+0000 7f11ec9c8640 1 --2- 172.21.15.77:0/274935933 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11e80c1f80 0x7f11e814ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:04.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.913+0000 7f11ec9c8640 1 -- 172.21.15.77:0/274935933 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e81f0190 con 0x7f11e80c1990 2024-04-25T01:40:04.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.913+0000 7f11ec9c8640 1 --2- 172.21.15.77:0/274935933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11e80c1990 0x7f11e815d850 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f11dc00c430 tx=0x7f11dc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:04.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.913+0000 7f11e57fa640 1 -- 172.21.15.77:0/274935933 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11dc011790 con 0x7f11e80c1990 2024-04-25T01:40:04.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.913+0000 7f11e57fa640 1 -- 172.21.15.77:0/274935933 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11dc017070 con 0x7f11e80c1990 2024-04-25T01:40:04.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.913+0000 7f11eec2c640 1 -- 172.21.15.77:0/274935933 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11e81f0450 con 0x7f11e80c1990 2024-04-25T01:40:04.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.913+0000 7f11e57fa640 1 -- 172.21.15.77:0/274935933 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11dc011b70 con 0x7f11e80c1990 2024-04-25T01:40:04.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.913+0000 7f11eec2c640 1 -- 172.21.15.77:0/274935933 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11e81f0a10 con 0x7f11e80c1990 2024-04-25T01:40:04.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.914+0000 7f11eec2c640 1 -- 172.21.15.77:0/274935933 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11e804f500 con 0x7f11e80c1990 2024-04-25T01:40:04.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.914+0000 7f11e57fa640 1 -- 172.21.15.77:0/274935933 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f11dc011d10 con 0x7f11e80c1990 2024-04-25T01:40:04.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.915+0000 7f11e57fa640 1 --2- 172.21.15.77:0/274935933 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f11cc06be30 0x7f11cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:04.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.915+0000 7f11e57fa640 1 -- 172.21.15.77:0/274935933 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6637+0+0 (secure 0 0 0) 0x7f11dc08afe0 con 0x7f11e80c1990 2024-04-25T01:40:04.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.915+0000 7f11e7fff640 1 --2- 172.21.15.77:0/274935933 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f11cc06be30 0x7f11cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:04.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.915+0000 7f11e7fff640 1 --2- 172.21.15.77:0/274935933 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f11cc06be30 0x7f11cc06e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f11d4006fd0 tx=0x7f11d4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:04.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:04.919+0000 7f11e57fa640 1 -- 172.21.15.77:0/274935933 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f11dc059680 con 0x7f11e80c1990 2024-04-25T01:40:05.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.090+0000 7f11eec2c640 1 -- 172.21.15.77:0/274935933 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7f11e80735e0 con 0x7f11e80c1990 2024-04-25T01:40:05.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.091+0000 7f11e57fa640 1 -- 172.21.15.77:0/274935933 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v25) ==== 95+0+11 (secure 0 0 0) 0x7f11dc058f80 con 0x7f11e80c1990 2024-04-25T01:40:05.075 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-25T01:40:05.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.093+0000 7f11eec2c640 1 -- 172.21.15.77:0/274935933 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f11cc06be30 msgr2=0x7f11cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:05.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.093+0000 7f11eec2c640 1 --2- 172.21.15.77:0/274935933 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f11cc06be30 0x7f11cc06e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f11d4006fd0 tx=0x7f11d4008040 comp rx=0 tx=0).stop 2024-04-25T01:40:05.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.093+0000 7f11eec2c640 1 -- 172.21.15.77:0/274935933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11e80c1990 msgr2=0x7f11e815d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:05.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.093+0000 7f11eec2c640 1 --2- 172.21.15.77:0/274935933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11e80c1990 0x7f11e815d850 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f11dc00c430 tx=0x7f11dc00c8f0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.093+0000 7f11eec2c640 1 -- 172.21.15.77:0/274935933 shutdown_connections 2024-04-25T01:40:05.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.093+0000 7f11eec2c640 1 --2- 172.21.15.77:0/274935933 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f11cc06be30 0x7f11cc06e2f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.093+0000 7f11eec2c640 1 --2- 172.21.15.77:0/274935933 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f11e80c56f0 0x7f11e815ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.093+0000 7f11eec2c640 1 --2- 172.21.15.77:0/274935933 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11e80c1f80 0x7f11e814ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.093+0000 7f11eec2c640 1 --2- 172.21.15.77:0/274935933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11e80c1990 0x7f11e815d850 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.093+0000 7f11eec2c640 1 -- 172.21.15.77:0/274935933 >> 172.21.15.77:0/274935933 conn(0x7f11e80c7580 msgr2=0x7f11e80c7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:05.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.093+0000 7f11eec2c640 1 -- 172.21.15.77:0/274935933 shutdown_connections 2024-04-25T01:40:05.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.093+0000 7f11eec2c640 1 -- 172.21.15.77:0/274935933 wait complete. 2024-04-25T01:40:05.088 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:40:05.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.199+0000 7f5fee170640 1 Processor -- start 2024-04-25T01:40:05.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.199+0000 7f5fee170640 1 -- start start 2024-04-25T01:40:05.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.200+0000 7f5fee170640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5fe814fa00 0x7f5fe806ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:05.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.200+0000 7f5fee170640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5fe806c870 0x7f5fe8152e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:05.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.200+0000 7f5fee170640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5fe81562f0 0x7f5fe80c3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:05.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.200+0000 7f5fee170640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f5fe8072570 con 0x7f5fe814fa00 2024-04-25T01:40:05.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.200+0000 7f5fee170640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f5fe8072b10 con 0x7f5fe806c870 2024-04-25T01:40:05.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.200+0000 7f5fee170640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f5fe8072830 con 0x7f5fe81562f0 2024-04-25T01:40:05.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.200+0000 7f5fe77fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5fe814fa00 0x7f5fe806ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:05.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.200+0000 7f5fe77fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5fe814fa00 0x7f5fe806ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39158/0 (socket says 172.21.15.77:39158) 2024-04-25T01:40:05.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.200+0000 7f5fe77fe640 1 -- 172.21.15.77:0/4078739446 learned_addr learned my addr 172.21.15.77:0/4078739446 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:05.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.200+0000 7f5fe7fff640 1 --2- 172.21.15.77:0/4078739446 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5fe81562f0 0x7f5fe80c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:05.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.200+0000 7f5fe6ffd640 1 --2- 172.21.15.77:0/4078739446 >> v2:172.21.15.121:3300/0 conn(0x7f5fe806c870 0x7f5fe8152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:05.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.201+0000 7f5fe77fe640 1 -- 172.21.15.77:0/4078739446 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5fe81562f0 msgr2=0x7f5fe80c3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:05.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.201+0000 7f5fe77fe640 1 --2- 172.21.15.77:0/4078739446 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5fe81562f0 0x7f5fe80c3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.201+0000 7f5fe77fe640 1 -- 172.21.15.77:0/4078739446 >> v2:172.21.15.121:3300/0 conn(0x7f5fe806c870 msgr2=0x7f5fe8152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:05.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.201+0000 7f5fe77fe640 1 --2- 172.21.15.77:0/4078739446 >> v2:172.21.15.121:3300/0 conn(0x7f5fe806c870 0x7f5fe8152e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.201+0000 7f5fe77fe640 1 -- 172.21.15.77:0/4078739446 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe8155af0 con 0x7f5fe814fa00 2024-04-25T01:40:05.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.201+0000 7f5fe6ffd640 1 --2- 172.21.15.77:0/4078739446 >> v2:172.21.15.121:3300/0 conn(0x7f5fe806c870 0x7f5fe8152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:40:05.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.201+0000 7f5fe77fe640 1 --2- 172.21.15.77:0/4078739446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fe814fa00 0x7f5fe806ceb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80c8f30 tx=0x7f5fdc02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb3b1861fca3802 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:05.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.201+0000 7f5fe67fc640 1 -- 172.21.15.77:0/4078739446 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc037070 con 0x7f5fe814fa00 2024-04-25T01:40:05.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.201+0000 7f5fe67fc640 1 -- 172.21.15.77:0/4078739446 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fdc02ae00 con 0x7f5fe814fa00 2024-04-25T01:40:05.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.201+0000 7f5fe67fc640 1 -- 172.21.15.77:0/4078739446 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc032660 con 0x7f5fe814fa00 2024-04-25T01:40:05.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.202+0000 7f5fee170640 1 -- 172.21.15.77:0/4078739446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fe814fa00 msgr2=0x7f5fe806ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:05.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.202+0000 7f5fee170640 1 --2- 172.21.15.77:0/4078739446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fe814fa00 0x7f5fe806ceb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80c8f30 tx=0x7f5fdc02a0b0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.202+0000 7f5fee170640 1 -- 172.21.15.77:0/4078739446 shutdown_connections 2024-04-25T01:40:05.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.202+0000 7f5fee170640 1 --2- 172.21.15.77:0/4078739446 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5fe81562f0 0x7f5fe80c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.202+0000 7f5fee170640 1 --2- 172.21.15.77:0/4078739446 >> v2:172.21.15.121:3300/0 conn(0x7f5fe806c870 0x7f5fe8152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.202+0000 7f5fee170640 1 --2- 172.21.15.77:0/4078739446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fe814fa00 0x7f5fe806ceb0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.202+0000 7f5fee170640 1 -- 172.21.15.77:0/4078739446 >> 172.21.15.77:0/4078739446 conn(0x7f5fe80c4970 msgr2=0x7f5fe80c4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:05.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.202+0000 7f5fee170640 1 -- 172.21.15.77:0/4078739446 shutdown_connections 2024-04-25T01:40:05.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.202+0000 7f5fee170640 1 -- 172.21.15.77:0/4078739446 wait complete. 2024-04-25T01:40:05.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.203+0000 7f5fee170640 1 Processor -- start 2024-04-25T01:40:05.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.203+0000 7f5fee170640 1 -- start start 2024-04-25T01:40:05.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.204+0000 7f5fee170640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5fe806c870 0x7f5fe81eb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:05.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.204+0000 7f5fee170640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fe814fa00 0x7f5fe8144aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:05.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.204+0000 7f5fee170640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5fe81562f0 0x7f5fe81e73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:05.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.204+0000 7f5fee170640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe8156760 con 0x7f5fe814fa00 2024-04-25T01:40:05.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.204+0000 7f5fee170640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe814fde0 con 0x7f5fe806c870 2024-04-25T01:40:05.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.204+0000 7f5fee170640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f5fe81568e0 con 0x7f5fe81562f0 2024-04-25T01:40:05.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.204+0000 7f5fe6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fe814fa00 0x7f5fe8144aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:05.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.204+0000 7f5fe6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fe814fa00 0x7f5fe8144aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39170/0 (socket says 172.21.15.77:39170) 2024-04-25T01:40:05.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.204+0000 7f5fe6ffd640 1 -- 172.21.15.77:0/2479777060 learned_addr learned my addr 172.21.15.77:0/2479777060 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:05.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.204+0000 7f5fe7fff640 1 --2- 172.21.15.77:0/2479777060 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5fe81562f0 0x7f5fe81e73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:05.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.204+0000 7f5fe77fe640 1 --2- 172.21.15.77:0/2479777060 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5fe806c870 0x7f5fe81eb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:05.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.204+0000 7f5fe6ffd640 1 -- 172.21.15.77:0/2479777060 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5fe81562f0 msgr2=0x7f5fe81e73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:05.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.204+0000 7f5fe6ffd640 1 --2- 172.21.15.77:0/2479777060 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5fe81562f0 0x7f5fe81e73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.204+0000 7f5fe6ffd640 1 -- 172.21.15.77:0/2479777060 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5fe806c870 msgr2=0x7f5fe81eb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:05.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.204+0000 7f5fe6ffd640 1 --2- 172.21.15.77:0/2479777060 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5fe806c870 0x7f5fe81eb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.204+0000 7f5fe6ffd640 1 -- 172.21.15.77:0/2479777060 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe80c6a70 con 0x7f5fe814fa00 2024-04-25T01:40:05.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.204+0000 7f5fe6ffd640 1 --2- 172.21.15.77:0/2479777060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fe814fa00 0x7f5fe8144aa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800c820 tx=0x7f5fd800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:05.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.205+0000 7f5fcffff640 1 -- 172.21.15.77:0/2479777060 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8015070 con 0x7f5fe814fa00 2024-04-25T01:40:05.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.205+0000 7f5fcffff640 1 -- 172.21.15.77:0/2479777060 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fd8007a30 con 0x7f5fe814fa00 2024-04-25T01:40:05.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.205+0000 7f5fee170640 1 -- 172.21.15.77:0/2479777060 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fe80c6d50 con 0x7f5fe814fa00 2024-04-25T01:40:05.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.205+0000 7f5fcffff640 1 -- 172.21.15.77:0/2479777060 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8007de0 con 0x7f5fe814fa00 2024-04-25T01:40:05.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.205+0000 7f5fee170640 1 -- 172.21.15.77:0/2479777060 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fe81eae60 con 0x7f5fe814fa00 2024-04-25T01:40:05.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.205+0000 7f5fee170640 1 -- 172.21.15.77:0/2479777060 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fe8075330 con 0x7f5fe814fa00 2024-04-25T01:40:05.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.206+0000 7f5fcffff640 1 -- 172.21.15.77:0/2479777060 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5fd8018070 con 0x7f5fe814fa00 2024-04-25T01:40:05.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.206+0000 7f5fcffff640 1 --2- 172.21.15.77:0/2479777060 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5fd406be30 0x7f5fd406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:05.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.206+0000 7f5fcffff640 1 -- 172.21.15.77:0/2479777060 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6637+0+0 (secure 0 0 0) 0x7f5fd808afe0 con 0x7f5fe814fa00 2024-04-25T01:40:05.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.206+0000 7f5fe77fe640 1 --2- 172.21.15.77:0/2479777060 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5fd406be30 0x7f5fd406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:05.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.207+0000 7f5fe77fe640 1 --2- 172.21.15.77:0/2479777060 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5fd406be30 0x7f5fd406e2f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc034000 tx=0x7f5fdc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:05.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.211+0000 7f5fcffff640 1 -- 172.21.15.77:0/2479777060 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5fe8075330 con 0x7f5fe814fa00 2024-04-25T01:40:05.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.417+0000 7f5fee170640 1 -- 172.21.15.77:0/2479777060 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5fe804f500 con 0x7f5fe814fa00 2024-04-25T01:40:05.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.418+0000 7f5fcffff640 1 -- 172.21.15.77:0/2479777060 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6488 (secure 0 0 0) 0x7f5fd8059030 con 0x7f5fe814fa00 2024-04-25T01:40:05.402 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:40:05.402 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:39:36.787357+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6837/3454203695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3454203695},{"type":"v1","addr":"172.21.15.77:6837","nonce":3454203695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-04-25T01:40:05.402 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 12 2024-04-25T01:40:05.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.420+0000 7f5fee170640 1 -- 172.21.15.77:0/2479777060 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5fd406be30 msgr2=0x7f5fd406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:05.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.420+0000 7f5fee170640 1 --2- 172.21.15.77:0/2479777060 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5fd406be30 0x7f5fd406e2f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc034000 tx=0x7f5fdc02e000 comp rx=0 tx=0).stop 2024-04-25T01:40:05.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.420+0000 7f5fee170640 1 -- 172.21.15.77:0/2479777060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fe814fa00 msgr2=0x7f5fe8144aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:05.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.420+0000 7f5fee170640 1 --2- 172.21.15.77:0/2479777060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fe814fa00 0x7f5fe8144aa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800c820 tx=0x7f5fd800cce0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.420+0000 7f5fee170640 1 -- 172.21.15.77:0/2479777060 shutdown_connections 2024-04-25T01:40:05.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.420+0000 7f5fee170640 1 --2- 172.21.15.77:0/2479777060 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5fd406be30 0x7f5fd406e2f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.420+0000 7f5fee170640 1 --2- 172.21.15.77:0/2479777060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fe814fa00 0x7f5fe8144aa0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.420+0000 7f5fee170640 1 --2- 172.21.15.77:0/2479777060 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5fe81562f0 0x7f5fe81e73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.420+0000 7f5fee170640 1 --2- 172.21.15.77:0/2479777060 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5fe806c870 0x7f5fe81eb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.420+0000 7f5fee170640 1 -- 172.21.15.77:0/2479777060 >> 172.21.15.77:0/2479777060 conn(0x7f5fe80c4970 msgr2=0x7f5fe80c2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:05.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.420+0000 7f5fee170640 1 -- 172.21.15.77:0/2479777060 shutdown_connections 2024-04-25T01:40:05.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.420+0000 7f5fee170640 1 -- 172.21.15.77:0/2479777060 wait complete. 2024-04-25T01:40:05.415 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T01:40:05.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.529+0000 7f1fa1495640 1 Processor -- start 2024-04-25T01:40:05.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.529+0000 7f1fa1495640 1 -- start start 2024-04-25T01:40:05.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.529+0000 7f1fa1495640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1f9c150090 0x7f1f9c156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:05.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.529+0000 7f1fa1495640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1f9c06c280 0x7f1f9c0c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:05.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.529+0000 7f1fa1495640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f9c0c89c0 con 0x7f1f9c0c8200 2024-04-25T01:40:05.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.529+0000 7f1fa1495640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f1f9c06b830 con 0x7f1f9c150090 2024-04-25T01:40:05.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.529+0000 7f1fa1495640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f1f9c0c8ca0 con 0x7f1f9c06c280 2024-04-25T01:40:05.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.530+0000 7f1f9affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1f9c150090 0x7f1f9c156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:05.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.530+0000 7f1f9affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1f9c150090 0x7f1f9c156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39178/0 (socket says 172.21.15.77:39178) 2024-04-25T01:40:05.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.530+0000 7f1f9affd640 1 -- 172.21.15.77:0/1116334444 learned_addr learned my addr 172.21.15.77:0/1116334444 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:05.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.530+0000 7f1f9b7fe640 1 --2- 172.21.15.77:0/1116334444 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1f9c06c280 0x7f1f9c0c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:05.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.530+0000 7f1f9affd640 1 -- 172.21.15.77:0/1116334444 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1f9c06c280 msgr2=0x7f1f9c0c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:05.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.530+0000 7f1f9affd640 1 --2- 172.21.15.77:0/1116334444 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1f9c06c280 0x7f1f9c0c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.530+0000 7f1f9affd640 1 -- 172.21.15.77:0/1116334444 >> v1:172.21.15.121:6789/0 conn(0x7f1f9c0c8200 legacy=0x7f1f9c0c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:05.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.530+0000 7f1f9affd640 1 -- 172.21.15.77:0/1116334444 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f9c06ba80 con 0x7f1f9c150090 2024-04-25T01:40:05.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.531+0000 7f1f9affd640 1 --2- 172.21.15.77:0/1116334444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f9c150090 0x7f1f9c156c80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c009870 tx=0x7f1f8c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c36181005f35a2e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:05.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.531+0000 7f1f9a7fc640 1 -- 172.21.15.77:0/1116334444 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c037070 con 0x7f1f9c150090 2024-04-25T01:40:05.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.531+0000 7f1f9a7fc640 1 -- 172.21.15.77:0/1116334444 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f8c032440 con 0x7f1f9c150090 2024-04-25T01:40:05.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.531+0000 7f1f9a7fc640 1 -- 172.21.15.77:0/1116334444 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c032810 con 0x7f1f9c150090 2024-04-25T01:40:05.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.531+0000 7f1fa1495640 1 -- 172.21.15.77:0/1116334444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f9c150090 msgr2=0x7f1f9c156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:05.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.531+0000 7f1fa1495640 1 --2- 172.21.15.77:0/1116334444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f9c150090 0x7f1f9c156c80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c009870 tx=0x7f1f8c02a210 comp rx=0 tx=0).stop 2024-04-25T01:40:05.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.531+0000 7f1fa1495640 1 -- 172.21.15.77:0/1116334444 shutdown_connections 2024-04-25T01:40:05.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.531+0000 7f1fa1495640 1 --2- 172.21.15.77:0/1116334444 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1f9c06c280 0x7f1f9c0c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.531+0000 7f1fa1495640 1 --2- 172.21.15.77:0/1116334444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f9c150090 0x7f1f9c156c80 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.531+0000 7f1fa1495640 1 -- 172.21.15.77:0/1116334444 >> 172.21.15.77:0/1116334444 conn(0x7f1f9c0ad4d0 msgr2=0x7f1f9c0ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:05.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.531+0000 7f1fa1495640 1 -- 172.21.15.77:0/1116334444 shutdown_connections 2024-04-25T01:40:05.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.531+0000 7f1fa1495640 1 -- 172.21.15.77:0/1116334444 wait complete. 2024-04-25T01:40:05.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.532+0000 7f1fa1495640 1 Processor -- start 2024-04-25T01:40:05.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.532+0000 7f1fa1495640 1 -- start start 2024-04-25T01:40:05.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.533+0000 7f1fa1495640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f9c06c280 0x7f1f9c0c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:05.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.533+0000 7f1fa1495640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1f9c0c8200 0x7f1f9c1efe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:05.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.533+0000 7f1fa1495640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f9c150090 0x7f1f9c1545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:05.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.533+0000 7f1fa1495640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9c06c6b0 con 0x7f1f9c150090 2024-04-25T01:40:05.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.533+0000 7f1fa1495640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9c0c86b0 con 0x7f1f9c06c280 2024-04-25T01:40:05.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.533+0000 7f1fa1495640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f1f9c06c830 con 0x7f1f9c0c8200 2024-04-25T01:40:05.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.533+0000 7f1f9b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f9c150090 0x7f1f9c1545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:05.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.533+0000 7f1f9b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f9c150090 0x7f1f9c1545a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39190/0 (socket says 172.21.15.77:39190) 2024-04-25T01:40:05.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.533+0000 7f1f9b7fe640 1 -- 172.21.15.77:0/3655879054 learned_addr learned my addr 172.21.15.77:0/3655879054 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:05.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.533+0000 7f1f9affd640 1 --2- 172.21.15.77:0/3655879054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f9c06c280 0x7f1f9c0c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:05.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.533+0000 7f1f93fff640 1 --2- 172.21.15.77:0/3655879054 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1f9c0c8200 0x7f1f9c1efe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:05.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.533+0000 7f1f9b7fe640 1 -- 172.21.15.77:0/3655879054 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1f9c0c8200 msgr2=0x7f1f9c1efe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:05.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.533+0000 7f1f9b7fe640 1 --2- 172.21.15.77:0/3655879054 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1f9c0c8200 0x7f1f9c1efe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.533+0000 7f1f9b7fe640 1 -- 172.21.15.77:0/3655879054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f9c06c280 msgr2=0x7f1f9c0c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:05.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.533+0000 7f1f9b7fe640 1 --2- 172.21.15.77:0/3655879054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f9c06c280 0x7f1f9c0c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.533+0000 7f1f9b7fe640 1 -- 172.21.15.77:0/3655879054 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f9c1ebed0 con 0x7f1f9c150090 2024-04-25T01:40:05.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.534+0000 7f1f9b7fe640 1 --2- 172.21.15.77:0/3655879054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f9c150090 0x7f1f9c1545a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1f94007e40 tx=0x7f1f9400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:05.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.534+0000 7f1f937fe640 1 -- 172.21.15.77:0/3655879054 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f94014620 con 0x7f1f9c150090 2024-04-25T01:40:05.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.534+0000 7f1f937fe640 1 -- 172.21.15.77:0/3655879054 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f94019070 con 0x7f1f9c150090 2024-04-25T01:40:05.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.534+0000 7f1fa1495640 1 -- 172.21.15.77:0/3655879054 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f9c0c5160 con 0x7f1f9c150090 2024-04-25T01:40:05.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.534+0000 7f1f937fe640 1 -- 172.21.15.77:0/3655879054 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f94014a20 con 0x7f1f9c150090 2024-04-25T01:40:05.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.534+0000 7f1fa1495640 1 -- 172.21.15.77:0/3655879054 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f9c1ec470 con 0x7f1f9c150090 2024-04-25T01:40:05.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.535+0000 7f1fa1495640 1 -- 172.21.15.77:0/3655879054 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f9c04f500 con 0x7f1f9c150090 2024-04-25T01:40:05.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.535+0000 7f1f937fe640 1 -- 172.21.15.77:0/3655879054 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1f94014bc0 con 0x7f1f9c150090 2024-04-25T01:40:05.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.536+0000 7f1f937fe640 1 --2- 172.21.15.77:0/3655879054 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1f7c06be30 0x7f1f7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:05.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.536+0000 7f1f937fe640 1 -- 172.21.15.77:0/3655879054 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6637+0+0 (secure 0 0 0) 0x7f1f9408b970 con 0x7f1f9c150090 2024-04-25T01:40:05.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.536+0000 7f1f9affd640 1 --2- 172.21.15.77:0/3655879054 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1f7c06be30 0x7f1f7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:05.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.536+0000 7f1f9affd640 1 --2- 172.21.15.77:0/3655879054 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1f7c06be30 0x7f1f7c06e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c034000 tx=0x7f1f8c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:05.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.540+0000 7f1f937fe640 1 -- 172.21.15.77:0/3655879054 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1f94059930 con 0x7f1f9c150090 2024-04-25T01:40:05.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.717+0000 7f1fa1495640 1 -- 172.21.15.77:0/3655879054 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f9c06cec0 con 0x7f1f9c150090 2024-04-25T01:40:05.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.718+0000 7f1f937fe640 1 -- 172.21.15.77:0/3655879054 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+20519 (secure 0 0 0) 0x7f1f9405dc30 con 0x7f1f9c150090 2024-04-25T01:40:05.702 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:40:05.703 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":26,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:40:05.548440+0000","last_up_change":"2024-04-25T01:39:10.729600+0000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T01:39:11.681151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T01:39:21.606752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T01:39:22.677664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T01:39:30.501700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T01:39:31.740717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6811","nonce":3366980158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6817","nonce":3366980158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6828","nonce":3366980158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6825","nonce":3366980158}]},"public_addr":"172.21.15.77:6811/3366980158","cluster_addr":"172.21.15.77:6817/3366980158","heartbeat_back_addr":"172.21.15.77:6828/3366980158","heartbeat_front_addr":"172.21.15.77:6825/3366980158","state":["exists","up"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6801","nonce":3971619298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6803","nonce":3971619298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6807","nonce":3971619298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6805","nonce":3971619298}]},"public_addr":"172.21.15.77:6801/3971619298","cluster_addr":"172.21.15.77:6803/3971619298","heartbeat_back_addr":"172.21.15.77:6807/3971619298","heartbeat_front_addr":"172.21.15.77:6805/3971619298","state":["exists","up"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6810","nonce":4103452689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6813","nonce":4103452689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6823","nonce":4103452689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6818","nonce":4103452689}]},"public_addr":"172.21.15.77:6810/4103452689","cluster_addr":"172.21.15.77:6813/4103452689","heartbeat_back_addr":"172.21.15.77:6823/4103452689","heartbeat_front_addr":"172.21.15.77:6818/4103452689","state":["exists","up"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6819","nonce":217398906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6824","nonce":217398906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6831","nonce":217398906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6829","nonce":217398906}]},"public_addr":"172.21.15.77:6819/217398906","cluster_addr":"172.21.15.77:6824/217398906","heartbeat_back_addr":"172.21.15.77:6831/217398906","heartbeat_front_addr":"172.21.15.77:6829/217398906","state":["exists","up"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6801","nonce":2565483070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6803","nonce":2565483070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6810","nonce":2565483070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6806","nonce":2565483070}]},"public_addr":"172.21.15.121:6801/2565483070","cluster_addr":"172.21.15.121:6803/2565483070","heartbeat_back_addr":"172.21.15.121:6810/2565483070","heartbeat_front_addr":"172.21.15.121:6806/2565483070","state":["exists","up"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6807","nonce":2785294752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6809","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6811","nonce":2785294752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6815","nonce":2785294752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6813","nonce":2785294752}]},"public_addr":"172.21.15.121:6807/2785294752","cluster_addr":"172.21.15.121:6811/2785294752","heartbeat_back_addr":"172.21.15.121:6815/2785294752","heartbeat_front_addr":"172.21.15.121:6813/2785294752","state":["exists","up"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6820","nonce":523906818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6824","nonce":523906818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6831","nonce":523906818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6828","nonce":523906818}]},"public_addr":"172.21.15.121:6820/523906818","cluster_addr":"172.21.15.121:6824/523906818","heartbeat_back_addr":"172.21.15.121:6831/523906818","heartbeat_front_addr":"172.21.15.121:6828/523906818","state":["exists","up"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6817","nonce":1683602459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6819","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6821","nonce":1683602459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6829","nonce":1683602459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6823","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6825","nonce":1683602459}]},"public_addr":"172.21.15.121:6817/1683602459","cluster_addr":"172.21.15.121:6821/1683602459","heartbeat_back_addr":"172.21.15.121:6829/1683602459","heartbeat_front_addr":"172.21.15.121:6825/1683602459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.839443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.818842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.776243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.793085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.822396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.907311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.918374+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.848430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:40:05.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.720+0000 7f1fa1495640 1 -- 172.21.15.77:0/3655879054 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1f7c06be30 msgr2=0x7f1f7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:05.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.720+0000 7f1fa1495640 1 --2- 172.21.15.77:0/3655879054 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1f7c06be30 0x7f1f7c06e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c034000 tx=0x7f1f8c02e000 comp rx=0 tx=0).stop 2024-04-25T01:40:05.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.720+0000 7f1fa1495640 1 -- 172.21.15.77:0/3655879054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f9c150090 msgr2=0x7f1f9c1545a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:05.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.720+0000 7f1fa1495640 1 --2- 172.21.15.77:0/3655879054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f9c150090 0x7f1f9c1545a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1f94007e40 tx=0x7f1f9400e4b0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.720+0000 7f1fa1495640 1 -- 172.21.15.77:0/3655879054 shutdown_connections 2024-04-25T01:40:05.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.720+0000 7f1fa1495640 1 --2- 172.21.15.77:0/3655879054 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1f7c06be30 0x7f1f7c06e2f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.720+0000 7f1fa1495640 1 --2- 172.21.15.77:0/3655879054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f9c150090 0x7f1f9c1545a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.720+0000 7f1fa1495640 1 --2- 172.21.15.77:0/3655879054 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1f9c0c8200 0x7f1f9c1efe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.720+0000 7f1fa1495640 1 --2- 172.21.15.77:0/3655879054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f9c06c280 0x7f1f9c0c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.720+0000 7f1fa1495640 1 -- 172.21.15.77:0/3655879054 >> 172.21.15.77:0/3655879054 conn(0x7f1f9c0ad4d0 msgr2=0x7f1f9c14e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:05.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.720+0000 7f1fa1495640 1 -- 172.21.15.77:0/3655879054 shutdown_connections 2024-04-25T01:40:05.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.720+0000 7f1fa1495640 1 -- 172.21.15.77:0/3655879054 wait complete. 2024-04-25T01:40:05.715 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T01:40:05.716 INFO:tasks.mds_thrash.fs.[a]:starting mds_do_thrash for fs a 2024-04-25T01:40:05.716 INFO:tasks.mds_thrash.fs.[a]:waiting for 72 secs before thrashing 2024-04-25T01:40:05.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.828+0000 7f412911d640 1 Processor -- start 2024-04-25T01:40:05.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.828+0000 7f412911d640 1 -- start start 2024-04-25T01:40:05.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.829+0000 7f412911d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4124153890 0x7f4124072c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:05.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.829+0000 7f412911d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4124153c70 con 0x7f4124156210 2024-04-25T01:40:05.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.829+0000 7f412911d640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4124156670 con 0x7f41240c96c0 2024-04-25T01:40:05.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.829+0000 7f412911d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f4124072ad0 con 0x7f4124153890 2024-04-25T01:40:05.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.829+0000 7f4122d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4124153890 0x7f4124072c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:05.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.829+0000 7f412259c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4124156210 0x7f41240723c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59518/0 (socket says 172.21.15.77:59518) 2024-04-25T01:40:05.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.829+0000 7f4122d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4124153890 0x7f4124072c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39196/0 (socket says 172.21.15.77:39196) 2024-04-25T01:40:05.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.829+0000 7f412259c640 1 -- 172.21.15.77:0/3062073722 learned_addr learned my addr 172.21.15.77:0/3062073722 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:40:05.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.829+0000 7f4122d9d640 1 -- 172.21.15.77:0/3062073722 >> v1:172.21.15.121:6789/0 conn(0x7f41240c96c0 legacy=0x7f4124160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:05.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.829+0000 7f4122d9d640 1 -- 172.21.15.77:0/3062073722 >> v1:172.21.15.77:6789/0 conn(0x7f4124156210 legacy=0x7f41240723c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:05.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.829+0000 7f4122d9d640 1 -- 172.21.15.77:0/3062073722 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41240c3180 con 0x7f4124153890 2024-04-25T01:40:05.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.829+0000 7f4121d9b640 1 -- 172.21.15.77:0/3062073722 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1034202434 0 0) 0x7f4118001110 con 0x7f4124156210 2024-04-25T01:40:05.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.830+0000 7f4122d9d640 1 --2- 172.21.15.77:0/3062073722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4124153890 0x7f4124072c80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4114009d90 tx=0x7f411402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e839e848429dbd27 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:05.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.830+0000 7f4121d9b640 1 -- 172.21.15.77:0/3062073722 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4114031600 con 0x7f4124153890 2024-04-25T01:40:05.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.830+0000 7f4121d9b640 1 -- 172.21.15.77:0/3062073722 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41140317a0 con 0x7f4124153890 2024-04-25T01:40:05.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.830+0000 7f4121d9b640 1 -- 172.21.15.77:0/3062073722 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4114031b70 con 0x7f4124153890 2024-04-25T01:40:05.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.831+0000 7f412911d640 1 -- 172.21.15.77:0/3062073722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4124153890 msgr2=0x7f4124072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:05.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.831+0000 7f412911d640 1 --2- 172.21.15.77:0/3062073722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4124153890 0x7f4124072c80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4114009d90 tx=0x7f411402a5d0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.831+0000 7f412911d640 1 -- 172.21.15.77:0/3062073722 shutdown_connections 2024-04-25T01:40:05.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.831+0000 7f412911d640 1 --2- 172.21.15.77:0/3062073722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4124153890 0x7f4124072c80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.831+0000 7f412911d640 1 -- 172.21.15.77:0/3062073722 >> 172.21.15.77:0/3062073722 conn(0x7f41240aa8f0 msgr2=0x7f4124066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:05.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.831+0000 7f412911d640 1 -- 172.21.15.77:0/3062073722 shutdown_connections 2024-04-25T01:40:05.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.831+0000 7f412911d640 1 -- 172.21.15.77:0/3062073722 wait complete. 2024-04-25T01:40:05.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.832+0000 7f412911d640 1 Processor -- start 2024-04-25T01:40:05.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.832+0000 7f412911d640 1 -- start start 2024-04-25T01:40:05.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.833+0000 7f412911d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41240c96c0 0x7f412406d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:05.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.833+0000 7f412911d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4124153890 0x7f4124149c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:05.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.833+0000 7f412911d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4124156210 0x7f412414a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:05.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.833+0000 7f412911d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4124070210 con 0x7f41240c96c0 2024-04-25T01:40:05.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.833+0000 7f412911d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f412406ff30 con 0x7f4124156210 2024-04-25T01:40:05.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.833+0000 7f412911d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f412406f300 con 0x7f4124153890 2024-04-25T01:40:05.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.833+0000 7f4122d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41240c96c0 0x7f412406d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:05.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.833+0000 7f4122d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41240c96c0 0x7f412406d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39204/0 (socket says 172.21.15.77:39204) 2024-04-25T01:40:05.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.833+0000 7f4122d9d640 1 -- 172.21.15.77:0/2067328331 learned_addr learned my addr 172.21.15.77:0/2067328331 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:05.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.833+0000 7f412359e640 1 --2- 172.21.15.77:0/2067328331 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4124156210 0x7f412414a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:05.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.833+0000 7f412259c640 1 --2- 172.21.15.77:0/2067328331 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4124153890 0x7f4124149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:05.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.833+0000 7f4122d9d640 1 -- 172.21.15.77:0/2067328331 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4124153890 msgr2=0x7f4124149c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:05.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.833+0000 7f4122d9d640 1 --2- 172.21.15.77:0/2067328331 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4124153890 0x7f4124149c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.833+0000 7f4122d9d640 1 -- 172.21.15.77:0/2067328331 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4124156210 msgr2=0x7f412414a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:05.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.833+0000 7f4122d9d640 1 --2- 172.21.15.77:0/2067328331 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4124156210 0x7f412414a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:05.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.833+0000 7f4122d9d640 1 -- 172.21.15.77:0/2067328331 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4124154dc0 con 0x7f41240c96c0 2024-04-25T01:40:05.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.833+0000 7f412259c640 1 --2- 172.21.15.77:0/2067328331 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4124153890 0x7f4124149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:40:05.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.833+0000 7f412359e640 1 --2- 172.21.15.77:0/2067328331 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4124156210 0x7f412414a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:40:05.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.833+0000 7f4122d9d640 1 --2- 172.21.15.77:0/2067328331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41240c96c0 0x7f412406d8b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4114009d90 tx=0x7f4114004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:05.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.834+0000 7f410b7fe640 1 -- 172.21.15.77:0/2067328331 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4114040070 con 0x7f41240c96c0 2024-04-25T01:40:05.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.834+0000 7f410b7fe640 1 -- 172.21.15.77:0/2067328331 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4114030be0 con 0x7f41240c96c0 2024-04-25T01:40:05.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.834+0000 7f412911d640 1 -- 172.21.15.77:0/2067328331 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41241efda0 con 0x7f41240c96c0 2024-04-25T01:40:05.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.834+0000 7f410b7fe640 1 -- 172.21.15.77:0/2067328331 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4114045460 con 0x7f41240c96c0 2024-04-25T01:40:05.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.834+0000 7f412911d640 1 -- 172.21.15.77:0/2067328331 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4124155340 con 0x7f41240c96c0 2024-04-25T01:40:05.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.835+0000 7f412911d640 1 -- 172.21.15.77:0/2067328331 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f412404f500 con 0x7f41240c96c0 2024-04-25T01:40:05.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.835+0000 7f410b7fe640 1 -- 172.21.15.77:0/2067328331 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4114039040 con 0x7f41240c96c0 2024-04-25T01:40:05.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.835+0000 7f410b7fe640 1 --2- 172.21.15.77:0/2067328331 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f411006be30 0x7f411006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:05.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.836+0000 7f410b7fe640 1 -- 172.21.15.77:0/2067328331 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6637+0+0 (secure 0 0 0) 0x7f41140ac9d0 con 0x7f41240c96c0 2024-04-25T01:40:05.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.836+0000 7f412259c640 1 --2- 172.21.15.77:0/2067328331 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f411006be30 0x7f411006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:05.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.836+0000 7f412259c640 1 --2- 172.21.15.77:0/2067328331 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f411006be30 0x7f411006e2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f412414ede0 tx=0x7f4118009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:05.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:05.840+0000 7f410b7fe640 1 -- 172.21.15.77:0/2067328331 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f411407b070 con 0x7f41240c96c0 2024-04-25T01:40:05.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.013+0000 7f412911d640 1 -- 172.21.15.77:0/2067328331 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f41240c2d20 con 0x7f41240c96c0 2024-04-25T01:40:05.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.015+0000 7f410b7fe640 1 -- 172.21.15.77:0/2067328331 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+20519 (secure 0 0 0) 0x7f4114043e40 con 0x7f41240c96c0 2024-04-25T01:40:05.999 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:40:05.999 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":26,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:40:05.548440+0000","last_up_change":"2024-04-25T01:39:10.729600+0000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T01:39:11.681151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T01:39:21.606752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T01:39:22.677664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T01:39:30.501700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T01:39:31.740717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6811","nonce":3366980158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6817","nonce":3366980158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6828","nonce":3366980158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6825","nonce":3366980158}]},"public_addr":"172.21.15.77:6811/3366980158","cluster_addr":"172.21.15.77:6817/3366980158","heartbeat_back_addr":"172.21.15.77:6828/3366980158","heartbeat_front_addr":"172.21.15.77:6825/3366980158","state":["exists","up"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6801","nonce":3971619298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6803","nonce":3971619298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6807","nonce":3971619298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6805","nonce":3971619298}]},"public_addr":"172.21.15.77:6801/3971619298","cluster_addr":"172.21.15.77:6803/3971619298","heartbeat_back_addr":"172.21.15.77:6807/3971619298","heartbeat_front_addr":"172.21.15.77:6805/3971619298","state":["exists","up"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6810","nonce":4103452689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6813","nonce":4103452689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6823","nonce":4103452689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6818","nonce":4103452689}]},"public_addr":"172.21.15.77:6810/4103452689","cluster_addr":"172.21.15.77:6813/4103452689","heartbeat_back_addr":"172.21.15.77:6823/4103452689","heartbeat_front_addr":"172.21.15.77:6818/4103452689","state":["exists","up"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6819","nonce":217398906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6824","nonce":217398906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6831","nonce":217398906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6829","nonce":217398906}]},"public_addr":"172.21.15.77:6819/217398906","cluster_addr":"172.21.15.77:6824/217398906","heartbeat_back_addr":"172.21.15.77:6831/217398906","heartbeat_front_addr":"172.21.15.77:6829/217398906","state":["exists","up"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6801","nonce":2565483070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6803","nonce":2565483070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6810","nonce":2565483070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6806","nonce":2565483070}]},"public_addr":"172.21.15.121:6801/2565483070","cluster_addr":"172.21.15.121:6803/2565483070","heartbeat_back_addr":"172.21.15.121:6810/2565483070","heartbeat_front_addr":"172.21.15.121:6806/2565483070","state":["exists","up"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6807","nonce":2785294752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6809","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6811","nonce":2785294752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6815","nonce":2785294752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6813","nonce":2785294752}]},"public_addr":"172.21.15.121:6807/2785294752","cluster_addr":"172.21.15.121:6811/2785294752","heartbeat_back_addr":"172.21.15.121:6815/2785294752","heartbeat_front_addr":"172.21.15.121:6813/2785294752","state":["exists","up"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6820","nonce":523906818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6824","nonce":523906818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6831","nonce":523906818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6828","nonce":523906818}]},"public_addr":"172.21.15.121:6820/523906818","cluster_addr":"172.21.15.121:6824/523906818","heartbeat_back_addr":"172.21.15.121:6831/523906818","heartbeat_front_addr":"172.21.15.121:6828/523906818","state":["exists","up"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6817","nonce":1683602459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6819","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6821","nonce":1683602459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6829","nonce":1683602459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6823","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6825","nonce":1683602459}]},"public_addr":"172.21.15.121:6817/1683602459","cluster_addr":"172.21.15.121:6821/1683602459","heartbeat_back_addr":"172.21.15.121:6829/1683602459","heartbeat_front_addr":"172.21.15.121:6825/1683602459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.839443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.818842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.776243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.793085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.822396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.907311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.918374+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.848430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:40:06.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.016+0000 7f412911d640 1 -- 172.21.15.77:0/2067328331 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f411006be30 msgr2=0x7f411006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:06.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.016+0000 7f412911d640 1 --2- 172.21.15.77:0/2067328331 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f411006be30 0x7f411006e2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f412414ede0 tx=0x7f4118009040 comp rx=0 tx=0).stop 2024-04-25T01:40:06.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.016+0000 7f412911d640 1 -- 172.21.15.77:0/2067328331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41240c96c0 msgr2=0x7f412406d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:06.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.016+0000 7f412911d640 1 --2- 172.21.15.77:0/2067328331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41240c96c0 0x7f412406d8b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4114009d90 tx=0x7f4114004a40 comp rx=0 tx=0).stop 2024-04-25T01:40:06.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.017+0000 7f412911d640 1 -- 172.21.15.77:0/2067328331 shutdown_connections 2024-04-25T01:40:06.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.017+0000 7f412911d640 1 --2- 172.21.15.77:0/2067328331 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f411006be30 0x7f411006e2f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.017+0000 7f412911d640 1 --2- 172.21.15.77:0/2067328331 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4124156210 0x7f412414a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.017+0000 7f412911d640 1 --2- 172.21.15.77:0/2067328331 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4124153890 0x7f4124149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.017+0000 7f412911d640 1 --2- 172.21.15.77:0/2067328331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41240c96c0 0x7f412406d8b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.017+0000 7f412911d640 1 -- 172.21.15.77:0/2067328331 >> 172.21.15.77:0/2067328331 conn(0x7f41240aa8f0 msgr2=0x7f412406f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:06.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.017+0000 7f412911d640 1 -- 172.21.15.77:0/2067328331 shutdown_connections 2024-04-25T01:40:06.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.017+0000 7f412911d640 1 -- 172.21.15.77:0/2067328331 wait complete. 2024-04-25T01:40:06.012 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T01:39:11.681151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-25T01:39:21.606752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-25T01:39:22.677664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-25T01:39:30.501700+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-25T01:39:31.740717+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T01:40:06.013 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T01:40:06.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.128+0000 7fdd0a163640 1 Processor -- start 2024-04-25T01:40:06.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.128+0000 7fdd0a163640 1 -- start start 2024-04-25T01:40:06.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.129+0000 7fdd0a163640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdd040bef50 0x7fdd041595f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:06.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.129+0000 7fdd0a163640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdd040c97c0 0x7fdd04159b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:06.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.129+0000 7fdd0a163640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd0406d110 con 0x7fdd04153530 2024-04-25T01:40:06.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.129+0000 7fdd0a163640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fdd04153910 con 0x7fdd040bef50 2024-04-25T01:40:06.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.129+0000 7fdd0a163640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fdd04156980 con 0x7fdd040c97c0 2024-04-25T01:40:06.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.129+0000 7fdd02ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdd040bef50 0x7fdd041595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:06.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.129+0000 7fdd037fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fdd04153530 0x7fdd040c6240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59522/0 (socket says 172.21.15.77:59522) 2024-04-25T01:40:06.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.129+0000 7fdd037fe640 1 -- 172.21.15.77:0/2645531700 learned_addr learned my addr 172.21.15.77:0/2645531700 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:40:06.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.130+0000 7fdd02ffd640 1 -- 172.21.15.77:0/2645531700 >> v2:172.21.15.121:3300/0 conn(0x7fdd040c97c0 msgr2=0x7fdd04159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:06.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.130+0000 7fdd02ffd640 1 --2- 172.21.15.77:0/2645531700 >> v2:172.21.15.121:3300/0 conn(0x7fdd040c97c0 0x7fdd04159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.130+0000 7fdd02ffd640 1 -- 172.21.15.77:0/2645531700 >> v1:172.21.15.77:6789/0 conn(0x7fdd04153530 legacy=0x7fdd040c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:06.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.130+0000 7fdd02ffd640 1 -- 172.21.15.77:0/2645531700 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd04156c60 con 0x7fdd040bef50 2024-04-25T01:40:06.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.130+0000 7fdd027fc640 1 -- 172.21.15.77:0/2645531700 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3780884009 0 0) 0x7fdd0406d110 con 0x7fdd04153530 2024-04-25T01:40:06.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.130+0000 7fdd02ffd640 1 --2- 172.21.15.77:0/2645531700 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd040bef50 0x7fdd041595f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fdd0406c880 tx=0x7fdcec02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a284230d18247ca6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:06.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.130+0000 7fdd027fc640 1 -- 172.21.15.77:0/2645531700 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec037070 con 0x7fdd040bef50 2024-04-25T01:40:06.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.130+0000 7fdd027fc640 1 -- 172.21.15.77:0/2645531700 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcec032440 con 0x7fdd040bef50 2024-04-25T01:40:06.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.130+0000 7fdd027fc640 1 -- 172.21.15.77:0/2645531700 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec02ae60 con 0x7fdd040bef50 2024-04-25T01:40:06.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.131+0000 7fdd0a163640 1 -- 172.21.15.77:0/2645531700 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd040bef50 msgr2=0x7fdd041595f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:06.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.131+0000 7fdd0a163640 1 --2- 172.21.15.77:0/2645531700 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd040bef50 0x7fdd041595f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fdd0406c880 tx=0x7fdcec02a110 comp rx=0 tx=0).stop 2024-04-25T01:40:06.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.131+0000 7fdd0a163640 1 -- 172.21.15.77:0/2645531700 shutdown_connections 2024-04-25T01:40:06.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.131+0000 7fdd0a163640 1 --2- 172.21.15.77:0/2645531700 >> v2:172.21.15.121:3300/0 conn(0x7fdd040c97c0 0x7fdd04159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.131+0000 7fdd0a163640 1 --2- 172.21.15.77:0/2645531700 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd040bef50 0x7fdd041595f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.131+0000 7fdd0a163640 1 -- 172.21.15.77:0/2645531700 >> 172.21.15.77:0/2645531700 conn(0x7fdd040672c0 msgr2=0x7fdd040676d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:06.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.131+0000 7fdd0a163640 1 -- 172.21.15.77:0/2645531700 shutdown_connections 2024-04-25T01:40:06.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.131+0000 7fdd0a163640 1 -- 172.21.15.77:0/2645531700 wait complete. 2024-04-25T01:40:06.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.132+0000 7fdd0a163640 1 Processor -- start 2024-04-25T01:40:06.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.132+0000 7fdd0a163640 1 -- start start 2024-04-25T01:40:06.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.133+0000 7fdd0a163640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd040bef50 0x7fdd04151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:06.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.133+0000 7fdd0a163640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd040c97c0 0x7fdd04157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:06.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.133+0000 7fdd0a163640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdd04153530 0x7fdd04158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:06.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.133+0000 7fdd0a163640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdd040c6950 con 0x7fdd040bef50 2024-04-25T01:40:06.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.133+0000 7fdd0a163640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdd040cc250 con 0x7fdd040c97c0 2024-04-25T01:40:06.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.133+0000 7fdd0a163640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fdd040c6ad0 con 0x7fdd04153530 2024-04-25T01:40:06.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.133+0000 7fdd037fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd040bef50 0x7fdd04151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:06.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.133+0000 7fdd037fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd040bef50 0x7fdd04151670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39218/0 (socket says 172.21.15.77:39218) 2024-04-25T01:40:06.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.133+0000 7fdd037fe640 1 -- 172.21.15.77:0/2719652175 learned_addr learned my addr 172.21.15.77:0/2719652175 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:06.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.133+0000 7fdd02ffd640 1 --2- 172.21.15.77:0/2719652175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd040c97c0 0x7fdd04157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:06.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.133+0000 7fdd03fff640 1 --2- 172.21.15.77:0/2719652175 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdd04153530 0x7fdd04158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:06.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.133+0000 7fdd037fe640 1 -- 172.21.15.77:0/2719652175 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdd04153530 msgr2=0x7fdd04158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:06.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.133+0000 7fdd037fe640 1 --2- 172.21.15.77:0/2719652175 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdd04153530 0x7fdd04158350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.133+0000 7fdd037fe640 1 -- 172.21.15.77:0/2719652175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd040c97c0 msgr2=0x7fdd04157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:06.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.133+0000 7fdd037fe640 1 --2- 172.21.15.77:0/2719652175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd040c97c0 0x7fdd04157e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.133+0000 7fdd037fe640 1 -- 172.21.15.77:0/2719652175 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd04157650 con 0x7fdd040bef50 2024-04-25T01:40:06.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.134+0000 7fdd037fe640 1 --2- 172.21.15.77:0/2719652175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd040bef50 0x7fdd04151670 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400c7f0 tx=0x7fdcf400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:06.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.134+0000 7fdcfbfff640 1 -- 172.21.15.77:0/2719652175 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4018070 con 0x7fdd040bef50 2024-04-25T01:40:06.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.134+0000 7fdcfbfff640 1 -- 172.21.15.77:0/2719652175 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcf400a640 con 0x7fdd040bef50 2024-04-25T01:40:06.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.134+0000 7fdcfbfff640 1 -- 172.21.15.77:0/2719652175 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf400aa30 con 0x7fdd040bef50 2024-04-25T01:40:06.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.134+0000 7fdd0a163640 1 -- 172.21.15.77:0/2719652175 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd04152b40 con 0x7fdd040bef50 2024-04-25T01:40:06.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.134+0000 7fdd0a163640 1 -- 172.21.15.77:0/2719652175 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd041592b0 con 0x7fdd040bef50 2024-04-25T01:40:06.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.135+0000 7fdd0a163640 1 -- 172.21.15.77:0/2719652175 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd0404f500 con 0x7fdd040bef50 2024-04-25T01:40:06.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.135+0000 7fdcfbfff640 1 -- 172.21.15.77:0/2719652175 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdcf401b070 con 0x7fdd040bef50 2024-04-25T01:40:06.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.135+0000 7fdcfbfff640 1 --2- 172.21.15.77:0/2719652175 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fdce406be30 0x7fdce406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:06.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.136+0000 7fdd02ffd640 1 --2- 172.21.15.77:0/2719652175 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fdce406be30 0x7fdce406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:06.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.136+0000 7fdcfbfff640 1 -- 172.21.15.77:0/2719652175 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6637+0+0 (secure 0 0 0) 0x7fdcf408a7f0 con 0x7fdd040bef50 2024-04-25T01:40:06.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.136+0000 7fdd02ffd640 1 --2- 172.21.15.77:0/2719652175 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fdce406be30 0x7fdce406e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdcec034000 tx=0x7fdcec02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:06.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.140+0000 7fdcfbfff640 1 -- 172.21.15.77:0/2719652175 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fdcf4058e90 con 0x7fdd040bef50 2024-04-25T01:40:06.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.313+0000 7fdd0a163640 1 -- 172.21.15.77:0/2719652175 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdd0406cd20 con 0x7fdd040bef50 2024-04-25T01:40:06.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.314+0000 7fdcfbfff640 1 -- 172.21.15.77:0/2719652175 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fdcf4058790 con 0x7fdd040bef50 2024-04-25T01:40:06.298 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-25T01:40:06.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.316+0000 7fdd0a163640 1 -- 172.21.15.77:0/2719652175 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fdce406be30 msgr2=0x7fdce406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:06.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.316+0000 7fdd0a163640 1 --2- 172.21.15.77:0/2719652175 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fdce406be30 0x7fdce406e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdcec034000 tx=0x7fdcec02e000 comp rx=0 tx=0).stop 2024-04-25T01:40:06.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.316+0000 7fdd0a163640 1 -- 172.21.15.77:0/2719652175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd040bef50 msgr2=0x7fdd04151670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:06.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.316+0000 7fdd0a163640 1 --2- 172.21.15.77:0/2719652175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd040bef50 0x7fdd04151670 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400c7f0 tx=0x7fdcf400ccb0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.316+0000 7fdd0a163640 1 -- 172.21.15.77:0/2719652175 shutdown_connections 2024-04-25T01:40:06.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.316+0000 7fdd0a163640 1 --2- 172.21.15.77:0/2719652175 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fdce406be30 0x7fdce406e2f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.316+0000 7fdd0a163640 1 --2- 172.21.15.77:0/2719652175 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdd04153530 0x7fdd04158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.316+0000 7fdd0a163640 1 --2- 172.21.15.77:0/2719652175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd040c97c0 0x7fdd04157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.316+0000 7fdd0a163640 1 --2- 172.21.15.77:0/2719652175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd040bef50 0x7fdd04151670 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.316+0000 7fdd0a163640 1 -- 172.21.15.77:0/2719652175 >> 172.21.15.77:0/2719652175 conn(0x7fdd040672c0 msgr2=0x7fdd040676a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:06.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.316+0000 7fdd0a163640 1 -- 172.21.15.77:0/2719652175 shutdown_connections 2024-04-25T01:40:06.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.316+0000 7fdd0a163640 1 -- 172.21.15.77:0/2719652175 wait complete. 2024-04-25T01:40:06.311 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-25T01:40:06.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.427+0000 7fbd0b009640 1 Processor -- start 2024-04-25T01:40:06.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.427+0000 7fbd0b009640 1 -- start start 2024-04-25T01:40:06.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.427+0000 7fbd0b009640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbd040c4280 0x7fbd041538f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:06.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.427+0000 7fbd0b009640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbd04073450 0x7fbd04153e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:06.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.427+0000 7fbd0b009640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd040c7040 con 0x7fbd040c4cb0 2024-04-25T01:40:06.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.428+0000 7fbd0b009640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fbd040c1cd0 con 0x7fbd04073450 2024-04-25T01:40:06.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.428+0000 7fbd0b009640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fbd040ac010 con 0x7fbd040c4280 2024-04-25T01:40:06.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.428+0000 7fbd095a6640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fbd040c4cb0 0x7fbd040c5480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59528/0 (socket says 172.21.15.77:59528) 2024-04-25T01:40:06.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.428+0000 7fbd095a6640 1 -- 172.21.15.77:0/341747183 learned_addr learned my addr 172.21.15.77:0/341747183 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:40:06.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.428+0000 7fbd03fff640 1 --2- 172.21.15.77:0/341747183 >> v2:172.21.15.121:3300/0 conn(0x7fbd04073450 0x7fbd04153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:06.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.428+0000 7fbd08da5640 1 --2- 172.21.15.77:0/341747183 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbd040c4280 0x7fbd041538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:06.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.428+0000 7fbd037fe640 1 -- 172.21.15.77:0/341747183 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3669823582 0 0) 0x7fbd040c7040 con 0x7fbd040c4cb0 2024-04-25T01:40:06.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.428+0000 7fbd037fe640 1 -- 172.21.15.77:0/341747183 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcf4003520 con 0x7fbd040c4cb0 2024-04-25T01:40:06.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.428+0000 7fbd037fe640 1 -- 172.21.15.77:0/341747183 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1244588075 0 0) 0x7fbcf4003520 con 0x7fbd040c4cb0 2024-04-25T01:40:06.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.428+0000 7fbd037fe640 1 -- 172.21.15.77:0/341747183 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbd040c4280 msgr2=0x7fbd041538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:06.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.428+0000 7fbd037fe640 1 --2- 172.21.15.77:0/341747183 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbd040c4280 0x7fbd041538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.428+0000 7fbd037fe640 1 -- 172.21.15.77:0/341747183 >> v2:172.21.15.121:3300/0 conn(0x7fbd04073450 msgr2=0x7fbd04153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:06.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.428+0000 7fbd037fe640 1 --2- 172.21.15.77:0/341747183 >> v2:172.21.15.121:3300/0 conn(0x7fbd04073450 0x7fbd04153e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.428+0000 7fbd037fe640 1 -- 172.21.15.77:0/341747183 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd040ac2f0 con 0x7fbd040c4cb0 2024-04-25T01:40:06.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.428+0000 7fbd037fe640 1 -- 172.21.15.77:0/341747183 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7fbcfc0019f0 con 0x7fbd040c4cb0 2024-04-25T01:40:06.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.428+0000 7fbd037fe640 1 -- 172.21.15.77:0/341747183 >> v1:172.21.15.77:6789/0 conn(0x7fbd040c4cb0 legacy=0x7fbd040c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:06.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.428+0000 7fbd037fe640 1 --2- 172.21.15.77:0/341747183 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcf40039b0 0x7fbcf4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:06.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.428+0000 7fbd037fe640 1 --2- 172.21.15.77:0/341747183 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbd040c4280 0x7fbcf4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:06.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.428+0000 7fbd037fe640 1 --2- 172.21.15.77:0/341747183 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcf4004d40 0x7fbcf40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:06.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.428+0000 7fbd037fe640 1 -- 172.21.15.77:0/341747183 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbd040c1cd0 con 0x7fbcf4004d40 2024-04-25T01:40:06.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.428+0000 7fbd037fe640 1 -- 172.21.15.77:0/341747183 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbd040ac010 con 0x7fbcf40039b0 2024-04-25T01:40:06.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.428+0000 7fbd037fe640 1 -- 172.21.15.77:0/341747183 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf400b9c0 con 0x7fbd040c4280 2024-04-25T01:40:06.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.428+0000 7fbd095a6640 1 --2- 172.21.15.77:0/341747183 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcf4004d40 0x7fbcf40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:06.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.428+0000 7fbd08da5640 1 --2- 172.21.15.77:0/341747183 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcf40039b0 0x7fbcf4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:06.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.428+0000 7fbd03fff640 1 --2- 172.21.15.77:0/341747183 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbd040c4280 0x7fbcf4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:06.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.429+0000 7fbd095a6640 1 -- 172.21.15.77:0/341747183 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbd040c4280 msgr2=0x7fbcf4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:06.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.429+0000 7fbd095a6640 1 --2- 172.21.15.77:0/341747183 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbd040c4280 0x7fbcf4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.429+0000 7fbd095a6640 1 -- 172.21.15.77:0/341747183 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcf40039b0 msgr2=0x7fbcf4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:06.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.429+0000 7fbd095a6640 1 --2- 172.21.15.77:0/341747183 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcf40039b0 0x7fbcf4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.429+0000 7fbd095a6640 1 -- 172.21.15.77:0/341747183 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf4003520 con 0x7fbcf4004d40 2024-04-25T01:40:06.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.429+0000 7fbd095a6640 1 --2- 172.21.15.77:0/341747183 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcf4004d40 0x7fbcf40051c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc00a8f0 tx=0x7fbcf4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e10b9e56ff660320 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:06.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.429+0000 7fbd037fe640 1 -- 172.21.15.77:0/341747183 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc00a4c0 con 0x7fbcf4004d40 2024-04-25T01:40:06.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.429+0000 7fbd037fe640 1 -- 172.21.15.77:0/341747183 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcfc02f070 con 0x7fbcf4004d40 2024-04-25T01:40:06.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.429+0000 7fbd037fe640 1 -- 172.21.15.77:0/341747183 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc02bd00 con 0x7fbcf4004d40 2024-04-25T01:40:06.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.430+0000 7fbd0b009640 1 -- 172.21.15.77:0/341747183 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcf4004d40 msgr2=0x7fbcf40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:06.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.430+0000 7fbd0b009640 1 --2- 172.21.15.77:0/341747183 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcf4004d40 0x7fbcf40051c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc00a8f0 tx=0x7fbcf4005830 comp rx=0 tx=0).stop 2024-04-25T01:40:06.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.430+0000 7fbd095a6640 1 -- 172.21.15.77:0/341747183 reap_dead start 2024-04-25T01:40:06.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.430+0000 7fbd0b009640 1 -- 172.21.15.77:0/341747183 shutdown_connections 2024-04-25T01:40:06.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.430+0000 7fbd0b009640 1 -- 172.21.15.77:0/341747183 >> 172.21.15.77:0/341747183 conn(0x7fbd040c7580 msgr2=0x7fbd040c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:06.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.430+0000 7fbd0b009640 1 -- 172.21.15.77:0/341747183 shutdown_connections 2024-04-25T01:40:06.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.430+0000 7fbd0b009640 1 -- 172.21.15.77:0/341747183 wait complete. 2024-04-25T01:40:06.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.431+0000 7fbd0b009640 1 Processor -- start 2024-04-25T01:40:06.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.431+0000 7fbd0b009640 1 -- start start 2024-04-25T01:40:06.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.432+0000 7fbd0b009640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd041e0c30 0x7fbd04155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:06.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.432+0000 7fbd0b009640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbd04148900 0x7fbd04148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:06.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.432+0000 7fbd0b009640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd041ef8d0 0x7fbd041efd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:06.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.432+0000 7fbd0b009640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbd040c1a90 con 0x7fbd041ef8d0 2024-04-25T01:40:06.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.432+0000 7fbd0b009640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbd040c1910 con 0x7fbd041e0c30 2024-04-25T01:40:06.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.432+0000 7fbd0b009640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fbd040c4660 con 0x7fbd04148900 2024-04-25T01:40:06.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.432+0000 7fbd095a6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd041ef8d0 0x7fbd041efd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:06.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.432+0000 7fbd095a6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd041ef8d0 0x7fbd041efd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39228/0 (socket says 172.21.15.77:39228) 2024-04-25T01:40:06.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.432+0000 7fbd095a6640 1 -- 172.21.15.77:0/2689999580 learned_addr learned my addr 172.21.15.77:0/2689999580 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:06.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.432+0000 7fbd08da5640 1 --2- 172.21.15.77:0/2689999580 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd041e0c30 0x7fbd04155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:06.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.432+0000 7fbd03fff640 1 --2- 172.21.15.77:0/2689999580 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbd04148900 0x7fbd04148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:06.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.432+0000 7fbd095a6640 1 -- 172.21.15.77:0/2689999580 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbd04148900 msgr2=0x7fbd04148d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:06.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.432+0000 7fbd095a6640 1 --2- 172.21.15.77:0/2689999580 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbd04148900 0x7fbd04148d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.432+0000 7fbd095a6640 1 -- 172.21.15.77:0/2689999580 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd041e0c30 msgr2=0x7fbd04155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:06.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.432+0000 7fbd095a6640 1 --2- 172.21.15.77:0/2689999580 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd041e0c30 0x7fbd04155120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.432+0000 7fbd095a6640 1 -- 172.21.15.77:0/2689999580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd04072290 con 0x7fbd041ef8d0 2024-04-25T01:40:06.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.432+0000 7fbd08da5640 1 --2- 172.21.15.77:0/2689999580 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd041e0c30 0x7fbd04155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:40:06.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.432+0000 7fbd03fff640 1 --2- 172.21.15.77:0/2689999580 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbd04148900 0x7fbd04148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:40:06.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.433+0000 7fbd095a6640 1 --2- 172.21.15.77:0/2689999580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd041ef8d0 0x7fbd041efd50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc00a8f0 tx=0x7fbcfc001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:06.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.433+0000 7fbd017fa640 1 -- 172.21.15.77:0/2689999580 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc00a4c0 con 0x7fbd041ef8d0 2024-04-25T01:40:06.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.433+0000 7fbd017fa640 1 -- 172.21.15.77:0/2689999580 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcfc0019e0 con 0x7fbd041ef8d0 2024-04-25T01:40:06.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.433+0000 7fbd017fa640 1 -- 172.21.15.77:0/2689999580 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc002000 con 0x7fbd041ef8d0 2024-04-25T01:40:06.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.433+0000 7fbd0b009640 1 -- 172.21.15.77:0/2689999580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd04072570 con 0x7fbd041ef8d0 2024-04-25T01:40:06.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.433+0000 7fbd0b009640 1 -- 172.21.15.77:0/2689999580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd04072b30 con 0x7fbd041ef8d0 2024-04-25T01:40:06.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.434+0000 7fbd0b009640 1 -- 172.21.15.77:0/2689999580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd040c5170 con 0x7fbd041ef8d0 2024-04-25T01:40:06.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.434+0000 7fbd017fa640 1 -- 172.21.15.77:0/2689999580 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbcfc0346b0 con 0x7fbd041ef8d0 2024-04-25T01:40:06.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.434+0000 7fbd017fa640 1 --2- 172.21.15.77:0/2689999580 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbce806be30 0x7fbce806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:06.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.435+0000 7fbd017fa640 1 -- 172.21.15.77:0/2689999580 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6637+0+0 (secure 0 0 0) 0x7fbcfc0ab300 con 0x7fbd041ef8d0 2024-04-25T01:40:06.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.435+0000 7fbd08da5640 1 --2- 172.21.15.77:0/2689999580 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbce806be30 0x7fbce806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:06.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.435+0000 7fbd08da5640 1 --2- 172.21.15.77:0/2689999580 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbce806be30 0x7fbce806e2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8009b40 tx=0x7fbcf8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:06.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.439+0000 7fbd017fa640 1 -- 172.21.15.77:0/2689999580 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbd040c5170 con 0x7fbd041ef8d0 2024-04-25T01:40:06.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.613+0000 7fbd0b009640 1 -- 172.21.15.77:0/2689999580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7fbd0404f500 con 0x7fbd041ef8d0 2024-04-25T01:40:06.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.613+0000 7fbd017fa640 1 -- 172.21.15.77:0/2689999580 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v26) ==== 99+0+11 (secure 0 0 0) 0x7fbcfc046060 con 0x7fbd041ef8d0 2024-04-25T01:40:06.597 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T01:40:06.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.615+0000 7fbd0b009640 1 -- 172.21.15.77:0/2689999580 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbce806be30 msgr2=0x7fbce806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:06.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.615+0000 7fbd0b009640 1 --2- 172.21.15.77:0/2689999580 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbce806be30 0x7fbce806e2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8009b40 tx=0x7fbcf8008040 comp rx=0 tx=0).stop 2024-04-25T01:40:06.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.615+0000 7fbd0b009640 1 -- 172.21.15.77:0/2689999580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd041ef8d0 msgr2=0x7fbd041efd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:06.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.615+0000 7fbd0b009640 1 --2- 172.21.15.77:0/2689999580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd041ef8d0 0x7fbd041efd50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc00a8f0 tx=0x7fbcfc001dc0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.615+0000 7fbd0b009640 1 -- 172.21.15.77:0/2689999580 shutdown_connections 2024-04-25T01:40:06.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.615+0000 7fbd0b009640 1 --2- 172.21.15.77:0/2689999580 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbce806be30 0x7fbce806e2f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.615+0000 7fbd0b009640 1 --2- 172.21.15.77:0/2689999580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd041ef8d0 0x7fbd041efd50 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.615+0000 7fbd0b009640 1 --2- 172.21.15.77:0/2689999580 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbd04148900 0x7fbd04148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.615+0000 7fbd0b009640 1 --2- 172.21.15.77:0/2689999580 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd041e0c30 0x7fbd04155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.615+0000 7fbd0b009640 1 -- 172.21.15.77:0/2689999580 >> 172.21.15.77:0/2689999580 conn(0x7fbd040c7580 msgr2=0x7fbd040c1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:06.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.615+0000 7fbd0b009640 1 -- 172.21.15.77:0/2689999580 shutdown_connections 2024-04-25T01:40:06.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.615+0000 7fbd0b009640 1 -- 172.21.15.77:0/2689999580 wait complete. 2024-04-25T01:40:06.610 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-25T01:40:06.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.726+0000 7f5c4cea5640 1 Processor -- start 2024-04-25T01:40:06.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.727+0000 7f5c4cea5640 1 -- start start 2024-04-25T01:40:06.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.727+0000 7f5c4cea5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c480bef50 0x7f5c481595f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:06.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.727+0000 7f5c4cea5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c4806d110 con 0x7f5c480c97c0 2024-04-25T01:40:06.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.727+0000 7f5c4cea5640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c48153910 con 0x7f5c48153530 2024-04-25T01:40:06.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.727+0000 7f5c4cea5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f5c48156980 con 0x7f5c480bef50 2024-04-25T01:40:06.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.727+0000 7f5c46d9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f5c480c97c0 0x7f5c48159b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59540/0 (socket says 172.21.15.77:59540) 2024-04-25T01:40:06.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.727+0000 7f5c46d9d640 1 -- 172.21.15.77:0/3327902759 learned_addr learned my addr 172.21.15.77:0/3327902759 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:40:06.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.728+0000 7f5c45d9b640 1 -- 172.21.15.77:0/3327902759 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2897384311 0 0) 0x7f5c4806d110 con 0x7f5c480c97c0 2024-04-25T01:40:06.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.728+0000 7f5c45d9b640 1 -- 172.21.15.77:0/3327902759 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c34003520 con 0x7f5c480c97c0 2024-04-25T01:40:06.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.728+0000 7f5c3ffff640 1 --2- 172.21.15.77:0/3327902759 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c480bef50 0x7f5c481595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:06.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.728+0000 7f5c45d9b640 1 -- 172.21.15.77:0/3327902759 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4085589812 0 0) 0x7f5c34003520 con 0x7f5c480c97c0 2024-04-25T01:40:06.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.728+0000 7f5c45d9b640 1 -- 172.21.15.77:0/3327902759 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c480bef50 msgr2=0x7f5c481595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:06.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.728+0000 7f5c45d9b640 1 --2- 172.21.15.77:0/3327902759 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c480bef50 0x7f5c481595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.728+0000 7f5c45d9b640 1 -- 172.21.15.77:0/3327902759 >> v1:172.21.15.121:6789/0 conn(0x7f5c48153530 legacy=0x7f5c480c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:06.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.728+0000 7f5c45d9b640 1 -- 172.21.15.77:0/3327902759 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c48156c60 con 0x7f5c480c97c0 2024-04-25T01:40:06.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.728+0000 7f5c45d9b640 1 -- 172.21.15.77:0/3327902759 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7f5c400019f0 con 0x7f5c480c97c0 2024-04-25T01:40:06.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.728+0000 7f5c45d9b640 1 -- 172.21.15.77:0/3327902759 >> v1:172.21.15.77:6789/0 conn(0x7f5c480c97c0 legacy=0x7f5c48159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:06.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.728+0000 7f5c45d9b640 1 --2- 172.21.15.77:0/3327902759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c340039e0 0x7f5c34003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:06.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.728+0000 7f5c45d9b640 1 --2- 172.21.15.77:0/3327902759 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c480bef50 0x7f5c34004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:06.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.728+0000 7f5c45d9b640 1 --2- 172.21.15.77:0/3327902759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c34004d40 0x7f5c340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:06.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.728+0000 7f5c45d9b640 1 -- 172.21.15.77:0/3327902759 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5c48156980 con 0x7f5c340039e0 2024-04-25T01:40:06.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.728+0000 7f5c45d9b640 1 -- 172.21.15.77:0/3327902759 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3400baf0 con 0x7f5c34004d40 2024-04-25T01:40:06.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.728+0000 7f5c45d9b640 1 -- 172.21.15.77:0/3327902759 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f5c3400bcf0 con 0x7f5c480bef50 2024-04-25T01:40:06.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.728+0000 7f5c4659c640 1 --2- 172.21.15.77:0/3327902759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c340039e0 0x7f5c34003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:06.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.728+0000 7f5c3ffff640 1 --2- 172.21.15.77:0/3327902759 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c480bef50 0x7f5c34004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:06.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.728+0000 7f5c46d9d640 1 --2- 172.21.15.77:0/3327902759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c34004d40 0x7f5c340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:06.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.728+0000 7f5c4659c640 1 -- 172.21.15.77:0/3327902759 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c480bef50 msgr2=0x7f5c34004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:06.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.728+0000 7f5c4659c640 1 --2- 172.21.15.77:0/3327902759 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c480bef50 0x7f5c34004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.728+0000 7f5c4659c640 1 -- 172.21.15.77:0/3327902759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c34004d40 msgr2=0x7f5c340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:06.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.728+0000 7f5c4659c640 1 --2- 172.21.15.77:0/3327902759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c34004d40 0x7f5c340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.728+0000 7f5c4659c640 1 -- 172.21.15.77:0/3327902759 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c34003520 con 0x7f5c340039e0 2024-04-25T01:40:06.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.728+0000 7f5c3ffff640 1 --2- 172.21.15.77:0/3327902759 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c480bef50 0x7f5c34004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:40:06.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.729+0000 7f5c4659c640 1 --2- 172.21.15.77:0/3327902759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c340039e0 0x7f5c34003e00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5c38001750 tx=0x7f5c34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6debafd8611e5714 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:06.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.729+0000 7f5c45d9b640 1 -- 172.21.15.77:0/3327902759 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c38001370 con 0x7f5c340039e0 2024-04-25T01:40:06.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.729+0000 7f5c45d9b640 1 -- 172.21.15.77:0/3327902759 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c380052d0 con 0x7f5c340039e0 2024-04-25T01:40:06.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.729+0000 7f5c45d9b640 1 -- 172.21.15.77:0/3327902759 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3802ab20 con 0x7f5c340039e0 2024-04-25T01:40:06.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.730+0000 7f5c4cea5640 1 -- 172.21.15.77:0/3327902759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c340039e0 msgr2=0x7f5c34003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:06.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.730+0000 7f5c4cea5640 1 --2- 172.21.15.77:0/3327902759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c340039e0 0x7f5c34003e00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5c38001750 tx=0x7f5c34005830 comp rx=0 tx=0).stop 2024-04-25T01:40:06.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.730+0000 7f5c46d9d640 1 -- 172.21.15.77:0/3327902759 reap_dead start 2024-04-25T01:40:06.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.730+0000 7f5c4cea5640 1 -- 172.21.15.77:0/3327902759 shutdown_connections 2024-04-25T01:40:06.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.730+0000 7f5c4cea5640 1 -- 172.21.15.77:0/3327902759 >> 172.21.15.77:0/3327902759 conn(0x7f5c480672c0 msgr2=0x7f5c480676d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:06.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.730+0000 7f5c4cea5640 1 -- 172.21.15.77:0/3327902759 shutdown_connections 2024-04-25T01:40:06.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.730+0000 7f5c4cea5640 1 -- 172.21.15.77:0/3327902759 wait complete. 2024-04-25T01:40:06.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.731+0000 7f5c4cea5640 1 Processor -- start 2024-04-25T01:40:06.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.731+0000 7f5c4cea5640 1 -- start start 2024-04-25T01:40:06.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.732+0000 7f5c4cea5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c340039e0 0x7f5c480c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:06.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.732+0000 7f5c4cea5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c48151a90 0x7f5c4814aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:06.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.732+0000 7f5c4cea5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c480c55f0 0x7f5c4814b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:06.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.732+0000 7f5c4cea5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4815a240 con 0x7f5c48151a90 2024-04-25T01:40:06.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.732+0000 7f5c4cea5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5c480cc250 con 0x7f5c340039e0 2024-04-25T01:40:06.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.732+0000 7f5c4cea5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f5c480c6950 con 0x7f5c480c55f0 2024-04-25T01:40:06.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.732+0000 7f5c3ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c48151a90 0x7f5c4814aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:06.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.732+0000 7f5c3ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c48151a90 0x7f5c4814aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39246/0 (socket says 172.21.15.77:39246) 2024-04-25T01:40:06.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.732+0000 7f5c3ffff640 1 -- 172.21.15.77:0/388950193 learned_addr learned my addr 172.21.15.77:0/388950193 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:06.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.732+0000 7f5c46d9d640 1 --2- 172.21.15.77:0/388950193 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c480c55f0 0x7f5c4814b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:06.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.732+0000 7f5c4659c640 1 --2- 172.21.15.77:0/388950193 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c340039e0 0x7f5c480c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:06.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.732+0000 7f5c3ffff640 1 -- 172.21.15.77:0/388950193 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c480c55f0 msgr2=0x7f5c4814b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:06.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.732+0000 7f5c3ffff640 1 --2- 172.21.15.77:0/388950193 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c480c55f0 0x7f5c4814b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.732+0000 7f5c3ffff640 1 -- 172.21.15.77:0/388950193 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c340039e0 msgr2=0x7f5c480c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:06.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.732+0000 7f5c3ffff640 1 --2- 172.21.15.77:0/388950193 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c340039e0 0x7f5c480c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.732+0000 7f5c3ffff640 1 -- 172.21.15.77:0/388950193 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c481ef770 con 0x7f5c48151a90 2024-04-25T01:40:06.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.732+0000 7f5c3ffff640 1 --2- 172.21.15.77:0/388950193 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c48151a90 0x7f5c4814aac0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5c30011620 tx=0x7f5c30011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:06.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.732+0000 7f5c3effd640 1 -- 172.21.15.77:0/388950193 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c30019070 con 0x7f5c48151a90 2024-04-25T01:40:06.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.732+0000 7f5c3effd640 1 -- 172.21.15.77:0/388950193 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c30005da0 con 0x7f5c48151a90 2024-04-25T01:40:06.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.732+0000 7f5c4cea5640 1 -- 172.21.15.77:0/388950193 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c481efa50 con 0x7f5c48151a90 2024-04-25T01:40:06.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.732+0000 7f5c3effd640 1 -- 172.21.15.77:0/388950193 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c30004240 con 0x7f5c48151a90 2024-04-25T01:40:06.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.732+0000 7f5c4cea5640 1 -- 172.21.15.77:0/388950193 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c481f0010 con 0x7f5c48151a90 2024-04-25T01:40:06.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.733+0000 7f5c4cea5640 1 -- 172.21.15.77:0/388950193 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c4804f500 con 0x7f5c48151a90 2024-04-25T01:40:06.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.734+0000 7f5c3effd640 1 -- 172.21.15.77:0/388950193 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5c30003610 con 0x7f5c48151a90 2024-04-25T01:40:06.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.734+0000 7f5c3effd640 1 --2- 172.21.15.77:0/388950193 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5c2806be30 0x7f5c2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:06.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.734+0000 7f5c3effd640 1 -- 172.21.15.77:0/388950193 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6637+0+0 (secure 0 0 0) 0x7f5c3008b590 con 0x7f5c48151a90 2024-04-25T01:40:06.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.734+0000 7f5c4659c640 1 --2- 172.21.15.77:0/388950193 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5c2806be30 0x7f5c2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:06.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.734+0000 7f5c4659c640 1 --2- 172.21.15.77:0/388950193 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5c2806be30 0x7f5c2806e2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5c38032000 tx=0x7f5c3802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:06.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.738+0000 7f5c3effd640 1 -- 172.21.15.77:0/388950193 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5c30059c30 con 0x7f5c48151a90 2024-04-25T01:40:06.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.911+0000 7f5c4cea5640 1 -- 172.21.15.77:0/388950193 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7f5c4806cac0 con 0x7f5c48151a90 2024-04-25T01:40:06.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.912+0000 7f5c3effd640 1 -- 172.21.15.77:0/388950193 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v26) ==== 95+0+11 (secure 0 0 0) 0x7f5c30059530 con 0x7f5c48151a90 2024-04-25T01:40:06.896 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-25T01:40:06.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.914+0000 7f5c4cea5640 1 -- 172.21.15.77:0/388950193 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5c2806be30 msgr2=0x7f5c2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:06.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.914+0000 7f5c4cea5640 1 --2- 172.21.15.77:0/388950193 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5c2806be30 0x7f5c2806e2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5c38032000 tx=0x7f5c3802e000 comp rx=0 tx=0).stop 2024-04-25T01:40:06.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.914+0000 7f5c4cea5640 1 -- 172.21.15.77:0/388950193 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c48151a90 msgr2=0x7f5c4814aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:06.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.914+0000 7f5c4cea5640 1 --2- 172.21.15.77:0/388950193 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c48151a90 0x7f5c4814aac0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5c30011620 tx=0x7f5c30011ae0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.914+0000 7f5c4cea5640 1 -- 172.21.15.77:0/388950193 shutdown_connections 2024-04-25T01:40:06.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.914+0000 7f5c4cea5640 1 --2- 172.21.15.77:0/388950193 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5c2806be30 0x7f5c2806e2f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.914+0000 7f5c4cea5640 1 --2- 172.21.15.77:0/388950193 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c48151a90 0x7f5c4814aac0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.914+0000 7f5c4cea5640 1 --2- 172.21.15.77:0/388950193 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c480c55f0 0x7f5c4814b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.914+0000 7f5c4cea5640 1 --2- 172.21.15.77:0/388950193 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c340039e0 0x7f5c480c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:06.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.914+0000 7f5c4cea5640 1 -- 172.21.15.77:0/388950193 >> 172.21.15.77:0/388950193 conn(0x7f5c480672c0 msgr2=0x7f5c48155f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:06.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.914+0000 7f5c4cea5640 1 -- 172.21.15.77:0/388950193 shutdown_connections 2024-04-25T01:40:06.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:06.914+0000 7f5c4cea5640 1 -- 172.21.15.77:0/388950193 wait complete. 2024-04-25T01:40:06.909 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-25T01:40:07.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.024+0000 7f6aa60a7640 1 Processor -- start 2024-04-25T01:40:07.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.025+0000 7f6aa60a7640 1 -- start start 2024-04-25T01:40:07.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.025+0000 7f6aa60a7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6aa00c4280 0x7f6aa01538f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:07.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.025+0000 7f6aa60a7640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6aa00c4cb0 0x7f6aa0153e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:07.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.025+0000 7f6aa60a7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6aa00c7040 con 0x7f6aa0073450 2024-04-25T01:40:07.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.025+0000 7f6aa60a7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f6aa00c1cd0 con 0x7f6aa00c4280 2024-04-25T01:40:07.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.025+0000 7f6aa60a7640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f6aa00ac010 con 0x7f6aa00c4cb0 2024-04-25T01:40:07.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.025+0000 7f6a9f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6aa00c4280 0x7f6aa01538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:07.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.025+0000 7f6a9effd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6aa0073450 0x7f6aa00c5480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59548/0 (socket says 172.21.15.77:59548) 2024-04-25T01:40:07.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.025+0000 7f6a9effd640 1 -- 172.21.15.77:0/2715047610 learned_addr learned my addr 172.21.15.77:0/2715047610 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:40:07.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.026+0000 7f6a9ffff640 1 --2- 172.21.15.77:0/2715047610 >> v2:172.21.15.121:3300/0 conn(0x7f6aa00c4cb0 0x7f6aa0153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:07.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.026+0000 7f6a9f7fe640 1 -- 172.21.15.77:0/2715047610 >> v2:172.21.15.121:3300/0 conn(0x7f6aa00c4cb0 msgr2=0x7f6aa0153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:07.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.026+0000 7f6a9f7fe640 1 --2- 172.21.15.77:0/2715047610 >> v2:172.21.15.121:3300/0 conn(0x7f6aa00c4cb0 0x7f6aa0153e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.026+0000 7f6a9f7fe640 1 -- 172.21.15.77:0/2715047610 >> v1:172.21.15.77:6789/0 conn(0x7f6aa0073450 legacy=0x7f6aa00c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:07.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.026+0000 7f6a9e7fc640 1 -- 172.21.15.77:0/2715047610 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1427695989 0 0) 0x7f6aa00c7040 con 0x7f6aa0073450 2024-04-25T01:40:07.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.026+0000 7f6a9f7fe640 1 -- 172.21.15.77:0/2715047610 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aa00ac2f0 con 0x7f6aa00c4280 2024-04-25T01:40:07.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.026+0000 7f6a9f7fe640 1 --2- 172.21.15.77:0/2715047610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6aa00c4280 0x7f6aa01538f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6aa00c1890 tx=0x7f6a9002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f530ae5cc96a355 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:07.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.027+0000 7f6a9e7fc640 1 -- 172.21.15.77:0/2715047610 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a90037070 con 0x7f6aa00c4280 2024-04-25T01:40:07.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.027+0000 7f6a9e7fc640 1 -- 172.21.15.77:0/2715047610 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a90032440 con 0x7f6aa00c4280 2024-04-25T01:40:07.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.027+0000 7f6a9e7fc640 1 -- 172.21.15.77:0/2715047610 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a90032810 con 0x7f6aa00c4280 2024-04-25T01:40:07.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.027+0000 7f6aa60a7640 1 -- 172.21.15.77:0/2715047610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6aa00c4280 msgr2=0x7f6aa01538f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:07.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.027+0000 7f6aa60a7640 1 --2- 172.21.15.77:0/2715047610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6aa00c4280 0x7f6aa01538f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6aa00c1890 tx=0x7f6a9002a1a0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.027+0000 7f6aa60a7640 1 -- 172.21.15.77:0/2715047610 shutdown_connections 2024-04-25T01:40:07.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.027+0000 7f6aa60a7640 1 --2- 172.21.15.77:0/2715047610 >> v2:172.21.15.121:3300/0 conn(0x7f6aa00c4cb0 0x7f6aa0153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.027+0000 7f6aa60a7640 1 --2- 172.21.15.77:0/2715047610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6aa00c4280 0x7f6aa01538f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.027+0000 7f6aa60a7640 1 -- 172.21.15.77:0/2715047610 >> 172.21.15.77:0/2715047610 conn(0x7f6aa00c7580 msgr2=0x7f6aa00c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:07.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.027+0000 7f6aa60a7640 1 -- 172.21.15.77:0/2715047610 shutdown_connections 2024-04-25T01:40:07.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.027+0000 7f6aa60a7640 1 -- 172.21.15.77:0/2715047610 wait complete. 2024-04-25T01:40:07.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.028+0000 7f6aa60a7640 1 Processor -- start 2024-04-25T01:40:07.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.028+0000 7f6aa60a7640 1 -- start start 2024-04-25T01:40:07.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.029+0000 7f6aa60a7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6aa0073450 0x7f6aa0071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:07.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.029+0000 7f6aa60a7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6aa00c4280 0x7f6aa01ecc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:07.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.029+0000 7f6aa60a7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6aa00c4cb0 0x7f6aa00bdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:07.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.029+0000 7f6aa60a7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa00c1a90 con 0x7f6aa0073450 2024-04-25T01:40:07.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.029+0000 7f6aa60a7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa00c1910 con 0x7f6aa00c4cb0 2024-04-25T01:40:07.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.029+0000 7f6aa60a7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f6aa00c4660 con 0x7f6aa00c4280 2024-04-25T01:40:07.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.029+0000 7f6a9f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6aa0073450 0x7f6aa0071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:07.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.029+0000 7f6a9f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6aa0073450 0x7f6aa0071150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39252/0 (socket says 172.21.15.77:39252) 2024-04-25T01:40:07.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.029+0000 7f6a9f7fe640 1 -- 172.21.15.77:0/1354426671 learned_addr learned my addr 172.21.15.77:0/1354426671 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:07.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.029+0000 7f6a9effd640 1 --2- 172.21.15.77:0/1354426671 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6aa00c4280 0x7f6aa01ecc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:07.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.029+0000 7f6a9ffff640 1 --2- 172.21.15.77:0/1354426671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6aa00c4cb0 0x7f6aa00bdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:07.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.029+0000 7f6a9f7fe640 1 -- 172.21.15.77:0/1354426671 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6aa00c4280 msgr2=0x7f6aa01ecc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:07.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.029+0000 7f6a9f7fe640 1 --2- 172.21.15.77:0/1354426671 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6aa00c4280 0x7f6aa01ecc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.029+0000 7f6a9f7fe640 1 -- 172.21.15.77:0/1354426671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6aa00c4cb0 msgr2=0x7f6aa00bdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:07.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.029+0000 7f6a9f7fe640 1 --2- 172.21.15.77:0/1354426671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6aa00c4cb0 0x7f6aa00bdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.029+0000 7f6a9f7fe640 1 -- 172.21.15.77:0/1354426671 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aa00724c0 con 0x7f6aa0073450 2024-04-25T01:40:07.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.030+0000 7f6a9f7fe640 1 --2- 172.21.15.77:0/1354426671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6aa0073450 0x7f6aa0071150 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6a90000c00 tx=0x7f6a900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:07.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.030+0000 7f6a87fff640 1 -- 172.21.15.77:0/1354426671 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a90037040 con 0x7f6aa0073450 2024-04-25T01:40:07.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.030+0000 7f6a87fff640 1 -- 172.21.15.77:0/1354426671 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a90042070 con 0x7f6aa0073450 2024-04-25T01:40:07.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.030+0000 7f6aa60a7640 1 -- 172.21.15.77:0/1354426671 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6aa00727a0 con 0x7f6aa0073450 2024-04-25T01:40:07.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.030+0000 7f6a87fff640 1 -- 172.21.15.77:0/1354426671 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a90030bd0 con 0x7f6aa0073450 2024-04-25T01:40:07.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.030+0000 7f6aa60a7640 1 -- 172.21.15.77:0/1354426671 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6aa0070c30 con 0x7f6aa0073450 2024-04-25T01:40:07.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.031+0000 7f6aa60a7640 1 -- 172.21.15.77:0/1354426671 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6aa004f500 con 0x7f6aa0073450 2024-04-25T01:40:07.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.031+0000 7f6a87fff640 1 -- 172.21.15.77:0/1354426671 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a90047460 con 0x7f6aa0073450 2024-04-25T01:40:07.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.032+0000 7f6a87fff640 1 --2- 172.21.15.77:0/1354426671 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6a8c06be30 0x7f6a8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:07.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.032+0000 7f6a87fff640 1 -- 172.21.15.77:0/1354426671 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6637+0+0 (secure 0 0 0) 0x7f6a900abe40 con 0x7f6aa0073450 2024-04-25T01:40:07.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.032+0000 7f6a9effd640 1 --2- 172.21.15.77:0/1354426671 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6a8c06be30 0x7f6a8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:07.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.032+0000 7f6a9effd640 1 --2- 172.21.15.77:0/1354426671 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6a8c06be30 0x7f6a8c06e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6aa00c8330 tx=0x7f6a94007b50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:07.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.036+0000 7f6a87fff640 1 -- 172.21.15.77:0/1354426671 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6a90032e20 con 0x7f6aa0073450 2024-04-25T01:40:07.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.208+0000 7f6aa60a7640 1 -- 172.21.15.77:0/1354426671 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7f6aa00c6bf0 con 0x7f6aa0073450 2024-04-25T01:40:07.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.208+0000 7f6a87fff640 1 -- 172.21.15.77:0/1354426671 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v26) ==== 99+0+11 (secure 0 0 0) 0x7f6a90045360 con 0x7f6aa0073450 2024-04-25T01:40:07.193 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T01:40:07.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.210+0000 7f6aa60a7640 1 -- 172.21.15.77:0/1354426671 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6a8c06be30 msgr2=0x7f6a8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:07.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.210+0000 7f6aa60a7640 1 --2- 172.21.15.77:0/1354426671 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6a8c06be30 0x7f6a8c06e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6aa00c8330 tx=0x7f6a94007b50 comp rx=0 tx=0).stop 2024-04-25T01:40:07.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.210+0000 7f6aa60a7640 1 -- 172.21.15.77:0/1354426671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6aa0073450 msgr2=0x7f6aa0071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:07.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.210+0000 7f6aa60a7640 1 --2- 172.21.15.77:0/1354426671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6aa0073450 0x7f6aa0071150 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6a90000c00 tx=0x7f6a900046c0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.210+0000 7f6aa60a7640 1 -- 172.21.15.77:0/1354426671 shutdown_connections 2024-04-25T01:40:07.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.210+0000 7f6aa60a7640 1 --2- 172.21.15.77:0/1354426671 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6a8c06be30 0x7f6a8c06e2f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.210+0000 7f6aa60a7640 1 --2- 172.21.15.77:0/1354426671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6aa00c4cb0 0x7f6aa00bdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.210+0000 7f6aa60a7640 1 --2- 172.21.15.77:0/1354426671 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6aa00c4280 0x7f6aa01ecc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.210+0000 7f6aa60a7640 1 --2- 172.21.15.77:0/1354426671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6aa0073450 0x7f6aa0071150 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.210+0000 7f6aa60a7640 1 -- 172.21.15.77:0/1354426671 >> 172.21.15.77:0/1354426671 conn(0x7f6aa00c7580 msgr2=0x7f6aa0152020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:07.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.210+0000 7f6aa60a7640 1 -- 172.21.15.77:0/1354426671 shutdown_connections 2024-04-25T01:40:07.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.210+0000 7f6aa60a7640 1 -- 172.21.15.77:0/1354426671 wait complete. 2024-04-25T01:40:07.205 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-25T01:40:07.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.320+0000 7f3f51368640 1 Processor -- start 2024-04-25T01:40:07.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.320+0000 7f3f51368640 1 -- start start 2024-04-25T01:40:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.321+0000 7f3f51368640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3f4c156bf0 0x7f3f4c161970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.321+0000 7f3f51368640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f4c06bf50 con 0x7f3f4c1535d0 2024-04-25T01:40:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.321+0000 7f3f51368640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f4c155fe0 con 0x7f3f4c0c1d10 2024-04-25T01:40:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.321+0000 7f3f51368640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f3f4c06e8a0 con 0x7f3f4c156bf0 2024-04-25T01:40:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.321+0000 7f3f4affd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3f4c1535d0 0x7f3f4c0c8550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59556/0 (socket says 172.21.15.77:59556) 2024-04-25T01:40:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.321+0000 7f3f4affd640 1 -- 172.21.15.77:0/3822209172 learned_addr learned my addr 172.21.15.77:0/3822209172 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:40:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.321+0000 7f3f4b7fe640 1 --2- 172.21.15.77:0/3822209172 >> v2:172.21.15.121:3300/0 conn(0x7f3f4c156bf0 0x7f3f4c161970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.321+0000 7f3f49ffb640 1 -- 172.21.15.77:0/3822209172 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1737639457 0 0) 0x7f3f4c06bf50 con 0x7f3f4c1535d0 2024-04-25T01:40:07.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.322+0000 7f3f49ffb640 1 -- 172.21.15.77:0/3822209172 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f38003520 con 0x7f3f4c1535d0 2024-04-25T01:40:07.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.322+0000 7f3f49ffb640 1 -- 172.21.15.77:0/3822209172 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2258115647 0 0) 0x7f3f38003520 con 0x7f3f4c1535d0 2024-04-25T01:40:07.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.322+0000 7f3f49ffb640 1 -- 172.21.15.77:0/3822209172 >> v2:172.21.15.121:3300/0 conn(0x7f3f4c156bf0 msgr2=0x7f3f4c161970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:07.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.322+0000 7f3f49ffb640 1 --2- 172.21.15.77:0/3822209172 >> v2:172.21.15.121:3300/0 conn(0x7f3f4c156bf0 0x7f3f4c161970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.322+0000 7f3f49ffb640 1 -- 172.21.15.77:0/3822209172 >> v1:172.21.15.121:6789/0 conn(0x7f3f4c0c1d10 legacy=0x7f3f4c1564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:07.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.322+0000 7f3f49ffb640 1 -- 172.21.15.77:0/3822209172 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4c06eb80 con 0x7f3f4c1535d0 2024-04-25T01:40:07.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.322+0000 7f3f49ffb640 1 -- 172.21.15.77:0/3822209172 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7f3f3c0019f0 con 0x7f3f4c1535d0 2024-04-25T01:40:07.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.322+0000 7f3f4b7fe640 1 --2- 172.21.15.77:0/3822209172 >> v2:172.21.15.121:3300/0 conn(0x7f3f4c156bf0 0x7f3f4c161970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:40:07.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.322+0000 7f3f49ffb640 1 -- 172.21.15.77:0/3822209172 >> v1:172.21.15.77:6789/0 conn(0x7f3f4c1535d0 legacy=0x7f3f4c0c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:07.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.322+0000 7f3f49ffb640 1 --2- 172.21.15.77:0/3822209172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f380039b0 0x7f3f38003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:07.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.322+0000 7f3f49ffb640 1 --2- 172.21.15.77:0/3822209172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f38004800 0x7f3f38004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:07.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.322+0000 7f3f49ffb640 1 --2- 172.21.15.77:0/3822209172 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3f380051c0 0x7f3f3800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:07.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.322+0000 7f3f49ffb640 1 -- 172.21.15.77:0/3822209172 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c06e8a0 con 0x7f3f380039b0 2024-04-25T01:40:07.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.322+0000 7f3f49ffb640 1 -- 172.21.15.77:0/3822209172 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3800c060 con 0x7f3f38004800 2024-04-25T01:40:07.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.322+0000 7f3f49ffb640 1 -- 172.21.15.77:0/3822209172 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f3f3800c260 con 0x7f3f380051c0 2024-04-25T01:40:07.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.322+0000 7f3f4affd640 1 --2- 172.21.15.77:0/3822209172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f380039b0 0x7f3f38003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:07.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.322+0000 7f3f4b7fe640 1 --2- 172.21.15.77:0/3822209172 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3f380051c0 0x7f3f3800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:07.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.322+0000 7f3f4a7fc640 1 --2- 172.21.15.77:0/3822209172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f38004800 0x7f3f38004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:07.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.322+0000 7f3f4affd640 1 -- 172.21.15.77:0/3822209172 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3f380051c0 msgr2=0x7f3f3800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:07.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.322+0000 7f3f4affd640 1 --2- 172.21.15.77:0/3822209172 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3f380051c0 0x7f3f3800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.322+0000 7f3f4affd640 1 -- 172.21.15.77:0/3822209172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f38004800 msgr2=0x7f3f38004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:07.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.322+0000 7f3f4affd640 1 --2- 172.21.15.77:0/3822209172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f38004800 0x7f3f38004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.322+0000 7f3f4affd640 1 -- 172.21.15.77:0/3822209172 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f38003520 con 0x7f3f380039b0 2024-04-25T01:40:07.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.322+0000 7f3f4b7fe640 1 -- 172.21.15.77:0/3822209172 reap_dead start 2024-04-25T01:40:07.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.322+0000 7f3f4a7fc640 1 --2- 172.21.15.77:0/3822209172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f38004800 0x7f3f38004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:40:07.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.323+0000 7f3f4affd640 1 --2- 172.21.15.77:0/3822209172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f380039b0 0x7f3f38003dd0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00a840 tx=0x7f3f38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf89859ffd5de40 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:07.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.323+0000 7f3f49ffb640 1 -- 172.21.15.77:0/3822209172 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c00a460 con 0x7f3f380039b0 2024-04-25T01:40:07.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.323+0000 7f3f49ffb640 1 -- 172.21.15.77:0/3822209172 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f3c02f070 con 0x7f3f380039b0 2024-04-25T01:40:07.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.323+0000 7f3f49ffb640 1 -- 172.21.15.77:0/3822209172 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c02bc90 con 0x7f3f380039b0 2024-04-25T01:40:07.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.324+0000 7f3f51368640 1 -- 172.21.15.77:0/3822209172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f380039b0 msgr2=0x7f3f38003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:07.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.324+0000 7f3f51368640 1 --2- 172.21.15.77:0/3822209172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f380039b0 0x7f3f38003dd0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00a840 tx=0x7f3f38005830 comp rx=0 tx=0).stop 2024-04-25T01:40:07.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.324+0000 7f3f51368640 1 -- 172.21.15.77:0/3822209172 shutdown_connections 2024-04-25T01:40:07.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.324+0000 7f3f51368640 1 --2- 172.21.15.77:0/3822209172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f380039b0 0x7f3f38003dd0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.324+0000 7f3f51368640 1 -- 172.21.15.77:0/3822209172 >> 172.21.15.77:0/3822209172 conn(0x7f3f4c0674d0 msgr2=0x7f3f4c0aa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:07.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.324+0000 7f3f51368640 1 -- 172.21.15.77:0/3822209172 shutdown_connections 2024-04-25T01:40:07.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.324+0000 7f3f51368640 1 -- 172.21.15.77:0/3822209172 wait complete. 2024-04-25T01:40:07.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.325+0000 7f3f51368640 1 Processor -- start 2024-04-25T01:40:07.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.325+0000 7f3f51368640 1 -- start start 2024-04-25T01:40:07.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.326+0000 7f3f51368640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f380039b0 0x7f3f4c06c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:07.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.326+0000 7f3f51368640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f4c0c6dc0 0x7f3f4c1ef370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:07.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.326+0000 7f3f51368640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3f4c1ef8b0 0x7f3f4c0ac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:07.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.326+0000 7f3f51368640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c1539b0 con 0x7f3f4c0c6dc0 2024-04-25T01:40:07.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.326+0000 7f3f51368640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c06b7c0 con 0x7f3f380039b0 2024-04-25T01:40:07.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.326+0000 7f3f51368640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f3f4c06bc40 con 0x7f3f4c1ef8b0 2024-04-25T01:40:07.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.326+0000 7f3f4a7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f4c0c6dc0 0x7f3f4c1ef370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:07.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.326+0000 7f3f4a7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f4c0c6dc0 0x7f3f4c1ef370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39284/0 (socket says 172.21.15.77:39284) 2024-04-25T01:40:07.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.326+0000 7f3f4a7fc640 1 -- 172.21.15.77:0/799377695 learned_addr learned my addr 172.21.15.77:0/799377695 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:07.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.326+0000 7f3f4b7fe640 1 --2- 172.21.15.77:0/799377695 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3f4c1ef8b0 0x7f3f4c0ac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:07.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.326+0000 7f3f4affd640 1 --2- 172.21.15.77:0/799377695 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f380039b0 0x7f3f4c06c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:07.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.326+0000 7f3f4a7fc640 1 -- 172.21.15.77:0/799377695 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3f4c1ef8b0 msgr2=0x7f3f4c0ac4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:07.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.326+0000 7f3f4a7fc640 1 --2- 172.21.15.77:0/799377695 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3f4c1ef8b0 0x7f3f4c0ac4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.326+0000 7f3f4a7fc640 1 -- 172.21.15.77:0/799377695 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f380039b0 msgr2=0x7f3f4c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:07.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.326+0000 7f3f4a7fc640 1 --2- 172.21.15.77:0/799377695 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f380039b0 0x7f3f4c06c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.326+0000 7f3f4a7fc640 1 -- 172.21.15.77:0/799377695 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4c072250 con 0x7f3f4c0c6dc0 2024-04-25T01:40:07.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.326+0000 7f3f4affd640 1 --2- 172.21.15.77:0/799377695 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f380039b0 0x7f3f4c06c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:40:07.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.326+0000 7f3f4a7fc640 1 --2- 172.21.15.77:0/799377695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f4c0c6dc0 0x7f3f4c1ef370 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3f3400e480 tx=0x7f3f3400e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:07.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.326+0000 7f3f437fe640 1 -- 172.21.15.77:0/799377695 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f340052e0 con 0x7f3f4c0c6dc0 2024-04-25T01:40:07.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.326+0000 7f3f437fe640 1 -- 172.21.15.77:0/799377695 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f34007020 con 0x7f3f4c0c6dc0 2024-04-25T01:40:07.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.326+0000 7f3f51368640 1 -- 172.21.15.77:0/799377695 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f4c1ec880 con 0x7f3f4c0c6dc0 2024-04-25T01:40:07.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.326+0000 7f3f437fe640 1 -- 172.21.15.77:0/799377695 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f34007210 con 0x7f3f4c0c6dc0 2024-04-25T01:40:07.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.326+0000 7f3f51368640 1 -- 172.21.15.77:0/799377695 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f4c071c90 con 0x7f3f4c0c6dc0 2024-04-25T01:40:07.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.327+0000 7f3f51368640 1 -- 172.21.15.77:0/799377695 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f4c04f500 con 0x7f3f4c0c6dc0 2024-04-25T01:40:07.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.328+0000 7f3f437fe640 1 -- 172.21.15.77:0/799377695 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3f3401a020 con 0x7f3f4c0c6dc0 2024-04-25T01:40:07.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.328+0000 7f3f437fe640 1 --2- 172.21.15.77:0/799377695 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3f2c06be60 0x7f3f2c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:07.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.328+0000 7f3f437fe640 1 -- 172.21.15.77:0/799377695 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6637+0+0 (secure 0 0 0) 0x7f3f3408a670 con 0x7f3f4c0c6dc0 2024-04-25T01:40:07.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.328+0000 7f3f4affd640 1 --2- 172.21.15.77:0/799377695 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3f2c06be60 0x7f3f2c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:07.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.329+0000 7f3f4affd640 1 --2- 172.21.15.77:0/799377695 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3f2c06be60 0x7f3f2c06e320 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c033000 tx=0x7f3f3c038040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:07.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.333+0000 7f3f437fe640 1 -- 172.21.15.77:0/799377695 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3f4c072250 con 0x7f3f4c0c6dc0 2024-04-25T01:40:07.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.504+0000 7f3f51368640 1 -- 172.21.15.77:0/799377695 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7f3f4c0c69e0 con 0x7f3f4c0c6dc0 2024-04-25T01:40:07.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.504+0000 7f3f437fe640 1 -- 172.21.15.77:0/799377695 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v26) ==== 95+0+11 (secure 0 0 0) 0x7f3f34058d10 con 0x7f3f4c0c6dc0 2024-04-25T01:40:07.488 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-25T01:40:07.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.506+0000 7f3f51368640 1 -- 172.21.15.77:0/799377695 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3f2c06be60 msgr2=0x7f3f2c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:07.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.506+0000 7f3f51368640 1 --2- 172.21.15.77:0/799377695 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3f2c06be60 0x7f3f2c06e320 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c033000 tx=0x7f3f3c038040 comp rx=0 tx=0).stop 2024-04-25T01:40:07.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.506+0000 7f3f51368640 1 -- 172.21.15.77:0/799377695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f4c0c6dc0 msgr2=0x7f3f4c1ef370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:07.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.506+0000 7f3f51368640 1 --2- 172.21.15.77:0/799377695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f4c0c6dc0 0x7f3f4c1ef370 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3f3400e480 tx=0x7f3f3400e940 comp rx=0 tx=0).stop 2024-04-25T01:40:07.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.506+0000 7f3f51368640 1 -- 172.21.15.77:0/799377695 shutdown_connections 2024-04-25T01:40:07.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.506+0000 7f3f51368640 1 --2- 172.21.15.77:0/799377695 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3f2c06be60 0x7f3f2c06e320 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.506+0000 7f3f51368640 1 --2- 172.21.15.77:0/799377695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f4c0c6dc0 0x7f3f4c1ef370 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.506+0000 7f3f51368640 1 --2- 172.21.15.77:0/799377695 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3f4c1ef8b0 0x7f3f4c0ac4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.506+0000 7f3f51368640 1 --2- 172.21.15.77:0/799377695 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f380039b0 0x7f3f4c06c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.506+0000 7f3f51368640 1 -- 172.21.15.77:0/799377695 >> 172.21.15.77:0/799377695 conn(0x7f3f4c0674d0 msgr2=0x7f3f4c0aa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:07.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.506+0000 7f3f51368640 1 -- 172.21.15.77:0/799377695 shutdown_connections 2024-04-25T01:40:07.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.506+0000 7f3f51368640 1 -- 172.21.15.77:0/799377695 wait complete. 2024-04-25T01:40:07.501 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:40:07.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.615+0000 7fd3025f9640 1 Processor -- start 2024-04-25T01:40:07.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.615+0000 7fd3025f9640 1 -- start start 2024-04-25T01:40:07.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.616+0000 7fd3025f9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd2fc06f840 0x7fd2fc157b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:07.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.616+0000 7fd3025f9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2fc0c6270 con 0x7fd2fc158080 2024-04-25T01:40:07.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.616+0000 7fd3025f9640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2fc0c6550 con 0x7fd2fc14df50 2024-04-25T01:40:07.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.616+0000 7fd3025f9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd2fc14e330 con 0x7fd2fc06f840 2024-04-25T01:40:07.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.616+0000 7fd300b96640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd2fc158080 0x7fd2fc0c40b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:59900/0 (socket says 172.21.15.77:59900) 2024-04-25T01:40:07.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.616+0000 7fd300b96640 1 -- 172.21.15.77:0/2471046675 learned_addr learned my addr 172.21.15.77:0/2471046675 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:40:07.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.616+0000 7fd2faffd640 1 -- 172.21.15.77:0/2471046675 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3138214910 0 0) 0x7fd2fc0c6270 con 0x7fd2fc158080 2024-04-25T01:40:07.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.616+0000 7fd2fb7fe640 1 --2- 172.21.15.77:0/2471046675 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd2fc06f840 0x7fd2fc157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:07.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.616+0000 7fd2faffd640 1 -- 172.21.15.77:0/2471046675 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2e4003520 con 0x7fd2fc158080 2024-04-25T01:40:07.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.616+0000 7fd2faffd640 1 -- 172.21.15.77:0/2471046675 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2735844832 0 0) 0x7fd2e4003520 con 0x7fd2fc158080 2024-04-25T01:40:07.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.616+0000 7fd2faffd640 1 -- 172.21.15.77:0/2471046675 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd2fc06f840 msgr2=0x7fd2fc157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:07.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.616+0000 7fd2faffd640 1 --2- 172.21.15.77:0/2471046675 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd2fc06f840 0x7fd2fc157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.616+0000 7fd2faffd640 1 -- 172.21.15.77:0/2471046675 >> v1:172.21.15.121:6789/0 conn(0x7fd2fc14df50 legacy=0x7fd2fc1548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:07.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.616+0000 7fd2faffd640 1 -- 172.21.15.77:0/2471046675 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2fc0c6830 con 0x7fd2fc158080 2024-04-25T01:40:07.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.616+0000 7fd2faffd640 1 -- 172.21.15.77:0/2471046675 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7fd2f40019f0 con 0x7fd2fc158080 2024-04-25T01:40:07.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.616+0000 7fd2faffd640 1 -- 172.21.15.77:0/2471046675 >> v1:172.21.15.77:6789/0 conn(0x7fd2fc158080 legacy=0x7fd2fc0c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:07.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.616+0000 7fd2faffd640 1 --2- 172.21.15.77:0/2471046675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2e40039e0 0x7fd2e4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:07.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.616+0000 7fd2faffd640 1 --2- 172.21.15.77:0/2471046675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2e4004800 0x7fd2e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:07.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.616+0000 7fd2faffd640 1 --2- 172.21.15.77:0/2471046675 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd2fc06f840 0x7fd2e4005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:07.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.616+0000 7fd2faffd640 1 -- 172.21.15.77:0/2471046675 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd2fc14e330 con 0x7fd2e4004800 2024-04-25T01:40:07.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.616+0000 7fd2faffd640 1 -- 172.21.15.77:0/2471046675 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e400bb80 con 0x7fd2e40039e0 2024-04-25T01:40:07.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.616+0000 7fd2faffd640 1 -- 172.21.15.77:0/2471046675 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e400bd80 con 0x7fd2fc06f840 2024-04-25T01:40:07.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.616+0000 7fd2fb7fe640 1 --2- 172.21.15.77:0/2471046675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2e4004800 0x7fd2e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:07.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.617+0000 7fd2fbfff640 1 --2- 172.21.15.77:0/2471046675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2e40039e0 0x7fd2e4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:07.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.617+0000 7fd300b96640 1 --2- 172.21.15.77:0/2471046675 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd2fc06f840 0x7fd2e4005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:07.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.617+0000 7fd2fb7fe640 1 -- 172.21.15.77:0/2471046675 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd2fc06f840 msgr2=0x7fd2e4005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:07.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.617+0000 7fd2fb7fe640 1 --2- 172.21.15.77:0/2471046675 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd2fc06f840 0x7fd2e4005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.617+0000 7fd2fb7fe640 1 -- 172.21.15.77:0/2471046675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2e40039e0 msgr2=0x7fd2e4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:07.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.617+0000 7fd2fb7fe640 1 --2- 172.21.15.77:0/2471046675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2e40039e0 0x7fd2e4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.617+0000 7fd2fb7fe640 1 -- 172.21.15.77:0/2471046675 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e4003520 con 0x7fd2e4004800 2024-04-25T01:40:07.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.617+0000 7fd2fb7fe640 1 --2- 172.21.15.77:0/2471046675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2e4004800 0x7fd2e4004c80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0009a90 tx=0x7fd2e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4461a361bad7ba5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:07.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.618+0000 7fd2faffd640 1 -- 172.21.15.77:0/2471046675 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0036070 con 0x7fd2e4004800 2024-04-25T01:40:07.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.618+0000 7fd2faffd640 1 -- 172.21.15.77:0/2471046675 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2f0031400 con 0x7fd2e4004800 2024-04-25T01:40:07.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.618+0000 7fd2faffd640 1 -- 172.21.15.77:0/2471046675 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0009690 con 0x7fd2e4004800 2024-04-25T01:40:07.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.618+0000 7fd3025f9640 1 -- 172.21.15.77:0/2471046675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2e4004800 msgr2=0x7fd2e4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:07.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.618+0000 7fd3025f9640 1 --2- 172.21.15.77:0/2471046675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2e4004800 0x7fd2e4004c80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0009a90 tx=0x7fd2e4005830 comp rx=0 tx=0).stop 2024-04-25T01:40:07.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.618+0000 7fd300b96640 1 -- 172.21.15.77:0/2471046675 reap_dead start 2024-04-25T01:40:07.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.618+0000 7fd3025f9640 1 -- 172.21.15.77:0/2471046675 shutdown_connections 2024-04-25T01:40:07.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.618+0000 7fd3025f9640 1 -- 172.21.15.77:0/2471046675 >> 172.21.15.77:0/2471046675 conn(0x7fd2fc0aa8f0 msgr2=0x7fd2fc066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:07.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.618+0000 7fd3025f9640 1 -- 172.21.15.77:0/2471046675 shutdown_connections 2024-04-25T01:40:07.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.618+0000 7fd3025f9640 1 -- 172.21.15.77:0/2471046675 wait complete. 2024-04-25T01:40:07.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.619+0000 7fd3025f9640 1 Processor -- start 2024-04-25T01:40:07.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.619+0000 7fd3025f9640 1 -- start start 2024-04-25T01:40:07.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.620+0000 7fd3025f9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2e4004800 0x7fd2fc0bebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.620+0000 7fd3025f9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd2fc1465f0 0x7fd2fc1442b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.620+0000 7fd3025f9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2fc1447f0 0x7fd2fc1ecc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.620+0000 7fd3025f9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd2fc0723c0 con 0x7fd2fc1447f0 2024-04-25T01:40:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.620+0000 7fd3025f9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd2fc1576b0 con 0x7fd2e4004800 2024-04-25T01:40:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.620+0000 7fd3025f9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd2fc072540 con 0x7fd2fc1465f0 2024-04-25T01:40:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.620+0000 7fd300b96640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2fc1447f0 0x7fd2fc1ecc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.620+0000 7fd300b96640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2fc1447f0 0x7fd2fc1ecc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44838/0 (socket says 172.21.15.77:44838) 2024-04-25T01:40:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.620+0000 7fd300b96640 1 -- 172.21.15.77:0/1478028653 learned_addr learned my addr 172.21.15.77:0/1478028653 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.620+0000 7fd2fbfff640 1 --2- 172.21.15.77:0/1478028653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2e4004800 0x7fd2fc0bebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.620+0000 7fd2fb7fe640 1 --2- 172.21.15.77:0/1478028653 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd2fc1465f0 0x7fd2fc1442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.620+0000 7fd300b96640 1 -- 172.21.15.77:0/1478028653 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd2fc1465f0 msgr2=0x7fd2fc1442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.620+0000 7fd300b96640 1 --2- 172.21.15.77:0/1478028653 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd2fc1465f0 0x7fd2fc1442b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.620+0000 7fd300b96640 1 -- 172.21.15.77:0/1478028653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2e4004800 msgr2=0x7fd2fc0bebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:07.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.620+0000 7fd300b96640 1 --2- 172.21.15.77:0/1478028653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2e4004800 0x7fd2fc0bebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.620+0000 7fd300b96640 1 -- 172.21.15.77:0/1478028653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2fc0af410 con 0x7fd2fc1447f0 2024-04-25T01:40:07.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.621+0000 7fd300b96640 1 --2- 172.21.15.77:0/1478028653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2fc1447f0 0x7fd2fc1ecc20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0c5c30 tx=0x7fd2f4007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:07.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.621+0000 7fd2f8ff9640 1 -- 172.21.15.77:0/1478028653 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f400abc0 con 0x7fd2fc1447f0 2024-04-25T01:40:07.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.621+0000 7fd2f8ff9640 1 -- 172.21.15.77:0/1478028653 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2f4018070 con 0x7fd2fc1447f0 2024-04-25T01:40:07.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.621+0000 7fd3025f9640 1 -- 172.21.15.77:0/1478028653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2fc0af6f0 con 0x7fd2fc1447f0 2024-04-25T01:40:07.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.621+0000 7fd2f8ff9640 1 -- 172.21.15.77:0/1478028653 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f40133f0 con 0x7fd2fc1447f0 2024-04-25T01:40:07.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.621+0000 7fd3025f9640 1 -- 172.21.15.77:0/1478028653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2fc0ae3c0 con 0x7fd2fc1447f0 2024-04-25T01:40:07.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.622+0000 7fd3025f9640 1 -- 172.21.15.77:0/1478028653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2fc0688e0 con 0x7fd2fc1447f0 2024-04-25T01:40:07.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.622+0000 7fd2f8ff9640 1 -- 172.21.15.77:0/1478028653 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd2f4013590 con 0x7fd2fc1447f0 2024-04-25T01:40:07.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.623+0000 7fd2f8ff9640 1 --2- 172.21.15.77:0/1478028653 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd2e806be30 0x7fd2e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:07.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.623+0000 7fd2f8ff9640 1 -- 172.21.15.77:0/1478028653 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6637+0+0 (secure 0 0 0) 0x7fd2f408b6a0 con 0x7fd2fc1447f0 2024-04-25T01:40:07.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.623+0000 7fd2fbfff640 1 --2- 172.21.15.77:0/1478028653 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd2e806be30 0x7fd2e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:07.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.623+0000 7fd2fbfff640 1 --2- 172.21.15.77:0/1478028653 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd2e806be30 0x7fd2e806e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0c1090 tx=0x7fd2ec009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:07.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.627+0000 7fd2f8ff9640 1 -- 172.21.15.77:0/1478028653 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd2f40596f0 con 0x7fd2fc1447f0 2024-04-25T01:40:07.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.839+0000 7fd3025f9640 1 -- 172.21.15.77:0/1478028653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2fc157b40 con 0x7fd2fc1447f0 2024-04-25T01:40:07.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.840+0000 7fd2f8ff9640 1 -- 172.21.15.77:0/1478028653 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6488 (secure 0 0 0) 0x7fd2fc157b40 con 0x7fd2fc1447f0 2024-04-25T01:40:07.824 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:40:07.824 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:39:36.787357+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6837/3454203695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3454203695},{"type":"v1","addr":"172.21.15.77:6837","nonce":3454203695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-04-25T01:40:07.825 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 12 2024-04-25T01:40:07.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.842+0000 7fd3025f9640 1 -- 172.21.15.77:0/1478028653 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd2e806be30 msgr2=0x7fd2e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:07.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.842+0000 7fd3025f9640 1 --2- 172.21.15.77:0/1478028653 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd2e806be30 0x7fd2e806e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0c1090 tx=0x7fd2ec009040 comp rx=0 tx=0).stop 2024-04-25T01:40:07.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.842+0000 7fd3025f9640 1 -- 172.21.15.77:0/1478028653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2fc1447f0 msgr2=0x7fd2fc1ecc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:07.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.842+0000 7fd3025f9640 1 --2- 172.21.15.77:0/1478028653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2fc1447f0 0x7fd2fc1ecc20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0c5c30 tx=0x7fd2f4007bd0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.842+0000 7fd3025f9640 1 -- 172.21.15.77:0/1478028653 shutdown_connections 2024-04-25T01:40:07.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.842+0000 7fd3025f9640 1 --2- 172.21.15.77:0/1478028653 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd2e806be30 0x7fd2e806e2f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.842+0000 7fd3025f9640 1 --2- 172.21.15.77:0/1478028653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2fc1447f0 0x7fd2fc1ecc20 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.842+0000 7fd3025f9640 1 --2- 172.21.15.77:0/1478028653 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd2fc1465f0 0x7fd2fc1442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.842+0000 7fd3025f9640 1 --2- 172.21.15.77:0/1478028653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2e4004800 0x7fd2fc0bebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.842+0000 7fd3025f9640 1 -- 172.21.15.77:0/1478028653 >> 172.21.15.77:0/1478028653 conn(0x7fd2fc0aa8f0 msgr2=0x7fd2fc14af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:07.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.842+0000 7fd3025f9640 1 -- 172.21.15.77:0/1478028653 shutdown_connections 2024-04-25T01:40:07.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.842+0000 7fd3025f9640 1 -- 172.21.15.77:0/1478028653 wait complete. 2024-04-25T01:40:07.837 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T01:40:07.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.950+0000 7fecf74df640 1 Processor -- start 2024-04-25T01:40:07.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.950+0000 7fecf74df640 1 -- start start 2024-04-25T01:40:07.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.951+0000 7fecf74df640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fecf0150090 0x7fecf0156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:07.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.951+0000 7fecf74df640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fecf00c8200 0x7fecf00c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:07.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.951+0000 7fecf74df640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecf00c9de0 con 0x7fecf006c280 2024-04-25T01:40:07.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.951+0000 7fecf74df640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fecf006b830 con 0x7fecf0150090 2024-04-25T01:40:07.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.951+0000 7fecf74df640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fecf00c89c0 con 0x7fecf00c8200 2024-04-25T01:40:07.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.951+0000 7fecf527b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fecf0150090 0x7fecf0156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:07.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.951+0000 7fecf527b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fecf0150090 0x7fecf0156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44848/0 (socket says 172.21.15.77:44848) 2024-04-25T01:40:07.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.951+0000 7fecf527b640 1 -- 172.21.15.77:0/1067211563 learned_addr learned my addr 172.21.15.77:0/1067211563 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:07.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.951+0000 7fecf4a7a640 1 --2- 172.21.15.77:0/1067211563 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fecf00c8200 0x7fecf00c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:07.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.952+0000 7fecf527b640 1 -- 172.21.15.77:0/1067211563 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fecf00c8200 msgr2=0x7fecf00c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:07.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.952+0000 7fecf527b640 1 --2- 172.21.15.77:0/1067211563 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fecf00c8200 0x7fecf00c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.952+0000 7fecf527b640 1 -- 172.21.15.77:0/1067211563 >> v1:172.21.15.121:6789/0 conn(0x7fecf006c280 legacy=0x7fecf00c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:07.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.952+0000 7fecf527b640 1 -- 172.21.15.77:0/1067211563 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf00c8ca0 con 0x7fecf0150090 2024-04-25T01:40:07.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.952+0000 7fecf527b640 1 --2- 172.21.15.77:0/1067211563 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecf0150090 0x7fecf0156c80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fecec009e50 tx=0x7fecec02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24019d113c0d191 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:07.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.952+0000 7fece7fff640 1 -- 172.21.15.77:0/1067211563 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec036070 con 0x7fecf0150090 2024-04-25T01:40:07.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.952+0000 7fece7fff640 1 -- 172.21.15.77:0/1067211563 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecec031600 con 0x7fecf0150090 2024-04-25T01:40:07.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.952+0000 7fece7fff640 1 -- 172.21.15.77:0/1067211563 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec0319d0 con 0x7fecf0150090 2024-04-25T01:40:07.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.953+0000 7fecf74df640 1 -- 172.21.15.77:0/1067211563 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecf0150090 msgr2=0x7fecf0156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:07.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.953+0000 7fecf74df640 1 --2- 172.21.15.77:0/1067211563 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecf0150090 0x7fecf0156c80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fecec009e50 tx=0x7fecec02a6c0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.953+0000 7fecf74df640 1 -- 172.21.15.77:0/1067211563 shutdown_connections 2024-04-25T01:40:07.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.953+0000 7fecf74df640 1 --2- 172.21.15.77:0/1067211563 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fecf00c8200 0x7fecf00c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.953+0000 7fecf74df640 1 --2- 172.21.15.77:0/1067211563 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecf0150090 0x7fecf0156c80 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.953+0000 7fecf74df640 1 -- 172.21.15.77:0/1067211563 >> 172.21.15.77:0/1067211563 conn(0x7fecf00ad4d0 msgr2=0x7fecf00ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:07.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.953+0000 7fecf74df640 1 -- 172.21.15.77:0/1067211563 shutdown_connections 2024-04-25T01:40:07.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.953+0000 7fecf74df640 1 -- 172.21.15.77:0/1067211563 wait complete. 2024-04-25T01:40:07.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.954+0000 7fecf74df640 1 Processor -- start 2024-04-25T01:40:07.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.954+0000 7fecf74df640 1 -- start start 2024-04-25T01:40:07.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.955+0000 7fecf74df640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fecf006c280 0x7fecf01506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:07.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.955+0000 7fecf74df640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecf00c8200 0x7fecf00c4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:07.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.955+0000 7fecf74df640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fecf0150090 0x7fecf01eb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:07.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.955+0000 7fecf74df640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fecf00c86b0 con 0x7fecf00c8200 2024-04-25T01:40:07.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.955+0000 7fecf74df640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fecf006bd60 con 0x7fecf006c280 2024-04-25T01:40:07.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.955+0000 7fecf74df640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fecf00c6a30 con 0x7fecf0150090 2024-04-25T01:40:07.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.955+0000 7fecf4a7a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecf00c8200 0x7fecf00c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:07.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.955+0000 7fecf4a7a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecf00c8200 0x7fecf00c4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44864/0 (socket says 172.21.15.77:44864) 2024-04-25T01:40:07.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.955+0000 7fecf4a7a640 1 -- 172.21.15.77:0/2909468368 learned_addr learned my addr 172.21.15.77:0/2909468368 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:07.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.955+0000 7fecf527b640 1 --2- 172.21.15.77:0/2909468368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fecf006c280 0x7fecf01506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:07.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.955+0000 7fecf5a7c640 1 --2- 172.21.15.77:0/2909468368 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fecf0150090 0x7fecf01eb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:07.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.955+0000 7fecf4a7a640 1 -- 172.21.15.77:0/2909468368 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fecf0150090 msgr2=0x7fecf01eb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:07.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.955+0000 7fecf4a7a640 1 --2- 172.21.15.77:0/2909468368 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fecf0150090 0x7fecf01eb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.955+0000 7fecf4a7a640 1 -- 172.21.15.77:0/2909468368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fecf006c280 msgr2=0x7fecf01506e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:07.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.955+0000 7fecf4a7a640 1 --2- 172.21.15.77:0/2909468368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fecf006c280 0x7fecf01506e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:07.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.955+0000 7fecf4a7a640 1 -- 172.21.15.77:0/2909468368 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf00c3ea0 con 0x7fecf00c8200 2024-04-25T01:40:07.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.955+0000 7fecf4a7a640 1 --2- 172.21.15.77:0/2909468368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecf00c8200 0x7fecf00c4990 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fece000d800 tx=0x7fece000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:07.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.956+0000 7fece5ffb640 1 -- 172.21.15.77:0/2909468368 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece000b6c0 con 0x7fecf00c8200 2024-04-25T01:40:07.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.956+0000 7fece5ffb640 1 -- 172.21.15.77:0/2909468368 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece0019070 con 0x7fecf00c8200 2024-04-25T01:40:07.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.956+0000 7fecf74df640 1 -- 172.21.15.77:0/2909468368 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecf00c4140 con 0x7fecf00c8200 2024-04-25T01:40:07.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.956+0000 7fece5ffb640 1 -- 172.21.15.77:0/2909468368 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece000ba80 con 0x7fecf00c8200 2024-04-25T01:40:07.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.956+0000 7fecf74df640 1 -- 172.21.15.77:0/2909468368 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecf01583e0 con 0x7fecf00c8200 2024-04-25T01:40:07.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.957+0000 7fecf74df640 1 -- 172.21.15.77:0/2909468368 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecf01581e0 con 0x7fecf00c8200 2024-04-25T01:40:07.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.957+0000 7fece5ffb640 1 -- 172.21.15.77:0/2909468368 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fece000bc20 con 0x7fecf00c8200 2024-04-25T01:40:07.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.957+0000 7fece5ffb640 1 --2- 172.21.15.77:0/2909468368 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fecd406be30 0x7fecd406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:07.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.958+0000 7fece5ffb640 1 -- 172.21.15.77:0/2909468368 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6637+0+0 (secure 0 0 0) 0x7fece008b4c0 con 0x7fecf00c8200 2024-04-25T01:40:07.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.958+0000 7fecf527b640 1 --2- 172.21.15.77:0/2909468368 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fecd406be30 0x7fecd406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:07.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.958+0000 7fecf527b640 1 --2- 172.21.15.77:0/2909468368 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fecd406be30 0x7fecd406e2f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fecec033000 tx=0x7fecec009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:07.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:07.962+0000 7fece5ffb640 1 -- 172.21.15.77:0/2909468368 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fece0059510 con 0x7fecf00c8200 2024-04-25T01:40:08.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:08.136+0000 7fecf74df640 1 -- 172.21.15.77:0/2909468368 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fecf006cec0 con 0x7fecf00c8200 2024-04-25T01:40:08.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:08.138+0000 7fece5ffb640 1 -- 172.21.15.77:0/2909468368 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+20519 (secure 0 0 0) 0x7fece005d810 con 0x7fecf00c8200 2024-04-25T01:40:08.122 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:40:08.122 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":26,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:40:05.548440+0000","last_up_change":"2024-04-25T01:39:10.729600+0000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T01:39:11.681151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T01:39:21.606752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T01:39:22.677664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T01:39:30.501700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T01:39:31.740717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6811","nonce":3366980158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6817","nonce":3366980158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6828","nonce":3366980158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6825","nonce":3366980158}]},"public_addr":"172.21.15.77:6811/3366980158","cluster_addr":"172.21.15.77:6817/3366980158","heartbeat_back_addr":"172.21.15.77:6828/3366980158","heartbeat_front_addr":"172.21.15.77:6825/3366980158","state":["exists","up"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6801","nonce":3971619298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6803","nonce":3971619298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6807","nonce":3971619298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6805","nonce":3971619298}]},"public_addr":"172.21.15.77:6801/3971619298","cluster_addr":"172.21.15.77:6803/3971619298","heartbeat_back_addr":"172.21.15.77:6807/3971619298","heartbeat_front_addr":"172.21.15.77:6805/3971619298","state":["exists","up"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6810","nonce":4103452689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6813","nonce":4103452689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6823","nonce":4103452689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6818","nonce":4103452689}]},"public_addr":"172.21.15.77:6810/4103452689","cluster_addr":"172.21.15.77:6813/4103452689","heartbeat_back_addr":"172.21.15.77:6823/4103452689","heartbeat_front_addr":"172.21.15.77:6818/4103452689","state":["exists","up"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6819","nonce":217398906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6824","nonce":217398906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6831","nonce":217398906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6829","nonce":217398906}]},"public_addr":"172.21.15.77:6819/217398906","cluster_addr":"172.21.15.77:6824/217398906","heartbeat_back_addr":"172.21.15.77:6831/217398906","heartbeat_front_addr":"172.21.15.77:6829/217398906","state":["exists","up"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6801","nonce":2565483070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6803","nonce":2565483070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6810","nonce":2565483070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6806","nonce":2565483070}]},"public_addr":"172.21.15.121:6801/2565483070","cluster_addr":"172.21.15.121:6803/2565483070","heartbeat_back_addr":"172.21.15.121:6810/2565483070","heartbeat_front_addr":"172.21.15.121:6806/2565483070","state":["exists","up"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6807","nonce":2785294752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6809","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6811","nonce":2785294752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6815","nonce":2785294752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6813","nonce":2785294752}]},"public_addr":"172.21.15.121:6807/2785294752","cluster_addr":"172.21.15.121:6811/2785294752","heartbeat_back_addr":"172.21.15.121:6815/2785294752","heartbeat_front_addr":"172.21.15.121:6813/2785294752","state":["exists","up"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6820","nonce":523906818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6824","nonce":523906818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6831","nonce":523906818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6828","nonce":523906818}]},"public_addr":"172.21.15.121:6820/523906818","cluster_addr":"172.21.15.121:6824/523906818","heartbeat_back_addr":"172.21.15.121:6831/523906818","heartbeat_front_addr":"172.21.15.121:6828/523906818","state":["exists","up"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6817","nonce":1683602459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6819","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6821","nonce":1683602459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6829","nonce":1683602459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6823","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6825","nonce":1683602459}]},"public_addr":"172.21.15.121:6817/1683602459","cluster_addr":"172.21.15.121:6821/1683602459","heartbeat_back_addr":"172.21.15.121:6829/1683602459","heartbeat_front_addr":"172.21.15.121:6825/1683602459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.839443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.818842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.776243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.793085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.822396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.907311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.918374+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.848430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:40:08.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:08.140+0000 7fecf74df640 1 -- 172.21.15.77:0/2909468368 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fecd406be30 msgr2=0x7fecd406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:08.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:08.140+0000 7fecf74df640 1 --2- 172.21.15.77:0/2909468368 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fecd406be30 0x7fecd406e2f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fecec033000 tx=0x7fecec009000 comp rx=0 tx=0).stop 2024-04-25T01:40:08.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:08.140+0000 7fecf74df640 1 -- 172.21.15.77:0/2909468368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecf00c8200 msgr2=0x7fecf00c4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:08.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:08.140+0000 7fecf74df640 1 --2- 172.21.15.77:0/2909468368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecf00c8200 0x7fecf00c4990 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fece000d800 tx=0x7fece000dcc0 comp rx=0 tx=0).stop 2024-04-25T01:40:08.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:08.140+0000 7fecf74df640 1 -- 172.21.15.77:0/2909468368 shutdown_connections 2024-04-25T01:40:08.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:08.140+0000 7fecf74df640 1 --2- 172.21.15.77:0/2909468368 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fecd406be30 0x7fecd406e2f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:08.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:08.140+0000 7fecf74df640 1 --2- 172.21.15.77:0/2909468368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecf00c8200 0x7fecf00c4990 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:08.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:08.140+0000 7fecf74df640 1 --2- 172.21.15.77:0/2909468368 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fecf0150090 0x7fecf01eb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:08.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:08.140+0000 7fecf74df640 1 --2- 172.21.15.77:0/2909468368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fecf006c280 0x7fecf01506e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:08.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:08.140+0000 7fecf74df640 1 -- 172.21.15.77:0/2909468368 >> 172.21.15.77:0/2909468368 conn(0x7fecf00ad4d0 msgr2=0x7fecf0154960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:08.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:08.140+0000 7fecf74df640 1 -- 172.21.15.77:0/2909468368 shutdown_connections 2024-04-25T01:40:08.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:08.140+0000 7fecf74df640 1 -- 172.21.15.77:0/2909468368 wait complete. 2024-04-25T01:40:08.136 DEBUG:tasks.mds_thrash:Yielding 2024-04-25T01:40:08.136 INFO:teuthology.run_tasks:Running task workunit... 2024-04-25T01:40:08.148 INFO:tasks.workunit:Pulling workunits from ref d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T01:40:08.149 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-25T01:40:08.149 INFO:tasks.workunit:timeout=3h 2024-04-25T01:40:08.149 INFO:tasks.workunit:cleanup=True 2024-04-25T01:40:08.149 DEBUG:teuthology.orchestra.run.smithi077:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-25T01:40:08.150 INFO:tasks.mds_thrash.fs.[b]:starting mds_do_thrash for fs b 2024-04-25T01:40:08.150 INFO:tasks.mds_thrash.fs.[b]:waiting for 33 secs before thrashing 2024-04-25T01:40:08.166 INFO:teuthology.orchestra.run.smithi077.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-25T01:40:08.166 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-25T01:40:08.166 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 2bh/43d Inode: 1 Links: 2 2024-04-25T01:40:08.166 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T01:40:08.166 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-25T01:40:08.166 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-25T01:40:08.166 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-04-25 01:39:24.379277598 +0000 2024-04-25T01:40:08.166 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-04-25 01:39:55.730439276 +0000 2024-04-25T01:40:08.166 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-04-25 01:39:24.379277598 +0000 2024-04-25T01:40:08.166 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-25T01:40:08.167 DEBUG:teuthology.orchestra.run.smithi077:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-25T01:40:08.233 DEBUG:teuthology.orchestra.run.smithi121:> stat -- /home/ubuntu/cephtest/mnt.1 2024-04-25T01:40:08.251 INFO:teuthology.orchestra.run.smithi121.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-04-25T01:40:08.252 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-25T01:40:08.252 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 2bh/43d Inode: 1 Links: 2 2024-04-25T01:40:08.252 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T01:40:08.252 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-25T01:40:08.252 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-25T01:40:08.252 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-04-25 01:39:33.414617533 +0000 2024-04-25T01:40:08.252 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-04-25 01:39:58.006404031 +0000 2024-04-25T01:40:08.252 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-04-25 01:39:33.414617533 +0000 2024-04-25T01:40:08.252 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-04-25T01:40:08.252 DEBUG:teuthology.orchestra.run.smithi121:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-04-25T01:40:08.324 DEBUG:teuthology.orchestra.run.smithi077:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T01:40:08.325 DEBUG:teuthology.orchestra.run.smithi121:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T01:40:08.340 INFO:tasks.workunit.client.0.smithi077.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-25T01:40:08.382 INFO:tasks.workunit.client.1.smithi121.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-04-25T01:40:19.237 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:40:19.240 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:40:41.152 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:40:41.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.278+0000 7f9e853e7640 1 Processor -- start 2024-04-25T01:40:41.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.278+0000 7f9e853e7640 1 -- start start 2024-04-25T01:40:41.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.278+0000 7f9e853e7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e80150320 0x7f9e80156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:41.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.278+0000 7f9e853e7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9e8006d4e0 0x7f9e80154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:41.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.278+0000 7f9e853e7640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e80153be0 con 0x7f9e8006d0a0 2024-04-25T01:40:41.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.278+0000 7f9e853e7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9e80152fd0 con 0x7f9e8006d4e0 2024-04-25T01:40:41.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.278+0000 7f9e853e7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9e801532b0 con 0x7f9e80150320 2024-04-25T01:40:41.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.279+0000 7f9e7f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9e8006d4e0 0x7f9e80154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:41.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.279+0000 7f9e7f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9e8006d4e0 0x7f9e80154a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34634/0 (socket says 172.21.15.77:34634) 2024-04-25T01:40:41.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.279+0000 7f9e7f7fe640 1 -- 172.21.15.77:0/3465548601 learned_addr learned my addr 172.21.15.77:0/3465548601 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:41.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.279+0000 7f9e7effd640 1 --2- 172.21.15.77:0/3465548601 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e80150320 0x7f9e80156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:41.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.279+0000 7f9e7f7fe640 1 -- 172.21.15.77:0/3465548601 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e80150320 msgr2=0x7f9e80156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:41.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.279+0000 7f9e7f7fe640 1 --2- 172.21.15.77:0/3465548601 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e80150320 0x7f9e80156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:41.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.279+0000 7f9e7f7fe640 1 -- 172.21.15.77:0/3465548601 >> v1:172.21.15.121:6789/0 conn(0x7f9e8006d0a0 legacy=0x7f9e80154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:41.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.279+0000 7f9e7f7fe640 1 -- 172.21.15.77:0/3465548601 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e80157100 con 0x7f9e8006d4e0 2024-04-25T01:40:41.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.279+0000 7f9e7effd640 1 --2- 172.21.15.77:0/3465548601 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e80150320 0x7f9e80156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:40:41.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.280+0000 7f9e7f7fe640 1 --2- 172.21.15.77:0/3465548601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e8006d4e0 0x7f9e80154a90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9e7800d150 tx=0x7f9e7802c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80dbffbbd3a3cd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:41.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.280+0000 7f9e7dffb640 1 -- 172.21.15.77:0/3465548601 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e78009600 con 0x7f9e8006d4e0 2024-04-25T01:40:41.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.280+0000 7f9e7dffb640 1 -- 172.21.15.77:0/3465548601 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e78037070 con 0x7f9e8006d4e0 2024-04-25T01:40:41.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.280+0000 7f9e7dffb640 1 -- 172.21.15.77:0/3465548601 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e780099c0 con 0x7f9e8006d4e0 2024-04-25T01:40:41.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.280+0000 7f9e853e7640 1 -- 172.21.15.77:0/3465548601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e8006d4e0 msgr2=0x7f9e80154a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:41.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.280+0000 7f9e853e7640 1 --2- 172.21.15.77:0/3465548601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e8006d4e0 0x7f9e80154a90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9e7800d150 tx=0x7f9e7802c930 comp rx=0 tx=0).stop 2024-04-25T01:40:41.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.280+0000 7f9e853e7640 1 -- 172.21.15.77:0/3465548601 shutdown_connections 2024-04-25T01:40:41.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.280+0000 7f9e853e7640 1 --2- 172.21.15.77:0/3465548601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e8006d4e0 0x7f9e80154a90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:41.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.280+0000 7f9e853e7640 1 --2- 172.21.15.77:0/3465548601 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e80150320 0x7f9e80156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:41.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.280+0000 7f9e853e7640 1 -- 172.21.15.77:0/3465548601 >> 172.21.15.77:0/3465548601 conn(0x7f9e800c3f80 msgr2=0x7f9e800c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:41.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.280+0000 7f9e853e7640 1 -- 172.21.15.77:0/3465548601 shutdown_connections 2024-04-25T01:40:41.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.280+0000 7f9e853e7640 1 -- 172.21.15.77:0/3465548601 wait complete. 2024-04-25T01:40:41.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.282+0000 7f9e853e7640 1 Processor -- start 2024-04-25T01:40:41.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.282+0000 7f9e853e7640 1 -- start start 2024-04-25T01:40:41.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.282+0000 7f9e853e7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e8006d0a0 0x7f9e800ab2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:41.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.282+0000 7f9e853e7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e8006d4e0 0x7f9e80140be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:41.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.282+0000 7f9e853e7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e80150320 0x7f9e80141120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:41.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.282+0000 7f9e853e7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9e80154fd0 con 0x7f9e8006d0a0 2024-04-25T01:40:41.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.282+0000 7f9e853e7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9e80153870 con 0x7f9e80150320 2024-04-25T01:40:41.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.282+0000 7f9e853e7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9e80152bf0 con 0x7f9e8006d4e0 2024-04-25T01:40:41.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.283+0000 7f9e7effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e8006d0a0 0x7f9e800ab2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:41.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.283+0000 7f9e7effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e8006d0a0 0x7f9e800ab2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34636/0 (socket says 172.21.15.77:34636) 2024-04-25T01:40:41.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.283+0000 7f9e7effd640 1 -- 172.21.15.77:0/3715020030 learned_addr learned my addr 172.21.15.77:0/3715020030 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:41.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.283+0000 7f9e7f7fe640 1 --2- 172.21.15.77:0/3715020030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e80150320 0x7f9e80141120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:41.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.283+0000 7f9e7e7fc640 1 --2- 172.21.15.77:0/3715020030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e8006d4e0 0x7f9e80140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:41.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.283+0000 7f9e7effd640 1 -- 172.21.15.77:0/3715020030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e8006d4e0 msgr2=0x7f9e80140be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:41.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.283+0000 7f9e7effd640 1 --2- 172.21.15.77:0/3715020030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e8006d4e0 0x7f9e80140be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:41.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.283+0000 7f9e7effd640 1 -- 172.21.15.77:0/3715020030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e80150320 msgr2=0x7f9e80141120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:41.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.283+0000 7f9e7effd640 1 --2- 172.21.15.77:0/3715020030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e80150320 0x7f9e80141120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:41.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.283+0000 7f9e7effd640 1 -- 172.21.15.77:0/3715020030 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8014e830 con 0x7f9e8006d0a0 2024-04-25T01:40:41.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.283+0000 7f9e7f7fe640 1 --2- 172.21.15.77:0/3715020030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e80150320 0x7f9e80141120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:40:41.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.283+0000 7f9e7e7fc640 1 --2- 172.21.15.77:0/3715020030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e8006d4e0 0x7f9e80140be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:40:41.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.283+0000 7f9e7effd640 1 --2- 172.21.15.77:0/3715020030 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e8006d0a0 0x7f9e800ab2d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000e810 tx=0x7f9e7000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:41.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.283+0000 7f9e677fe640 1 -- 172.21.15.77:0/3715020030 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7000f040 con 0x7f9e8006d0a0 2024-04-25T01:40:41.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.283+0000 7f9e677fe640 1 -- 172.21.15.77:0/3715020030 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e70004030 con 0x7f9e8006d0a0 2024-04-25T01:40:41.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.283+0000 7f9e677fe640 1 -- 172.21.15.77:0/3715020030 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e70004400 con 0x7f9e8006d0a0 2024-04-25T01:40:41.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.283+0000 7f9e853e7640 1 -- 172.21.15.77:0/3715020030 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e8014eb10 con 0x7f9e8006d0a0 2024-04-25T01:40:41.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.283+0000 7f9e853e7640 1 -- 172.21.15.77:0/3715020030 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e800ab810 con 0x7f9e8006d0a0 2024-04-25T01:40:41.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.284+0000 7f9e853e7640 1 -- 172.21.15.77:0/3715020030 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e8004f500 con 0x7f9e8006d0a0 2024-04-25T01:40:41.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.285+0000 7f9e677fe640 1 -- 172.21.15.77:0/3715020030 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e7000c6d0 con 0x7f9e8006d0a0 2024-04-25T01:40:41.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.285+0000 7f9e677fe640 1 --2- 172.21.15.77:0/3715020030 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9e6c06be30 0x7f9e6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:41.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.285+0000 7f9e677fe640 1 -- 172.21.15.77:0/3715020030 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6637+0+0 (secure 0 0 0) 0x7f9e7008af60 con 0x7f9e8006d0a0 2024-04-25T01:40:41.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.285+0000 7f9e7e7fc640 1 --2- 172.21.15.77:0/3715020030 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9e6c06be30 0x7f9e6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:41.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.286+0000 7f9e7e7fc640 1 --2- 172.21.15.77:0/3715020030 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9e6c06be30 0x7f9e6c06e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9e801570d0 tx=0x7f9e74009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:41.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.290+0000 7f9e677fe640 1 -- 172.21.15.77:0/3715020030 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9e70017020 con 0x7f9e8006d0a0 2024-04-25T01:40:41.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.499+0000 7f9e853e7640 1 -- 172.21.15.77:0/3715020030 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e8014fb40 con 0x7f9e8006d0a0 2024-04-25T01:40:41.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.499+0000 7f9e677fe640 1 -- 172.21.15.77:0/3715020030 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6488 (secure 0 0 0) 0x7f9e70059600 con 0x7f9e8006d0a0 2024-04-25T01:40:41.485 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:40:41.485 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:39:36.787357+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6837/3454203695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3454203695},{"type":"v1","addr":"172.21.15.77:6837","nonce":3454203695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-04-25T01:40:41.486 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 12 2024-04-25T01:40:41.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.501+0000 7f9e853e7640 1 -- 172.21.15.77:0/3715020030 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9e6c06be30 msgr2=0x7f9e6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:41.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.501+0000 7f9e853e7640 1 --2- 172.21.15.77:0/3715020030 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9e6c06be30 0x7f9e6c06e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9e801570d0 tx=0x7f9e74009040 comp rx=0 tx=0).stop 2024-04-25T01:40:41.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.501+0000 7f9e853e7640 1 -- 172.21.15.77:0/3715020030 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e8006d0a0 msgr2=0x7f9e800ab2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:41.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.501+0000 7f9e853e7640 1 --2- 172.21.15.77:0/3715020030 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e8006d0a0 0x7f9e800ab2d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000e810 tx=0x7f9e7000ecd0 comp rx=0 tx=0).stop 2024-04-25T01:40:41.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.501+0000 7f9e853e7640 1 -- 172.21.15.77:0/3715020030 shutdown_connections 2024-04-25T01:40:41.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.501+0000 7f9e853e7640 1 --2- 172.21.15.77:0/3715020030 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9e6c06be30 0x7f9e6c06e2f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:41.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.501+0000 7f9e853e7640 1 --2- 172.21.15.77:0/3715020030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e80150320 0x7f9e80141120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:41.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.501+0000 7f9e853e7640 1 --2- 172.21.15.77:0/3715020030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e8006d4e0 0x7f9e80140be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:41.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.501+0000 7f9e853e7640 1 --2- 172.21.15.77:0/3715020030 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e8006d0a0 0x7f9e800ab2d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:41.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.501+0000 7f9e853e7640 1 -- 172.21.15.77:0/3715020030 >> 172.21.15.77:0/3715020030 conn(0x7f9e800c3f80 msgr2=0x7f9e80156350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:41.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.502+0000 7f9e853e7640 1 -- 172.21.15.77:0/3715020030 shutdown_connections 2024-04-25T01:40:41.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.502+0000 7f9e853e7640 1 -- 172.21.15.77:0/3715020030 wait complete. 2024-04-25T01:40:41.499 INFO:tasks.mds_thrash.fs.[b]:kill mds.c (rank=0) 2024-04-25T01:40:41.499 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T01:40:41.500 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T01:40:41.509 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T01:40:41.510 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:40:41.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.663+0000 7fe1134ee640 1 Processor -- start 2024-04-25T01:40:41.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.663+0000 7fe1134ee640 1 -- start start 2024-04-25T01:40:41.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.664+0000 7fe1134ee640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe10c150090 0x7fe10c156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:41.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.664+0000 7fe1134ee640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe10c0c8200 0x7fe10c0c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:41.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.664+0000 7fe1134ee640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe10c06c280 0x7fe10c0c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:41.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.664+0000 7fe1134ee640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe10c06b830 con 0x7fe10c06c280 2024-04-25T01:40:41.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.664+0000 7fe1134ee640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fe10c0c9de0 con 0x7fe10c0c8200 2024-04-25T01:40:41.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.664+0000 7fe1134ee640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe10c0c89c0 con 0x7fe10c150090 2024-04-25T01:40:41.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.664+0000 7fe111a8b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe10c06c280 0x7fe10c0c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:41.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.664+0000 7fe111a8b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe10c06c280 0x7fe10c0c6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34646/0 (socket says 172.21.15.77:34646) 2024-04-25T01:40:41.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.664+0000 7fe111a8b640 1 -- 172.21.15.77:0/1009404502 learned_addr learned my addr 172.21.15.77:0/1009404502 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:41.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.665+0000 7fe110a89640 1 --2- 172.21.15.77:0/1009404502 >> v2:172.21.15.121:3300/0 conn(0x7fe10c0c8200 0x7fe10c0c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:41.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.665+0000 7fe11128a640 1 --2- 172.21.15.77:0/1009404502 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe10c150090 0x7fe10c156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:41.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.665+0000 7fe111a8b640 1 -- 172.21.15.77:0/1009404502 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe10c150090 msgr2=0x7fe10c156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:41.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.665+0000 7fe111a8b640 1 --2- 172.21.15.77:0/1009404502 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe10c150090 0x7fe10c156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:41.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.665+0000 7fe111a8b640 1 -- 172.21.15.77:0/1009404502 >> v2:172.21.15.121:3300/0 conn(0x7fe10c0c8200 msgr2=0x7fe10c0c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:41.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.665+0000 7fe111a8b640 1 --2- 172.21.15.77:0/1009404502 >> v2:172.21.15.121:3300/0 conn(0x7fe10c0c8200 0x7fe10c0c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:41.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.665+0000 7fe111a8b640 1 -- 172.21.15.77:0/1009404502 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10c0c8ca0 con 0x7fe10c06c280 2024-04-25T01:40:41.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.665+0000 7fe111a8b640 1 --2- 172.21.15.77:0/1009404502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe10c06c280 0x7fe10c0c6320 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe10c0ae0a0 tx=0x7fe10402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d6965ef4fccabc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:41.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.665+0000 7fe103fff640 1 -- 172.21.15.77:0/1009404502 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe104037070 con 0x7fe10c06c280 2024-04-25T01:40:41.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.665+0000 7fe103fff640 1 -- 172.21.15.77:0/1009404502 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe104032440 con 0x7fe10c06c280 2024-04-25T01:40:41.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.665+0000 7fe103fff640 1 -- 172.21.15.77:0/1009404502 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe104032810 con 0x7fe10c06c280 2024-04-25T01:40:41.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.666+0000 7fe1134ee640 1 -- 172.21.15.77:0/1009404502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe10c06c280 msgr2=0x7fe10c0c6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:41.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.666+0000 7fe1134ee640 1 --2- 172.21.15.77:0/1009404502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe10c06c280 0x7fe10c0c6320 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe10c0ae0a0 tx=0x7fe10402a1e0 comp rx=0 tx=0).stop 2024-04-25T01:40:41.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.666+0000 7fe1134ee640 1 -- 172.21.15.77:0/1009404502 shutdown_connections 2024-04-25T01:40:41.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.666+0000 7fe1134ee640 1 --2- 172.21.15.77:0/1009404502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe10c06c280 0x7fe10c0c6320 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:41.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.666+0000 7fe1134ee640 1 --2- 172.21.15.77:0/1009404502 >> v2:172.21.15.121:3300/0 conn(0x7fe10c0c8200 0x7fe10c0c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:41.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.666+0000 7fe1134ee640 1 --2- 172.21.15.77:0/1009404502 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe10c150090 0x7fe10c156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:41.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.666+0000 7fe1134ee640 1 -- 172.21.15.77:0/1009404502 >> 172.21.15.77:0/1009404502 conn(0x7fe10c0ad4d0 msgr2=0x7fe10c0ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:41.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.666+0000 7fe1134ee640 1 -- 172.21.15.77:0/1009404502 shutdown_connections 2024-04-25T01:40:41.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.666+0000 7fe1134ee640 1 -- 172.21.15.77:0/1009404502 wait complete. 2024-04-25T01:40:41.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.667+0000 7fe1134ee640 1 Processor -- start 2024-04-25T01:40:41.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.667+0000 7fe1134ee640 1 -- start start 2024-04-25T01:40:41.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.668+0000 7fe1134ee640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe10c06c280 0x7fe10c1585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:41.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.668+0000 7fe1134ee640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe10c0c8200 0x7fe10c158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:41.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.668+0000 7fe1134ee640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe10c150090 0x7fe10c0c16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:41.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.668+0000 7fe1134ee640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe10c0c8680 con 0x7fe10c0c8200 2024-04-25T01:40:41.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.668+0000 7fe1134ee640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe10c06bd60 con 0x7fe10c06c280 2024-04-25T01:40:41.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.668+0000 7fe1134ee640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe10c06c6b0 con 0x7fe10c150090 2024-04-25T01:40:41.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.668+0000 7fe110a89640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe10c0c8200 0x7fe10c158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:41.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.668+0000 7fe110a89640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe10c0c8200 0x7fe10c158af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34654/0 (socket says 172.21.15.77:34654) 2024-04-25T01:40:41.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.668+0000 7fe110a89640 1 -- 172.21.15.77:0/3585416822 learned_addr learned my addr 172.21.15.77:0/3585416822 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:41.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.668+0000 7fe11128a640 1 --2- 172.21.15.77:0/3585416822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe10c06c280 0x7fe10c1585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:41.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.668+0000 7fe111a8b640 1 --2- 172.21.15.77:0/3585416822 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe10c150090 0x7fe10c0c16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:41.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.668+0000 7fe110a89640 1 -- 172.21.15.77:0/3585416822 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe10c150090 msgr2=0x7fe10c0c16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:41.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.668+0000 7fe110a89640 1 --2- 172.21.15.77:0/3585416822 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe10c150090 0x7fe10c0c16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:41.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.668+0000 7fe110a89640 1 -- 172.21.15.77:0/3585416822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe10c06c280 msgr2=0x7fe10c1585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:41.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.668+0000 7fe110a89640 1 --2- 172.21.15.77:0/3585416822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe10c06c280 0x7fe10c1585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:41.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.668+0000 7fe110a89640 1 -- 172.21.15.77:0/3585416822 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10c0c57a0 con 0x7fe10c0c8200 2024-04-25T01:40:41.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.669+0000 7fe110a89640 1 --2- 172.21.15.77:0/3585416822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe10c0c8200 0x7fe10c158af0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc00d830 tx=0x7fe0fc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:41.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.669+0000 7fe101ffb640 1 -- 172.21.15.77:0/3585416822 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc018030 con 0x7fe10c0c8200 2024-04-25T01:40:41.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.669+0000 7fe101ffb640 1 -- 172.21.15.77:0/3585416822 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0fc00be10 con 0x7fe10c0c8200 2024-04-25T01:40:41.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.669+0000 7fe1134ee640 1 -- 172.21.15.77:0/3585416822 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe10c0c5a80 con 0x7fe10c0c8200 2024-04-25T01:40:41.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.669+0000 7fe101ffb640 1 -- 172.21.15.77:0/3585416822 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc0098b0 con 0x7fe10c0c8200 2024-04-25T01:40:41.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.669+0000 7fe1134ee640 1 -- 172.21.15.77:0/3585416822 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe10c1ecbf0 con 0x7fe10c0c8200 2024-04-25T01:40:41.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.670+0000 7fe1134ee640 1 -- 172.21.15.77:0/3585416822 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe10c068d20 con 0x7fe10c0c8200 2024-04-25T01:40:41.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.670+0000 7fe101ffb640 1 -- 172.21.15.77:0/3585416822 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe0fc01b070 con 0x7fe10c0c8200 2024-04-25T01:40:41.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.671+0000 7fe101ffb640 1 --2- 172.21.15.77:0/3585416822 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe0f006be30 0x7fe0f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:41.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.671+0000 7fe101ffb640 1 -- 172.21.15.77:0/3585416822 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6637+0+0 (secure 0 0 0) 0x7fe0fc08b2a0 con 0x7fe10c0c8200 2024-04-25T01:40:41.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.671+0000 7fe11128a640 1 --2- 172.21.15.77:0/3585416822 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe0f006be30 0x7fe0f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:41.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.671+0000 7fe11128a640 1 --2- 172.21.15.77:0/3585416822 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe0f006be30 0x7fe0f006e2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe108003aa0 tx=0x7fe108009830 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:41.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.675+0000 7fe101ffb640 1 -- 172.21.15.77:0/3585416822 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe10c068d20 con 0x7fe10c0c8200 2024-04-25T01:40:41.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.883+0000 7fe1134ee640 1 -- 172.21.15.77:0/3585416822 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe10c04f500 con 0x7fe10c0c8200 2024-04-25T01:40:41.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.884+0000 7fe101ffb640 1 -- 172.21.15.77:0/3585416822 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6488 (secure 0 0 0) 0x7fe0fc059260 con 0x7fe10c0c8200 2024-04-25T01:40:41.869 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:40:41.869 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:39:36.787357+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6837/3454203695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3454203695},{"type":"v1","addr":"172.21.15.77:6837","nonce":3454203695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-04-25T01:40:41.870 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 12 2024-04-25T01:40:41.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.886+0000 7fe1134ee640 1 -- 172.21.15.77:0/3585416822 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe0f006be30 msgr2=0x7fe0f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:41.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.886+0000 7fe1134ee640 1 --2- 172.21.15.77:0/3585416822 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe0f006be30 0x7fe0f006e2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe108003aa0 tx=0x7fe108009830 comp rx=0 tx=0).stop 2024-04-25T01:40:41.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.886+0000 7fe1134ee640 1 -- 172.21.15.77:0/3585416822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe10c0c8200 msgr2=0x7fe10c158af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:41.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.886+0000 7fe1134ee640 1 --2- 172.21.15.77:0/3585416822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe10c0c8200 0x7fe10c158af0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc00d830 tx=0x7fe0fc00dcf0 comp rx=0 tx=0).stop 2024-04-25T01:40:41.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.886+0000 7fe1134ee640 1 -- 172.21.15.77:0/3585416822 shutdown_connections 2024-04-25T01:40:41.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.886+0000 7fe1134ee640 1 --2- 172.21.15.77:0/3585416822 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe0f006be30 0x7fe0f006e2f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:41.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.886+0000 7fe1134ee640 1 --2- 172.21.15.77:0/3585416822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe10c0c8200 0x7fe10c158af0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:41.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.886+0000 7fe1134ee640 1 --2- 172.21.15.77:0/3585416822 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe10c150090 0x7fe10c0c16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:41.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.886+0000 7fe1134ee640 1 --2- 172.21.15.77:0/3585416822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe10c06c280 0x7fe10c1585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:41.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.886+0000 7fe1134ee640 1 -- 172.21.15.77:0/3585416822 >> 172.21.15.77:0/3585416822 conn(0x7fe10c0ad4d0 msgr2=0x7fe10c0c6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:41.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.886+0000 7fe1134ee640 1 -- 172.21.15.77:0/3585416822 shutdown_connections 2024-04-25T01:40:41.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:41.886+0000 7fe1134ee640 1 -- 172.21.15.77:0/3585416822 wait complete. 2024-04-25T01:40:41.882 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T01:40:43.883 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:40:43.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.006+0000 7f14ef0a5640 1 Processor -- start 2024-04-25T01:40:43.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.006+0000 7f14ef0a5640 1 -- start start 2024-04-25T01:40:43.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.006+0000 7f14ef0a5640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f14e806d4e0 0x7f14e8154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:43.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.006+0000 7f14ef0a5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14e8153be0 con 0x7f14e8150320 2024-04-25T01:40:43.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.006+0000 7f14ef0a5640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14e8152fd0 con 0x7f14e806d0a0 2024-04-25T01:40:43.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.006+0000 7f14ef0a5640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f14e81532b0 con 0x7f14e806d4e0 2024-04-25T01:40:43.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.007+0000 7f14ece41640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f14e8150320 0x7f14e8156bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:34656/0 (socket says 172.21.15.77:34656) 2024-04-25T01:40:43.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.007+0000 7f14ece41640 1 -- 172.21.15.77:0/986294089 learned_addr learned my addr 172.21.15.77:0/986294089 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:40:43.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.007+0000 7f14ed642640 1 --2- 172.21.15.77:0/986294089 >> v2:172.21.15.121:3300/0 conn(0x7f14e806d4e0 0x7f14e8154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:43.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.007+0000 7f14e77fe640 1 -- 172.21.15.77:0/986294089 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3721835771 0 0) 0x7f14e8153be0 con 0x7f14e8150320 2024-04-25T01:40:43.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.007+0000 7f14e77fe640 1 -- 172.21.15.77:0/986294089 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14d4003520 con 0x7f14e8150320 2024-04-25T01:40:43.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.007+0000 7f14e77fe640 1 -- 172.21.15.77:0/986294089 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2359263609 0 0) 0x7f14d4003520 con 0x7f14e8150320 2024-04-25T01:40:43.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.007+0000 7f14e77fe640 1 -- 172.21.15.77:0/986294089 >> v2:172.21.15.121:3300/0 conn(0x7f14e806d4e0 msgr2=0x7f14e8154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:43.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.007+0000 7f14e77fe640 1 --2- 172.21.15.77:0/986294089 >> v2:172.21.15.121:3300/0 conn(0x7f14e806d4e0 0x7f14e8154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:43.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.007+0000 7f14e77fe640 1 -- 172.21.15.77:0/986294089 >> v1:172.21.15.121:6789/0 conn(0x7f14e806d0a0 legacy=0x7f14e8154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:43.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.007+0000 7f14e77fe640 1 -- 172.21.15.77:0/986294089 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e8153590 con 0x7f14e8150320 2024-04-25T01:40:43.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.007+0000 7f14e77fe640 1 -- 172.21.15.77:0/986294089 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7f14e00019f0 con 0x7f14e8150320 2024-04-25T01:40:43.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.007+0000 7f14e77fe640 1 -- 172.21.15.77:0/986294089 >> v1:172.21.15.77:6789/0 conn(0x7f14e8150320 legacy=0x7f14e8156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:43.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.007+0000 7f14e77fe640 1 --2- 172.21.15.77:0/986294089 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f14d40039b0 0x7f14d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:43.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.007+0000 7f14e77fe640 1 --2- 172.21.15.77:0/986294089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14d4004800 0x7f14d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:43.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.007+0000 7f14e77fe640 1 --2- 172.21.15.77:0/986294089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14d40051c0 0x7f14d400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:43.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.007+0000 7f14e77fe640 1 -- 172.21.15.77:0/986294089 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f14e81532b0 con 0x7f14d4004800 2024-04-25T01:40:43.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.007+0000 7f14e77fe640 1 -- 172.21.15.77:0/986294089 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f14d400c060 con 0x7f14d40051c0 2024-04-25T01:40:43.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.007+0000 7f14e77fe640 1 -- 172.21.15.77:0/986294089 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f14d400c260 con 0x7f14d40039b0 2024-04-25T01:40:43.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.007+0000 7f14e7fff640 1 --2- 172.21.15.77:0/986294089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14d4004800 0x7f14d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:43.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.007+0000 7f14ece41640 1 --2- 172.21.15.77:0/986294089 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f14d40039b0 0x7f14d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:43.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.007+0000 7f14ed642640 1 --2- 172.21.15.77:0/986294089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14d40051c0 0x7f14d400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:43.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.008+0000 7f14e7fff640 1 -- 172.21.15.77:0/986294089 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f14d40039b0 msgr2=0x7f14d4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:43.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.008+0000 7f14e7fff640 1 --2- 172.21.15.77:0/986294089 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f14d40039b0 0x7f14d4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:43.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.008+0000 7f14e7fff640 1 -- 172.21.15.77:0/986294089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14d40051c0 msgr2=0x7f14d400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:43.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.008+0000 7f14e7fff640 1 --2- 172.21.15.77:0/986294089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14d40051c0 0x7f14d400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:43.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.008+0000 7f14e7fff640 1 -- 172.21.15.77:0/986294089 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14d4003520 con 0x7f14d4004800 2024-04-25T01:40:43.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.008+0000 7f14ed642640 1 -- 172.21.15.77:0/986294089 reap_dead start 2024-04-25T01:40:43.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.008+0000 7f14e7fff640 1 --2- 172.21.15.77:0/986294089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14d4004800 0x7f14d4004c80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f14d0001720 tx=0x7f14d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b10adc96bc07cb71 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:43.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.008+0000 7f14e77fe640 1 -- 172.21.15.77:0/986294089 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d0001370 con 0x7f14d4004800 2024-04-25T01:40:43.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.008+0000 7f14e77fe640 1 -- 172.21.15.77:0/986294089 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d00052d0 con 0x7f14d4004800 2024-04-25T01:40:43.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.008+0000 7f14e77fe640 1 -- 172.21.15.77:0/986294089 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d002ab90 con 0x7f14d4004800 2024-04-25T01:40:43.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.009+0000 7f14ef0a5640 1 -- 172.21.15.77:0/986294089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14d4004800 msgr2=0x7f14d4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:43.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.009+0000 7f14ef0a5640 1 --2- 172.21.15.77:0/986294089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14d4004800 0x7f14d4004c80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f14d0001720 tx=0x7f14d4005830 comp rx=0 tx=0).stop 2024-04-25T01:40:43.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.009+0000 7f14ef0a5640 1 -- 172.21.15.77:0/986294089 shutdown_connections 2024-04-25T01:40:43.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.009+0000 7f14ef0a5640 1 --2- 172.21.15.77:0/986294089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14d4004800 0x7f14d4004c80 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:43.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.009+0000 7f14ef0a5640 1 -- 172.21.15.77:0/986294089 >> 172.21.15.77:0/986294089 conn(0x7f14e80c3f80 msgr2=0x7f14e80c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:43.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.009+0000 7f14ef0a5640 1 -- 172.21.15.77:0/986294089 shutdown_connections 2024-04-25T01:40:43.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.009+0000 7f14ef0a5640 1 -- 172.21.15.77:0/986294089 wait complete. 2024-04-25T01:40:44.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.010+0000 7f14ef0a5640 1 Processor -- start 2024-04-25T01:40:44.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.010+0000 7f14ef0a5640 1 -- start start 2024-04-25T01:40:44.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.011+0000 7f14ef0a5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f14d4004800 0x7f14e81ec290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:44.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.011+0000 7f14ef0a5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14e8149c90 0x7f14e814f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:44.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.011+0000 7f14ef0a5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14e814f560 0x7f14e8149260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:44.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.011+0000 7f14ef0a5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f14e8152d70 con 0x7f14e8149c90 2024-04-25T01:40:44.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.011+0000 7f14ef0a5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f14e8152bf0 con 0x7f14e814f560 2024-04-25T01:40:44.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.011+0000 7f14ef0a5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f14e80c3100 con 0x7f14d4004800 2024-04-25T01:40:44.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.011+0000 7f14e7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14e8149c90 0x7f14e814f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:44.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.011+0000 7f14e7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14e8149c90 0x7f14e814f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34682/0 (socket says 172.21.15.77:34682) 2024-04-25T01:40:44.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.011+0000 7f14e7fff640 1 -- 172.21.15.77:0/734114187 learned_addr learned my addr 172.21.15.77:0/734114187 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:44.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.011+0000 7f14ece41640 1 --2- 172.21.15.77:0/734114187 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f14d4004800 0x7f14e81ec290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:44.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.011+0000 7f14ed642640 1 --2- 172.21.15.77:0/734114187 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14e814f560 0x7f14e8149260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:44.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.011+0000 7f14e7fff640 1 -- 172.21.15.77:0/734114187 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f14d4004800 msgr2=0x7f14e81ec290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:44.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.011+0000 7f14e7fff640 1 --2- 172.21.15.77:0/734114187 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f14d4004800 0x7f14e81ec290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:44.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.011+0000 7f14e7fff640 1 -- 172.21.15.77:0/734114187 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14e814f560 msgr2=0x7f14e8149260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:44.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.011+0000 7f14e7fff640 1 --2- 172.21.15.77:0/734114187 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14e814f560 0x7f14e8149260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:44.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.011+0000 7f14e7fff640 1 -- 172.21.15.77:0/734114187 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e80aa530 con 0x7f14e8149c90 2024-04-25T01:40:44.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.012+0000 7f14e7fff640 1 --2- 172.21.15.77:0/734114187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14e8149c90 0x7f14e814f020 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f14d002a540 tx=0x7f14d0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:44.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.012+0000 7f14e57fa640 1 -- 172.21.15.77:0/734114187 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d003f030 con 0x7f14e8149c90 2024-04-25T01:40:44.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.012+0000 7f14e57fa640 1 -- 172.21.15.77:0/734114187 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d0005480 con 0x7f14e8149c90 2024-04-25T01:40:44.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.012+0000 7f14ef0a5640 1 -- 172.21.15.77:0/734114187 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14e80c13f0 con 0x7f14e8149c90 2024-04-25T01:40:44.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.012+0000 7f14e57fa640 1 -- 172.21.15.77:0/734114187 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d0037040 con 0x7f14e8149c90 2024-04-25T01:40:44.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.012+0000 7f14ef0a5640 1 -- 172.21.15.77:0/734114187 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14e80ac440 con 0x7f14e8149c90 2024-04-25T01:40:44.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.013+0000 7f14ef0a5640 1 -- 172.21.15.77:0/734114187 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14e804f500 con 0x7f14e8149c90 2024-04-25T01:40:44.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.013+0000 7f14e57fa640 1 -- 172.21.15.77:0/734114187 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f14d0042070 con 0x7f14e8149c90 2024-04-25T01:40:44.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.014+0000 7f14e57fa640 1 --2- 172.21.15.77:0/734114187 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f14c806be60 0x7f14c806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:44.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.014+0000 7f14e57fa640 1 -- 172.21.15.77:0/734114187 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6637+0+0 (secure 0 0 0) 0x7f14d00aab90 con 0x7f14e8149c90 2024-04-25T01:40:44.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.014+0000 7f14ece41640 1 --2- 172.21.15.77:0/734114187 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f14c806be60 0x7f14c806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:44.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.014+0000 7f14ece41640 1 --2- 172.21.15.77:0/734114187 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f14c806be60 0x7f14c806e320 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f14e00013d0 tx=0x7f14e0006040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:44.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.018+0000 7f14e57fa640 1 -- 172.21.15.77:0/734114187 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f14d0079180 con 0x7f14e8149c90 2024-04-25T01:40:44.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.231+0000 7f14ef0a5640 1 -- 172.21.15.77:0/734114187 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f14e8073750 con 0x7f14e8149c90 2024-04-25T01:40:44.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.232+0000 7f14e57fa640 1 -- 172.21.15.77:0/734114187 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6488 (secure 0 0 0) 0x7f14d0078a80 con 0x7f14e8149c90 2024-04-25T01:40:44.217 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:40:44.217 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:39:36.787357+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6837/3454203695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3454203695},{"type":"v1","addr":"172.21.15.77:6837","nonce":3454203695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-04-25T01:40:44.218 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 12 2024-04-25T01:40:44.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.234+0000 7f14ef0a5640 1 -- 172.21.15.77:0/734114187 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f14c806be60 msgr2=0x7f14c806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:44.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.234+0000 7f14ef0a5640 1 --2- 172.21.15.77:0/734114187 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f14c806be60 0x7f14c806e320 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f14e00013d0 tx=0x7f14e0006040 comp rx=0 tx=0).stop 2024-04-25T01:40:44.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.234+0000 7f14ef0a5640 1 -- 172.21.15.77:0/734114187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14e8149c90 msgr2=0x7f14e814f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:44.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.234+0000 7f14ef0a5640 1 --2- 172.21.15.77:0/734114187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14e8149c90 0x7f14e814f020 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f14d002a540 tx=0x7f14d0001120 comp rx=0 tx=0).stop 2024-04-25T01:40:44.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.234+0000 7f14ef0a5640 1 -- 172.21.15.77:0/734114187 shutdown_connections 2024-04-25T01:40:44.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.234+0000 7f14ef0a5640 1 --2- 172.21.15.77:0/734114187 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f14c806be60 0x7f14c806e320 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:44.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.234+0000 7f14ef0a5640 1 --2- 172.21.15.77:0/734114187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14e8149c90 0x7f14e814f020 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:44.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.234+0000 7f14ef0a5640 1 --2- 172.21.15.77:0/734114187 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14e814f560 0x7f14e8149260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:44.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.234+0000 7f14ef0a5640 1 --2- 172.21.15.77:0/734114187 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f14d4004800 0x7f14e81ec290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:44.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.234+0000 7f14ef0a5640 1 -- 172.21.15.77:0/734114187 >> 172.21.15.77:0/734114187 conn(0x7f14e80c3f80 msgr2=0x7f14e814d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:44.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.234+0000 7f14ef0a5640 1 -- 172.21.15.77:0/734114187 shutdown_connections 2024-04-25T01:40:44.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:44.234+0000 7f14ef0a5640 1 -- 172.21.15.77:0/734114187 wait complete. 2024-04-25T01:40:44.231 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T01:40:46.232 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:40:46.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.355+0000 7f9fc4370640 1 Processor -- start 2024-04-25T01:40:46.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.355+0000 7f9fc4370640 1 -- start start 2024-04-25T01:40:46.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.356+0000 7f9fc4370640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9fbc14fdd0 0x7f9fbc06da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:46.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.356+0000 7f9fc4370640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9fbc06df70 0x7f9fbc156170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:46.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.356+0000 7f9fc4370640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fbc0c2cb0 con 0x7f9fbc0ad3a0 2024-04-25T01:40:46.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.356+0000 7f9fc4370640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9fbc0c30e0 con 0x7f9fbc14fdd0 2024-04-25T01:40:46.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.356+0000 7f9fc4370640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9fbc152f80 con 0x7f9fbc06df70 2024-04-25T01:40:46.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.356+0000 7f9fc210c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9fbc14fdd0 0x7f9fbc06da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:46.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.356+0000 7f9fc190b640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9fbc0ad3a0 0x7f9fbc155a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:34664/0 (socket says 172.21.15.77:34664) 2024-04-25T01:40:46.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.356+0000 7f9fc210c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9fbc14fdd0 0x7f9fbc06da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34696/0 (socket says 172.21.15.77:34696) 2024-04-25T01:40:46.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.356+0000 7f9fc190b640 1 -- 172.21.15.77:0/1377197662 learned_addr learned my addr 172.21.15.77:0/1377197662 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:40:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.357+0000 7f9fc290d640 1 --2- 172.21.15.77:0/1377197662 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9fbc06df70 0x7f9fbc156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.357+0000 7f9fc210c640 1 -- 172.21.15.77:0/1377197662 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9fbc06df70 msgr2=0x7f9fbc156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.357+0000 7f9fc210c640 1 --2- 172.21.15.77:0/1377197662 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9fbc06df70 0x7f9fbc156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.357+0000 7f9fc210c640 1 -- 172.21.15.77:0/1377197662 >> v1:172.21.15.77:6789/0 conn(0x7f9fbc0ad3a0 legacy=0x7f9fbc155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.357+0000 7f9fc210c640 1 -- 172.21.15.77:0/1377197662 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fbc153260 con 0x7f9fbc14fdd0 2024-04-25T01:40:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.357+0000 7f9fc290d640 1 --2- 172.21.15.77:0/1377197662 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9fbc06df70 0x7f9fbc156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:40:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.357+0000 7f9fc210c640 1 --2- 172.21.15.77:0/1377197662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fbc14fdd0 0x7f9fbc06da30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9fb800aea0 tx=0x7f9fb802b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bfbbbbe07d835ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.357+0000 7f9fc110a640 1 -- 172.21.15.77:0/1377197662 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb8037070 con 0x7f9fbc14fdd0 2024-04-25T01:40:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.357+0000 7f9fc110a640 1 -- 172.21.15.77:0/1377197662 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fb8008640 con 0x7f9fbc14fdd0 2024-04-25T01:40:46.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.357+0000 7f9fc110a640 1 -- 172.21.15.77:0/1377197662 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb8008a10 con 0x7f9fbc14fdd0 2024-04-25T01:40:46.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.358+0000 7f9fc4370640 1 -- 172.21.15.77:0/1377197662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fbc14fdd0 msgr2=0x7f9fbc06da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.358+0000 7f9fc4370640 1 --2- 172.21.15.77:0/1377197662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fbc14fdd0 0x7f9fbc06da30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9fb800aea0 tx=0x7f9fb802b720 comp rx=0 tx=0).stop 2024-04-25T01:40:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.358+0000 7f9fc4370640 1 -- 172.21.15.77:0/1377197662 shutdown_connections 2024-04-25T01:40:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.358+0000 7f9fc4370640 1 --2- 172.21.15.77:0/1377197662 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9fbc06df70 0x7f9fbc156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.358+0000 7f9fc4370640 1 --2- 172.21.15.77:0/1377197662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fbc14fdd0 0x7f9fbc06da30 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.358+0000 7f9fc4370640 1 -- 172.21.15.77:0/1377197662 >> 172.21.15.77:0/1377197662 conn(0x7f9fbc0c3f80 msgr2=0x7f9fbc0c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.358+0000 7f9fc4370640 1 -- 172.21.15.77:0/1377197662 shutdown_connections 2024-04-25T01:40:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.358+0000 7f9fc4370640 1 -- 172.21.15.77:0/1377197662 wait complete. 2024-04-25T01:40:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.359+0000 7f9fc4370640 1 Processor -- start 2024-04-25T01:40:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.359+0000 7f9fc4370640 1 -- start start 2024-04-25T01:40:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.360+0000 7f9fc4370640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fbc06df70 0x7f9fbc149740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:46.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.360+0000 7f9fc4370640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fbc0ad3a0 0x7f9fbc149c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:46.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.360+0000 7f9fc4370640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9fbc14fdd0 0x7f9fbc150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:46.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.360+0000 7f9fc4370640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9fbc0c28f0 con 0x7f9fbc06df70 2024-04-25T01:40:46.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.360+0000 7f9fc4370640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9fbc1566b0 con 0x7f9fbc0ad3a0 2024-04-25T01:40:46.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.360+0000 7f9fc4370640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9fbc0c2a70 con 0x7f9fbc14fdd0 2024-04-25T01:40:46.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.360+0000 7f9fc210c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fbc06df70 0x7f9fbc149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:46.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.360+0000 7f9fc210c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fbc06df70 0x7f9fbc149740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34712/0 (socket says 172.21.15.77:34712) 2024-04-25T01:40:46.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.360+0000 7f9fc210c640 1 -- 172.21.15.77:0/3458620835 learned_addr learned my addr 172.21.15.77:0/3458620835 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:46.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.360+0000 7f9fc290d640 1 --2- 172.21.15.77:0/3458620835 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9fbc14fdd0 0x7f9fbc150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:46.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.360+0000 7f9fc190b640 1 --2- 172.21.15.77:0/3458620835 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fbc0ad3a0 0x7f9fbc149c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:46.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.360+0000 7f9fc210c640 1 -- 172.21.15.77:0/3458620835 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9fbc14fdd0 msgr2=0x7f9fbc150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:46.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.360+0000 7f9fc210c640 1 --2- 172.21.15.77:0/3458620835 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9fbc14fdd0 0x7f9fbc150c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:46.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.360+0000 7f9fc210c640 1 -- 172.21.15.77:0/3458620835 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fbc0ad3a0 msgr2=0x7f9fbc149c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:46.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.360+0000 7f9fc210c640 1 --2- 172.21.15.77:0/3458620835 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fbc0ad3a0 0x7f9fbc149c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:46.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.360+0000 7f9fc210c640 1 -- 172.21.15.77:0/3458620835 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fbc1551f0 con 0x7f9fbc06df70 2024-04-25T01:40:46.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.361+0000 7f9fc210c640 1 --2- 172.21.15.77:0/3458620835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fbc06df70 0x7f9fbc149740 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9fb802bc90 tx=0x7f9fb8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:46.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.361+0000 7f9fb2ffd640 1 -- 172.21.15.77:0/3458620835 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb8037040 con 0x7f9fbc06df70 2024-04-25T01:40:46.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.361+0000 7f9fb2ffd640 1 -- 172.21.15.77:0/3458620835 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fb8042070 con 0x7f9fbc06df70 2024-04-25T01:40:46.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.361+0000 7f9fc4370640 1 -- 172.21.15.77:0/3458620835 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fbc070200 con 0x7f9fbc06df70 2024-04-25T01:40:46.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.361+0000 7f9fb2ffd640 1 -- 172.21.15.77:0/3458620835 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb8033a80 con 0x7f9fbc06df70 2024-04-25T01:40:46.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.361+0000 7f9fc4370640 1 -- 172.21.15.77:0/3458620835 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fbc072770 con 0x7f9fbc06df70 2024-04-25T01:40:46.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.362+0000 7f9fc4370640 1 -- 172.21.15.77:0/3458620835 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fbc04f500 con 0x7f9fbc06df70 2024-04-25T01:40:46.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.362+0000 7f9fb2ffd640 1 -- 172.21.15.77:0/3458620835 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9fb8033c20 con 0x7f9fbc06df70 2024-04-25T01:40:46.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.363+0000 7f9fb2ffd640 1 --2- 172.21.15.77:0/3458620835 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9fa006be30 0x7f9fa006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:46.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.363+0000 7f9fc190b640 1 --2- 172.21.15.77:0/3458620835 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9fa006be30 0x7f9fa006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:46.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.363+0000 7f9fb2ffd640 1 -- 172.21.15.77:0/3458620835 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6637+0+0 (secure 0 0 0) 0x7f9fb80abf40 con 0x7f9fbc06df70 2024-04-25T01:40:46.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.363+0000 7f9fc190b640 1 --2- 172.21.15.77:0/3458620835 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9fa006be30 0x7f9fa006e2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9fac000f60 tx=0x7f9fac009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:46.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.367+0000 7f9fb2ffd640 1 -- 172.21.15.77:0/3458620835 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9fb807a5e0 con 0x7f9fbc06df70 2024-04-25T01:40:46.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.575+0000 7f9fc4370640 1 -- 172.21.15.77:0/3458620835 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9fbc073750 con 0x7f9fbc06df70 2024-04-25T01:40:46.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.575+0000 7f9fb2ffd640 1 -- 172.21.15.77:0/3458620835 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6488 (secure 0 0 0) 0x7f9fb8079ee0 con 0x7f9fbc06df70 2024-04-25T01:40:46.561 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:40:46.561 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:39:36.787357+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6837/3454203695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3454203695},{"type":"v1","addr":"172.21.15.77:6837","nonce":3454203695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-04-25T01:40:46.561 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 12 2024-04-25T01:40:46.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.577+0000 7f9fc4370640 1 -- 172.21.15.77:0/3458620835 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9fa006be30 msgr2=0x7f9fa006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:46.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.577+0000 7f9fc4370640 1 --2- 172.21.15.77:0/3458620835 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9fa006be30 0x7f9fa006e2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9fac000f60 tx=0x7f9fac009040 comp rx=0 tx=0).stop 2024-04-25T01:40:46.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.577+0000 7f9fc4370640 1 -- 172.21.15.77:0/3458620835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fbc06df70 msgr2=0x7f9fbc149740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:46.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.577+0000 7f9fc4370640 1 --2- 172.21.15.77:0/3458620835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fbc06df70 0x7f9fbc149740 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9fb802bc90 tx=0x7f9fb8004a40 comp rx=0 tx=0).stop 2024-04-25T01:40:46.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.577+0000 7f9fc4370640 1 -- 172.21.15.77:0/3458620835 shutdown_connections 2024-04-25T01:40:46.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.577+0000 7f9fc4370640 1 --2- 172.21.15.77:0/3458620835 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9fa006be30 0x7f9fa006e2f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:46.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.577+0000 7f9fc4370640 1 --2- 172.21.15.77:0/3458620835 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9fbc14fdd0 0x7f9fbc150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:46.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.577+0000 7f9fc4370640 1 --2- 172.21.15.77:0/3458620835 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fbc0ad3a0 0x7f9fbc149c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:46.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.577+0000 7f9fc4370640 1 --2- 172.21.15.77:0/3458620835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fbc06df70 0x7f9fbc149740 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:46.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.577+0000 7f9fc4370640 1 -- 172.21.15.77:0/3458620835 >> 172.21.15.77:0/3458620835 conn(0x7f9fbc0c3f80 msgr2=0x7f9fbc14e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:46.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.577+0000 7f9fc4370640 1 -- 172.21.15.77:0/3458620835 shutdown_connections 2024-04-25T01:40:46.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:46.577+0000 7f9fc4370640 1 -- 172.21.15.77:0/3458620835 wait complete. 2024-04-25T01:40:46.574 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T01:40:48.575 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:40:48.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.698+0000 7f67301c8640 1 Processor -- start 2024-04-25T01:40:48.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.699+0000 7f67301c8640 1 -- start start 2024-04-25T01:40:48.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.699+0000 7f67301c8640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f672806d0a0 0x7f672806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:48.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.699+0000 7f67301c8640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6728153be0 con 0x7f6728154380 2024-04-25T01:40:48.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.699+0000 7f67301c8640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6728152fd0 con 0x7f6728150320 2024-04-25T01:40:48.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.699+0000 7f67301c8640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f67281532b0 con 0x7f672806d0a0 2024-04-25T01:40:48.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.700+0000 7f672e765640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6728154380 0x7f6728154830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36054/0 (socket says 172.21.15.77:36054) 2024-04-25T01:40:48.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.700+0000 7f672e765640 1 -- 172.21.15.77:0/3800178104 learned_addr learned my addr 172.21.15.77:0/3800178104 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:40:48.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.700+0000 7f672cf62640 1 -- 172.21.15.77:0/3800178104 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1008710569 0 0) 0x7f6728153be0 con 0x7f6728154380 2024-04-25T01:40:48.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.700+0000 7f672cf62640 1 -- 172.21.15.77:0/3800178104 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6714003520 con 0x7f6728154380 2024-04-25T01:40:48.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.700+0000 7f672d763640 1 --2- 172.21.15.77:0/3800178104 >> v2:172.21.15.121:3300/0 conn(0x7f672806d0a0 0x7f672806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:48.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.700+0000 7f672cf62640 1 -- 172.21.15.77:0/3800178104 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4099148975 0 0) 0x7f6714003520 con 0x7f6728154380 2024-04-25T01:40:48.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.700+0000 7f672cf62640 1 -- 172.21.15.77:0/3800178104 >> v2:172.21.15.121:3300/0 conn(0x7f672806d0a0 msgr2=0x7f672806d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:48.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.700+0000 7f672cf62640 1 --2- 172.21.15.77:0/3800178104 >> v2:172.21.15.121:3300/0 conn(0x7f672806d0a0 0x7f672806d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:48.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.700+0000 7f672cf62640 1 -- 172.21.15.77:0/3800178104 >> v1:172.21.15.121:6789/0 conn(0x7f6728150320 legacy=0x7f6728156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:48.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.700+0000 7f672cf62640 1 -- 172.21.15.77:0/3800178104 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6728153590 con 0x7f6728154380 2024-04-25T01:40:48.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.700+0000 7f672cf62640 1 -- 172.21.15.77:0/3800178104 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7f67200019f0 con 0x7f6728154380 2024-04-25T01:40:48.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.700+0000 7f672d763640 1 --2- 172.21.15.77:0/3800178104 >> v2:172.21.15.121:3300/0 conn(0x7f672806d0a0 0x7f672806d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:40:48.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.700+0000 7f672cf62640 1 -- 172.21.15.77:0/3800178104 >> v1:172.21.15.77:6789/0 conn(0x7f6728154380 legacy=0x7f6728154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:48.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.700+0000 7f672cf62640 1 --2- 172.21.15.77:0/3800178104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67140039b0 0x7f6714003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:48.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.700+0000 7f672cf62640 1 --2- 172.21.15.77:0/3800178104 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6714004800 0x7f6714004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:48.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.700+0000 7f672cf62640 1 --2- 172.21.15.77:0/3800178104 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67140052e0 0x7f671400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:48.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.700+0000 7f672cf62640 1 -- 172.21.15.77:0/3800178104 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f67281532b0 con 0x7f67140039b0 2024-04-25T01:40:48.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.700+0000 7f672cf62640 1 -- 172.21.15.77:0/3800178104 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f671400c1b0 con 0x7f67140052e0 2024-04-25T01:40:48.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.700+0000 7f672cf62640 1 -- 172.21.15.77:0/3800178104 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f671400c3b0 con 0x7f6714004800 2024-04-25T01:40:48.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.700+0000 7f672df64640 1 --2- 172.21.15.77:0/3800178104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67140039b0 0x7f6714003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:48.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.700+0000 7f672d763640 1 --2- 172.21.15.77:0/3800178104 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6714004800 0x7f6714004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:48.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.700+0000 7f672e765640 1 --2- 172.21.15.77:0/3800178104 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67140052e0 0x7f671400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:48.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.701+0000 7f672df64640 1 -- 172.21.15.77:0/3800178104 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6714004800 msgr2=0x7f6714004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:48.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.701+0000 7f672df64640 1 --2- 172.21.15.77:0/3800178104 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6714004800 0x7f6714004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:48.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.701+0000 7f672df64640 1 -- 172.21.15.77:0/3800178104 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67140052e0 msgr2=0x7f671400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:48.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.701+0000 7f672df64640 1 --2- 172.21.15.77:0/3800178104 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67140052e0 0x7f671400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:48.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.701+0000 7f672df64640 1 -- 172.21.15.77:0/3800178104 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6714003520 con 0x7f67140039b0 2024-04-25T01:40:48.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.701+0000 7f672e765640 1 --2- 172.21.15.77:0/3800178104 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67140052e0 0x7f671400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:40:48.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.701+0000 7f672e765640 1 -- 172.21.15.77:0/3800178104 reap_dead start 2024-04-25T01:40:48.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.701+0000 7f672df64640 1 --2- 172.21.15.77:0/3800178104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67140039b0 0x7f6714003dd0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6724001720 tx=0x7f6714005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a887d95e3df981 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:48.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.701+0000 7f672cf62640 1 -- 172.21.15.77:0/3800178104 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6724001370 con 0x7f67140039b0 2024-04-25T01:40:48.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.701+0000 7f672cf62640 1 -- 172.21.15.77:0/3800178104 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67240052d0 con 0x7f67140039b0 2024-04-25T01:40:48.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.702+0000 7f672cf62640 1 -- 172.21.15.77:0/3800178104 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672402ab90 con 0x7f67140039b0 2024-04-25T01:40:48.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.702+0000 7f67301c8640 1 -- 172.21.15.77:0/3800178104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67140039b0 msgr2=0x7f6714003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:48.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.702+0000 7f67301c8640 1 --2- 172.21.15.77:0/3800178104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67140039b0 0x7f6714003dd0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6724001720 tx=0x7f6714005830 comp rx=0 tx=0).stop 2024-04-25T01:40:48.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.702+0000 7f67301c8640 1 -- 172.21.15.77:0/3800178104 shutdown_connections 2024-04-25T01:40:48.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.702+0000 7f67301c8640 1 --2- 172.21.15.77:0/3800178104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67140039b0 0x7f6714003dd0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:48.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.702+0000 7f67301c8640 1 -- 172.21.15.77:0/3800178104 >> 172.21.15.77:0/3800178104 conn(0x7f67280c3f80 msgr2=0x7f67280c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:48.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.702+0000 7f67301c8640 1 -- 172.21.15.77:0/3800178104 shutdown_connections 2024-04-25T01:40:48.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.702+0000 7f67301c8640 1 -- 172.21.15.77:0/3800178104 wait complete. 2024-04-25T01:40:48.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.703+0000 7f67301c8640 1 Processor -- start 2024-04-25T01:40:48.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.703+0000 7f67301c8640 1 -- start start 2024-04-25T01:40:48.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.704+0000 7f67301c8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67140039b0 0x7f6728149460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:48.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.704+0000 7f67301c8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67280c5230 0x7f67280c0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:48.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.704+0000 7f67301c8640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67281eb840 0x7f67281ebcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:48.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.704+0000 7f67301c8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6728152d70 con 0x7f67140039b0 2024-04-25T01:40:48.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.704+0000 7f67301c8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6728152bf0 con 0x7f67280c5230 2024-04-25T01:40:48.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.704+0000 7f67301c8640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f67280c3100 con 0x7f67281eb840 2024-04-25T01:40:48.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.704+0000 7f672df64640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67140039b0 0x7f6728149460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:48.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.704+0000 7f672df64640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67140039b0 0x7f6728149460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54154/0 (socket says 172.21.15.77:54154) 2024-04-25T01:40:48.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.704+0000 7f672df64640 1 -- 172.21.15.77:0/2920088014 learned_addr learned my addr 172.21.15.77:0/2920088014 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:48.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.704+0000 7f672e765640 1 --2- 172.21.15.77:0/2920088014 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67281eb840 0x7f67281ebcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:48.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.704+0000 7f672d763640 1 --2- 172.21.15.77:0/2920088014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67280c5230 0x7f67280c0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:48.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.704+0000 7f672df64640 1 -- 172.21.15.77:0/2920088014 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67281eb840 msgr2=0x7f67281ebcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:48.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.704+0000 7f672df64640 1 --2- 172.21.15.77:0/2920088014 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67281eb840 0x7f67281ebcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:48.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.704+0000 7f672df64640 1 -- 172.21.15.77:0/2920088014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67280c5230 msgr2=0x7f67280c0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:48.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.704+0000 7f672df64640 1 --2- 172.21.15.77:0/2920088014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67280c5230 0x7f67280c0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:48.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.704+0000 7f672df64640 1 -- 172.21.15.77:0/2920088014 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67280c77c0 con 0x7f67140039b0 2024-04-25T01:40:48.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.704+0000 7f672d763640 1 --2- 172.21.15.77:0/2920088014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67280c5230 0x7f67280c0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:40:48.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.705+0000 7f672df64640 1 --2- 172.21.15.77:0/2920088014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67140039b0 0x7f6728149460 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6724005040 tx=0x7f6724001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:48.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.705+0000 7f671e7fc640 1 -- 172.21.15.77:0/2920088014 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672403f020 con 0x7f67140039b0 2024-04-25T01:40:48.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.705+0000 7f671e7fc640 1 -- 172.21.15.77:0/2920088014 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f672402be40 con 0x7f67140039b0 2024-04-25T01:40:48.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.705+0000 7f67301c8640 1 -- 172.21.15.77:0/2920088014 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6728072cb0 con 0x7f67140039b0 2024-04-25T01:40:48.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.705+0000 7f671e7fc640 1 -- 172.21.15.77:0/2920088014 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6724001370 con 0x7f67140039b0 2024-04-25T01:40:48.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.705+0000 7f67301c8640 1 -- 172.21.15.77:0/2920088014 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67280c6fc0 con 0x7f67140039b0 2024-04-25T01:40:48.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.706+0000 7f67301c8640 1 -- 172.21.15.77:0/2920088014 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f672804f500 con 0x7f67140039b0 2024-04-25T01:40:48.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.706+0000 7f671e7fc640 1 -- 172.21.15.77:0/2920088014 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6724042020 con 0x7f67140039b0 2024-04-25T01:40:48.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.707+0000 7f671e7fc640 1 --2- 172.21.15.77:0/2920088014 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f670c06be60 0x7f670c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:48.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.707+0000 7f671e7fc640 1 -- 172.21.15.77:0/2920088014 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6637+0+0 (secure 0 0 0) 0x7f67240aac10 con 0x7f67140039b0 2024-04-25T01:40:48.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.707+0000 7f672d763640 1 --2- 172.21.15.77:0/2920088014 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f670c06be60 0x7f670c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:48.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.707+0000 7f672d763640 1 --2- 172.21.15.77:0/2920088014 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f670c06be60 0x7f670c06e320 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f67280c1520 tx=0x7f6718008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:48.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.711+0000 7f671e7fc640 1 -- 172.21.15.77:0/2920088014 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6724049030 con 0x7f67140039b0 2024-04-25T01:40:48.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.918+0000 7f67301c8640 1 -- 172.21.15.77:0/2920088014 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6728073750 con 0x7f67140039b0 2024-04-25T01:40:48.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.919+0000 7f671e7fc640 1 -- 172.21.15.77:0/2920088014 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6488 (secure 0 0 0) 0x7f67240792b0 con 0x7f67140039b0 2024-04-25T01:40:48.905 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:40:48.905 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:39:36.787357+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6837/3454203695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3454203695},{"type":"v1","addr":"172.21.15.77:6837","nonce":3454203695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-04-25T01:40:48.905 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 12 2024-04-25T01:40:48.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.921+0000 7f67301c8640 1 -- 172.21.15.77:0/2920088014 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f670c06be60 msgr2=0x7f670c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:48.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.921+0000 7f67301c8640 1 --2- 172.21.15.77:0/2920088014 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f670c06be60 0x7f670c06e320 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f67280c1520 tx=0x7f6718008040 comp rx=0 tx=0).stop 2024-04-25T01:40:48.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.921+0000 7f67301c8640 1 -- 172.21.15.77:0/2920088014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67140039b0 msgr2=0x7f6728149460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:48.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.921+0000 7f67301c8640 1 --2- 172.21.15.77:0/2920088014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67140039b0 0x7f6728149460 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6724005040 tx=0x7f6724001120 comp rx=0 tx=0).stop 2024-04-25T01:40:48.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.921+0000 7f67301c8640 1 -- 172.21.15.77:0/2920088014 shutdown_connections 2024-04-25T01:40:48.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.921+0000 7f67301c8640 1 --2- 172.21.15.77:0/2920088014 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f670c06be60 0x7f670c06e320 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:48.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.921+0000 7f67301c8640 1 --2- 172.21.15.77:0/2920088014 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67281eb840 0x7f67281ebcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:48.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.921+0000 7f67301c8640 1 --2- 172.21.15.77:0/2920088014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67280c5230 0x7f67280c0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:48.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.921+0000 7f67301c8640 1 --2- 172.21.15.77:0/2920088014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67140039b0 0x7f6728149460 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:48.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.921+0000 7f67301c8640 1 -- 172.21.15.77:0/2920088014 >> 172.21.15.77:0/2920088014 conn(0x7f67280c3f80 msgr2=0x7f672814f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:48.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.921+0000 7f67301c8640 1 -- 172.21.15.77:0/2920088014 shutdown_connections 2024-04-25T01:40:48.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:48.921+0000 7f67301c8640 1 -- 172.21.15.77:0/2920088014 wait complete. 2024-04-25T01:40:48.917 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T01:40:49.302 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:40:49.305 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:40:50.918 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:40:51.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.041+0000 7ffa7703f640 1 Processor -- start 2024-04-25T01:40:51.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.041+0000 7ffa7703f640 1 -- start start 2024-04-25T01:40:51.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.042+0000 7ffa7703f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ffa70150320 0x7ffa70156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:51.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.042+0000 7ffa7703f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffa7006d4e0 0x7ffa70154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:51.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.042+0000 7ffa7703f640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa70153be0 con 0x7ffa7006d0a0 2024-04-25T01:40:51.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.042+0000 7ffa7703f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ffa70152fd0 con 0x7ffa7006d4e0 2024-04-25T01:40:51.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.042+0000 7ffa7703f640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7ffa701532b0 con 0x7ffa70150320 2024-04-25T01:40:51.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.042+0000 7ffa755dc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffa7006d4e0 0x7ffa70154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:51.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.042+0000 7ffa755dc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffa7006d4e0 0x7ffa70154a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54162/0 (socket says 172.21.15.77:54162) 2024-04-25T01:40:51.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.042+0000 7ffa755dc640 1 -- 172.21.15.77:0/2571125642 learned_addr learned my addr 172.21.15.77:0/2571125642 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:51.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.042+0000 7ffa74ddb640 1 --2- 172.21.15.77:0/2571125642 >> v2:172.21.15.121:3300/0 conn(0x7ffa70150320 0x7ffa70156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:51.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.042+0000 7ffa755dc640 1 -- 172.21.15.77:0/2571125642 >> v2:172.21.15.121:3300/0 conn(0x7ffa70150320 msgr2=0x7ffa70156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:51.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.042+0000 7ffa755dc640 1 --2- 172.21.15.77:0/2571125642 >> v2:172.21.15.121:3300/0 conn(0x7ffa70150320 0x7ffa70156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:51.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.042+0000 7ffa755dc640 1 -- 172.21.15.77:0/2571125642 >> v1:172.21.15.121:6789/0 conn(0x7ffa7006d0a0 legacy=0x7ffa70154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:51.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.042+0000 7ffa755dc640 1 -- 172.21.15.77:0/2571125642 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa70157100 con 0x7ffa7006d4e0 2024-04-25T01:40:51.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.043+0000 7ffa755dc640 1 --2- 172.21.15.77:0/2571125642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa7006d4e0 0x7ffa70154a90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ffa7006db60 tx=0x7ffa6802a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cdb66353cba6239 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:51.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.043+0000 7ffa6f7fe640 1 -- 172.21.15.77:0/2571125642 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa68036070 con 0x7ffa7006d4e0 2024-04-25T01:40:51.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.043+0000 7ffa6f7fe640 1 -- 172.21.15.77:0/2571125642 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa68031600 con 0x7ffa7006d4e0 2024-04-25T01:40:51.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.043+0000 7ffa6f7fe640 1 -- 172.21.15.77:0/2571125642 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa680319d0 con 0x7ffa7006d4e0 2024-04-25T01:40:51.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.043+0000 7ffa7703f640 1 -- 172.21.15.77:0/2571125642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa7006d4e0 msgr2=0x7ffa70154a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:51.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.043+0000 7ffa7703f640 1 --2- 172.21.15.77:0/2571125642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa7006d4e0 0x7ffa70154a90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ffa7006db60 tx=0x7ffa6802a760 comp rx=0 tx=0).stop 2024-04-25T01:40:51.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.043+0000 7ffa7703f640 1 -- 172.21.15.77:0/2571125642 shutdown_connections 2024-04-25T01:40:51.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.043+0000 7ffa7703f640 1 --2- 172.21.15.77:0/2571125642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa7006d4e0 0x7ffa70154a90 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:51.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.043+0000 7ffa7703f640 1 --2- 172.21.15.77:0/2571125642 >> v2:172.21.15.121:3300/0 conn(0x7ffa70150320 0x7ffa70156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:51.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.043+0000 7ffa7703f640 1 -- 172.21.15.77:0/2571125642 >> 172.21.15.77:0/2571125642 conn(0x7ffa700c3f80 msgr2=0x7ffa700c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:51.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.044+0000 7ffa7703f640 1 -- 172.21.15.77:0/2571125642 shutdown_connections 2024-04-25T01:40:51.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.044+0000 7ffa7703f640 1 -- 172.21.15.77:0/2571125642 wait complete. 2024-04-25T01:40:51.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.045+0000 7ffa7703f640 1 Processor -- start 2024-04-25T01:40:51.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.045+0000 7ffa7703f640 1 -- start start 2024-04-25T01:40:51.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.046+0000 7ffa7703f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa7006d0a0 0x7ffa701432e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:51.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.046+0000 7ffa7703f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa7006d4e0 0x7ffa70144280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:51.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.046+0000 7ffa7703f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa70150320 0x7ffa701447c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:51.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.046+0000 7ffa7703f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffa70154fd0 con 0x7ffa7006d0a0 2024-04-25T01:40:51.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.046+0000 7ffa7703f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ffa70153870 con 0x7ffa70150320 2024-04-25T01:40:51.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.046+0000 7ffa7703f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ffa70152bf0 con 0x7ffa7006d4e0 2024-04-25T01:40:51.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.046+0000 7ffa74ddb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa7006d0a0 0x7ffa701432e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:51.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.046+0000 7ffa74ddb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa7006d0a0 0x7ffa701432e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54164/0 (socket says 172.21.15.77:54164) 2024-04-25T01:40:51.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.046+0000 7ffa74ddb640 1 -- 172.21.15.77:0/3947256202 learned_addr learned my addr 172.21.15.77:0/3947256202 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:51.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.046+0000 7ffa74ddb640 1 -- 172.21.15.77:0/3947256202 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa7006d4e0 msgr2=0x7ffa70144280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:51.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.046+0000 7ffa74ddb640 1 --2- 172.21.15.77:0/3947256202 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa7006d4e0 0x7ffa70144280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:51.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.046+0000 7ffa755dc640 1 --2- 172.21.15.77:0/3947256202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa70150320 0x7ffa701447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:51.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.046+0000 7ffa74ddb640 1 -- 172.21.15.77:0/3947256202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa70150320 msgr2=0x7ffa701447c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:51.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.046+0000 7ffa74ddb640 1 --2- 172.21.15.77:0/3947256202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa70150320 0x7ffa701447c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:51.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.046+0000 7ffa74ddb640 1 -- 172.21.15.77:0/3947256202 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa70144d00 con 0x7ffa7006d0a0 2024-04-25T01:40:51.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.046+0000 7ffa74ddb640 1 --2- 172.21.15.77:0/3947256202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa7006d0a0 0x7ffa701432e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400d600 tx=0x7ffa6400dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:51.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.046+0000 7ffa6d7fa640 1 -- 172.21.15.77:0/3947256202 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa640125f0 con 0x7ffa7006d0a0 2024-04-25T01:40:51.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.046+0000 7ffa6d7fa640 1 -- 172.21.15.77:0/3947256202 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa64019070 con 0x7ffa7006d0a0 2024-04-25T01:40:51.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.046+0000 7ffa7703f640 1 -- 172.21.15.77:0/3947256202 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa70142a80 con 0x7ffa7006d0a0 2024-04-25T01:40:51.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.046+0000 7ffa6d7fa640 1 -- 172.21.15.77:0/3947256202 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa640129f0 con 0x7ffa7006d0a0 2024-04-25T01:40:51.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.046+0000 7ffa7703f640 1 -- 172.21.15.77:0/3947256202 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa701427a0 con 0x7ffa7006d0a0 2024-04-25T01:40:51.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.047+0000 7ffa7703f640 1 -- 172.21.15.77:0/3947256202 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa7004f500 con 0x7ffa7006d0a0 2024-04-25T01:40:51.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.048+0000 7ffa6d7fa640 1 -- 172.21.15.77:0/3947256202 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffa64012b90 con 0x7ffa7006d0a0 2024-04-25T01:40:51.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.048+0000 7ffa6d7fa640 1 --2- 172.21.15.77:0/3947256202 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ffa5406be30 0x7ffa5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:51.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.048+0000 7ffa6d7fa640 1 -- 172.21.15.77:0/3947256202 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6637+0+0 (secure 0 0 0) 0x7ffa6408b5b0 con 0x7ffa7006d0a0 2024-04-25T01:40:51.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.048+0000 7ffa6ffff640 1 --2- 172.21.15.77:0/3947256202 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ffa5406be30 0x7ffa5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:51.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.049+0000 7ffa6ffff640 1 --2- 172.21.15.77:0/3947256202 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ffa5406be30 0x7ffa5406e2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c000f60 tx=0x7ffa5c0079d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:51.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.053+0000 7ffa6d7fa640 1 -- 172.21.15.77:0/3947256202 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ffa64059c50 con 0x7ffa7006d0a0 2024-04-25T01:40:51.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.262+0000 7ffa7703f640 1 -- 172.21.15.77:0/3947256202 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa70073750 con 0x7ffa7006d0a0 2024-04-25T01:40:51.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.262+0000 7ffa6d7fa640 1 -- 172.21.15.77:0/3947256202 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6488 (secure 0 0 0) 0x7ffa64059550 con 0x7ffa7006d0a0 2024-04-25T01:40:51.248 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:40:51.248 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:39:36.787357+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6837/3454203695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3454203695},{"type":"v1","addr":"172.21.15.77:6837","nonce":3454203695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-04-25T01:40:51.248 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 12 2024-04-25T01:40:51.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.264+0000 7ffa7703f640 1 -- 172.21.15.77:0/3947256202 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ffa5406be30 msgr2=0x7ffa5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:51.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.264+0000 7ffa7703f640 1 --2- 172.21.15.77:0/3947256202 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ffa5406be30 0x7ffa5406e2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c000f60 tx=0x7ffa5c0079d0 comp rx=0 tx=0).stop 2024-04-25T01:40:51.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.264+0000 7ffa7703f640 1 -- 172.21.15.77:0/3947256202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa7006d0a0 msgr2=0x7ffa701432e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:51.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.264+0000 7ffa7703f640 1 --2- 172.21.15.77:0/3947256202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa7006d0a0 0x7ffa701432e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400d600 tx=0x7ffa6400dac0 comp rx=0 tx=0).stop 2024-04-25T01:40:51.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.264+0000 7ffa7703f640 1 -- 172.21.15.77:0/3947256202 shutdown_connections 2024-04-25T01:40:51.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.264+0000 7ffa7703f640 1 --2- 172.21.15.77:0/3947256202 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ffa5406be30 0x7ffa5406e2f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:51.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.264+0000 7ffa7703f640 1 --2- 172.21.15.77:0/3947256202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa70150320 0x7ffa701447c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:51.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.264+0000 7ffa7703f640 1 --2- 172.21.15.77:0/3947256202 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa7006d4e0 0x7ffa70144280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:51.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.264+0000 7ffa7703f640 1 --2- 172.21.15.77:0/3947256202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa7006d0a0 0x7ffa701432e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:51.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.264+0000 7ffa7703f640 1 -- 172.21.15.77:0/3947256202 >> 172.21.15.77:0/3947256202 conn(0x7ffa700c3f80 msgr2=0x7ffa70155150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:51.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.265+0000 7ffa7703f640 1 -- 172.21.15.77:0/3947256202 shutdown_connections 2024-04-25T01:40:51.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:51.265+0000 7ffa7703f640 1 -- 172.21.15.77:0/3947256202 wait complete. 2024-04-25T01:40:51.261 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T01:40:53.262 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:40:53.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.384+0000 7f6e2ad90640 1 Processor -- start 2024-04-25T01:40:53.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.384+0000 7f6e2ad90640 1 -- start start 2024-04-25T01:40:53.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.385+0000 7f6e2ad90640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6e24153570 0x7f6e240c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:53.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.385+0000 7f6e2ad90640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6e24156d10 0x7f6e241609f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:53.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.385+0000 7f6e2ad90640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e240c3290 con 0x7f6e240c9c00 2024-04-25T01:40:53.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.385+0000 7f6e2ad90640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f6e24070090 con 0x7f6e24153570 2024-04-25T01:40:53.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.385+0000 7f6e2ad90640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f6e24070370 con 0x7f6e24156d10 2024-04-25T01:40:53.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.385+0000 7f6e28b2c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6e24153570 0x7f6e240c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:53.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.385+0000 7f6e23fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6e240c9c00 0x7f6e24156600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36056/0 (socket says 172.21.15.77:36056) 2024-04-25T01:40:53.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.385+0000 7f6e23fff640 1 -- 172.21.15.77:0/294972898 learned_addr learned my addr 172.21.15.77:0/294972898 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:40:53.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.385+0000 7f6e2932d640 1 --2- 172.21.15.77:0/294972898 >> v2:172.21.15.121:3300/0 conn(0x7f6e24156d10 0x7f6e241609f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:53.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.385+0000 7f6e28b2c640 1 -- 172.21.15.77:0/294972898 >> v2:172.21.15.121:3300/0 conn(0x7f6e24156d10 msgr2=0x7f6e241609f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:53.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.385+0000 7f6e28b2c640 1 --2- 172.21.15.77:0/294972898 >> v2:172.21.15.121:3300/0 conn(0x7f6e24156d10 0x7f6e241609f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:53.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.385+0000 7f6e28b2c640 1 -- 172.21.15.77:0/294972898 >> v1:172.21.15.77:6789/0 conn(0x7f6e240c9c00 legacy=0x7f6e24156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:53.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.385+0000 7f6e237fe640 1 -- 172.21.15.77:0/294972898 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3942267831 0 0) 0x7f6e240c3290 con 0x7f6e240c9c00 2024-04-25T01:40:53.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.385+0000 7f6e28b2c640 1 -- 172.21.15.77:0/294972898 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e24156070 con 0x7f6e24153570 2024-04-25T01:40:53.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.386+0000 7f6e28b2c640 1 --2- 172.21.15.77:0/294972898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e24153570 0x7f6e240c96c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6e240c4420 tx=0x7f6e1802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f84bd52a969eed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:53.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.386+0000 7f6e237fe640 1 -- 172.21.15.77:0/294972898 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e18037070 con 0x7f6e24153570 2024-04-25T01:40:53.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.386+0000 7f6e237fe640 1 -- 172.21.15.77:0/294972898 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e18032440 con 0x7f6e24153570 2024-04-25T01:40:53.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.386+0000 7f6e237fe640 1 -- 172.21.15.77:0/294972898 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1802ae60 con 0x7f6e24153570 2024-04-25T01:40:53.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.387+0000 7f6e2ad90640 1 -- 172.21.15.77:0/294972898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e24153570 msgr2=0x7f6e240c96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:53.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.387+0000 7f6e2ad90640 1 --2- 172.21.15.77:0/294972898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e24153570 0x7f6e240c96c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6e240c4420 tx=0x7f6e1802a110 comp rx=0 tx=0).stop 2024-04-25T01:40:53.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.387+0000 7f6e2ad90640 1 -- 172.21.15.77:0/294972898 shutdown_connections 2024-04-25T01:40:53.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.387+0000 7f6e2ad90640 1 --2- 172.21.15.77:0/294972898 >> v2:172.21.15.121:3300/0 conn(0x7f6e24156d10 0x7f6e241609f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:53.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.387+0000 7f6e2ad90640 1 --2- 172.21.15.77:0/294972898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e24153570 0x7f6e240c96c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:53.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.387+0000 7f6e2ad90640 1 -- 172.21.15.77:0/294972898 >> 172.21.15.77:0/294972898 conn(0x7f6e240aa8f0 msgr2=0x7f6e24066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:53.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.387+0000 7f6e2ad90640 1 -- 172.21.15.77:0/294972898 shutdown_connections 2024-04-25T01:40:53.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.387+0000 7f6e2ad90640 1 -- 172.21.15.77:0/294972898 wait complete. 2024-04-25T01:40:53.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.388+0000 7f6e2ad90640 1 Processor -- start 2024-04-25T01:40:53.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.388+0000 7f6e2ad90640 1 -- start start 2024-04-25T01:40:53.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.389+0000 7f6e2ad90640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e240c9c00 0x7f6e240c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:53.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.389+0000 7f6e2ad90640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e24153570 0x7f6e24144b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:53.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.389+0000 7f6e2ad90640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6e24156d10 0x7f6e24145070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:53.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.389+0000 7f6e2ad90640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6e241576e0 con 0x7f6e240c9c00 2024-04-25T01:40:53.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.389+0000 7f6e2ad90640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6e24157560 con 0x7f6e24153570 2024-04-25T01:40:53.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.389+0000 7f6e2ad90640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f6e24153950 con 0x7f6e24156d10 2024-04-25T01:40:53.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.389+0000 7f6e28b2c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e240c9c00 0x7f6e240c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:53.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.389+0000 7f6e28b2c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e240c9c00 0x7f6e240c8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54170/0 (socket says 172.21.15.77:54170) 2024-04-25T01:40:53.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.389+0000 7f6e28b2c640 1 -- 172.21.15.77:0/163293477 learned_addr learned my addr 172.21.15.77:0/163293477 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:53.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.389+0000 7f6e23fff640 1 --2- 172.21.15.77:0/163293477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e24153570 0x7f6e24144b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:53.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.389+0000 7f6e2932d640 1 --2- 172.21.15.77:0/163293477 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6e24156d10 0x7f6e24145070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:53.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.389+0000 7f6e28b2c640 1 -- 172.21.15.77:0/163293477 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6e24156d10 msgr2=0x7f6e24145070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:53.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.389+0000 7f6e28b2c640 1 --2- 172.21.15.77:0/163293477 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6e24156d10 0x7f6e24145070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:53.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.389+0000 7f6e28b2c640 1 -- 172.21.15.77:0/163293477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e24153570 msgr2=0x7f6e24144b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:53.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.389+0000 7f6e28b2c640 1 --2- 172.21.15.77:0/163293477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e24153570 0x7f6e24144b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:53.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.389+0000 7f6e28b2c640 1 -- 172.21.15.77:0/163293477 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e240af450 con 0x7f6e240c9c00 2024-04-25T01:40:53.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.389+0000 7f6e28b2c640 1 --2- 172.21.15.77:0/163293477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e240c9c00 0x7f6e240c8580 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6e18000c00 tx=0x7f6e180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:53.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.389+0000 7f6e217fa640 1 -- 172.21.15.77:0/163293477 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e18037040 con 0x7f6e240c9c00 2024-04-25T01:40:53.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.390+0000 7f6e217fa640 1 -- 172.21.15.77:0/163293477 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e18042070 con 0x7f6e240c9c00 2024-04-25T01:40:53.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.390+0000 7f6e217fa640 1 -- 172.21.15.77:0/163293477 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e18030bd0 con 0x7f6e240c9c00 2024-04-25T01:40:53.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.390+0000 7f6e2ad90640 1 -- 172.21.15.77:0/163293477 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e241ecef0 con 0x7f6e240c9c00 2024-04-25T01:40:53.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.390+0000 7f6e2ad90640 1 -- 172.21.15.77:0/163293477 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e24155a30 con 0x7f6e240c9c00 2024-04-25T01:40:53.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.391+0000 7f6e2ad90640 1 -- 172.21.15.77:0/163293477 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e2404f500 con 0x7f6e240c9c00 2024-04-25T01:40:53.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.391+0000 7f6e217fa640 1 -- 172.21.15.77:0/163293477 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6e18047460 con 0x7f6e240c9c00 2024-04-25T01:40:53.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.392+0000 7f6e217fa640 1 --2- 172.21.15.77:0/163293477 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6e0806be60 0x7f6e0806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:53.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.392+0000 7f6e23fff640 1 --2- 172.21.15.77:0/163293477 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6e0806be60 0x7f6e0806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:53.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.392+0000 7f6e217fa640 1 -- 172.21.15.77:0/163293477 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6637+0+0 (secure 0 0 0) 0x7f6e180abd60 con 0x7f6e240c9c00 2024-04-25T01:40:53.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.392+0000 7f6e23fff640 1 --2- 172.21.15.77:0/163293477 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6e0806be60 0x7f6e0806e320 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6e241584f0 tx=0x7f6e10007b50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:53.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.396+0000 7f6e217fa640 1 -- 172.21.15.77:0/163293477 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6e240af450 con 0x7f6e240c9c00 2024-04-25T01:40:53.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.609+0000 7f6e2ad90640 1 -- 172.21.15.77:0/163293477 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e24068400 con 0x7f6e240c9c00 2024-04-25T01:40:53.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.610+0000 7f6e217fa640 1 -- 172.21.15.77:0/163293477 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6488 (secure 0 0 0) 0x7f6e18032e20 con 0x7f6e240c9c00 2024-04-25T01:40:53.595 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:40:53.596 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:39:36.787357+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6837/3454203695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3454203695},{"type":"v1","addr":"172.21.15.77:6837","nonce":3454203695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-04-25T01:40:53.596 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 12 2024-04-25T01:40:53.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.611+0000 7f6e2ad90640 1 -- 172.21.15.77:0/163293477 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6e0806be60 msgr2=0x7f6e0806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:53.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.611+0000 7f6e2ad90640 1 --2- 172.21.15.77:0/163293477 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6e0806be60 0x7f6e0806e320 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6e241584f0 tx=0x7f6e10007b50 comp rx=0 tx=0).stop 2024-04-25T01:40:53.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.611+0000 7f6e2ad90640 1 -- 172.21.15.77:0/163293477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e240c9c00 msgr2=0x7f6e240c8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:53.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.611+0000 7f6e2ad90640 1 --2- 172.21.15.77:0/163293477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e240c9c00 0x7f6e240c8580 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6e18000c00 tx=0x7f6e180046c0 comp rx=0 tx=0).stop 2024-04-25T01:40:53.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.612+0000 7f6e2ad90640 1 -- 172.21.15.77:0/163293477 shutdown_connections 2024-04-25T01:40:53.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.612+0000 7f6e2ad90640 1 --2- 172.21.15.77:0/163293477 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6e0806be60 0x7f6e0806e320 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:53.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.612+0000 7f6e2ad90640 1 --2- 172.21.15.77:0/163293477 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6e24156d10 0x7f6e24145070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:53.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.612+0000 7f6e2ad90640 1 --2- 172.21.15.77:0/163293477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e24153570 0x7f6e24144b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:53.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.612+0000 7f6e2ad90640 1 --2- 172.21.15.77:0/163293477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e240c9c00 0x7f6e240c8580 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:53.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.612+0000 7f6e2ad90640 1 -- 172.21.15.77:0/163293477 >> 172.21.15.77:0/163293477 conn(0x7f6e240aa8f0 msgr2=0x7f6e240c3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:53.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.612+0000 7f6e2ad90640 1 -- 172.21.15.77:0/163293477 shutdown_connections 2024-04-25T01:40:53.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:53.612+0000 7f6e2ad90640 1 -- 172.21.15.77:0/163293477 wait complete. 2024-04-25T01:40:53.609 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T01:40:55.610 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:40:55.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.733+0000 7f9d09476640 1 Processor -- start 2024-04-25T01:40:55.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.733+0000 7f9d09476640 1 -- start start 2024-04-25T01:40:55.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.734+0000 7f9d09476640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9d04150320 0x7f9d04156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:55.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.734+0000 7f9d09476640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d0406d0a0 0x7f9d0406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:55.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.734+0000 7f9d09476640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d04153be0 con 0x7f9d04154380 2024-04-25T01:40:55.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.734+0000 7f9d09476640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9d04152fd0 con 0x7f9d04150320 2024-04-25T01:40:55.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.734+0000 7f9d09476640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9d041532b0 con 0x7f9d0406d0a0 2024-04-25T01:40:55.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.734+0000 7f9d02ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9d04150320 0x7f9d04156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:55.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.734+0000 7f9d037fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9d04154380 0x7f9d04154800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36066/0 (socket says 172.21.15.77:36066) 2024-04-25T01:40:55.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.734+0000 7f9d037fe640 1 -- 172.21.15.77:0/2786398961 learned_addr learned my addr 172.21.15.77:0/2786398961 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:40:55.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.734+0000 7f9d027fc640 1 --2- 172.21.15.77:0/2786398961 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d0406d0a0 0x7f9d0406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:55.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.734+0000 7f9d02ffd640 1 -- 172.21.15.77:0/2786398961 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d0406d0a0 msgr2=0x7f9d0406d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:55.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.734+0000 7f9d02ffd640 1 --2- 172.21.15.77:0/2786398961 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d0406d0a0 0x7f9d0406d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:55.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.734+0000 7f9d02ffd640 1 -- 172.21.15.77:0/2786398961 >> v1:172.21.15.77:6789/0 conn(0x7f9d04154380 legacy=0x7f9d04154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:55.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.734+0000 7f9d01ffb640 1 -- 172.21.15.77:0/2786398961 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4189077340 0 0) 0x7f9d04153be0 con 0x7f9d04154380 2024-04-25T01:40:55.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.734+0000 7f9d02ffd640 1 -- 172.21.15.77:0/2786398961 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d04157100 con 0x7f9d04150320 2024-04-25T01:40:55.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.735+0000 7f9d02ffd640 1 --2- 172.21.15.77:0/2786398961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d04150320 0x7f9d04156bc0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9cf40097a0 tx=0x7f9cf402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8122956b86778394 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:55.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.735+0000 7f9d01ffb640 1 -- 172.21.15.77:0/2786398961 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4037070 con 0x7f9d04150320 2024-04-25T01:40:55.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.735+0000 7f9d01ffb640 1 -- 172.21.15.77:0/2786398961 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cf402ae50 con 0x7f9d04150320 2024-04-25T01:40:55.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.735+0000 7f9d01ffb640 1 -- 172.21.15.77:0/2786398961 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4032660 con 0x7f9d04150320 2024-04-25T01:40:55.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.736+0000 7f9d09476640 1 -- 172.21.15.77:0/2786398961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d04150320 msgr2=0x7f9d04156bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:55.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.736+0000 7f9d09476640 1 --2- 172.21.15.77:0/2786398961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d04150320 0x7f9d04156bc0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9cf40097a0 tx=0x7f9cf402a100 comp rx=0 tx=0).stop 2024-04-25T01:40:55.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.736+0000 7f9d09476640 1 -- 172.21.15.77:0/2786398961 shutdown_connections 2024-04-25T01:40:55.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.736+0000 7f9d09476640 1 --2- 172.21.15.77:0/2786398961 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d0406d0a0 0x7f9d0406d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:55.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.736+0000 7f9d09476640 1 --2- 172.21.15.77:0/2786398961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d04150320 0x7f9d04156bc0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:55.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.736+0000 7f9d09476640 1 -- 172.21.15.77:0/2786398961 >> 172.21.15.77:0/2786398961 conn(0x7f9d040c3f80 msgr2=0x7f9d040c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:55.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.736+0000 7f9d09476640 1 -- 172.21.15.77:0/2786398961 shutdown_connections 2024-04-25T01:40:55.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.736+0000 7f9d09476640 1 -- 172.21.15.77:0/2786398961 wait complete. 2024-04-25T01:40:55.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.737+0000 7f9d09476640 1 Processor -- start 2024-04-25T01:40:55.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.737+0000 7f9d09476640 1 -- start start 2024-04-25T01:40:55.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.738+0000 7f9d09476640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d0406d0a0 0x7f9d041ed7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:55.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.738+0000 7f9d09476640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d04150320 0x7f9d040c5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:55.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.738+0000 7f9d09476640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d04154380 0x7f9d0414bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:55.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.738+0000 7f9d09476640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9d04154f10 con 0x7f9d04154380 2024-04-25T01:40:55.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.738+0000 7f9d09476640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9d04153870 con 0x7f9d0406d0a0 2024-04-25T01:40:55.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.738+0000 7f9d09476640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9d04155090 con 0x7f9d04150320 2024-04-25T01:40:55.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.738+0000 7f9d037fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d04154380 0x7f9d0414bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:55.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.738+0000 7f9d037fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d04154380 0x7f9d0414bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54184/0 (socket says 172.21.15.77:54184) 2024-04-25T01:40:55.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.738+0000 7f9d037fe640 1 -- 172.21.15.77:0/3008782579 learned_addr learned my addr 172.21.15.77:0/3008782579 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:55.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.738+0000 7f9d027fc640 1 --2- 172.21.15.77:0/3008782579 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d04150320 0x7f9d040c5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:55.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.738+0000 7f9d02ffd640 1 --2- 172.21.15.77:0/3008782579 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d0406d0a0 0x7f9d041ed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:55.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.738+0000 7f9d037fe640 1 -- 172.21.15.77:0/3008782579 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d04150320 msgr2=0x7f9d040c5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:55.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.738+0000 7f9d037fe640 1 --2- 172.21.15.77:0/3008782579 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d04150320 0x7f9d040c5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:55.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.738+0000 7f9d037fe640 1 -- 172.21.15.77:0/3008782579 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d0406d0a0 msgr2=0x7f9d041ed7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:55.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.738+0000 7f9d037fe640 1 --2- 172.21.15.77:0/3008782579 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d0406d0a0 0x7f9d041ed7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:55.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.738+0000 7f9d037fe640 1 -- 172.21.15.77:0/3008782579 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d040c5780 con 0x7f9d04154380 2024-04-25T01:40:55.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.738+0000 7f9d037fe640 1 --2- 172.21.15.77:0/3008782579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d04154380 0x7f9d0414bab0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc00c780 tx=0x7f9cfc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:55.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.739+0000 7f9ceb7fe640 1 -- 172.21.15.77:0/3008782579 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc018070 con 0x7f9d04154380 2024-04-25T01:40:55.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.739+0000 7f9ceb7fe640 1 -- 172.21.15.77:0/3008782579 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cfc00a5e0 con 0x7f9d04154380 2024-04-25T01:40:55.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.739+0000 7f9d09476640 1 -- 172.21.15.77:0/3008782579 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d040c5a40 con 0x7f9d04154380 2024-04-25T01:40:55.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.739+0000 7f9ceb7fe640 1 -- 172.21.15.77:0/3008782579 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc00a9d0 con 0x7f9d04154380 2024-04-25T01:40:55.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.739+0000 7f9d09476640 1 -- 172.21.15.77:0/3008782579 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d0414bff0 con 0x7f9d04154380 2024-04-25T01:40:55.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.740+0000 7f9d09476640 1 -- 172.21.15.77:0/3008782579 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d0404f500 con 0x7f9d04154380 2024-04-25T01:40:55.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.740+0000 7f9ceb7fe640 1 -- 172.21.15.77:0/3008782579 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9cfc00ab70 con 0x7f9d04154380 2024-04-25T01:40:55.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.740+0000 7f9ceb7fe640 1 --2- 172.21.15.77:0/3008782579 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9cf006be30 0x7f9cf006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:55.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.741+0000 7f9d02ffd640 1 --2- 172.21.15.77:0/3008782579 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9cf006be30 0x7f9cf006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:55.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.741+0000 7f9ceb7fe640 1 -- 172.21.15.77:0/3008782579 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6637+0+0 (secure 0 0 0) 0x7f9cfc08a710 con 0x7f9d04154380 2024-04-25T01:40:55.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.741+0000 7f9d02ffd640 1 --2- 172.21.15.77:0/3008782579 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9cf006be30 0x7f9cf006e2f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4034000 tx=0x7f9cf402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:55.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.745+0000 7f9ceb7fe640 1 -- 172.21.15.77:0/3008782579 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9cfc058d30 con 0x7f9d04154380 2024-04-25T01:40:55.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.953+0000 7f9d09476640 1 -- 172.21.15.77:0/3008782579 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d0414a0c0 con 0x7f9d04154380 2024-04-25T01:40:55.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.954+0000 7f9ceb7fe640 1 -- 172.21.15.77:0/3008782579 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6488 (secure 0 0 0) 0x7f9cfc058630 con 0x7f9d04154380 2024-04-25T01:40:55.940 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:40:55.940 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:39:36.787357+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6837/3454203695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3454203695},{"type":"v1","addr":"172.21.15.77:6837","nonce":3454203695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-04-25T01:40:55.940 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 12 2024-04-25T01:40:55.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.956+0000 7f9d09476640 1 -- 172.21.15.77:0/3008782579 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9cf006be30 msgr2=0x7f9cf006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:55.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.956+0000 7f9d09476640 1 --2- 172.21.15.77:0/3008782579 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9cf006be30 0x7f9cf006e2f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4034000 tx=0x7f9cf402e000 comp rx=0 tx=0).stop 2024-04-25T01:40:55.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.956+0000 7f9d09476640 1 -- 172.21.15.77:0/3008782579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d04154380 msgr2=0x7f9d0414bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:55.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.956+0000 7f9d09476640 1 --2- 172.21.15.77:0/3008782579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d04154380 0x7f9d0414bab0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc00c780 tx=0x7f9cfc00cc40 comp rx=0 tx=0).stop 2024-04-25T01:40:55.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.956+0000 7f9d09476640 1 -- 172.21.15.77:0/3008782579 shutdown_connections 2024-04-25T01:40:55.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.956+0000 7f9d09476640 1 --2- 172.21.15.77:0/3008782579 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9cf006be30 0x7f9cf006e2f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:55.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.956+0000 7f9d09476640 1 --2- 172.21.15.77:0/3008782579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d04154380 0x7f9d0414bab0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:55.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.956+0000 7f9d09476640 1 --2- 172.21.15.77:0/3008782579 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d04150320 0x7f9d040c5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:55.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.956+0000 7f9d09476640 1 --2- 172.21.15.77:0/3008782579 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d0406d0a0 0x7f9d041ed7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:55.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.956+0000 7f9d09476640 1 -- 172.21.15.77:0/3008782579 >> 172.21.15.77:0/3008782579 conn(0x7f9d040c3f80 msgr2=0x7f9d04155aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:55.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.956+0000 7f9d09476640 1 -- 172.21.15.77:0/3008782579 shutdown_connections 2024-04-25T01:40:55.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:55.956+0000 7f9d09476640 1 -- 172.21.15.77:0/3008782579 wait complete. 2024-04-25T01:40:55.953 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T01:40:57.954 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:40:58.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.076+0000 7f756bfe7640 1 Processor -- start 2024-04-25T01:40:58.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.077+0000 7f756bfe7640 1 -- start start 2024-04-25T01:40:58.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.077+0000 7f756bfe7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7564150090 0x7f7564156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:58.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.077+0000 7f756bfe7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f75640c8200 0x7f75640c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:58.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.077+0000 7f756bfe7640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f756406c280 0x7f75640c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:58.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.077+0000 7f756bfe7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f756406b830 con 0x7f7564150090 2024-04-25T01:40:58.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.077+0000 7f756bfe7640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f75640c9de0 con 0x7f756406c280 2024-04-25T01:40:58.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.077+0000 7f756bfe7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f75640c89c0 con 0x7f75640c8200 2024-04-25T01:40:58.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.077+0000 7f7569d83640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7564150090 0x7f7564156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:58.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.077+0000 7f7569d83640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7564150090 0x7f7564156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42932/0 (socket says 172.21.15.77:42932) 2024-04-25T01:40:58.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.077+0000 7f7569d83640 1 -- 172.21.15.77:0/2650319808 learned_addr learned my addr 172.21.15.77:0/2650319808 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:58.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.078+0000 7f7569d83640 1 -- 172.21.15.77:0/2650319808 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f75640c8200 msgr2=0x7f75640c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:58.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.078+0000 7f7569d83640 1 --2- 172.21.15.77:0/2650319808 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f75640c8200 0x7f75640c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:58.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.078+0000 7f7569d83640 1 -- 172.21.15.77:0/2650319808 >> v2:172.21.15.121:3300/0 conn(0x7f756406c280 msgr2=0x7f75640c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:40:58.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.078+0000 7f7569d83640 1 --2- 172.21.15.77:0/2650319808 >> v2:172.21.15.121:3300/0 conn(0x7f756406c280 0x7f75640c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:58.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.078+0000 7f7569d83640 1 -- 172.21.15.77:0/2650319808 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75640c8ca0 con 0x7f7564150090 2024-04-25T01:40:58.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.078+0000 7f7569d83640 1 --2- 172.21.15.77:0/2650319808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7564150090 0x7f7564156c80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f75640ab3d0 tx=0x7f755c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce7e065f2db3d8c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:58.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.079+0000 7f7568d81640 1 -- 172.21.15.77:0/2650319808 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c036070 con 0x7f7564150090 2024-04-25T01:40:58.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.079+0000 7f7568d81640 1 -- 172.21.15.77:0/2650319808 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f755c031600 con 0x7f7564150090 2024-04-25T01:40:58.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.079+0000 7f7568d81640 1 -- 172.21.15.77:0/2650319808 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c0319d0 con 0x7f7564150090 2024-04-25T01:40:58.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.079+0000 7f756bfe7640 1 -- 172.21.15.77:0/2650319808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7564150090 msgr2=0x7f7564156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:58.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.079+0000 7f756bfe7640 1 --2- 172.21.15.77:0/2650319808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7564150090 0x7f7564156c80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f75640ab3d0 tx=0x7f755c02a6a0 comp rx=0 tx=0).stop 2024-04-25T01:40:58.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.079+0000 7f756bfe7640 1 -- 172.21.15.77:0/2650319808 shutdown_connections 2024-04-25T01:40:58.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.079+0000 7f756bfe7640 1 --2- 172.21.15.77:0/2650319808 >> v2:172.21.15.121:3300/0 conn(0x7f756406c280 0x7f75640c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:58.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.079+0000 7f756bfe7640 1 --2- 172.21.15.77:0/2650319808 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f75640c8200 0x7f75640c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:58.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.079+0000 7f756bfe7640 1 --2- 172.21.15.77:0/2650319808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7564150090 0x7f7564156c80 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:58.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.079+0000 7f756bfe7640 1 -- 172.21.15.77:0/2650319808 >> 172.21.15.77:0/2650319808 conn(0x7f75640ad4d0 msgr2=0x7f75640ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:58.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.079+0000 7f756bfe7640 1 -- 172.21.15.77:0/2650319808 shutdown_connections 2024-04-25T01:40:58.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.079+0000 7f756bfe7640 1 -- 172.21.15.77:0/2650319808 wait complete. 2024-04-25T01:40:58.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.080+0000 7f756bfe7640 1 Processor -- start 2024-04-25T01:40:58.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.080+0000 7f756bfe7640 1 -- start start 2024-04-25T01:40:58.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.081+0000 7f756bfe7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f756406c280 0x7f7564150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:58.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.081+0000 7f756bfe7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75640c8200 0x7f7564154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:58.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.081+0000 7f756bfe7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7564150090 0x7f756414c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:58.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.081+0000 7f756bfe7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f75640c86b0 con 0x7f7564150090 2024-04-25T01:40:58.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.081+0000 7f756bfe7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f756406bd60 con 0x7f75640c8200 2024-04-25T01:40:58.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.081+0000 7f756bfe7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f756406c6d0 con 0x7f756406c280 2024-04-25T01:40:58.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.081+0000 7f756a584640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7564150090 0x7f756414c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:58.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.081+0000 7f756a584640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7564150090 0x7f756414c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42944/0 (socket says 172.21.15.77:42944) 2024-04-25T01:40:58.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.081+0000 7f756a584640 1 -- 172.21.15.77:0/331746178 learned_addr learned my addr 172.21.15.77:0/331746178 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:40:58.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.081+0000 7f7569d83640 1 --2- 172.21.15.77:0/331746178 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f756406c280 0x7f7564150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:58.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.081+0000 7f7569582640 1 --2- 172.21.15.77:0/331746178 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75640c8200 0x7f7564154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:58.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.081+0000 7f756a584640 1 -- 172.21.15.77:0/331746178 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f756406c280 msgr2=0x7f7564150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:58.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.081+0000 7f756a584640 1 --2- 172.21.15.77:0/331746178 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f756406c280 0x7f7564150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:58.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.081+0000 7f756a584640 1 -- 172.21.15.77:0/331746178 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75640c8200 msgr2=0x7f7564154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:58.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.081+0000 7f756a584640 1 --2- 172.21.15.77:0/331746178 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75640c8200 0x7f7564154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:58.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.081+0000 7f756a584640 1 -- 172.21.15.77:0/331746178 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7564151f40 con 0x7f7564150090 2024-04-25T01:40:58.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.081+0000 7f7569d83640 1 --2- 172.21.15.77:0/331746178 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f756406c280 0x7f7564150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:40:58.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.081+0000 7f7569582640 1 --2- 172.21.15.77:0/331746178 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75640c8200 0x7f7564154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:40:58.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.082+0000 7f756a584640 1 --2- 172.21.15.77:0/331746178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7564150090 0x7f756414c9a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f756000b410 tx=0x7f756000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:58.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.082+0000 7f755a7fc640 1 -- 172.21.15.77:0/331746178 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7560015020 con 0x7f7564150090 2024-04-25T01:40:58.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.082+0000 7f755a7fc640 1 -- 172.21.15.77:0/331746178 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7560011850 con 0x7f7564150090 2024-04-25T01:40:58.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.082+0000 7f756bfe7640 1 -- 172.21.15.77:0/331746178 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75641521e0 con 0x7f7564150090 2024-04-25T01:40:58.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.082+0000 7f755a7fc640 1 -- 172.21.15.77:0/331746178 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7560011c40 con 0x7f7564150090 2024-04-25T01:40:58.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.082+0000 7f756bfe7640 1 -- 172.21.15.77:0/331746178 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7564152c90 con 0x7f7564150090 2024-04-25T01:40:58.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.083+0000 7f756bfe7640 1 -- 172.21.15.77:0/331746178 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f756404f500 con 0x7f7564150090 2024-04-25T01:40:58.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.083+0000 7f755a7fc640 1 -- 172.21.15.77:0/331746178 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7560018020 con 0x7f7564150090 2024-04-25T01:40:58.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.084+0000 7f755a7fc640 1 --2- 172.21.15.77:0/331746178 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f754806be30 0x7f754806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:40:58.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.084+0000 7f755a7fc640 1 -- 172.21.15.77:0/331746178 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6637+0+0 (secure 0 0 0) 0x7f756008b050 con 0x7f7564150090 2024-04-25T01:40:58.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.084+0000 7f7569d83640 1 --2- 172.21.15.77:0/331746178 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f754806be30 0x7f754806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:40:58.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.084+0000 7f7569d83640 1 --2- 172.21.15.77:0/331746178 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f754806be30 0x7f754806e2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f755c033000 tx=0x7f755c009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:40:58.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.088+0000 7f755a7fc640 1 -- 172.21.15.77:0/331746178 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f756001f020 con 0x7f7564150090 2024-04-25T01:40:58.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.298+0000 7f756bfe7640 1 -- 172.21.15.77:0/331746178 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f756406cec0 con 0x7f7564150090 2024-04-25T01:40:58.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.299+0000 7f755a7fc640 1 -- 172.21.15.77:0/331746178 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6488 (secure 0 0 0) 0x7f75600172c0 con 0x7f7564150090 2024-04-25T01:40:58.286 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:40:58.286 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:39:36.787357+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.77:6837/3454203695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3454203695},{"type":"v1","addr":"172.21.15.77:6837","nonce":3454203695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-04-25T01:40:58.288 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 12 2024-04-25T01:40:58.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.301+0000 7f756bfe7640 1 -- 172.21.15.77:0/331746178 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f754806be30 msgr2=0x7f754806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:58.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.301+0000 7f756bfe7640 1 --2- 172.21.15.77:0/331746178 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f754806be30 0x7f754806e2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f755c033000 tx=0x7f755c009000 comp rx=0 tx=0).stop 2024-04-25T01:40:58.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.301+0000 7f756bfe7640 1 -- 172.21.15.77:0/331746178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7564150090 msgr2=0x7f756414c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:40:58.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.301+0000 7f756bfe7640 1 --2- 172.21.15.77:0/331746178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7564150090 0x7f756414c9a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f756000b410 tx=0x7f756000b8d0 comp rx=0 tx=0).stop 2024-04-25T01:40:58.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.301+0000 7f756bfe7640 1 -- 172.21.15.77:0/331746178 shutdown_connections 2024-04-25T01:40:58.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.301+0000 7f756bfe7640 1 --2- 172.21.15.77:0/331746178 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f754806be30 0x7f754806e2f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:58.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.301+0000 7f756bfe7640 1 --2- 172.21.15.77:0/331746178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7564150090 0x7f756414c9a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:58.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.301+0000 7f756bfe7640 1 --2- 172.21.15.77:0/331746178 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75640c8200 0x7f7564154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:58.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.301+0000 7f756bfe7640 1 --2- 172.21.15.77:0/331746178 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f756406c280 0x7f7564150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:40:58.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.301+0000 7f756bfe7640 1 -- 172.21.15.77:0/331746178 >> 172.21.15.77:0/331746178 conn(0x7f75640ad4d0 msgr2=0x7f7564153ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:40:58.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.301+0000 7f756bfe7640 1 -- 172.21.15.77:0/331746178 shutdown_connections 2024-04-25T01:40:58.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:40:58.301+0000 7f756bfe7640 1 -- 172.21.15.77:0/331746178 wait complete. 2024-04-25T01:40:58.299 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T01:41:00.299 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:00.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.427+0000 7f18f288c640 1 Processor -- start 2024-04-25T01:41:00.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.428+0000 7f18f288c640 1 -- start start 2024-04-25T01:41:00.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.428+0000 7f18f288c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f18ec06f840 0x7f18ec15a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:00.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.429+0000 7f18f288c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f18ec15ab90 0x7f18ec164db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:00.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.429+0000 7f18f288c640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18ec06f300 con 0x7f18ec157a10 2024-04-25T01:41:00.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.429+0000 7f18f288c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f18ec15da20 con 0x7f18ec06f840 2024-04-25T01:41:00.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.429+0000 7f18f288c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f18ec15e880 con 0x7f18ec15ab90 2024-04-25T01:41:00.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.429+0000 7f18eb7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f18ec06f840 0x7f18ec15a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:00.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.429+0000 7f18eb7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f18ec06f840 0x7f18ec15a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42956/0 (socket says 172.21.15.77:42956) 2024-04-25T01:41:00.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.429+0000 7f18eb7fe640 1 -- 172.21.15.77:0/467026823 learned_addr learned my addr 172.21.15.77:0/467026823 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:00.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.429+0000 7f18ebfff640 1 --1- 172.21.15.77:0/467026823 >> v1:172.21.15.121:6789/0 conn(0x7f18ec157a10 0x7f18ec0c40b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.77:53412/0 (socket says 172.21.15.77:53412) 2024-04-25T01:41:00.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.429+0000 7f18f0e29640 1 --2- 172.21.15.77:0/467026823 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f18ec15ab90 0x7f18ec164db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:00.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.429+0000 7f18eb7fe640 1 -- 172.21.15.77:0/467026823 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f18ec15ab90 msgr2=0x7f18ec164db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:00.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.429+0000 7f18eb7fe640 1 --2- 172.21.15.77:0/467026823 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f18ec15ab90 0x7f18ec164db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:00.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.429+0000 7f18eb7fe640 1 -- 172.21.15.77:0/467026823 >> v1:172.21.15.121:6789/0 conn(0x7f18ec157a10 legacy=0x7f18ec0c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:00.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.429+0000 7f18eb7fe640 1 -- 172.21.15.77:0/467026823 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18ec15dc70 con 0x7f18ec06f840 2024-04-25T01:41:00.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.429+0000 7f18eaffd640 1 -- 172.21.15.77:0/467026823 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1091378511 0 0) 0x7f18ec06f300 con 0x7f18ec157a10 2024-04-25T01:41:00.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.430+0000 7f18eb7fe640 1 --2- 172.21.15.77:0/467026823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18ec06f840 0x7f18ec15a650 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f18e0009870 tx=0x7f18e002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a9fc9ec3685234c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:00.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.430+0000 7f18eaffd640 1 -- 172.21.15.77:0/467026823 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e0037070 con 0x7f18ec06f840 2024-04-25T01:41:00.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.430+0000 7f18eaffd640 1 -- 172.21.15.77:0/467026823 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18e0032440 con 0x7f18ec06f840 2024-04-25T01:41:00.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.430+0000 7f18eaffd640 1 -- 172.21.15.77:0/467026823 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e0032810 con 0x7f18ec06f840 2024-04-25T01:41:00.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.431+0000 7f18f288c640 1 -- 172.21.15.77:0/467026823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18ec06f840 msgr2=0x7f18ec15a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:00.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.431+0000 7f18f288c640 1 --2- 172.21.15.77:0/467026823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18ec06f840 0x7f18ec15a650 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f18e0009870 tx=0x7f18e002a130 comp rx=0 tx=0).stop 2024-04-25T01:41:00.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.431+0000 7f18f288c640 1 -- 172.21.15.77:0/467026823 shutdown_connections 2024-04-25T01:41:00.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.431+0000 7f18f288c640 1 --2- 172.21.15.77:0/467026823 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f18ec15ab90 0x7f18ec164db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:00.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.431+0000 7f18f288c640 1 --2- 172.21.15.77:0/467026823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18ec06f840 0x7f18ec15a650 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:00.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.431+0000 7f18f288c640 1 -- 172.21.15.77:0/467026823 >> 172.21.15.77:0/467026823 conn(0x7f18ec0aa8f0 msgr2=0x7f18ec066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:00.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.431+0000 7f18f288c640 1 -- 172.21.15.77:0/467026823 shutdown_connections 2024-04-25T01:41:00.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.431+0000 7f18f288c640 1 -- 172.21.15.77:0/467026823 wait complete. 2024-04-25T01:41:00.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.432+0000 7f18f288c640 1 Processor -- start 2024-04-25T01:41:00.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.432+0000 7f18f288c640 1 -- start start 2024-04-25T01:41:00.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.433+0000 7f18f288c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f18ec06f840 0x7f18ec14e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:00.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.433+0000 7f18f288c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18ec157a10 0x7f18ec0c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:00.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.433+0000 7f18f288c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18ec15ab90 0x7f18ec150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:00.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.433+0000 7f18f288c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f18ec15e510 con 0x7f18ec157a10 2024-04-25T01:41:00.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.433+0000 7f18f288c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f18ec15e230 con 0x7f18ec15ab90 2024-04-25T01:41:00.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.433+0000 7f18f288c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f18ec157df0 con 0x7f18ec06f840 2024-04-25T01:41:00.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.433+0000 7f18eb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18ec157a10 0x7f18ec0c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:00.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.433+0000 7f18eb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18ec157a10 0x7f18ec0c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42964/0 (socket says 172.21.15.77:42964) 2024-04-25T01:41:00.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.433+0000 7f18eb7fe640 1 -- 172.21.15.77:0/619787713 learned_addr learned my addr 172.21.15.77:0/619787713 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:00.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.433+0000 7f18ebfff640 1 --2- 172.21.15.77:0/619787713 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f18ec06f840 0x7f18ec14e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:00.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.433+0000 7f18f0e29640 1 --2- 172.21.15.77:0/619787713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18ec15ab90 0x7f18ec150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:00.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.433+0000 7f18eb7fe640 1 -- 172.21.15.77:0/619787713 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f18ec06f840 msgr2=0x7f18ec14e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:00.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.433+0000 7f18eb7fe640 1 --2- 172.21.15.77:0/619787713 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f18ec06f840 0x7f18ec14e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:00.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.433+0000 7f18eb7fe640 1 -- 172.21.15.77:0/619787713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18ec15ab90 msgr2=0x7f18ec150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:00.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.433+0000 7f18eb7fe640 1 --2- 172.21.15.77:0/619787713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18ec15ab90 0x7f18ec150860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:00.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.433+0000 7f18eb7fe640 1 -- 172.21.15.77:0/619787713 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18ec1514c0 con 0x7f18ec157a10 2024-04-25T01:41:00.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.434+0000 7f18eb7fe640 1 --2- 172.21.15.77:0/619787713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18ec157a10 0x7f18ec0c8250 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f18e0000c00 tx=0x7f18e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:00.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.434+0000 7f18e8ff9640 1 -- 172.21.15.77:0/619787713 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e0037040 con 0x7f18ec157a10 2024-04-25T01:41:00.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.434+0000 7f18e8ff9640 1 -- 172.21.15.77:0/619787713 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18e0042070 con 0x7f18ec157a10 2024-04-25T01:41:00.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.434+0000 7f18f288c640 1 -- 172.21.15.77:0/619787713 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18ec14ebf0 con 0x7f18ec157a10 2024-04-25T01:41:00.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.434+0000 7f18e8ff9640 1 -- 172.21.15.77:0/619787713 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e0030880 con 0x7f18ec157a10 2024-04-25T01:41:00.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.434+0000 7f18f288c640 1 -- 172.21.15.77:0/619787713 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18ec1511e0 con 0x7f18ec157a10 2024-04-25T01:41:00.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.435+0000 7f18f288c640 1 -- 172.21.15.77:0/619787713 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18ec04f500 con 0x7f18ec157a10 2024-04-25T01:41:00.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.435+0000 7f18e8ff9640 1 -- 172.21.15.77:0/619787713 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f18e0030a20 con 0x7f18ec157a10 2024-04-25T01:41:00.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.436+0000 7f18e8ff9640 1 --2- 172.21.15.77:0/619787713 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f18d806be30 0x7f18d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:00.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.436+0000 7f18e8ff9640 1 -- 172.21.15.77:0/619787713 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6723+0+0 (secure 0 0 0) 0x7f18e00ab880 con 0x7f18ec157a10 2024-04-25T01:41:00.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.436+0000 7f18ebfff640 1 --2- 172.21.15.77:0/619787713 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f18d806be30 0x7f18d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:00.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.436+0000 7f18ebfff640 1 --2- 172.21.15.77:0/619787713 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f18d806be30 0x7f18d806e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f18dc007f70 tx=0x7f18dc007f00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:00.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.440+0000 7f18e8ff9640 1 -- 172.21.15.77:0/619787713 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f18e0079870 con 0x7f18ec157a10 2024-04-25T01:41:00.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.649+0000 7f18f288c640 1 -- 172.21.15.77:0/619787713 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18ec06f620 con 0x7f18ec157a10 2024-04-25T01:41:00.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.650+0000 7f18e8ff9640 1 -- 172.21.15.77:0/619787713 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5663 (secure 0 0 0) 0x7f18e007db70 con 0x7f18ec157a10 2024-04-25T01:41:00.636 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:00.636 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:40:59.388333+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":13,"state":"up:reconnect","state_seq":27,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-25T01:41:00.636 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 14 2024-04-25T01:41:00.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.652+0000 7f18f288c640 1 -- 172.21.15.77:0/619787713 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f18d806be30 msgr2=0x7f18d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:00.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.652+0000 7f18f288c640 1 --2- 172.21.15.77:0/619787713 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f18d806be30 0x7f18d806e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f18dc007f70 tx=0x7f18dc007f00 comp rx=0 tx=0).stop 2024-04-25T01:41:00.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.652+0000 7f18f288c640 1 -- 172.21.15.77:0/619787713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18ec157a10 msgr2=0x7f18ec0c8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:00.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.652+0000 7f18f288c640 1 --2- 172.21.15.77:0/619787713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18ec157a10 0x7f18ec0c8250 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f18e0000c00 tx=0x7f18e00046c0 comp rx=0 tx=0).stop 2024-04-25T01:41:00.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.652+0000 7f18f288c640 1 -- 172.21.15.77:0/619787713 shutdown_connections 2024-04-25T01:41:00.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.652+0000 7f18f288c640 1 --2- 172.21.15.77:0/619787713 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f18d806be30 0x7f18d806e2f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:00.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.652+0000 7f18f288c640 1 --2- 172.21.15.77:0/619787713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18ec157a10 0x7f18ec0c8250 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:00.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.652+0000 7f18f288c640 1 --2- 172.21.15.77:0/619787713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18ec15ab90 0x7f18ec150860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:00.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.652+0000 7f18f288c640 1 --2- 172.21.15.77:0/619787713 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f18ec06f840 0x7f18ec14e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:00.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.652+0000 7f18f288c640 1 -- 172.21.15.77:0/619787713 >> 172.21.15.77:0/619787713 conn(0x7f18ec0aa8f0 msgr2=0x7f18ec072e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:00.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.652+0000 7f18f288c640 1 -- 172.21.15.77:0/619787713 shutdown_connections 2024-04-25T01:41:00.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.652+0000 7f18f288c640 1 -- 172.21.15.77:0/619787713 wait complete. 2024-04-25T01:41:00.649 INFO:tasks.mds_thrash.fs.[b]:mds.c down, removed from mdsmap 2024-04-25T01:41:00.649 INFO:tasks.mds_thrash.fs.[b]:waiting for mds cluster to stabilize... 2024-04-25T01:41:00.649 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:00.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.759+0000 7fd365bb7640 1 Processor -- start 2024-04-25T01:41:00.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.759+0000 7fd365bb7640 1 -- start start 2024-04-25T01:41:00.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.760+0000 7fd365bb7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd360150090 0x7fd360156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:00.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.760+0000 7fd365bb7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd36006c280 0x7fd3600c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:00.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.760+0000 7fd365bb7640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3600c89c0 con 0x7fd3600c8200 2024-04-25T01:41:00.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.760+0000 7fd365bb7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd36006b830 con 0x7fd360150090 2024-04-25T01:41:00.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.760+0000 7fd365bb7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd3600c8ca0 con 0x7fd36006c280 2024-04-25T01:41:00.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.760+0000 7fd35f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd360150090 0x7fd360156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:00.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.760+0000 7fd35f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd360150090 0x7fd360156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42966/0 (socket says 172.21.15.77:42966) 2024-04-25T01:41:00.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.760+0000 7fd35f7fe640 1 -- 172.21.15.77:0/3379543663 learned_addr learned my addr 172.21.15.77:0/3379543663 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:00.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.760+0000 7fd35ffff640 1 --2- 172.21.15.77:0/3379543663 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd36006c280 0x7fd3600c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:00.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.761+0000 7fd35f7fe640 1 -- 172.21.15.77:0/3379543663 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd36006c280 msgr2=0x7fd3600c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:00.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.761+0000 7fd35f7fe640 1 --2- 172.21.15.77:0/3379543663 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd36006c280 0x7fd3600c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:00.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.761+0000 7fd35f7fe640 1 -- 172.21.15.77:0/3379543663 >> v1:172.21.15.121:6789/0 conn(0x7fd3600c8200 legacy=0x7fd3600c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:00.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.761+0000 7fd35f7fe640 1 -- 172.21.15.77:0/3379543663 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd36006ba80 con 0x7fd360150090 2024-04-25T01:41:00.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.761+0000 7fd35ffff640 1 --2- 172.21.15.77:0/3379543663 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd36006c280 0x7fd3600c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:41:00.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.761+0000 7fd35f7fe640 1 --2- 172.21.15.77:0/3379543663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd360150090 0x7fd360156c80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd350009870 tx=0x7fd35002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ab899f0b05909f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:00.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.761+0000 7fd35e7fc640 1 -- 172.21.15.77:0/3379543663 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd350037070 con 0x7fd360150090 2024-04-25T01:41:00.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.761+0000 7fd35e7fc640 1 -- 172.21.15.77:0/3379543663 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd350032440 con 0x7fd360150090 2024-04-25T01:41:00.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.761+0000 7fd35e7fc640 1 -- 172.21.15.77:0/3379543663 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd350032810 con 0x7fd360150090 2024-04-25T01:41:00.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.762+0000 7fd365bb7640 1 -- 172.21.15.77:0/3379543663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd360150090 msgr2=0x7fd360156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:00.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.762+0000 7fd365bb7640 1 --2- 172.21.15.77:0/3379543663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd360150090 0x7fd360156c80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd350009870 tx=0x7fd35002a270 comp rx=0 tx=0).stop 2024-04-25T01:41:00.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.762+0000 7fd365bb7640 1 -- 172.21.15.77:0/3379543663 shutdown_connections 2024-04-25T01:41:00.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.762+0000 7fd365bb7640 1 --2- 172.21.15.77:0/3379543663 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd36006c280 0x7fd3600c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:00.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.762+0000 7fd365bb7640 1 --2- 172.21.15.77:0/3379543663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd360150090 0x7fd360156c80 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:00.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.762+0000 7fd365bb7640 1 -- 172.21.15.77:0/3379543663 >> 172.21.15.77:0/3379543663 conn(0x7fd3600ad4d0 msgr2=0x7fd3600ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:00.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.762+0000 7fd365bb7640 1 -- 172.21.15.77:0/3379543663 shutdown_connections 2024-04-25T01:41:00.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.762+0000 7fd365bb7640 1 -- 172.21.15.77:0/3379543663 wait complete. 2024-04-25T01:41:00.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.763+0000 7fd365bb7640 1 Processor -- start 2024-04-25T01:41:00.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.763+0000 7fd365bb7640 1 -- start start 2024-04-25T01:41:00.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.764+0000 7fd365bb7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd36006c280 0x7fd360152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:00.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.764+0000 7fd365bb7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3600c8200 0x7fd360151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:00.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.764+0000 7fd365bb7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd360150090 0x7fd3601523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:00.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.764+0000 7fd365bb7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd36006c6b0 con 0x7fd3600c8200 2024-04-25T01:41:00.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.764+0000 7fd365bb7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd3600c86b0 con 0x7fd36006c280 2024-04-25T01:41:00.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.764+0000 7fd365bb7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd36006c830 con 0x7fd360150090 2024-04-25T01:41:00.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.764+0000 7fd35effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3600c8200 0x7fd360151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:00.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.764+0000 7fd35effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3600c8200 0x7fd360151e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42978/0 (socket says 172.21.15.77:42978) 2024-04-25T01:41:00.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.764+0000 7fd35effd640 1 -- 172.21.15.77:0/662402533 learned_addr learned my addr 172.21.15.77:0/662402533 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:00.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.764+0000 7fd35ffff640 1 --2- 172.21.15.77:0/662402533 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd360150090 0x7fd3601523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:00.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.764+0000 7fd35f7fe640 1 --2- 172.21.15.77:0/662402533 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd36006c280 0x7fd360152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:00.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.764+0000 7fd35effd640 1 -- 172.21.15.77:0/662402533 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd360150090 msgr2=0x7fd3601523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:00.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.764+0000 7fd35effd640 1 --2- 172.21.15.77:0/662402533 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd360150090 0x7fd3601523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:00.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.764+0000 7fd35effd640 1 -- 172.21.15.77:0/662402533 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd36006c280 msgr2=0x7fd360152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:00.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.764+0000 7fd35effd640 1 --2- 172.21.15.77:0/662402533 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd36006c280 0x7fd360152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:00.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.764+0000 7fd35effd640 1 -- 172.21.15.77:0/662402533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3601ec8e0 con 0x7fd3600c8200 2024-04-25T01:41:00.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.764+0000 7fd35f7fe640 1 --2- 172.21.15.77:0/662402533 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd36006c280 0x7fd360152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:41:00.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.764+0000 7fd35effd640 1 --2- 172.21.15.77:0/662402533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3600c8200 0x7fd360151e70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd35400c440 tx=0x7fd354001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:00.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.765+0000 7fd347fff640 1 -- 172.21.15.77:0/662402533 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3540052d0 con 0x7fd3600c8200 2024-04-25T01:41:00.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.765+0000 7fd347fff640 1 -- 172.21.15.77:0/662402533 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd354005470 con 0x7fd3600c8200 2024-04-25T01:41:00.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.765+0000 7fd347fff640 1 -- 172.21.15.77:0/662402533 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd354007260 con 0x7fd3600c8200 2024-04-25T01:41:00.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.765+0000 7fd365bb7640 1 -- 172.21.15.77:0/662402533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd360150680 con 0x7fd3600c8200 2024-04-25T01:41:00.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.765+0000 7fd365bb7640 1 -- 172.21.15.77:0/662402533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd360151950 con 0x7fd3600c8200 2024-04-25T01:41:00.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.766+0000 7fd365bb7640 1 -- 172.21.15.77:0/662402533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3601ecde0 con 0x7fd3600c8200 2024-04-25T01:41:00.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.766+0000 7fd347fff640 1 -- 172.21.15.77:0/662402533 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd354007400 con 0x7fd3600c8200 2024-04-25T01:41:00.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.767+0000 7fd347fff640 1 --2- 172.21.15.77:0/662402533 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd34c06be30 0x7fd34c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:00.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.767+0000 7fd35f7fe640 1 --2- 172.21.15.77:0/662402533 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd34c06be30 0x7fd34c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:00.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.767+0000 7fd347fff640 1 -- 172.21.15.77:0/662402533 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6723+0+0 (secure 0 0 0) 0x7fd35408a630 con 0x7fd3600c8200 2024-04-25T01:41:00.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.767+0000 7fd35f7fe640 1 --2- 172.21.15.77:0/662402533 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd34c06be30 0x7fd34c06e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd350034000 tx=0x7fd35002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:00.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.771+0000 7fd347fff640 1 -- 172.21.15.77:0/662402533 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd3601ecde0 con 0x7fd3600c8200 2024-04-25T01:41:00.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.979+0000 7fd365bb7640 1 -- 172.21.15.77:0/662402533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd36004f500 con 0x7fd3600c8200 2024-04-25T01:41:00.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.980+0000 7fd347fff640 1 -- 172.21.15.77:0/662402533 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5663 (secure 0 0 0) 0x7fd354058620 con 0x7fd3600c8200 2024-04-25T01:41:00.966 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:00.966 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:40:59.388333+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":13,"state":"up:reconnect","state_seq":27,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-25T01:41:00.966 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 14 2024-04-25T01:41:00.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.981+0000 7fd365bb7640 1 -- 172.21.15.77:0/662402533 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd34c06be30 msgr2=0x7fd34c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:00.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.982+0000 7fd365bb7640 1 --2- 172.21.15.77:0/662402533 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd34c06be30 0x7fd34c06e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd350034000 tx=0x7fd35002e000 comp rx=0 tx=0).stop 2024-04-25T01:41:00.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.982+0000 7fd365bb7640 1 -- 172.21.15.77:0/662402533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3600c8200 msgr2=0x7fd360151e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:00.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.982+0000 7fd365bb7640 1 --2- 172.21.15.77:0/662402533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3600c8200 0x7fd360151e70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd35400c440 tx=0x7fd354001e70 comp rx=0 tx=0).stop 2024-04-25T01:41:00.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.982+0000 7fd365bb7640 1 -- 172.21.15.77:0/662402533 shutdown_connections 2024-04-25T01:41:00.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.982+0000 7fd365bb7640 1 --2- 172.21.15.77:0/662402533 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd34c06be30 0x7fd34c06e2f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:00.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.982+0000 7fd365bb7640 1 --2- 172.21.15.77:0/662402533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3600c8200 0x7fd360151e70 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:00.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.982+0000 7fd365bb7640 1 --2- 172.21.15.77:0/662402533 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd360150090 0x7fd3601523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:00.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.982+0000 7fd365bb7640 1 --2- 172.21.15.77:0/662402533 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd36006c280 0x7fd360152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:00.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.982+0000 7fd365bb7640 1 -- 172.21.15.77:0/662402533 >> 172.21.15.77:0/662402533 conn(0x7fd3600ad4d0 msgr2=0x7fd3600c6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:00.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.982+0000 7fd365bb7640 1 -- 172.21.15.77:0/662402533 shutdown_connections 2024-04-25T01:41:00.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:00.982+0000 7fd365bb7640 1 -- 172.21.15.77:0/662402533 wait complete. 2024-04-25T01:41:00.979 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 14, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T01:39:23.701997+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 7, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_4290": { "addr": "172.21.15.121:6835/2449150984", "addrs": { "addrvec": [ { "addr": "172.21.15.121:6833", "nonce": 2449150984, "type": "v2" }, { "addr": "172.21.15.121:6835", "nonce": 2449150984, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4290, "incarnation": 4, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:active", "state_seq": 3 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-25T01:39:26.722911+0000", "qdb_cluster": [ 4290 ], "qdb_leader": 4290, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4290 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T01:39:32.761220+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 14, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_4275": { "addr": "172.21.15.77:6835/1958322306", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6834", "nonce": 1958322306, "type": "v2" }, { "addr": "172.21.15.77:6835", "nonce": 1958322306, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4275, "incarnation": 13, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:reconnect", "state_seq": 27 } }, "last_failure": 0, "last_failure_osd_epoch": 27, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-04-25T01:40:59.388333+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4275 } } } ], "standbys": [ { "addr": "172.21.15.121:6834/1039950655", "addrs": { "addrvec": [ { "addr": "172.21.15.121:6832", "nonce": 1039950655, "type": "v2" }, { "addr": "172.21.15.121:6834", "nonce": 1039950655, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4250, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-25T01:41:02.980 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:03.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.099+0000 7fe5ccfee640 1 Processor -- start 2024-04-25T01:41:03.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.099+0000 7fe5ccfee640 1 -- start start 2024-04-25T01:41:03.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.099+0000 7fe5ccfee640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe5c8150320 0x7fe5c8156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:03.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.100+0000 7fe5ccfee640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5c8153be0 con 0x7fe5c806d4e0 2024-04-25T01:41:03.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.100+0000 7fe5ccfee640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5c8157100 con 0x7fe5c806d0a0 2024-04-25T01:41:03.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.100+0000 7fe5ccfee640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe5c8152fd0 con 0x7fe5c8150320 2024-04-25T01:41:03.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.100+0000 7fe5c6d9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe5c806d4e0 0x7fe5c8154a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44340/0 (socket says 172.21.15.77:44340) 2024-04-25T01:41:03.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.100+0000 7fe5c6d9d640 1 -- 172.21.15.77:0/2217157743 learned_addr learned my addr 172.21.15.77:0/2217157743 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:41:03.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.100+0000 7fe5c659c640 1 --2- 172.21.15.77:0/2217157743 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe5c8150320 0x7fe5c8156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:03.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.100+0000 7fe5c5d9b640 1 -- 172.21.15.77:0/2217157743 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2983663059 0 0) 0x7fe5c8153be0 con 0x7fe5c806d4e0 2024-04-25T01:41:03.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.100+0000 7fe5c5d9b640 1 -- 172.21.15.77:0/2217157743 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5b4003520 con 0x7fe5c806d4e0 2024-04-25T01:41:03.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.100+0000 7fe5c5d9b640 1 -- 172.21.15.77:0/2217157743 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1536842317 0 0) 0x7fe5b4003520 con 0x7fe5c806d4e0 2024-04-25T01:41:03.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.100+0000 7fe5c5d9b640 1 -- 172.21.15.77:0/2217157743 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe5c8150320 msgr2=0x7fe5c8156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:03.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.100+0000 7fe5c5d9b640 1 --2- 172.21.15.77:0/2217157743 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe5c8150320 0x7fe5c8156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:03.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.100+0000 7fe5c5d9b640 1 -- 172.21.15.77:0/2217157743 >> v1:172.21.15.121:6789/0 conn(0x7fe5c806d0a0 legacy=0x7fe5c8154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:03.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.100+0000 7fe5c5d9b640 1 -- 172.21.15.77:0/2217157743 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c81532b0 con 0x7fe5c806d4e0 2024-04-25T01:41:03.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.100+0000 7fe5c5d9b640 1 -- 172.21.15.77:0/2217157743 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7fe5c00019f0 con 0x7fe5c806d4e0 2024-04-25T01:41:03.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.100+0000 7fe5c5d9b640 1 -- 172.21.15.77:0/2217157743 >> v1:172.21.15.77:6789/0 conn(0x7fe5c806d4e0 legacy=0x7fe5c8154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:03.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.100+0000 7fe5c5d9b640 1 --2- 172.21.15.77:0/2217157743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5b40039e0 0x7fe5b4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:03.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.100+0000 7fe5c5d9b640 1 --2- 172.21.15.77:0/2217157743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5b4004800 0x7fe5b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:03.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.100+0000 7fe5c5d9b640 1 --2- 172.21.15.77:0/2217157743 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe5c8150320 0x7fe5b4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:03.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.100+0000 7fe5c5d9b640 1 -- 172.21.15.77:0/2217157743 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c8152fd0 con 0x7fe5b4004800 2024-04-25T01:41:03.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.100+0000 7fe5c5d9b640 1 -- 172.21.15.77:0/2217157743 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b400baf0 con 0x7fe5b40039e0 2024-04-25T01:41:03.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.100+0000 7fe5c5d9b640 1 -- 172.21.15.77:0/2217157743 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe5b400bcf0 con 0x7fe5c8150320 2024-04-25T01:41:03.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.100+0000 7fe5bffff640 1 --2- 172.21.15.77:0/2217157743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5b4004800 0x7fe5b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:03.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.100+0000 7fe5c659c640 1 --2- 172.21.15.77:0/2217157743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5b40039e0 0x7fe5b4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:03.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.101+0000 7fe5c6d9d640 1 --2- 172.21.15.77:0/2217157743 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe5c8150320 0x7fe5b4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:03.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.101+0000 7fe5bffff640 1 -- 172.21.15.77:0/2217157743 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe5c8150320 msgr2=0x7fe5b4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:03.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.101+0000 7fe5bffff640 1 --2- 172.21.15.77:0/2217157743 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe5c8150320 0x7fe5b4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:03.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.101+0000 7fe5bffff640 1 -- 172.21.15.77:0/2217157743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5b40039e0 msgr2=0x7fe5b4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:03.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.101+0000 7fe5bffff640 1 --2- 172.21.15.77:0/2217157743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5b40039e0 0x7fe5b4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:03.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.101+0000 7fe5bffff640 1 -- 172.21.15.77:0/2217157743 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5b4003520 con 0x7fe5b4004800 2024-04-25T01:41:03.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.101+0000 7fe5bffff640 1 --2- 172.21.15.77:0/2217157743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5b4004800 0x7fe5b4004c80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0001750 tx=0x7fe5b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=825f5ab67afded87 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:03.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.102+0000 7fe5c5d9b640 1 -- 172.21.15.77:0/2217157743 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0001370 con 0x7fe5b4004800 2024-04-25T01:41:03.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.102+0000 7fe5c5d9b640 1 -- 172.21.15.77:0/2217157743 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5b00052d0 con 0x7fe5b4004800 2024-04-25T01:41:03.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.102+0000 7fe5c5d9b640 1 -- 172.21.15.77:0/2217157743 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b002abe0 con 0x7fe5b4004800 2024-04-25T01:41:03.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.102+0000 7fe5ccfee640 1 -- 172.21.15.77:0/2217157743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5b4004800 msgr2=0x7fe5b4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:03.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.102+0000 7fe5ccfee640 1 --2- 172.21.15.77:0/2217157743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5b4004800 0x7fe5b4004c80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0001750 tx=0x7fe5b4005830 comp rx=0 tx=0).stop 2024-04-25T01:41:03.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.102+0000 7fe5c6d9d640 1 -- 172.21.15.77:0/2217157743 reap_dead start 2024-04-25T01:41:03.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.102+0000 7fe5ccfee640 1 -- 172.21.15.77:0/2217157743 shutdown_connections 2024-04-25T01:41:03.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.102+0000 7fe5ccfee640 1 -- 172.21.15.77:0/2217157743 >> 172.21.15.77:0/2217157743 conn(0x7fe5c80c3f80 msgr2=0x7fe5c80c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:03.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.102+0000 7fe5ccfee640 1 -- 172.21.15.77:0/2217157743 shutdown_connections 2024-04-25T01:41:03.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.102+0000 7fe5ccfee640 1 -- 172.21.15.77:0/2217157743 wait complete. 2024-04-25T01:41:03.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.103+0000 7fe5ccfee640 1 Processor -- start 2024-04-25T01:41:03.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.103+0000 7fe5ccfee640 1 -- start start 2024-04-25T01:41:03.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.104+0000 7fe5ccfee640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5b4004800 0x7fe5c80c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:03.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.104+0000 7fe5ccfee640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5c8149ab0 0x7fe5c80c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:03.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.104+0000 7fe5ccfee640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe5c8071ef0 0x7fe5c81ecba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:03.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.104+0000 7fe5ccfee640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c8152bf0 con 0x7fe5c8149ab0 2024-04-25T01:41:03.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.104+0000 7fe5ccfee640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c8153870 con 0x7fe5b4004800 2024-04-25T01:41:03.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.104+0000 7fe5ccfee640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe5c8152d70 con 0x7fe5c8071ef0 2024-04-25T01:41:03.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.104+0000 7fe5bffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5c8149ab0 0x7fe5c80c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:03.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.104+0000 7fe5bffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5c8149ab0 0x7fe5c80c7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42988/0 (socket says 172.21.15.77:42988) 2024-04-25T01:41:03.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.104+0000 7fe5bffff640 1 -- 172.21.15.77:0/1052077398 learned_addr learned my addr 172.21.15.77:0/1052077398 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:03.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.104+0000 7fe5c6d9d640 1 --2- 172.21.15.77:0/1052077398 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe5c8071ef0 0x7fe5c81ecba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:03.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.104+0000 7fe5c659c640 1 --2- 172.21.15.77:0/1052077398 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5b4004800 0x7fe5c80c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:03.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.104+0000 7fe5bffff640 1 -- 172.21.15.77:0/1052077398 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe5c8071ef0 msgr2=0x7fe5c81ecba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:03.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.104+0000 7fe5bffff640 1 --2- 172.21.15.77:0/1052077398 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe5c8071ef0 0x7fe5c81ecba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:03.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.104+0000 7fe5bffff640 1 -- 172.21.15.77:0/1052077398 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5b4004800 msgr2=0x7fe5c80c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:03.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.104+0000 7fe5bffff640 1 --2- 172.21.15.77:0/1052077398 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5b4004800 0x7fe5c80c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:03.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.104+0000 7fe5bffff640 1 -- 172.21.15.77:0/1052077398 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c8149860 con 0x7fe5c8149ab0 2024-04-25T01:41:03.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.104+0000 7fe5c659c640 1 --2- 172.21.15.77:0/1052077398 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5b4004800 0x7fe5c80c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:41:03.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.105+0000 7fe5bffff640 1 --2- 172.21.15.77:0/1052077398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5c8149ab0 0x7fe5c80c7cd0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe5b002a590 tx=0x7fe5b0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:03.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.105+0000 7fe5beffd640 1 -- 172.21.15.77:0/1052077398 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0037040 con 0x7fe5c8149ab0 2024-04-25T01:41:03.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.105+0000 7fe5beffd640 1 -- 172.21.15.77:0/1052077398 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5b0005480 con 0x7fe5c8149ab0 2024-04-25T01:41:03.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.105+0000 7fe5ccfee640 1 -- 172.21.15.77:0/1052077398 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5c8149580 con 0x7fe5c8149ab0 2024-04-25T01:41:03.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.105+0000 7fe5beffd640 1 -- 172.21.15.77:0/1052077398 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0007a30 con 0x7fe5c8149ab0 2024-04-25T01:41:03.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.105+0000 7fe5ccfee640 1 -- 172.21.15.77:0/1052077398 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5c80c6390 con 0x7fe5c8149ab0 2024-04-25T01:41:03.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.106+0000 7fe5ccfee640 1 -- 172.21.15.77:0/1052077398 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5c804f500 con 0x7fe5c8149ab0 2024-04-25T01:41:03.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.106+0000 7fe5beffd640 1 -- 172.21.15.77:0/1052077398 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe5b0044020 con 0x7fe5c8149ab0 2024-04-25T01:41:03.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.106+0000 7fe5beffd640 1 --2- 172.21.15.77:0/1052077398 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe5a806be60 0x7fe5a806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:03.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.107+0000 7fe5beffd640 1 -- 172.21.15.77:0/1052077398 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6723+0+0 (secure 0 0 0) 0x7fe5b00aaaf0 con 0x7fe5c8149ab0 2024-04-25T01:41:03.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.107+0000 7fe5c659c640 1 --2- 172.21.15.77:0/1052077398 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe5a806be60 0x7fe5a806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:03.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.107+0000 7fe5c659c640 1 --2- 172.21.15.77:0/1052077398 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe5a806be60 0x7fe5a806e320 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe5c814daa0 tx=0x7fe5b8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:03.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.112+0000 7fe5beffd640 1 -- 172.21.15.77:0/1052077398 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe5b004b020 con 0x7fe5c8149ab0 2024-04-25T01:41:03.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.329+0000 7fe5ccfee640 1 -- 172.21.15.77:0/1052077398 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe5c8073750 con 0x7fe5c8149ab0 2024-04-25T01:41:03.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.330+0000 7fe5beffd640 1 -- 172.21.15.77:0/1052077398 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5667 (secure 0 0 0) 0x7fe5b0079130 con 0x7fe5c8149ab0 2024-04-25T01:41:03.316 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:03.316 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:02.386295+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":29,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":2}]} 2024-04-25T01:41:03.317 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 16 2024-04-25T01:41:03.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.333+0000 7fe5ccfee640 1 -- 172.21.15.77:0/1052077398 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe5a806be60 msgr2=0x7fe5a806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:03.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.333+0000 7fe5ccfee640 1 --2- 172.21.15.77:0/1052077398 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe5a806be60 0x7fe5a806e320 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe5c814daa0 tx=0x7fe5b8008040 comp rx=0 tx=0).stop 2024-04-25T01:41:03.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.333+0000 7fe5ccfee640 1 -- 172.21.15.77:0/1052077398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5c8149ab0 msgr2=0x7fe5c80c7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:03.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.333+0000 7fe5ccfee640 1 --2- 172.21.15.77:0/1052077398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5c8149ab0 0x7fe5c80c7cd0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe5b002a590 tx=0x7fe5b0001120 comp rx=0 tx=0).stop 2024-04-25T01:41:03.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.333+0000 7fe5ccfee640 1 -- 172.21.15.77:0/1052077398 shutdown_connections 2024-04-25T01:41:03.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.333+0000 7fe5ccfee640 1 --2- 172.21.15.77:0/1052077398 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe5a806be60 0x7fe5a806e320 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:03.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.333+0000 7fe5ccfee640 1 --2- 172.21.15.77:0/1052077398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5c8149ab0 0x7fe5c80c7cd0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:03.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.333+0000 7fe5ccfee640 1 --2- 172.21.15.77:0/1052077398 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe5c8071ef0 0x7fe5c81ecba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:03.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.333+0000 7fe5ccfee640 1 --2- 172.21.15.77:0/1052077398 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5b4004800 0x7fe5c80c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:03.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.333+0000 7fe5ccfee640 1 -- 172.21.15.77:0/1052077398 >> 172.21.15.77:0/1052077398 conn(0x7fe5c80c3f80 msgr2=0x7fe5c8155b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:03.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.333+0000 7fe5ccfee640 1 -- 172.21.15.77:0/1052077398 shutdown_connections 2024-04-25T01:41:03.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:03.333+0000 7fe5ccfee640 1 -- 172.21.15.77:0/1052077398 wait complete. 2024-04-25T01:41:03.329 INFO:tasks.mds_thrash.fs.[b]:mds.a has gained rank=0, replacing gid=4278 2024-04-25T01:41:03.329 INFO:tasks.mds_thrash.fs.[b]:waiting for 2 secs before reviving mds.c 2024-04-25T01:41:05.330 INFO:tasks.mds_thrash.fs.[b]:reviving mds.c 2024-04-25T01:41:05.330 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T01:41:05.330 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T01:41:05.333 INFO:tasks.ceph.mds.c:Started 2024-04-25T01:41:05.333 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:05.407 INFO:tasks.ceph.mds.c.smithi077.stdout:starting mds.c at 2024-04-25T01:41:05.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.448+0000 7f6afba3f640 1 Processor -- start 2024-04-25T01:41:05.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.448+0000 7f6afba3f640 1 -- start start 2024-04-25T01:41:05.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.449+0000 7f6afba3f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6af4150090 0x7f6af4156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:05.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.449+0000 7f6afba3f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6af40c8200 0x7f6af40c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:05.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.449+0000 7f6afba3f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6af406c280 0x7f6af40c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:05.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.449+0000 7f6afba3f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f6af406b830 con 0x7f6af4150090 2024-04-25T01:41:05.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.449+0000 7f6afba3f640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f6af40c9de0 con 0x7f6af406c280 2024-04-25T01:41:05.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.449+0000 7f6afba3f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f6af40c89c0 con 0x7f6af40c8200 2024-04-25T01:41:05.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.449+0000 7f6af97db640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6af4150090 0x7f6af4156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:05.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.449+0000 7f6af97db640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6af4150090 0x7f6af4156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43018/0 (socket says 172.21.15.77:43018) 2024-04-25T01:41:05.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.449+0000 7f6af97db640 1 -- 172.21.15.77:0/2945021807 learned_addr learned my addr 172.21.15.77:0/2945021807 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:05.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.449+0000 7f6af9fdc640 1 --2- 172.21.15.77:0/2945021807 >> v2:172.21.15.121:3300/0 conn(0x7f6af406c280 0x7f6af40c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:05.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.449+0000 7f6af8fda640 1 --2- 172.21.15.77:0/2945021807 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6af40c8200 0x7f6af40c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:05.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.449+0000 7f6af97db640 1 -- 172.21.15.77:0/2945021807 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6af40c8200 msgr2=0x7f6af40c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:05.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.449+0000 7f6af97db640 1 --2- 172.21.15.77:0/2945021807 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6af40c8200 0x7f6af40c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:05.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.449+0000 7f6af97db640 1 -- 172.21.15.77:0/2945021807 >> v2:172.21.15.121:3300/0 conn(0x7f6af406c280 msgr2=0x7f6af40c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:05.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.449+0000 7f6af97db640 1 --2- 172.21.15.77:0/2945021807 >> v2:172.21.15.121:3300/0 conn(0x7f6af406c280 0x7f6af40c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:05.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.449+0000 7f6af97db640 1 -- 172.21.15.77:0/2945021807 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af40c8ca0 con 0x7f6af4150090 2024-04-25T01:41:05.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.450+0000 7f6af97db640 1 --2- 172.21.15.77:0/2945021807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6af4150090 0x7f6af4156c80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6af40ab3d0 tx=0x7f6af002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b7503177073a21 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:05.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.450+0000 7f6aebfff640 1 -- 172.21.15.77:0/2945021807 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af0037070 con 0x7f6af4150090 2024-04-25T01:41:05.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.450+0000 7f6aebfff640 1 -- 172.21.15.77:0/2945021807 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6af0032440 con 0x7f6af4150090 2024-04-25T01:41:05.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.450+0000 7f6aebfff640 1 -- 172.21.15.77:0/2945021807 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af0032810 con 0x7f6af4150090 2024-04-25T01:41:05.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.451+0000 7f6afba3f640 1 -- 172.21.15.77:0/2945021807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6af4150090 msgr2=0x7f6af4156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:05.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.451+0000 7f6afba3f640 1 --2- 172.21.15.77:0/2945021807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6af4150090 0x7f6af4156c80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6af40ab3d0 tx=0x7f6af002a1e0 comp rx=0 tx=0).stop 2024-04-25T01:41:05.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.451+0000 7f6afba3f640 1 -- 172.21.15.77:0/2945021807 shutdown_connections 2024-04-25T01:41:05.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.451+0000 7f6afba3f640 1 --2- 172.21.15.77:0/2945021807 >> v2:172.21.15.121:3300/0 conn(0x7f6af406c280 0x7f6af40c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:05.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.451+0000 7f6afba3f640 1 --2- 172.21.15.77:0/2945021807 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6af40c8200 0x7f6af40c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:05.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.451+0000 7f6afba3f640 1 --2- 172.21.15.77:0/2945021807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6af4150090 0x7f6af4156c80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:05.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.451+0000 7f6afba3f640 1 -- 172.21.15.77:0/2945021807 >> 172.21.15.77:0/2945021807 conn(0x7f6af40ad4d0 msgr2=0x7f6af40ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:05.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.451+0000 7f6afba3f640 1 -- 172.21.15.77:0/2945021807 shutdown_connections 2024-04-25T01:41:05.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.451+0000 7f6afba3f640 1 -- 172.21.15.77:0/2945021807 wait complete. 2024-04-25T01:41:05.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.452+0000 7f6afba3f640 1 Processor -- start 2024-04-25T01:41:05.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.452+0000 7f6afba3f640 1 -- start start 2024-04-25T01:41:05.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.453+0000 7f6afba3f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6af406c280 0x7f6af40c2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:05.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.453+0000 7f6afba3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6af40c8200 0x7f6af41e8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:05.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.453+0000 7f6afba3f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6af4150090 0x7f6af41e9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:05.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.453+0000 7f6afba3f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6af40c86b0 con 0x7f6af406c280 2024-04-25T01:41:05.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.453+0000 7f6afba3f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6af406bd60 con 0x7f6af40c8200 2024-04-25T01:41:05.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.453+0000 7f6afba3f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f6af406c6d0 con 0x7f6af4150090 2024-04-25T01:41:05.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.453+0000 7f6af97db640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6af406c280 0x7f6af40c2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:05.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.453+0000 7f6af97db640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6af406c280 0x7f6af40c2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43034/0 (socket says 172.21.15.77:43034) 2024-04-25T01:41:05.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.453+0000 7f6af97db640 1 -- 172.21.15.77:0/80275481 learned_addr learned my addr 172.21.15.77:0/80275481 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:05.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.453+0000 7f6af8fda640 1 --2- 172.21.15.77:0/80275481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6af40c8200 0x7f6af41e8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:05.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.453+0000 7f6af9fdc640 1 --2- 172.21.15.77:0/80275481 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6af4150090 0x7f6af41e9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:05.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.453+0000 7f6af97db640 1 -- 172.21.15.77:0/80275481 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6af4150090 msgr2=0x7f6af41e9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:05.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.453+0000 7f6af97db640 1 --2- 172.21.15.77:0/80275481 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6af4150090 0x7f6af41e9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:05.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.453+0000 7f6af97db640 1 -- 172.21.15.77:0/80275481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6af40c8200 msgr2=0x7f6af41e8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:05.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.453+0000 7f6af97db640 1 --2- 172.21.15.77:0/80275481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6af40c8200 0x7f6af41e8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:05.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.453+0000 7f6af97db640 1 -- 172.21.15.77:0/80275481 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af41eef00 con 0x7f6af406c280 2024-04-25T01:41:05.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.453+0000 7f6af9fdc640 1 --2- 172.21.15.77:0/80275481 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6af4150090 0x7f6af41e9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:41:05.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.453+0000 7f6af97db640 1 --2- 172.21.15.77:0/80275481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6af406c280 0x7f6af40c2ce0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6af002a220 tx=0x7f6af00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:05.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.454+0000 7f6ae9ffb640 1 -- 172.21.15.77:0/80275481 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af0041020 con 0x7f6af406c280 2024-04-25T01:41:05.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.454+0000 7f6afba3f640 1 -- 172.21.15.77:0/80275481 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6af41ef1e0 con 0x7f6af406c280 2024-04-25T01:41:05.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.454+0000 7f6ae9ffb640 1 -- 172.21.15.77:0/80275481 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6af003d620 con 0x7f6af406c280 2024-04-25T01:41:05.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.454+0000 7f6ae9ffb640 1 -- 172.21.15.77:0/80275481 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af0041020 con 0x7f6af406c280 2024-04-25T01:41:05.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.454+0000 7f6afba3f640 1 -- 172.21.15.77:0/80275481 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6af41ef7a0 con 0x7f6af406c280 2024-04-25T01:41:05.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.455+0000 7f6afba3f640 1 -- 172.21.15.77:0/80275481 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6af404f500 con 0x7f6af406c280 2024-04-25T01:41:05.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.455+0000 7f6ae9ffb640 1 -- 172.21.15.77:0/80275481 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6af0044020 con 0x7f6af406c280 2024-04-25T01:41:05.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.456+0000 7f6ae9ffb640 1 --2- 172.21.15.77:0/80275481 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6ad806c030 0x7f6ad806e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:05.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.456+0000 7f6ae9ffb640 1 -- 172.21.15.77:0/80275481 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6723+0+0 (secure 0 0 0) 0x7f6af00ab340 con 0x7f6af406c280 2024-04-25T01:41:05.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.456+0000 7f6af8fda640 1 --2- 172.21.15.77:0/80275481 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6ad806c030 0x7f6ad806e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:05.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.456+0000 7f6af8fda640 1 --2- 172.21.15.77:0/80275481 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6ad806c030 0x7f6ad806e4f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6af4154ad0 tx=0x7f6ae4009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:05.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.464+0000 7f6ae9ffb640 1 -- 172.21.15.77:0/80275481 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6af004b030 con 0x7f6af406c280 2024-04-25T01:41:05.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.688+0000 7f6afba3f640 1 -- 172.21.15.77:0/80275481 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6af406cec0 con 0x7f6af406c280 2024-04-25T01:41:05.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.688+0000 7f6ae9ffb640 1 -- 172.21.15.77:0/80275481 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5667 (secure 0 0 0) 0x7f6af00792b0 con 0x7f6af406c280 2024-04-25T01:41:05.675 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:05.675 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:02.386295+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":29,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":2}]} 2024-04-25T01:41:05.675 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 16 2024-04-25T01:41:05.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.691+0000 7f6afba3f640 1 -- 172.21.15.77:0/80275481 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6ad806c030 msgr2=0x7f6ad806e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:05.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.691+0000 7f6afba3f640 1 --2- 172.21.15.77:0/80275481 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6ad806c030 0x7f6ad806e4f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6af4154ad0 tx=0x7f6ae4009190 comp rx=0 tx=0).stop 2024-04-25T01:41:05.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.691+0000 7f6afba3f640 1 -- 172.21.15.77:0/80275481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6af406c280 msgr2=0x7f6af40c2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:05.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.691+0000 7f6afba3f640 1 --2- 172.21.15.77:0/80275481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6af406c280 0x7f6af40c2ce0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6af002a220 tx=0x7f6af00046c0 comp rx=0 tx=0).stop 2024-04-25T01:41:05.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.691+0000 7f6afba3f640 1 -- 172.21.15.77:0/80275481 shutdown_connections 2024-04-25T01:41:05.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.691+0000 7f6afba3f640 1 --2- 172.21.15.77:0/80275481 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6ad806c030 0x7f6ad806e4f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:05.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.691+0000 7f6afba3f640 1 --2- 172.21.15.77:0/80275481 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6af4150090 0x7f6af41e9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:05.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.691+0000 7f6afba3f640 1 --2- 172.21.15.77:0/80275481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6af40c8200 0x7f6af41e8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:05.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.691+0000 7f6afba3f640 1 --2- 172.21.15.77:0/80275481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6af406c280 0x7f6af40c2ce0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:05.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.691+0000 7f6afba3f640 1 -- 172.21.15.77:0/80275481 >> 172.21.15.77:0/80275481 conn(0x7f6af40ad4d0 msgr2=0x7f6af4154b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:05.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.691+0000 7f6afba3f640 1 -- 172.21.15.77:0/80275481 shutdown_connections 2024-04-25T01:41:05.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:05.691+0000 7f6afba3f640 1 -- 172.21.15.77:0/80275481 wait complete. 2024-04-25T01:41:05.688 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is in active, standby or standby-replay 2024-04-25T01:41:07.204 INFO:tasks.ceph.mds.a.smithi077.stderr:2024-04-25T01:41:07.218+0000 7f578892a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T01:41:07.689 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:07.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.804+0000 7fb4cc210640 1 Processor -- start 2024-04-25T01:41:07.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.804+0000 7fb4cc210640 1 -- start start 2024-04-25T01:41:07.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.805+0000 7fb4cc210640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb4c4156c80 0x7fb4c40c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:07.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.805+0000 7fb4cc210640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb4c406c280 0x7fb4c40c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:07.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.805+0000 7fb4cc210640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4c4157130 con 0x7fb4c4150090 2024-04-25T01:41:07.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.805+0000 7fb4cc210640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb4c406b830 con 0x7fb4c4156c80 2024-04-25T01:41:07.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.805+0000 7fb4cc210640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb4c40c9de0 con 0x7fb4c406c280 2024-04-25T01:41:07.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.805+0000 7fb4c97ab640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb4c4156c80 0x7fb4c40c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:07.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.805+0000 7fb4c97ab640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb4c4156c80 0x7fb4c40c98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39384/0 (socket says 172.21.15.77:39384) 2024-04-25T01:41:07.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.805+0000 7fb4c97ab640 1 -- 172.21.15.77:0/2174976383 learned_addr learned my addr 172.21.15.77:0/2174976383 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:07.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.805+0000 7fb4ca7ad640 1 --2- 172.21.15.77:0/2174976383 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb4c406c280 0x7fb4c40c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:07.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.806+0000 7fb4c97ab640 1 -- 172.21.15.77:0/2174976383 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb4c406c280 msgr2=0x7fb4c40c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:07.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.806+0000 7fb4c97ab640 1 --2- 172.21.15.77:0/2174976383 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb4c406c280 0x7fb4c40c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:07.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.806+0000 7fb4c97ab640 1 -- 172.21.15.77:0/2174976383 >> v1:172.21.15.121:6789/0 conn(0x7fb4c4150090 legacy=0x7fb4c40c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:07.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.806+0000 7fb4c97ab640 1 -- 172.21.15.77:0/2174976383 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4c40c89c0 con 0x7fb4c4156c80 2024-04-25T01:41:07.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.807+0000 7fb4c97ab640 1 --2- 172.21.15.77:0/2174976383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4c4156c80 0x7fb4c40c98a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4009870 tx=0x7fb4b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd48d1c9fa6ad855 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:07.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.807+0000 7fb4c8faa640 1 -- 172.21.15.77:0/2174976383 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4037070 con 0x7fb4c4156c80 2024-04-25T01:41:07.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.807+0000 7fb4c8faa640 1 -- 172.21.15.77:0/2174976383 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4b4032440 con 0x7fb4c4156c80 2024-04-25T01:41:07.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.807+0000 7fb4c8faa640 1 -- 172.21.15.77:0/2174976383 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4032810 con 0x7fb4c4156c80 2024-04-25T01:41:07.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.807+0000 7fb4cc210640 1 -- 172.21.15.77:0/2174976383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4c4156c80 msgr2=0x7fb4c40c98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:07.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.807+0000 7fb4cc210640 1 --2- 172.21.15.77:0/2174976383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4c4156c80 0x7fb4c40c98a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4009870 tx=0x7fb4b402a270 comp rx=0 tx=0).stop 2024-04-25T01:41:07.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.807+0000 7fb4cc210640 1 -- 172.21.15.77:0/2174976383 shutdown_connections 2024-04-25T01:41:07.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.807+0000 7fb4cc210640 1 --2- 172.21.15.77:0/2174976383 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb4c406c280 0x7fb4c40c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:07.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.807+0000 7fb4cc210640 1 --2- 172.21.15.77:0/2174976383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4c4156c80 0x7fb4c40c98a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:07.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.807+0000 7fb4cc210640 1 -- 172.21.15.77:0/2174976383 >> 172.21.15.77:0/2174976383 conn(0x7fb4c40ad4d0 msgr2=0x7fb4c40ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:07.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.808+0000 7fb4cc210640 1 -- 172.21.15.77:0/2174976383 shutdown_connections 2024-04-25T01:41:07.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.808+0000 7fb4cc210640 1 -- 172.21.15.77:0/2174976383 wait complete. 2024-04-25T01:41:07.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.809+0000 7fb4cc210640 1 Processor -- start 2024-04-25T01:41:07.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.809+0000 7fb4cc210640 1 -- start start 2024-04-25T01:41:07.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.809+0000 7fb4cc210640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb4c406c280 0x7fb4c4157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:07.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.809+0000 7fb4cc210640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4c4150090 0x7fb4c41ebaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.809+0000 7fb4cc210640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4c4156c80 0x7fb4c41506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.809+0000 7fb4cc210640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c406bd60 con 0x7fb4c4156c80 2024-04-25T01:41:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.809+0000 7fb4cc210640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c406ba80 con 0x7fb4c4150090 2024-04-25T01:41:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.809+0000 7fb4cc210640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb4c406c690 con 0x7fb4c406c280 2024-04-25T01:41:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.809+0000 7fb4ca7ad640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4c4156c80 0x7fb4c41506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.809+0000 7fb4ca7ad640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4c4156c80 0x7fb4c41506e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39386/0 (socket says 172.21.15.77:39386) 2024-04-25T01:41:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.809+0000 7fb4ca7ad640 1 -- 172.21.15.77:0/2431149804 learned_addr learned my addr 172.21.15.77:0/2431149804 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.809+0000 7fb4c9fac640 1 --2- 172.21.15.77:0/2431149804 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb4c406c280 0x7fb4c4157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.809+0000 7fb4c97ab640 1 --2- 172.21.15.77:0/2431149804 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4c4150090 0x7fb4c41ebaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.810+0000 7fb4ca7ad640 1 -- 172.21.15.77:0/2431149804 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb4c406c280 msgr2=0x7fb4c4157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.810+0000 7fb4ca7ad640 1 --2- 172.21.15.77:0/2431149804 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb4c406c280 0x7fb4c4157b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.810+0000 7fb4ca7ad640 1 -- 172.21.15.77:0/2431149804 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4c4150090 msgr2=0x7fb4c41ebaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.810+0000 7fb4ca7ad640 1 --2- 172.21.15.77:0/2431149804 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4c4150090 0x7fb4c41ebaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.810+0000 7fb4ca7ad640 1 -- 172.21.15.77:0/2431149804 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4c4158100 con 0x7fb4c4156c80 2024-04-25T01:41:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.810+0000 7fb4c9fac640 1 --2- 172.21.15.77:0/2431149804 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb4c406c280 0x7fb4c4157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:41:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.810+0000 7fb4ca7ad640 1 --2- 172.21.15.77:0/2431149804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4c4156c80 0x7fb4c41506e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009d30 tx=0x7fb4bc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.810+0000 7fb4ba7fc640 1 -- 172.21.15.77:0/2431149804 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc018020 con 0x7fb4c4156c80 2024-04-25T01:41:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.810+0000 7fb4ba7fc640 1 -- 172.21.15.77:0/2431149804 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4bc014480 con 0x7fb4c4156c80 2024-04-25T01:41:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.810+0000 7fb4cc210640 1 -- 172.21.15.77:0/2431149804 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4c41583e0 con 0x7fb4c4156c80 2024-04-25T01:41:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.810+0000 7fb4ba7fc640 1 -- 172.21.15.77:0/2431149804 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc014870 con 0x7fb4c4156c80 2024-04-25T01:41:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.810+0000 7fb4cc210640 1 -- 172.21.15.77:0/2431149804 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4c41589a0 con 0x7fb4c4156c80 2024-04-25T01:41:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.811+0000 7fb4cc210640 1 -- 172.21.15.77:0/2431149804 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4c404f500 con 0x7fb4c4156c80 2024-04-25T01:41:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.812+0000 7fb4ba7fc640 1 -- 172.21.15.77:0/2431149804 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb4bc005d10 con 0x7fb4c4156c80 2024-04-25T01:41:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.812+0000 7fb4ba7fc640 1 --2- 172.21.15.77:0/2431149804 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb4a806be30 0x7fb4a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.813+0000 7fb4ba7fc640 1 -- 172.21.15.77:0/2431149804 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6723+0+0 (secure 0 0 0) 0x7fb4bc08bb20 con 0x7fb4c4156c80 2024-04-25T01:41:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.813+0000 7fb4c9fac640 1 --2- 172.21.15.77:0/2431149804 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb4a806be30 0x7fb4a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.813+0000 7fb4c9fac640 1 --2- 172.21.15.77:0/2431149804 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb4a806be30 0x7fb4a806e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0000f60 tx=0x7fb4c0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:07.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:07.817+0000 7fb4ba7fc640 1 -- 172.21.15.77:0/2431149804 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb4bc022070 con 0x7fb4c4156c80 2024-04-25T01:41:08.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:08.041+0000 7fb4cc210640 1 -- 172.21.15.77:0/2431149804 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb4c406cec0 con 0x7fb4c4156c80 2024-04-25T01:41:08.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:08.042+0000 7fb4ba7fc640 1 -- 172.21.15.77:0/2431149804 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6492 (secure 0 0 0) 0x7fb4bc010040 con 0x7fb4c4156c80 2024-04-25T01:41:08.028 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:08.028 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5265,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:02.386295+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":29,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":2}]} 2024-04-25T01:41:08.028 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 17 2024-04-25T01:41:08.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:08.044+0000 7fb4cc210640 1 -- 172.21.15.77:0/2431149804 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb4a806be30 msgr2=0x7fb4a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:08.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:08.044+0000 7fb4cc210640 1 --2- 172.21.15.77:0/2431149804 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb4a806be30 0x7fb4a806e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0000f60 tx=0x7fb4c0009040 comp rx=0 tx=0).stop 2024-04-25T01:41:08.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:08.044+0000 7fb4cc210640 1 -- 172.21.15.77:0/2431149804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4c4156c80 msgr2=0x7fb4c41506e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:08.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:08.044+0000 7fb4cc210640 1 --2- 172.21.15.77:0/2431149804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4c4156c80 0x7fb4c41506e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009d30 tx=0x7fb4bc00c490 comp rx=0 tx=0).stop 2024-04-25T01:41:08.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:08.044+0000 7fb4cc210640 1 -- 172.21.15.77:0/2431149804 shutdown_connections 2024-04-25T01:41:08.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:08.044+0000 7fb4cc210640 1 --2- 172.21.15.77:0/2431149804 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb4a806be30 0x7fb4a806e2f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:08.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:08.044+0000 7fb4cc210640 1 --2- 172.21.15.77:0/2431149804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4c4156c80 0x7fb4c41506e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:08.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:08.044+0000 7fb4cc210640 1 --2- 172.21.15.77:0/2431149804 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4c4150090 0x7fb4c41ebaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:08.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:08.044+0000 7fb4cc210640 1 --2- 172.21.15.77:0/2431149804 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb4c406c280 0x7fb4c4157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:08.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:08.044+0000 7fb4cc210640 1 -- 172.21.15.77:0/2431149804 >> 172.21.15.77:0/2431149804 conn(0x7fb4c40ad4d0 msgr2=0x7fb4c4154820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:08.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:08.044+0000 7fb4cc210640 1 -- 172.21.15.77:0/2431149804 shutdown_connections 2024-04-25T01:41:08.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:08.044+0000 7fb4cc210640 1 -- 172.21.15.77:0/2431149804 wait complete. 2024-04-25T01:41:08.042 INFO:tasks.mds_thrash.fs.[b]:mds.c reported in up:standby state 2024-04-25T01:41:08.042 INFO:tasks.mds_thrash.fs.[b]:waiting for 10 secs before thrashing 2024-04-25T01:41:17.717 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:17.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.831+0000 7f1209858640 1 Processor -- start 2024-04-25T01:41:17.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.831+0000 7f1209858640 1 -- start start 2024-04-25T01:41:17.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.832+0000 7f1209858640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1204156c80 0x7f12040c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.832+0000 7f1209858640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f120406c280 0x7f12040c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.832+0000 7f1209858640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1204157130 con 0x7f1204150090 2024-04-25T01:41:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.832+0000 7f1209858640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f120406b830 con 0x7f120406c280 2024-04-25T01:41:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.832+0000 7f1209858640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f12040c9de0 con 0x7f1204156c80 2024-04-25T01:41:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.832+0000 7f1202ffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f1204150090 0x7f12040c8200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:34942/0 (socket says 172.21.15.77:34942) 2024-04-25T01:41:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.832+0000 7f1202ffd640 1 -- 172.21.15.77:0/3670745766 learned_addr learned my addr 172.21.15.77:0/3670745766 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:41:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.832+0000 7f12037fe640 1 --2- 172.21.15.77:0/3670745766 >> v2:172.21.15.77:3300/0 conn(0x7f120406c280 0x7f12040c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.832+0000 7f12027fc640 1 --2- 172.21.15.77:0/3670745766 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1204156c80 0x7f12040c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.833+0000 7f1201ffb640 1 -- 172.21.15.77:0/3670745766 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1512024825 0 0) 0x7f11f4001490 con 0x7f1204150090 2024-04-25T01:41:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.833+0000 7f1201ffb640 1 -- 172.21.15.77:0/3670745766 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11ec003520 con 0x7f1204150090 2024-04-25T01:41:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.833+0000 7f12037fe640 1 -- 172.21.15.77:0/3670745766 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1204156c80 msgr2=0x7f12040c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.833+0000 7f12037fe640 1 --2- 172.21.15.77:0/3670745766 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1204156c80 0x7f12040c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.833+0000 7f12037fe640 1 -- 172.21.15.77:0/3670745766 >> v1:172.21.15.77:6789/0 conn(0x7f1204150090 legacy=0x7f12040c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.833+0000 7f12037fe640 1 -- 172.21.15.77:0/3670745766 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12040c89c0 con 0x7f120406c280 2024-04-25T01:41:17.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.833+0000 7f12037fe640 1 --2- 172.21.15.77:0/3670745766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f120406c280 0x7f12040c6320 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f11fc0097a0 tx=0x7f11fc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e176cfabf8a0837a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:17.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.834+0000 7f1201ffb640 1 -- 172.21.15.77:0/3670745766 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11fc037070 con 0x7f120406c280 2024-04-25T01:41:17.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.834+0000 7f1201ffb640 1 -- 172.21.15.77:0/3670745766 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11fc032440 con 0x7f120406c280 2024-04-25T01:41:17.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.834+0000 7f1201ffb640 1 -- 172.21.15.77:0/3670745766 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11fc0327f0 con 0x7f120406c280 2024-04-25T01:41:17.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.834+0000 7f1209858640 1 -- 172.21.15.77:0/3670745766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f120406c280 msgr2=0x7f12040c6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:17.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.834+0000 7f1209858640 1 --2- 172.21.15.77:0/3670745766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f120406c280 0x7f12040c6320 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f11fc0097a0 tx=0x7f11fc02a180 comp rx=0 tx=0).stop 2024-04-25T01:41:17.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.835+0000 7f1209858640 1 -- 172.21.15.77:0/3670745766 shutdown_connections 2024-04-25T01:41:17.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.835+0000 7f1209858640 1 --2- 172.21.15.77:0/3670745766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f120406c280 0x7f12040c6320 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:17.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.835+0000 7f1209858640 1 --2- 172.21.15.77:0/3670745766 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1204156c80 0x7f12040c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:17.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.835+0000 7f1209858640 1 -- 172.21.15.77:0/3670745766 >> 172.21.15.77:0/3670745766 conn(0x7f12040ad4d0 msgr2=0x7f12040ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:17.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.835+0000 7f1209858640 1 -- 172.21.15.77:0/3670745766 shutdown_connections 2024-04-25T01:41:17.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.835+0000 7f1209858640 1 -- 172.21.15.77:0/3670745766 wait complete. 2024-04-25T01:41:17.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.836+0000 7f1209858640 1 Processor -- start 2024-04-25T01:41:17.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.836+0000 7f1209858640 1 -- start start 2024-04-25T01:41:17.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.837+0000 7f1209858640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f120406c280 0x7f12040c1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:17.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.837+0000 7f1209858640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1204150090 0x7f12040c20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:17.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.837+0000 7f1209858640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1204156c80 0x7f12041ef1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.838+0000 7f1209858640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f120406bd60 con 0x7f120406c280 2024-04-25T01:41:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.838+0000 7f1202ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f120406c280 0x7f12040c1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.838+0000 7f1202ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f120406c280 0x7f12040c1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45014/0 (socket says 172.21.15.77:45014) 2024-04-25T01:41:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.838+0000 7f1202ffd640 1 -- 172.21.15.77:0/3609602438 learned_addr learned my addr 172.21.15.77:0/3609602438 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.838+0000 7f12027fc640 1 --2- 172.21.15.77:0/3609602438 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1204150090 0x7f12040c20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.838+0000 7f12037fe640 1 --2- 172.21.15.77:0/3609602438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1204156c80 0x7f12041ef1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.838+0000 7f1209858640 1 -- 172.21.15.77:0/3609602438 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f120406ba80 con 0x7f1204156c80 2024-04-25T01:41:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.838+0000 7f1209858640 1 -- 172.21.15.77:0/3609602438 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f120406c6d0 con 0x7f1204150090 2024-04-25T01:41:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.838+0000 7f1202ffd640 1 -- 172.21.15.77:0/3609602438 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1204150090 msgr2=0x7f12040c20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.838+0000 7f1202ffd640 1 --2- 172.21.15.77:0/3609602438 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1204150090 0x7f12040c20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.838+0000 7f1202ffd640 1 -- 172.21.15.77:0/3609602438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1204156c80 msgr2=0x7f12041ef1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.838+0000 7f1202ffd640 1 --2- 172.21.15.77:0/3609602438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1204156c80 0x7f12041ef1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.838+0000 7f1202ffd640 1 -- 172.21.15.77:0/3609602438 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12040c2630 con 0x7f120406c280 2024-04-25T01:41:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.839+0000 7f1202ffd640 1 --2- 172.21.15.77:0/3609602438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f120406c280 0x7f12040c1bb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f11f400cbc0 tx=0x7f11f400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:17.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.839+0000 7f11ebfff640 1 -- 172.21.15.77:0/3609602438 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f4017070 con 0x7f120406c280 2024-04-25T01:41:17.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.839+0000 7f1209858640 1 -- 172.21.15.77:0/3609602438 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12040c5850 con 0x7f120406c280 2024-04-25T01:41:17.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.839+0000 7f1209858640 1 -- 172.21.15.77:0/3609602438 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12040c3680 con 0x7f120406c280 2024-04-25T01:41:17.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.839+0000 7f11ebfff640 1 -- 172.21.15.77:0/3609602438 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f400ad40 con 0x7f120406c280 2024-04-25T01:41:17.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.839+0000 7f11ebfff640 1 -- 172.21.15.77:0/3609602438 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f4012600 con 0x7f120406c280 2024-04-25T01:41:17.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.840+0000 7f11ebfff640 1 -- 172.21.15.77:0/3609602438 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f11f401a070 con 0x7f120406c280 2024-04-25T01:41:17.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.841+0000 7f1209858640 1 -- 172.21.15.77:0/3609602438 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11e4005290 con 0x7f120406c280 2024-04-25T01:41:17.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.841+0000 7f11ebfff640 1 --2- 172.21.15.77:0/3609602438 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f11f006be60 0x7f11f006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:17.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.841+0000 7f11ebfff640 1 -- 172.21.15.77:0/3609602438 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6723+0+0 (secure 0 0 0) 0x7f11f408b060 con 0x7f120406c280 2024-04-25T01:41:17.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.841+0000 7f12027fc640 1 --2- 172.21.15.77:0/3609602438 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f11f006be60 0x7f11f006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:17.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.842+0000 7f12027fc640 1 --2- 172.21.15.77:0/3609602438 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f11f006be60 0x7f11f006e320 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f120414db80 tx=0x7f11f8009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:17.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:17.849+0000 7f11ebfff640 1 -- 172.21.15.77:0/3609602438 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1204157130 con 0x7f120406c280 2024-04-25T01:41:18.043 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:18.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.152+0000 7f1209858640 1 -- 172.21.15.77:0/3609602438 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11e4005580 con 0x7f120406c280 2024-04-25T01:41:18.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.153+0000 7f11ebfff640 1 -- 172.21.15.77:0/3609602438 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6492 (secure 0 0 0) 0x7f11f4058e90 con 0x7f120406c280 2024-04-25T01:41:18.139 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:18.140 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5265,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:02.386295+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":29,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":2}]} 2024-04-25T01:41:18.140 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 17 2024-04-25T01:41:18.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.156+0000 7f1209858640 1 -- 172.21.15.77:0/3609602438 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f11f006be60 msgr2=0x7f11f006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:18.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.156+0000 7f1209858640 1 --2- 172.21.15.77:0/3609602438 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f11f006be60 0x7f11f006e320 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f120414db80 tx=0x7f11f8009190 comp rx=0 tx=0).stop 2024-04-25T01:41:18.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.156+0000 7f1209858640 1 -- 172.21.15.77:0/3609602438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f120406c280 msgr2=0x7f12040c1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:18.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.156+0000 7f1209858640 1 --2- 172.21.15.77:0/3609602438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f120406c280 0x7f12040c1bb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f11f400cbc0 tx=0x7f11f400a430 comp rx=0 tx=0).stop 2024-04-25T01:41:18.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.156+0000 7f1209858640 1 -- 172.21.15.77:0/3609602438 shutdown_connections 2024-04-25T01:41:18.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.156+0000 7f1209858640 1 --2- 172.21.15.77:0/3609602438 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f11f006be60 0x7f11f006e320 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.156+0000 7f1209858640 1 --2- 172.21.15.77:0/3609602438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1204156c80 0x7f12041ef1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.156+0000 7f1209858640 1 --2- 172.21.15.77:0/3609602438 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1204150090 0x7f12040c20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.156+0000 7f1209858640 1 --2- 172.21.15.77:0/3609602438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f120406c280 0x7f12040c1bb0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.156+0000 7f1209858640 1 -- 172.21.15.77:0/3609602438 >> 172.21.15.77:0/3609602438 conn(0x7f12040ad4d0 msgr2=0x7f120414e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:18.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.156+0000 7f1209858640 1 -- 172.21.15.77:0/3609602438 shutdown_connections 2024-04-25T01:41:18.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.156+0000 7f1209858640 1 -- 172.21.15.77:0/3609602438 wait complete. 2024-04-25T01:41:18.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.162+0000 7f3e6e742640 1 Processor -- start 2024-04-25T01:41:18.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.162+0000 7f3e6e742640 1 -- start start 2024-04-25T01:41:18.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.163+0000 7f3e6e742640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3e68150090 0x7f3e68156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:18.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.163+0000 7f3e6e742640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e680c89c0 con 0x7f3e680c8200 2024-04-25T01:41:18.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.163+0000 7f3e6e742640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e680c8ca0 con 0x7f3e6806c280 2024-04-25T01:41:18.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.163+0000 7f3e6e742640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f3e6806b830 con 0x7f3e68150090 2024-04-25T01:41:18.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.163+0000 7f3e677fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3e680c8200 0x7f3e680c98a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:34954/0 (socket says 172.21.15.77:34954) 2024-04-25T01:41:18.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.163+0000 7f3e677fe640 1 -- 172.21.15.77:0/4263342386 learned_addr learned my addr 172.21.15.77:0/4263342386 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:41:18.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.163+0000 7f3e67fff640 1 --2- 172.21.15.77:0/4263342386 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3e68150090 0x7f3e68156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:18.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.163+0000 7f3e66ffd640 1 -- 172.21.15.77:0/4263342386 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 855107502 0 0) 0x7f3e680c89c0 con 0x7f3e680c8200 2024-04-25T01:41:18.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.163+0000 7f3e66ffd640 1 -- 172.21.15.77:0/4263342386 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e50003520 con 0x7f3e680c8200 2024-04-25T01:41:18.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.163+0000 7f3e67fff640 1 -- 172.21.15.77:0/4263342386 >> v1:172.21.15.121:6789/0 conn(0x7f3e6806c280 legacy=0x7f3e680c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:18.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.163+0000 7f3e67fff640 1 -- 172.21.15.77:0/4263342386 >> v1:172.21.15.77:6789/0 conn(0x7f3e680c8200 legacy=0x7f3e680c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:18.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.163+0000 7f3e67fff640 1 -- 172.21.15.77:0/4263342386 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e6806ba80 con 0x7f3e68150090 2024-04-25T01:41:18.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.164+0000 7f3e67fff640 1 --2- 172.21.15.77:0/4263342386 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3e68150090 0x7f3e68156c80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3e580097d0 tx=0x7f3e5802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5eff9fdfc4b53ecb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:18.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.164+0000 7f3e66ffd640 1 -- 172.21.15.77:0/4263342386 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e58037070 con 0x7f3e68150090 2024-04-25T01:41:18.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.164+0000 7f3e66ffd640 1 -- 172.21.15.77:0/4263342386 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e58032440 con 0x7f3e68150090 2024-04-25T01:41:18.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.164+0000 7f3e66ffd640 1 -- 172.21.15.77:0/4263342386 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e58032810 con 0x7f3e68150090 2024-04-25T01:41:18.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.165+0000 7f3e6e742640 1 -- 172.21.15.77:0/4263342386 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3e68150090 msgr2=0x7f3e68156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:18.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.165+0000 7f3e6e742640 1 --2- 172.21.15.77:0/4263342386 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3e68150090 0x7f3e68156c80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3e580097d0 tx=0x7f3e5802a210 comp rx=0 tx=0).stop 2024-04-25T01:41:18.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.165+0000 7f3e6e742640 1 -- 172.21.15.77:0/4263342386 shutdown_connections 2024-04-25T01:41:18.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.165+0000 7f3e6e742640 1 --2- 172.21.15.77:0/4263342386 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3e68150090 0x7f3e68156c80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.165+0000 7f3e6e742640 1 -- 172.21.15.77:0/4263342386 >> 172.21.15.77:0/4263342386 conn(0x7f3e680ad4d0 msgr2=0x7f3e680ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:18.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.165+0000 7f3e6e742640 1 -- 172.21.15.77:0/4263342386 shutdown_connections 2024-04-25T01:41:18.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.165+0000 7f3e6e742640 1 -- 172.21.15.77:0/4263342386 wait complete. 2024-04-25T01:41:18.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.167+0000 7f3e6e742640 1 Processor -- start 2024-04-25T01:41:18.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.167+0000 7f3e6e742640 1 -- start start 2024-04-25T01:41:18.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.169+0000 7f3e6e742640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3e6806c280 0x7f3e681595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:18.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.169+0000 7f3e6e742640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e680c8200 0x7f3e680b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:18.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.169+0000 7f3e6e742640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e68150090 0x7f3e680b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:18.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.169+0000 7f3e677fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e680c8200 0x7f3e680b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:18.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.169+0000 7f3e677fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e680c8200 0x7f3e680b0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:38828/0 (socket says 172.21.15.77:38828) 2024-04-25T01:41:18.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.169+0000 7f3e677fe640 1 -- 172.21.15.77:0/335929019 learned_addr learned my addr 172.21.15.77:0/335929019 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:18.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.169+0000 7f3e67fff640 1 --2- 172.21.15.77:0/335929019 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3e6806c280 0x7f3e681595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:18.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.169+0000 7f3e6ccdf640 1 --2- 172.21.15.77:0/335929019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e68150090 0x7f3e680b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:18.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.169+0000 7f3e6e742640 1 -- 172.21.15.77:0/335929019 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6806c6f0 con 0x7f3e68150090 2024-04-25T01:41:18.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.169+0000 7f3e6e742640 1 -- 172.21.15.77:0/335929019 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3e680c8680 con 0x7f3e680c8200 2024-04-25T01:41:18.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.169+0000 7f3e6e742640 1 -- 172.21.15.77:0/335929019 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f3e6806c870 con 0x7f3e6806c280 2024-04-25T01:41:18.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.170+0000 7f3e67fff640 1 -- 172.21.15.77:0/335929019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e680c8200 msgr2=0x7f3e680b0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:18.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.170+0000 7f3e67fff640 1 --2- 172.21.15.77:0/335929019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e680c8200 0x7f3e680b0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.170+0000 7f3e67fff640 1 -- 172.21.15.77:0/335929019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e68150090 msgr2=0x7f3e680b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:18.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.170+0000 7f3e67fff640 1 --2- 172.21.15.77:0/335929019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e68150090 0x7f3e680b11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.170+0000 7f3e67fff640 1 -- 172.21.15.77:0/335929019 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e68159af0 con 0x7f3e6806c280 2024-04-25T01:41:18.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.170+0000 7f3e677fe640 1 --2- 172.21.15.77:0/335929019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e680c8200 0x7f3e680b0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:41:18.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.170+0000 7f3e67fff640 1 --2- 172.21.15.77:0/335929019 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3e6806c280 0x7f3e681595b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3e58031000 tx=0x7f3e580046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:18.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.170+0000 7f3e64ff9640 1 -- 172.21.15.77:0/335929019 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e58041020 con 0x7f3e6806c280 2024-04-25T01:41:18.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.170+0000 7f3e64ff9640 1 -- 172.21.15.77:0/335929019 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e58030990 con 0x7f3e6806c280 2024-04-25T01:41:18.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.170+0000 7f3e64ff9640 1 -- 172.21.15.77:0/335929019 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e58037040 con 0x7f3e6806c280 2024-04-25T01:41:18.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.170+0000 7f3e6e742640 1 -- 172.21.15.77:0/335929019 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e680b16e0 con 0x7f3e6806c280 2024-04-25T01:41:18.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.170+0000 7f3e6e742640 1 -- 172.21.15.77:0/335929019 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e681ec190 con 0x7f3e6806c280 2024-04-25T01:41:18.160 INFO:tasks.mds_thrash.fs.[a]:kill mds.d (rank=0) 2024-04-25T01:41:18.160 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T01:41:18.160 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T01:41:18.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.171+0000 7f3e6e742640 1 -- 172.21.15.77:0/335929019 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e6804f500 con 0x7f3e6806c280 2024-04-25T01:41:18.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.172+0000 7f3e64ff9640 1 -- 172.21.15.77:0/335929019 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e58044020 con 0x7f3e6806c280 2024-04-25T01:41:18.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.172+0000 7f3e64ff9640 1 --2- 172.21.15.77:0/335929019 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3e5406be30 0x7f3e5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:18.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.173+0000 7f3e677fe640 1 --2- 172.21.15.77:0/335929019 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3e5406be30 0x7f3e5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:18.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.173+0000 7f3e64ff9640 1 -- 172.21.15.77:0/335929019 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6723+0+0 (secure 0 0 0) 0x7f3e580abba0 con 0x7f3e6806c280 2024-04-25T01:41:18.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.173+0000 7f3e677fe640 1 --2- 172.21.15.77:0/335929019 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3e5406be30 0x7f3e5406e2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3e681e9270 tx=0x7f3e5c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:18.171 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T01:41:18.172 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:18.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.186+0000 7f3e64ff9640 1 -- 172.21.15.77:0/335929019 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3e5804b030 con 0x7f3e6806c280 2024-04-25T01:41:18.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.285+0000 7f9c2e6f5640 1 Processor -- start 2024-04-25T01:41:18.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.285+0000 7f9c2e6f5640 1 -- start start 2024-04-25T01:41:18.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.286+0000 7f9c2e6f5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9c28150090 0x7f9c28156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:18.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.286+0000 7f9c2e6f5640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9c280c8200 0x7f9c280c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:18.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.286+0000 7f9c2e6f5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c280c9de0 con 0x7f9c2806c280 2024-04-25T01:41:18.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.286+0000 7f9c2e6f5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9c2806b830 con 0x7f9c28150090 2024-04-25T01:41:18.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.286+0000 7f9c2e6f5640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f9c280c89c0 con 0x7f9c280c8200 2024-04-25T01:41:18.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.286+0000 7f9c27fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9c28150090 0x7f9c28156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:18.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.286+0000 7f9c2cc92640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9c2806c280 0x7f9c280c6320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:34962/0 (socket says 172.21.15.77:34962) 2024-04-25T01:41:18.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.286+0000 7f9c277fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9c280c8200 0x7f9c280c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:18.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.286+0000 7f9c2cc92640 1 -- 172.21.15.77:0/2903071446 learned_addr learned my addr 172.21.15.77:0/2903071446 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:41:18.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.286+0000 7f9c27fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9c28150090 0x7f9c28156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45032/0 (socket says 172.21.15.77:45032) 2024-04-25T01:41:18.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.286+0000 7f9c27fff640 1 -- 172.21.15.77:0/2903071446 >> v2:172.21.15.121:3300/0 conn(0x7f9c280c8200 msgr2=0x7f9c280c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:18.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.286+0000 7f9c27fff640 1 --2- 172.21.15.77:0/2903071446 >> v2:172.21.15.121:3300/0 conn(0x7f9c280c8200 0x7f9c280c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.286+0000 7f9c27fff640 1 -- 172.21.15.77:0/2903071446 >> v1:172.21.15.77:6789/0 conn(0x7f9c2806c280 legacy=0x7f9c280c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:18.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.286+0000 7f9c27fff640 1 -- 172.21.15.77:0/2903071446 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c280c8ca0 con 0x7f9c28150090 2024-04-25T01:41:18.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.287+0000 7f9c27fff640 1 --2- 172.21.15.77:0/2903071446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c28150090 0x7f9c28156c80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9c2806b9b0 tx=0x7f9c1802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10cef5cbc39ac3dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:18.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.287+0000 7f9c26ffd640 1 -- 172.21.15.77:0/2903071446 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18037070 con 0x7f9c28150090 2024-04-25T01:41:18.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.287+0000 7f9c26ffd640 1 -- 172.21.15.77:0/2903071446 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c18032440 con 0x7f9c28150090 2024-04-25T01:41:18.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.287+0000 7f9c26ffd640 1 -- 172.21.15.77:0/2903071446 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18032810 con 0x7f9c28150090 2024-04-25T01:41:18.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.288+0000 7f9c2e6f5640 1 -- 172.21.15.77:0/2903071446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c28150090 msgr2=0x7f9c28156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:18.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.288+0000 7f9c2e6f5640 1 --2- 172.21.15.77:0/2903071446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c28150090 0x7f9c28156c80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9c2806b9b0 tx=0x7f9c1802a1a0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.288+0000 7f9c2e6f5640 1 -- 172.21.15.77:0/2903071446 shutdown_connections 2024-04-25T01:41:18.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.288+0000 7f9c2e6f5640 1 --2- 172.21.15.77:0/2903071446 >> v2:172.21.15.121:3300/0 conn(0x7f9c280c8200 0x7f9c280c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.288+0000 7f9c2e6f5640 1 --2- 172.21.15.77:0/2903071446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c28150090 0x7f9c28156c80 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.288+0000 7f9c2e6f5640 1 -- 172.21.15.77:0/2903071446 >> 172.21.15.77:0/2903071446 conn(0x7f9c280ad4d0 msgr2=0x7f9c280ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:18.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.288+0000 7f9c2e6f5640 1 -- 172.21.15.77:0/2903071446 shutdown_connections 2024-04-25T01:41:18.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.288+0000 7f9c2e6f5640 1 -- 172.21.15.77:0/2903071446 wait complete. 2024-04-25T01:41:18.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.289+0000 7f9c2e6f5640 1 Processor -- start 2024-04-25T01:41:18.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.289+0000 7f9c2e6f5640 1 -- start start 2024-04-25T01:41:18.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.290+0000 7f9c2e6f5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9c2806c280 0x7f9c2815a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:18.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.290+0000 7f9c2e6f5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c280c8200 0x7f9c280c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:18.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.290+0000 7f9c2e6f5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c28150090 0x7f9c280c16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:18.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.290+0000 7f9c2e6f5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9c280c86b0 con 0x7f9c28150090 2024-04-25T01:41:18.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.290+0000 7f9c2e6f5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2806bd60 con 0x7f9c280c8200 2024-04-25T01:41:18.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.290+0000 7f9c2e6f5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9c280c6a30 con 0x7f9c2806c280 2024-04-25T01:41:18.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.290+0000 7f9c2cc92640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c28150090 0x7f9c280c16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:18.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.290+0000 7f9c2cc92640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c28150090 0x7f9c280c16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45042/0 (socket says 172.21.15.77:45042) 2024-04-25T01:41:18.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.290+0000 7f9c2cc92640 1 -- 172.21.15.77:0/2240287238 learned_addr learned my addr 172.21.15.77:0/2240287238 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:18.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.290+0000 7f9c27fff640 1 --2- 172.21.15.77:0/2240287238 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9c2806c280 0x7f9c2815a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:18.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.290+0000 7f9c277fe640 1 --2- 172.21.15.77:0/2240287238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c280c8200 0x7f9c280c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:18.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.291+0000 7f9c2cc92640 1 -- 172.21.15.77:0/2240287238 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9c2806c280 msgr2=0x7f9c2815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:18.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.291+0000 7f9c2cc92640 1 --2- 172.21.15.77:0/2240287238 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9c2806c280 0x7f9c2815a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.291+0000 7f9c2cc92640 1 -- 172.21.15.77:0/2240287238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c280c8200 msgr2=0x7f9c280c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:18.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.291+0000 7f9c2cc92640 1 --2- 172.21.15.77:0/2240287238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c280c8200 0x7f9c280c4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.291+0000 7f9c2cc92640 1 -- 172.21.15.77:0/2240287238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c280c5d20 con 0x7f9c28150090 2024-04-25T01:41:18.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.291+0000 7f9c2cc92640 1 --2- 172.21.15.77:0/2240287238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c28150090 0x7f9c280c16e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9c2000caa0 tx=0x7f9c2000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:18.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.291+0000 7f9c24ff9640 1 -- 172.21.15.77:0/2240287238 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c20017070 con 0x7f9c28150090 2024-04-25T01:41:18.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.291+0000 7f9c2e6f5640 1 -- 172.21.15.77:0/2240287238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c281ecde0 con 0x7f9c28150090 2024-04-25T01:41:18.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.291+0000 7f9c2e6f5640 1 -- 172.21.15.77:0/2240287238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c280c5760 con 0x7f9c28150090 2024-04-25T01:41:18.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.291+0000 7f9c24ff9640 1 -- 172.21.15.77:0/2240287238 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c2000ac00 con 0x7f9c28150090 2024-04-25T01:41:18.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.291+0000 7f9c24ff9640 1 -- 172.21.15.77:0/2240287238 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c20012620 con 0x7f9c28150090 2024-04-25T01:41:18.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.292+0000 7f9c2e6f5640 1 -- 172.21.15.77:0/2240287238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c08005290 con 0x7f9c28150090 2024-04-25T01:41:18.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.293+0000 7f9c24ff9640 1 -- 172.21.15.77:0/2240287238 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9c2001a070 con 0x7f9c28150090 2024-04-25T01:41:18.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.293+0000 7f9c24ff9640 1 --2- 172.21.15.77:0/2240287238 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9c1406be30 0x7f9c1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:18.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.293+0000 7f9c24ff9640 1 -- 172.21.15.77:0/2240287238 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6723+0+0 (secure 0 0 0) 0x7f9c2008ae80 con 0x7f9c28150090 2024-04-25T01:41:18.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.294+0000 7f9c27fff640 1 --2- 172.21.15.77:0/2240287238 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9c1406be30 0x7f9c1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:18.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.294+0000 7f9c27fff640 1 --2- 172.21.15.77:0/2240287238 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9c1406be30 0x7f9c1406e2f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9c18034000 tx=0x7f9c1802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:18.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.302+0000 7f9c24ff9640 1 -- 172.21.15.77:0/2240287238 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9c20058de0 con 0x7f9c28150090 2024-04-25T01:41:18.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.470+0000 7f3e6e742640 1 -- 172.21.15.77:0/335929019 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e6806cec0 con 0x7f3e6806c280 2024-04-25T01:41:18.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.471+0000 7f3e64ff9640 1 -- 172.21.15.77:0/335929019 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6492 (secure 0 0 0) 0x7f3e58079af0 con 0x7f3e6806c280 2024-04-25T01:41:18.458 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:18.458 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5265,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:02.386295+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":29,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":2}]} 2024-04-25T01:41:18.458 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 17 2024-04-25T01:41:18.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.473+0000 7f3e6e742640 1 -- 172.21.15.77:0/335929019 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3e5406be30 msgr2=0x7f3e5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:18.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.473+0000 7f3e6e742640 1 --2- 172.21.15.77:0/335929019 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3e5406be30 0x7f3e5406e2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3e681e9270 tx=0x7f3e5c009040 comp rx=0 tx=0).stop 2024-04-25T01:41:18.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.473+0000 7f3e6e742640 1 -- 172.21.15.77:0/335929019 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3e6806c280 msgr2=0x7f3e681595b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:18.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.473+0000 7f3e6e742640 1 --2- 172.21.15.77:0/335929019 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3e6806c280 0x7f3e681595b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3e58031000 tx=0x7f3e580046c0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.473+0000 7f3e6e742640 1 -- 172.21.15.77:0/335929019 shutdown_connections 2024-04-25T01:41:18.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.473+0000 7f3e6e742640 1 --2- 172.21.15.77:0/335929019 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3e5406be30 0x7f3e5406e2f0 secure :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3e681e9270 tx=0x7f3e5c009040 comp rx=0 tx=0).stop 2024-04-25T01:41:18.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.473+0000 7f3e6e742640 1 --2- 172.21.15.77:0/335929019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e68150090 0x7f3e680b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.473+0000 7f3e6e742640 1 --2- 172.21.15.77:0/335929019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e680c8200 0x7f3e680b0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.473+0000 7f3e6e742640 1 --2- 172.21.15.77:0/335929019 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3e6806c280 0x7f3e681595b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.473+0000 7f3e6e742640 1 -- 172.21.15.77:0/335929019 >> 172.21.15.77:0/335929019 conn(0x7f3e680ad4d0 msgr2=0x7f3e6814ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:18.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.473+0000 7f3e6e742640 1 -- 172.21.15.77:0/335929019 shutdown_connections 2024-04-25T01:41:18.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.473+0000 7f3e6e742640 1 -- 172.21.15.77:0/335929019 wait complete. 2024-04-25T01:41:18.471 INFO:tasks.mds_thrash.fs.[b]:kill mds.a (rank=0) 2024-04-25T01:41:18.472 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T01:41:18.472 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T01:41:18.484 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T01:41:18.484 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:18.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.555+0000 7f9c2e6f5640 1 -- 172.21.15.77:0/2240287238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c08005850 con 0x7f9c28150090 2024-04-25T01:41:18.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.556+0000 7f9c24ff9640 1 -- 172.21.15.77:0/2240287238 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6492 (secure 0 0 0) 0x7f9c2005d0e0 con 0x7f9c28150090 2024-04-25T01:41:18.543 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:18.543 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5265,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:02.386295+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":29,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":2}]} 2024-04-25T01:41:18.543 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 17 2024-04-25T01:41:18.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.558+0000 7f9c2e6f5640 1 -- 172.21.15.77:0/2240287238 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9c1406be30 msgr2=0x7f9c1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:18.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.558+0000 7f9c2e6f5640 1 --2- 172.21.15.77:0/2240287238 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9c1406be30 0x7f9c1406e2f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9c18034000 tx=0x7f9c1802e000 comp rx=0 tx=0).stop 2024-04-25T01:41:18.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.558+0000 7f9c2e6f5640 1 -- 172.21.15.77:0/2240287238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c28150090 msgr2=0x7f9c280c16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:18.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.558+0000 7f9c2e6f5640 1 --2- 172.21.15.77:0/2240287238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c28150090 0x7f9c280c16e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9c2000caa0 tx=0x7f9c2000cf60 comp rx=0 tx=0).stop 2024-04-25T01:41:18.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.558+0000 7f9c2e6f5640 1 -- 172.21.15.77:0/2240287238 shutdown_connections 2024-04-25T01:41:18.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.558+0000 7f9c2e6f5640 1 --2- 172.21.15.77:0/2240287238 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9c1406be30 0x7f9c1406e2f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.558+0000 7f9c2e6f5640 1 --2- 172.21.15.77:0/2240287238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c28150090 0x7f9c280c16e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.558+0000 7f9c2e6f5640 1 --2- 172.21.15.77:0/2240287238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c280c8200 0x7f9c280c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.558+0000 7f9c2e6f5640 1 --2- 172.21.15.77:0/2240287238 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9c2806c280 0x7f9c2815a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.558+0000 7f9c2e6f5640 1 -- 172.21.15.77:0/2240287238 >> 172.21.15.77:0/2240287238 conn(0x7f9c280ad4d0 msgr2=0x7f9c280ad8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:18.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.558+0000 7f9c2e6f5640 1 -- 172.21.15.77:0/2240287238 shutdown_connections 2024-04-25T01:41:18.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.558+0000 7f9c2e6f5640 1 -- 172.21.15.77:0/2240287238 wait complete. 2024-04-25T01:41:18.562 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-25T01:41:18.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.664+0000 7f480ae4d640 1 Processor -- start 2024-04-25T01:41:18.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.664+0000 7f480ae4d640 1 -- start start 2024-04-25T01:41:18.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.665+0000 7f480ae4d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4804150090 0x7f4804156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:18.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.665+0000 7f480ae4d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f48040c8200 0x7f48040c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:18.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.665+0000 7f480ae4d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f480406c280 0x7f48040c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:18.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.665+0000 7f480ae4d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f480406b830 con 0x7f48040c8200 2024-04-25T01:41:18.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.665+0000 7f480ae4d640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f48040c9de0 con 0x7f480406c280 2024-04-25T01:41:18.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.665+0000 7f480ae4d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f48040c89c0 con 0x7f4804150090 2024-04-25T01:41:18.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.665+0000 7f4803fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f48040c8200 0x7f48040c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:18.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.665+0000 7f4803fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f48040c8200 0x7f48040c98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45056/0 (socket says 172.21.15.77:45056) 2024-04-25T01:41:18.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.665+0000 7f4803fff640 1 -- 172.21.15.77:0/2499837717 learned_addr learned my addr 172.21.15.77:0/2499837717 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:18.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.665+0000 7f4808be9640 1 --2- 172.21.15.77:0/2499837717 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4804150090 0x7f4804156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:18.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.665+0000 7f48093ea640 1 --2- 172.21.15.77:0/2499837717 >> v2:172.21.15.121:3300/0 conn(0x7f480406c280 0x7f48040c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:18.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.666+0000 7f4803fff640 1 -- 172.21.15.77:0/2499837717 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4804150090 msgr2=0x7f4804156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:18.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.666+0000 7f4803fff640 1 --2- 172.21.15.77:0/2499837717 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4804150090 0x7f4804156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.666+0000 7f4803fff640 1 -- 172.21.15.77:0/2499837717 >> v2:172.21.15.121:3300/0 conn(0x7f480406c280 msgr2=0x7f48040c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:18.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.666+0000 7f4803fff640 1 --2- 172.21.15.77:0/2499837717 >> v2:172.21.15.121:3300/0 conn(0x7f480406c280 0x7f48040c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.666+0000 7f4803fff640 1 -- 172.21.15.77:0/2499837717 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48040c8ca0 con 0x7f48040c8200 2024-04-25T01:41:18.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.666+0000 7f4803fff640 1 --2- 172.21.15.77:0/2499837717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48040c8200 0x7f48040c98a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f480406ce70 tx=0x7f47f002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38f419015f85896 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:18.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.666+0000 7f48037fe640 1 -- 172.21.15.77:0/2499837717 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f0037070 con 0x7f48040c8200 2024-04-25T01:41:18.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.667+0000 7f48037fe640 1 -- 172.21.15.77:0/2499837717 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47f0032440 con 0x7f48040c8200 2024-04-25T01:41:18.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.667+0000 7f48037fe640 1 -- 172.21.15.77:0/2499837717 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f0032810 con 0x7f48040c8200 2024-04-25T01:41:18.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.667+0000 7f480ae4d640 1 -- 172.21.15.77:0/2499837717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48040c8200 msgr2=0x7f48040c98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:18.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.667+0000 7f480ae4d640 1 --2- 172.21.15.77:0/2499837717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48040c8200 0x7f48040c98a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f480406ce70 tx=0x7f47f002a1e0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.667+0000 7f480ae4d640 1 -- 172.21.15.77:0/2499837717 shutdown_connections 2024-04-25T01:41:18.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.667+0000 7f480ae4d640 1 --2- 172.21.15.77:0/2499837717 >> v2:172.21.15.121:3300/0 conn(0x7f480406c280 0x7f48040c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.667+0000 7f480ae4d640 1 --2- 172.21.15.77:0/2499837717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48040c8200 0x7f48040c98a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.667+0000 7f480ae4d640 1 --2- 172.21.15.77:0/2499837717 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4804150090 0x7f4804156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.667+0000 7f480ae4d640 1 -- 172.21.15.77:0/2499837717 >> 172.21.15.77:0/2499837717 conn(0x7f48040ad4d0 msgr2=0x7f48040ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:18.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.667+0000 7f480ae4d640 1 -- 172.21.15.77:0/2499837717 shutdown_connections 2024-04-25T01:41:18.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.667+0000 7f480ae4d640 1 -- 172.21.15.77:0/2499837717 wait complete. 2024-04-25T01:41:18.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.668+0000 7f480ae4d640 1 Processor -- start 2024-04-25T01:41:18.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.668+0000 7f480ae4d640 1 -- start start 2024-04-25T01:41:18.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.669+0000 7f480ae4d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f480406c280 0x7f48040c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:18.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.669+0000 7f480ae4d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f48040c8200 0x7f48040c1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:18.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.669+0000 7f480ae4d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4804150090 0x7f48040c2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:18.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.669+0000 7f480ae4d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f48040c8680 con 0x7f4804150090 2024-04-25T01:41:18.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.669+0000 7f480ae4d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f480406bd60 con 0x7f480406c280 2024-04-25T01:41:18.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.669+0000 7f480ae4d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f480406c6b0 con 0x7f48040c8200 2024-04-25T01:41:18.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.669+0000 7f4808be9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f480406c280 0x7f48040c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:18.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.669+0000 7f4803fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f48040c8200 0x7f48040c1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:18.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.669+0000 7f4808be9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f480406c280 0x7f48040c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:38878/0 (socket says 172.21.15.77:38878) 2024-04-25T01:41:18.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.669+0000 7f4808be9640 1 -- 172.21.15.77:0/13084127 learned_addr learned my addr 172.21.15.77:0/13084127 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:18.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.669+0000 7f48093ea640 1 --2- 172.21.15.77:0/13084127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4804150090 0x7f48040c2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:18.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.670+0000 7f48093ea640 1 -- 172.21.15.77:0/13084127 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f48040c8200 msgr2=0x7f48040c1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:18.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.670+0000 7f48093ea640 1 --2- 172.21.15.77:0/13084127 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f48040c8200 0x7f48040c1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.670+0000 7f48093ea640 1 -- 172.21.15.77:0/13084127 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f480406c280 msgr2=0x7f48040c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:18.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.670+0000 7f48093ea640 1 --2- 172.21.15.77:0/13084127 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f480406c280 0x7f48040c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.670+0000 7f48093ea640 1 -- 172.21.15.77:0/13084127 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48040c2690 con 0x7f4804150090 2024-04-25T01:41:18.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.670+0000 7f4808be9640 1 --2- 172.21.15.77:0/13084127 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f480406c280 0x7f48040c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:41:18.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.670+0000 7f48093ea640 1 --2- 172.21.15.77:0/13084127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4804150090 0x7f48040c2150 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f47fc00eae0 tx=0x7f47fc00b0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:18.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.670+0000 7f48017fa640 1 -- 172.21.15.77:0/13084127 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47fc018020 con 0x7f4804150090 2024-04-25T01:41:18.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.670+0000 7f48017fa640 1 -- 172.21.15.77:0/13084127 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47fc00bc10 con 0x7f4804150090 2024-04-25T01:41:18.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.670+0000 7f480ae4d640 1 -- 172.21.15.77:0/13084127 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48040c3e40 con 0x7f4804150090 2024-04-25T01:41:18.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.670+0000 7f48017fa640 1 -- 172.21.15.77:0/13084127 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47fc014400 con 0x7f4804150090 2024-04-25T01:41:18.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.670+0000 7f480ae4d640 1 -- 172.21.15.77:0/13084127 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48041579a0 con 0x7f4804150090 2024-04-25T01:41:18.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.671+0000 7f480ae4d640 1 -- 172.21.15.77:0/13084127 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f480404f500 con 0x7f4804150090 2024-04-25T01:41:18.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.672+0000 7f48017fa640 1 -- 172.21.15.77:0/13084127 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f47fc005d10 con 0x7f4804150090 2024-04-25T01:41:18.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.672+0000 7f48017fa640 1 --2- 172.21.15.77:0/13084127 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f47e806be30 0x7f47e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:18.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.672+0000 7f48017fa640 1 -- 172.21.15.77:0/13084127 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6723+0+0 (secure 0 0 0) 0x7f47fc08b880 con 0x7f4804150090 2024-04-25T01:41:18.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.672+0000 7f4808be9640 1 --2- 172.21.15.77:0/13084127 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f47e806be30 0x7f47e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:18.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.673+0000 7f4808be9640 1 --2- 172.21.15.77:0/13084127 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f47e806be30 0x7f47e806e2f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f47f8009f50 tx=0x7f47f8009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:18.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.680+0000 7f48017fa640 1 -- 172.21.15.77:0/13084127 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f47fc022030 con 0x7f4804150090 2024-04-25T01:41:18.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.921+0000 7f480ae4d640 1 -- 172.21.15.77:0/13084127 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f480406cec0 con 0x7f4804150090 2024-04-25T01:41:18.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.922+0000 7f48017fa640 1 -- 172.21.15.77:0/13084127 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6492 (secure 0 0 0) 0x7f47fc059870 con 0x7f4804150090 2024-04-25T01:41:18.909 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:18.909 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5265,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:02.386295+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":29,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":2}]} 2024-04-25T01:41:18.909 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 17 2024-04-25T01:41:18.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.924+0000 7f480ae4d640 1 -- 172.21.15.77:0/13084127 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f47e806be30 msgr2=0x7f47e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:18.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.924+0000 7f480ae4d640 1 --2- 172.21.15.77:0/13084127 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f47e806be30 0x7f47e806e2f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f47f8009f50 tx=0x7f47f8009190 comp rx=0 tx=0).stop 2024-04-25T01:41:18.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.924+0000 7f480ae4d640 1 -- 172.21.15.77:0/13084127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4804150090 msgr2=0x7f48040c2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:18.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.924+0000 7f480ae4d640 1 --2- 172.21.15.77:0/13084127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4804150090 0x7f48040c2150 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f47fc00eae0 tx=0x7f47fc00b0b0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.924+0000 7f480ae4d640 1 -- 172.21.15.77:0/13084127 shutdown_connections 2024-04-25T01:41:18.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.924+0000 7f480ae4d640 1 --2- 172.21.15.77:0/13084127 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f47e806be30 0x7f47e806e2f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.924+0000 7f480ae4d640 1 --2- 172.21.15.77:0/13084127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4804150090 0x7f48040c2150 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.924+0000 7f480ae4d640 1 --2- 172.21.15.77:0/13084127 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f48040c8200 0x7f48040c1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.924+0000 7f480ae4d640 1 --2- 172.21.15.77:0/13084127 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f480406c280 0x7f48040c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:18.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.924+0000 7f480ae4d640 1 -- 172.21.15.77:0/13084127 >> 172.21.15.77:0/13084127 conn(0x7f48040ad4d0 msgr2=0x7f48041542e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:18.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.924+0000 7f480ae4d640 1 -- 172.21.15.77:0/13084127 shutdown_connections 2024-04-25T01:41:18.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:18.924+0000 7f480ae4d640 1 -- 172.21.15.77:0/13084127 wait complete. 2024-04-25T01:41:18.922 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T01:41:19.416 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:41:19.418 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:41:20.563 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:20.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.696+0000 7f9a62d7e640 1 Processor -- start 2024-04-25T01:41:20.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.697+0000 7f9a62d7e640 1 -- start start 2024-04-25T01:41:20.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.698+0000 7f9a62d7e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9a5c150090 0x7f9a5c156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:20.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.698+0000 7f9a62d7e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a5c0c89c0 con 0x7f9a5c06c280 2024-04-25T01:41:20.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.698+0000 7f9a62d7e640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a5c0c8ca0 con 0x7f9a5c0c8200 2024-04-25T01:41:20.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.698+0000 7f9a62d7e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9a5c06b830 con 0x7f9a5c150090 2024-04-25T01:41:20.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.698+0000 7f9a6131b640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9a5c06c280 0x7f9a5c0c6320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:34968/0 (socket says 172.21.15.77:34968) 2024-04-25T01:41:20.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.698+0000 7f9a6131b640 1 -- 172.21.15.77:0/1845420762 learned_addr learned my addr 172.21.15.77:0/1845420762 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:41:20.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.698+0000 7f9a60b1a640 1 --2- 172.21.15.77:0/1845420762 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9a5c150090 0x7f9a5c156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:20.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.698+0000 7f9a5b7fe640 1 -- 172.21.15.77:0/1845420762 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 916723060 0 0) 0x7f9a5c0c89c0 con 0x7f9a5c06c280 2024-04-25T01:41:20.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.698+0000 7f9a5b7fe640 1 -- 172.21.15.77:0/1845420762 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a4c003520 con 0x7f9a5c06c280 2024-04-25T01:41:20.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.698+0000 7f9a5b7fe640 1 -- 172.21.15.77:0/1845420762 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 321321705 0 0) 0x7f9a5c0c8ca0 con 0x7f9a5c0c8200 2024-04-25T01:41:20.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.698+0000 7f9a5b7fe640 1 -- 172.21.15.77:0/1845420762 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a5c0c89c0 con 0x7f9a5c0c8200 2024-04-25T01:41:20.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.698+0000 7f9a60b1a640 1 -- 172.21.15.77:0/1845420762 >> v1:172.21.15.121:6789/0 conn(0x7f9a5c0c8200 legacy=0x7f9a5c0c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:20.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.698+0000 7f9a60b1a640 1 -- 172.21.15.77:0/1845420762 >> v1:172.21.15.77:6789/0 conn(0x7f9a5c06c280 legacy=0x7f9a5c0c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:20.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.698+0000 7f9a60b1a640 1 -- 172.21.15.77:0/1845420762 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a5c06ba80 con 0x7f9a5c150090 2024-04-25T01:41:20.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.699+0000 7f9a60b1a640 1 --2- 172.21.15.77:0/1845420762 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9a5c150090 0x7f9a5c156c80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9a500097d0 tx=0x7f9a5002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b39c1ccacddef91b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:20.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.700+0000 7f9a5b7fe640 1 -- 172.21.15.77:0/1845420762 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a50037070 con 0x7f9a5c150090 2024-04-25T01:41:20.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.700+0000 7f9a5b7fe640 1 -- 172.21.15.77:0/1845420762 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a50032440 con 0x7f9a5c150090 2024-04-25T01:41:20.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.700+0000 7f9a5b7fe640 1 -- 172.21.15.77:0/1845420762 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a50032810 con 0x7f9a5c150090 2024-04-25T01:41:20.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.700+0000 7f9a62d7e640 1 -- 172.21.15.77:0/1845420762 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9a5c150090 msgr2=0x7f9a5c156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:20.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.700+0000 7f9a62d7e640 1 --2- 172.21.15.77:0/1845420762 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9a5c150090 0x7f9a5c156c80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9a500097d0 tx=0x7f9a5002a210 comp rx=0 tx=0).stop 2024-04-25T01:41:20.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.700+0000 7f9a62d7e640 1 -- 172.21.15.77:0/1845420762 shutdown_connections 2024-04-25T01:41:20.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.700+0000 7f9a62d7e640 1 --2- 172.21.15.77:0/1845420762 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9a5c150090 0x7f9a5c156c80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:20.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.700+0000 7f9a62d7e640 1 -- 172.21.15.77:0/1845420762 >> 172.21.15.77:0/1845420762 conn(0x7f9a5c0ad4d0 msgr2=0x7f9a5c0ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:20.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.700+0000 7f9a62d7e640 1 -- 172.21.15.77:0/1845420762 shutdown_connections 2024-04-25T01:41:20.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.700+0000 7f9a62d7e640 1 -- 172.21.15.77:0/1845420762 wait complete. 2024-04-25T01:41:20.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.702+0000 7f9a62d7e640 1 Processor -- start 2024-04-25T01:41:20.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.702+0000 7f9a62d7e640 1 -- start start 2024-04-25T01:41:20.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.703+0000 7f9a62d7e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a5c06c280 0x7f9a5c0aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:20.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.703+0000 7f9a62d7e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9a5c0c8200 0x7f9a5c14abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:20.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.703+0000 7f9a62d7e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a5c150090 0x7f9a5c14b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:20.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.703+0000 7f9a60b1a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a5c06c280 0x7f9a5c0aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:20.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.703+0000 7f9a60b1a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a5c06c280 0x7f9a5c0aedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45064/0 (socket says 172.21.15.77:45064) 2024-04-25T01:41:20.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.703+0000 7f9a60b1a640 1 -- 172.21.15.77:0/1812282749 learned_addr learned my addr 172.21.15.77:0/1812282749 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:20.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.703+0000 7f9a62d7e640 1 -- 172.21.15.77:0/1812282749 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5c06c6f0 con 0x7f9a5c06c280 2024-04-25T01:41:20.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.703+0000 7f9a62d7e640 1 -- 172.21.15.77:0/1812282749 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5c0c8680 con 0x7f9a5c150090 2024-04-25T01:41:20.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.703+0000 7f9a62d7e640 1 -- 172.21.15.77:0/1812282749 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9a5c06c870 con 0x7f9a5c0c8200 2024-04-25T01:41:20.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.704+0000 7f9a5bfff640 1 --2- 172.21.15.77:0/1812282749 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9a5c0c8200 0x7f9a5c14abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:20.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.704+0000 7f9a6131b640 1 --2- 172.21.15.77:0/1812282749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a5c150090 0x7f9a5c14b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:20.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.704+0000 7f9a60b1a640 1 -- 172.21.15.77:0/1812282749 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9a5c0c8200 msgr2=0x7f9a5c14abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:20.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.704+0000 7f9a60b1a640 1 --2- 172.21.15.77:0/1812282749 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9a5c0c8200 0x7f9a5c14abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:20.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.704+0000 7f9a60b1a640 1 -- 172.21.15.77:0/1812282749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a5c150090 msgr2=0x7f9a5c14b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:20.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.704+0000 7f9a60b1a640 1 --2- 172.21.15.77:0/1812282749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a5c150090 0x7f9a5c14b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:20.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.704+0000 7f9a60b1a640 1 -- 172.21.15.77:0/1812282749 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a5c0c5030 con 0x7f9a5c06c280 2024-04-25T01:41:20.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.704+0000 7f9a60b1a640 1 --2- 172.21.15.77:0/1812282749 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a5c06c280 0x7f9a5c0aedf0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9a50000c00 tx=0x7f9a500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:20.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.704+0000 7f9a597fa640 1 -- 172.21.15.77:0/1812282749 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a50041020 con 0x7f9a5c06c280 2024-04-25T01:41:20.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.704+0000 7f9a597fa640 1 -- 172.21.15.77:0/1812282749 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a5003d640 con 0x7f9a5c06c280 2024-04-25T01:41:20.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.704+0000 7f9a597fa640 1 -- 172.21.15.77:0/1812282749 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a50037040 con 0x7f9a5c06c280 2024-04-25T01:41:20.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.704+0000 7f9a62d7e640 1 -- 172.21.15.77:0/1812282749 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a5c0c2bf0 con 0x7f9a5c06c280 2024-04-25T01:41:20.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.705+0000 7f9a62d7e640 1 -- 172.21.15.77:0/1812282749 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a5c1530f0 con 0x7f9a5c06c280 2024-04-25T01:41:20.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.706+0000 7f9a62d7e640 1 -- 172.21.15.77:0/1812282749 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a5c04f500 con 0x7f9a5c06c280 2024-04-25T01:41:20.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.706+0000 7f9a597fa640 1 -- 172.21.15.77:0/1812282749 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9a50044020 con 0x7f9a5c06c280 2024-04-25T01:41:20.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.707+0000 7f9a597fa640 1 --2- 172.21.15.77:0/1812282749 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9a4006be30 0x7f9a4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:20.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.707+0000 7f9a597fa640 1 -- 172.21.15.77:0/1812282749 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6723+0+0 (secure 0 0 0) 0x7f9a500ab800 con 0x7f9a5c06c280 2024-04-25T01:41:20.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.707+0000 7f9a5bfff640 1 --2- 172.21.15.77:0/1812282749 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9a4006be30 0x7f9a4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:20.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.707+0000 7f9a5bfff640 1 --2- 172.21.15.77:0/1812282749 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9a4006be30 0x7f9a4006e2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9a48007fd0 tx=0x7f9a48009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:20.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.715+0000 7f9a597fa640 1 -- 172.21.15.77:0/1812282749 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9a5004b030 con 0x7f9a5c06c280 2024-04-25T01:41:20.923 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:20.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.956+0000 7f9a62d7e640 1 -- 172.21.15.77:0/1812282749 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a5c0c27e0 con 0x7f9a5c06c280 2024-04-25T01:41:20.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.957+0000 7f9a597fa640 1 -- 172.21.15.77:0/1812282749 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6492 (secure 0 0 0) 0x7f9a50079770 con 0x7f9a5c06c280 2024-04-25T01:41:20.944 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:20.944 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5265,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:02.386295+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":29,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":2}]} 2024-04-25T01:41:20.944 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 17 2024-04-25T01:41:20.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.960+0000 7f9a62d7e640 1 -- 172.21.15.77:0/1812282749 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9a4006be30 msgr2=0x7f9a4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:20.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.960+0000 7f9a62d7e640 1 --2- 172.21.15.77:0/1812282749 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9a4006be30 0x7f9a4006e2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9a48007fd0 tx=0x7f9a48009040 comp rx=0 tx=0).stop 2024-04-25T01:41:20.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.960+0000 7f9a62d7e640 1 -- 172.21.15.77:0/1812282749 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a5c06c280 msgr2=0x7f9a5c0aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:20.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.960+0000 7f9a62d7e640 1 --2- 172.21.15.77:0/1812282749 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a5c06c280 0x7f9a5c0aedf0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9a50000c00 tx=0x7f9a500046c0 comp rx=0 tx=0).stop 2024-04-25T01:41:20.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.960+0000 7f9a62d7e640 1 -- 172.21.15.77:0/1812282749 shutdown_connections 2024-04-25T01:41:20.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.960+0000 7f9a62d7e640 1 --2- 172.21.15.77:0/1812282749 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9a4006be30 0x7f9a4006e2f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:20.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.960+0000 7f9a62d7e640 1 --2- 172.21.15.77:0/1812282749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a5c150090 0x7f9a5c14b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:20.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.960+0000 7f9a62d7e640 1 --2- 172.21.15.77:0/1812282749 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9a5c0c8200 0x7f9a5c14abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:20.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.960+0000 7f9a62d7e640 1 --2- 172.21.15.77:0/1812282749 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a5c06c280 0x7f9a5c0aedf0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:20.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.961+0000 7f9a62d7e640 1 -- 172.21.15.77:0/1812282749 >> 172.21.15.77:0/1812282749 conn(0x7f9a5c0ad4d0 msgr2=0x7f9a5c154410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:20.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.961+0000 7f9a62d7e640 1 -- 172.21.15.77:0/1812282749 shutdown_connections 2024-04-25T01:41:20.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:20.961+0000 7f9a62d7e640 1 -- 172.21.15.77:0/1812282749 wait complete. 2024-04-25T01:41:20.962 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-25T01:41:21.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.078+0000 7fb0e0a93640 1 Processor -- start 2024-04-25T01:41:21.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.078+0000 7fb0e0a93640 1 -- start start 2024-04-25T01:41:21.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.079+0000 7fb0e0a93640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb0dc06f7d0 0x7fb0dc157450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:21.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.079+0000 7fb0e0a93640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0dc157ba0 con 0x7fb0dc0723c0 2024-04-25T01:41:21.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.079+0000 7fb0e0a93640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0dc157e80 con 0x7fb0dc151430 2024-04-25T01:41:21.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.079+0000 7fb0e0a93640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fb0dc0677c0 con 0x7fb0dc06f7d0 2024-04-25T01:41:21.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.079+0000 7fb0d3fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb0dc0723c0 0x7fb0dc154590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:34976/0 (socket says 172.21.15.77:34976) 2024-04-25T01:41:21.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.079+0000 7fb0d3fff640 1 -- 172.21.15.77:0/571078641 learned_addr learned my addr 172.21.15.77:0/571078641 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:41:21.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.079+0000 7fb0dad9d640 1 --2- 172.21.15.77:0/571078641 >> v2:172.21.15.121:3300/0 conn(0x7fb0dc06f7d0 0x7fb0dc157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:21.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.079+0000 7fb0d9d9b640 1 -- 172.21.15.77:0/571078641 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 799713864 0 0) 0x7fb0dc157ba0 con 0x7fb0dc0723c0 2024-04-25T01:41:21.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.079+0000 7fb0d9d9b640 1 -- 172.21.15.77:0/571078641 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0c8003520 con 0x7fb0dc0723c0 2024-04-25T01:41:21.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.079+0000 7fb0dad9d640 1 -- 172.21.15.77:0/571078641 >> v1:172.21.15.121:6789/0 conn(0x7fb0dc151430 legacy=0x7fb0dc0c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:21.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.079+0000 7fb0dad9d640 1 -- 172.21.15.77:0/571078641 >> v1:172.21.15.77:6789/0 conn(0x7fb0dc0723c0 legacy=0x7fb0dc154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:21.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.079+0000 7fb0dad9d640 1 -- 172.21.15.77:0/571078641 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0dc158160 con 0x7fb0dc06f7d0 2024-04-25T01:41:21.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.080+0000 7fb0dad9d640 1 --2- 172.21.15.77:0/571078641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0dc06f7d0 0x7fb0dc157450 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4009d90 tx=0x7fb0d402a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4dcfa4083ef6d8b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:21.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.081+0000 7fb0d9d9b640 1 -- 172.21.15.77:0/571078641 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d4031600 con 0x7fb0dc06f7d0 2024-04-25T01:41:21.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.081+0000 7fb0d9d9b640 1 -- 172.21.15.77:0/571078641 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d40317a0 con 0x7fb0dc06f7d0 2024-04-25T01:41:21.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.081+0000 7fb0d9d9b640 1 -- 172.21.15.77:0/571078641 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d4031b70 con 0x7fb0dc06f7d0 2024-04-25T01:41:21.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.081+0000 7fb0e0a93640 1 -- 172.21.15.77:0/571078641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0dc06f7d0 msgr2=0x7fb0dc157450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:21.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.081+0000 7fb0e0a93640 1 --2- 172.21.15.77:0/571078641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0dc06f7d0 0x7fb0dc157450 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4009d90 tx=0x7fb0d402a5d0 comp rx=0 tx=0).stop 2024-04-25T01:41:21.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.081+0000 7fb0e0a93640 1 -- 172.21.15.77:0/571078641 shutdown_connections 2024-04-25T01:41:21.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.081+0000 7fb0e0a93640 1 --2- 172.21.15.77:0/571078641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0dc06f7d0 0x7fb0dc157450 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:21.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.081+0000 7fb0e0a93640 1 -- 172.21.15.77:0/571078641 >> 172.21.15.77:0/571078641 conn(0x7fb0dc0aa8f0 msgr2=0x7fb0dc066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:21.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.081+0000 7fb0e0a93640 1 -- 172.21.15.77:0/571078641 shutdown_connections 2024-04-25T01:41:21.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.081+0000 7fb0e0a93640 1 -- 172.21.15.77:0/571078641 wait complete. 2024-04-25T01:41:21.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.083+0000 7fb0e0a93640 1 Processor -- start 2024-04-25T01:41:21.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.083+0000 7fb0e0a93640 1 -- start start 2024-04-25T01:41:21.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.084+0000 7fb0e0a93640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0dc06f7d0 0x7fb0dc1555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:21.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.084+0000 7fb0e0a93640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb0dc0723c0 0x7fb0dc142f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:21.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.084+0000 7fb0e0a93640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0dc151430 0x7fb0dc1434a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:21.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.084+0000 7fb0e0a93640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc0c47c0 con 0x7fb0dc06f7d0 2024-04-25T01:41:21.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.084+0000 7fb0e0a93640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc154100 con 0x7fb0dc151430 2024-04-25T01:41:21.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.084+0000 7fb0e0a93640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb0dc0c4940 con 0x7fb0dc0723c0 2024-04-25T01:41:21.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.084+0000 7fb0da59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0dc06f7d0 0x7fb0dc1555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:21.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.084+0000 7fb0da59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0dc06f7d0 0x7fb0dc1555f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45080/0 (socket says 172.21.15.77:45080) 2024-04-25T01:41:21.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.084+0000 7fb0da59c640 1 -- 172.21.15.77:0/1533437622 learned_addr learned my addr 172.21.15.77:0/1533437622 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:21.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.085+0000 7fb0d3fff640 1 --2- 172.21.15.77:0/1533437622 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb0dc0723c0 0x7fb0dc142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:21.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.085+0000 7fb0dad9d640 1 --2- 172.21.15.77:0/1533437622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0dc151430 0x7fb0dc1434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:21.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.085+0000 7fb0da59c640 1 -- 172.21.15.77:0/1533437622 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb0dc0723c0 msgr2=0x7fb0dc142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:21.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.085+0000 7fb0da59c640 1 --2- 172.21.15.77:0/1533437622 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb0dc0723c0 0x7fb0dc142f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:21.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.085+0000 7fb0da59c640 1 -- 172.21.15.77:0/1533437622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0dc151430 msgr2=0x7fb0dc1434a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:21.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.085+0000 7fb0da59c640 1 --2- 172.21.15.77:0/1533437622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0dc151430 0x7fb0dc1434a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:21.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.085+0000 7fb0da59c640 1 -- 172.21.15.77:0/1533437622 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0dc155140 con 0x7fb0dc06f7d0 2024-04-25T01:41:21.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.085+0000 7fb0da59c640 1 --2- 172.21.15.77:0/1533437622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0dc06f7d0 0x7fb0dc1555f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00c480 tx=0x7fb0cc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:21.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.085+0000 7fb0d2ffd640 1 -- 172.21.15.77:0/1533437622 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc0052d0 con 0x7fb0dc06f7d0 2024-04-25T01:41:21.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.085+0000 7fb0d2ffd640 1 -- 172.21.15.77:0/1533437622 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0cc005470 con 0x7fb0dc06f7d0 2024-04-25T01:41:21.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.085+0000 7fb0e0a93640 1 -- 172.21.15.77:0/1533437622 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0dc1573c0 con 0x7fb0dc06f7d0 2024-04-25T01:41:21.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.086+0000 7fb0d2ffd640 1 -- 172.21.15.77:0/1533437622 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc012870 con 0x7fb0dc06f7d0 2024-04-25T01:41:21.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.086+0000 7fb0e0a93640 1 -- 172.21.15.77:0/1533437622 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0dc14c970 con 0x7fb0dc06f7d0 2024-04-25T01:41:21.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.087+0000 7fb0e0a93640 1 -- 172.21.15.77:0/1533437622 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0dc1578e0 con 0x7fb0dc06f7d0 2024-04-25T01:41:21.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.087+0000 7fb0d2ffd640 1 -- 172.21.15.77:0/1533437622 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb0cc012a10 con 0x7fb0dc06f7d0 2024-04-25T01:41:21.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.088+0000 7fb0d2ffd640 1 --2- 172.21.15.77:0/1533437622 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb0bc06be30 0x7fb0bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:21.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.088+0000 7fb0d3fff640 1 --2- 172.21.15.77:0/1533437622 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb0bc06be30 0x7fb0bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:21.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.088+0000 7fb0d2ffd640 1 -- 172.21.15.77:0/1533437622 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6723+0+0 (secure 0 0 0) 0x7fb0cc08ad10 con 0x7fb0dc06f7d0 2024-04-25T01:41:21.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.088+0000 7fb0d3fff640 1 --2- 172.21.15.77:0/1533437622 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb0bc06be30 0x7fb0bc06e2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc14c500 tx=0x7fb0c4007d30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:21.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.096+0000 7fb0d2ffd640 1 -- 172.21.15.77:0/1533437622 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb0dc1578e0 con 0x7fb0dc06f7d0 2024-04-25T01:41:21.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.363+0000 7fb0e0a93640 1 -- 172.21.15.77:0/1533437622 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0dc04f500 con 0x7fb0dc06f7d0 2024-04-25T01:41:21.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.363+0000 7fb0d2ffd640 1 -- 172.21.15.77:0/1533437622 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6492 (secure 0 0 0) 0x7fb0cc058d00 con 0x7fb0dc06f7d0 2024-04-25T01:41:21.350 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:21.350 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5265,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:02.386295+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":29,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":2}]} 2024-04-25T01:41:21.351 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 17 2024-04-25T01:41:21.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.366+0000 7fb0e0a93640 1 -- 172.21.15.77:0/1533437622 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb0bc06be30 msgr2=0x7fb0bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:21.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.366+0000 7fb0e0a93640 1 --2- 172.21.15.77:0/1533437622 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb0bc06be30 0x7fb0bc06e2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc14c500 tx=0x7fb0c4007d30 comp rx=0 tx=0).stop 2024-04-25T01:41:21.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.366+0000 7fb0e0a93640 1 -- 172.21.15.77:0/1533437622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0dc06f7d0 msgr2=0x7fb0dc1555f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:21.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.366+0000 7fb0e0a93640 1 --2- 172.21.15.77:0/1533437622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0dc06f7d0 0x7fb0dc1555f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00c480 tx=0x7fb0cc00c940 comp rx=0 tx=0).stop 2024-04-25T01:41:21.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.366+0000 7fb0e0a93640 1 -- 172.21.15.77:0/1533437622 shutdown_connections 2024-04-25T01:41:21.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.366+0000 7fb0e0a93640 1 --2- 172.21.15.77:0/1533437622 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb0bc06be30 0x7fb0bc06e2f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:21.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.366+0000 7fb0e0a93640 1 --2- 172.21.15.77:0/1533437622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0dc151430 0x7fb0dc1434a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:21.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.366+0000 7fb0e0a93640 1 --2- 172.21.15.77:0/1533437622 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb0dc0723c0 0x7fb0dc142f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:21.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.366+0000 7fb0e0a93640 1 --2- 172.21.15.77:0/1533437622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0dc06f7d0 0x7fb0dc1555f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:21.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.366+0000 7fb0e0a93640 1 -- 172.21.15.77:0/1533437622 >> 172.21.15.77:0/1533437622 conn(0x7fb0dc0aa8f0 msgr2=0x7fb0dc0c6140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:21.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.366+0000 7fb0e0a93640 1 -- 172.21.15.77:0/1533437622 shutdown_connections 2024-04-25T01:41:21.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:21.367+0000 7fb0e0a93640 1 -- 172.21.15.77:0/1533437622 wait complete. 2024-04-25T01:41:21.368 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T01:41:22.963 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:23.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.074+0000 7fe289be9640 1 Processor -- start 2024-04-25T01:41:23.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.075+0000 7fe289be9640 1 -- start start 2024-04-25T01:41:23.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.076+0000 7fe289be9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe284150090 0x7fe284156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:23.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.076+0000 7fe289be9640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe28406c280 0x7fe2840c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:23.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.076+0000 7fe289be9640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2840c89c0 con 0x7fe2840c8200 2024-04-25T01:41:23.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.076+0000 7fe289be9640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fe28406b830 con 0x7fe28406c280 2024-04-25T01:41:23.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.076+0000 7fe289be9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe2840c8ca0 con 0x7fe284150090 2024-04-25T01:41:23.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.076+0000 7fe2837fe640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe284150090 0x7fe284156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:23.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.076+0000 7fe282ffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fe2840c8200 0x7fe2840c98a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.77:43478/0 (socket says 172.21.15.77:43478) 2024-04-25T01:41:23.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.076+0000 7fe282ffd640 1 -- 172.21.15.77:0/734424542 learned_addr learned my addr 172.21.15.77:0/734424542 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:41:23.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.076+0000 7fe283fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe28406c280 0x7fe2840c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:23.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.076+0000 7fe2827fc640 1 -- 172.21.15.77:0/734424542 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 658765936 0 0) 0x7fe2840c89c0 con 0x7fe2840c8200 2024-04-25T01:41:23.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.076+0000 7fe2827fc640 1 -- 172.21.15.77:0/734424542 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe26c003520 con 0x7fe2840c8200 2024-04-25T01:41:23.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.076+0000 7fe283fff640 1 -- 172.21.15.77:0/734424542 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe284150090 msgr2=0x7fe284156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:23.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.076+0000 7fe283fff640 1 --2- 172.21.15.77:0/734424542 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe284150090 0x7fe284156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:23.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.076+0000 7fe283fff640 1 -- 172.21.15.77:0/734424542 >> v1:172.21.15.121:6789/0 conn(0x7fe2840c8200 legacy=0x7fe2840c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:23.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.076+0000 7fe283fff640 1 -- 172.21.15.77:0/734424542 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe28406ba80 con 0x7fe28406c280 2024-04-25T01:41:23.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.077+0000 7fe2837fe640 1 --2- 172.21.15.77:0/734424542 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe284150090 0x7fe284156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:41:23.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.078+0000 7fe283fff640 1 --2- 172.21.15.77:0/734424542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe28406c280 0x7fe2840c6320 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe27c009d90 tx=0x7fe27c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7aa0fdc3d4986e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:23.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.078+0000 7fe2827fc640 1 -- 172.21.15.77:0/734424542 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c007740 con 0x7fe28406c280 2024-04-25T01:41:23.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.078+0000 7fe2827fc640 1 -- 172.21.15.77:0/734424542 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe27c0078e0 con 0x7fe28406c280 2024-04-25T01:41:23.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.078+0000 7fe2827fc640 1 -- 172.21.15.77:0/734424542 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c007cb0 con 0x7fe28406c280 2024-04-25T01:41:23.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.079+0000 7fe289be9640 1 -- 172.21.15.77:0/734424542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe28406c280 msgr2=0x7fe2840c6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:23.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.079+0000 7fe289be9640 1 --2- 172.21.15.77:0/734424542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe28406c280 0x7fe2840c6320 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe27c009d90 tx=0x7fe27c02a660 comp rx=0 tx=0).stop 2024-04-25T01:41:23.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.079+0000 7fe289be9640 1 -- 172.21.15.77:0/734424542 shutdown_connections 2024-04-25T01:41:23.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.079+0000 7fe289be9640 1 --2- 172.21.15.77:0/734424542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe28406c280 0x7fe2840c6320 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:23.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.079+0000 7fe289be9640 1 --2- 172.21.15.77:0/734424542 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe284150090 0x7fe284156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:23.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.079+0000 7fe289be9640 1 -- 172.21.15.77:0/734424542 >> 172.21.15.77:0/734424542 conn(0x7fe2840ad4d0 msgr2=0x7fe2840ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:23.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.079+0000 7fe289be9640 1 -- 172.21.15.77:0/734424542 shutdown_connections 2024-04-25T01:41:23.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.079+0000 7fe289be9640 1 -- 172.21.15.77:0/734424542 wait complete. 2024-04-25T01:41:23.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.080+0000 7fe289be9640 1 Processor -- start 2024-04-25T01:41:23.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.081+0000 7fe289be9640 1 -- start start 2024-04-25T01:41:23.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.082+0000 7fe289be9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe28406c280 0x7fe2841460e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:23.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.082+0000 7fe289be9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2840c8200 0x7fe284152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:23.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.082+0000 7fe289be9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe284150090 0x7fe284159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:23.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.082+0000 7fe289be9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe28406c6f0 con 0x7fe2840c8200 2024-04-25T01:41:23.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.082+0000 7fe289be9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe2840c8680 con 0x7fe28406c280 2024-04-25T01:41:23.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.082+0000 7fe289be9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe28406c870 con 0x7fe284150090 2024-04-25T01:41:23.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.082+0000 7fe282ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2840c8200 0x7fe284152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:23.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.082+0000 7fe2837fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe28406c280 0x7fe2841460e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:23.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.082+0000 7fe282ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2840c8200 0x7fe284152590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45088/0 (socket says 172.21.15.77:45088) 2024-04-25T01:41:23.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.082+0000 7fe282ffd640 1 -- 172.21.15.77:0/2999202425 learned_addr learned my addr 172.21.15.77:0/2999202425 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:23.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.082+0000 7fe283fff640 1 --2- 172.21.15.77:0/2999202425 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe284150090 0x7fe284159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:23.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.082+0000 7fe2837fe640 1 -- 172.21.15.77:0/2999202425 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe284150090 msgr2=0x7fe284159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:23.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.082+0000 7fe2837fe640 1 --2- 172.21.15.77:0/2999202425 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe284150090 0x7fe284159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:23.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.082+0000 7fe2837fe640 1 -- 172.21.15.77:0/2999202425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2840c8200 msgr2=0x7fe284152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:23.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.082+0000 7fe2837fe640 1 --2- 172.21.15.77:0/2999202425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2840c8200 0x7fe284152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:23.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.082+0000 7fe2837fe640 1 -- 172.21.15.77:0/2999202425 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe284152fe0 con 0x7fe28406c280 2024-04-25T01:41:23.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.083+0000 7fe2837fe640 1 --2- 172.21.15.77:0/2999202425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe28406c280 0x7fe2841460e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe27400e870 tx=0x7fe27400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:23.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.083+0000 7fe26bfff640 1 -- 172.21.15.77:0/2999202425 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe274017070 con 0x7fe28406c280 2024-04-25T01:41:23.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.083+0000 7fe26bfff640 1 -- 172.21.15.77:0/2999202425 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe27400c940 con 0x7fe28406c280 2024-04-25T01:41:23.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.083+0000 7fe289be9640 1 -- 172.21.15.77:0/2999202425 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe284157c50 con 0x7fe28406c280 2024-04-25T01:41:23.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.083+0000 7fe26bfff640 1 -- 172.21.15.77:0/2999202425 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27400cd10 con 0x7fe28406c280 2024-04-25T01:41:23.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.083+0000 7fe289be9640 1 -- 172.21.15.77:0/2999202425 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe284158210 con 0x7fe28406c280 2024-04-25T01:41:23.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.084+0000 7fe289be9640 1 -- 172.21.15.77:0/2999202425 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe28404f500 con 0x7fe28406c280 2024-04-25T01:41:23.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.085+0000 7fe26bfff640 1 -- 172.21.15.77:0/2999202425 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe27401a070 con 0x7fe28406c280 2024-04-25T01:41:23.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.085+0000 7fe26bfff640 1 --2- 172.21.15.77:0/2999202425 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe27006be30 0x7fe27006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:23.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.086+0000 7fe26bfff640 1 -- 172.21.15.77:0/2999202425 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6723+0+0 (secure 0 0 0) 0x7fe27408afe0 con 0x7fe28406c280 2024-04-25T01:41:23.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.086+0000 7fe282ffd640 1 --2- 172.21.15.77:0/2999202425 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe27006be30 0x7fe27006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:23.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.086+0000 7fe282ffd640 1 --2- 172.21.15.77:0/2999202425 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe27006be30 0x7fe27006e2f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe284155dd0 tx=0x7fe278009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:23.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.094+0000 7fe26bfff640 1 -- 172.21.15.77:0/2999202425 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe274058f40 con 0x7fe28406c280 2024-04-25T01:41:23.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.312+0000 7fe289be9640 1 -- 172.21.15.77:0/2999202425 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe2840ca460 con 0x7fe28406c280 2024-04-25T01:41:23.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.313+0000 7fe26bfff640 1 -- 172.21.15.77:0/2999202425 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6492 (secure 0 0 0) 0x7fe27405d240 con 0x7fe28406c280 2024-04-25T01:41:23.300 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:23.300 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5265,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:02.386295+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":29,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":2}]} 2024-04-25T01:41:23.300 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 17 2024-04-25T01:41:23.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.316+0000 7fe289be9640 1 -- 172.21.15.77:0/2999202425 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe27006be30 msgr2=0x7fe27006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:23.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.316+0000 7fe289be9640 1 --2- 172.21.15.77:0/2999202425 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe27006be30 0x7fe27006e2f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe284155dd0 tx=0x7fe278009040 comp rx=0 tx=0).stop 2024-04-25T01:41:23.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.316+0000 7fe289be9640 1 -- 172.21.15.77:0/2999202425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe28406c280 msgr2=0x7fe2841460e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:23.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.316+0000 7fe289be9640 1 --2- 172.21.15.77:0/2999202425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe28406c280 0x7fe2841460e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe27400e870 tx=0x7fe27400ed30 comp rx=0 tx=0).stop 2024-04-25T01:41:23.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.316+0000 7fe289be9640 1 -- 172.21.15.77:0/2999202425 shutdown_connections 2024-04-25T01:41:23.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.316+0000 7fe289be9640 1 --2- 172.21.15.77:0/2999202425 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe27006be30 0x7fe27006e2f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:23.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.316+0000 7fe289be9640 1 --2- 172.21.15.77:0/2999202425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2840c8200 0x7fe284152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:23.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.316+0000 7fe289be9640 1 --2- 172.21.15.77:0/2999202425 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe284150090 0x7fe284159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:23.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.316+0000 7fe289be9640 1 --2- 172.21.15.77:0/2999202425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe28406c280 0x7fe2841460e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:23.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.316+0000 7fe289be9640 1 -- 172.21.15.77:0/2999202425 >> 172.21.15.77:0/2999202425 conn(0x7fe2840ad4d0 msgr2=0x7fe2840ad8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:23.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.316+0000 7fe289be9640 1 -- 172.21.15.77:0/2999202425 shutdown_connections 2024-04-25T01:41:23.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.316+0000 7fe289be9640 1 -- 172.21.15.77:0/2999202425 wait complete. 2024-04-25T01:41:23.317 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-25T01:41:23.368 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:23.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.479+0000 7faf840fc640 1 Processor -- start 2024-04-25T01:41:23.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.479+0000 7faf840fc640 1 -- start start 2024-04-25T01:41:23.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.480+0000 7faf840fc640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faf7c153890 0x7faf7c072c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:23.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.480+0000 7faf840fc640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf7c153c70 con 0x7faf7c156210 2024-04-25T01:41:23.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.480+0000 7faf840fc640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf7c156670 con 0x7faf7c0c96c0 2024-04-25T01:41:23.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.480+0000 7faf840fc640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7faf7c072ad0 con 0x7faf7c153890 2024-04-25T01:41:23.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.480+0000 7faf81697640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7faf7c156210 0x7faf7c0723c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:34980/0 (socket says 172.21.15.77:34980) 2024-04-25T01:41:23.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.480+0000 7faf81697640 1 -- 172.21.15.77:0/3554210056 learned_addr learned my addr 172.21.15.77:0/3554210056 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:41:23.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.480+0000 7faf81e98640 1 --2- 172.21.15.77:0/3554210056 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faf7c153890 0x7faf7c072c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:23.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.481+0000 7faf80e96640 1 -- 172.21.15.77:0/3554210056 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 587129044 0 0) 0x7faf740013c0 con 0x7faf7c0c96c0 2024-04-25T01:41:23.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.481+0000 7faf80e96640 1 -- 172.21.15.77:0/3554210056 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf68003520 con 0x7faf7c0c96c0 2024-04-25T01:41:23.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.481+0000 7faf80e96640 1 -- 172.21.15.77:0/3554210056 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3330172124 0 0) 0x7faf6c001110 con 0x7faf7c156210 2024-04-25T01:41:23.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.481+0000 7faf80e96640 1 -- 172.21.15.77:0/3554210056 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf740013c0 con 0x7faf7c156210 2024-04-25T01:41:23.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.481+0000 7faf81e98640 1 -- 172.21.15.77:0/3554210056 >> v1:172.21.15.121:6789/0 conn(0x7faf7c0c96c0 legacy=0x7faf7c160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:23.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.481+0000 7faf81e98640 1 -- 172.21.15.77:0/3554210056 >> v1:172.21.15.77:6789/0 conn(0x7faf7c156210 legacy=0x7faf7c0723c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:23.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.481+0000 7faf81e98640 1 -- 172.21.15.77:0/3554210056 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf7c0c3180 con 0x7faf7c153890 2024-04-25T01:41:23.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.482+0000 7faf81e98640 1 --2- 172.21.15.77:0/3554210056 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faf7c153890 0x7faf7c072c80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faf780097d0 tx=0x7faf7802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebe9563a9896a088 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:23.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.482+0000 7faf80e96640 1 -- 172.21.15.77:0/3554210056 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf78037070 con 0x7faf7c153890 2024-04-25T01:41:23.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.482+0000 7faf80e96640 1 -- 172.21.15.77:0/3554210056 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf7802ae50 con 0x7faf7c153890 2024-04-25T01:41:23.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.482+0000 7faf80e96640 1 -- 172.21.15.77:0/3554210056 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf78037070 con 0x7faf7c153890 2024-04-25T01:41:23.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.482+0000 7faf840fc640 1 -- 172.21.15.77:0/3554210056 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faf7c153890 msgr2=0x7faf7c072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:23.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.483+0000 7faf840fc640 1 --2- 172.21.15.77:0/3554210056 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faf7c153890 0x7faf7c072c80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faf780097d0 tx=0x7faf7802a100 comp rx=0 tx=0).stop 2024-04-25T01:41:23.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.483+0000 7faf840fc640 1 -- 172.21.15.77:0/3554210056 shutdown_connections 2024-04-25T01:41:23.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.483+0000 7faf840fc640 1 --2- 172.21.15.77:0/3554210056 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faf7c153890 0x7faf7c072c80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:23.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.483+0000 7faf840fc640 1 -- 172.21.15.77:0/3554210056 >> 172.21.15.77:0/3554210056 conn(0x7faf7c0aa8f0 msgr2=0x7faf7c066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:23.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.483+0000 7faf840fc640 1 -- 172.21.15.77:0/3554210056 shutdown_connections 2024-04-25T01:41:23.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.483+0000 7faf840fc640 1 -- 172.21.15.77:0/3554210056 wait complete. 2024-04-25T01:41:23.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.484+0000 7faf840fc640 1 Processor -- start 2024-04-25T01:41:23.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.484+0000 7faf840fc640 1 -- start start 2024-04-25T01:41:23.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.485+0000 7faf840fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf7c0c96c0 0x7faf7c06d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:23.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.485+0000 7faf840fc640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faf7c153890 0x7faf7c0c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:23.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.485+0000 7faf840fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf7c156210 0x7faf7c0c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:23.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.485+0000 7faf81e98640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf7c0c96c0 0x7faf7c06d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:23.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.485+0000 7faf840fc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faf7c070210 con 0x7faf7c0c96c0 2024-04-25T01:41:23.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.485+0000 7faf840fc640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faf7c06ff30 con 0x7faf7c156210 2024-04-25T01:41:23.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.485+0000 7faf840fc640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7faf7c06f300 con 0x7faf7c153890 2024-04-25T01:41:23.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.485+0000 7faf81e98640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf7c0c96c0 0x7faf7c06d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45100/0 (socket says 172.21.15.77:45100) 2024-04-25T01:41:23.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.485+0000 7faf81e98640 1 -- 172.21.15.77:0/2984999892 learned_addr learned my addr 172.21.15.77:0/2984999892 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:23.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.485+0000 7faf82699640 1 --2- 172.21.15.77:0/2984999892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf7c156210 0x7faf7c0c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:23.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.485+0000 7faf81697640 1 --2- 172.21.15.77:0/2984999892 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faf7c153890 0x7faf7c0c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:23.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.485+0000 7faf81e98640 1 -- 172.21.15.77:0/2984999892 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faf7c153890 msgr2=0x7faf7c0c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:23.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.485+0000 7faf81e98640 1 --2- 172.21.15.77:0/2984999892 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faf7c153890 0x7faf7c0c7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:23.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.485+0000 7faf81e98640 1 -- 172.21.15.77:0/2984999892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf7c156210 msgr2=0x7faf7c0c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:23.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.485+0000 7faf81e98640 1 --2- 172.21.15.77:0/2984999892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf7c156210 0x7faf7c0c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:23.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.485+0000 7faf81e98640 1 -- 172.21.15.77:0/2984999892 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf7c0c91c0 con 0x7faf7c0c96c0 2024-04-25T01:41:23.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.485+0000 7faf81e98640 1 --2- 172.21.15.77:0/2984999892 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf7c0c96c0 0x7faf7c06d610 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7faf780098f0 tx=0x7faf780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:23.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.486+0000 7faf727fc640 1 -- 172.21.15.77:0/2984999892 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf78040020 con 0x7faf7c0c96c0 2024-04-25T01:41:23.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.486+0000 7faf727fc640 1 -- 172.21.15.77:0/2984999892 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf78038040 con 0x7faf7c0c96c0 2024-04-25T01:41:23.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.486+0000 7faf840fc640 1 -- 172.21.15.77:0/2984999892 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf7c1ef1b0 con 0x7faf7c0c96c0 2024-04-25T01:41:23.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.486+0000 7faf727fc640 1 -- 172.21.15.77:0/2984999892 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf78037070 con 0x7faf7c0c96c0 2024-04-25T01:41:23.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.486+0000 7faf840fc640 1 -- 172.21.15.77:0/2984999892 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf7c06db50 con 0x7faf7c0c96c0 2024-04-25T01:41:23.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.487+0000 7faf840fc640 1 -- 172.21.15.77:0/2984999892 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf7c04f500 con 0x7faf7c0c96c0 2024-04-25T01:41:23.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.487+0000 7faf727fc640 1 -- 172.21.15.77:0/2984999892 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faf78043020 con 0x7faf7c0c96c0 2024-04-25T01:41:23.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.488+0000 7faf727fc640 1 --2- 172.21.15.77:0/2984999892 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7faf6006be30 0x7faf6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:23.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.488+0000 7faf727fc640 1 -- 172.21.15.77:0/2984999892 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6723+0+0 (secure 0 0 0) 0x7faf780ab190 con 0x7faf7c0c96c0 2024-04-25T01:41:23.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.491+0000 7faf81697640 1 --2- 172.21.15.77:0/2984999892 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7faf6006be30 0x7faf6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:23.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.491+0000 7faf81697640 1 --2- 172.21.15.77:0/2984999892 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7faf6006be30 0x7faf6006e2f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faf7c0c8810 tx=0x7faf6c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:23.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.492+0000 7faf727fc640 1 -- 172.21.15.77:0/2984999892 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7faf7804a030 con 0x7faf7c0c96c0 2024-04-25T01:41:23.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.711+0000 7faf840fc640 1 -- 172.21.15.77:0/2984999892 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf7c0c2f60 con 0x7faf7c0c96c0 2024-04-25T01:41:23.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.711+0000 7faf727fc640 1 -- 172.21.15.77:0/2984999892 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6492 (secure 0 0 0) 0x7faf78003e20 con 0x7faf7c0c96c0 2024-04-25T01:41:23.698 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:23.699 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5265,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:02.386295+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":29,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":2}]} 2024-04-25T01:41:23.699 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 17 2024-04-25T01:41:23.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.714+0000 7faf840fc640 1 -- 172.21.15.77:0/2984999892 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7faf6006be30 msgr2=0x7faf6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:23.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.714+0000 7faf840fc640 1 --2- 172.21.15.77:0/2984999892 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7faf6006be30 0x7faf6006e2f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faf7c0c8810 tx=0x7faf6c009040 comp rx=0 tx=0).stop 2024-04-25T01:41:23.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.714+0000 7faf840fc640 1 -- 172.21.15.77:0/2984999892 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf7c0c96c0 msgr2=0x7faf7c06d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:23.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.714+0000 7faf840fc640 1 --2- 172.21.15.77:0/2984999892 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf7c0c96c0 0x7faf7c06d610 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7faf780098f0 tx=0x7faf780046c0 comp rx=0 tx=0).stop 2024-04-25T01:41:23.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.714+0000 7faf840fc640 1 -- 172.21.15.77:0/2984999892 shutdown_connections 2024-04-25T01:41:23.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.714+0000 7faf840fc640 1 --2- 172.21.15.77:0/2984999892 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7faf6006be30 0x7faf6006e2f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:23.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.714+0000 7faf840fc640 1 --2- 172.21.15.77:0/2984999892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf7c156210 0x7faf7c0c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:23.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.714+0000 7faf840fc640 1 --2- 172.21.15.77:0/2984999892 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faf7c153890 0x7faf7c0c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:23.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.714+0000 7faf840fc640 1 --2- 172.21.15.77:0/2984999892 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf7c0c96c0 0x7faf7c06d610 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:23.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.714+0000 7faf840fc640 1 -- 172.21.15.77:0/2984999892 >> 172.21.15.77:0/2984999892 conn(0x7faf7c0aa8f0 msgr2=0x7faf7c156850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:23.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.714+0000 7faf840fc640 1 -- 172.21.15.77:0/2984999892 shutdown_connections 2024-04-25T01:41:23.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:23.714+0000 7faf840fc640 1 -- 172.21.15.77:0/2984999892 wait complete. 2024-04-25T01:41:23.715 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T01:41:25.318 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:25.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.483+0000 7f7f70e37640 1 Processor -- start 2024-04-25T01:41:25.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.483+0000 7f7f70e37640 1 -- start start 2024-04-25T01:41:25.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.484+0000 7f7f70e37640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f6c150090 0x7f7f6c156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:25.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.484+0000 7f7f70e37640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f6c0c89c0 con 0x7f7f6c06c280 2024-04-25T01:41:25.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.484+0000 7f7f70e37640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f6c0c8ca0 con 0x7f7f6c0c8200 2024-04-25T01:41:25.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.484+0000 7f7f70e37640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f7f6c06b830 con 0x7f7f6c150090 2024-04-25T01:41:25.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.484+0000 7f7f6ad9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7f6c06c280 0x7f7f6c0c6320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:34986/0 (socket says 172.21.15.77:34986) 2024-04-25T01:41:25.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.484+0000 7f7f6ad9d640 1 -- 172.21.15.77:0/1275546158 learned_addr learned my addr 172.21.15.77:0/1275546158 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:41:25.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.484+0000 7f7f6a59c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f6c150090 0x7f7f6c156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:25.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.485+0000 7f7f6959a640 1 -- 172.21.15.77:0/1275546158 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4244579754 0 0) 0x7f7f6c0c8ca0 con 0x7f7f6c0c8200 2024-04-25T01:41:25.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.485+0000 7f7f6a59c640 1 -- 172.21.15.77:0/1275546158 >> v1:172.21.15.121:6789/0 conn(0x7f7f6c0c8200 legacy=0x7f7f6c0c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:25.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.485+0000 7f7f6a59c640 1 -- 172.21.15.77:0/1275546158 >> v1:172.21.15.77:6789/0 conn(0x7f7f6c06c280 legacy=0x7f7f6c0c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:25.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.485+0000 7f7f6a59c640 1 -- 172.21.15.77:0/1275546158 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f6c06ba80 con 0x7f7f6c150090 2024-04-25T01:41:25.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.486+0000 7f7f6a59c640 1 --2- 172.21.15.77:0/1275546158 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f6c150090 0x7f7f6c156c80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0097d0 tx=0x7f7f5c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fc37b6cd6ac2f65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:25.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.486+0000 7f7f6959a640 1 -- 172.21.15.77:0/1275546158 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c037070 con 0x7f7f6c150090 2024-04-25T01:41:25.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.486+0000 7f7f6959a640 1 -- 172.21.15.77:0/1275546158 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f5c02ad90 con 0x7f7f6c150090 2024-04-25T01:41:25.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.486+0000 7f7f6959a640 1 -- 172.21.15.77:0/1275546158 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c032660 con 0x7f7f6c150090 2024-04-25T01:41:25.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.487+0000 7f7f70e37640 1 -- 172.21.15.77:0/1275546158 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f6c150090 msgr2=0x7f7f6c156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:25.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.487+0000 7f7f70e37640 1 --2- 172.21.15.77:0/1275546158 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f6c150090 0x7f7f6c156c80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0097d0 tx=0x7f7f5c02a100 comp rx=0 tx=0).stop 2024-04-25T01:41:25.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.487+0000 7f7f70e37640 1 -- 172.21.15.77:0/1275546158 shutdown_connections 2024-04-25T01:41:25.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.487+0000 7f7f70e37640 1 --2- 172.21.15.77:0/1275546158 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f6c150090 0x7f7f6c156c80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:25.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.487+0000 7f7f70e37640 1 -- 172.21.15.77:0/1275546158 >> 172.21.15.77:0/1275546158 conn(0x7f7f6c0ad4d0 msgr2=0x7f7f6c0ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:25.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.487+0000 7f7f70e37640 1 -- 172.21.15.77:0/1275546158 shutdown_connections 2024-04-25T01:41:25.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.487+0000 7f7f70e37640 1 -- 172.21.15.77:0/1275546158 wait complete. 2024-04-25T01:41:25.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.489+0000 7f7f70e37640 1 Processor -- start 2024-04-25T01:41:25.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.489+0000 7f7f70e37640 1 -- start start 2024-04-25T01:41:25.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.490+0000 7f7f70e37640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f6c06c280 0x7f7f6c155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:25.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.490+0000 7f7f70e37640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f6c0c8200 0x7f7f6c14cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:25.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.490+0000 7f7f70e37640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f6c150090 0x7f7f6c14d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:25.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.490+0000 7f7f70e37640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c06c6f0 con 0x7f7f6c0c8200 2024-04-25T01:41:25.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.490+0000 7f7f70e37640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c0c8680 con 0x7f7f6c150090 2024-04-25T01:41:25.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.490+0000 7f7f6a59c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f6c06c280 0x7f7f6c155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:25.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.490+0000 7f7f69d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f6c0c8200 0x7f7f6c14cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:25.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.490+0000 7f7f6a59c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f6c06c280 0x7f7f6c155d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.77:56364/0 (socket says 172.21.15.77:56364) 2024-04-25T01:41:25.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.490+0000 7f7f6a59c640 1 -- 172.21.15.77:0/384434190 learned_addr learned my addr 172.21.15.77:0/384434190 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:25.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.490+0000 7f7f70e37640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f7f6c06c870 con 0x7f7f6c06c280 2024-04-25T01:41:25.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.490+0000 7f7f6ad9d640 1 --2- 172.21.15.77:0/384434190 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f6c150090 0x7f7f6c14d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:25.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.491+0000 7f7f6a59c640 1 -- 172.21.15.77:0/384434190 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f6c150090 msgr2=0x7f7f6c14d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:25.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.491+0000 7f7f6a59c640 1 --2- 172.21.15.77:0/384434190 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f6c150090 0x7f7f6c14d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:25.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.491+0000 7f7f6a59c640 1 -- 172.21.15.77:0/384434190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f6c0c8200 msgr2=0x7f7f6c14cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:25.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.491+0000 7f7f6a59c640 1 --2- 172.21.15.77:0/384434190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f6c0c8200 0x7f7f6c14cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:25.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.491+0000 7f7f6a59c640 1 -- 172.21.15.77:0/384434190 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f6c0b03a0 con 0x7f7f6c06c280 2024-04-25T01:41:25.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.491+0000 7f7f6a59c640 1 --2- 172.21.15.77:0/384434190 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f6c06c280 0x7f7f6c155d00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0097d0 tx=0x7f7f5c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:25.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.491+0000 7f7f5affd640 1 -- 172.21.15.77:0/384434190 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c042020 con 0x7f7f6c06c280 2024-04-25T01:41:25.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.491+0000 7f7f5affd640 1 -- 172.21.15.77:0/384434190 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f5c03d690 con 0x7f7f6c06c280 2024-04-25T01:41:25.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.491+0000 7f7f70e37640 1 -- 172.21.15.77:0/384434190 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f6c0af830 con 0x7f7f6c06c280 2024-04-25T01:41:25.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.491+0000 7f7f5affd640 1 -- 172.21.15.77:0/384434190 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c037040 con 0x7f7f6c06c280 2024-04-25T01:41:25.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.491+0000 7f7f70e37640 1 -- 172.21.15.77:0/384434190 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f6c1ec550 con 0x7f7f6c06c280 2024-04-25T01:41:25.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.493+0000 7f7f70e37640 1 -- 172.21.15.77:0/384434190 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f6c1eee00 con 0x7f7f6c06c280 2024-04-25T01:41:25.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.494+0000 7f7f5affd640 1 -- 172.21.15.77:0/384434190 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7f5c045020 con 0x7f7f6c06c280 2024-04-25T01:41:25.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.494+0000 7f7f5affd640 1 --2- 172.21.15.77:0/384434190 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7f4c06be30 0x7f7f4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:25.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.494+0000 7f7f5affd640 1 -- 172.21.15.77:0/384434190 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6723+0+0 (secure 0 0 0) 0x7f7f5c0ab660 con 0x7f7f6c06c280 2024-04-25T01:41:25.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.494+0000 7f7f69d9b640 1 --2- 172.21.15.77:0/384434190 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7f4c06be30 0x7f7f4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:25.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.495+0000 7f7f69d9b640 1 --2- 172.21.15.77:0/384434190 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7f4c06be30 0x7f7f4c06e2f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c156650 tx=0x7f7f60009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:25.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.499+0000 7f7f5affd640 1 -- 172.21.15.77:0/384434190 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7f5c04c070 con 0x7f7f6c06c280 2024-04-25T01:41:25.716 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:25.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.814+0000 7f7f70e37640 1 -- 172.21.15.77:0/384434190 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f6c06cec0 con 0x7f7f6c06c280 2024-04-25T01:41:25.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.815+0000 7f7f5affd640 1 -- 172.21.15.77:0/384434190 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6492 (secure 0 0 0) 0x7f7f5c0795b0 con 0x7f7f6c06c280 2024-04-25T01:41:25.802 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:25.802 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5265,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:02.386295+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":29,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":2}]} 2024-04-25T01:41:25.803 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 17 2024-04-25T01:41:25.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.817+0000 7f7f70e37640 1 -- 172.21.15.77:0/384434190 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7f4c06be30 msgr2=0x7f7f4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:25.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.817+0000 7f7f70e37640 1 --2- 172.21.15.77:0/384434190 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7f4c06be30 0x7f7f4c06e2f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c156650 tx=0x7f7f60009040 comp rx=0 tx=0).stop 2024-04-25T01:41:25.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.817+0000 7f7f70e37640 1 -- 172.21.15.77:0/384434190 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f6c06c280 msgr2=0x7f7f6c155d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:25.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.817+0000 7f7f70e37640 1 --2- 172.21.15.77:0/384434190 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f6c06c280 0x7f7f6c155d00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0097d0 tx=0x7f7f5c0046c0 comp rx=0 tx=0).stop 2024-04-25T01:41:25.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.817+0000 7f7f70e37640 1 -- 172.21.15.77:0/384434190 shutdown_connections 2024-04-25T01:41:25.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.817+0000 7f7f70e37640 1 --2- 172.21.15.77:0/384434190 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7f4c06be30 0x7f7f4c06e2f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:25.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.817+0000 7f7f70e37640 1 --2- 172.21.15.77:0/384434190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f6c0c8200 0x7f7f6c14cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:25.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.817+0000 7f7f70e37640 1 --2- 172.21.15.77:0/384434190 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f6c150090 0x7f7f6c14d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:25.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.818+0000 7f7f70e37640 1 --2- 172.21.15.77:0/384434190 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f6c06c280 0x7f7f6c155d00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:25.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.818+0000 7f7f70e37640 1 -- 172.21.15.77:0/384434190 >> 172.21.15.77:0/384434190 conn(0x7f7f6c0ad4d0 msgr2=0x7f7f6c156b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:25.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.818+0000 7f7f70e37640 1 -- 172.21.15.77:0/384434190 shutdown_connections 2024-04-25T01:41:25.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.818+0000 7f7f70e37640 1 -- 172.21.15.77:0/384434190 wait complete. 2024-04-25T01:41:25.816 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-25T01:41:25.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.832+0000 7ff7c79c1640 1 Processor -- start 2024-04-25T01:41:25.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.832+0000 7ff7c79c1640 1 -- start start 2024-04-25T01:41:25.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.833+0000 7ff7c79c1640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff7c0151390 0x7ff7c00ab380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:25.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.833+0000 7ff7c79c1640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7c00ab8c0 0x7ff7c0157450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:25.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.833+0000 7ff7c79c1640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7c0070170 con 0x7ff7c00c6b70 2024-04-25T01:41:25.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.833+0000 7ff7c79c1640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7ff7c01541f0 con 0x7ff7c0151390 2024-04-25T01:41:25.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.833+0000 7ff7c79c1640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff7c01544d0 con 0x7ff7c00ab8c0 2024-04-25T01:41:25.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.833+0000 7ff7c575d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff7c0151390 0x7ff7c00ab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:25.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.833+0000 7ff7c4f5c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7c00ab8c0 0x7ff7c0157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:25.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.833+0000 7ff7c5f5e640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ff7c00c6b70 0x7ff7c00c96c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.77:43504/0 (socket says 172.21.15.77:43504) 2024-04-25T01:41:25.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.833+0000 7ff7c5f5e640 1 -- 172.21.15.77:0/1177083665 learned_addr learned my addr 172.21.15.77:0/1177083665 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:41:25.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.833+0000 7ff7c575d640 1 -- 172.21.15.77:0/1177083665 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7c00ab8c0 msgr2=0x7ff7c0157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:25.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.833+0000 7ff7c575d640 1 --2- 172.21.15.77:0/1177083665 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7c00ab8c0 0x7ff7c0157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:25.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.833+0000 7ff7c575d640 1 -- 172.21.15.77:0/1177083665 >> v1:172.21.15.121:6789/0 conn(0x7ff7c00c6b70 legacy=0x7ff7c00c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:25.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.833+0000 7ff7c575d640 1 -- 172.21.15.77:0/1177083665 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c01547b0 con 0x7ff7c0151390 2024-04-25T01:41:25.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.834+0000 7ff7c575d640 1 --2- 172.21.15.77:0/1177083665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c0151390 0x7ff7c00ab380 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0097a0 tx=0x7ff7bc02a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1ebabd58711b680 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:25.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.834+0000 7ff7b7fff640 1 -- 172.21.15.77:0/1177083665 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc037070 con 0x7ff7c0151390 2024-04-25T01:41:25.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.834+0000 7ff7b7fff640 1 -- 172.21.15.77:0/1177083665 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7bc02adb0 con 0x7ff7c0151390 2024-04-25T01:41:25.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.834+0000 7ff7b7fff640 1 -- 172.21.15.77:0/1177083665 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc032660 con 0x7ff7c0151390 2024-04-25T01:41:25.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.835+0000 7ff7c79c1640 1 -- 172.21.15.77:0/1177083665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c0151390 msgr2=0x7ff7c00ab380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:25.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.835+0000 7ff7c79c1640 1 --2- 172.21.15.77:0/1177083665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c0151390 0x7ff7c00ab380 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0097a0 tx=0x7ff7bc02a060 comp rx=0 tx=0).stop 2024-04-25T01:41:25.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.835+0000 7ff7c79c1640 1 -- 172.21.15.77:0/1177083665 shutdown_connections 2024-04-25T01:41:25.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.835+0000 7ff7c79c1640 1 --2- 172.21.15.77:0/1177083665 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7c00ab8c0 0x7ff7c0157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:25.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.835+0000 7ff7c79c1640 1 --2- 172.21.15.77:0/1177083665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c0151390 0x7ff7c00ab380 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:25.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.835+0000 7ff7c79c1640 1 -- 172.21.15.77:0/1177083665 >> 172.21.15.77:0/1177083665 conn(0x7ff7c006b530 msgr2=0x7ff7c00aa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:25.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.835+0000 7ff7c79c1640 1 -- 172.21.15.77:0/1177083665 shutdown_connections 2024-04-25T01:41:25.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.835+0000 7ff7c79c1640 1 -- 172.21.15.77:0/1177083665 wait complete. 2024-04-25T01:41:25.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.836+0000 7ff7c79c1640 1 Processor -- start 2024-04-25T01:41:25.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.836+0000 7ff7c79c1640 1 -- start start 2024-04-25T01:41:25.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.837+0000 7ff7c79c1640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7c00ab8c0 0x7ff7c00ae600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:25.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.837+0000 7ff7c79c1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c00c6b70 0x7ff7c006c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:25.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.837+0000 7ff7c79c1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7c0151390 0x7ff7c00add40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:25.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.837+0000 7ff7c79c1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c0154cd0 con 0x7ff7c0151390 2024-04-25T01:41:25.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.837+0000 7ff7c79c1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c006f290 con 0x7ff7c00c6b70 2024-04-25T01:41:25.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.837+0000 7ff7c79c1640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff7c0154e50 con 0x7ff7c00ab8c0 2024-04-25T01:41:25.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.837+0000 7ff7c5f5e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7c0151390 0x7ff7c00add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:25.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.837+0000 7ff7c575d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7c00ab8c0 0x7ff7c00ae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:25.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.837+0000 7ff7c5f5e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7c0151390 0x7ff7c00add40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45118/0 (socket says 172.21.15.77:45118) 2024-04-25T01:41:25.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.837+0000 7ff7c5f5e640 1 -- 172.21.15.77:0/3074391097 learned_addr learned my addr 172.21.15.77:0/3074391097 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:25.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.837+0000 7ff7c4f5c640 1 --2- 172.21.15.77:0/3074391097 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c00c6b70 0x7ff7c006c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:25.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.837+0000 7ff7c5f5e640 1 -- 172.21.15.77:0/3074391097 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7c00ab8c0 msgr2=0x7ff7c00ae600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:25.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.837+0000 7ff7c5f5e640 1 --2- 172.21.15.77:0/3074391097 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7c00ab8c0 0x7ff7c00ae600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:25.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.837+0000 7ff7c5f5e640 1 -- 172.21.15.77:0/3074391097 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c00c6b70 msgr2=0x7ff7c006c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:25.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.837+0000 7ff7c5f5e640 1 --2- 172.21.15.77:0/3074391097 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c00c6b70 0x7ff7c006c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:25.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.837+0000 7ff7c5f5e640 1 -- 172.21.15.77:0/3074391097 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c01eb920 con 0x7ff7c0151390 2024-04-25T01:41:25.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.838+0000 7ff7c5f5e640 1 --2- 172.21.15.77:0/3074391097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7c0151390 0x7ff7c00add40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff7b800cbc0 tx=0x7ff7b800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:25.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.838+0000 7ff7b5ffb640 1 -- 172.21.15.77:0/3074391097 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8017070 con 0x7ff7c0151390 2024-04-25T01:41:25.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.838+0000 7ff7b5ffb640 1 -- 172.21.15.77:0/3074391097 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b800ad40 con 0x7ff7c0151390 2024-04-25T01:41:25.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.838+0000 7ff7c79c1640 1 -- 172.21.15.77:0/3074391097 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7c00acc00 con 0x7ff7c0151390 2024-04-25T01:41:25.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.838+0000 7ff7b5ffb640 1 -- 172.21.15.77:0/3074391097 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8012600 con 0x7ff7c0151390 2024-04-25T01:41:25.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.838+0000 7ff7c79c1640 1 -- 172.21.15.77:0/3074391097 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7c01ebba0 con 0x7ff7c0151390 2024-04-25T01:41:25.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.839+0000 7ff7c79c1640 1 -- 172.21.15.77:0/3074391097 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7c00688e0 con 0x7ff7c0151390 2024-04-25T01:41:25.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.839+0000 7ff7b5ffb640 1 -- 172.21.15.77:0/3074391097 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff7b801a070 con 0x7ff7c0151390 2024-04-25T01:41:25.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.840+0000 7ff7b5ffb640 1 --2- 172.21.15.77:0/3074391097 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff7a406be30 0x7ff7a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:25.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.840+0000 7ff7b5ffb640 1 -- 172.21.15.77:0/3074391097 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6723+0+0 (secure 0 0 0) 0x7ff7b808ae60 con 0x7ff7c0151390 2024-04-25T01:41:25.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.840+0000 7ff7c575d640 1 --2- 172.21.15.77:0/3074391097 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff7a406be30 0x7ff7a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:25.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.840+0000 7ff7c575d640 1 --2- 172.21.15.77:0/3074391097 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff7a406be30 0x7ff7a406e2f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc034000 tx=0x7ff7bc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:25.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:25.844+0000 7ff7b5ffb640 1 -- 172.21.15.77:0/3074391097 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff7c01eb920 con 0x7ff7c0151390 2024-04-25T01:41:26.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:26.063+0000 7ff7c79c1640 1 -- 172.21.15.77:0/3074391097 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7c00ad120 con 0x7ff7c0151390 2024-04-25T01:41:26.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:26.063+0000 7ff7b5ffb640 1 -- 172.21.15.77:0/3074391097 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6492 (secure 0 0 0) 0x7ff7b8058e50 con 0x7ff7c0151390 2024-04-25T01:41:26.050 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:26.050 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5265,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:02.386295+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":29,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":2}]} 2024-04-25T01:41:26.050 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 17 2024-04-25T01:41:26.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:26.065+0000 7ff7c79c1640 1 -- 172.21.15.77:0/3074391097 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff7a406be30 msgr2=0x7ff7a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:26.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:26.065+0000 7ff7c79c1640 1 --2- 172.21.15.77:0/3074391097 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff7a406be30 0x7ff7a406e2f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc034000 tx=0x7ff7bc02e000 comp rx=0 tx=0).stop 2024-04-25T01:41:26.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:26.065+0000 7ff7c79c1640 1 -- 172.21.15.77:0/3074391097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7c0151390 msgr2=0x7ff7c00add40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:26.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:26.065+0000 7ff7c79c1640 1 --2- 172.21.15.77:0/3074391097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7c0151390 0x7ff7c00add40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff7b800cbc0 tx=0x7ff7b800a430 comp rx=0 tx=0).stop 2024-04-25T01:41:26.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:26.066+0000 7ff7c79c1640 1 -- 172.21.15.77:0/3074391097 shutdown_connections 2024-04-25T01:41:26.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:26.066+0000 7ff7c79c1640 1 --2- 172.21.15.77:0/3074391097 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff7a406be30 0x7ff7a406e2f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:26.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:26.066+0000 7ff7c79c1640 1 --2- 172.21.15.77:0/3074391097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7c0151390 0x7ff7c00add40 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:26.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:26.066+0000 7ff7c79c1640 1 --2- 172.21.15.77:0/3074391097 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c00c6b70 0x7ff7c006c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:26.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:26.066+0000 7ff7c79c1640 1 --2- 172.21.15.77:0/3074391097 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7c00ab8c0 0x7ff7c00ae600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:26.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:26.066+0000 7ff7c79c1640 1 -- 172.21.15.77:0/3074391097 >> 172.21.15.77:0/3074391097 conn(0x7ff7c006b530 msgr2=0x7ff7c0072370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:26.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:26.066+0000 7ff7c79c1640 1 -- 172.21.15.77:0/3074391097 shutdown_connections 2024-04-25T01:41:26.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:26.066+0000 7ff7c79c1640 1 -- 172.21.15.77:0/3074391097 wait complete. 2024-04-25T01:41:26.064 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T01:41:27.817 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:27.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.929+0000 7f1b641d5640 1 Processor -- start 2024-04-25T01:41:27.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.929+0000 7f1b641d5640 1 -- start start 2024-04-25T01:41:27.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.930+0000 7f1b641d5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1b5c156c80 0x7f1b5c0c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:27.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.930+0000 7f1b641d5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1b5c06c280 0x7f1b5c0c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:27.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.930+0000 7f1b641d5640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b5c157130 con 0x7f1b5c150090 2024-04-25T01:41:27.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.930+0000 7f1b641d5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f1b5c06b830 con 0x7f1b5c06c280 2024-04-25T01:41:27.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.930+0000 7f1b641d5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f1b5c0c9de0 con 0x7f1b5c156c80 2024-04-25T01:41:27.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.930+0000 7f1b62772640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1b5c06c280 0x7f1b5c0c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:27.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.930+0000 7f1b62772640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1b5c06c280 0x7f1b5c0c6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37100/0 (socket says 172.21.15.77:37100) 2024-04-25T01:41:27.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.930+0000 7f1b62772640 1 -- 172.21.15.77:0/963395592 learned_addr learned my addr 172.21.15.77:0/963395592 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:27.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.930+0000 7f1b61770640 1 --2- 172.21.15.77:0/963395592 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1b5c156c80 0x7f1b5c0c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:27.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.930+0000 7f1b62772640 1 -- 172.21.15.77:0/963395592 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1b5c156c80 msgr2=0x7f1b5c0c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:27.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.930+0000 7f1b62772640 1 --2- 172.21.15.77:0/963395592 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1b5c156c80 0x7f1b5c0c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:27.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.930+0000 7f1b62772640 1 -- 172.21.15.77:0/963395592 >> v1:172.21.15.121:6789/0 conn(0x7f1b5c150090 legacy=0x7f1b5c0c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:27.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.930+0000 7f1b62772640 1 -- 172.21.15.77:0/963395592 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b5c0c89c0 con 0x7f1b5c06c280 2024-04-25T01:41:27.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.931+0000 7f1b62772640 1 --2- 172.21.15.77:0/963395592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b5c06c280 0x7f1b5c0c6320 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1b54009e50 tx=0x7f1b5402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b8910a679581f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:27.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.931+0000 7f1b60f6f640 1 -- 172.21.15.77:0/963395592 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b54036070 con 0x7f1b5c06c280 2024-04-25T01:41:27.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.931+0000 7f1b60f6f640 1 -- 172.21.15.77:0/963395592 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b54031600 con 0x7f1b5c06c280 2024-04-25T01:41:27.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.931+0000 7f1b60f6f640 1 -- 172.21.15.77:0/963395592 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b540319d0 con 0x7f1b5c06c280 2024-04-25T01:41:27.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.932+0000 7f1b641d5640 1 -- 172.21.15.77:0/963395592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b5c06c280 msgr2=0x7f1b5c0c6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:27.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.932+0000 7f1b641d5640 1 --2- 172.21.15.77:0/963395592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b5c06c280 0x7f1b5c0c6320 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1b54009e50 tx=0x7f1b5402a710 comp rx=0 tx=0).stop 2024-04-25T01:41:27.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.932+0000 7f1b641d5640 1 -- 172.21.15.77:0/963395592 shutdown_connections 2024-04-25T01:41:27.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.932+0000 7f1b641d5640 1 --2- 172.21.15.77:0/963395592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b5c06c280 0x7f1b5c0c6320 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:27.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.932+0000 7f1b641d5640 1 --2- 172.21.15.77:0/963395592 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1b5c156c80 0x7f1b5c0c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:27.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.932+0000 7f1b641d5640 1 -- 172.21.15.77:0/963395592 >> 172.21.15.77:0/963395592 conn(0x7f1b5c0ad4d0 msgr2=0x7f1b5c0ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:27.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.932+0000 7f1b641d5640 1 -- 172.21.15.77:0/963395592 shutdown_connections 2024-04-25T01:41:27.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.932+0000 7f1b641d5640 1 -- 172.21.15.77:0/963395592 wait complete. 2024-04-25T01:41:27.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.934+0000 7f1b641d5640 1 Processor -- start 2024-04-25T01:41:27.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.934+0000 7f1b641d5640 1 -- start start 2024-04-25T01:41:27.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.935+0000 7f1b641d5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b5c06c280 0x7f1b5c1ef6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:27.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.935+0000 7f1b641d5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b5c150090 0x7f1b5c0c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:27.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.935+0000 7f1b61770640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b5c150090 0x7f1b5c0c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:27.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.935+0000 7f1b61770640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b5c150090 0x7f1b5c0c4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37116/0 (socket says 172.21.15.77:37116) 2024-04-25T01:41:27.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.935+0000 7f1b641d5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1b5c156c80 0x7f1b5c0c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:27.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.935+0000 7f1b61f71640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b5c06c280 0x7f1b5c1ef6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:27.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.935+0000 7f1b61f71640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b5c06c280 0x7f1b5c1ef6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:53374/0 (socket says 172.21.15.77:53374) 2024-04-25T01:41:27.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.935+0000 7f1b61770640 1 -- 172.21.15.77:0/2910979911 learned_addr learned my addr 172.21.15.77:0/2910979911 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:27.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.935+0000 7f1b641d5640 1 -- 172.21.15.77:0/2910979911 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5c06bd60 con 0x7f1b5c150090 2024-04-25T01:41:27.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.935+0000 7f1b641d5640 1 -- 172.21.15.77:0/2910979911 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5c06ba80 con 0x7f1b5c06c280 2024-04-25T01:41:27.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.935+0000 7f1b641d5640 1 -- 172.21.15.77:0/2910979911 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f1b5c06c6d0 con 0x7f1b5c156c80 2024-04-25T01:41:27.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.936+0000 7f1b62772640 1 --2- 172.21.15.77:0/2910979911 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1b5c156c80 0x7f1b5c0c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:27.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.936+0000 7f1b61f71640 1 -- 172.21.15.77:0/2910979911 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1b5c156c80 msgr2=0x7f1b5c0c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:27.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.936+0000 7f1b61f71640 1 --2- 172.21.15.77:0/2910979911 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1b5c156c80 0x7f1b5c0c4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:27.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.936+0000 7f1b61f71640 1 -- 172.21.15.77:0/2910979911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b5c150090 msgr2=0x7f1b5c0c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:27.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.936+0000 7f1b61f71640 1 --2- 172.21.15.77:0/2910979911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b5c150090 0x7f1b5c0c4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:27.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.936+0000 7f1b61f71640 1 -- 172.21.15.77:0/2910979911 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b5c1ec590 con 0x7f1b5c06c280 2024-04-25T01:41:27.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.936+0000 7f1b61770640 1 --2- 172.21.15.77:0/2910979911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b5c150090 0x7f1b5c0c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:41:27.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.936+0000 7f1b61f71640 1 --2- 172.21.15.77:0/2910979911 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b5c06c280 0x7f1b5c1ef6e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800c340 tx=0x7f1b5800c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:27.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.936+0000 7f1b527fc640 1 -- 172.21.15.77:0/2910979911 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b580052d0 con 0x7f1b5c06c280 2024-04-25T01:41:27.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.936+0000 7f1b527fc640 1 -- 172.21.15.77:0/2910979911 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b58005490 con 0x7f1b5c06c280 2024-04-25T01:41:27.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.936+0000 7f1b641d5640 1 -- 172.21.15.77:0/2910979911 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b5c1ec800 con 0x7f1b5c06c280 2024-04-25T01:41:27.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.937+0000 7f1b527fc640 1 -- 172.21.15.77:0/2910979911 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b58007260 con 0x7f1b5c06c280 2024-04-25T01:41:27.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.937+0000 7f1b641d5640 1 -- 172.21.15.77:0/2910979911 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b5c0c2a70 con 0x7f1b5c06c280 2024-04-25T01:41:27.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.938+0000 7f1b527fc640 1 -- 172.21.15.77:0/2910979911 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1b58007400 con 0x7f1b5c06c280 2024-04-25T01:41:27.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.938+0000 7f1b641d5640 1 -- 172.21.15.77:0/2910979911 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b5c04f500 con 0x7f1b5c06c280 2024-04-25T01:41:27.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.939+0000 7f1b527fc640 1 --2- 172.21.15.77:0/2910979911 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1b4006be30 0x7f1b4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:27.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.939+0000 7f1b61770640 1 --2- 172.21.15.77:0/2910979911 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1b4006be30 0x7f1b4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:27.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.939+0000 7f1b527fc640 1 -- 172.21.15.77:0/2910979911 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6723+0+0 (secure 0 0 0) 0x7f1b5808a650 con 0x7f1b5c06c280 2024-04-25T01:41:27.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.939+0000 7f1b61770640 1 --2- 172.21.15.77:0/2910979911 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1b4006be30 0x7f1b4006e2f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c1449a0 tx=0x7f1b4c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:27.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:27.948+0000 7f1b527fc640 1 -- 172.21.15.77:0/2910979911 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1b5c157130 con 0x7f1b5c06c280 2024-04-25T01:41:28.064 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:28.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.228+0000 7f3cd514f640 1 Processor -- start 2024-04-25T01:41:28.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.228+0000 7f3cd514f640 1 -- start start 2024-04-25T01:41:28.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.229+0000 7f3cd514f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3cd00ad220 0x7f3cd00c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:28.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.230+0000 7f3cd514f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cd006eee0 con 0x7f3cd00c38f0 2024-04-25T01:41:28.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.230+0000 7f3cced9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3cd00c38f0 0x7f3cd015adb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36578/0 (socket says 172.21.15.77:36578) 2024-04-25T01:41:28.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.230+0000 7f3cced9d640 1 -- 172.21.15.77:0/750397453 learned_addr learned my addr 172.21.15.77:0/750397453 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:41:28.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.230+0000 7f3cce59c640 1 --2- 172.21.15.77:0/750397453 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3cd00ad220 0x7f3cd00c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:28.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.230+0000 7f3cd514f640 1 -- 172.21.15.77:0/750397453 --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cd006f1c0 con 0x7f3cd00670c0 2024-04-25T01:41:28.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.230+0000 7f3cd514f640 1 -- 172.21.15.77:0/750397453 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f3cd006ecb0 con 0x7f3cd00ad220 2024-04-25T01:41:28.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.230+0000 7f3ccdd9b640 1 -- 172.21.15.77:0/750397453 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1507152620 0 0) 0x7f3cd006eee0 con 0x7f3cd00c38f0 2024-04-25T01:41:28.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.230+0000 7f3ccdd9b640 1 -- 172.21.15.77:0/750397453 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cbc003520 con 0x7f3cd00c38f0 2024-04-25T01:41:28.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.230+0000 7f3ccdd9b640 1 -- 172.21.15.77:0/750397453 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3140865441 0 0) 0x7f3cd006f1c0 con 0x7f3cd00670c0 2024-04-25T01:41:28.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.230+0000 7f3cce59c640 1 -- 172.21.15.77:0/750397453 >> v1:172.21.15.121:6789/0 conn(0x7f3cd00670c0 legacy=0x7f3cd0164da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:28.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.230+0000 7f3cce59c640 1 -- 172.21.15.77:0/750397453 >> v1:172.21.15.77:6789/0 conn(0x7f3cd00c38f0 legacy=0x7f3cd015adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:28.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.230+0000 7f3cce59c640 1 -- 172.21.15.77:0/750397453 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd006f4a0 con 0x7f3cd00ad220 2024-04-25T01:41:28.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.231+0000 7f3cce59c640 1 --2- 172.21.15.77:0/750397453 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3cd00ad220 0x7f3cd00c3cd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3cb80097d0 tx=0x7f3cb802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8aaf04d0a6106f91 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:28.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.231+0000 7f3ccdd9b640 1 -- 172.21.15.77:0/750397453 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8037070 con 0x7f3cd00ad220 2024-04-25T01:41:28.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.232+0000 7f3ccdd9b640 1 -- 172.21.15.77:0/750397453 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cb8032440 con 0x7f3cd00ad220 2024-04-25T01:41:28.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.232+0000 7f3ccdd9b640 1 -- 172.21.15.77:0/750397453 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8032810 con 0x7f3cd00ad220 2024-04-25T01:41:28.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.232+0000 7f3cd514f640 1 -- 172.21.15.77:0/750397453 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3cd00ad220 msgr2=0x7f3cd00c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:28.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.232+0000 7f3cd514f640 1 --2- 172.21.15.77:0/750397453 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3cd00ad220 0x7f3cd00c3cd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3cb80097d0 tx=0x7f3cb802a180 comp rx=0 tx=0).stop 2024-04-25T01:41:28.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.232+0000 7f3cd514f640 1 -- 172.21.15.77:0/750397453 shutdown_connections 2024-04-25T01:41:28.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.232+0000 7f3cd514f640 1 --2- 172.21.15.77:0/750397453 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3cd00ad220 0x7f3cd00c3cd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:28.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.232+0000 7f3cd514f640 1 -- 172.21.15.77:0/750397453 >> 172.21.15.77:0/750397453 conn(0x7f3cd00c49e0 msgr2=0x7f3cd00c4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:28.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.232+0000 7f3cd514f640 1 -- 172.21.15.77:0/750397453 shutdown_connections 2024-04-25T01:41:28.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.233+0000 7f3cd514f640 1 -- 172.21.15.77:0/750397453 wait complete. 2024-04-25T01:41:28.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.235+0000 7f3cd514f640 1 Processor -- start 2024-04-25T01:41:28.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.235+0000 7f3cd514f640 1 -- start start 2024-04-25T01:41:28.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.236+0000 7f3cd514f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cd00670c0 0x7f3cd01e4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:28.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.236+0000 7f3cd514f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3cd00ad220 0x7f3cd01524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:28.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.236+0000 7f3cced9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cd00670c0 0x7f3cd01e4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:28.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.236+0000 7f3cced9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cd00670c0 0x7f3cd01e4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37122/0 (socket says 172.21.15.77:37122) 2024-04-25T01:41:28.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.236+0000 7f3cced9d640 1 -- 172.21.15.77:0/1010113371 learned_addr learned my addr 172.21.15.77:0/1010113371 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:28.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.236+0000 7f3cce59c640 1 --2- 172.21.15.77:0/1010113371 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3cd00ad220 0x7f3cd01524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:28.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.236+0000 7f3cd514f640 1 --2- 172.21.15.77:0/1010113371 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3cd00c38f0 0x7f3cd0156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:28.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.236+0000 7f3cd514f640 1 -- 172.21.15.77:0/1010113371 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd00acf70 con 0x7f3cd00670c0 2024-04-25T01:41:28.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.236+0000 7f3cd514f640 1 -- 172.21.15.77:0/1010113371 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd015a890 con 0x7f3cd00ad220 2024-04-25T01:41:28.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.236+0000 7f3cd514f640 1 -- 172.21.15.77:0/1010113371 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f3cd0073110 con 0x7f3cd00c38f0 2024-04-25T01:41:28.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.236+0000 7f3ccf59e640 1 --2- 172.21.15.77:0/1010113371 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3cd00c38f0 0x7f3cd0156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:28.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.237+0000 7f3cced9d640 1 -- 172.21.15.77:0/1010113371 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3cd00c38f0 msgr2=0x7f3cd0156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:28.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.237+0000 7f3cced9d640 1 --2- 172.21.15.77:0/1010113371 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3cd00c38f0 0x7f3cd0156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:28.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.237+0000 7f3cced9d640 1 -- 172.21.15.77:0/1010113371 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3cd00ad220 msgr2=0x7f3cd01524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:28.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.237+0000 7f3cced9d640 1 --2- 172.21.15.77:0/1010113371 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3cd00ad220 0x7f3cd01524c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:28.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.237+0000 7f3cced9d640 1 -- 172.21.15.77:0/1010113371 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd0157040 con 0x7f3cd00670c0 2024-04-25T01:41:28.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.237+0000 7f3cced9d640 1 --2- 172.21.15.77:0/1010113371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cd00670c0 0x7f3cd01e4b70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8001460 tx=0x7f3cc800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:28.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.237+0000 7f3cc77fe640 1 -- 172.21.15.77:0/1010113371 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8017070 con 0x7f3cd00670c0 2024-04-25T01:41:28.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.237+0000 7f3cc77fe640 1 -- 172.21.15.77:0/1010113371 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cc800ac30 con 0x7f3cd00670c0 2024-04-25T01:41:28.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.237+0000 7f3cc77fe640 1 -- 172.21.15.77:0/1010113371 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8012620 con 0x7f3cd00670c0 2024-04-25T01:41:28.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.237+0000 7f3cd514f640 1 -- 172.21.15.77:0/1010113371 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cd01e3b20 con 0x7f3cd00670c0 2024-04-25T01:41:28.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.237+0000 7f3cd514f640 1 -- 172.21.15.77:0/1010113371 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cd0155950 con 0x7f3cd00670c0 2024-04-25T01:41:28.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.239+0000 7f3cc57fa640 1 -- 172.21.15.77:0/1010113371 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ca8005290 con 0x7f3cd00670c0 2024-04-25T01:41:28.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.240+0000 7f3cc77fe640 1 -- 172.21.15.77:0/1010113371 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3cc801a070 con 0x7f3cd00670c0 2024-04-25T01:41:28.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.241+0000 7f3cc77fe640 1 --2- 172.21.15.77:0/1010113371 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3cb006be30 0x7f3cb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:28.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.241+0000 7f3cc77fe640 1 -- 172.21.15.77:0/1010113371 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6723+0+0 (secure 0 0 0) 0x7f3cc808b430 con 0x7f3cd00670c0 2024-04-25T01:41:28.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.241+0000 7f3cce59c640 1 --2- 172.21.15.77:0/1010113371 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3cb006be30 0x7f3cb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:28.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.242+0000 7f3cce59c640 1 --2- 172.21.15.77:0/1010113371 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3cb006be30 0x7f3cb006e2f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8034000 tx=0x7f3cb802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:28.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.248+0000 7f3cc77fe640 1 -- 172.21.15.77:0/1010113371 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3cc8021020 con 0x7f3cd00670c0 2024-04-25T01:41:28.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.380+0000 7f1b641d5640 1 -- 172.21.15.77:0/2910979911 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b5c06cec0 con 0x7f1b5c06c280 2024-04-25T01:41:28.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.381+0000 7f1b527fc640 1 -- 172.21.15.77:0/2910979911 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6492 (secure 0 0 0) 0x7f1b580585a0 con 0x7f1b5c06c280 2024-04-25T01:41:28.368 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:28.368 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5265,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:02.386295+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":29,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":2}]} 2024-04-25T01:41:28.368 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 17 2024-04-25T01:41:28.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.384+0000 7f1b641d5640 1 -- 172.21.15.77:0/2910979911 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1b4006be30 msgr2=0x7f1b4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:28.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.384+0000 7f1b641d5640 1 --2- 172.21.15.77:0/2910979911 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1b4006be30 0x7f1b4006e2f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c1449a0 tx=0x7f1b4c009190 comp rx=0 tx=0).stop 2024-04-25T01:41:28.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.384+0000 7f1b641d5640 1 -- 172.21.15.77:0/2910979911 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b5c06c280 msgr2=0x7f1b5c1ef6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:28.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.384+0000 7f1b641d5640 1 --2- 172.21.15.77:0/2910979911 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b5c06c280 0x7f1b5c1ef6e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800c340 tx=0x7f1b5800c800 comp rx=0 tx=0).stop 2024-04-25T01:41:28.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.384+0000 7f1b641d5640 1 -- 172.21.15.77:0/2910979911 shutdown_connections 2024-04-25T01:41:28.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.384+0000 7f1b641d5640 1 --2- 172.21.15.77:0/2910979911 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1b4006be30 0x7f1b4006e2f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:28.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.384+0000 7f1b641d5640 1 --2- 172.21.15.77:0/2910979911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b5c150090 0x7f1b5c0c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:28.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.384+0000 7f1b641d5640 1 --2- 172.21.15.77:0/2910979911 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1b5c156c80 0x7f1b5c0c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:28.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.384+0000 7f1b641d5640 1 --2- 172.21.15.77:0/2910979911 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b5c06c280 0x7f1b5c1ef6e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:28.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.384+0000 7f1b641d5640 1 -- 172.21.15.77:0/2910979911 >> 172.21.15.77:0/2910979911 conn(0x7f1b5c0ad4d0 msgr2=0x7f1b5c1549f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:28.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.384+0000 7f1b641d5640 1 -- 172.21.15.77:0/2910979911 shutdown_connections 2024-04-25T01:41:28.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.384+0000 7f1b641d5640 1 -- 172.21.15.77:0/2910979911 wait complete. 2024-04-25T01:41:28.386 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-25T01:41:28.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.683+0000 7f3cc57fa640 1 -- 172.21.15.77:0/1010113371 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ca8005580 con 0x7f3cd00670c0 2024-04-25T01:41:28.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.684+0000 7f3cc77fe640 1 -- 172.21.15.77:0/1010113371 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6492 (secure 0 0 0) 0x7f3cc800ae20 con 0x7f3cd00670c0 2024-04-25T01:41:28.671 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:28.671 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5265,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:02.386295+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":29,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":2}]} 2024-04-25T01:41:28.671 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 17 2024-04-25T01:41:28.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.687+0000 7f3cc57fa640 1 -- 172.21.15.77:0/1010113371 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3cb006be30 msgr2=0x7f3cb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:28.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.687+0000 7f3cc57fa640 1 --2- 172.21.15.77:0/1010113371 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3cb006be30 0x7f3cb006e2f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8034000 tx=0x7f3cb802e000 comp rx=0 tx=0).stop 2024-04-25T01:41:28.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.687+0000 7f3cc57fa640 1 -- 172.21.15.77:0/1010113371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cd00670c0 msgr2=0x7f3cd01e4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:28.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.687+0000 7f3cc57fa640 1 --2- 172.21.15.77:0/1010113371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cd00670c0 0x7f3cd01e4b70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8001460 tx=0x7f3cc800cf90 comp rx=0 tx=0).stop 2024-04-25T01:41:28.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.687+0000 7f3cc57fa640 1 -- 172.21.15.77:0/1010113371 shutdown_connections 2024-04-25T01:41:28.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.687+0000 7f3cc57fa640 1 --2- 172.21.15.77:0/1010113371 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3cb006be30 0x7f3cb006e2f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:28.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.687+0000 7f3cc57fa640 1 --2- 172.21.15.77:0/1010113371 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3cd00c38f0 0x7f3cd0156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:28.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.687+0000 7f3cc57fa640 1 --2- 172.21.15.77:0/1010113371 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3cd00ad220 0x7f3cd01524c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:28.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.687+0000 7f3cc57fa640 1 --2- 172.21.15.77:0/1010113371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cd00670c0 0x7f3cd01e4b70 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:28.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.687+0000 7f3cc57fa640 1 -- 172.21.15.77:0/1010113371 >> 172.21.15.77:0/1010113371 conn(0x7f3cd00c49e0 msgr2=0x7f3cd0159ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:28.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.687+0000 7f3cc57fa640 1 -- 172.21.15.77:0/1010113371 shutdown_connections 2024-04-25T01:41:28.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:28.687+0000 7f3cc57fa640 1 -- 172.21.15.77:0/1010113371 wait complete. 2024-04-25T01:41:28.689 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T01:41:30.387 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:30.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.550+0000 7fbc8a2ae640 1 Processor -- start 2024-04-25T01:41:30.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.550+0000 7fbc8a2ae640 1 -- start start 2024-04-25T01:41:30.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.551+0000 7fbc8a2ae640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbc84156c80 0x7fbc840c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:30.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.551+0000 7fbc8a2ae640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc8406c280 0x7fbc840c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:30.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.552+0000 7fbc83fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fbc84150090 0x7fbc840c8200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36592/0 (socket says 172.21.15.77:36592) 2024-04-25T01:41:30.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.552+0000 7fbc83fff640 1 -- 172.21.15.77:0/2149432520 learned_addr learned my addr 172.21.15.77:0/2149432520 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:41:30.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.552+0000 7fbc8a2ae640 1 -- 172.21.15.77:0/2149432520 --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc84157130 con 0x7fbc84150090 2024-04-25T01:41:30.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.552+0000 7fbc8a2ae640 1 -- 172.21.15.77:0/2149432520 --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fbc8406b830 con 0x7fbc84156c80 2024-04-25T01:41:30.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.552+0000 7fbc8a2ae640 1 -- 172.21.15.77:0/2149432520 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fbc840c9de0 con 0x7fbc8406c280 2024-04-25T01:41:30.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.552+0000 7fbc837fe640 1 --2- 172.21.15.77:0/2149432520 >> v2:172.21.15.121:3300/0 conn(0x7fbc84156c80 0x7fbc840c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:30.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.552+0000 7fbc8884b640 1 --2- 172.21.15.77:0/2149432520 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc8406c280 0x7fbc840c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:30.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.552+0000 7fbc82ffd640 1 -- 172.21.15.77:0/2149432520 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3500416367 0 0) 0x7fbc74001110 con 0x7fbc84150090 2024-04-25T01:41:30.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.552+0000 7fbc82ffd640 1 -- 172.21.15.77:0/2149432520 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc6c003520 con 0x7fbc84150090 2024-04-25T01:41:30.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.552+0000 7fbc82ffd640 1 -- 172.21.15.77:0/2149432520 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3991532306 0 0) 0x7fbc6c003520 con 0x7fbc84150090 2024-04-25T01:41:30.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.552+0000 7fbc82ffd640 1 -- 172.21.15.77:0/2149432520 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc8406c280 msgr2=0x7fbc840c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:30.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.552+0000 7fbc82ffd640 1 --2- 172.21.15.77:0/2149432520 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc8406c280 0x7fbc840c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:30.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.552+0000 7fbc82ffd640 1 -- 172.21.15.77:0/2149432520 >> v2:172.21.15.121:3300/0 conn(0x7fbc84156c80 msgr2=0x7fbc840c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:30.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.552+0000 7fbc82ffd640 1 --2- 172.21.15.77:0/2149432520 >> v2:172.21.15.121:3300/0 conn(0x7fbc84156c80 0x7fbc840c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:30.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.552+0000 7fbc82ffd640 1 -- 172.21.15.77:0/2149432520 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc840c89c0 con 0x7fbc84150090 2024-04-25T01:41:30.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.552+0000 7fbc82ffd640 1 -- 172.21.15.77:0/2149432520 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7fbc74001840 con 0x7fbc84150090 2024-04-25T01:41:30.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.552+0000 7fbc82ffd640 1 -- 172.21.15.77:0/2149432520 >> v1:172.21.15.77:6789/0 conn(0x7fbc84150090 legacy=0x7fbc840c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:30.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.552+0000 7fbc82ffd640 1 --2- 172.21.15.77:0/2149432520 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc6c0039b0 0x7fbc6c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:30.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.552+0000 7fbc82ffd640 1 --2- 172.21.15.77:0/2149432520 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc6c004800 0x7fbc6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:30.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.552+0000 7fbc82ffd640 1 --2- 172.21.15.77:0/2149432520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc6c0051c0 0x7fbc6c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:30.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.552+0000 7fbc82ffd640 1 -- 172.21.15.77:0/2149432520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8406b830 con 0x7fbc6c0051c0 2024-04-25T01:41:30.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.552+0000 7fbc82ffd640 1 -- 172.21.15.77:0/2149432520 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbc840c9de0 con 0x7fbc6c004800 2024-04-25T01:41:30.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.552+0000 7fbc82ffd640 1 -- 172.21.15.77:0/2149432520 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fbc6c00bf00 con 0x7fbc6c0039b0 2024-04-25T01:41:30.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.552+0000 7fbc8884b640 1 --2- 172.21.15.77:0/2149432520 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc8406c280 0x7fbc840c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:41:30.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.553+0000 7fbc8884b640 1 --2- 172.21.15.77:0/2149432520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc6c0051c0 0x7fbc6c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:30.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.553+0000 7fbc83fff640 1 --2- 172.21.15.77:0/2149432520 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc6c0039b0 0x7fbc6c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:30.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.553+0000 7fbc8884b640 1 -- 172.21.15.77:0/2149432520 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc6c0039b0 msgr2=0x7fbc6c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:30.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.553+0000 7fbc8884b640 1 --2- 172.21.15.77:0/2149432520 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc6c0039b0 0x7fbc6c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:30.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.553+0000 7fbc8884b640 1 -- 172.21.15.77:0/2149432520 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc6c004800 msgr2=0x7fbc6c004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T01:41:30.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.553+0000 7fbc8884b640 1 --2- 172.21.15.77:0/2149432520 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc6c004800 0x7fbc6c004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:30.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.553+0000 7fbc8884b640 1 -- 172.21.15.77:0/2149432520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc6c003520 con 0x7fbc6c0051c0 2024-04-25T01:41:30.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.554+0000 7fbc8884b640 1 --2- 172.21.15.77:0/2149432520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc6c0051c0 0x7fbc6c00b9c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c009fc0 tx=0x7fbc6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b08f2a454c068ae3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:30.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.554+0000 7fbc82ffd640 1 -- 172.21.15.77:0/2149432520 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c009d40 con 0x7fbc6c0051c0 2024-04-25T01:41:30.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.554+0000 7fbc82ffd640 1 -- 172.21.15.77:0/2149432520 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc7c033d20 con 0x7fbc6c0051c0 2024-04-25T01:41:30.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.554+0000 7fbc82ffd640 1 -- 172.21.15.77:0/2149432520 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c003bb0 con 0x7fbc6c0051c0 2024-04-25T01:41:30.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.555+0000 7fbc8a2ae640 1 -- 172.21.15.77:0/2149432520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc6c0051c0 msgr2=0x7fbc6c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:30.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.555+0000 7fbc8a2ae640 1 --2- 172.21.15.77:0/2149432520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc6c0051c0 0x7fbc6c00b9c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c009fc0 tx=0x7fbc6c005830 comp rx=0 tx=0).stop 2024-04-25T01:41:30.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.555+0000 7fbc8884b640 1 -- 172.21.15.77:0/2149432520 reap_dead start 2024-04-25T01:41:30.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.555+0000 7fbc8a2ae640 1 -- 172.21.15.77:0/2149432520 shutdown_connections 2024-04-25T01:41:30.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.555+0000 7fbc8a2ae640 1 -- 172.21.15.77:0/2149432520 >> 172.21.15.77:0/2149432520 conn(0x7fbc840ad4d0 msgr2=0x7fbc840ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:30.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.555+0000 7fbc8a2ae640 1 -- 172.21.15.77:0/2149432520 shutdown_connections 2024-04-25T01:41:30.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.555+0000 7fbc8a2ae640 1 -- 172.21.15.77:0/2149432520 wait complete. 2024-04-25T01:41:30.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.557+0000 7fbc8a2ae640 1 Processor -- start 2024-04-25T01:41:30.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.557+0000 7fbc8a2ae640 1 -- start start 2024-04-25T01:41:30.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.558+0000 7fbc8a2ae640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc6c0051c0 0x7fbc840b1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:30.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.558+0000 7fbc8a2ae640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc840b1010 0x7fbc841eaee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:30.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.558+0000 7fbc8a2ae640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc84149970 0x7fbc84149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:30.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.558+0000 7fbc83fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc6c0051c0 0x7fbc840b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:30.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.558+0000 7fbc83fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc6c0051c0 0x7fbc840b1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37126/0 (socket says 172.21.15.77:37126) 2024-04-25T01:41:30.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.558+0000 7fbc83fff640 1 -- 172.21.15.77:0/2791452914 learned_addr learned my addr 172.21.15.77:0/2791452914 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:30.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.558+0000 7fbc8a2ae640 1 -- 172.21.15.77:0/2791452914 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8406bd60 con 0x7fbc6c0051c0 2024-04-25T01:41:30.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.558+0000 7fbc8a2ae640 1 -- 172.21.15.77:0/2791452914 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8406ba80 con 0x7fbc840b1010 2024-04-25T01:41:30.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.558+0000 7fbc8a2ae640 1 -- 172.21.15.77:0/2791452914 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fbc8406c690 con 0x7fbc84149970 2024-04-25T01:41:30.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.558+0000 7fbc8884b640 1 --2- 172.21.15.77:0/2791452914 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc84149970 0x7fbc84149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:30.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.559+0000 7fbc837fe640 1 --2- 172.21.15.77:0/2791452914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc840b1010 0x7fbc841eaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:30.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.559+0000 7fbc83fff640 1 -- 172.21.15.77:0/2791452914 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc84149970 msgr2=0x7fbc84149df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:30.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.559+0000 7fbc83fff640 1 --2- 172.21.15.77:0/2791452914 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc84149970 0x7fbc84149df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:30.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.559+0000 7fbc83fff640 1 -- 172.21.15.77:0/2791452914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc840b1010 msgr2=0x7fbc841eaee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:30.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.559+0000 7fbc83fff640 1 --2- 172.21.15.77:0/2791452914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc840b1010 0x7fbc841eaee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:30.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.559+0000 7fbc83fff640 1 -- 172.21.15.77:0/2791452914 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc84159880 con 0x7fbc6c0051c0 2024-04-25T01:41:30.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.559+0000 7fbc83fff640 1 --2- 172.21.15.77:0/2791452914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc6c0051c0 0x7fbc840b1560 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbc74001050 tx=0x7fbc7400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:30.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.560+0000 7fbc80ff9640 1 -- 172.21.15.77:0/2791452914 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7400c870 con 0x7fbc6c0051c0 2024-04-25T01:41:30.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.560+0000 7fbc80ff9640 1 -- 172.21.15.77:0/2791452914 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc74018070 con 0x7fbc6c0051c0 2024-04-25T01:41:30.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.560+0000 7fbc80ff9640 1 -- 172.21.15.77:0/2791452914 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7400cc70 con 0x7fbc6c0051c0 2024-04-25T01:41:30.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.560+0000 7fbc8a2ae640 1 -- 172.21.15.77:0/2791452914 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc841eb820 con 0x7fbc6c0051c0 2024-04-25T01:41:30.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.561+0000 7fbc8a2ae640 1 -- 172.21.15.77:0/2791452914 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc841ebb00 con 0x7fbc6c0051c0 2024-04-25T01:41:30.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.562+0000 7fbc8a2ae640 1 -- 172.21.15.77:0/2791452914 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc8404f500 con 0x7fbc6c0051c0 2024-04-25T01:41:30.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.565+0000 7fbc80ff9640 1 -- 172.21.15.77:0/2791452914 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc7401d460 con 0x7fbc6c0051c0 2024-04-25T01:41:30.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.565+0000 7fbc80ff9640 1 --2- 172.21.15.77:0/2791452914 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbc7006bf30 0x7fbc7006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:30.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.565+0000 7fbc80ff9640 1 -- 172.21.15.77:0/2791452914 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6723+0+0 (secure 0 0 0) 0x7fbc7408af40 con 0x7fbc6c0051c0 2024-04-25T01:41:30.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.565+0000 7fbc837fe640 1 --2- 172.21.15.77:0/2791452914 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbc7006bf30 0x7fbc7006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:30.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.566+0000 7fbc837fe640 1 --2- 172.21.15.77:0/2791452914 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbc7006bf30 0x7fbc7006e3f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbc84155770 tx=0x7fbc78009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:30.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.571+0000 7fbc80ff9640 1 -- 172.21.15.77:0/2791452914 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbc84157130 con 0x7fbc6c0051c0 2024-04-25T01:41:30.689 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:30.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.853+0000 7fe726570640 1 Processor -- start 2024-04-25T01:41:30.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.853+0000 7fe726570640 1 -- start start 2024-04-25T01:41:30.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.855+0000 7fe726570640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe720151430 0x7fe720157450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:30.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.855+0000 7fe726570640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe720157ba0 con 0x7fe72006f7d0 2024-04-25T01:41:30.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.855+0000 7fe726570640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe720157e80 con 0x7fe7200723c0 2024-04-25T01:41:30.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.855+0000 7fe726570640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fe7200677c0 con 0x7fe720151430 2024-04-25T01:41:30.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.855+0000 7fe724b0d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe72006f7d0 0x7fe720154590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36596/0 (socket says 172.21.15.77:36596) 2024-04-25T01:41:30.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.855+0000 7fe724b0d640 1 -- 172.21.15.77:0/895181122 learned_addr learned my addr 172.21.15.77:0/895181122 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:41:30.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.855+0000 7fe71ffff640 1 --2- 172.21.15.77:0/895181122 >> v2:172.21.15.121:3300/0 conn(0x7fe720151430 0x7fe720157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:30.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.855+0000 7fe71effd640 1 -- 172.21.15.77:0/895181122 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1564941676 0 0) 0x7fe720157ba0 con 0x7fe72006f7d0 2024-04-25T01:41:30.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.855+0000 7fe71effd640 1 -- 172.21.15.77:0/895181122 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe708003520 con 0x7fe72006f7d0 2024-04-25T01:41:30.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.855+0000 7fe71effd640 1 -- 172.21.15.77:0/895181122 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3332105492 0 0) 0x7fe720157e80 con 0x7fe7200723c0 2024-04-25T01:41:30.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.855+0000 7fe71effd640 1 -- 172.21.15.77:0/895181122 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe720157ba0 con 0x7fe7200723c0 2024-04-25T01:41:30.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.855+0000 7fe71effd640 1 -- 172.21.15.77:0/895181122 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2344688402 0 0) 0x7fe708003520 con 0x7fe72006f7d0 2024-04-25T01:41:30.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.855+0000 7fe71effd640 1 -- 172.21.15.77:0/895181122 >> v2:172.21.15.121:3300/0 conn(0x7fe720151430 msgr2=0x7fe720157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:30.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.856+0000 7fe71effd640 1 --2- 172.21.15.77:0/895181122 >> v2:172.21.15.121:3300/0 conn(0x7fe720151430 0x7fe720157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:30.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.856+0000 7fe71effd640 1 -- 172.21.15.77:0/895181122 >> v1:172.21.15.121:6789/0 conn(0x7fe7200723c0 legacy=0x7fe7200c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:30.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.856+0000 7fe71effd640 1 -- 172.21.15.77:0/895181122 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe720158160 con 0x7fe72006f7d0 2024-04-25T01:41:30.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.856+0000 7fe71effd640 1 -- 172.21.15.77:0/895181122 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7fe7180019f0 con 0x7fe72006f7d0 2024-04-25T01:41:30.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.856+0000 7fe71effd640 1 -- 172.21.15.77:0/895181122 >> v1:172.21.15.77:6789/0 conn(0x7fe72006f7d0 legacy=0x7fe720154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:30.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.856+0000 7fe71effd640 1 --2- 172.21.15.77:0/895181122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe708003b70 0x7fe708003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:30.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.856+0000 7fe71effd640 1 --2- 172.21.15.77:0/895181122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe708004800 0x7fe708004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:30.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.856+0000 7fe71effd640 1 --2- 172.21.15.77:0/895181122 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe7080052e0 0x7fe7080145c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:30.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.856+0000 7fe71effd640 1 -- 172.21.15.77:0/895181122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe708014b00 con 0x7fe708003b70 2024-04-25T01:41:30.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.856+0000 7fe71effd640 1 -- 172.21.15.77:0/895181122 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe708014c80 con 0x7fe708004800 2024-04-25T01:41:30.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.856+0000 7fe71effd640 1 -- 172.21.15.77:0/895181122 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe708014e00 con 0x7fe7080052e0 2024-04-25T01:41:30.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.856+0000 7fe71f7fe640 1 --2- 172.21.15.77:0/895181122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe708004800 0x7fe708004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:30.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.856+0000 7fe724b0d640 1 --2- 172.21.15.77:0/895181122 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe7080052e0 0x7fe7080145c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:30.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.856+0000 7fe71ffff640 1 --2- 172.21.15.77:0/895181122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe708003b70 0x7fe708003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:30.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.856+0000 7fe71f7fe640 1 -- 172.21.15.77:0/895181122 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe7080052e0 msgr2=0x7fe7080145c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:30.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.856+0000 7fe71f7fe640 1 --2- 172.21.15.77:0/895181122 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe7080052e0 0x7fe7080145c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:30.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.856+0000 7fe71f7fe640 1 -- 172.21.15.77:0/895181122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe708003b70 msgr2=0x7fe708003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:30.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.856+0000 7fe71f7fe640 1 --2- 172.21.15.77:0/895181122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe708003b70 0x7fe708003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:30.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.857+0000 7fe71f7fe640 1 -- 172.21.15.77:0/895181122 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe708003520 con 0x7fe708004800 2024-04-25T01:41:30.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.857+0000 7fe71ffff640 1 --2- 172.21.15.77:0/895181122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe708003b70 0x7fe708003f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:41:30.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.857+0000 7fe724b0d640 1 -- 172.21.15.77:0/895181122 reap_dead start 2024-04-25T01:41:30.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.858+0000 7fe71f7fe640 1 --2- 172.21.15.77:0/895181122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe708004800 0x7fe708004c80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe71400c0e0 tx=0x7fe708005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8628b88b9e370ffb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:30.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.858+0000 7fe71effd640 1 -- 172.21.15.77:0/895181122 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe714036070 con 0x7fe708004800 2024-04-25T01:41:30.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.858+0000 7fe71effd640 1 -- 172.21.15.77:0/895181122 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe714031600 con 0x7fe708004800 2024-04-25T01:41:30.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.858+0000 7fe71effd640 1 -- 172.21.15.77:0/895181122 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe714007c00 con 0x7fe708004800 2024-04-25T01:41:30.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.858+0000 7fe726570640 1 -- 172.21.15.77:0/895181122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe708004800 msgr2=0x7fe708004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:30.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.858+0000 7fe726570640 1 --2- 172.21.15.77:0/895181122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe708004800 0x7fe708004c80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe71400c0e0 tx=0x7fe708005830 comp rx=0 tx=0).stop 2024-04-25T01:41:30.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.859+0000 7fe726570640 1 -- 172.21.15.77:0/895181122 shutdown_connections 2024-04-25T01:41:30.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.859+0000 7fe726570640 1 --2- 172.21.15.77:0/895181122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe708004800 0x7fe708004c80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:30.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.859+0000 7fe726570640 1 -- 172.21.15.77:0/895181122 >> 172.21.15.77:0/895181122 conn(0x7fe7200aa8f0 msgr2=0x7fe720066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:30.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.859+0000 7fe726570640 1 -- 172.21.15.77:0/895181122 shutdown_connections 2024-04-25T01:41:30.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.859+0000 7fe726570640 1 -- 172.21.15.77:0/895181122 wait complete. 2024-04-25T01:41:30.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.861+0000 7fe726570640 1 Processor -- start 2024-04-25T01:41:30.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.861+0000 7fe726570640 1 -- start start 2024-04-25T01:41:30.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.862+0000 7fe726570640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe708004800 0x7fe7200c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:30.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.862+0000 7fe726570640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe720149db0 0x7fe72014a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:30.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.862+0000 7fe726570640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe7201e6ff0 0x7fe7201e7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:30.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.862+0000 7fe71ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe708004800 0x7fe7200c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:30.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.862+0000 7fe726570640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe720157450 con 0x7fe708004800 2024-04-25T01:41:30.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.862+0000 7fe71ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe708004800 0x7fe7200c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37134/0 (socket says 172.21.15.77:37134) 2024-04-25T01:41:30.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.862+0000 7fe71ffff640 1 -- 172.21.15.77:0/95939665 learned_addr learned my addr 172.21.15.77:0/95939665 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:30.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.862+0000 7fe726570640 1 -- 172.21.15.77:0/95939665 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe720154100 con 0x7fe720149db0 2024-04-25T01:41:30.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.862+0000 7fe726570640 1 -- 172.21.15.77:0/95939665 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe7201575d0 con 0x7fe7201e6ff0 2024-04-25T01:41:30.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.862+0000 7fe71f7fe640 1 --2- 172.21.15.77:0/95939665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe720149db0 0x7fe72014a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:30.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.862+0000 7fe724b0d640 1 --2- 172.21.15.77:0/95939665 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe7201e6ff0 0x7fe7201e7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:30.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.863+0000 7fe71f7fe640 1 -- 172.21.15.77:0/95939665 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe7201e6ff0 msgr2=0x7fe7201e7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:30.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.863+0000 7fe71f7fe640 1 --2- 172.21.15.77:0/95939665 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe7201e6ff0 0x7fe7201e7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:30.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.863+0000 7fe71f7fe640 1 -- 172.21.15.77:0/95939665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe708004800 msgr2=0x7fe7200c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:30.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.863+0000 7fe71f7fe640 1 --2- 172.21.15.77:0/95939665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe708004800 0x7fe7200c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:30.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.863+0000 7fe71f7fe640 1 -- 172.21.15.77:0/95939665 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7201eb1c0 con 0x7fe720149db0 2024-04-25T01:41:30.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.863+0000 7fe71f7fe640 1 --2- 172.21.15.77:0/95939665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe720149db0 0x7fe72014a230 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe7140018a0 tx=0x7fe714001810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:30.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.863+0000 7fe71cff9640 1 -- 172.21.15.77:0/95939665 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe714036040 con 0x7fe720149db0 2024-04-25T01:41:30.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.863+0000 7fe71cff9640 1 -- 172.21.15.77:0/95939665 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe714007be0 con 0x7fe720149db0 2024-04-25T01:41:30.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.863+0000 7fe726570640 1 -- 172.21.15.77:0/95939665 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7200ac6d0 con 0x7fe720149db0 2024-04-25T01:41:30.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.863+0000 7fe71cff9640 1 -- 172.21.15.77:0/95939665 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe714001c40 con 0x7fe720149db0 2024-04-25T01:41:30.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.863+0000 7fe726570640 1 -- 172.21.15.77:0/95939665 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7200af9b0 con 0x7fe720149db0 2024-04-25T01:41:30.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.865+0000 7fe726570640 1 -- 172.21.15.77:0/95939665 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe72004f500 con 0x7fe720149db0 2024-04-25T01:41:30.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.865+0000 7fe71cff9640 1 -- 172.21.15.77:0/95939665 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe714043020 con 0x7fe720149db0 2024-04-25T01:41:30.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.866+0000 7fe71cff9640 1 --2- 172.21.15.77:0/95939665 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe70c06be60 0x7fe70c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:30.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.866+0000 7fe71ffff640 1 --2- 172.21.15.77:0/95939665 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe70c06be60 0x7fe70c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:30.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.867+0000 7fe71cff9640 1 -- 172.21.15.77:0/95939665 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6723+0+0 (secure 0 0 0) 0x7fe7140ab2d0 con 0x7fe720149db0 2024-04-25T01:41:30.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.867+0000 7fe71ffff640 1 --2- 172.21.15.77:0/95939665 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe70c06be60 0x7fe70c06e320 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe710006c00 tx=0x7fe710008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:30.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:30.874+0000 7fe71cff9640 1 -- 172.21.15.77:0/95939665 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe714079220 con 0x7fe720149db0 2024-04-25T01:41:30.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:31.007+0000 7fbc8a2ae640 1 -- 172.21.15.77:0/2791452914 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc84153ad0 con 0x7fbc6c0051c0 2024-04-25T01:41:30.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:31.008+0000 7fbc80ff9640 1 -- 172.21.15.77:0/2791452914 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6492 (secure 0 0 0) 0x7fbc74058f10 con 0x7fbc6c0051c0 2024-04-25T01:41:30.995 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:30.995 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5265,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:02.386295+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":29,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":2}]} 2024-04-25T01:41:30.996 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 17 2024-04-25T01:41:30.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:31.011+0000 7fbc8a2ae640 1 -- 172.21.15.77:0/2791452914 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbc7006bf30 msgr2=0x7fbc7006e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:30.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:31.011+0000 7fbc8a2ae640 1 --2- 172.21.15.77:0/2791452914 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbc7006bf30 0x7fbc7006e3f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbc84155770 tx=0x7fbc78009190 comp rx=0 tx=0).stop 2024-04-25T01:41:30.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:31.011+0000 7fbc8a2ae640 1 -- 172.21.15.77:0/2791452914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc6c0051c0 msgr2=0x7fbc840b1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:30.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:31.011+0000 7fbc8a2ae640 1 --2- 172.21.15.77:0/2791452914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc6c0051c0 0x7fbc840b1560 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbc74001050 tx=0x7fbc7400ec80 comp rx=0 tx=0).stop 2024-04-25T01:41:30.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:31.011+0000 7fbc8a2ae640 1 -- 172.21.15.77:0/2791452914 shutdown_connections 2024-04-25T01:41:30.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:31.011+0000 7fbc8a2ae640 1 --2- 172.21.15.77:0/2791452914 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbc7006bf30 0x7fbc7006e3f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:30.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:31.011+0000 7fbc8a2ae640 1 --2- 172.21.15.77:0/2791452914 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc84149970 0x7fbc84149df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:30.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:31.011+0000 7fbc8a2ae640 1 --2- 172.21.15.77:0/2791452914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc840b1010 0x7fbc841eaee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:30.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:31.011+0000 7fbc8a2ae640 1 --2- 172.21.15.77:0/2791452914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc6c0051c0 0x7fbc840b1560 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:31.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:31.011+0000 7fbc8a2ae640 1 -- 172.21.15.77:0/2791452914 >> 172.21.15.77:0/2791452914 conn(0x7fbc840ad4d0 msgr2=0x7fbc840c9570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:31.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:31.011+0000 7fbc8a2ae640 1 -- 172.21.15.77:0/2791452914 shutdown_connections 2024-04-25T01:41:31.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:31.011+0000 7fbc8a2ae640 1 -- 172.21.15.77:0/2791452914 wait complete. 2024-04-25T01:41:31.013 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-25T01:41:31.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:31.311+0000 7fe726570640 1 -- 172.21.15.77:0/95939665 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7200ac500 con 0x7fe720149db0 2024-04-25T01:41:31.298 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:31.299 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5265,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:02.386295+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":29,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":2}]} 2024-04-25T01:41:31.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:31.312+0000 7fe71cff9640 1 -- 172.21.15.77:0/95939665 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6492 (secure 0 0 0) 0x7fe71407d520 con 0x7fe720149db0 2024-04-25T01:41:31.299 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 17 2024-04-25T01:41:31.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:31.314+0000 7fe726570640 1 -- 172.21.15.77:0/95939665 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe70c06be60 msgr2=0x7fe70c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:31.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:31.314+0000 7fe726570640 1 --2- 172.21.15.77:0/95939665 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe70c06be60 0x7fe70c06e320 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe710006c00 tx=0x7fe710008040 comp rx=0 tx=0).stop 2024-04-25T01:41:31.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:31.314+0000 7fe726570640 1 -- 172.21.15.77:0/95939665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe720149db0 msgr2=0x7fe72014a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:31.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:31.314+0000 7fe726570640 1 --2- 172.21.15.77:0/95939665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe720149db0 0x7fe72014a230 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe7140018a0 tx=0x7fe714001810 comp rx=0 tx=0).stop 2024-04-25T01:41:31.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:31.314+0000 7fe726570640 1 -- 172.21.15.77:0/95939665 shutdown_connections 2024-04-25T01:41:31.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:31.314+0000 7fe726570640 1 --2- 172.21.15.77:0/95939665 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe70c06be60 0x7fe70c06e320 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:31.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:31.314+0000 7fe726570640 1 --2- 172.21.15.77:0/95939665 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe7201e6ff0 0x7fe7201e7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:31.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:31.314+0000 7fe726570640 1 --2- 172.21.15.77:0/95939665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe720149db0 0x7fe72014a230 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:31.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:31.314+0000 7fe726570640 1 --2- 172.21.15.77:0/95939665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe708004800 0x7fe7200c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:31.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:31.314+0000 7fe726570640 1 -- 172.21.15.77:0/95939665 >> 172.21.15.77:0/95939665 conn(0x7fe7200aa8f0 msgr2=0x7fe72014ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:31.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:31.315+0000 7fe726570640 1 -- 172.21.15.77:0/95939665 shutdown_connections 2024-04-25T01:41:31.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:31.315+0000 7fe726570640 1 -- 172.21.15.77:0/95939665 wait complete. 2024-04-25T01:41:31.317 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T01:41:33.014 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:33.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.126+0000 7ff08b25d640 1 Processor -- start 2024-04-25T01:41:33.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.126+0000 7ff08b25d640 1 -- start start 2024-04-25T01:41:33.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.127+0000 7ff08b25d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff084150090 0x7ff084156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:33.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.127+0000 7ff08b25d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff08406c280 0x7ff0840c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:33.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.127+0000 7ff08b25d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0840c89c0 con 0x7ff0840c8200 2024-04-25T01:41:33.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.127+0000 7ff08b25d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff08406b830 con 0x7ff084150090 2024-04-25T01:41:33.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.127+0000 7ff08b25d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff0840c8ca0 con 0x7ff08406c280 2024-04-25T01:41:33.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.127+0000 7ff083fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff0840c8200 0x7ff0840c98a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36598/0 (socket says 172.21.15.77:36598) 2024-04-25T01:41:33.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.127+0000 7ff083fff640 1 -- 172.21.15.77:0/4132206096 learned_addr learned my addr 172.21.15.77:0/4132206096 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:41:33.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.127+0000 7ff088ff9640 1 --2- 172.21.15.77:0/4132206096 >> v2:172.21.15.77:3300/0 conn(0x7ff084150090 0x7ff084156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:33.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.127+0000 7ff0897fa640 1 --2- 172.21.15.77:0/4132206096 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff08406c280 0x7ff0840c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:33.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.127+0000 7ff0837fe640 1 -- 172.21.15.77:0/4132206096 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2089008147 0 0) 0x7ff0840c89c0 con 0x7ff0840c8200 2024-04-25T01:41:33.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.127+0000 7ff0837fe640 1 -- 172.21.15.77:0/4132206096 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff074003520 con 0x7ff0840c8200 2024-04-25T01:41:33.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.127+0000 7ff088ff9640 1 -- 172.21.15.77:0/4132206096 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff08406c280 msgr2=0x7ff0840c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:33.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.127+0000 7ff088ff9640 1 --2- 172.21.15.77:0/4132206096 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff08406c280 0x7ff0840c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:33.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.127+0000 7ff088ff9640 1 -- 172.21.15.77:0/4132206096 >> v1:172.21.15.77:6789/0 conn(0x7ff0840c8200 legacy=0x7ff0840c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:33.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.127+0000 7ff088ff9640 1 -- 172.21.15.77:0/4132206096 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08406ba80 con 0x7ff084150090 2024-04-25T01:41:33.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.127+0000 7ff0897fa640 1 --2- 172.21.15.77:0/4132206096 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff08406c280 0x7ff0840c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:41:33.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.128+0000 7ff088ff9640 1 --2- 172.21.15.77:0/4132206096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff084150090 0x7ff084156c80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff0780097a0 tx=0x7ff07802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c8df615462d53 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:33.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.128+0000 7ff0837fe640 1 -- 172.21.15.77:0/4132206096 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff078037070 con 0x7ff084150090 2024-04-25T01:41:33.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.128+0000 7ff0837fe640 1 -- 172.21.15.77:0/4132206096 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff078032440 con 0x7ff084150090 2024-04-25T01:41:33.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.128+0000 7ff0837fe640 1 -- 172.21.15.77:0/4132206096 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff078032810 con 0x7ff084150090 2024-04-25T01:41:33.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.129+0000 7ff08b25d640 1 -- 172.21.15.77:0/4132206096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff084150090 msgr2=0x7ff084156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:33.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.129+0000 7ff08b25d640 1 --2- 172.21.15.77:0/4132206096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff084150090 0x7ff084156c80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff0780097a0 tx=0x7ff07802a180 comp rx=0 tx=0).stop 2024-04-25T01:41:33.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.129+0000 7ff08b25d640 1 -- 172.21.15.77:0/4132206096 shutdown_connections 2024-04-25T01:41:33.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.129+0000 7ff08b25d640 1 --2- 172.21.15.77:0/4132206096 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff08406c280 0x7ff0840c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:33.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.129+0000 7ff08b25d640 1 --2- 172.21.15.77:0/4132206096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff084150090 0x7ff084156c80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:33.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.129+0000 7ff08b25d640 1 -- 172.21.15.77:0/4132206096 >> 172.21.15.77:0/4132206096 conn(0x7ff0840ad4d0 msgr2=0x7ff0840ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:33.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.129+0000 7ff08b25d640 1 -- 172.21.15.77:0/4132206096 shutdown_connections 2024-04-25T01:41:33.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.129+0000 7ff08b25d640 1 -- 172.21.15.77:0/4132206096 wait complete. 2024-04-25T01:41:33.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.130+0000 7ff08b25d640 1 Processor -- start 2024-04-25T01:41:33.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.130+0000 7ff08b25d640 1 -- start start 2024-04-25T01:41:33.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.131+0000 7ff08b25d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff08406c280 0x7ff084149c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:33.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.131+0000 7ff08b25d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff0840c8200 0x7ff08414a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:33.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.131+0000 7ff08b25d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff084150090 0x7ff0841eed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:33.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.131+0000 7ff08b25d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff08406c6b0 con 0x7ff084150090 2024-04-25T01:41:33.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.131+0000 7ff08b25d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff0840c86b0 con 0x7ff08406c280 2024-04-25T01:41:33.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.131+0000 7ff08b25d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff08406c830 con 0x7ff0840c8200 2024-04-25T01:41:33.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.131+0000 7ff083fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff0840c8200 0x7ff08414a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:33.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.131+0000 7ff0897fa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff084150090 0x7ff0841eed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:33.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.131+0000 7ff083fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff0840c8200 0x7ff08414a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.77:59726/0 (socket says 172.21.15.77:59726) 2024-04-25T01:41:33.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.131+0000 7ff083fff640 1 -- 172.21.15.77:0/451574095 learned_addr learned my addr 172.21.15.77:0/451574095 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:33.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.131+0000 7ff088ff9640 1 --2- 172.21.15.77:0/451574095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff08406c280 0x7ff084149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:33.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.131+0000 7ff083fff640 1 -- 172.21.15.77:0/451574095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff08406c280 msgr2=0x7ff084149c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:33.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.131+0000 7ff083fff640 1 --2- 172.21.15.77:0/451574095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff08406c280 0x7ff084149c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:33.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.131+0000 7ff083fff640 1 -- 172.21.15.77:0/451574095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff084150090 msgr2=0x7ff0841eed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:33.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.131+0000 7ff083fff640 1 --2- 172.21.15.77:0/451574095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff084150090 0x7ff0841eed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:33.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.131+0000 7ff083fff640 1 -- 172.21.15.77:0/451574095 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0841592d0 con 0x7ff0840c8200 2024-04-25T01:41:33.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.132+0000 7ff083fff640 1 --2- 172.21.15.77:0/451574095 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff0840c8200 0x7ff08414a140 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff07000c430 tx=0x7ff07000c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:33.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.132+0000 7ff0817fa640 1 -- 172.21.15.77:0/451574095 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff070017070 con 0x7ff0840c8200 2024-04-25T01:41:33.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.132+0000 7ff0817fa640 1 -- 172.21.15.77:0/451574095 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff070005d00 con 0x7ff0840c8200 2024-04-25T01:41:33.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.132+0000 7ff0817fa640 1 -- 172.21.15.77:0/451574095 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff070007310 con 0x7ff0840c8200 2024-04-25T01:41:33.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.132+0000 7ff08b25d640 1 -- 172.21.15.77:0/451574095 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff08415a070 con 0x7ff0840c8200 2024-04-25T01:41:33.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.132+0000 7ff08b25d640 1 -- 172.21.15.77:0/451574095 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff084150610 con 0x7ff0840c8200 2024-04-25T01:41:33.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.133+0000 7ff0817fa640 1 -- 172.21.15.77:0/451574095 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff07001a070 con 0x7ff0840c8200 2024-04-25T01:41:33.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.133+0000 7ff08b25d640 1 -- 172.21.15.77:0/451574095 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff08415a590 con 0x7ff0840c8200 2024-04-25T01:41:33.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.134+0000 7ff0817fa640 1 --2- 172.21.15.77:0/451574095 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff06806be30 0x7ff06806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:33.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.134+0000 7ff0817fa640 1 -- 172.21.15.77:0/451574095 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6723+0+0 (secure 0 0 0) 0x7ff07008a5c0 con 0x7ff0840c8200 2024-04-25T01:41:33.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.134+0000 7ff088ff9640 1 --2- 172.21.15.77:0/451574095 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff06806be30 0x7ff06806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:33.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.134+0000 7ff088ff9640 1 --2- 172.21.15.77:0/451574095 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff06806be30 0x7ff06806e2f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff078034000 tx=0x7ff07802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:33.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.142+0000 7ff0817fa640 1 -- 172.21.15.77:0/451574095 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff08415a590 con 0x7ff0840c8200 2024-04-25T01:41:33.318 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:33.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.422+0000 7ff08b25d640 1 -- 172.21.15.77:0/451574095 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff08404f500 con 0x7ff0840c8200 2024-04-25T01:41:33.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.422+0000 7ff0817fa640 1 -- 172.21.15.77:0/451574095 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6492 (secure 0 0 0) 0x7ff070058490 con 0x7ff0840c8200 2024-04-25T01:41:33.410 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:33.410 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5265,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:02.386295+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":29,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":2}]} 2024-04-25T01:41:33.410 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 17 2024-04-25T01:41:33.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.425+0000 7ff08b25d640 1 -- 172.21.15.77:0/451574095 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff06806be30 msgr2=0x7ff06806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:33.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.425+0000 7ff08b25d640 1 --2- 172.21.15.77:0/451574095 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff06806be30 0x7ff06806e2f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff078034000 tx=0x7ff07802e000 comp rx=0 tx=0).stop 2024-04-25T01:41:33.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.425+0000 7ff08b25d640 1 -- 172.21.15.77:0/451574095 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff0840c8200 msgr2=0x7ff08414a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:33.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.425+0000 7ff08b25d640 1 --2- 172.21.15.77:0/451574095 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff0840c8200 0x7ff08414a140 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff07000c430 tx=0x7ff07000c830 comp rx=0 tx=0).stop 2024-04-25T01:41:33.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.425+0000 7ff08b25d640 1 -- 172.21.15.77:0/451574095 shutdown_connections 2024-04-25T01:41:33.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.425+0000 7ff08b25d640 1 --2- 172.21.15.77:0/451574095 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff06806be30 0x7ff06806e2f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:33.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.425+0000 7ff08b25d640 1 --2- 172.21.15.77:0/451574095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff084150090 0x7ff0841eed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:33.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.425+0000 7ff08b25d640 1 --2- 172.21.15.77:0/451574095 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff0840c8200 0x7ff08414a140 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:33.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.425+0000 7ff08b25d640 1 --2- 172.21.15.77:0/451574095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff08406c280 0x7ff084149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:33.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.425+0000 7ff08b25d640 1 -- 172.21.15.77:0/451574095 >> 172.21.15.77:0/451574095 conn(0x7ff0840ad4d0 msgr2=0x7ff0840c6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:33.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.425+0000 7ff08b25d640 1 -- 172.21.15.77:0/451574095 shutdown_connections 2024-04-25T01:41:33.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.425+0000 7ff08b25d640 1 -- 172.21.15.77:0/451574095 wait complete. 2024-04-25T01:41:33.425 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-25T01:41:33.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.463+0000 7fa3013dc640 1 Processor -- start 2024-04-25T01:41:33.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.463+0000 7fa3013dc640 1 -- start start 2024-04-25T01:41:33.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.464+0000 7fa3013dc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa2fc150090 0x7fa2fc156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:33.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.464+0000 7fa3013dc640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa2fc06c280 0x7fa2fc0c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:33.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.464+0000 7fa3013dc640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2fc0c89c0 con 0x7fa2fc0c8200 2024-04-25T01:41:33.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.464+0000 7fa3013dc640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fa2fc06b830 con 0x7fa2fc150090 2024-04-25T01:41:33.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.464+0000 7fa3013dc640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fa2fc0c8ca0 con 0x7fa2fc06c280 2024-04-25T01:41:33.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.464+0000 7fa2faffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa2fc150090 0x7fa2fc156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:33.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.464+0000 7fa2fb7fe640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa2fc06c280 0x7fa2fc0c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:33.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.464+0000 7fa2faffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa2fc150090 0x7fa2fc156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:53430/0 (socket says 172.21.15.77:53430) 2024-04-25T01:41:33.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.464+0000 7fa2faffd640 1 -- 172.21.15.77:0/2533479390 learned_addr learned my addr 172.21.15.77:0/2533479390 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:33.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.465+0000 7fa2fb7fe640 1 -- 172.21.15.77:0/2533479390 >> v2:172.21.15.121:3300/0 conn(0x7fa2fc150090 msgr2=0x7fa2fc156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:33.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.465+0000 7fa2fb7fe640 1 --2- 172.21.15.77:0/2533479390 >> v2:172.21.15.121:3300/0 conn(0x7fa2fc150090 0x7fa2fc156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:33.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.465+0000 7fa2fb7fe640 1 -- 172.21.15.77:0/2533479390 >> v1:172.21.15.121:6789/0 conn(0x7fa2fc0c8200 legacy=0x7fa2fc0c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:33.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.465+0000 7fa2fb7fe640 1 -- 172.21.15.77:0/2533479390 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2fc06ba80 con 0x7fa2fc06c280 2024-04-25T01:41:33.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.465+0000 7fa2faffd640 1 --2- 172.21.15.77:0/2533479390 >> v2:172.21.15.121:3300/0 conn(0x7fa2fc150090 0x7fa2fc156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:41:33.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.465+0000 7fa2fb7fe640 1 --2- 172.21.15.77:0/2533479390 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa2fc06c280 0x7fa2fc0c6320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4009d90 tx=0x7fa2f402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b5959066063d626 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:33.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.466+0000 7fa2f9ffb640 1 -- 172.21.15.77:0/2533479390 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4007740 con 0x7fa2fc06c280 2024-04-25T01:41:33.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.466+0000 7fa2f9ffb640 1 -- 172.21.15.77:0/2533479390 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2f40078e0 con 0x7fa2fc06c280 2024-04-25T01:41:33.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.466+0000 7fa2f9ffb640 1 -- 172.21.15.77:0/2533479390 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4007cb0 con 0x7fa2fc06c280 2024-04-25T01:41:33.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.466+0000 7fa3013dc640 1 -- 172.21.15.77:0/2533479390 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa2fc06c280 msgr2=0x7fa2fc0c6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:33.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.466+0000 7fa3013dc640 1 --2- 172.21.15.77:0/2533479390 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa2fc06c280 0x7fa2fc0c6320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4009d90 tx=0x7fa2f402a660 comp rx=0 tx=0).stop 2024-04-25T01:41:33.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.466+0000 7fa3013dc640 1 -- 172.21.15.77:0/2533479390 shutdown_connections 2024-04-25T01:41:33.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.466+0000 7fa3013dc640 1 --2- 172.21.15.77:0/2533479390 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa2fc06c280 0x7fa2fc0c6320 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:33.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.466+0000 7fa3013dc640 1 --2- 172.21.15.77:0/2533479390 >> v2:172.21.15.121:3300/0 conn(0x7fa2fc150090 0x7fa2fc156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:33.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.466+0000 7fa3013dc640 1 -- 172.21.15.77:0/2533479390 >> 172.21.15.77:0/2533479390 conn(0x7fa2fc0ad4d0 msgr2=0x7fa2fc0ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:33.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.466+0000 7fa3013dc640 1 -- 172.21.15.77:0/2533479390 shutdown_connections 2024-04-25T01:41:33.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.466+0000 7fa3013dc640 1 -- 172.21.15.77:0/2533479390 wait complete. 2024-04-25T01:41:33.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.468+0000 7fa3013dc640 1 Processor -- start 2024-04-25T01:41:33.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.468+0000 7fa3013dc640 1 -- start start 2024-04-25T01:41:33.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.468+0000 7fa3013dc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2fc06c280 0x7fa2fc159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:33.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.468+0000 7fa3013dc640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa2fc0c8200 0x7fa2fc1ef2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:33.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.468+0000 7fa3013dc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2fc150090 0x7fa2fc1ef800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:33.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.468+0000 7fa3013dc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc06c6b0 con 0x7fa2fc06c280 2024-04-25T01:41:33.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.468+0000 7fa3013dc640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc0c86b0 con 0x7fa2fc150090 2024-04-25T01:41:33.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.468+0000 7fa3013dc640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fa2fc06c830 con 0x7fa2fc0c8200 2024-04-25T01:41:33.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.468+0000 7fa2faffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2fc06c280 0x7fa2fc159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:33.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.468+0000 7fa2faffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2fc06c280 0x7fa2fc159da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37158/0 (socket says 172.21.15.77:37158) 2024-04-25T01:41:33.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.468+0000 7fa2faffd640 1 -- 172.21.15.77:0/1049282588 learned_addr learned my addr 172.21.15.77:0/1049282588 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:33.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.469+0000 7fa2fa7fc640 1 --2- 172.21.15.77:0/1049282588 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa2fc0c8200 0x7fa2fc1ef2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:33.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.469+0000 7fa2fb7fe640 1 --2- 172.21.15.77:0/1049282588 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2fc150090 0x7fa2fc1ef800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:33.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.469+0000 7fa2faffd640 1 -- 172.21.15.77:0/1049282588 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa2fc0c8200 msgr2=0x7fa2fc1ef2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:33.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.469+0000 7fa2faffd640 1 --2- 172.21.15.77:0/1049282588 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa2fc0c8200 0x7fa2fc1ef2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:33.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.469+0000 7fa2faffd640 1 -- 172.21.15.77:0/1049282588 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2fc150090 msgr2=0x7fa2fc1ef800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:33.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.469+0000 7fa2faffd640 1 --2- 172.21.15.77:0/1049282588 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2fc150090 0x7fa2fc1ef800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:33.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.469+0000 7fa2faffd640 1 -- 172.21.15.77:0/1049282588 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2fc14caa0 con 0x7fa2fc06c280 2024-04-25T01:41:33.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.469+0000 7fa2fa7fc640 1 --2- 172.21.15.77:0/1049282588 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa2fc0c8200 0x7fa2fc1ef2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:41:33.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.469+0000 7fa2faffd640 1 --2- 172.21.15.77:0/1049282588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2fc06c280 0x7fa2fc159da0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec00e9b0 tx=0x7fa2ec00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:33.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.469+0000 7fa2e37fe640 1 -- 172.21.15.77:0/1049282588 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec017070 con 0x7fa2fc06c280 2024-04-25T01:41:33.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.469+0000 7fa2e37fe640 1 -- 172.21.15.77:0/1049282588 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2ec00c9a0 con 0x7fa2fc06c280 2024-04-25T01:41:33.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.469+0000 7fa2e37fe640 1 -- 172.21.15.77:0/1049282588 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec00cd50 con 0x7fa2fc06c280 2024-04-25T01:41:33.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.469+0000 7fa3013dc640 1 -- 172.21.15.77:0/1049282588 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2fc14cd40 con 0x7fa2fc06c280 2024-04-25T01:41:33.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.469+0000 7fa3013dc640 1 -- 172.21.15.77:0/1049282588 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2fc153880 con 0x7fa2fc06c280 2024-04-25T01:41:33.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.471+0000 7fa3013dc640 1 -- 172.21.15.77:0/1049282588 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2fc04f500 con 0x7fa2fc06c280 2024-04-25T01:41:33.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.471+0000 7fa2e37fe640 1 -- 172.21.15.77:0/1049282588 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa2ec01a070 con 0x7fa2fc06c280 2024-04-25T01:41:33.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.471+0000 7fa2e37fe640 1 --2- 172.21.15.77:0/1049282588 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa2e806be80 0x7fa2e806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:33.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.472+0000 7fa2e37fe640 1 -- 172.21.15.77:0/1049282588 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6723+0+0 (secure 0 0 0) 0x7fa2ec08b2b0 con 0x7fa2fc06c280 2024-04-25T01:41:33.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.472+0000 7fa2fa7fc640 1 --2- 172.21.15.77:0/1049282588 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa2e806be80 0x7fa2e806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:33.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.472+0000 7fa2fa7fc640 1 --2- 172.21.15.77:0/1049282588 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa2e806be80 0x7fa2e806e340 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc156930 tx=0x7fa2f0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:33.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.476+0000 7fa2e37fe640 1 -- 172.21.15.77:0/1049282588 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa2ec059380 con 0x7fa2fc06c280 2024-04-25T01:41:33.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.695+0000 7fa3013dc640 1 -- 172.21.15.77:0/1049282588 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa2fc06cec0 con 0x7fa2fc06c280 2024-04-25T01:41:33.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.696+0000 7fa2e37fe640 1 -- 172.21.15.77:0/1049282588 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6492 (secure 0 0 0) 0x7fa2ec05d680 con 0x7fa2fc06c280 2024-04-25T01:41:33.683 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:33.683 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5265,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:39:26.722911+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/2449150984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2449150984},{"type":"v1","addr":"172.21.15.121:6835","nonce":2449150984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1},{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:02.386295+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":29,"addr":"172.21.15.77:6835/1958322306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1958322306},{"type":"v1","addr":"172.21.15.77:6835","nonce":1958322306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":2}]} 2024-04-25T01:41:33.683 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 17 2024-04-25T01:41:33.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.698+0000 7fa3013dc640 1 -- 172.21.15.77:0/1049282588 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa2e806be80 msgr2=0x7fa2e806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:33.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.698+0000 7fa3013dc640 1 --2- 172.21.15.77:0/1049282588 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa2e806be80 0x7fa2e806e340 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc156930 tx=0x7fa2f0009040 comp rx=0 tx=0).stop 2024-04-25T01:41:33.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.698+0000 7fa3013dc640 1 -- 172.21.15.77:0/1049282588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2fc06c280 msgr2=0x7fa2fc159da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:33.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.698+0000 7fa3013dc640 1 --2- 172.21.15.77:0/1049282588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2fc06c280 0x7fa2fc159da0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec00e9b0 tx=0x7fa2ec00ee70 comp rx=0 tx=0).stop 2024-04-25T01:41:33.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.698+0000 7fa3013dc640 1 -- 172.21.15.77:0/1049282588 shutdown_connections 2024-04-25T01:41:33.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.698+0000 7fa3013dc640 1 --2- 172.21.15.77:0/1049282588 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa2e806be80 0x7fa2e806e340 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:33.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.698+0000 7fa3013dc640 1 --2- 172.21.15.77:0/1049282588 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2fc150090 0x7fa2fc1ef800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:33.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.698+0000 7fa3013dc640 1 --2- 172.21.15.77:0/1049282588 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa2fc0c8200 0x7fa2fc1ef2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:33.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.699+0000 7fa3013dc640 1 --2- 172.21.15.77:0/1049282588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2fc06c280 0x7fa2fc159da0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:33.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.699+0000 7fa3013dc640 1 -- 172.21.15.77:0/1049282588 >> 172.21.15.77:0/1049282588 conn(0x7fa2fc0ad4d0 msgr2=0x7fa2fc14f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:33.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.699+0000 7fa3013dc640 1 -- 172.21.15.77:0/1049282588 shutdown_connections 2024-04-25T01:41:33.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:33.699+0000 7fa3013dc640 1 -- 172.21.15.77:0/1049282588 wait complete. 2024-04-25T01:41:33.700 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T01:41:35.426 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:35.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.541+0000 7f3eabb77640 1 Processor -- start 2024-04-25T01:41:35.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.541+0000 7f3eabb77640 1 -- start start 2024-04-25T01:41:35.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.542+0000 7f3eabb77640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3ea4150090 0x7f3ea4156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:35.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.542+0000 7f3eabb77640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3ea40c8200 0x7f3ea40c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:35.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.542+0000 7f3eabb77640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ea40c9de0 con 0x7f3ea406c280 2024-04-25T01:41:35.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.542+0000 7f3eabb77640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f3ea406b830 con 0x7f3ea40c8200 2024-04-25T01:41:35.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.542+0000 7f3eabb77640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f3ea40c89c0 con 0x7f3ea4150090 2024-04-25T01:41:35.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.542+0000 7f3ea9112640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3ea40c8200 0x7f3ea40c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:35.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.542+0000 7f3ea9112640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3ea40c8200 0x7f3ea40c98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37170/0 (socket says 172.21.15.77:37170) 2024-04-25T01:41:35.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.542+0000 7f3eaa114640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3ea406c280 0x7f3ea40c6320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36602/0 (socket says 172.21.15.77:36602) 2024-04-25T01:41:35.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.542+0000 7f3ea9112640 1 -- 172.21.15.77:0/2142042332 learned_addr learned my addr 172.21.15.77:0/2142042332 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:35.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.542+0000 7f3ea9913640 1 --2- 172.21.15.77:0/2142042332 >> v2:172.21.15.121:3300/0 conn(0x7f3ea4150090 0x7f3ea4156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:35.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.542+0000 7f3ea9112640 1 -- 172.21.15.77:0/2142042332 >> v2:172.21.15.121:3300/0 conn(0x7f3ea4150090 msgr2=0x7f3ea4156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:35.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.542+0000 7f3ea9112640 1 --2- 172.21.15.77:0/2142042332 >> v2:172.21.15.121:3300/0 conn(0x7f3ea4150090 0x7f3ea4156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:35.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.542+0000 7f3ea9112640 1 -- 172.21.15.77:0/2142042332 >> v1:172.21.15.77:6789/0 conn(0x7f3ea406c280 legacy=0x7f3ea40c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:35.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.542+0000 7f3ea8911640 1 -- 172.21.15.77:0/2142042332 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2861707003 0 0) 0x7f3ea40c9de0 con 0x7f3ea406c280 2024-04-25T01:41:35.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.542+0000 7f3ea9112640 1 -- 172.21.15.77:0/2142042332 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ea40c8ca0 con 0x7f3ea40c8200 2024-04-25T01:41:35.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.543+0000 7f3ea9112640 1 --2- 172.21.15.77:0/2142042332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ea40c8200 0x7f3ea40c98a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3ea406b9b0 tx=0x7f3e9402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b748d2a13edeb9a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:35.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.544+0000 7f3ea8911640 1 -- 172.21.15.77:0/2142042332 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e94037070 con 0x7f3ea40c8200 2024-04-25T01:41:35.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.544+0000 7f3ea8911640 1 -- 172.21.15.77:0/2142042332 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e94032440 con 0x7f3ea40c8200 2024-04-25T01:41:35.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.544+0000 7f3ea8911640 1 -- 172.21.15.77:0/2142042332 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e94032810 con 0x7f3ea40c8200 2024-04-25T01:41:35.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.544+0000 7f3eabb77640 1 -- 172.21.15.77:0/2142042332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ea40c8200 msgr2=0x7f3ea40c98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:35.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.544+0000 7f3eabb77640 1 --2- 172.21.15.77:0/2142042332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ea40c8200 0x7f3ea40c98a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3ea406b9b0 tx=0x7f3e9402a270 comp rx=0 tx=0).stop 2024-04-25T01:41:35.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.545+0000 7f3eabb77640 1 -- 172.21.15.77:0/2142042332 shutdown_connections 2024-04-25T01:41:35.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.545+0000 7f3eabb77640 1 --2- 172.21.15.77:0/2142042332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ea40c8200 0x7f3ea40c98a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:35.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.545+0000 7f3eabb77640 1 --2- 172.21.15.77:0/2142042332 >> v2:172.21.15.121:3300/0 conn(0x7f3ea4150090 0x7f3ea4156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:35.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.545+0000 7f3eabb77640 1 -- 172.21.15.77:0/2142042332 >> 172.21.15.77:0/2142042332 conn(0x7f3ea40ad4d0 msgr2=0x7f3ea40ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:35.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.545+0000 7f3eabb77640 1 -- 172.21.15.77:0/2142042332 shutdown_connections 2024-04-25T01:41:35.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.545+0000 7f3eabb77640 1 -- 172.21.15.77:0/2142042332 wait complete. 2024-04-25T01:41:35.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.546+0000 7f3eabb77640 1 Processor -- start 2024-04-25T01:41:35.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.546+0000 7f3eabb77640 1 -- start start 2024-04-25T01:41:35.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.547+0000 7f3eabb77640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3ea406c280 0x7f3ea40c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:35.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.547+0000 7f3eabb77640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ea40c8200 0x7f3ea4159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:35.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.548+0000 7f3ea9112640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ea40c8200 0x7f3ea4159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:35.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.548+0000 7f3ea9112640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ea40c8200 0x7f3ea4159e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37184/0 (socket says 172.21.15.77:37184) 2024-04-25T01:41:35.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.548+0000 7f3eabb77640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ea4150090 0x7f3ea41eb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:35.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.548+0000 7f3ea9112640 1 -- 172.21.15.77:0/2345439773 learned_addr learned my addr 172.21.15.77:0/2345439773 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:35.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.548+0000 7f3eabb77640 1 -- 172.21.15.77:0/2345439773 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea40c86b0 con 0x7f3ea40c8200 2024-04-25T01:41:35.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.548+0000 7f3eabb77640 1 -- 172.21.15.77:0/2345439773 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea406bd60 con 0x7f3ea4150090 2024-04-25T01:41:35.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.548+0000 7f3eabb77640 1 -- 172.21.15.77:0/2345439773 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f3ea40c6a30 con 0x7f3ea406c280 2024-04-25T01:41:35.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.548+0000 7f3ea9913640 1 --2- 172.21.15.77:0/2345439773 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3ea406c280 0x7f3ea40c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:35.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.548+0000 7f3eaa114640 1 --2- 172.21.15.77:0/2345439773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ea4150090 0x7f3ea41eb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:35.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.548+0000 7f3ea9112640 1 -- 172.21.15.77:0/2345439773 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3ea406c280 msgr2=0x7f3ea40c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:35.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.548+0000 7f3ea9112640 1 --2- 172.21.15.77:0/2345439773 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3ea406c280 0x7f3ea40c4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:35.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.548+0000 7f3ea9112640 1 -- 172.21.15.77:0/2345439773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ea4150090 msgr2=0x7f3ea41eb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:35.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.548+0000 7f3ea9112640 1 --2- 172.21.15.77:0/2345439773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ea4150090 0x7f3ea41eb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:35.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.548+0000 7f3ea9112640 1 -- 172.21.15.77:0/2345439773 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ea41ef4f0 con 0x7f3ea40c8200 2024-04-25T01:41:35.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.548+0000 7f3eaa114640 1 --2- 172.21.15.77:0/2345439773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ea4150090 0x7f3ea41eb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:41:35.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.548+0000 7f3ea9112640 1 --2- 172.21.15.77:0/2345439773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ea40c8200 0x7f3ea4159e10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3e940090b0 tx=0x7f3e940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:35.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.548+0000 7f3e9a7fc640 1 -- 172.21.15.77:0/2345439773 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e94037040 con 0x7f3ea40c8200 2024-04-25T01:41:35.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.549+0000 7f3e9a7fc640 1 -- 172.21.15.77:0/2345439773 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e94004030 con 0x7f3ea40c8200 2024-04-25T01:41:35.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.549+0000 7f3eabb77640 1 -- 172.21.15.77:0/2345439773 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ea41ef7d0 con 0x7f3ea40c8200 2024-04-25T01:41:35.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.549+0000 7f3e9a7fc640 1 -- 172.21.15.77:0/2345439773 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e94004400 con 0x7f3ea40c8200 2024-04-25T01:41:35.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.549+0000 7f3eabb77640 1 -- 172.21.15.77:0/2345439773 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ea4158870 con 0x7f3ea40c8200 2024-04-25T01:41:35.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.550+0000 7f3eabb77640 1 -- 172.21.15.77:0/2345439773 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ea404f500 con 0x7f3ea40c8200 2024-04-25T01:41:35.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.550+0000 7f3e9a7fc640 1 -- 172.21.15.77:0/2345439773 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e9403a070 con 0x7f3ea40c8200 2024-04-25T01:41:35.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.551+0000 7f3e9a7fc640 1 --2- 172.21.15.77:0/2345439773 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3e8806be30 0x7f3e8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:35.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.551+0000 7f3e9a7fc640 1 -- 172.21.15.77:0/2345439773 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6895+0+0 (secure 0 0 0) 0x7f3e940ab730 con 0x7f3ea40c8200 2024-04-25T01:41:35.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.551+0000 7f3ea9913640 1 --2- 172.21.15.77:0/2345439773 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3e8806be30 0x7f3e8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:35.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.552+0000 7f3ea9913640 1 --2- 172.21.15.77:0/2345439773 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3e8806be30 0x7f3e8806e2f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0009aa0 tx=0x7f3ea0009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:35.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.556+0000 7f3e9a7fc640 1 -- 172.21.15.77:0/2345439773 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3e94041020 con 0x7f3ea40c8200 2024-04-25T01:41:35.702 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:35.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.807+0000 7f3eabb77640 1 -- 172.21.15.77:0/2345439773 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ea40ada50 con 0x7f3ea40c8200 2024-04-25T01:41:35.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.808+0000 7f3e9a7fc640 1 -- 172.21.15.77:0/2345439773 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+4836 (secure 0 0 0) 0x7f3e94079680 con 0x7f3ea40c8200 2024-04-25T01:41:35.795 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:35.795 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:41:34.396501+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":0,"incarnation":18,"state":"up:reconnect","state_seq":36,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:34.397297+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:reconnect","state_seq":9,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-25T01:41:35.795 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 19 2024-04-25T01:41:35.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.809+0000 7f3eabb77640 1 -- 172.21.15.77:0/2345439773 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3e8806be30 msgr2=0x7f3e8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:35.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.810+0000 7f3eabb77640 1 --2- 172.21.15.77:0/2345439773 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3e8806be30 0x7f3e8806e2f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0009aa0 tx=0x7f3ea0009190 comp rx=0 tx=0).stop 2024-04-25T01:41:35.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.810+0000 7f3eabb77640 1 -- 172.21.15.77:0/2345439773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ea40c8200 msgr2=0x7f3ea4159e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:35.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.810+0000 7f3eabb77640 1 --2- 172.21.15.77:0/2345439773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ea40c8200 0x7f3ea4159e10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3e940090b0 tx=0x7f3e940046c0 comp rx=0 tx=0).stop 2024-04-25T01:41:35.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.810+0000 7f3eabb77640 1 -- 172.21.15.77:0/2345439773 shutdown_connections 2024-04-25T01:41:35.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.810+0000 7f3eabb77640 1 --2- 172.21.15.77:0/2345439773 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3e8806be30 0x7f3e8806e2f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:35.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.810+0000 7f3eabb77640 1 --2- 172.21.15.77:0/2345439773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ea40c8200 0x7f3ea4159e10 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:35.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.810+0000 7f3eabb77640 1 --2- 172.21.15.77:0/2345439773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ea4150090 0x7f3ea41eb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:35.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.810+0000 7f3eabb77640 1 --2- 172.21.15.77:0/2345439773 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3ea406c280 0x7f3ea40c4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:35.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.810+0000 7f3eabb77640 1 -- 172.21.15.77:0/2345439773 >> 172.21.15.77:0/2345439773 conn(0x7f3ea40ad4d0 msgr2=0x7f3ea41544a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:35.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.810+0000 7f3eabb77640 1 -- 172.21.15.77:0/2345439773 shutdown_connections 2024-04-25T01:41:35.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.810+0000 7f3eabb77640 1 -- 172.21.15.77:0/2345439773 wait complete. 2024-04-25T01:41:35.812 INFO:tasks.mds_thrash.fs.[a]:mds.d down, removed from mdsmap 2024-04-25T01:41:35.812 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2024-04-25T01:41:35.812 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:35.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.862+0000 7fadde568640 1 Processor -- start 2024-04-25T01:41:35.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.862+0000 7fadde568640 1 -- start start 2024-04-25T01:41:35.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.863+0000 7fadde568640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fadd8151430 0x7fadd8157450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:35.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.863+0000 7fadde568640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fadd80723c0 0x7fadd80c40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:35.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.863+0000 7faddcb05640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fadd80c45f0 0x7fadd8154590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36606/0 (socket says 172.21.15.77:36606) 2024-04-25T01:41:35.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.863+0000 7faddcb05640 1 -- 172.21.15.77:0/3270529833 learned_addr learned my addr 172.21.15.77:0/3270529833 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:41:35.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.863+0000 7fadd77fe640 1 --2- 172.21.15.77:0/3270529833 >> v2:172.21.15.121:3300/0 conn(0x7fadd80723c0 0x7fadd80c40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:35.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.863+0000 7fadde568640 1 -- 172.21.15.77:0/3270529833 --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadd8157ba0 con 0x7fadd80c45f0 2024-04-25T01:41:35.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.864+0000 7fadd7fff640 1 --2- 172.21.15.77:0/3270529833 >> v2:172.21.15.77:3300/0 conn(0x7fadd8151430 0x7fadd8157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:35.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.864+0000 7fadde568640 1 -- 172.21.15.77:0/3270529833 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fadd80677c0 con 0x7fadd8151430 2024-04-25T01:41:35.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.864+0000 7fadde568640 1 -- 172.21.15.77:0/3270529833 --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fadd8154100 con 0x7fadd80723c0 2024-04-25T01:41:35.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.864+0000 7fadd6ffd640 1 -- 172.21.15.77:0/3270529833 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 871590597 0 0) 0x7fadd8157ba0 con 0x7fadd80c45f0 2024-04-25T01:41:35.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.864+0000 7fadd6ffd640 1 -- 172.21.15.77:0/3270529833 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadc0003520 con 0x7fadd80c45f0 2024-04-25T01:41:35.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.864+0000 7fadd6ffd640 1 -- 172.21.15.77:0/3270529833 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 530969768 0 0) 0x7fadc0003520 con 0x7fadd80c45f0 2024-04-25T01:41:35.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.864+0000 7fadd6ffd640 1 -- 172.21.15.77:0/3270529833 >> v2:172.21.15.121:3300/0 conn(0x7fadd80723c0 msgr2=0x7fadd80c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:35.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.864+0000 7fadd6ffd640 1 --2- 172.21.15.77:0/3270529833 >> v2:172.21.15.121:3300/0 conn(0x7fadd80723c0 0x7fadd80c40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:35.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.864+0000 7fadd6ffd640 1 -- 172.21.15.77:0/3270529833 >> v2:172.21.15.77:3300/0 conn(0x7fadd8151430 msgr2=0x7fadd8157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:35.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.864+0000 7fadd6ffd640 1 --2- 172.21.15.77:0/3270529833 >> v2:172.21.15.77:3300/0 conn(0x7fadd8151430 0x7fadd8157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:35.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.864+0000 7fadd6ffd640 1 -- 172.21.15.77:0/3270529833 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd8157e80 con 0x7fadd80c45f0 2024-04-25T01:41:35.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.864+0000 7fadd6ffd640 1 -- 172.21.15.77:0/3270529833 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7fadd00019f0 con 0x7fadd80c45f0 2024-04-25T01:41:35.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.864+0000 7fadd6ffd640 1 -- 172.21.15.77:0/3270529833 >> v1:172.21.15.77:6789/0 conn(0x7fadd80c45f0 legacy=0x7fadd8154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:35.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.864+0000 7fadd6ffd640 1 --2- 172.21.15.77:0/3270529833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadc0003a00 0x7fadc0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:35.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.864+0000 7fadd6ffd640 1 --2- 172.21.15.77:0/3270529833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadc0004800 0x7fadc0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:35.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.864+0000 7fadd6ffd640 1 --2- 172.21.15.77:0/3270529833 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fadc00051c0 0x7fadc000fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:35.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.864+0000 7fadd6ffd640 1 -- 172.21.15.77:0/3270529833 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fadd8154100 con 0x7fadc0004800 2024-04-25T01:41:35.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.864+0000 7fadd6ffd640 1 -- 172.21.15.77:0/3270529833 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fadc00103f0 con 0x7fadc0003a00 2024-04-25T01:41:35.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.864+0000 7fadd6ffd640 1 -- 172.21.15.77:0/3270529833 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fadc00105f0 con 0x7fadc00051c0 2024-04-25T01:41:35.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.865+0000 7fadd77fe640 1 --2- 172.21.15.77:0/3270529833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadc0004800 0x7fadc0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:35.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.865+0000 7fadd7fff640 1 --2- 172.21.15.77:0/3270529833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadc0003a00 0x7fadc0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:35.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.865+0000 7fadd77fe640 1 -- 172.21.15.77:0/3270529833 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fadc00051c0 msgr2=0x7fadc000fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:35.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.865+0000 7fadd77fe640 1 --2- 172.21.15.77:0/3270529833 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fadc00051c0 0x7fadc000fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:35.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.865+0000 7fadd77fe640 1 -- 172.21.15.77:0/3270529833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadc0003a00 msgr2=0x7fadc0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:35.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.865+0000 7fadd77fe640 1 --2- 172.21.15.77:0/3270529833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadc0003a00 0x7fadc0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:35.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.865+0000 7fadd77fe640 1 -- 172.21.15.77:0/3270529833 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc0003520 con 0x7fadc0004800 2024-04-25T01:41:35.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.865+0000 7faddcb05640 1 -- 172.21.15.77:0/3270529833 reap_dead start 2024-04-25T01:41:35.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.866+0000 7fadd77fe640 1 --2- 172.21.15.77:0/3270529833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadc0004800 0x7fadc0004c80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009a70 tx=0x7fadc0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa25e24ab1c39d68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:35.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.866+0000 7fadd6ffd640 1 -- 172.21.15.77:0/3270529833 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc036070 con 0x7fadc0004800 2024-04-25T01:41:35.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.866+0000 7fadd6ffd640 1 -- 172.21.15.77:0/3270529833 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadcc031400 con 0x7fadc0004800 2024-04-25T01:41:35.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.866+0000 7fadd6ffd640 1 -- 172.21.15.77:0/3270529833 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc009670 con 0x7fadc0004800 2024-04-25T01:41:35.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.867+0000 7fadde568640 1 -- 172.21.15.77:0/3270529833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadc0004800 msgr2=0x7fadc0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:35.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.867+0000 7fadde568640 1 --2- 172.21.15.77:0/3270529833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadc0004800 0x7fadc0004c80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009a70 tx=0x7fadc0005830 comp rx=0 tx=0).stop 2024-04-25T01:41:35.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.867+0000 7fadde568640 1 -- 172.21.15.77:0/3270529833 shutdown_connections 2024-04-25T01:41:35.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.867+0000 7fadde568640 1 --2- 172.21.15.77:0/3270529833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadc0004800 0x7fadc0004c80 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:35.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.867+0000 7fadde568640 1 -- 172.21.15.77:0/3270529833 >> 172.21.15.77:0/3270529833 conn(0x7fadd80aa8f0 msgr2=0x7fadd8066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:35.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.867+0000 7fadde568640 1 -- 172.21.15.77:0/3270529833 shutdown_connections 2024-04-25T01:41:35.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.867+0000 7fadde568640 1 -- 172.21.15.77:0/3270529833 wait complete. 2024-04-25T01:41:35.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.869+0000 7fadde568640 1 Processor -- start 2024-04-25T01:41:35.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.869+0000 7fadde568640 1 -- start start 2024-04-25T01:41:35.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.871+0000 7fadde568640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadc0004800 0x7fadd81e6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:35.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.871+0000 7fadde568640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadd8156640 0x7fadd8152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:35.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.871+0000 7fadde568640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fadd8156a90 0x7fadd81eab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:35.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.871+0000 7fadde568640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fadd806f7d0 con 0x7fadc0004800 2024-04-25T01:41:35.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.871+0000 7fadd7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadc0004800 0x7fadd81e6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:35.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.871+0000 7fadd77fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadd8156640 0x7fadd8152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:35.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.871+0000 7fadd77fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadd8156640 0x7fadd8152dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:53470/0 (socket says 172.21.15.77:53470) 2024-04-25T01:41:35.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.871+0000 7fadd77fe640 1 -- 172.21.15.77:0/1982548227 learned_addr learned my addr 172.21.15.77:0/1982548227 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:35.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.871+0000 7fadde568640 1 -- 172.21.15.77:0/1982548227 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fadd8151810 con 0x7fadd8156640 2024-04-25T01:41:35.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.871+0000 7fadde568640 1 -- 172.21.15.77:0/1982548227 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fadd806f950 con 0x7fadd8156a90 2024-04-25T01:41:35.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.871+0000 7faddcb05640 1 --2- 172.21.15.77:0/1982548227 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fadd8156a90 0x7fadd81eab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:35.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.871+0000 7fadd77fe640 1 -- 172.21.15.77:0/1982548227 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fadd8156a90 msgr2=0x7fadd81eab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:35.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.871+0000 7fadd77fe640 1 --2- 172.21.15.77:0/1982548227 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fadd8156a90 0x7fadd81eab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:35.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.871+0000 7fadd77fe640 1 -- 172.21.15.77:0/1982548227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadc0004800 msgr2=0x7fadd81e6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:35.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.871+0000 7fadd77fe640 1 --2- 172.21.15.77:0/1982548227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadc0004800 0x7fadd81e6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:35.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.871+0000 7fadd77fe640 1 -- 172.21.15.77:0/1982548227 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd80aeba0 con 0x7fadd8156640 2024-04-25T01:41:35.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.872+0000 7fadd77fe640 1 --2- 172.21.15.77:0/1982548227 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadd8156640 0x7fadd8152dd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fadcc034040 tx=0x7fadcc004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:35.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.872+0000 7fadd4ff9640 1 -- 172.21.15.77:0/1982548227 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc040070 con 0x7fadd8156640 2024-04-25T01:41:35.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.872+0000 7fadd4ff9640 1 -- 172.21.15.77:0/1982548227 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadcc03b660 con 0x7fadd8156640 2024-04-25T01:41:35.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.872+0000 7fadd4ff9640 1 -- 172.21.15.77:0/1982548227 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc036040 con 0x7fadd8156640 2024-04-25T01:41:35.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.872+0000 7fadde568640 1 -- 172.21.15.77:0/1982548227 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadd80aee80 con 0x7fadd8156640 2024-04-25T01:41:35.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.872+0000 7fadde568640 1 -- 172.21.15.77:0/1982548227 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadd8153310 con 0x7fadd8156640 2024-04-25T01:41:35.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.874+0000 7fadde568640 1 -- 172.21.15.77:0/1982548227 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadd80af3a0 con 0x7fadd8156640 2024-04-25T01:41:35.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.874+0000 7fadd4ff9640 1 -- 172.21.15.77:0/1982548227 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fadcc039070 con 0x7fadd8156640 2024-04-25T01:41:35.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.875+0000 7fadd4ff9640 1 --2- 172.21.15.77:0/1982548227 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fadc406be30 0x7fadc406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:35.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.875+0000 7fadd7fff640 1 --2- 172.21.15.77:0/1982548227 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fadc406be30 0x7fadc406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:35.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.876+0000 7fadd4ff9640 1 -- 172.21.15.77:0/1982548227 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6895+0+0 (secure 0 0 0) 0x7fadcc0ab6f0 con 0x7fadd8156640 2024-04-25T01:41:35.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.876+0000 7fadd7fff640 1 --2- 172.21.15.77:0/1982548227 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fadc406be30 0x7fadc406e2f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fadd8050e00 tx=0x7fadc8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:35.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.883+0000 7fadd4ff9640 1 -- 172.21.15.77:0/1982548227 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fadcc079520 con 0x7fadd8156640 2024-04-25T01:41:35.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.930+0000 7f694499e640 1 Processor -- start 2024-04-25T01:41:35.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.930+0000 7f694499e640 1 -- start start 2024-04-25T01:41:35.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.931+0000 7f694499e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6940157cc0 0x7f69400c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:35.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.931+0000 7f694499e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f69400c9f70 0x7f694006b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:35.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.931+0000 7f694499e640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69401580a0 con 0x7f69400c98a0 2024-04-25T01:41:35.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.931+0000 7f694499e640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f694015b2c0 con 0x7f6940157cc0 2024-04-25T01:41:35.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.931+0000 7f694499e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f694015a990 con 0x7f69400c9f70 2024-04-25T01:41:35.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.931+0000 7f693dd9b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f69400c9f70 0x7f694006b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:35.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.931+0000 7f693dd9b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f69400c9f70 0x7f694006b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.77:59778/0 (socket says 172.21.15.77:59778) 2024-04-25T01:41:35.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.931+0000 7f693dd9b640 1 -- 172.21.15.77:0/409542600 learned_addr learned my addr 172.21.15.77:0/409542600 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:35.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.931+0000 7f693e59c640 1 --2- 172.21.15.77:0/409542600 >> v2:172.21.15.121:3300/0 conn(0x7f6940157cc0 0x7f69400c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:35.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.932+0000 7f693dd9b640 1 -- 172.21.15.77:0/409542600 >> v2:172.21.15.121:3300/0 conn(0x7f6940157cc0 msgr2=0x7f69400c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:35.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.932+0000 7f693dd9b640 1 --2- 172.21.15.77:0/409542600 >> v2:172.21.15.121:3300/0 conn(0x7f6940157cc0 0x7f69400c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:35.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.932+0000 7f693dd9b640 1 -- 172.21.15.77:0/409542600 >> v1:172.21.15.121:6789/0 conn(0x7f69400c98a0 legacy=0x7f694006bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:35.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.932+0000 7f693dd9b640 1 -- 172.21.15.77:0/409542600 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f694015ac70 con 0x7f69400c9f70 2024-04-25T01:41:35.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.932+0000 7f693dd9b640 1 --2- 172.21.15.77:0/409542600 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f69400c9f70 0x7f694006b830 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6934009870 tx=0x7f693402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1172b70a3ed39c16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:35.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.933+0000 7f693d59a640 1 -- 172.21.15.77:0/409542600 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934037070 con 0x7f69400c9f70 2024-04-25T01:41:35.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.933+0000 7f693d59a640 1 -- 172.21.15.77:0/409542600 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6934032440 con 0x7f69400c9f70 2024-04-25T01:41:35.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.933+0000 7f693d59a640 1 -- 172.21.15.77:0/409542600 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934032810 con 0x7f69400c9f70 2024-04-25T01:41:35.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.933+0000 7f694499e640 1 -- 172.21.15.77:0/409542600 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f69400c9f70 msgr2=0x7f694006b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:35.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.933+0000 7f694499e640 1 --2- 172.21.15.77:0/409542600 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f69400c9f70 0x7f694006b830 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6934009870 tx=0x7f693402a1c0 comp rx=0 tx=0).stop 2024-04-25T01:41:35.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.934+0000 7f694499e640 1 -- 172.21.15.77:0/409542600 shutdown_connections 2024-04-25T01:41:35.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.934+0000 7f694499e640 1 --2- 172.21.15.77:0/409542600 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f69400c9f70 0x7f694006b830 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:35.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.934+0000 7f694499e640 1 --2- 172.21.15.77:0/409542600 >> v2:172.21.15.121:3300/0 conn(0x7f6940157cc0 0x7f69400c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:35.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.934+0000 7f694499e640 1 -- 172.21.15.77:0/409542600 >> 172.21.15.77:0/409542600 conn(0x7f69400ad4d0 msgr2=0x7f69400ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:35.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.934+0000 7f694499e640 1 -- 172.21.15.77:0/409542600 shutdown_connections 2024-04-25T01:41:35.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.934+0000 7f694499e640 1 -- 172.21.15.77:0/409542600 wait complete. 2024-04-25T01:41:35.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.935+0000 7f694499e640 1 Processor -- start 2024-04-25T01:41:35.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.935+0000 7f694499e640 1 -- start start 2024-04-25T01:41:35.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.936+0000 7f694499e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69400c98a0 0x7f69400c1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:35.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.936+0000 7f694499e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69400c9f70 0x7f69400c2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:35.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.936+0000 7f694499e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6940157cc0 0x7f69400c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:35.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.936+0000 7f694499e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f694015a640 con 0x7f69400c98a0 2024-04-25T01:41:35.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.936+0000 7f694499e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f694006c480 con 0x7f69400c9f70 2024-04-25T01:41:35.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.936+0000 7f693dd9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69400c9f70 0x7f69400c2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:35.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.936+0000 7f693dd9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69400c9f70 0x7f69400c2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:53488/0 (socket says 172.21.15.77:53488) 2024-04-25T01:41:35.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.936+0000 7f693dd9b640 1 -- 172.21.15.77:0/3537157058 learned_addr learned my addr 172.21.15.77:0/3537157058 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:35.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.936+0000 7f694499e640 1 -- 172.21.15.77:0/3537157058 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f69400c8c70 con 0x7f6940157cc0 2024-04-25T01:41:35.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.936+0000 7f693e59c640 1 --2- 172.21.15.77:0/3537157058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69400c98a0 0x7f69400c1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:35.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.936+0000 7f693ed9d640 1 --2- 172.21.15.77:0/3537157058 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6940157cc0 0x7f69400c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:35.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.937+0000 7f693dd9b640 1 -- 172.21.15.77:0/3537157058 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6940157cc0 msgr2=0x7f69400c2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:35.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.937+0000 7f693dd9b640 1 --2- 172.21.15.77:0/3537157058 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6940157cc0 0x7f69400c2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:35.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.937+0000 7f693dd9b640 1 -- 172.21.15.77:0/3537157058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69400c98a0 msgr2=0x7f69400c1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:35.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.937+0000 7f693dd9b640 1 --2- 172.21.15.77:0/3537157058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69400c98a0 0x7f69400c1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:35.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.937+0000 7f693dd9b640 1 -- 172.21.15.77:0/3537157058 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f694015dc90 con 0x7f69400c9f70 2024-04-25T01:41:35.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.937+0000 7f693dd9b640 1 --2- 172.21.15.77:0/3537157058 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69400c9f70 0x7f69400c2a70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6934009870 tx=0x7f69340046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:35.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.937+0000 7f692effd640 1 -- 172.21.15.77:0/3537157058 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934041070 con 0x7f69400c9f70 2024-04-25T01:41:35.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.937+0000 7f694499e640 1 -- 172.21.15.77:0/3537157058 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69400bea60 con 0x7f69400c9f70 2024-04-25T01:41:35.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.937+0000 7f694499e640 1 -- 172.21.15.77:0/3537157058 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69400c4ec0 con 0x7f69400c9f70 2024-04-25T01:41:35.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.937+0000 7f692effd640 1 -- 172.21.15.77:0/3537157058 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f693403c870 con 0x7f69400c9f70 2024-04-25T01:41:35.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.937+0000 7f692effd640 1 -- 172.21.15.77:0/3537157058 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934037040 con 0x7f69400c9f70 2024-04-25T01:41:35.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.938+0000 7f694499e640 1 -- 172.21.15.77:0/3537157058 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6924005290 con 0x7f69400c9f70 2024-04-25T01:41:35.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.938+0000 7f693ed9d640 1 --2- 172.21.15.77:0/3537157058 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6940157cc0 0x7f69400c2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:41:35.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.939+0000 7f692effd640 1 -- 172.21.15.77:0/3537157058 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6934044070 con 0x7f69400c9f70 2024-04-25T01:41:35.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.939+0000 7f692effd640 1 --2- 172.21.15.77:0/3537157058 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f692006be30 0x7f692006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:35.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.939+0000 7f692effd640 1 -- 172.21.15.77:0/3537157058 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6895+0+0 (secure 0 0 0) 0x7f69340abb70 con 0x7f69400c9f70 2024-04-25T01:41:35.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.940+0000 7f693e59c640 1 --2- 172.21.15.77:0/3537157058 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f692006be30 0x7f692006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:35.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.940+0000 7f693e59c640 1 --2- 172.21.15.77:0/3537157058 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f692006be30 0x7f692006e2f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6930009aa0 tx=0x7f6930009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:35.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:35.948+0000 7f692effd640 1 -- 172.21.15.77:0/3537157058 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6934079be0 con 0x7f69400c9f70 2024-04-25T01:41:36.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.207+0000 7fadde568640 1 -- 172.21.15.77:0/1982548227 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fadd804f500 con 0x7fadd8156640 2024-04-25T01:41:36.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.208+0000 7fadd4ff9640 1 -- 172.21.15.77:0/1982548227 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+4836 (secure 0 0 0) 0x7fadcc07d820 con 0x7fadd8156640 2024-04-25T01:41:36.195 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:36.195 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:41:34.396501+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":0,"incarnation":18,"state":"up:reconnect","state_seq":36,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:34.397297+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:reconnect","state_seq":9,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-25T01:41:36.195 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 19 2024-04-25T01:41:36.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.210+0000 7fadde568640 1 -- 172.21.15.77:0/1982548227 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fadc406be30 msgr2=0x7fadc406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:36.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.210+0000 7fadde568640 1 --2- 172.21.15.77:0/1982548227 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fadc406be30 0x7fadc406e2f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fadd8050e00 tx=0x7fadc8008040 comp rx=0 tx=0).stop 2024-04-25T01:41:36.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.210+0000 7fadde568640 1 -- 172.21.15.77:0/1982548227 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadd8156640 msgr2=0x7fadd8152dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:36.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.210+0000 7fadde568640 1 --2- 172.21.15.77:0/1982548227 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadd8156640 0x7fadd8152dd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fadcc034040 tx=0x7fadcc004730 comp rx=0 tx=0).stop 2024-04-25T01:41:36.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.210+0000 7fadde568640 1 -- 172.21.15.77:0/1982548227 shutdown_connections 2024-04-25T01:41:36.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.210+0000 7fadde568640 1 --2- 172.21.15.77:0/1982548227 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fadc406be30 0x7fadc406e2f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:36.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.210+0000 7fadde568640 1 --2- 172.21.15.77:0/1982548227 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fadd8156a90 0x7fadd81eab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:36.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.210+0000 7fadde568640 1 --2- 172.21.15.77:0/1982548227 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadd8156640 0x7fadd8152dd0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:36.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.210+0000 7fadde568640 1 --2- 172.21.15.77:0/1982548227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadc0004800 0x7fadd81e6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:36.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.210+0000 7fadde568640 1 -- 172.21.15.77:0/1982548227 >> 172.21.15.77:0/1982548227 conn(0x7fadd80aa8f0 msgr2=0x7fadd81542b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:36.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.210+0000 7fadde568640 1 -- 172.21.15.77:0/1982548227 shutdown_connections 2024-04-25T01:41:36.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.211+0000 7fadde568640 1 -- 172.21.15.77:0/1982548227 wait complete. 2024-04-25T01:41:36.213 INFO:tasks.mds_thrash.fs.[b]:mds.a down, removed from mdsmap 2024-04-25T01:41:36.213 INFO:tasks.mds_thrash.fs.[b]:waiting for mds cluster to stabilize... 2024-04-25T01:41:36.213 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:36.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.255+0000 7f694499e640 1 -- 172.21.15.77:0/3537157058 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6924005850 con 0x7f69400c9f70 2024-04-25T01:41:36.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.255+0000 7f692effd640 1 -- 172.21.15.77:0/3537157058 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+4836 (secure 0 0 0) 0x7f693407dee0 con 0x7f69400c9f70 2024-04-25T01:41:36.243 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:36.243 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:41:34.396501+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":0,"incarnation":18,"state":"up:reconnect","state_seq":36,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:34.397297+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:reconnect","state_seq":9,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-25T01:41:36.243 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 19 2024-04-25T01:41:36.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.258+0000 7f694499e640 1 -- 172.21.15.77:0/3537157058 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f692006be30 msgr2=0x7f692006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:36.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.258+0000 7f694499e640 1 --2- 172.21.15.77:0/3537157058 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f692006be30 0x7f692006e2f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6930009aa0 tx=0x7f6930009190 comp rx=0 tx=0).stop 2024-04-25T01:41:36.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.258+0000 7f694499e640 1 -- 172.21.15.77:0/3537157058 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69400c9f70 msgr2=0x7f69400c2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:36.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.258+0000 7f694499e640 1 --2- 172.21.15.77:0/3537157058 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69400c9f70 0x7f69400c2a70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6934009870 tx=0x7f69340046c0 comp rx=0 tx=0).stop 2024-04-25T01:41:36.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.258+0000 7f694499e640 1 -- 172.21.15.77:0/3537157058 shutdown_connections 2024-04-25T01:41:36.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.258+0000 7f694499e640 1 --2- 172.21.15.77:0/3537157058 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f692006be30 0x7f692006e2f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:36.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.258+0000 7f694499e640 1 --2- 172.21.15.77:0/3537157058 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6940157cc0 0x7f69400c2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:36.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.258+0000 7f694499e640 1 --2- 172.21.15.77:0/3537157058 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69400c9f70 0x7f69400c2a70 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:36.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.258+0000 7f694499e640 1 --2- 172.21.15.77:0/3537157058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69400c98a0 0x7f69400c1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:36.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.258+0000 7f694499e640 1 -- 172.21.15.77:0/3537157058 >> 172.21.15.77:0/3537157058 conn(0x7f69400ad4d0 msgr2=0x7f69400acb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:36.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.258+0000 7f694499e640 1 -- 172.21.15.77:0/3537157058 shutdown_connections 2024-04-25T01:41:36.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.258+0000 7f694499e640 1 -- 172.21.15.77:0/3537157058 wait complete. 2024-04-25T01:41:36.260 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 19, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T01:39:23.701997+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 19, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_4250": { "addr": "172.21.15.121:6834/1039950655", "addrs": { "addrvec": [ { "addr": "172.21.15.121:6832", "nonce": 1039950655, "type": "v2" }, { "addr": "172.21.15.121:6834", "nonce": 1039950655, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4250, "incarnation": 18, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:reconnect", "state_seq": 36 } }, "last_failure": 0, "last_failure_osd_epoch": 28, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-25T01:41:34.396501+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4250 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T01:39:32.761220+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 19, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_5265": { "addr": "172.21.15.77:6837/2398109146", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6836", "nonce": 2398109146, "type": "v2" }, { "addr": "172.21.15.77:6837", "nonce": 2398109146, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5265, "incarnation": 18, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:reconnect", "state_seq": 9 } }, "last_failure": 0, "last_failure_osd_epoch": 28, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-04-25T01:41:34.397297+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5265 } } } ], "standbys": [] } 2024-04-25T01:41:36.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.355+0000 7f04e1dc1640 1 Processor -- start 2024-04-25T01:41:36.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.355+0000 7f04e1dc1640 1 -- start start 2024-04-25T01:41:36.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.356+0000 7f04e1dc1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f04dc150090 0x7f04dc156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:36.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.356+0000 7f04e1dc1640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04dc0c89c0 con 0x7f04dc0c8200 2024-04-25T01:41:36.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.356+0000 7f04e1dc1640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04dc0c8ca0 con 0x7f04dc06c280 2024-04-25T01:41:36.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.356+0000 7f04e1dc1640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f04dc06b830 con 0x7f04dc150090 2024-04-25T01:41:36.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.356+0000 7f04daffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f04dc0c8200 0x7f04dc0c98a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36618/0 (socket says 172.21.15.77:36618) 2024-04-25T01:41:36.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.356+0000 7f04daffd640 1 -- 172.21.15.77:0/2129853664 learned_addr learned my addr 172.21.15.77:0/2129853664 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:41:36.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.356+0000 7f04db7fe640 1 --2- 172.21.15.77:0/2129853664 >> v2:172.21.15.77:3300/0 conn(0x7f04dc150090 0x7f04dc156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:36.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.356+0000 7f04db7fe640 1 -- 172.21.15.77:0/2129853664 >> v1:172.21.15.121:6789/0 conn(0x7f04dc06c280 legacy=0x7f04dc0c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:36.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.356+0000 7f04db7fe640 1 -- 172.21.15.77:0/2129853664 >> v1:172.21.15.77:6789/0 conn(0x7f04dc0c8200 legacy=0x7f04dc0c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:36.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.356+0000 7f04db7fe640 1 -- 172.21.15.77:0/2129853664 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04dc06ba80 con 0x7f04dc150090 2024-04-25T01:41:36.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.356+0000 7f04da7fc640 1 -- 172.21.15.77:0/2129853664 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3101962522 0 0) 0x7f04dc0c89c0 con 0x7f04dc0c8200 2024-04-25T01:41:36.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.357+0000 7f04db7fe640 1 --2- 172.21.15.77:0/2129853664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04dc150090 0x7f04dc156c80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009d90 tx=0x7f04cc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=250b6e298eadbdcb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:36.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.357+0000 7f04da7fc640 1 -- 172.21.15.77:0/2129853664 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04cc007740 con 0x7f04dc150090 2024-04-25T01:41:36.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.357+0000 7f04da7fc640 1 -- 172.21.15.77:0/2129853664 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04cc0078e0 con 0x7f04dc150090 2024-04-25T01:41:36.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.357+0000 7f04da7fc640 1 -- 172.21.15.77:0/2129853664 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04cc007cb0 con 0x7f04dc150090 2024-04-25T01:41:36.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.358+0000 7f04e1dc1640 1 -- 172.21.15.77:0/2129853664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04dc150090 msgr2=0x7f04dc156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:36.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.358+0000 7f04e1dc1640 1 --2- 172.21.15.77:0/2129853664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04dc150090 0x7f04dc156c80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009d90 tx=0x7f04cc02a6f0 comp rx=0 tx=0).stop 2024-04-25T01:41:36.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.358+0000 7f04e1dc1640 1 -- 172.21.15.77:0/2129853664 shutdown_connections 2024-04-25T01:41:36.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.358+0000 7f04e1dc1640 1 --2- 172.21.15.77:0/2129853664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04dc150090 0x7f04dc156c80 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:36.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.358+0000 7f04e1dc1640 1 -- 172.21.15.77:0/2129853664 >> 172.21.15.77:0/2129853664 conn(0x7f04dc0ad4d0 msgr2=0x7f04dc0ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:36.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.358+0000 7f04e1dc1640 1 -- 172.21.15.77:0/2129853664 shutdown_connections 2024-04-25T01:41:36.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.358+0000 7f04e1dc1640 1 -- 172.21.15.77:0/2129853664 wait complete. 2024-04-25T01:41:36.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.359+0000 7f04e1dc1640 1 Processor -- start 2024-04-25T01:41:36.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.359+0000 7f04e1dc1640 1 -- start start 2024-04-25T01:41:36.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.360+0000 7f04e1dc1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04dc06c280 0x7f04dc0b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:36.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.360+0000 7f04e1dc1640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f04dc0c8200 0x7f04dc158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:36.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.360+0000 7f04e1dc1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04dc150090 0x7f04dc1590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:36.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.360+0000 7f04e1dc1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc0c6a30 con 0x7f04dc06c280 2024-04-25T01:41:36.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.360+0000 7f04e1dc1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc0c86b0 con 0x7f04dc150090 2024-04-25T01:41:36.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.360+0000 7f04e1dc1640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f04dc0c6bb0 con 0x7f04dc0c8200 2024-04-25T01:41:36.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.360+0000 7f04db7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04dc06c280 0x7f04dc0b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:36.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.360+0000 7f04db7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04dc06c280 0x7f04dc0b01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37242/0 (socket says 172.21.15.77:37242) 2024-04-25T01:41:36.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.360+0000 7f04db7fe640 1 -- 172.21.15.77:0/3609731487 learned_addr learned my addr 172.21.15.77:0/3609731487 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:36.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.360+0000 7f04daffd640 1 --2- 172.21.15.77:0/3609731487 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f04dc0c8200 0x7f04dc158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:36.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.360+0000 7f04dbfff640 1 --2- 172.21.15.77:0/3609731487 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04dc150090 0x7f04dc1590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:36.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.360+0000 7f04db7fe640 1 -- 172.21.15.77:0/3609731487 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f04dc0c8200 msgr2=0x7f04dc158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:36.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.360+0000 7f04db7fe640 1 --2- 172.21.15.77:0/3609731487 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f04dc0c8200 0x7f04dc158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:36.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.360+0000 7f04db7fe640 1 -- 172.21.15.77:0/3609731487 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04dc150090 msgr2=0x7f04dc1590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:36.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.361+0000 7f04db7fe640 1 --2- 172.21.15.77:0/3609731487 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04dc150090 0x7f04dc1590c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:36.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.361+0000 7f04db7fe640 1 -- 172.21.15.77:0/3609731487 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04dc0b10b0 con 0x7f04dc06c280 2024-04-25T01:41:36.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.361+0000 7f04db7fe640 1 --2- 172.21.15.77:0/3609731487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04dc06c280 0x7f04dc0b01f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009d90 tx=0x7f04cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:36.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.361+0000 7f04c3fff640 1 -- 172.21.15.77:0/3609731487 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04cc040070 con 0x7f04dc06c280 2024-04-25T01:41:36.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.361+0000 7f04e1dc1640 1 -- 172.21.15.77:0/3609731487 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04dc159600 con 0x7f04dc06c280 2024-04-25T01:41:36.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.361+0000 7f04c3fff640 1 -- 172.21.15.77:0/3609731487 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04cc031d00 con 0x7f04dc06c280 2024-04-25T01:41:36.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.361+0000 7f04c3fff640 1 -- 172.21.15.77:0/3609731487 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04cc045660 con 0x7f04dc06c280 2024-04-25T01:41:36.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.361+0000 7f04e1dc1640 1 -- 172.21.15.77:0/3609731487 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04dc159db0 con 0x7f04dc06c280 2024-04-25T01:41:36.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.362+0000 7f04c1ffb640 1 -- 172.21.15.77:0/3609731487 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04b4005290 con 0x7f04dc06c280 2024-04-25T01:41:36.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.363+0000 7f04c3fff640 1 -- 172.21.15.77:0/3609731487 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f04cc039040 con 0x7f04dc06c280 2024-04-25T01:41:36.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.364+0000 7f04c3fff640 1 --2- 172.21.15.77:0/3609731487 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f04c806be30 0x7f04c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:36.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.364+0000 7f04c3fff640 1 -- 172.21.15.77:0/3609731487 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6895+0+0 (secure 0 0 0) 0x7f04cc0acbd0 con 0x7f04dc06c280 2024-04-25T01:41:36.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.364+0000 7f04daffd640 1 --2- 172.21.15.77:0/3609731487 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f04c806be30 0x7f04c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:36.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.364+0000 7f04daffd640 1 --2- 172.21.15.77:0/3609731487 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f04c806be30 0x7f04c806e2f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f04d0007f70 tx=0x7f04d0007f00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:36.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.368+0000 7f04c3fff640 1 -- 172.21.15.77:0/3609731487 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f04cc07aaa0 con 0x7f04dc06c280 2024-04-25T01:41:36.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.595+0000 7f04c1ffb640 1 -- 172.21.15.77:0/3609731487 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04b4005850 con 0x7f04dc06c280 2024-04-25T01:41:36.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.596+0000 7f04c3fff640 1 -- 172.21.15.77:0/3609731487 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+4831 (secure 0 0 0) 0x7f04cc07eda0 con 0x7f04dc06c280 2024-04-25T01:41:36.583 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:36.583 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:41:35.379011+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":0,"incarnation":18,"state":"up:rejoin","state_seq":37,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:35.379617+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:rejoin","state_seq":10,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-25T01:41:36.583 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 20 2024-04-25T01:41:36.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.598+0000 7f04c1ffb640 1 -- 172.21.15.77:0/3609731487 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f04c806be30 msgr2=0x7f04c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:36.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.598+0000 7f04c1ffb640 1 --2- 172.21.15.77:0/3609731487 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f04c806be30 0x7f04c806e2f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f04d0007f70 tx=0x7f04d0007f00 comp rx=0 tx=0).stop 2024-04-25T01:41:36.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.598+0000 7f04c1ffb640 1 -- 172.21.15.77:0/3609731487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04dc06c280 msgr2=0x7f04dc0b01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:36.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.598+0000 7f04c1ffb640 1 --2- 172.21.15.77:0/3609731487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04dc06c280 0x7f04dc0b01f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009d90 tx=0x7f04cc004a40 comp rx=0 tx=0).stop 2024-04-25T01:41:36.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.598+0000 7f04c1ffb640 1 -- 172.21.15.77:0/3609731487 shutdown_connections 2024-04-25T01:41:36.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.598+0000 7f04c1ffb640 1 --2- 172.21.15.77:0/3609731487 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f04c806be30 0x7f04c806e2f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:36.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.598+0000 7f04c1ffb640 1 --2- 172.21.15.77:0/3609731487 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04dc150090 0x7f04dc1590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:36.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.598+0000 7f04c1ffb640 1 --2- 172.21.15.77:0/3609731487 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f04dc0c8200 0x7f04dc158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:36.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.598+0000 7f04c1ffb640 1 --2- 172.21.15.77:0/3609731487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04dc06c280 0x7f04dc0b01f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:36.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.598+0000 7f04c1ffb640 1 -- 172.21.15.77:0/3609731487 >> 172.21.15.77:0/3609731487 conn(0x7f04dc0ad4d0 msgr2=0x7f04dc1547a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:36.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.598+0000 7f04c1ffb640 1 -- 172.21.15.77:0/3609731487 shutdown_connections 2024-04-25T01:41:36.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:36.598+0000 7f04c1ffb640 1 -- 172.21.15.77:0/3609731487 wait complete. 2024-04-25T01:41:36.597 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 20, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T01:39:23.701997+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 20, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_4250": { "addr": "172.21.15.121:6834/1039950655", "addrs": { "addrvec": [ { "addr": "172.21.15.121:6832", "nonce": 1039950655, "type": "v2" }, { "addr": "172.21.15.121:6834", "nonce": 1039950655, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4250, "incarnation": 18, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:rejoin", "state_seq": 37 } }, "last_failure": 0, "last_failure_osd_epoch": 28, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-25T01:41:35.379011+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4250 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T01:39:32.761220+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 20, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_5265": { "addr": "172.21.15.77:6837/2398109146", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6836", "nonce": 2398109146, "type": "v2" }, { "addr": "172.21.15.77:6837", "nonce": 2398109146, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5265, "incarnation": 18, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:rejoin", "state_seq": 10 } }, "last_failure": 0, "last_failure_osd_epoch": 28, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-04-25T01:41:35.379617+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5265 } } } ], "standbys": [] } 2024-04-25T01:41:38.209 INFO:tasks.ceph.mds.b.smithi121.stderr:2024-04-25T01:41:38.223+0000 7fc49951d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T01:41:38.261 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:38.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.380+0000 7f6ea305d640 1 Processor -- start 2024-04-25T01:41:38.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.380+0000 7f6ea305d640 1 -- start start 2024-04-25T01:41:38.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.381+0000 7f6ea305d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6e9c150090 0x7f6e9c156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:38.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.381+0000 7f6ea305d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6e9c0c8200 0x7f6e9c0c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:38.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.381+0000 7f6ea305d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6e9c06c280 0x7f6e9c0c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:38.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.381+0000 7f6ea305d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f6e9c06b830 con 0x7f6e9c06c280 2024-04-25T01:41:38.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.381+0000 7f6ea305d640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f6e9c0c9de0 con 0x7f6e9c150090 2024-04-25T01:41:38.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.381+0000 7f6ea305d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f6e9c0c89c0 con 0x7f6e9c0c8200 2024-04-25T01:41:38.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.381+0000 7f6e9bfff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6e9c0c8200 0x7f6e9c0c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:38.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.381+0000 7f6ea15fa640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6e9c06c280 0x7f6e9c0c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:38.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.381+0000 7f6ea15fa640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6e9c06c280 0x7f6e9c0c6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47640/0 (socket says 172.21.15.77:47640) 2024-04-25T01:41:38.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.381+0000 7f6e9bfff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6e9c0c8200 0x7f6e9c0c98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.77:39108/0 (socket says 172.21.15.77:39108) 2024-04-25T01:41:38.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.381+0000 7f6ea15fa640 1 -- 172.21.15.77:0/1759692159 learned_addr learned my addr 172.21.15.77:0/1759692159 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:38.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.381+0000 7f6ea0df9640 1 --2- 172.21.15.77:0/1759692159 >> v2:172.21.15.121:3300/0 conn(0x7f6e9c150090 0x7f6e9c156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:38.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.381+0000 7f6ea15fa640 1 -- 172.21.15.77:0/1759692159 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6e9c0c8200 msgr2=0x7f6e9c0c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:38.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.381+0000 7f6ea15fa640 1 --2- 172.21.15.77:0/1759692159 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6e9c0c8200 0x7f6e9c0c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:38.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.381+0000 7f6ea15fa640 1 -- 172.21.15.77:0/1759692159 >> v2:172.21.15.121:3300/0 conn(0x7f6e9c150090 msgr2=0x7f6e9c156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:38.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.381+0000 7f6ea15fa640 1 --2- 172.21.15.77:0/1759692159 >> v2:172.21.15.121:3300/0 conn(0x7f6e9c150090 0x7f6e9c156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:38.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.381+0000 7f6ea15fa640 1 -- 172.21.15.77:0/1759692159 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e9c0c8ca0 con 0x7f6e9c06c280 2024-04-25T01:41:38.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.381+0000 7f6e9bfff640 1 --2- 172.21.15.77:0/1759692159 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6e9c0c8200 0x7f6e9c0c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:41:38.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.382+0000 7f6ea15fa640 1 --2- 172.21.15.77:0/1759692159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e9c06c280 0x7f6e9c0c6320 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0ae020 tx=0x7f6e9402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dcdcfaf6ec744a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:38.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.382+0000 7f6e9b7fe640 1 -- 172.21.15.77:0/1759692159 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e94036070 con 0x7f6e9c06c280 2024-04-25T01:41:38.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.382+0000 7f6e9b7fe640 1 -- 172.21.15.77:0/1759692159 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e94031600 con 0x7f6e9c06c280 2024-04-25T01:41:38.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.382+0000 7f6e9b7fe640 1 -- 172.21.15.77:0/1759692159 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e940319d0 con 0x7f6e9c06c280 2024-04-25T01:41:38.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.383+0000 7f6ea305d640 1 -- 172.21.15.77:0/1759692159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e9c06c280 msgr2=0x7f6e9c0c6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:38.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.383+0000 7f6ea305d640 1 --2- 172.21.15.77:0/1759692159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e9c06c280 0x7f6e9c0c6320 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0ae020 tx=0x7f6e9402a6a0 comp rx=0 tx=0).stop 2024-04-25T01:41:38.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.383+0000 7f6ea305d640 1 -- 172.21.15.77:0/1759692159 shutdown_connections 2024-04-25T01:41:38.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.383+0000 7f6ea305d640 1 --2- 172.21.15.77:0/1759692159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e9c06c280 0x7f6e9c0c6320 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:38.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.383+0000 7f6ea305d640 1 --2- 172.21.15.77:0/1759692159 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6e9c0c8200 0x7f6e9c0c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:38.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.383+0000 7f6ea305d640 1 --2- 172.21.15.77:0/1759692159 >> v2:172.21.15.121:3300/0 conn(0x7f6e9c150090 0x7f6e9c156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:38.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.383+0000 7f6ea305d640 1 -- 172.21.15.77:0/1759692159 >> 172.21.15.77:0/1759692159 conn(0x7f6e9c0ad4d0 msgr2=0x7f6e9c0ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:38.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.383+0000 7f6ea305d640 1 -- 172.21.15.77:0/1759692159 shutdown_connections 2024-04-25T01:41:38.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.383+0000 7f6ea305d640 1 -- 172.21.15.77:0/1759692159 wait complete. 2024-04-25T01:41:38.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.384+0000 7f6ea305d640 1 Processor -- start 2024-04-25T01:41:38.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.384+0000 7f6ea305d640 1 -- start start 2024-04-25T01:41:38.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.385+0000 7f6ea305d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e9c06c280 0x7f6e9c1eba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:38.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.385+0000 7f6ea305d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6e9c0c8200 0x7f6e9c1ebf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:38.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.385+0000 7f6ea305d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e9c150090 0x7f6e9c0c1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:38.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.385+0000 7f6ea305d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9c0c86b0 con 0x7f6e9c06c280 2024-04-25T01:41:38.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.385+0000 7f6ea305d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9c06bd60 con 0x7f6e9c150090 2024-04-25T01:41:38.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.385+0000 7f6ea305d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f6e9c06c6d0 con 0x7f6e9c0c8200 2024-04-25T01:41:38.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.385+0000 7f6e9bfff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6e9c0c8200 0x7f6e9c1ebf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:38.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.385+0000 7f6ea15fa640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e9c150090 0x7f6e9c0c1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:38.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.385+0000 7f6ea15fa640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e9c150090 0x7f6e9c0c1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:40176/0 (socket says 172.21.15.77:40176) 2024-04-25T01:41:38.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.385+0000 7f6ea15fa640 1 -- 172.21.15.77:0/4120190593 learned_addr learned my addr 172.21.15.77:0/4120190593 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:38.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.385+0000 7f6ea0df9640 1 --2- 172.21.15.77:0/4120190593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e9c06c280 0x7f6e9c1eba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:38.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.386+0000 7f6ea15fa640 1 -- 172.21.15.77:0/4120190593 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6e9c0c8200 msgr2=0x7f6e9c1ebf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:38.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.386+0000 7f6ea15fa640 1 --2- 172.21.15.77:0/4120190593 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6e9c0c8200 0x7f6e9c1ebf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:38.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.386+0000 7f6ea15fa640 1 -- 172.21.15.77:0/4120190593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e9c06c280 msgr2=0x7f6e9c1eba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:38.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.386+0000 7f6ea15fa640 1 --2- 172.21.15.77:0/4120190593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e9c06c280 0x7f6e9c1eba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:38.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.386+0000 7f6ea15fa640 1 -- 172.21.15.77:0/4120190593 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e9c0c2b00 con 0x7f6e9c150090 2024-04-25T01:41:38.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.386+0000 7f6ea15fa640 1 --2- 172.21.15.77:0/4120190593 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e9c150090 0x7f6e9c0c1bd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6e94009f40 tx=0x7f6e94004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:38.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.386+0000 7f6e997fa640 1 -- 172.21.15.77:0/4120190593 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e94036050 con 0x7f6e9c150090 2024-04-25T01:41:38.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.386+0000 7f6e997fa640 1 -- 172.21.15.77:0/4120190593 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e94042070 con 0x7f6e9c150090 2024-04-25T01:41:38.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.386+0000 7f6e997fa640 1 -- 172.21.15.77:0/4120190593 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e94009510 con 0x7f6e9c150090 2024-04-25T01:41:38.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.386+0000 7f6ea305d640 1 -- 172.21.15.77:0/4120190593 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e9c0c3710 con 0x7f6e9c150090 2024-04-25T01:41:38.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.386+0000 7f6ea305d640 1 -- 172.21.15.77:0/4120190593 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e9c147bc0 con 0x7f6e9c150090 2024-04-25T01:41:38.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.388+0000 7f6ea305d640 1 -- 172.21.15.77:0/4120190593 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e9c14e870 con 0x7f6e9c150090 2024-04-25T01:41:38.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.388+0000 7f6e997fa640 1 -- 172.21.15.77:0/4120190593 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6e94007bf0 con 0x7f6e9c150090 2024-04-25T01:41:38.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.389+0000 7f6e997fa640 1 --2- 172.21.15.77:0/4120190593 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6e8006be30 0x7f6e8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:38.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.389+0000 7f6e997fa640 1 -- 172.21.15.77:0/4120190593 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6895+0+0 (secure 0 0 0) 0x7f6e940abfe0 con 0x7f6e9c150090 2024-04-25T01:41:38.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.389+0000 7f6ea0df9640 1 --2- 172.21.15.77:0/4120190593 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6e8006be30 0x7f6e8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:38.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.389+0000 7f6ea0df9640 1 --2- 172.21.15.77:0/4120190593 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6e8006be30 0x7f6e8006e2f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6e90009b40 tx=0x7f6e90009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:38.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.397+0000 7f6e997fa640 1 -- 172.21.15.77:0/4120190593 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6e9c14e870 con 0x7f6e9c150090 2024-04-25T01:41:38.598 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:38.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.651+0000 7f6ea305d640 1 -- 172.21.15.77:0/4120190593 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e9c04f500 con 0x7f6e9c150090 2024-04-25T01:41:38.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.652+0000 7f6e997fa640 1 -- 172.21.15.77:0/4120190593 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+4845 (secure 0 0 0) 0x7f6e9c0c2b00 con 0x7f6e9c150090 2024-04-25T01:41:38.639 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:38.639 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:41:37.377243+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":38,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4250,"qdb_cluster":[4250]},"id":1},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:37.377244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5265,"qdb_cluster":[5265]},"id":2}]} 2024-04-25T01:41:38.639 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-04-25T01:41:38.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.654+0000 7f6ea305d640 1 -- 172.21.15.77:0/4120190593 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6e8006be30 msgr2=0x7f6e8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:38.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.654+0000 7f6ea305d640 1 --2- 172.21.15.77:0/4120190593 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6e8006be30 0x7f6e8006e2f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6e90009b40 tx=0x7f6e90009190 comp rx=0 tx=0).stop 2024-04-25T01:41:38.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.654+0000 7f6ea305d640 1 -- 172.21.15.77:0/4120190593 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e9c150090 msgr2=0x7f6e9c0c1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:38.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.654+0000 7f6ea305d640 1 --2- 172.21.15.77:0/4120190593 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e9c150090 0x7f6e9c0c1bd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6e94009f40 tx=0x7f6e94004a40 comp rx=0 tx=0).stop 2024-04-25T01:41:38.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.654+0000 7f6ea305d640 1 -- 172.21.15.77:0/4120190593 shutdown_connections 2024-04-25T01:41:38.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.654+0000 7f6ea305d640 1 --2- 172.21.15.77:0/4120190593 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f6e8006be30 0x7f6e8006e2f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:38.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.654+0000 7f6ea305d640 1 --2- 172.21.15.77:0/4120190593 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e9c150090 0x7f6e9c0c1bd0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:38.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.654+0000 7f6ea305d640 1 --2- 172.21.15.77:0/4120190593 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6e9c0c8200 0x7f6e9c1ebf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:38.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.654+0000 7f6ea305d640 1 --2- 172.21.15.77:0/4120190593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e9c06c280 0x7f6e9c1eba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:38.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.654+0000 7f6ea305d640 1 -- 172.21.15.77:0/4120190593 >> 172.21.15.77:0/4120190593 conn(0x7f6e9c0ad4d0 msgr2=0x7f6e9c154af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:38.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.655+0000 7f6ea305d640 1 -- 172.21.15.77:0/4120190593 shutdown_connections 2024-04-25T01:41:38.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.659+0000 7f6ea305d640 1 -- 172.21.15.77:0/4120190593 wait complete. 2024-04-25T01:41:38.658 INFO:tasks.mds_thrash.fs.[a]:mds.b has gained rank=0, replacing gid=4290 2024-04-25T01:41:38.658 INFO:tasks.mds_thrash.fs.[a]:waiting for 0 secs before reviving mds.d 2024-04-25T01:41:38.658 INFO:tasks.mds_thrash.fs.[a]:reviving mds.d 2024-04-25T01:41:38.658 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T01:41:38.658 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T01:41:38.661 INFO:tasks.ceph.mds.d:Started 2024-04-25T01:41:38.661 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:38.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.765+0000 7fe1bb1a5640 1 Processor -- start 2024-04-25T01:41:38.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.765+0000 7fe1bb1a5640 1 -- start start 2024-04-25T01:41:38.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.767+0000 7fe1bb1a5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe1b4071ce0 0x7fe1b40c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:38.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.767+0000 7fe1bb1a5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1b40c4570 con 0x7fe1b40c74a0 2024-04-25T01:41:38.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.767+0000 7fe1b8f41640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe1b40c74a0 0x7fe1b40715d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:42016/0 (socket says 172.21.15.77:42016) 2024-04-25T01:41:38.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.767+0000 7fe1b8f41640 1 -- 172.21.15.77:0/2979485253 learned_addr learned my addr 172.21.15.77:0/2979485253 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:41:38.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.767+0000 7fe1bb1a5640 1 -- 172.21.15.77:0/2979485253 --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1b40c28a0 con 0x7fe1b40a7920 2024-04-25T01:41:38.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.767+0000 7fe1bb1a5640 1 -- 172.21.15.77:0/2979485253 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe1b40c2b80 con 0x7fe1b4071ce0 2024-04-25T01:41:38.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.767+0000 7fe1b3fff640 1 --2- 172.21.15.77:0/2979485253 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe1b4071ce0 0x7fe1b40c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:38.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.767+0000 7fe1b37fe640 1 -- 172.21.15.77:0/2979485253 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4049080723 0 0) 0x7fe1b40c4570 con 0x7fe1b40c74a0 2024-04-25T01:41:38.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.767+0000 7fe1b37fe640 1 -- 172.21.15.77:0/2979485253 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1a4003520 con 0x7fe1b40c74a0 2024-04-25T01:41:38.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.767+0000 7fe1b37fe640 1 -- 172.21.15.77:0/2979485253 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 680398626 0 0) 0x7fe1b40c28a0 con 0x7fe1b40a7920 2024-04-25T01:41:38.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.767+0000 7fe1b37fe640 1 -- 172.21.15.77:0/2979485253 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1b40c4570 con 0x7fe1b40a7920 2024-04-25T01:41:38.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.767+0000 7fe1b3fff640 1 -- 172.21.15.77:0/2979485253 >> v1:172.21.15.121:6789/0 conn(0x7fe1b40a7920 legacy=0x7fe1b4164ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:38.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.767+0000 7fe1b3fff640 1 -- 172.21.15.77:0/2979485253 >> v1:172.21.15.77:6789/0 conn(0x7fe1b40c74a0 legacy=0x7fe1b40715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:38.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.767+0000 7fe1b3fff640 1 -- 172.21.15.77:0/2979485253 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b415a690 con 0x7fe1b4071ce0 2024-04-25T01:41:38.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.768+0000 7fe1b3fff640 1 --2- 172.21.15.77:0/2979485253 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe1b4071ce0 0x7fe1b40c7880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0009800 tx=0x7fe1a002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f250f45d78764638 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:38.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.769+0000 7fe1b37fe640 1 -- 172.21.15.77:0/2979485253 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0037070 con 0x7fe1b4071ce0 2024-04-25T01:41:38.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.769+0000 7fe1b37fe640 1 -- 172.21.15.77:0/2979485253 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1a0032440 con 0x7fe1b4071ce0 2024-04-25T01:41:38.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.769+0000 7fe1b37fe640 1 -- 172.21.15.77:0/2979485253 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0032810 con 0x7fe1b4071ce0 2024-04-25T01:41:38.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.770+0000 7fe1bb1a5640 1 -- 172.21.15.77:0/2979485253 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe1b4071ce0 msgr2=0x7fe1b40c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:38.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.770+0000 7fe1bb1a5640 1 --2- 172.21.15.77:0/2979485253 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe1b4071ce0 0x7fe1b40c7880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0009800 tx=0x7fe1a002a1a0 comp rx=0 tx=0).stop 2024-04-25T01:41:38.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.770+0000 7fe1bb1a5640 1 -- 172.21.15.77:0/2979485253 shutdown_connections 2024-04-25T01:41:38.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.770+0000 7fe1bb1a5640 1 --2- 172.21.15.77:0/2979485253 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe1b4071ce0 0x7fe1b40c7880 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:38.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.770+0000 7fe1bb1a5640 1 -- 172.21.15.77:0/2979485253 >> 172.21.15.77:0/2979485253 conn(0x7fe1b40c8590 msgr2=0x7fe1b40c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:38.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.770+0000 7fe1bb1a5640 1 -- 172.21.15.77:0/2979485253 shutdown_connections 2024-04-25T01:41:38.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.770+0000 7fe1bb1a5640 1 -- 172.21.15.77:0/2979485253 wait complete. 2024-04-25T01:41:38.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.772+0000 7fe1bb1a5640 1 Processor -- start 2024-04-25T01:41:38.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.772+0000 7fe1bb1a5640 1 -- start start 2024-04-25T01:41:38.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.773+0000 7fe1bb1a5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1b4071ce0 0x7fe1b415d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:38.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.774+0000 7fe1bb1a5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe1b40a7920 0x7fe1b40a54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:38.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.774+0000 7fe1b8f41640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1b4071ce0 0x7fe1b415d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:38.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.774+0000 7fe1b8f41640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1b4071ce0 0x7fe1b415d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47662/0 (socket says 172.21.15.77:47662) 2024-04-25T01:41:38.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.774+0000 7fe1b8f41640 1 -- 172.21.15.77:0/1028064708 learned_addr learned my addr 172.21.15.77:0/1028064708 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:38.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.774+0000 7fe1b3fff640 1 --2- 172.21.15.77:0/1028064708 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe1b40a7920 0x7fe1b40a54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:38.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.774+0000 7fe1bb1a5640 1 --2- 172.21.15.77:0/1028064708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1b40c74a0 0x7fe1b41509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:38.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.774+0000 7fe1bb1a5640 1 -- 172.21.15.77:0/1028064708 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b415a340 con 0x7fe1b4071ce0 2024-04-25T01:41:38.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.774+0000 7fe1bb1a5640 1 -- 172.21.15.77:0/1028064708 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b415ac50 con 0x7fe1b40c74a0 2024-04-25T01:41:38.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.774+0000 7fe1bb1a5640 1 -- 172.21.15.77:0/1028064708 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe1b4071270 con 0x7fe1b40a7920 2024-04-25T01:41:38.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.774+0000 7fe1b9742640 1 --2- 172.21.15.77:0/1028064708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1b40c74a0 0x7fe1b41509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:38.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.775+0000 7fe1b8f41640 1 -- 172.21.15.77:0/1028064708 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe1b40a7920 msgr2=0x7fe1b40a54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:38.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.775+0000 7fe1b8f41640 1 --2- 172.21.15.77:0/1028064708 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe1b40a7920 0x7fe1b40a54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:38.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.775+0000 7fe1b8f41640 1 -- 172.21.15.77:0/1028064708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1b40c74a0 msgr2=0x7fe1b41509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:38.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.775+0000 7fe1b8f41640 1 --2- 172.21.15.77:0/1028064708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1b40c74a0 0x7fe1b41509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:38.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.775+0000 7fe1b8f41640 1 -- 172.21.15.77:0/1028064708 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b415dd10 con 0x7fe1b4071ce0 2024-04-25T01:41:38.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.775+0000 7fe1b8f41640 1 --2- 172.21.15.77:0/1028064708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1b4071ce0 0x7fe1b415d060 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe1a800c500 tx=0x7fe1a800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:38.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.775+0000 7fe1b17fa640 1 -- 172.21.15.77:0/1028064708 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a8017070 con 0x7fe1b4071ce0 2024-04-25T01:41:38.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.776+0000 7fe1b17fa640 1 -- 172.21.15.77:0/1028064708 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1a8005d00 con 0x7fe1b4071ce0 2024-04-25T01:41:38.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.776+0000 7fe1b17fa640 1 -- 172.21.15.77:0/1028064708 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a8007330 con 0x7fe1b4071ce0 2024-04-25T01:41:38.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.777+0000 7fe1bb1a5640 1 -- 172.21.15.77:0/1028064708 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1b4151ba0 con 0x7fe1b4071ce0 2024-04-25T01:41:38.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.777+0000 7fe1bb1a5640 1 -- 172.21.15.77:0/1028064708 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1b415c860 con 0x7fe1b4071ce0 2024-04-25T01:41:38.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.779+0000 7fe1b17fa640 1 -- 172.21.15.77:0/1028064708 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe1a801a070 con 0x7fe1b4071ce0 2024-04-25T01:41:38.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.779+0000 7fe1bb1a5640 1 -- 172.21.15.77:0/1028064708 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1b415c690 con 0x7fe1b4071ce0 2024-04-25T01:41:38.767 INFO:tasks.ceph.mds.d.smithi121.stdout:starting mds.d at 2024-04-25T01:41:38.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.779+0000 7fe1b17fa640 1 --2- 172.21.15.77:0/1028064708 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe19806bf00 0x7fe19806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:38.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.780+0000 7fe1b3fff640 1 --2- 172.21.15.77:0/1028064708 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe19806bf00 0x7fe19806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:38.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.780+0000 7fe1b17fa640 1 -- 172.21.15.77:0/1028064708 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6895+0+0 (secure 0 0 0) 0x7fe1a808a670 con 0x7fe1b4071ce0 2024-04-25T01:41:38.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.780+0000 7fe1b3fff640 1 --2- 172.21.15.77:0/1028064708 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe19806bf00 0x7fe19806e3c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0034000 tx=0x7fe1a002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:38.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.788+0000 7fe1b17fa640 1 -- 172.21.15.77:0/1028064708 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe1a8058660 con 0x7fe1b4071ce0 2024-04-25T01:41:38.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.836+0000 7faf52b77640 1 Processor -- start 2024-04-25T01:41:38.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.837+0000 7faf52b77640 1 -- start start 2024-04-25T01:41:38.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.838+0000 7faf52b77640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faf4c150090 0x7faf4c156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:38.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.838+0000 7faf52b77640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7faf4c06c280 0x7faf4c0c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:38.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.838+0000 7faf52b77640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf4c0c89c0 con 0x7faf4c0c8200 2024-04-25T01:41:38.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.838+0000 7faf52b77640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7faf4c06b830 con 0x7faf4c150090 2024-04-25T01:41:38.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.838+0000 7faf52b77640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7faf4c0c8ca0 con 0x7faf4c06c280 2024-04-25T01:41:38.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.838+0000 7faf4bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7faf4c0c8200 0x7faf4c0c98a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:42022/0 (socket says 172.21.15.77:42022) 2024-04-25T01:41:38.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.838+0000 7faf4bfff640 1 -- 172.21.15.77:0/2771728383 learned_addr learned my addr 172.21.15.77:0/2771728383 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:41:38.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.838+0000 7faf50913640 1 --2- 172.21.15.77:0/2771728383 >> v2:172.21.15.77:3300/0 conn(0x7faf4c150090 0x7faf4c156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:38.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.838+0000 7faf51114640 1 --2- 172.21.15.77:0/2771728383 >> v2:172.21.15.121:3300/0 conn(0x7faf4c06c280 0x7faf4c0c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:38.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.839+0000 7faf50913640 1 -- 172.21.15.77:0/2771728383 >> v2:172.21.15.121:3300/0 conn(0x7faf4c06c280 msgr2=0x7faf4c0c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:38.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.839+0000 7faf50913640 1 --2- 172.21.15.77:0/2771728383 >> v2:172.21.15.121:3300/0 conn(0x7faf4c06c280 0x7faf4c0c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:38.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.839+0000 7faf4b7fe640 1 -- 172.21.15.77:0/2771728383 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4051163998 0 0) 0x7faf4c0c89c0 con 0x7faf4c0c8200 2024-04-25T01:41:38.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.839+0000 7faf50913640 1 -- 172.21.15.77:0/2771728383 >> v1:172.21.15.77:6789/0 conn(0x7faf4c0c8200 legacy=0x7faf4c0c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:38.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.839+0000 7faf50913640 1 -- 172.21.15.77:0/2771728383 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf4c06ba80 con 0x7faf4c150090 2024-04-25T01:41:38.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.839+0000 7faf51114640 1 --2- 172.21.15.77:0/2771728383 >> v2:172.21.15.121:3300/0 conn(0x7faf4c06c280 0x7faf4c0c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:41:38.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.840+0000 7faf50913640 1 --2- 172.21.15.77:0/2771728383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf4c150090 0x7faf4c156c80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0cb860 tx=0x7faf3c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d5c7ca4b086500 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:38.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.840+0000 7faf4b7fe640 1 -- 172.21.15.77:0/2771728383 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c037070 con 0x7faf4c150090 2024-04-25T01:41:38.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.840+0000 7faf4b7fe640 1 -- 172.21.15.77:0/2771728383 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf3c032440 con 0x7faf4c150090 2024-04-25T01:41:38.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.840+0000 7faf4b7fe640 1 -- 172.21.15.77:0/2771728383 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c032810 con 0x7faf4c150090 2024-04-25T01:41:38.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.841+0000 7faf52b77640 1 -- 172.21.15.77:0/2771728383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf4c150090 msgr2=0x7faf4c156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:38.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.841+0000 7faf52b77640 1 --2- 172.21.15.77:0/2771728383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf4c150090 0x7faf4c156c80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0cb860 tx=0x7faf3c02a1a0 comp rx=0 tx=0).stop 2024-04-25T01:41:38.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.841+0000 7faf52b77640 1 -- 172.21.15.77:0/2771728383 shutdown_connections 2024-04-25T01:41:38.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.841+0000 7faf52b77640 1 --2- 172.21.15.77:0/2771728383 >> v2:172.21.15.121:3300/0 conn(0x7faf4c06c280 0x7faf4c0c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:38.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.841+0000 7faf52b77640 1 --2- 172.21.15.77:0/2771728383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf4c150090 0x7faf4c156c80 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:38.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.841+0000 7faf52b77640 1 -- 172.21.15.77:0/2771728383 >> 172.21.15.77:0/2771728383 conn(0x7faf4c0ad4d0 msgr2=0x7faf4c0ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:38.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.841+0000 7faf52b77640 1 -- 172.21.15.77:0/2771728383 shutdown_connections 2024-04-25T01:41:38.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.841+0000 7faf52b77640 1 -- 172.21.15.77:0/2771728383 wait complete. 2024-04-25T01:41:38.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.842+0000 7faf52b77640 1 Processor -- start 2024-04-25T01:41:38.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.842+0000 7faf52b77640 1 -- start start 2024-04-25T01:41:38.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.843+0000 7faf52b77640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf4c06c280 0x7faf4c159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:38.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.843+0000 7faf52b77640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faf4c0c8200 0x7faf4c0c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:38.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.843+0000 7faf52b77640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf4c150090 0x7faf4c0c2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:38.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.843+0000 7faf52b77640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faf4c06c690 con 0x7faf4c06c280 2024-04-25T01:41:38.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.843+0000 7faf52b77640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faf4c0c86b0 con 0x7faf4c150090 2024-04-25T01:41:38.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.843+0000 7faf52b77640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7faf4c06c810 con 0x7faf4c0c8200 2024-04-25T01:41:38.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.844+0000 7faf50913640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf4c06c280 0x7faf4c159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:38.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.844+0000 7faf50913640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf4c06c280 0x7faf4c159610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47680/0 (socket says 172.21.15.77:47680) 2024-04-25T01:41:38.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.844+0000 7faf50913640 1 -- 172.21.15.77:0/1780244369 learned_addr learned my addr 172.21.15.77:0/1780244369 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:38.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.844+0000 7faf4bfff640 1 --2- 172.21.15.77:0/1780244369 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faf4c0c8200 0x7faf4c0c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:38.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.844+0000 7faf51114640 1 --2- 172.21.15.77:0/1780244369 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf4c150090 0x7faf4c0c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:38.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.844+0000 7faf50913640 1 -- 172.21.15.77:0/1780244369 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faf4c0c8200 msgr2=0x7faf4c0c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:38.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.844+0000 7faf50913640 1 --2- 172.21.15.77:0/1780244369 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faf4c0c8200 0x7faf4c0c1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:38.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.844+0000 7faf50913640 1 -- 172.21.15.77:0/1780244369 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf4c150090 msgr2=0x7faf4c0c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:38.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.844+0000 7faf50913640 1 --2- 172.21.15.77:0/1780244369 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf4c150090 0x7faf4c0c2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:38.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.844+0000 7faf50913640 1 -- 172.21.15.77:0/1780244369 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf4c150570 con 0x7faf4c06c280 2024-04-25T01:41:38.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.844+0000 7faf4bfff640 1 --2- 172.21.15.77:0/1780244369 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faf4c0c8200 0x7faf4c0c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:41:38.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.844+0000 7faf50913640 1 --2- 172.21.15.77:0/1780244369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf4c06c280 0x7faf4c159610 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7faf3c035040 tx=0x7faf3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:38.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.844+0000 7faf497fa640 1 -- 172.21.15.77:0/1780244369 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c037050 con 0x7faf4c06c280 2024-04-25T01:41:38.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.844+0000 7faf497fa640 1 -- 172.21.15.77:0/1780244369 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf3c038040 con 0x7faf4c06c280 2024-04-25T01:41:38.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.844+0000 7faf497fa640 1 -- 172.21.15.77:0/1780244369 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c004450 con 0x7faf4c06c280 2024-04-25T01:41:38.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.844+0000 7faf52b77640 1 -- 172.21.15.77:0/1780244369 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf4c150be0 con 0x7faf4c06c280 2024-04-25T01:41:38.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.845+0000 7faf52b77640 1 -- 172.21.15.77:0/1780244369 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf4c1590f0 con 0x7faf4c06c280 2024-04-25T01:41:38.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.846+0000 7faf52b77640 1 -- 172.21.15.77:0/1780244369 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf4c1592f0 con 0x7faf4c06c280 2024-04-25T01:41:38.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.847+0000 7faf497fa640 1 -- 172.21.15.77:0/1780244369 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faf3c030980 con 0x7faf4c06c280 2024-04-25T01:41:38.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.847+0000 7faf497fa640 1 --2- 172.21.15.77:0/1780244369 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7faf3806be80 0x7faf3806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:38.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.847+0000 7faf4bfff640 1 --2- 172.21.15.77:0/1780244369 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7faf3806be80 0x7faf3806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:38.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.848+0000 7faf497fa640 1 -- 172.21.15.77:0/1780244369 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6895+0+0 (secure 0 0 0) 0x7faf3c0abd50 con 0x7faf4c06c280 2024-04-25T01:41:38.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.848+0000 7faf4bfff640 1 --2- 172.21.15.77:0/1780244369 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7faf3806be80 0x7faf3806e340 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0ac300 tx=0x7faf40009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:38.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:38.852+0000 7faf497fa640 1 -- 172.21.15.77:0/1780244369 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7faf4c1592f0 con 0x7faf4c06c280 2024-04-25T01:41:39.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:39.069+0000 7faf52b77640 1 -- 172.21.15.77:0/1780244369 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf4c04f500 con 0x7faf4c06c280 2024-04-25T01:41:39.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:39.069+0000 7faf497fa640 1 -- 172.21.15.77:0/1780244369 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+4845 (secure 0 0 0) 0x7faf4c150570 con 0x7faf4c06c280 2024-04-25T01:41:39.057 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:39.057 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:41:37.377243+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":38,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4250,"qdb_cluster":[4250]},"id":1},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:37.377244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5265,"qdb_cluster":[5265]},"id":2}]} 2024-04-25T01:41:39.057 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-04-25T01:41:39.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:39.071+0000 7faf52b77640 1 -- 172.21.15.77:0/1780244369 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7faf3806be80 msgr2=0x7faf3806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:39.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:39.071+0000 7faf52b77640 1 --2- 172.21.15.77:0/1780244369 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7faf3806be80 0x7faf3806e340 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0ac300 tx=0x7faf40009040 comp rx=0 tx=0).stop 2024-04-25T01:41:39.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:39.071+0000 7faf52b77640 1 -- 172.21.15.77:0/1780244369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf4c06c280 msgr2=0x7faf4c159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:39.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:39.071+0000 7faf52b77640 1 --2- 172.21.15.77:0/1780244369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf4c06c280 0x7faf4c159610 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7faf3c035040 tx=0x7faf3c0046c0 comp rx=0 tx=0).stop 2024-04-25T01:41:39.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:39.071+0000 7faf52b77640 1 -- 172.21.15.77:0/1780244369 shutdown_connections 2024-04-25T01:41:39.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:39.071+0000 7faf52b77640 1 --2- 172.21.15.77:0/1780244369 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7faf3806be80 0x7faf3806e340 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:39.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:39.072+0000 7faf52b77640 1 --2- 172.21.15.77:0/1780244369 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf4c150090 0x7faf4c0c2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:39.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:39.072+0000 7faf52b77640 1 --2- 172.21.15.77:0/1780244369 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faf4c0c8200 0x7faf4c0c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:39.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:39.072+0000 7faf52b77640 1 --2- 172.21.15.77:0/1780244369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf4c06c280 0x7faf4c159610 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:39.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:39.072+0000 7faf52b77640 1 -- 172.21.15.77:0/1780244369 >> 172.21.15.77:0/1780244369 conn(0x7faf4c0ad4d0 msgr2=0x7faf4c0c6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:39.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:39.072+0000 7faf52b77640 1 -- 172.21.15.77:0/1780244369 shutdown_connections 2024-04-25T01:41:39.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:39.072+0000 7faf52b77640 1 -- 172.21.15.77:0/1780244369 wait complete. 2024-04-25T01:41:39.070 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is in active, standby or standby-replay 2024-04-25T01:41:39.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:39.162+0000 7fe1bb1a5640 1 -- 172.21.15.77:0/1028064708 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1b41520c0 con 0x7fe1b4071ce0 2024-04-25T01:41:39.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:39.162+0000 7fe1b17fa640 1 -- 172.21.15.77:0/1028064708 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+4845 (secure 0 0 0) 0x7fe1b41520c0 con 0x7fe1b4071ce0 2024-04-25T01:41:39.150 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:39.150 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:41:37.377243+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":38,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4250,"qdb_cluster":[4250]},"id":1},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:37.377244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5265,"qdb_cluster":[5265]},"id":2}]} 2024-04-25T01:41:39.150 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-04-25T01:41:39.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:39.165+0000 7fe1bb1a5640 1 -- 172.21.15.77:0/1028064708 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe19806bf00 msgr2=0x7fe19806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:39.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:39.165+0000 7fe1bb1a5640 1 --2- 172.21.15.77:0/1028064708 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe19806bf00 0x7fe19806e3c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0034000 tx=0x7fe1a002e000 comp rx=0 tx=0).stop 2024-04-25T01:41:39.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:39.165+0000 7fe1bb1a5640 1 -- 172.21.15.77:0/1028064708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1b4071ce0 msgr2=0x7fe1b415d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:39.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:39.165+0000 7fe1bb1a5640 1 --2- 172.21.15.77:0/1028064708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1b4071ce0 0x7fe1b415d060 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe1a800c500 tx=0x7fe1a800c9c0 comp rx=0 tx=0).stop 2024-04-25T01:41:39.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:39.165+0000 7fe1bb1a5640 1 -- 172.21.15.77:0/1028064708 shutdown_connections 2024-04-25T01:41:39.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:39.165+0000 7fe1bb1a5640 1 --2- 172.21.15.77:0/1028064708 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe19806bf00 0x7fe19806e3c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:39.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:39.165+0000 7fe1bb1a5640 1 --2- 172.21.15.77:0/1028064708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1b40c74a0 0x7fe1b41509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:39.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:39.165+0000 7fe1bb1a5640 1 --2- 172.21.15.77:0/1028064708 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe1b40a7920 0x7fe1b40a54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:39.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:39.165+0000 7fe1bb1a5640 1 --2- 172.21.15.77:0/1028064708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1b4071ce0 0x7fe1b415d060 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:39.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:39.165+0000 7fe1bb1a5640 1 -- 172.21.15.77:0/1028064708 >> 172.21.15.77:0/1028064708 conn(0x7fe1b40c8590 msgr2=0x7fe1b40715d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:39.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:39.165+0000 7fe1bb1a5640 1 -- 172.21.15.77:0/1028064708 shutdown_connections 2024-04-25T01:41:39.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:39.165+0000 7fe1bb1a5640 1 -- 172.21.15.77:0/1028064708 wait complete. 2024-04-25T01:41:39.167 INFO:tasks.mds_thrash.fs.[b]:mds.c has gained rank=0, replacing gid=4275 2024-04-25T01:41:39.167 INFO:tasks.mds_thrash.fs.[b]:waiting for 1 secs before reviving mds.a 2024-04-25T01:41:40.168 INFO:tasks.mds_thrash.fs.[b]:reviving mds.a 2024-04-25T01:41:40.168 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T01:41:40.168 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T01:41:40.171 INFO:tasks.ceph.mds.a:Started 2024-04-25T01:41:40.171 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:40.254 INFO:tasks.ceph.mds.a.smithi077.stdout:starting mds.a at 2024-04-25T01:41:40.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.332+0000 7f6010d14640 1 Processor -- start 2024-04-25T01:41:40.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.332+0000 7f6010d14640 1 -- start start 2024-04-25T01:41:40.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.333+0000 7f6010d14640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f600c150090 0x7f600c156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:40.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.333+0000 7f6010d14640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f600c0c8200 0x7f600c0c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:40.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.333+0000 7f6010d14640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f600c0c9de0 con 0x7f600c06c280 2024-04-25T01:41:40.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.333+0000 7f6010d14640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f600c06b830 con 0x7f600c150090 2024-04-25T01:41:40.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.333+0000 7f6010d14640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f600c0c89c0 con 0x7f600c0c8200 2024-04-25T01:41:40.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.334+0000 7f600a59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f600c150090 0x7f600c156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:40.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.334+0000 7f600a59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f600c150090 0x7f600c156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47714/0 (socket says 172.21.15.77:47714) 2024-04-25T01:41:40.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.334+0000 7f600a59c640 1 -- 172.21.15.77:0/973870233 learned_addr learned my addr 172.21.15.77:0/973870233 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:40.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.334+0000 7f6009d9b640 1 --2- 172.21.15.77:0/973870233 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f600c0c8200 0x7f600c0c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:40.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.334+0000 7f600959a640 1 -- 172.21.15.77:0/973870233 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2251575814 0 0) 0x7f600c0c9de0 con 0x7f600c06c280 2024-04-25T01:41:40.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.334+0000 7f600a59c640 1 -- 172.21.15.77:0/973870233 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f600c0c8200 msgr2=0x7f600c0c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:40.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.334+0000 7f600a59c640 1 --2- 172.21.15.77:0/973870233 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f600c0c8200 0x7f600c0c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:40.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.334+0000 7f600a59c640 1 -- 172.21.15.77:0/973870233 >> v1:172.21.15.121:6789/0 conn(0x7f600c06c280 legacy=0x7f600c0c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:40.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.334+0000 7f600a59c640 1 -- 172.21.15.77:0/973870233 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f600c0c8ca0 con 0x7f600c150090 2024-04-25T01:41:40.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.334+0000 7f6009d9b640 1 --2- 172.21.15.77:0/973870233 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f600c0c8200 0x7f600c0c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:41:40.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.335+0000 7f600a59c640 1 --2- 172.21.15.77:0/973870233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f600c150090 0x7f600c156c80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc009870 tx=0x7f5ffc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d756b9ada2c3c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:40.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.335+0000 7f600959a640 1 -- 172.21.15.77:0/973870233 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc037070 con 0x7f600c150090 2024-04-25T01:41:40.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.335+0000 7f600959a640 1 -- 172.21.15.77:0/973870233 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ffc032440 con 0x7f600c150090 2024-04-25T01:41:40.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.335+0000 7f600959a640 1 -- 172.21.15.77:0/973870233 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc032810 con 0x7f600c150090 2024-04-25T01:41:40.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.336+0000 7f6010d14640 1 -- 172.21.15.77:0/973870233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f600c150090 msgr2=0x7f600c156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:40.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.336+0000 7f6010d14640 1 --2- 172.21.15.77:0/973870233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f600c150090 0x7f600c156c80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc009870 tx=0x7f5ffc02a270 comp rx=0 tx=0).stop 2024-04-25T01:41:40.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.336+0000 7f6010d14640 1 -- 172.21.15.77:0/973870233 shutdown_connections 2024-04-25T01:41:40.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.336+0000 7f6010d14640 1 --2- 172.21.15.77:0/973870233 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f600c0c8200 0x7f600c0c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:40.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.336+0000 7f6010d14640 1 --2- 172.21.15.77:0/973870233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f600c150090 0x7f600c156c80 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:40.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.336+0000 7f6010d14640 1 -- 172.21.15.77:0/973870233 >> 172.21.15.77:0/973870233 conn(0x7f600c0ad4d0 msgr2=0x7f600c0ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:40.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.336+0000 7f6010d14640 1 -- 172.21.15.77:0/973870233 shutdown_connections 2024-04-25T01:41:40.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.336+0000 7f6010d14640 1 -- 172.21.15.77:0/973870233 wait complete. 2024-04-25T01:41:40.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.338+0000 7f6010d14640 1 Processor -- start 2024-04-25T01:41:40.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.338+0000 7f6010d14640 1 -- start start 2024-04-25T01:41:40.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.339+0000 7f6010d14640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f600c06c280 0x7f600c1e8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:40.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.339+0000 7f6010d14640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f600c0c8200 0x7f600c1eee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:40.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.339+0000 7f6010d14640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f600c150090 0x7f600c1ef3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:40.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.339+0000 7f6010d14640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f600c0c86b0 con 0x7f600c0c8200 2024-04-25T01:41:40.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.339+0000 7f6010d14640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f600c06bd60 con 0x7f600c06c280 2024-04-25T01:41:40.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.339+0000 7f6010d14640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f600c0c6a30 con 0x7f600c150090 2024-04-25T01:41:40.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.339+0000 7f6009d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f600c0c8200 0x7f600c1eee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:40.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.339+0000 7f6009d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f600c0c8200 0x7f600c1eee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47730/0 (socket says 172.21.15.77:47730) 2024-04-25T01:41:40.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.339+0000 7f6009d9b640 1 -- 172.21.15.77:0/1821146123 learned_addr learned my addr 172.21.15.77:0/1821146123 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:40.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.340+0000 7f600ad9d640 1 --2- 172.21.15.77:0/1821146123 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f600c150090 0x7f600c1ef3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:40.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.340+0000 7f600a59c640 1 --2- 172.21.15.77:0/1821146123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f600c06c280 0x7f600c1e8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:40.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.340+0000 7f6009d9b640 1 -- 172.21.15.77:0/1821146123 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f600c150090 msgr2=0x7f600c1ef3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:40.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.340+0000 7f6009d9b640 1 --2- 172.21.15.77:0/1821146123 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f600c150090 0x7f600c1ef3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:40.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.340+0000 7f6009d9b640 1 -- 172.21.15.77:0/1821146123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f600c06c280 msgr2=0x7f600c1e8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:40.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.340+0000 7f6009d9b640 1 --2- 172.21.15.77:0/1821146123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f600c06c280 0x7f600c1e8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:40.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.340+0000 7f6009d9b640 1 -- 172.21.15.77:0/1821146123 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f600c1ef8e0 con 0x7f600c0c8200 2024-04-25T01:41:40.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.340+0000 7f6009d9b640 1 --2- 172.21.15.77:0/1821146123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f600c0c8200 0x7f600c1eee60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f600000ec10 tx=0x7f600000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:40.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.340+0000 7f5ffaffd640 1 -- 172.21.15.77:0/1821146123 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6000017070 con 0x7f600c0c8200 2024-04-25T01:41:40.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.340+0000 7f5ffaffd640 1 -- 172.21.15.77:0/1821146123 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f600000cc30 con 0x7f600c0c8200 2024-04-25T01:41:40.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.340+0000 7f5ffaffd640 1 -- 172.21.15.77:0/1821146123 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6000013470 con 0x7f600c0c8200 2024-04-25T01:41:40.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.341+0000 7f6010d14640 1 -- 172.21.15.77:0/1821146123 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f600c144f60 con 0x7f600c0c8200 2024-04-25T01:41:40.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.341+0000 7f6010d14640 1 -- 172.21.15.77:0/1821146123 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f600c14af20 con 0x7f600c0c8200 2024-04-25T01:41:40.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.342+0000 7f6010d14640 1 -- 172.21.15.77:0/1821146123 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f600c04f500 con 0x7f600c0c8200 2024-04-25T01:41:40.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.343+0000 7f5ffaffd640 1 -- 172.21.15.77:0/1821146123 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f600001a070 con 0x7f600c0c8200 2024-04-25T01:41:40.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.344+0000 7f5ffaffd640 1 --2- 172.21.15.77:0/1821146123 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5fec06be60 0x7f5fec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:40.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.344+0000 7f5ffaffd640 1 -- 172.21.15.77:0/1821146123 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6895+0+0 (secure 0 0 0) 0x7f600008b510 con 0x7f600c0c8200 2024-04-25T01:41:40.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.344+0000 7f600a59c640 1 --2- 172.21.15.77:0/1821146123 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5fec06be60 0x7f5fec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:40.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.345+0000 7f600a59c640 1 --2- 172.21.15.77:0/1821146123 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5fec06be60 0x7f5fec06e320 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc034000 tx=0x7f5ffc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:40.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.352+0000 7f5ffaffd640 1 -- 172.21.15.77:0/1821146123 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f60000593d0 con 0x7f600c0c8200 2024-04-25T01:41:40.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.789+0000 7f6010d14640 1 -- 172.21.15.77:0/1821146123 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f600c06cec0 con 0x7f600c0c8200 2024-04-25T01:41:40.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.789+0000 7f5ffaffd640 1 -- 172.21.15.77:0/1821146123 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+6488 (secure 0 0 0) 0x7f600005d6d0 con 0x7f600c0c8200 2024-04-25T01:41:40.777 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:40.777 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5439,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:41:37.377243+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":38,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4250,"qdb_cluster":[4250]},"id":1},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:37.377244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5265,"qdb_cluster":[5265]},"id":2}]} 2024-04-25T01:41:40.777 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 23 2024-04-25T01:41:40.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.792+0000 7f6010d14640 1 -- 172.21.15.77:0/1821146123 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5fec06be60 msgr2=0x7f5fec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:40.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.792+0000 7f6010d14640 1 --2- 172.21.15.77:0/1821146123 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5fec06be60 0x7f5fec06e320 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc034000 tx=0x7f5ffc02e000 comp rx=0 tx=0).stop 2024-04-25T01:41:40.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.792+0000 7f6010d14640 1 -- 172.21.15.77:0/1821146123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f600c0c8200 msgr2=0x7f600c1eee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:40.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.792+0000 7f6010d14640 1 --2- 172.21.15.77:0/1821146123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f600c0c8200 0x7f600c1eee60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f600000ec10 tx=0x7f600000c520 comp rx=0 tx=0).stop 2024-04-25T01:41:40.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.792+0000 7f6010d14640 1 -- 172.21.15.77:0/1821146123 shutdown_connections 2024-04-25T01:41:40.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.792+0000 7f6010d14640 1 --2- 172.21.15.77:0/1821146123 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5fec06be60 0x7f5fec06e320 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:40.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.792+0000 7f6010d14640 1 --2- 172.21.15.77:0/1821146123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f600c0c8200 0x7f600c1eee60 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:40.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.792+0000 7f6010d14640 1 --2- 172.21.15.77:0/1821146123 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f600c150090 0x7f600c1ef3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:40.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.792+0000 7f6010d14640 1 --2- 172.21.15.77:0/1821146123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f600c06c280 0x7f600c1e8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:40.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.792+0000 7f6010d14640 1 -- 172.21.15.77:0/1821146123 >> 172.21.15.77:0/1821146123 conn(0x7f600c0ad4d0 msgr2=0x7f600c0ad8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:40.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.793+0000 7f6010d14640 1 -- 172.21.15.77:0/1821146123 shutdown_connections 2024-04-25T01:41:40.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:40.793+0000 7f6010d14640 1 -- 172.21.15.77:0/1821146123 wait complete. 2024-04-25T01:41:40.794 INFO:tasks.mds_thrash.fs.[b]:mds.a reported in up:standby state 2024-04-25T01:41:40.794 INFO:tasks.mds_thrash.fs.[b]:waiting for 93 secs before thrashing 2024-04-25T01:41:41.071 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:41.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.184+0000 7f06f9370640 1 Processor -- start 2024-04-25T01:41:41.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.184+0000 7f06f9370640 1 -- start start 2024-04-25T01:41:41.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.185+0000 7f06f9370640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f06f4150090 0x7f06f4156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:41.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.185+0000 7f06f9370640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f06f406c280 0x7f06f40c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:41.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.185+0000 7f06f9370640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06f40c89c0 con 0x7f06f40c8200 2024-04-25T01:41:41.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.185+0000 7f06f9370640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f06f406b830 con 0x7f06f4150090 2024-04-25T01:41:41.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.185+0000 7f06f9370640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f06f40c8ca0 con 0x7f06f406c280 2024-04-25T01:41:41.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.185+0000 7f06f2ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f06f4150090 0x7f06f4156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:41.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.185+0000 7f06f2ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f06f4150090 0x7f06f4156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47734/0 (socket says 172.21.15.77:47734) 2024-04-25T01:41:41.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.185+0000 7f06f2ffd640 1 -- 172.21.15.77:0/365281410 learned_addr learned my addr 172.21.15.77:0/365281410 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:41.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.185+0000 7f06f37fe640 1 --2- 172.21.15.77:0/365281410 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f06f406c280 0x7f06f40c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:41.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.185+0000 7f06f2ffd640 1 -- 172.21.15.77:0/365281410 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f06f406c280 msgr2=0x7f06f40c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:41.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.185+0000 7f06f2ffd640 1 --2- 172.21.15.77:0/365281410 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f06f406c280 0x7f06f40c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:41.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.186+0000 7f06f2ffd640 1 -- 172.21.15.77:0/365281410 >> v1:172.21.15.121:6789/0 conn(0x7f06f40c8200 legacy=0x7f06f40c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:41.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.186+0000 7f06f2ffd640 1 -- 172.21.15.77:0/365281410 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f406ba80 con 0x7f06f4150090 2024-04-25T01:41:41.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.186+0000 7f06f37fe640 1 --2- 172.21.15.77:0/365281410 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f06f406c280 0x7f06f40c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:41:41.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.187+0000 7f06f2ffd640 1 --2- 172.21.15.77:0/365281410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06f4150090 0x7f06f4156c80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009870 tx=0x7f06e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d943b78c74829e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:41.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.187+0000 7f06f1ffb640 1 -- 172.21.15.77:0/365281410 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e4037070 con 0x7f06f4150090 2024-04-25T01:41:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.187+0000 7f06f1ffb640 1 -- 172.21.15.77:0/365281410 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e4032440 con 0x7f06f4150090 2024-04-25T01:41:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.187+0000 7f06f1ffb640 1 -- 172.21.15.77:0/365281410 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e4032810 con 0x7f06f4150090 2024-04-25T01:41:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.187+0000 7f06f9370640 1 -- 172.21.15.77:0/365281410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06f4150090 msgr2=0x7f06f4156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.187+0000 7f06f9370640 1 --2- 172.21.15.77:0/365281410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06f4150090 0x7f06f4156c80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009870 tx=0x7f06e402a270 comp rx=0 tx=0).stop 2024-04-25T01:41:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.187+0000 7f06f9370640 1 -- 172.21.15.77:0/365281410 shutdown_connections 2024-04-25T01:41:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.187+0000 7f06f9370640 1 --2- 172.21.15.77:0/365281410 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f06f406c280 0x7f06f40c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.187+0000 7f06f9370640 1 --2- 172.21.15.77:0/365281410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06f4150090 0x7f06f4156c80 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.187+0000 7f06f9370640 1 -- 172.21.15.77:0/365281410 >> 172.21.15.77:0/365281410 conn(0x7f06f40ad4d0 msgr2=0x7f06f40ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.188+0000 7f06f9370640 1 -- 172.21.15.77:0/365281410 shutdown_connections 2024-04-25T01:41:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.188+0000 7f06f9370640 1 -- 172.21.15.77:0/365281410 wait complete. 2024-04-25T01:41:41.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.189+0000 7f06f9370640 1 Processor -- start 2024-04-25T01:41:41.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.189+0000 7f06f9370640 1 -- start start 2024-04-25T01:41:41.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.189+0000 7f06f9370640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06f406c280 0x7f06f41e8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:41.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.189+0000 7f06f9370640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06f40c8200 0x7f06f40c0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:41.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.189+0000 7f06f9370640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f06f4150090 0x7f06f40c06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:41.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.189+0000 7f06f9370640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f06f406c6b0 con 0x7f06f40c8200 2024-04-25T01:41:41.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.190+0000 7f06f9370640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f06f40c86b0 con 0x7f06f406c280 2024-04-25T01:41:41.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.190+0000 7f06f9370640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f06f406c830 con 0x7f06f4150090 2024-04-25T01:41:41.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.190+0000 7f06f27fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06f40c8200 0x7f06f40c0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:41.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.190+0000 7f06f37fe640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f06f4150090 0x7f06f40c06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:41.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.190+0000 7f06f2ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06f406c280 0x7f06f41e8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:41.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.190+0000 7f06f37fe640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f06f4150090 0x7f06f40c06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.77:39200/0 (socket says 172.21.15.77:39200) 2024-04-25T01:41:41.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.190+0000 7f06f37fe640 1 -- 172.21.15.77:0/2016171067 learned_addr learned my addr 172.21.15.77:0/2016171067 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:41.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.190+0000 7f06f27fc640 1 -- 172.21.15.77:0/2016171067 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f06f4150090 msgr2=0x7f06f40c06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:41.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.190+0000 7f06f27fc640 1 --2- 172.21.15.77:0/2016171067 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f06f4150090 0x7f06f40c06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:41.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.190+0000 7f06f27fc640 1 -- 172.21.15.77:0/2016171067 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06f406c280 msgr2=0x7f06f41e8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:41.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.190+0000 7f06f27fc640 1 --2- 172.21.15.77:0/2016171067 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06f406c280 0x7f06f41e8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:41.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.190+0000 7f06f27fc640 1 -- 172.21.15.77:0/2016171067 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f40bfac0 con 0x7f06f40c8200 2024-04-25T01:41:41.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.190+0000 7f06f2ffd640 1 --2- 172.21.15.77:0/2016171067 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06f406c280 0x7f06f41e8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:41:41.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.190+0000 7f06f37fe640 1 --2- 172.21.15.77:0/2016171067 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f06f4150090 0x7f06f40c06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:41:41.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.190+0000 7f06f27fc640 1 --2- 172.21.15.77:0/2016171067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06f40c8200 0x7f06f40c0180 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f06e800c390 tx=0x7f06e800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:41.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.191+0000 7f06db7fe640 1 -- 172.21.15.77:0/2016171067 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e8017070 con 0x7f06f40c8200 2024-04-25T01:41:41.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.191+0000 7f06db7fe640 1 -- 172.21.15.77:0/2016171067 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e80052d0 con 0x7f06f40c8200 2024-04-25T01:41:41.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.191+0000 7f06f9370640 1 -- 172.21.15.77:0/2016171067 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f4157700 con 0x7f06f40c8200 2024-04-25T01:41:41.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.191+0000 7f06f9370640 1 -- 172.21.15.77:0/2016171067 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f41ebdb0 con 0x7f06f40c8200 2024-04-25T01:41:41.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.191+0000 7f06db7fe640 1 -- 172.21.15.77:0/2016171067 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e8003830 con 0x7f06f40c8200 2024-04-25T01:41:41.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.193+0000 7f06db7fe640 1 -- 172.21.15.77:0/2016171067 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f06e801a070 con 0x7f06f40c8200 2024-04-25T01:41:41.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.193+0000 7f06f9370640 1 -- 172.21.15.77:0/2016171067 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06f404f500 con 0x7f06f40c8200 2024-04-25T01:41:41.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.193+0000 7f06db7fe640 1 --2- 172.21.15.77:0/2016171067 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f06e006be60 0x7f06e006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:41.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.193+0000 7f06db7fe640 1 -- 172.21.15.77:0/2016171067 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6895+0+0 (secure 0 0 0) 0x7f06e808a270 con 0x7f06f40c8200 2024-04-25T01:41:41.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.193+0000 7f06f2ffd640 1 --2- 172.21.15.77:0/2016171067 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f06e006be60 0x7f06e006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:41.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.194+0000 7f06f2ffd640 1 --2- 172.21.15.77:0/2016171067 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f06e006be60 0x7f06e006e320 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f06e4034000 tx=0x7f06e402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:41.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.198+0000 7f06db7fe640 1 -- 172.21.15.77:0/2016171067 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f06e8058130 con 0x7f06f40c8200 2024-04-25T01:41:41.396 INFO:tasks.ceph.mds.c.smithi077.stderr:2024-04-25T01:41:41.408+0000 7fd985ae9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T01:41:41.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.421+0000 7f06f9370640 1 -- 172.21.15.77:0/2016171067 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06f40acd70 con 0x7f06f40c8200 2024-04-25T01:41:41.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.421+0000 7f06db7fe640 1 -- 172.21.15.77:0/2016171067 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+6488 (secure 0 0 0) 0x7f06e805c430 con 0x7f06f40c8200 2024-04-25T01:41:41.409 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:41.409 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5439,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:41:37.377243+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":38,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4250,"qdb_cluster":[4250]},"id":1},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:37.377244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5265,"qdb_cluster":[5265]},"id":2}]} 2024-04-25T01:41:41.409 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 23 2024-04-25T01:41:41.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.424+0000 7f06f9370640 1 -- 172.21.15.77:0/2016171067 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f06e006be60 msgr2=0x7f06e006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:41.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.424+0000 7f06f9370640 1 --2- 172.21.15.77:0/2016171067 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f06e006be60 0x7f06e006e320 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f06e4034000 tx=0x7f06e402e000 comp rx=0 tx=0).stop 2024-04-25T01:41:41.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.424+0000 7f06f9370640 1 -- 172.21.15.77:0/2016171067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06f40c8200 msgr2=0x7f06f40c0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:41.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.424+0000 7f06f9370640 1 --2- 172.21.15.77:0/2016171067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06f40c8200 0x7f06f40c0180 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f06e800c390 tx=0x7f06e800c850 comp rx=0 tx=0).stop 2024-04-25T01:41:41.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.424+0000 7f06f9370640 1 -- 172.21.15.77:0/2016171067 shutdown_connections 2024-04-25T01:41:41.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.424+0000 7f06f9370640 1 --2- 172.21.15.77:0/2016171067 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f06e006be60 0x7f06e006e320 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:41.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.424+0000 7f06f9370640 1 --2- 172.21.15.77:0/2016171067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06f40c8200 0x7f06f40c0180 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:41.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.424+0000 7f06f9370640 1 --2- 172.21.15.77:0/2016171067 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f06f4150090 0x7f06f40c06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:41.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.424+0000 7f06f9370640 1 --2- 172.21.15.77:0/2016171067 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06f406c280 0x7f06f41e8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:41.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.424+0000 7f06f9370640 1 -- 172.21.15.77:0/2016171067 >> 172.21.15.77:0/2016171067 conn(0x7f06f40ad4d0 msgr2=0x7f06f414f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:41.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.424+0000 7f06f9370640 1 -- 172.21.15.77:0/2016171067 shutdown_connections 2024-04-25T01:41:41.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:41.424+0000 7f06f9370640 1 -- 172.21.15.77:0/2016171067 wait complete. 2024-04-25T01:41:41.427 INFO:tasks.mds_thrash.fs.[a]:mds.d reported in up:standby state 2024-04-25T01:41:41.427 INFO:tasks.mds_thrash.fs.[a]:waiting for 6 secs before thrashing 2024-04-25T01:41:43.355 INFO:tasks.workunit.client.1.smithi121.stderr:Note: switching to 'd2c45d977142e024a59b68a8f1dce8f0b9840551'. 2024-04-25T01:41:43.355 INFO:tasks.workunit.client.1.smithi121.stderr: 2024-04-25T01:41:43.355 INFO:tasks.workunit.client.1.smithi121.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-25T01:41:43.355 INFO:tasks.workunit.client.1.smithi121.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-25T01:41:43.355 INFO:tasks.workunit.client.1.smithi121.stderr:state without impacting any branches by switching back to a branch. 2024-04-25T01:41:43.355 INFO:tasks.workunit.client.1.smithi121.stderr: 2024-04-25T01:41:43.355 INFO:tasks.workunit.client.1.smithi121.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-25T01:41:43.355 INFO:tasks.workunit.client.1.smithi121.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-25T01:41:43.355 INFO:tasks.workunit.client.1.smithi121.stderr: 2024-04-25T01:41:43.355 INFO:tasks.workunit.client.1.smithi121.stderr: git switch -c 2024-04-25T01:41:43.355 INFO:tasks.workunit.client.1.smithi121.stderr: 2024-04-25T01:41:43.355 INFO:tasks.workunit.client.1.smithi121.stderr:Or undo this operation with: 2024-04-25T01:41:43.355 INFO:tasks.workunit.client.1.smithi121.stderr: 2024-04-25T01:41:43.356 INFO:tasks.workunit.client.1.smithi121.stderr: git switch - 2024-04-25T01:41:43.356 INFO:tasks.workunit.client.1.smithi121.stderr: 2024-04-25T01:41:43.356 INFO:tasks.workunit.client.1.smithi121.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-25T01:41:43.356 INFO:tasks.workunit.client.1.smithi121.stderr: 2024-04-25T01:41:43.356 INFO:tasks.workunit.client.1.smithi121.stderr:HEAD is now at d2c45d97714 Merge pull request #56528 from adk3798/squid-mypy-bump 2024-04-25T01:41:43.358 DEBUG:teuthology.orchestra.run.smithi121:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-04-25T01:41:43.472 INFO:tasks.workunit.client.1.smithi121.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-25T01:41:43.474 INFO:tasks.workunit.client.1.smithi121.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-25T01:41:43.474 INFO:tasks.workunit.client.1.smithi121.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-25T01:41:44.012 INFO:tasks.workunit.client.1.smithi121.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-25T01:41:44.066 INFO:tasks.workunit.client.1.smithi121.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-25T01:41:44.106 INFO:tasks.workunit.client.1.smithi121.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-25T01:41:44.107 INFO:tasks.workunit.client.1.smithi121.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-25T01:41:44.107 INFO:tasks.workunit.client.1.smithi121.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-25T01:41:44.145 INFO:tasks.workunit.client.1.smithi121.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-25T01:41:44.148 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-25T01:41:44.148 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-04-25T01:41:44.164 INFO:tasks.workunit:Running workunits matching suites/iozone.sh on client.1... 2024-04-25T01:41:44.165 INFO:tasks.workunit:Running workunit suites/iozone.sh... 2024-04-25T01:41:44.165 DEBUG:teuthology.orchestra.run.smithi121:workunit test suites/iozone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2c45d977142e024a59b68a8f1dce8f0b9840551 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/iozone.sh 2024-04-25T01:41:44.223 INFO:tasks.workunit.client.1.smithi121.stderr:+ iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-04-25T01:41:44.295 INFO:tasks.workunit.client.1.smithi121.stdout: Iozone: Performance Test of File I/O 2024-04-25T01:41:44.295 INFO:tasks.workunit.client.1.smithi121.stdout: Version $Revision: 3.494 $ 2024-04-25T01:41:44.295 INFO:tasks.workunit.client.1.smithi121.stdout: Compiled for 64 bit mode. 2024-04-25T01:41:44.295 INFO:tasks.workunit.client.1.smithi121.stdout: Build: linux-AMD64 2024-04-25T01:41:44.295 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:41:44.295 INFO:tasks.workunit.client.1.smithi121.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-04-25T01:41:44.295 INFO:tasks.workunit.client.1.smithi121.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-04-25T01:41:44.295 INFO:tasks.workunit.client.1.smithi121.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-04-25T01:41:44.295 INFO:tasks.workunit.client.1.smithi121.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-04-25T01:41:44.296 INFO:tasks.workunit.client.1.smithi121.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-04-25T01:41:44.296 INFO:tasks.workunit.client.1.smithi121.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-04-25T01:41:44.296 INFO:tasks.workunit.client.1.smithi121.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-04-25T01:41:44.296 INFO:tasks.workunit.client.1.smithi121.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-04-25T01:41:44.296 INFO:tasks.workunit.client.1.smithi121.stdout: Alexey Skidanov, Sudhir Kumar. 2024-04-25T01:41:44.296 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:41:44.296 INFO:tasks.workunit.client.1.smithi121.stdout: Run began: Thu Apr 25 01:41:44 2024 2024-04-25T01:41:44.296 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:41:44.296 INFO:tasks.workunit.client.1.smithi121.stdout: Include close in write timing 2024-04-25T01:41:44.296 INFO:tasks.workunit.client.1.smithi121.stdout: Include fsync in write timing 2024-04-25T01:41:44.296 INFO:tasks.workunit.client.1.smithi121.stdout: File size set to 1048576 kB 2024-04-25T01:41:44.296 INFO:tasks.workunit.client.1.smithi121.stdout: Record Size 16 kB 2024-04-25T01:41:44.296 INFO:tasks.workunit.client.1.smithi121.stdout: Command line used: iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-04-25T01:41:44.296 INFO:tasks.workunit.client.1.smithi121.stdout: Output is in kBytes/sec 2024-04-25T01:41:44.297 INFO:tasks.workunit.client.1.smithi121.stdout: Time Resolution = 0.000001 seconds. 2024-04-25T01:41:44.297 INFO:tasks.workunit.client.1.smithi121.stdout: Processor cache size set to 1024 kBytes. 2024-04-25T01:41:44.297 INFO:tasks.workunit.client.1.smithi121.stdout: Processor cache line size set to 32 bytes. 2024-04-25T01:41:44.297 INFO:tasks.workunit.client.1.smithi121.stdout: File stride size set to 17 * record size. 2024-04-25T01:41:44.297 INFO:tasks.workunit.client.1.smithi121.stdout: Throughput test with 1 process 2024-04-25T01:41:44.297 INFO:tasks.workunit.client.1.smithi121.stdout: Each process writes a 1048576 kByte file in 16 kByte records 2024-04-25T01:41:45.301 INFO:tasks.workunit.client.0.smithi077.stderr:Note: switching to 'd2c45d977142e024a59b68a8f1dce8f0b9840551'. 2024-04-25T01:41:45.301 INFO:tasks.workunit.client.0.smithi077.stderr: 2024-04-25T01:41:45.301 INFO:tasks.workunit.client.0.smithi077.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-25T01:41:45.301 INFO:tasks.workunit.client.0.smithi077.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-25T01:41:45.301 INFO:tasks.workunit.client.0.smithi077.stderr:state without impacting any branches by switching back to a branch. 2024-04-25T01:41:45.301 INFO:tasks.workunit.client.0.smithi077.stderr: 2024-04-25T01:41:45.301 INFO:tasks.workunit.client.0.smithi077.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-25T01:41:45.301 INFO:tasks.workunit.client.0.smithi077.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-25T01:41:45.302 INFO:tasks.workunit.client.0.smithi077.stderr: 2024-04-25T01:41:45.302 INFO:tasks.workunit.client.0.smithi077.stderr: git switch -c 2024-04-25T01:41:45.302 INFO:tasks.workunit.client.0.smithi077.stderr: 2024-04-25T01:41:45.302 INFO:tasks.workunit.client.0.smithi077.stderr:Or undo this operation with: 2024-04-25T01:41:45.302 INFO:tasks.workunit.client.0.smithi077.stderr: 2024-04-25T01:41:45.302 INFO:tasks.workunit.client.0.smithi077.stderr: git switch - 2024-04-25T01:41:45.302 INFO:tasks.workunit.client.0.smithi077.stderr: 2024-04-25T01:41:45.302 INFO:tasks.workunit.client.0.smithi077.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-25T01:41:45.302 INFO:tasks.workunit.client.0.smithi077.stderr: 2024-04-25T01:41:45.302 INFO:tasks.workunit.client.0.smithi077.stderr:HEAD is now at d2c45d97714 Merge pull request #56528 from adk3798/squid-mypy-bump 2024-04-25T01:41:45.306 DEBUG:teuthology.orchestra.run.smithi077:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-25T01:41:45.339 INFO:tasks.workunit.client.0.smithi077.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-25T01:41:45.345 INFO:tasks.workunit.client.0.smithi077.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T01:41:45.346 INFO:tasks.workunit.client.0.smithi077.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-25T01:41:45.954 INFO:tasks.workunit.client.0.smithi077.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-25T01:41:45.959 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:41:45.959 INFO:tasks.workunit.client.1.smithi121.stdout: Children see throughput for 1 initial writers = 630680.69 kB/sec 2024-04-25T01:41:45.959 INFO:tasks.workunit.client.1.smithi121.stdout: Parent sees throughput for 1 initial writers = 630619.18 kB/sec 2024-04-25T01:41:45.960 INFO:tasks.workunit.client.1.smithi121.stdout: Min throughput per process = 630680.69 kB/sec 2024-04-25T01:41:45.960 INFO:tasks.workunit.client.1.smithi121.stdout: Max throughput per process = 630680.69 kB/sec 2024-04-25T01:41:45.960 INFO:tasks.workunit.client.1.smithi121.stdout: Avg throughput per process = 630680.69 kB/sec 2024-04-25T01:41:45.960 INFO:tasks.workunit.client.1.smithi121.stdout: Min xfer = 1048576.00 kB 2024-04-25T01:41:46.006 INFO:tasks.workunit.client.0.smithi077.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-25T01:41:46.045 INFO:tasks.workunit.client.0.smithi077.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T01:41:46.046 INFO:tasks.workunit.client.0.smithi077.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T01:41:46.046 INFO:tasks.workunit.client.0.smithi077.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-25T01:41:46.083 INFO:tasks.workunit.client.0.smithi077.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T01:41:46.087 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:41:46.087 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-25T01:41:46.142 INFO:tasks.workunit:Running workunits matching suites/iozone.sh on client.0... 2024-04-25T01:41:46.144 INFO:tasks.workunit:Running workunit suites/iozone.sh... 2024-04-25T01:41:46.144 DEBUG:teuthology.orchestra.run.smithi077:workunit test suites/iozone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2c45d977142e024a59b68a8f1dce8f0b9840551 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh 2024-04-25T01:41:46.203 INFO:tasks.workunit.client.0.smithi077.stderr:+ iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-04-25T01:41:46.280 INFO:tasks.workunit.client.0.smithi077.stdout: Iozone: Performance Test of File I/O 2024-04-25T01:41:46.280 INFO:tasks.workunit.client.0.smithi077.stdout: Version $Revision: 3.494 $ 2024-04-25T01:41:46.280 INFO:tasks.workunit.client.0.smithi077.stdout: Compiled for 64 bit mode. 2024-04-25T01:41:46.280 INFO:tasks.workunit.client.0.smithi077.stdout: Build: linux-AMD64 2024-04-25T01:41:46.280 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:41:46.281 INFO:tasks.workunit.client.0.smithi077.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-04-25T01:41:46.281 INFO:tasks.workunit.client.0.smithi077.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-04-25T01:41:46.281 INFO:tasks.workunit.client.0.smithi077.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-04-25T01:41:46.281 INFO:tasks.workunit.client.0.smithi077.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-04-25T01:41:46.281 INFO:tasks.workunit.client.0.smithi077.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-04-25T01:41:46.281 INFO:tasks.workunit.client.0.smithi077.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-04-25T01:41:46.281 INFO:tasks.workunit.client.0.smithi077.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-04-25T01:41:46.281 INFO:tasks.workunit.client.0.smithi077.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-04-25T01:41:46.282 INFO:tasks.workunit.client.0.smithi077.stdout: Alexey Skidanov, Sudhir Kumar. 2024-04-25T01:41:46.282 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:41:46.282 INFO:tasks.workunit.client.0.smithi077.stdout: Run began: Thu Apr 25 01:41:46 2024 2024-04-25T01:41:46.282 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:41:46.282 INFO:tasks.workunit.client.0.smithi077.stdout: Include close in write timing 2024-04-25T01:41:46.282 INFO:tasks.workunit.client.0.smithi077.stdout: Include fsync in write timing 2024-04-25T01:41:46.282 INFO:tasks.workunit.client.0.smithi077.stdout: File size set to 1048576 kB 2024-04-25T01:41:46.282 INFO:tasks.workunit.client.0.smithi077.stdout: Record Size 16 kB 2024-04-25T01:41:46.282 INFO:tasks.workunit.client.0.smithi077.stdout: Command line used: iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-04-25T01:41:46.282 INFO:tasks.workunit.client.0.smithi077.stdout: Output is in kBytes/sec 2024-04-25T01:41:46.282 INFO:tasks.workunit.client.0.smithi077.stdout: Time Resolution = 0.000001 seconds. 2024-04-25T01:41:46.282 INFO:tasks.workunit.client.0.smithi077.stdout: Processor cache size set to 1024 kBytes. 2024-04-25T01:41:46.282 INFO:tasks.workunit.client.0.smithi077.stdout: Processor cache line size set to 32 bytes. 2024-04-25T01:41:46.283 INFO:tasks.workunit.client.0.smithi077.stdout: File stride size set to 17 * record size. 2024-04-25T01:41:46.283 INFO:tasks.workunit.client.0.smithi077.stdout: Throughput test with 1 process 2024-04-25T01:41:46.283 INFO:tasks.workunit.client.0.smithi077.stdout: Each process writes a 1048576 kByte file in 16 kByte records 2024-04-25T01:41:47.429 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:47.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.620+0000 7f3d120f5640 1 Processor -- start 2024-04-25T01:41:47.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.620+0000 7f3d120f5640 1 -- start start 2024-04-25T01:41:47.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.620+0000 7f3d120f5640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3d0c0c43a0 0x7f3d0c0c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:47.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.620+0000 7f3d120f5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3d0c0c79e0 0x7f3d0c0c3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:47.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.620+0000 7f3d120f5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d0c072a20 con 0x7f3d0c150300 2024-04-25T01:41:47.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.620+0000 7f3d120f5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f3d0c0c3030 con 0x7f3d0c0c79e0 2024-04-25T01:41:47.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.620+0000 7f3d120f5640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f3d0c1506e0 con 0x7f3d0c0c43a0 2024-04-25T01:41:47.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.621+0000 7f3d0b7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3d0c150300 0x7f3d0c153780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54764/0 (socket says 172.21.15.77:54764) 2024-04-25T01:41:47.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.621+0000 7f3d0b7fe640 1 -- 172.21.15.77:0/2992860674 learned_addr learned my addr 172.21.15.77:0/2992860674 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:41:47.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.621+0000 7f3d0bfff640 1 --2- 172.21.15.77:0/2992860674 >> v2:172.21.15.77:3300/0 conn(0x7f3d0c0c79e0 0x7f3d0c0c3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:47.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.621+0000 7f3d0bfff640 1 -- 172.21.15.77:0/2992860674 >> v2:172.21.15.121:3300/0 conn(0x7f3d0c0c43a0 msgr2=0x7f3d0c0c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:47.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.621+0000 7f3d0bfff640 1 --2- 172.21.15.77:0/2992860674 >> v2:172.21.15.121:3300/0 conn(0x7f3d0c0c43a0 0x7f3d0c0c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:47.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.621+0000 7f3d0bfff640 1 -- 172.21.15.77:0/2992860674 >> v1:172.21.15.77:6789/0 conn(0x7f3d0c150300 legacy=0x7f3d0c153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:47.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.621+0000 7f3d0bfff640 1 -- 172.21.15.77:0/2992860674 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d0c072cc0 con 0x7f3d0c0c79e0 2024-04-25T01:41:47.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.622+0000 7f3d0bfff640 1 --2- 172.21.15.77:0/2992860674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d0c0c79e0 0x7f3d0c0c3510 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0c7fd0 tx=0x7f3d0402a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36814980e9fcfd7f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:47.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.695+0000 7f3d0a7fc640 1 -- 172.21.15.77:0/2992860674 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d04007740 con 0x7f3d0c0c79e0 2024-04-25T01:41:47.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.696+0000 7f3d0a7fc640 1 -- 172.21.15.77:0/2992860674 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d040078e0 con 0x7f3d0c0c79e0 2024-04-25T01:41:47.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.696+0000 7f3d0a7fc640 1 -- 172.21.15.77:0/2992860674 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d04007cb0 con 0x7f3d0c0c79e0 2024-04-25T01:41:47.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.696+0000 7f3d120f5640 1 -- 172.21.15.77:0/2992860674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d0c0c79e0 msgr2=0x7f3d0c0c3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:47.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.696+0000 7f3d120f5640 1 --2- 172.21.15.77:0/2992860674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d0c0c79e0 0x7f3d0c0c3510 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0c7fd0 tx=0x7f3d0402a560 comp rx=0 tx=0).stop 2024-04-25T01:41:47.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.697+0000 7f3d120f5640 1 -- 172.21.15.77:0/2992860674 shutdown_connections 2024-04-25T01:41:47.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.697+0000 7f3d120f5640 1 --2- 172.21.15.77:0/2992860674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d0c0c79e0 0x7f3d0c0c3510 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:47.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.697+0000 7f3d120f5640 1 --2- 172.21.15.77:0/2992860674 >> v2:172.21.15.121:3300/0 conn(0x7f3d0c0c43a0 0x7f3d0c0c74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:47.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.697+0000 7f3d120f5640 1 -- 172.21.15.77:0/2992860674 >> 172.21.15.77:0/2992860674 conn(0x7f3d0c0c8590 msgr2=0x7f3d0c0c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:47.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.697+0000 7f3d120f5640 1 -- 172.21.15.77:0/2992860674 shutdown_connections 2024-04-25T01:41:47.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.697+0000 7f3d120f5640 1 -- 172.21.15.77:0/2992860674 wait complete. 2024-04-25T01:41:47.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.700+0000 7f3d120f5640 1 Processor -- start 2024-04-25T01:41:47.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.706+0000 7f3d120f5640 1 -- start start 2024-04-25T01:41:47.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.709+0000 7f3d120f5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d0c0c43a0 0x7f3d0c1ead60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:47.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.709+0000 7f3d120f5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d0c0c79e0 0x7f3d0c14b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:47.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.709+0000 7f3d120f5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d0c150300 0x7f3d0c14ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:47.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.709+0000 7f3d120f5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c073280 con 0x7f3d0c150300 2024-04-25T01:41:47.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.709+0000 7f3d120f5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c071270 con 0x7f3d0c0c79e0 2024-04-25T01:41:47.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.709+0000 7f3d120f5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f3d0c073400 con 0x7f3d0c0c43a0 2024-04-25T01:41:47.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.709+0000 7f3d0bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d0c150300 0x7f3d0c14ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:47.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.709+0000 7f3d0bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d0c150300 0x7f3d0c14ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35788/0 (socket says 172.21.15.77:35788) 2024-04-25T01:41:47.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.710+0000 7f3d0bfff640 1 -- 172.21.15.77:0/3330652145 learned_addr learned my addr 172.21.15.77:0/3330652145 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:47.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.710+0000 7f3d0b7fe640 1 --2- 172.21.15.77:0/3330652145 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d0c0c43a0 0x7f3d0c1ead60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:47.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.710+0000 7f3d0bfff640 1 -- 172.21.15.77:0/3330652145 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d0c0c43a0 msgr2=0x7f3d0c1ead60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:47.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.710+0000 7f3d0bfff640 1 --2- 172.21.15.77:0/3330652145 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d0c0c43a0 0x7f3d0c1ead60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:47.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.710+0000 7f3d0bfff640 1 -- 172.21.15.77:0/3330652145 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d0c0c79e0 msgr2=0x7f3d0c14b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:47.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.710+0000 7f3d0bfff640 1 --2- 172.21.15.77:0/3330652145 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d0c0c79e0 0x7f3d0c14b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:47.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.710+0000 7f3d0bfff640 1 -- 172.21.15.77:0/3330652145 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d0c14d3f0 con 0x7f3d0c150300 2024-04-25T01:41:47.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.710+0000 7f3d0bfff640 1 --2- 172.21.15.77:0/3330652145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d0c150300 0x7f3d0c14ba70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3d0402ab50 tx=0x7f3d04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:47.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.711+0000 7f3cf3fff640 1 -- 172.21.15.77:0/3330652145 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d04040070 con 0x7f3d0c150300 2024-04-25T01:41:47.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.711+0000 7f3cf3fff640 1 -- 172.21.15.77:0/3330652145 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d04031c40 con 0x7f3d0c150300 2024-04-25T01:41:47.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.711+0000 7f3cf3fff640 1 -- 172.21.15.77:0/3330652145 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d04045460 con 0x7f3d0c150300 2024-04-25T01:41:47.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.711+0000 7f3d120f5640 1 -- 172.21.15.77:0/3330652145 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d0c14b050 con 0x7f3d0c150300 2024-04-25T01:41:47.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.711+0000 7f3d120f5640 1 -- 172.21.15.77:0/3330652145 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d0c1eb980 con 0x7f3d0c150300 2024-04-25T01:41:47.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.712+0000 7f3d120f5640 1 -- 172.21.15.77:0/3330652145 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d0c04f500 con 0x7f3d0c150300 2024-04-25T01:41:47.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.713+0000 7f3cf3fff640 1 -- 172.21.15.77:0/3330652145 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d04039040 con 0x7f3d0c150300 2024-04-25T01:41:47.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.713+0000 7f3cf3fff640 1 --2- 172.21.15.77:0/3330652145 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3cf806be30 0x7f3cf806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:47.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.713+0000 7f3cf3fff640 1 -- 172.21.15.77:0/3330652145 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6895+0+0 (secure 0 0 0) 0x7f3d040acd20 con 0x7f3d0c150300 2024-04-25T01:41:47.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.713+0000 7f3d0b7fe640 1 --2- 172.21.15.77:0/3330652145 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3cf806be30 0x7f3cf806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:47.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.714+0000 7f3d0b7fe640 1 --2- 172.21.15.77:0/3330652145 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3cf806be30 0x7f3cf806e2f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc000f60 tx=0x7f3cfc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:47.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:47.719+0000 7f3cf3fff640 1 -- 172.21.15.77:0/3330652145 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3d0407b230 con 0x7f3d0c150300 2024-04-25T01:41:48.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.034+0000 7f3d120f5640 1 -- 172.21.15.77:0/3330652145 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d0c0c4180 con 0x7f3d0c150300 2024-04-25T01:41:48.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.035+0000 7f3cf3fff640 1 -- 172.21.15.77:0/3330652145 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+6488 (secure 0 0 0) 0x7f3d0407ab30 con 0x7f3d0c150300 2024-04-25T01:41:48.023 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:48.023 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5439,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:41:37.377243+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":38,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4250,"qdb_cluster":[4250]},"id":1},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:37.377244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5265,"qdb_cluster":[5265]},"id":2}]} 2024-04-25T01:41:48.023 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 23 2024-04-25T01:41:48.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.037+0000 7f3d120f5640 1 -- 172.21.15.77:0/3330652145 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3cf806be30 msgr2=0x7f3cf806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:48.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.037+0000 7f3d120f5640 1 --2- 172.21.15.77:0/3330652145 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3cf806be30 0x7f3cf806e2f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc000f60 tx=0x7f3cfc009040 comp rx=0 tx=0).stop 2024-04-25T01:41:48.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.037+0000 7f3d120f5640 1 -- 172.21.15.77:0/3330652145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d0c150300 msgr2=0x7f3d0c14ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:48.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.037+0000 7f3d120f5640 1 --2- 172.21.15.77:0/3330652145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d0c150300 0x7f3d0c14ba70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3d0402ab50 tx=0x7f3d04004a40 comp rx=0 tx=0).stop 2024-04-25T01:41:48.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.038+0000 7f3d120f5640 1 -- 172.21.15.77:0/3330652145 shutdown_connections 2024-04-25T01:41:48.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.038+0000 7f3d120f5640 1 --2- 172.21.15.77:0/3330652145 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3cf806be30 0x7f3cf806e2f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:48.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.038+0000 7f3d120f5640 1 --2- 172.21.15.77:0/3330652145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d0c150300 0x7f3d0c14ba70 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:48.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.038+0000 7f3d120f5640 1 --2- 172.21.15.77:0/3330652145 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d0c0c79e0 0x7f3d0c14b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:48.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.038+0000 7f3d120f5640 1 --2- 172.21.15.77:0/3330652145 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d0c0c43a0 0x7f3d0c1ead60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:48.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.038+0000 7f3d120f5640 1 -- 172.21.15.77:0/3330652145 >> 172.21.15.77:0/3330652145 conn(0x7f3d0c0c8590 msgr2=0x7f3d0c0a8710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:48.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.038+0000 7f3d120f5640 1 -- 172.21.15.77:0/3330652145 shutdown_connections 2024-04-25T01:41:48.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.038+0000 7f3d120f5640 1 -- 172.21.15.77:0/3330652145 wait complete. 2024-04-25T01:41:48.037 INFO:tasks.mds_thrash.fs.[a]:kill mds.b (rank=0) 2024-04-25T01:41:48.038 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T01:41:48.038 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T01:41:48.055 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T01:41:48.055 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:48.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.178+0000 7fb32b6df640 1 Processor -- start 2024-04-25T01:41:48.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.178+0000 7fb32b6df640 1 -- start start 2024-04-25T01:41:48.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.179+0000 7fb32b6df640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb32414e020 0x7fb324153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:48.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.179+0000 7fb32b6df640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb3240722c0 0x7fb324157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:48.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.179+0000 7fb32b6df640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3241546e0 con 0x7fb3241580f0 2024-04-25T01:41:48.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.179+0000 7fb32b6df640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fb3241549c0 con 0x7fb3240722c0 2024-04-25T01:41:48.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.179+0000 7fb32b6df640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb324154ca0 con 0x7fb32414e020 2024-04-25T01:41:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.179+0000 7fb328c7a640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb3240722c0 0x7fb324157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.179+0000 7fb32947b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb32414e020 0x7fb324153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.179+0000 7fb328c7a640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb3240722c0 0x7fb324157bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:49448/0 (socket says 172.21.15.77:49448) 2024-04-25T01:41:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.179+0000 7fb32947b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb32414e020 0x7fb324153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.77:36508/0 (socket says 172.21.15.77:36508) 2024-04-25T01:41:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.179+0000 7fb328c7a640 1 -- 172.21.15.77:0/1986127367 learned_addr learned my addr 172.21.15.77:0/1986127367 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.180+0000 7fb328c7a640 1 -- 172.21.15.77:0/1986127367 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb32414e020 msgr2=0x7fb324153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.180+0000 7fb328c7a640 1 --2- 172.21.15.77:0/1986127367 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb32414e020 0x7fb324153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.180+0000 7fb328c7a640 1 -- 172.21.15.77:0/1986127367 >> v1:172.21.15.121:6789/0 conn(0x7fb3241580f0 legacy=0x7fb3240c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.180+0000 7fb328c7a640 1 -- 172.21.15.77:0/1986127367 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb324157690 con 0x7fb3240722c0 2024-04-25T01:41:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.181+0000 7fb328c7a640 1 --2- 172.21.15.77:0/1986127367 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3240722c0 0x7fb324157bb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb314009870 tx=0x7fb31402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4def677589265f01 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.181+0000 7fb31bfff640 1 -- 172.21.15.77:0/1986127367 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb314037070 con 0x7fb3240722c0 2024-04-25T01:41:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.181+0000 7fb31bfff640 1 -- 172.21.15.77:0/1986127367 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb314032440 con 0x7fb3240722c0 2024-04-25T01:41:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.181+0000 7fb31bfff640 1 -- 172.21.15.77:0/1986127367 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb314032810 con 0x7fb3240722c0 2024-04-25T01:41:48.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.182+0000 7fb32b6df640 1 -- 172.21.15.77:0/1986127367 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3240722c0 msgr2=0x7fb324157bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:48.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.182+0000 7fb32b6df640 1 --2- 172.21.15.77:0/1986127367 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3240722c0 0x7fb324157bb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb314009870 tx=0x7fb31402a1c0 comp rx=0 tx=0).stop 2024-04-25T01:41:48.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.182+0000 7fb32b6df640 1 -- 172.21.15.77:0/1986127367 shutdown_connections 2024-04-25T01:41:48.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.182+0000 7fb32b6df640 1 --2- 172.21.15.77:0/1986127367 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3240722c0 0x7fb324157bb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:48.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.182+0000 7fb32b6df640 1 --2- 172.21.15.77:0/1986127367 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb32414e020 0x7fb324153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:48.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.182+0000 7fb32b6df640 1 -- 172.21.15.77:0/1986127367 >> 172.21.15.77:0/1986127367 conn(0x7fb3240aa8f0 msgr2=0x7fb324066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:48.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.182+0000 7fb32b6df640 1 -- 172.21.15.77:0/1986127367 shutdown_connections 2024-04-25T01:41:48.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.182+0000 7fb32b6df640 1 -- 172.21.15.77:0/1986127367 wait complete. 2024-04-25T01:41:48.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.183+0000 7fb32b6df640 1 Processor -- start 2024-04-25T01:41:48.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.183+0000 7fb32b6df640 1 -- start start 2024-04-25T01:41:48.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.184+0000 7fb32b6df640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3240722c0 0x7fb3240c2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:48.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.184+0000 7fb32b6df640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb32414e020 0x7fb3241eece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:48.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.184+0000 7fb32b6df640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3241580f0 0x7fb3241ef220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:48.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.184+0000 7fb32b6df640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb3240c4940 con 0x7fb3241580f0 2024-04-25T01:41:48.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.184+0000 7fb32b6df640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb3240c47c0 con 0x7fb3240722c0 2024-04-25T01:41:48.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.184+0000 7fb32b6df640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb32406f7a0 con 0x7fb32414e020 2024-04-25T01:41:48.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.185+0000 7fb329c7c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3241580f0 0x7fb3241ef220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:48.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.185+0000 7fb329c7c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3241580f0 0x7fb3241ef220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35792/0 (socket says 172.21.15.77:35792) 2024-04-25T01:41:48.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.185+0000 7fb329c7c640 1 -- 172.21.15.77:0/1087388619 learned_addr learned my addr 172.21.15.77:0/1087388619 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:48.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.185+0000 7fb328c7a640 1 --2- 172.21.15.77:0/1087388619 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb32414e020 0x7fb3241eece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:48.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.185+0000 7fb329c7c640 1 -- 172.21.15.77:0/1087388619 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb32414e020 msgr2=0x7fb3241eece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:48.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.185+0000 7fb329c7c640 1 --2- 172.21.15.77:0/1087388619 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb32414e020 0x7fb3241eece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:48.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.185+0000 7fb329c7c640 1 -- 172.21.15.77:0/1087388619 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3240722c0 msgr2=0x7fb3240c2d50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T01:41:48.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.185+0000 7fb329c7c640 1 --2- 172.21.15.77:0/1087388619 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3240722c0 0x7fb3240c2d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:48.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.185+0000 7fb329c7c640 1 -- 172.21.15.77:0/1087388619 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3240c98c0 con 0x7fb3241580f0 2024-04-25T01:41:48.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.185+0000 7fb329c7c640 1 --2- 172.21.15.77:0/1087388619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3241580f0 0x7fb3241ef220 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb31c00c6b0 tx=0x7fb31c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:48.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.185+0000 7fb319ffb640 1 -- 172.21.15.77:0/1087388619 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31c003b70 con 0x7fb3241580f0 2024-04-25T01:41:48.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.185+0000 7fb319ffb640 1 -- 172.21.15.77:0/1087388619 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb31c003d30 con 0x7fb3241580f0 2024-04-25T01:41:48.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.185+0000 7fb32b6df640 1 -- 172.21.15.77:0/1087388619 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3240c8380 con 0x7fb3241580f0 2024-04-25T01:41:48.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.185+0000 7fb319ffb640 1 -- 172.21.15.77:0/1087388619 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31c005310 con 0x7fb3241580f0 2024-04-25T01:41:48.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.186+0000 7fb32b6df640 1 -- 172.21.15.77:0/1087388619 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3240c8940 con 0x7fb3241580f0 2024-04-25T01:41:48.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.187+0000 7fb32b6df640 1 -- 172.21.15.77:0/1087388619 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3240688e0 con 0x7fb3241580f0 2024-04-25T01:41:48.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.188+0000 7fb319ffb640 1 -- 172.21.15.77:0/1087388619 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb31c0054b0 con 0x7fb3241580f0 2024-04-25T01:41:48.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.188+0000 7fb319ffb640 1 --2- 172.21.15.77:0/1087388619 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb30806be30 0x7fb30806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:48.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.189+0000 7fb319ffb640 1 -- 172.21.15.77:0/1087388619 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6895+0+0 (secure 0 0 0) 0x7fb31c08b140 con 0x7fb3241580f0 2024-04-25T01:41:48.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.189+0000 7fb32947b640 1 --2- 172.21.15.77:0/1087388619 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb30806be30 0x7fb30806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:48.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.189+0000 7fb32947b640 1 --2- 172.21.15.77:0/1087388619 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb30806be30 0x7fb30806e2f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb3200099d0 tx=0x7fb320009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:48.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.193+0000 7fb319ffb640 1 -- 172.21.15.77:0/1087388619 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb31c0596c0 con 0x7fb3241580f0 2024-04-25T01:41:48.449 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:41:48.449 INFO:tasks.workunit.client.0.smithi077.stdout: Children see throughput for 1 initial writers = 483906.91 kB/sec 2024-04-25T01:41:48.450 INFO:tasks.workunit.client.0.smithi077.stdout: Parent sees throughput for 1 initial writers = 483862.95 kB/sec 2024-04-25T01:41:48.450 INFO:tasks.workunit.client.0.smithi077.stdout: Min throughput per process = 483906.91 kB/sec 2024-04-25T01:41:48.450 INFO:tasks.workunit.client.0.smithi077.stdout: Max throughput per process = 483906.91 kB/sec 2024-04-25T01:41:48.450 INFO:tasks.workunit.client.0.smithi077.stdout: Avg throughput per process = 483906.91 kB/sec 2024-04-25T01:41:48.450 INFO:tasks.workunit.client.0.smithi077.stdout: Min xfer = 1048576.00 kB 2024-04-25T01:41:48.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.491+0000 7fb32b6df640 1 -- 172.21.15.77:0/1087388619 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb32404f500 con 0x7fb3241580f0 2024-04-25T01:41:48.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.492+0000 7fb319ffb640 1 -- 172.21.15.77:0/1087388619 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+6488 (secure 0 0 0) 0x7fb31c058fc0 con 0x7fb3241580f0 2024-04-25T01:41:48.479 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:48.479 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5439,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:41:37.377243+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":38,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4250,"qdb_cluster":[4250]},"id":1},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:37.377244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5265,"qdb_cluster":[5265]},"id":2}]} 2024-04-25T01:41:48.480 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 23 2024-04-25T01:41:48.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.493+0000 7fb32b6df640 1 -- 172.21.15.77:0/1087388619 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb30806be30 msgr2=0x7fb30806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:48.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.493+0000 7fb32b6df640 1 --2- 172.21.15.77:0/1087388619 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb30806be30 0x7fb30806e2f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb3200099d0 tx=0x7fb320009190 comp rx=0 tx=0).stop 2024-04-25T01:41:48.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.493+0000 7fb32b6df640 1 -- 172.21.15.77:0/1087388619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3241580f0 msgr2=0x7fb3241ef220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:48.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.493+0000 7fb32b6df640 1 --2- 172.21.15.77:0/1087388619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3241580f0 0x7fb3241ef220 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb31c00c6b0 tx=0x7fb31c00cb70 comp rx=0 tx=0).stop 2024-04-25T01:41:48.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.494+0000 7fb32b6df640 1 -- 172.21.15.77:0/1087388619 shutdown_connections 2024-04-25T01:41:48.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.494+0000 7fb32b6df640 1 --2- 172.21.15.77:0/1087388619 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb30806be30 0x7fb30806e2f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:48.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.494+0000 7fb32b6df640 1 --2- 172.21.15.77:0/1087388619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3241580f0 0x7fb3241ef220 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:48.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.494+0000 7fb32b6df640 1 --2- 172.21.15.77:0/1087388619 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb32414e020 0x7fb3241eece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:48.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.494+0000 7fb32b6df640 1 --2- 172.21.15.77:0/1087388619 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3240722c0 0x7fb3240c2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:48.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.494+0000 7fb32b6df640 1 -- 172.21.15.77:0/1087388619 >> 172.21.15.77:0/1087388619 conn(0x7fb3240aa8f0 msgr2=0x7fb324072b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:48.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.494+0000 7fb32b6df640 1 -- 172.21.15.77:0/1087388619 shutdown_connections 2024-04-25T01:41:48.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:48.494+0000 7fb32b6df640 1 -- 172.21.15.77:0/1087388619 wait complete. 2024-04-25T01:41:48.493 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-25T01:41:49.489 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:41:49.492 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:41:50.493 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:50.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.684+0000 7f15ed790640 1 Processor -- start 2024-04-25T01:41:50.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.684+0000 7f15ed790640 1 -- start start 2024-04-25T01:41:50.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.685+0000 7f15ed790640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f15e815a190 0x7f15e80c36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:50.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.685+0000 7f15ed790640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f15e80c2eb0 0x7f15e806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:50.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.685+0000 7f15ed790640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15e8159620 con 0x7f15e80701e0 2024-04-25T01:41:50.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.685+0000 7f15ed790640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f15e80c3be0 con 0x7f15e815a190 2024-04-25T01:41:50.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.685+0000 7f15ed790640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f15e8072460 con 0x7f15e80c2eb0 2024-04-25T01:41:50.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.685+0000 7f15e6ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f15e815a190 0x7f15e80c36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:50.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.685+0000 7f15e6ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f15e815a190 0x7f15e80c36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35800/0 (socket says 172.21.15.77:35800) 2024-04-25T01:41:50.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.685+0000 7f15e6ffd640 1 -- 172.21.15.77:0/3689139688 learned_addr learned my addr 172.21.15.77:0/3689139688 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:50.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.686+0000 7f15e6ffd640 1 -- 172.21.15.77:0/3689139688 >> v2:172.21.15.121:3300/0 conn(0x7f15e80c2eb0 msgr2=0x7f15e806fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:50.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.686+0000 7f15e6ffd640 1 --2- 172.21.15.77:0/3689139688 >> v2:172.21.15.121:3300/0 conn(0x7f15e80c2eb0 0x7f15e806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:50.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.686+0000 7f15e6ffd640 1 -- 172.21.15.77:0/3689139688 >> v1:172.21.15.121:6789/0 conn(0x7f15e80701e0 legacy=0x7f15e8156460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T01:41:50.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.686+0000 7f15e6ffd640 1 -- 172.21.15.77:0/3689139688 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e8072740 con 0x7f15e815a190 2024-04-25T01:41:50.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.687+0000 7f15e6ffd640 1 --2- 172.21.15.77:0/3689139688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15e815a190 0x7f15e80c36a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f15e806e400 tx=0x7f15d002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c16284d1d074efe9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:50.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.687+0000 7f15e5ffb640 1 -- 172.21.15.77:0/3689139688 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d0037070 con 0x7f15e815a190 2024-04-25T01:41:50.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.687+0000 7f15e5ffb640 1 -- 172.21.15.77:0/3689139688 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15d0032440 con 0x7f15e815a190 2024-04-25T01:41:50.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.687+0000 7f15e5ffb640 1 -- 172.21.15.77:0/3689139688 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d0032810 con 0x7f15e815a190 2024-04-25T01:41:50.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.688+0000 7f15ed790640 1 -- 172.21.15.77:0/3689139688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15e815a190 msgr2=0x7f15e80c36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:50.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.688+0000 7f15ed790640 1 --2- 172.21.15.77:0/3689139688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15e815a190 0x7f15e80c36a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f15e806e400 tx=0x7f15d002a180 comp rx=0 tx=0).stop 2024-04-25T01:41:50.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.688+0000 7f15ed790640 1 -- 172.21.15.77:0/3689139688 shutdown_connections 2024-04-25T01:41:50.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.688+0000 7f15ed790640 1 --2- 172.21.15.77:0/3689139688 >> v2:172.21.15.121:3300/0 conn(0x7f15e80c2eb0 0x7f15e806fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:50.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.688+0000 7f15ed790640 1 --2- 172.21.15.77:0/3689139688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15e815a190 0x7f15e80c36a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:50.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.688+0000 7f15ed790640 1 -- 172.21.15.77:0/3689139688 >> 172.21.15.77:0/3689139688 conn(0x7f15e80aa8f0 msgr2=0x7f15e8066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:50.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.688+0000 7f15ed790640 1 -- 172.21.15.77:0/3689139688 shutdown_connections 2024-04-25T01:41:50.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.688+0000 7f15ed790640 1 -- 172.21.15.77:0/3689139688 wait complete. 2024-04-25T01:41:50.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.690+0000 7f15ed790640 1 Processor -- start 2024-04-25T01:41:50.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.690+0000 7f15ed790640 1 -- start start 2024-04-25T01:41:50.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.691+0000 7f15ed790640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15e80701e0 0x7f15e81551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:50.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.691+0000 7f15ed790640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15e80c2eb0 0x7f15e8148950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:50.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.691+0000 7f15ed790640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15e815a190 0x7f15e81ec360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:50.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.691+0000 7f15ed790640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f15e8156b70 con 0x7f15e80c2eb0 2024-04-25T01:41:50.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.691+0000 7f15ed790640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f15e8072d00 con 0x7f15e815a190 2024-04-25T01:41:50.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.691+0000 7f15ed790640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f15e8156cf0 con 0x7f15e80701e0 2024-04-25T01:41:50.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.691+0000 7f15e67fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15e80c2eb0 0x7f15e8148950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:50.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.692+0000 7f15e67fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15e80c2eb0 0x7f15e8148950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35806/0 (socket says 172.21.15.77:35806) 2024-04-25T01:41:50.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.692+0000 7f15e67fc640 1 -- 172.21.15.77:0/3235099271 learned_addr learned my addr 172.21.15.77:0/3235099271 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:50.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.692+0000 7f15e67fc640 1 -- 172.21.15.77:0/3235099271 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15e80701e0 msgr2=0x7f15e81551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:50.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.692+0000 7f15e6ffd640 1 --2- 172.21.15.77:0/3235099271 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15e80701e0 0x7f15e81551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:50.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.692+0000 7f15e67fc640 1 --2- 172.21.15.77:0/3235099271 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15e80701e0 0x7f15e81551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:50.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.692+0000 7f15e67fc640 1 -- 172.21.15.77:0/3235099271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15e815a190 msgr2=0x7f15e81ec360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:50.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.692+0000 7f15e67fc640 1 --2- 172.21.15.77:0/3235099271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15e815a190 0x7f15e81ec360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:50.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.692+0000 7f15e67fc640 1 -- 172.21.15.77:0/3235099271 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e81f0430 con 0x7f15e80c2eb0 2024-04-25T01:41:50.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.692+0000 7f15e6ffd640 1 --2- 172.21.15.77:0/3235099271 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15e80701e0 0x7f15e81551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:41:50.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.692+0000 7f15e67fc640 1 --2- 172.21.15.77:0/3235099271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15e80c2eb0 0x7f15e8148950 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f15d800b4d0 tx=0x7f15d800b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:50.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.692+0000 7f15df7fe640 1 -- 172.21.15.77:0/3235099271 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d8014070 con 0x7f15e80c2eb0 2024-04-25T01:41:50.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.693+0000 7f15ed790640 1 -- 172.21.15.77:0/3235099271 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15e80ac520 con 0x7f15e80c2eb0 2024-04-25T01:41:50.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.693+0000 7f15ed790640 1 -- 172.21.15.77:0/3235099271 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15e8149480 con 0x7f15e80c2eb0 2024-04-25T01:41:50.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.693+0000 7f15df7fe640 1 -- 172.21.15.77:0/3235099271 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15d8010870 con 0x7f15e80c2eb0 2024-04-25T01:41:50.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.693+0000 7f15df7fe640 1 -- 172.21.15.77:0/3235099271 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d8010c60 con 0x7f15e80c2eb0 2024-04-25T01:41:50.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.695+0000 7f15ed790640 1 -- 172.21.15.77:0/3235099271 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15cc005290 con 0x7f15e80c2eb0 2024-04-25T01:41:50.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.695+0000 7f15df7fe640 1 -- 172.21.15.77:0/3235099271 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f15d8017070 con 0x7f15e80c2eb0 2024-04-25T01:41:50.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.695+0000 7f15df7fe640 1 --2- 172.21.15.77:0/3235099271 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f15c806be30 0x7f15c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:50.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.696+0000 7f15df7fe640 1 -- 172.21.15.77:0/3235099271 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6895+0+0 (secure 0 0 0) 0x7f15d808b000 con 0x7f15e80c2eb0 2024-04-25T01:41:50.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.696+0000 7f15e6ffd640 1 --2- 172.21.15.77:0/3235099271 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f15c806be30 0x7f15c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:50.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.697+0000 7f15e6ffd640 1 --2- 172.21.15.77:0/3235099271 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f15c806be30 0x7f15c806e2f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f15d0034000 tx=0x7f15d002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:50.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:50.705+0000 7f15df7fe640 1 -- 172.21.15.77:0/3235099271 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f15d80595e0 con 0x7f15e80c2eb0 2024-04-25T01:41:51.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:51.106+0000 7f15ed790640 1 -- 172.21.15.77:0/3235099271 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15cc005850 con 0x7f15e80c2eb0 2024-04-25T01:41:51.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:51.107+0000 7f15df7fe640 1 -- 172.21.15.77:0/3235099271 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+6488 (secure 0 0 0) 0x7f15d8058ee0 con 0x7f15e80c2eb0 2024-04-25T01:41:51.094 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:51.095 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5439,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:41:37.377243+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":38,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4250,"qdb_cluster":[4250]},"id":1},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:37.377244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5265,"qdb_cluster":[5265]},"id":2}]} 2024-04-25T01:41:51.095 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 23 2024-04-25T01:41:51.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:51.109+0000 7f15ed790640 1 -- 172.21.15.77:0/3235099271 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f15c806be30 msgr2=0x7f15c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:51.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:51.109+0000 7f15ed790640 1 --2- 172.21.15.77:0/3235099271 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f15c806be30 0x7f15c806e2f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f15d0034000 tx=0x7f15d002e000 comp rx=0 tx=0).stop 2024-04-25T01:41:51.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:51.109+0000 7f15ed790640 1 -- 172.21.15.77:0/3235099271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15e80c2eb0 msgr2=0x7f15e8148950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:51.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:51.109+0000 7f15ed790640 1 --2- 172.21.15.77:0/3235099271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15e80c2eb0 0x7f15e8148950 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f15d800b4d0 tx=0x7f15d800b990 comp rx=0 tx=0).stop 2024-04-25T01:41:51.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:51.109+0000 7f15ed790640 1 -- 172.21.15.77:0/3235099271 shutdown_connections 2024-04-25T01:41:51.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:51.109+0000 7f15ed790640 1 --2- 172.21.15.77:0/3235099271 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f15c806be30 0x7f15c806e2f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:51.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:51.109+0000 7f15ed790640 1 --2- 172.21.15.77:0/3235099271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15e80c2eb0 0x7f15e8148950 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:51.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:51.109+0000 7f15ed790640 1 --2- 172.21.15.77:0/3235099271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15e815a190 0x7f15e81ec360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:51.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:51.109+0000 7f15ed790640 1 --2- 172.21.15.77:0/3235099271 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15e80701e0 0x7f15e81551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:51.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:51.109+0000 7f15ed790640 1 -- 172.21.15.77:0/3235099271 >> 172.21.15.77:0/3235099271 conn(0x7f15e80aa8f0 msgr2=0x7f15e81578b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:51.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:51.109+0000 7f15ed790640 1 -- 172.21.15.77:0/3235099271 shutdown_connections 2024-04-25T01:41:51.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:51.109+0000 7f15ed790640 1 -- 172.21.15.77:0/3235099271 wait complete. 2024-04-25T01:41:51.119 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-25T01:41:51.986 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:41:51.986 INFO:tasks.workunit.client.1.smithi121.stdout: Children see throughput for 1 rewriters = 533479.56 kB/sec 2024-04-25T01:41:51.986 INFO:tasks.workunit.client.1.smithi121.stdout: Parent sees throughput for 1 rewriters = 533416.35 kB/sec 2024-04-25T01:41:51.986 INFO:tasks.workunit.client.1.smithi121.stdout: Min throughput per process = 533479.56 kB/sec 2024-04-25T01:41:51.986 INFO:tasks.workunit.client.1.smithi121.stdout: Max throughput per process = 533479.56 kB/sec 2024-04-25T01:41:51.986 INFO:tasks.workunit.client.1.smithi121.stdout: Avg throughput per process = 533479.56 kB/sec 2024-04-25T01:41:51.987 INFO:tasks.workunit.client.1.smithi121.stdout: Min xfer = 1048576.00 kB 2024-04-25T01:41:53.120 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:53.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.242+0000 7fd0a1d9d640 1 Processor -- start 2024-04-25T01:41:53.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.242+0000 7fd0a1d9d640 1 -- start start 2024-04-25T01:41:53.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.242+0000 7fd0a1d9d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd09c150090 0x7fd09c156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:53.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.242+0000 7fd0a1d9d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd09c06c280 0x7fd09c0c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:53.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.242+0000 7fd0a1d9d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd09c0c89c0 con 0x7fd09c0c8200 2024-04-25T01:41:53.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.242+0000 7fd0a1d9d640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fd09c06b830 con 0x7fd09c150090 2024-04-25T01:41:53.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.242+0000 7fd0a1d9d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd09c0c8ca0 con 0x7fd09c06c280 2024-04-25T01:41:53.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.243+0000 7fd09affd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd09c0c8200 0x7fd09c0c98a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54770/0 (socket says 172.21.15.77:54770) 2024-04-25T01:41:53.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.243+0000 7fd09affd640 1 -- 172.21.15.77:0/4150716524 learned_addr learned my addr 172.21.15.77:0/4150716524 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:41:53.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.243+0000 7fd09bfff640 1 --2- 172.21.15.77:0/4150716524 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd09c06c280 0x7fd09c0c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:53.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.243+0000 7fd09b7fe640 1 --2- 172.21.15.77:0/4150716524 >> v2:172.21.15.121:3300/0 conn(0x7fd09c150090 0x7fd09c156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:53.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.243+0000 7fd09a7fc640 1 -- 172.21.15.77:0/4150716524 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3604623314 0 0) 0x7fd09c0c89c0 con 0x7fd09c0c8200 2024-04-25T01:41:53.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.243+0000 7fd09a7fc640 1 -- 172.21.15.77:0/4150716524 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd084003520 con 0x7fd09c0c8200 2024-04-25T01:41:53.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.243+0000 7fd09a7fc640 1 -- 172.21.15.77:0/4150716524 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 269144802 0 0) 0x7fd084003520 con 0x7fd09c0c8200 2024-04-25T01:41:53.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.243+0000 7fd09a7fc640 1 -- 172.21.15.77:0/4150716524 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd09c06c280 msgr2=0x7fd09c0c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:53.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.243+0000 7fd09a7fc640 1 --2- 172.21.15.77:0/4150716524 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd09c06c280 0x7fd09c0c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:53.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.243+0000 7fd09a7fc640 1 -- 172.21.15.77:0/4150716524 >> v2:172.21.15.121:3300/0 conn(0x7fd09c150090 msgr2=0x7fd09c156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:53.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.243+0000 7fd09a7fc640 1 --2- 172.21.15.77:0/4150716524 >> v2:172.21.15.121:3300/0 conn(0x7fd09c150090 0x7fd09c156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:53.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.243+0000 7fd09a7fc640 1 -- 172.21.15.77:0/4150716524 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd09c06ba80 con 0x7fd09c0c8200 2024-04-25T01:41:53.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.243+0000 7fd09a7fc640 1 -- 172.21.15.77:0/4150716524 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7fd090001670 con 0x7fd09c0c8200 2024-04-25T01:41:53.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.243+0000 7fd09bfff640 1 --2- 172.21.15.77:0/4150716524 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd09c06c280 0x7fd09c0c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:41:53.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.243+0000 7fd09b7fe640 1 --2- 172.21.15.77:0/4150716524 >> v2:172.21.15.121:3300/0 conn(0x7fd09c150090 0x7fd09c156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:41:53.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.243+0000 7fd09a7fc640 1 -- 172.21.15.77:0/4150716524 >> v1:172.21.15.77:6789/0 conn(0x7fd09c0c8200 legacy=0x7fd09c0c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:53.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.243+0000 7fd09a7fc640 1 --2- 172.21.15.77:0/4150716524 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0840039b0 0x7fd084003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:53.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.243+0000 7fd09a7fc640 1 --2- 172.21.15.77:0/4150716524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd084004800 0x7fd084004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:53.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.243+0000 7fd09a7fc640 1 --2- 172.21.15.77:0/4150716524 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd09c06c280 0x7fd0840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:53.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.243+0000 7fd09a7fc640 1 -- 172.21.15.77:0/4150716524 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c06b830 con 0x7fd084004800 2024-04-25T01:41:53.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.243+0000 7fd09a7fc640 1 -- 172.21.15.77:0/4150716524 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c0c8ca0 con 0x7fd0840039b0 2024-04-25T01:41:53.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.243+0000 7fd09a7fc640 1 -- 172.21.15.77:0/4150716524 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd08400b9c0 con 0x7fd09c06c280 2024-04-25T01:41:53.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.243+0000 7fd09affd640 1 --2- 172.21.15.77:0/4150716524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd084004800 0x7fd084004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:53.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.243+0000 7fd09b7fe640 1 --2- 172.21.15.77:0/4150716524 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0840039b0 0x7fd084003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:53.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.243+0000 7fd09bfff640 1 --2- 172.21.15.77:0/4150716524 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd09c06c280 0x7fd0840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:53.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.244+0000 7fd09affd640 1 -- 172.21.15.77:0/4150716524 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd09c06c280 msgr2=0x7fd0840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:53.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.244+0000 7fd09affd640 1 --2- 172.21.15.77:0/4150716524 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd09c06c280 0x7fd0840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:53.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.244+0000 7fd09affd640 1 -- 172.21.15.77:0/4150716524 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0840039b0 msgr2=0x7fd084003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:53.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.244+0000 7fd09affd640 1 --2- 172.21.15.77:0/4150716524 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0840039b0 0x7fd084003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:53.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.244+0000 7fd09affd640 1 -- 172.21.15.77:0/4150716524 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd084003520 con 0x7fd084004800 2024-04-25T01:41:53.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.244+0000 7fd09affd640 1 --2- 172.21.15.77:0/4150716524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd084004800 0x7fd084004c80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd09000c210 tx=0x7fd084005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9845792d9119b763 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:53.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.244+0000 7fd09a7fc640 1 -- 172.21.15.77:0/4150716524 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd090007d30 con 0x7fd084004800 2024-04-25T01:41:53.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.244+0000 7fd09a7fc640 1 -- 172.21.15.77:0/4150716524 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd090005ad0 con 0x7fd084004800 2024-04-25T01:41:53.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.244+0000 7fd09a7fc640 1 -- 172.21.15.77:0/4150716524 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd090007070 con 0x7fd084004800 2024-04-25T01:41:53.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.245+0000 7fd0a1d9d640 1 -- 172.21.15.77:0/4150716524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd084004800 msgr2=0x7fd084004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:53.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.245+0000 7fd0a1d9d640 1 --2- 172.21.15.77:0/4150716524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd084004800 0x7fd084004c80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd09000c210 tx=0x7fd084005830 comp rx=0 tx=0).stop 2024-04-25T01:41:53.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.245+0000 7fd09bfff640 1 -- 172.21.15.77:0/4150716524 reap_dead start 2024-04-25T01:41:53.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.245+0000 7fd0a1d9d640 1 -- 172.21.15.77:0/4150716524 shutdown_connections 2024-04-25T01:41:53.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.245+0000 7fd0a1d9d640 1 -- 172.21.15.77:0/4150716524 >> 172.21.15.77:0/4150716524 conn(0x7fd09c0ad4d0 msgr2=0x7fd09c0ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:53.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.245+0000 7fd0a1d9d640 1 -- 172.21.15.77:0/4150716524 shutdown_connections 2024-04-25T01:41:53.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.245+0000 7fd0a1d9d640 1 -- 172.21.15.77:0/4150716524 wait complete. 2024-04-25T01:41:53.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.246+0000 7fd0a1d9d640 1 Processor -- start 2024-04-25T01:41:53.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.246+0000 7fd0a1d9d640 1 -- start start 2024-04-25T01:41:53.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.247+0000 7fd0a1d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd084004800 0x7fd09c0c2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:53.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.247+0000 7fd0a1d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd09c0afa70 0x7fd09c14ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:53.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.247+0000 7fd0a1d9d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd09c0c5c10 0x7fd09c14b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:53.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.247+0000 7fd0a1d9d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c06c6b0 con 0x7fd09c0afa70 2024-04-25T01:41:53.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.247+0000 7fd0a1d9d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c0c86b0 con 0x7fd084004800 2024-04-25T01:41:53.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.247+0000 7fd0a1d9d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd09c06c830 con 0x7fd09c0c5c10 2024-04-25T01:41:53.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.247+0000 7fd09affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd09c0afa70 0x7fd09c14ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:53.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.247+0000 7fd09affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd09c0afa70 0x7fd09c14ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35824/0 (socket says 172.21.15.77:35824) 2024-04-25T01:41:53.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.247+0000 7fd09affd640 1 -- 172.21.15.77:0/3524993122 learned_addr learned my addr 172.21.15.77:0/3524993122 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:53.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.247+0000 7fd09b7fe640 1 --2- 172.21.15.77:0/3524993122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd084004800 0x7fd09c0c2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:53.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.247+0000 7fd09bfff640 1 --2- 172.21.15.77:0/3524993122 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd09c0c5c10 0x7fd09c14b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:53.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.247+0000 7fd09affd640 1 -- 172.21.15.77:0/3524993122 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd09c0c5c10 msgr2=0x7fd09c14b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:53.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.247+0000 7fd09affd640 1 --2- 172.21.15.77:0/3524993122 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd09c0c5c10 0x7fd09c14b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:53.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.247+0000 7fd09affd640 1 -- 172.21.15.77:0/3524993122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd084004800 msgr2=0x7fd09c0c2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:53.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.247+0000 7fd09affd640 1 --2- 172.21.15.77:0/3524993122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd084004800 0x7fd09c0c2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:53.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.247+0000 7fd09affd640 1 -- 172.21.15.77:0/3524993122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd09c0c4960 con 0x7fd09c0afa70 2024-04-25T01:41:53.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.247+0000 7fd09b7fe640 1 --2- 172.21.15.77:0/3524993122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd084004800 0x7fd09c0c2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:41:53.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.248+0000 7fd09affd640 1 --2- 172.21.15.77:0/3524993122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd09c0afa70 0x7fd09c14ac10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd09002ae20 tx=0x7fd09c0c8f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:53.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.248+0000 7fd083fff640 1 -- 172.21.15.77:0/3524993122 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd090042070 con 0x7fd09c0afa70 2024-04-25T01:41:53.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.248+0000 7fd083fff640 1 -- 172.21.15.77:0/3524993122 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd090007480 con 0x7fd09c0afa70 2024-04-25T01:41:53.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.248+0000 7fd0a1d9d640 1 -- 172.21.15.77:0/3524993122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd09c0c4c40 con 0x7fd09c0afa70 2024-04-25T01:41:53.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.248+0000 7fd083fff640 1 -- 172.21.15.77:0/3524993122 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd090001c70 con 0x7fd09c0afa70 2024-04-25T01:41:53.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.248+0000 7fd0a1d9d640 1 -- 172.21.15.77:0/3524993122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd09c0c5200 con 0x7fd09c0afa70 2024-04-25T01:41:53.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.249+0000 7fd0a1d9d640 1 -- 172.21.15.77:0/3524993122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd09c04f500 con 0x7fd09c0afa70 2024-04-25T01:41:53.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.249+0000 7fd083fff640 1 -- 172.21.15.77:0/3524993122 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd09003b050 con 0x7fd09c0afa70 2024-04-25T01:41:53.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.250+0000 7fd083fff640 1 --2- 172.21.15.77:0/3524993122 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd08806be30 0x7fd08806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:53.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.250+0000 7fd083fff640 1 -- 172.21.15.77:0/3524993122 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6895+0+0 (secure 0 0 0) 0x7fd0900abdf0 con 0x7fd09c0afa70 2024-04-25T01:41:53.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.250+0000 7fd09b7fe640 1 --2- 172.21.15.77:0/3524993122 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd08806be30 0x7fd08806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:53.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.250+0000 7fd09b7fe640 1 --2- 172.21.15.77:0/3524993122 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd08806be30 0x7fd08806e2f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0cb3d0 tx=0x7fd08c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:53.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.254+0000 7fd083fff640 1 -- 172.21.15.77:0/3524993122 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd09004b020 con 0x7fd09c0afa70 2024-04-25T01:41:53.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.464+0000 7fd0a1d9d640 1 -- 172.21.15.77:0/3524993122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd09c06cec0 con 0x7fd09c0afa70 2024-04-25T01:41:53.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.464+0000 7fd083fff640 1 -- 172.21.15.77:0/3524993122 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+6488 (secure 0 0 0) 0x7fd09007a310 con 0x7fd09c0afa70 2024-04-25T01:41:53.451 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:53.451 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5439,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:41:37.377243+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":38,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4250,"qdb_cluster":[4250]},"id":1},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:37.377244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5265,"qdb_cluster":[5265]},"id":2}]} 2024-04-25T01:41:53.452 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 23 2024-04-25T01:41:53.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.466+0000 7fd0a1d9d640 1 -- 172.21.15.77:0/3524993122 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd08806be30 msgr2=0x7fd08806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:53.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.466+0000 7fd0a1d9d640 1 --2- 172.21.15.77:0/3524993122 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd08806be30 0x7fd08806e2f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0cb3d0 tx=0x7fd08c008040 comp rx=0 tx=0).stop 2024-04-25T01:41:53.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.466+0000 7fd0a1d9d640 1 -- 172.21.15.77:0/3524993122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd09c0afa70 msgr2=0x7fd09c14ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:53.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.466+0000 7fd0a1d9d640 1 --2- 172.21.15.77:0/3524993122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd09c0afa70 0x7fd09c14ac10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd09002ae20 tx=0x7fd09c0c8f80 comp rx=0 tx=0).stop 2024-04-25T01:41:53.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.466+0000 7fd0a1d9d640 1 -- 172.21.15.77:0/3524993122 shutdown_connections 2024-04-25T01:41:53.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.466+0000 7fd0a1d9d640 1 --2- 172.21.15.77:0/3524993122 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd08806be30 0x7fd08806e2f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:53.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.466+0000 7fd0a1d9d640 1 --2- 172.21.15.77:0/3524993122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd09c0afa70 0x7fd09c14ac10 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:53.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.466+0000 7fd0a1d9d640 1 --2- 172.21.15.77:0/3524993122 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd09c0c5c10 0x7fd09c14b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:53.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.466+0000 7fd0a1d9d640 1 --2- 172.21.15.77:0/3524993122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd084004800 0x7fd09c0c2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:53.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.466+0000 7fd0a1d9d640 1 -- 172.21.15.77:0/3524993122 >> 172.21.15.77:0/3524993122 conn(0x7fd09c0ad4d0 msgr2=0x7fd09c154530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:53.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.467+0000 7fd0a1d9d640 1 -- 172.21.15.77:0/3524993122 shutdown_connections 2024-04-25T01:41:53.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:53.467+0000 7fd0a1d9d640 1 -- 172.21.15.77:0/3524993122 wait complete. 2024-04-25T01:41:53.464 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-25T01:41:54.294 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:41:54.294 INFO:tasks.workunit.client.1.smithi121.stdout: Children see throughput for 1 readers = 6904205.50 kB/sec 2024-04-25T01:41:54.295 INFO:tasks.workunit.client.1.smithi121.stdout: Parent sees throughput for 1 readers = 6894399.66 kB/sec 2024-04-25T01:41:54.295 INFO:tasks.workunit.client.1.smithi121.stdout: Min throughput per process = 6904205.50 kB/sec 2024-04-25T01:41:54.295 INFO:tasks.workunit.client.1.smithi121.stdout: Max throughput per process = 6904205.50 kB/sec 2024-04-25T01:41:54.295 INFO:tasks.workunit.client.1.smithi121.stdout: Avg throughput per process = 6904205.50 kB/sec 2024-04-25T01:41:54.295 INFO:tasks.workunit.client.1.smithi121.stdout: Min xfer = 1048576.00 kB 2024-04-25T01:41:55.465 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:55.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.586+0000 7efc76b42640 1 Processor -- start 2024-04-25T01:41:55.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.586+0000 7efc76b42640 1 -- start start 2024-04-25T01:41:55.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.587+0000 7efc76b42640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efc70150320 0x7efc70156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:55.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.587+0000 7efc76b42640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7efc7006d0a0 0x7efc7006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:55.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.587+0000 7efc76b42640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc70153be0 con 0x7efc70154380 2024-04-25T01:41:55.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.587+0000 7efc76b42640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7efc70152fd0 con 0x7efc7006d0a0 2024-04-25T01:41:55.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.587+0000 7efc76b42640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7efc701532b0 con 0x7efc70150320 2024-04-25T01:41:55.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.587+0000 7efc750df640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7efc70154380 0x7efc701547e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54782/0 (socket says 172.21.15.77:54782) 2024-04-25T01:41:55.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.587+0000 7efc750df640 1 -- 172.21.15.77:0/2245685439 learned_addr learned my addr 172.21.15.77:0/2245685439 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:41:55.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.587+0000 7efc748de640 1 --2- 172.21.15.77:0/2245685439 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efc70150320 0x7efc70156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:55.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.587+0000 7efc6ffff640 1 --2- 172.21.15.77:0/2245685439 >> v2:172.21.15.121:3300/0 conn(0x7efc7006d0a0 0x7efc7006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:55.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.588+0000 7efc6f7fe640 1 -- 172.21.15.77:0/2245685439 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 185892511 0 0) 0x7efc70153be0 con 0x7efc70154380 2024-04-25T01:41:55.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.588+0000 7efc6f7fe640 1 -- 172.21.15.77:0/2245685439 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc58003520 con 0x7efc70154380 2024-04-25T01:41:55.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.588+0000 7efc6f7fe640 1 -- 172.21.15.77:0/2245685439 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1900464504 0 0) 0x7efc58003520 con 0x7efc70154380 2024-04-25T01:41:55.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.588+0000 7efc6f7fe640 1 -- 172.21.15.77:0/2245685439 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efc70150320 msgr2=0x7efc70156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:55.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.588+0000 7efc6f7fe640 1 --2- 172.21.15.77:0/2245685439 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efc70150320 0x7efc70156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:55.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.588+0000 7efc6f7fe640 1 -- 172.21.15.77:0/2245685439 >> v2:172.21.15.121:3300/0 conn(0x7efc7006d0a0 msgr2=0x7efc7006d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:55.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.588+0000 7efc6f7fe640 1 --2- 172.21.15.77:0/2245685439 >> v2:172.21.15.121:3300/0 conn(0x7efc7006d0a0 0x7efc7006d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:55.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.588+0000 7efc6f7fe640 1 -- 172.21.15.77:0/2245685439 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc70157100 con 0x7efc70154380 2024-04-25T01:41:55.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.588+0000 7efc6f7fe640 1 -- 172.21.15.77:0/2245685439 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7efc680019f0 con 0x7efc70154380 2024-04-25T01:41:55.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.588+0000 7efc6f7fe640 1 -- 172.21.15.77:0/2245685439 >> v1:172.21.15.77:6789/0 conn(0x7efc70154380 legacy=0x7efc701547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:55.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.588+0000 7efc6f7fe640 1 --2- 172.21.15.77:0/2245685439 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc580039b0 0x7efc58003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:55.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.588+0000 7efc6f7fe640 1 --2- 172.21.15.77:0/2245685439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc58004800 0x7efc58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:55.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.588+0000 7efc6f7fe640 1 --2- 172.21.15.77:0/2245685439 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efc70150320 0x7efc580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:55.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.588+0000 7efc6f7fe640 1 -- 172.21.15.77:0/2245685439 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efc70152fd0 con 0x7efc58004800 2024-04-25T01:41:55.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.588+0000 7efc6f7fe640 1 -- 172.21.15.77:0/2245685439 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efc701532b0 con 0x7efc580039b0 2024-04-25T01:41:55.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.588+0000 7efc6f7fe640 1 -- 172.21.15.77:0/2245685439 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7efc5800b9c0 con 0x7efc70150320 2024-04-25T01:41:55.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.588+0000 7efc6ffff640 1 --2- 172.21.15.77:0/2245685439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc58004800 0x7efc58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:55.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.588+0000 7efc748de640 1 --2- 172.21.15.77:0/2245685439 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc580039b0 0x7efc58003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:55.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.588+0000 7efc750df640 1 --2- 172.21.15.77:0/2245685439 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efc70150320 0x7efc580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:55.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.588+0000 7efc6ffff640 1 -- 172.21.15.77:0/2245685439 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efc70150320 msgr2=0x7efc580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:55.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.588+0000 7efc6ffff640 1 --2- 172.21.15.77:0/2245685439 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efc70150320 0x7efc580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:55.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.588+0000 7efc6ffff640 1 -- 172.21.15.77:0/2245685439 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc580039b0 msgr2=0x7efc58003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:41:55.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.588+0000 7efc6ffff640 1 --2- 172.21.15.77:0/2245685439 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc580039b0 0x7efc58003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:55.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.588+0000 7efc6ffff640 1 -- 172.21.15.77:0/2245685439 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc58003520 con 0x7efc58004800 2024-04-25T01:41:55.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.588+0000 7efc748de640 1 --2- 172.21.15.77:0/2245685439 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc580039b0 0x7efc58003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:41:55.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.588+0000 7efc750df640 1 --2- 172.21.15.77:0/2245685439 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efc70150320 0x7efc580051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:41:55.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.589+0000 7efc6ffff640 1 --2- 172.21.15.77:0/2245685439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc58004800 0x7efc58004c80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7efc64009af0 tx=0x7efc58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d334bfbd0b69c82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:55.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.589+0000 7efc6f7fe640 1 -- 172.21.15.77:0/2245685439 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc64036070 con 0x7efc58004800 2024-04-25T01:41:55.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.589+0000 7efc6f7fe640 1 -- 172.21.15.77:0/2245685439 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc64031400 con 0x7efc58004800 2024-04-25T01:41:55.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.589+0000 7efc6f7fe640 1 -- 172.21.15.77:0/2245685439 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc64009690 con 0x7efc58004800 2024-04-25T01:41:55.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.590+0000 7efc76b42640 1 -- 172.21.15.77:0/2245685439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc58004800 msgr2=0x7efc58004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:55.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.590+0000 7efc76b42640 1 --2- 172.21.15.77:0/2245685439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc58004800 0x7efc58004c80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7efc64009af0 tx=0x7efc58005830 comp rx=0 tx=0).stop 2024-04-25T01:41:55.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.590+0000 7efc750df640 1 -- 172.21.15.77:0/2245685439 reap_dead start 2024-04-25T01:41:55.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.590+0000 7efc76b42640 1 -- 172.21.15.77:0/2245685439 shutdown_connections 2024-04-25T01:41:55.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.590+0000 7efc76b42640 1 -- 172.21.15.77:0/2245685439 >> 172.21.15.77:0/2245685439 conn(0x7efc700c3f80 msgr2=0x7efc700c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:55.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.590+0000 7efc76b42640 1 -- 172.21.15.77:0/2245685439 shutdown_connections 2024-04-25T01:41:55.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.590+0000 7efc76b42640 1 -- 172.21.15.77:0/2245685439 wait complete. 2024-04-25T01:41:55.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.591+0000 7efc76b42640 1 Processor -- start 2024-04-25T01:41:55.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.591+0000 7efc76b42640 1 -- start start 2024-04-25T01:41:55.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.592+0000 7efc76b42640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc58004800 0x7efc701e06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:55.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.592+0000 7efc76b42640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc70070e50 0x7efc701466f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:55.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.592+0000 7efc76b42640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efc700ab240 0x7efc70146c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:55.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.592+0000 7efc76b42640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efc70152bf0 con 0x7efc58004800 2024-04-25T01:41:55.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.592+0000 7efc76b42640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efc70153870 con 0x7efc70070e50 2024-04-25T01:41:55.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.592+0000 7efc76b42640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7efc70152d70 con 0x7efc700ab240 2024-04-25T01:41:55.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.592+0000 7efc748de640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc58004800 0x7efc701e06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:55.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.592+0000 7efc748de640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc58004800 0x7efc701e06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35854/0 (socket says 172.21.15.77:35854) 2024-04-25T01:41:55.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.592+0000 7efc748de640 1 -- 172.21.15.77:0/2947702839 learned_addr learned my addr 172.21.15.77:0/2947702839 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:55.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.592+0000 7efc750df640 1 --2- 172.21.15.77:0/2947702839 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efc700ab240 0x7efc70146c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:55.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.592+0000 7efc6ffff640 1 --2- 172.21.15.77:0/2947702839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc70070e50 0x7efc701466f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:55.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.592+0000 7efc748de640 1 -- 172.21.15.77:0/2947702839 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efc700ab240 msgr2=0x7efc70146c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:55.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.592+0000 7efc748de640 1 --2- 172.21.15.77:0/2947702839 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efc700ab240 0x7efc70146c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:55.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.592+0000 7efc748de640 1 -- 172.21.15.77:0/2947702839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc70070e50 msgr2=0x7efc701466f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:55.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.592+0000 7efc748de640 1 --2- 172.21.15.77:0/2947702839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc70070e50 0x7efc701466f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:55.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.592+0000 7efc748de640 1 -- 172.21.15.77:0/2947702839 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc700aad90 con 0x7efc58004800 2024-04-25T01:41:55.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.592+0000 7efc6ffff640 1 --2- 172.21.15.77:0/2947702839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc70070e50 0x7efc701466f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:41:55.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.592+0000 7efc748de640 1 --2- 172.21.15.77:0/2947702839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc58004800 0x7efc701e06c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7efc600116d0 tx=0x7efc60011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:55.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.592+0000 7efc6d7fa640 1 -- 172.21.15.77:0/2947702839 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6000f960 con 0x7efc58004800 2024-04-25T01:41:55.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.593+0000 7efc6d7fa640 1 -- 172.21.15.77:0/2947702839 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc6000fb00 con 0x7efc58004800 2024-04-25T01:41:55.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.593+0000 7efc76b42640 1 -- 172.21.15.77:0/2947702839 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc700aa7b0 con 0x7efc58004800 2024-04-25T01:41:55.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.593+0000 7efc6d7fa640 1 -- 172.21.15.77:0/2947702839 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc60015460 con 0x7efc58004800 2024-04-25T01:41:55.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.593+0000 7efc76b42640 1 -- 172.21.15.77:0/2947702839 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc701e0c00 con 0x7efc58004800 2024-04-25T01:41:55.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.594+0000 7efc76b42640 1 -- 172.21.15.77:0/2947702839 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc70153fe0 con 0x7efc58004800 2024-04-25T01:41:55.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.594+0000 7efc6d7fa640 1 -- 172.21.15.77:0/2947702839 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efc60015600 con 0x7efc58004800 2024-04-25T01:41:55.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.594+0000 7efc6d7fa640 1 --2- 172.21.15.77:0/2947702839 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7efc5c06be30 0x7efc5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:55.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.595+0000 7efc6ffff640 1 --2- 172.21.15.77:0/2947702839 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7efc5c06be30 0x7efc5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:55.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.595+0000 7efc6d7fa640 1 -- 172.21.15.77:0/2947702839 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6895+0+0 (secure 0 0 0) 0x7efc6008bb20 con 0x7efc58004800 2024-04-25T01:41:55.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.595+0000 7efc6ffff640 1 --2- 172.21.15.77:0/2947702839 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7efc5c06be30 0x7efc5c06e2f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efc64033000 tx=0x7efc64008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:55.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.599+0000 7efc6d7fa640 1 -- 172.21.15.77:0/2947702839 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7efc70153fe0 con 0x7efc58004800 2024-04-25T01:41:55.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.808+0000 7efc76b42640 1 -- 172.21.15.77:0/2947702839 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc7004f500 con 0x7efc58004800 2024-04-25T01:41:55.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.809+0000 7efc6d7fa640 1 -- 172.21.15.77:0/2947702839 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+6488 (secure 0 0 0) 0x7efc60019030 con 0x7efc58004800 2024-04-25T01:41:55.797 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:55.797 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5439,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:41:37.377243+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":38,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4250,"qdb_cluster":[4250]},"id":1},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:37.377244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5265,"qdb_cluster":[5265]},"id":2}]} 2024-04-25T01:41:55.797 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 23 2024-04-25T01:41:55.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.811+0000 7efc76b42640 1 -- 172.21.15.77:0/2947702839 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7efc5c06be30 msgr2=0x7efc5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:55.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.811+0000 7efc76b42640 1 --2- 172.21.15.77:0/2947702839 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7efc5c06be30 0x7efc5c06e2f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efc64033000 tx=0x7efc64008030 comp rx=0 tx=0).stop 2024-04-25T01:41:55.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.811+0000 7efc76b42640 1 -- 172.21.15.77:0/2947702839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc58004800 msgr2=0x7efc701e06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:55.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.811+0000 7efc76b42640 1 --2- 172.21.15.77:0/2947702839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc58004800 0x7efc701e06c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7efc600116d0 tx=0x7efc60011b90 comp rx=0 tx=0).stop 2024-04-25T01:41:55.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.811+0000 7efc76b42640 1 -- 172.21.15.77:0/2947702839 shutdown_connections 2024-04-25T01:41:55.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.811+0000 7efc76b42640 1 --2- 172.21.15.77:0/2947702839 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7efc5c06be30 0x7efc5c06e2f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:55.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.811+0000 7efc76b42640 1 --2- 172.21.15.77:0/2947702839 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efc700ab240 0x7efc70146c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:55.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.811+0000 7efc76b42640 1 --2- 172.21.15.77:0/2947702839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc70070e50 0x7efc701466f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:55.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.811+0000 7efc76b42640 1 --2- 172.21.15.77:0/2947702839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc58004800 0x7efc701e06c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:55.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.811+0000 7efc76b42640 1 -- 172.21.15.77:0/2947702839 >> 172.21.15.77:0/2947702839 conn(0x7efc700c3f80 msgr2=0x7efc7014eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:55.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.811+0000 7efc76b42640 1 -- 172.21.15.77:0/2947702839 shutdown_connections 2024-04-25T01:41:55.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:55.811+0000 7efc76b42640 1 -- 172.21.15.77:0/2947702839 wait complete. 2024-04-25T01:41:55.810 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-25T01:41:56.602 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:41:56.602 INFO:tasks.workunit.client.1.smithi121.stdout: Children see throughput for 1 re-readers = 7159621.00 kB/sec 2024-04-25T01:41:56.602 INFO:tasks.workunit.client.1.smithi121.stdout: Parent sees throughput for 1 re-readers = 7149170.08 kB/sec 2024-04-25T01:41:56.602 INFO:tasks.workunit.client.1.smithi121.stdout: Min throughput per process = 7159621.00 kB/sec 2024-04-25T01:41:56.602 INFO:tasks.workunit.client.1.smithi121.stdout: Max throughput per process = 7159621.00 kB/sec 2024-04-25T01:41:56.602 INFO:tasks.workunit.client.1.smithi121.stdout: Avg throughput per process = 7159621.00 kB/sec 2024-04-25T01:41:56.603 INFO:tasks.workunit.client.1.smithi121.stdout: Min xfer = 1048576.00 kB 2024-04-25T01:41:57.811 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:41:57.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.932+0000 7fcec9342640 1 Processor -- start 2024-04-25T01:41:57.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.932+0000 7fcec9342640 1 -- start start 2024-04-25T01:41:57.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.933+0000 7fcec9342640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcec4156c80 0x7fcec40c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:57.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.933+0000 7fcec9342640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcec4157130 con 0x7fcec406c280 2024-04-25T01:41:57.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.933+0000 7fcec9342640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcec40c9de0 con 0x7fcec4150090 2024-04-25T01:41:57.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.933+0000 7fcec9342640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fcec406b830 con 0x7fcec4156c80 2024-04-25T01:41:57.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.933+0000 7fcec37fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fcec406c280 0x7fcec40c6320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:48962/0 (socket says 172.21.15.77:48962) 2024-04-25T01:41:57.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.933+0000 7fcec37fe640 1 -- 172.21.15.77:0/3010313791 learned_addr learned my addr 172.21.15.77:0/3010313791 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:41:57.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.933+0000 7fcec27fc640 1 --2- 172.21.15.77:0/3010313791 >> v2:172.21.15.121:3300/0 conn(0x7fcec4156c80 0x7fcec40c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:57.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.934+0000 7fcec1ffb640 1 -- 172.21.15.77:0/3010313791 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3013845541 0 0) 0x7fcebc001110 con 0x7fcec406c280 2024-04-25T01:41:57.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.934+0000 7fcec1ffb640 1 -- 172.21.15.77:0/3010313791 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fceac003520 con 0x7fcec406c280 2024-04-25T01:41:57.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.934+0000 7fcec1ffb640 1 -- 172.21.15.77:0/3010313791 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2100397798 0 0) 0x7fceac003520 con 0x7fcec406c280 2024-04-25T01:41:57.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.934+0000 7fcec27fc640 1 -- 172.21.15.77:0/3010313791 >> v1:172.21.15.121:6789/0 conn(0x7fcec4150090 legacy=0x7fcec40c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:57.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.934+0000 7fcec27fc640 1 -- 172.21.15.77:0/3010313791 >> v1:172.21.15.77:6789/0 conn(0x7fcec406c280 legacy=0x7fcec40c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:57.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.934+0000 7fcec27fc640 1 -- 172.21.15.77:0/3010313791 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec40c89c0 con 0x7fcec4156c80 2024-04-25T01:41:57.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.935+0000 7fcec27fc640 1 --2- 172.21.15.77:0/3010313791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcec4156c80 0x7fcec40c98a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fceb80097a0 tx=0x7fceb802a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95f5198fc4f2c7e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:57.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.935+0000 7fcec1ffb640 1 -- 172.21.15.77:0/3010313791 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb8037070 con 0x7fcec4156c80 2024-04-25T01:41:57.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.935+0000 7fcec1ffb640 1 -- 172.21.15.77:0/3010313791 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb802ab60 con 0x7fcec4156c80 2024-04-25T01:41:57.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.935+0000 7fcec1ffb640 1 -- 172.21.15.77:0/3010313791 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc001840 con 0x7fcec4156c80 2024-04-25T01:41:57.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.935+0000 7fcec9342640 1 -- 172.21.15.77:0/3010313791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcec4156c80 msgr2=0x7fcec40c98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:57.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.935+0000 7fcec9342640 1 --2- 172.21.15.77:0/3010313791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcec4156c80 0x7fcec40c98a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fceb80097a0 tx=0x7fceb802a0d0 comp rx=0 tx=0).stop 2024-04-25T01:41:57.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.935+0000 7fcec9342640 1 -- 172.21.15.77:0/3010313791 shutdown_connections 2024-04-25T01:41:57.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.935+0000 7fcec9342640 1 --2- 172.21.15.77:0/3010313791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcec4156c80 0x7fcec40c98a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:57.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.935+0000 7fcec9342640 1 -- 172.21.15.77:0/3010313791 >> 172.21.15.77:0/3010313791 conn(0x7fcec40ad4d0 msgr2=0x7fcec40ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:57.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.935+0000 7fcec9342640 1 -- 172.21.15.77:0/3010313791 shutdown_connections 2024-04-25T01:41:57.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.935+0000 7fcec9342640 1 -- 172.21.15.77:0/3010313791 wait complete. 2024-04-25T01:41:57.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.937+0000 7fcec9342640 1 Processor -- start 2024-04-25T01:41:57.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.937+0000 7fcec9342640 1 -- start start 2024-04-25T01:41:57.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.937+0000 7fcec9342640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcec406c280 0x7fcec40c2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:57.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.937+0000 7fcec9342640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcec4150090 0x7fcec40c3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:57.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.937+0000 7fcec9342640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcec4156c80 0x7fcec41512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:57.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.937+0000 7fcec9342640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcec406bd60 con 0x7fcec4156c80 2024-04-25T01:41:57.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.937+0000 7fcec9342640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcec406ba80 con 0x7fcec4150090 2024-04-25T01:41:57.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.937+0000 7fcec9342640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fcec40c6a30 con 0x7fcec406c280 2024-04-25T01:41:57.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.937+0000 7fcec37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcec4156c80 0x7fcec41512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:57.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.938+0000 7fcec37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcec4156c80 0x7fcec41512f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44302/0 (socket says 172.21.15.77:44302) 2024-04-25T01:41:57.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.938+0000 7fcec37fe640 1 -- 172.21.15.77:0/1337081488 learned_addr learned my addr 172.21.15.77:0/1337081488 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:41:57.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.938+0000 7fcec2ffd640 1 --2- 172.21.15.77:0/1337081488 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcec406c280 0x7fcec40c2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:57.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.938+0000 7fcec27fc640 1 --2- 172.21.15.77:0/1337081488 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcec4150090 0x7fcec40c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:57.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.938+0000 7fcec37fe640 1 -- 172.21.15.77:0/1337081488 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcec406c280 msgr2=0x7fcec40c2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:57.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.938+0000 7fcec37fe640 1 --2- 172.21.15.77:0/1337081488 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcec406c280 0x7fcec40c2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:57.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.938+0000 7fcec37fe640 1 -- 172.21.15.77:0/1337081488 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcec4150090 msgr2=0x7fcec40c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:57.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.938+0000 7fcec37fe640 1 --2- 172.21.15.77:0/1337081488 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcec4150090 0x7fcec40c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:57.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.938+0000 7fcec37fe640 1 -- 172.21.15.77:0/1337081488 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec4152e90 con 0x7fcec4156c80 2024-04-25T01:41:57.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.938+0000 7fcec2ffd640 1 --2- 172.21.15.77:0/1337081488 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcec406c280 0x7fcec40c2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:41:57.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.938+0000 7fcec27fc640 1 --2- 172.21.15.77:0/1337081488 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcec4150090 0x7fcec40c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:41:57.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.938+0000 7fcec37fe640 1 --2- 172.21.15.77:0/1337081488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcec4156c80 0x7fcec41512f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00c430 tx=0x7fcebc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:57.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.938+0000 7fceab7fe640 1 -- 172.21.15.77:0/1337081488 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc0074e0 con 0x7fcec4156c80 2024-04-25T01:41:57.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.938+0000 7fceab7fe640 1 -- 172.21.15.77:0/1337081488 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcebc0047e0 con 0x7fcec4156c80 2024-04-25T01:41:57.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.938+0000 7fcec9342640 1 -- 172.21.15.77:0/1337081488 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcec4153170 con 0x7fcec4156c80 2024-04-25T01:41:57.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.938+0000 7fceab7fe640 1 -- 172.21.15.77:0/1337081488 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc004c50 con 0x7fcec4156c80 2024-04-25T01:41:57.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.938+0000 7fcec9342640 1 -- 172.21.15.77:0/1337081488 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcec40c5a80 con 0x7fcec4156c80 2024-04-25T01:41:57.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.939+0000 7fcec9342640 1 -- 172.21.15.77:0/1337081488 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcec404f500 con 0x7fcec4156c80 2024-04-25T01:41:57.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.940+0000 7fceab7fe640 1 -- 172.21.15.77:0/1337081488 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcebc011070 con 0x7fcec4156c80 2024-04-25T01:41:57.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.940+0000 7fceab7fe640 1 --2- 172.21.15.77:0/1337081488 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fceb006be30 0x7fceb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:41:57.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.940+0000 7fcec2ffd640 1 --2- 172.21.15.77:0/1337081488 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fceb006be30 0x7fceb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:41:57.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.940+0000 7fceab7fe640 1 -- 172.21.15.77:0/1337081488 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6895+0+0 (secure 0 0 0) 0x7fcebc08b030 con 0x7fcec4156c80 2024-04-25T01:41:57.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.941+0000 7fcec2ffd640 1 --2- 172.21.15.77:0/1337081488 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fceb006be30 0x7fceb006e2f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcec4154e00 tx=0x7fceb4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:41:57.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:57.945+0000 7fceab7fe640 1 -- 172.21.15.77:0/1337081488 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcec4157130 con 0x7fcec4156c80 2024-04-25T01:41:58.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:58.154+0000 7fcec9342640 1 -- 172.21.15.77:0/1337081488 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcec406cec0 con 0x7fcec4156c80 2024-04-25T01:41:58.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:58.154+0000 7fceab7fe640 1 -- 172.21.15.77:0/1337081488 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+6488 (secure 0 0 0) 0x7fcebc00e280 con 0x7fcec4156c80 2024-04-25T01:41:58.142 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:41:58.142 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5439,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:41:37.377243+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":38,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4250,"qdb_cluster":[4250]},"id":1},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:37.377244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5265,"qdb_cluster":[5265]},"id":2}]} 2024-04-25T01:41:58.143 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 23 2024-04-25T01:41:58.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:58.156+0000 7fcec9342640 1 -- 172.21.15.77:0/1337081488 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fceb006be30 msgr2=0x7fceb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:58.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:58.156+0000 7fcec9342640 1 --2- 172.21.15.77:0/1337081488 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fceb006be30 0x7fceb006e2f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcec4154e00 tx=0x7fceb4009040 comp rx=0 tx=0).stop 2024-04-25T01:41:58.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:58.156+0000 7fcec9342640 1 -- 172.21.15.77:0/1337081488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcec4156c80 msgr2=0x7fcec41512f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:41:58.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:58.156+0000 7fcec9342640 1 --2- 172.21.15.77:0/1337081488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcec4156c80 0x7fcec41512f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00c430 tx=0x7fcebc00c8f0 comp rx=0 tx=0).stop 2024-04-25T01:41:58.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:58.156+0000 7fcec9342640 1 -- 172.21.15.77:0/1337081488 shutdown_connections 2024-04-25T01:41:58.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:58.156+0000 7fcec9342640 1 --2- 172.21.15.77:0/1337081488 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fceb006be30 0x7fceb006e2f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:58.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:58.156+0000 7fcec9342640 1 --2- 172.21.15.77:0/1337081488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcec4156c80 0x7fcec41512f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:58.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:58.156+0000 7fcec9342640 1 --2- 172.21.15.77:0/1337081488 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcec4150090 0x7fcec40c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:58.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:58.156+0000 7fcec9342640 1 --2- 172.21.15.77:0/1337081488 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcec406c280 0x7fcec40c2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:41:58.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:58.156+0000 7fcec9342640 1 -- 172.21.15.77:0/1337081488 >> 172.21.15.77:0/1337081488 conn(0x7fcec40ad4d0 msgr2=0x7fcec40c6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:41:58.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:58.156+0000 7fcec9342640 1 -- 172.21.15.77:0/1337081488 shutdown_connections 2024-04-25T01:41:58.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:41:58.156+0000 7fcec9342640 1 -- 172.21.15.77:0/1337081488 wait complete. 2024-04-25T01:41:58.155 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-25T01:42:00.156 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:42:00.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.276+0000 7fbc5ac72640 1 Processor -- start 2024-04-25T01:42:00.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.276+0000 7fbc5ac72640 1 -- start start 2024-04-25T01:42:00.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.277+0000 7fbc5ac72640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc54150090 0x7fbc54156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:00.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.277+0000 7fbc5ac72640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbc5406c280 0x7fbc540c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:00.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.277+0000 7fbc5ac72640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc540c89c0 con 0x7fbc540c8200 2024-04-25T01:42:00.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.277+0000 7fbc5ac72640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fbc5406b830 con 0x7fbc5406c280 2024-04-25T01:42:00.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.277+0000 7fbc5ac72640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fbc540c8ca0 con 0x7fbc54150090 2024-04-25T01:42:00.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.278+0000 7fbc5920f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbc5406c280 0x7fbc540c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:00.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.278+0000 7fbc58a0e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc54150090 0x7fbc54156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:00.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.278+0000 7fbc53fff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fbc540c8200 0x7fbc540c98a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.77:60266/0 (socket says 172.21.15.77:60266) 2024-04-25T01:42:00.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.278+0000 7fbc53fff640 1 -- 172.21.15.77:0/336955392 learned_addr learned my addr 172.21.15.77:0/336955392 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:42:00.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.278+0000 7fbc5920f640 1 -- 172.21.15.77:0/336955392 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc54150090 msgr2=0x7fbc54156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:42:00.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.278+0000 7fbc5920f640 1 --2- 172.21.15.77:0/336955392 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc54150090 0x7fbc54156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:00.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.278+0000 7fbc5920f640 1 -- 172.21.15.77:0/336955392 >> v1:172.21.15.121:6789/0 conn(0x7fbc540c8200 legacy=0x7fbc540c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:00.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.278+0000 7fbc5920f640 1 -- 172.21.15.77:0/336955392 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc5406ba80 con 0x7fbc5406c280 2024-04-25T01:42:00.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.279+0000 7fbc5920f640 1 --2- 172.21.15.77:0/336955392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc5406c280 0x7fbc540c6320 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0097a0 tx=0x7fbc3c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b582a1165067eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:42:00.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.279+0000 7fbc537fe640 1 -- 172.21.15.77:0/336955392 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c037070 con 0x7fbc5406c280 2024-04-25T01:42:00.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.279+0000 7fbc537fe640 1 -- 172.21.15.77:0/336955392 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc3c032440 con 0x7fbc5406c280 2024-04-25T01:42:00.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.279+0000 7fbc537fe640 1 -- 172.21.15.77:0/336955392 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c032810 con 0x7fbc5406c280 2024-04-25T01:42:00.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.279+0000 7fbc5ac72640 1 -- 172.21.15.77:0/336955392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc5406c280 msgr2=0x7fbc540c6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:00.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.279+0000 7fbc5ac72640 1 --2- 172.21.15.77:0/336955392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc5406c280 0x7fbc540c6320 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0097a0 tx=0x7fbc3c02a180 comp rx=0 tx=0).stop 2024-04-25T01:42:00.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.280+0000 7fbc5ac72640 1 -- 172.21.15.77:0/336955392 shutdown_connections 2024-04-25T01:42:00.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.280+0000 7fbc5ac72640 1 --2- 172.21.15.77:0/336955392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc5406c280 0x7fbc540c6320 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:00.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.280+0000 7fbc5ac72640 1 --2- 172.21.15.77:0/336955392 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc54150090 0x7fbc54156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:00.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.280+0000 7fbc5ac72640 1 -- 172.21.15.77:0/336955392 >> 172.21.15.77:0/336955392 conn(0x7fbc540ad4d0 msgr2=0x7fbc540ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:42:00.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.280+0000 7fbc5ac72640 1 -- 172.21.15.77:0/336955392 shutdown_connections 2024-04-25T01:42:00.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.280+0000 7fbc5ac72640 1 -- 172.21.15.77:0/336955392 wait complete. 2024-04-25T01:42:00.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.281+0000 7fbc5ac72640 1 Processor -- start 2024-04-25T01:42:00.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.281+0000 7fbc5ac72640 1 -- start start 2024-04-25T01:42:00.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.282+0000 7fbc5ac72640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc5406c280 0x7fbc541ec8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:00.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.282+0000 7fbc5ac72640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc540c8200 0x7fbc540c1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:00.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.282+0000 7fbc5ac72640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc54150090 0x7fbc540c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:00.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.282+0000 7fbc5ac72640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5406c6f0 con 0x7fbc5406c280 2024-04-25T01:42:00.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.282+0000 7fbc5ac72640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbc540c8680 con 0x7fbc540c8200 2024-04-25T01:42:00.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.282+0000 7fbc5ac72640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fbc5406c870 con 0x7fbc54150090 2024-04-25T01:42:00.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.282+0000 7fbc58a0e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc5406c280 0x7fbc541ec8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:00.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.282+0000 7fbc58a0e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc5406c280 0x7fbc541ec8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44312/0 (socket says 172.21.15.77:44312) 2024-04-25T01:42:00.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.282+0000 7fbc58a0e640 1 -- 172.21.15.77:0/3778469813 learned_addr learned my addr 172.21.15.77:0/3778469813 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:42:00.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.282+0000 7fbc53fff640 1 --2- 172.21.15.77:0/3778469813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc540c8200 0x7fbc540c1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:00.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.282+0000 7fbc5920f640 1 --2- 172.21.15.77:0/3778469813 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc54150090 0x7fbc540c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:00.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.282+0000 7fbc58a0e640 1 -- 172.21.15.77:0/3778469813 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc54150090 msgr2=0x7fbc540c2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:00.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.282+0000 7fbc58a0e640 1 --2- 172.21.15.77:0/3778469813 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc54150090 0x7fbc540c2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:00.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.282+0000 7fbc58a0e640 1 -- 172.21.15.77:0/3778469813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc540c8200 msgr2=0x7fbc540c1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:00.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.282+0000 7fbc58a0e640 1 --2- 172.21.15.77:0/3778469813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc540c8200 0x7fbc540c1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:00.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.282+0000 7fbc58a0e640 1 -- 172.21.15.77:0/3778469813 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc541505a0 con 0x7fbc5406c280 2024-04-25T01:42:00.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.282+0000 7fbc53fff640 1 --2- 172.21.15.77:0/3778469813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc540c8200 0x7fbc540c1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:42:00.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.282+0000 7fbc5920f640 1 --2- 172.21.15.77:0/3778469813 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc54150090 0x7fbc540c2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:42:00.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.282+0000 7fbc58a0e640 1 --2- 172.21.15.77:0/3778469813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc5406c280 0x7fbc541ec8e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c009d10 tx=0x7fbc4c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:42:00.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.282+0000 7fbc517fa640 1 -- 172.21.15.77:0/3778469813 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c018020 con 0x7fbc5406c280 2024-04-25T01:42:00.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.282+0000 7fbc517fa640 1 -- 172.21.15.77:0/3778469813 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc4c014480 con 0x7fbc5406c280 2024-04-25T01:42:00.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.282+0000 7fbc5ac72640 1 -- 172.21.15.77:0/3778469813 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc541ebe00 con 0x7fbc5406c280 2024-04-25T01:42:00.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.282+0000 7fbc517fa640 1 -- 172.21.15.77:0/3778469813 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c014830 con 0x7fbc5406c280 2024-04-25T01:42:00.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.283+0000 7fbc5ac72640 1 -- 172.21.15.77:0/3778469813 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc541ec3c0 con 0x7fbc5406c280 2024-04-25T01:42:00.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.284+0000 7fbc5ac72640 1 -- 172.21.15.77:0/3778469813 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc5404f500 con 0x7fbc5406c280 2024-04-25T01:42:00.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.284+0000 7fbc517fa640 1 -- 172.21.15.77:0/3778469813 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc4c01b020 con 0x7fbc5406c280 2024-04-25T01:42:00.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.284+0000 7fbc517fa640 1 --2- 172.21.15.77:0/3778469813 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbc3406be30 0x7fbc3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:00.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.285+0000 7fbc517fa640 1 -- 172.21.15.77:0/3778469813 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6895+0+0 (secure 0 0 0) 0x7fbc4c08c160 con 0x7fbc5406c280 2024-04-25T01:42:00.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.285+0000 7fbc53fff640 1 --2- 172.21.15.77:0/3778469813 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbc3406be30 0x7fbc3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:00.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.285+0000 7fbc53fff640 1 --2- 172.21.15.77:0/3778469813 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbc3406be30 0x7fbc3406e2f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbc5415a770 tx=0x7fbc44009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:42:00.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.289+0000 7fbc517fa640 1 -- 172.21.15.77:0/3778469813 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbc4c022020 con 0x7fbc5406c280 2024-04-25T01:42:00.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.500+0000 7fbc5ac72640 1 -- 172.21.15.77:0/3778469813 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc5406cec0 con 0x7fbc5406c280 2024-04-25T01:42:00.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.500+0000 7fbc517fa640 1 -- 172.21.15.77:0/3778469813 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+6488 (secure 0 0 0) 0x7fbc4c010040 con 0x7fbc5406c280 2024-04-25T01:42:00.489 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:42:00.489 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5439,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:41:37.377243+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":38,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4250,"qdb_cluster":[4250]},"id":1},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:37.377244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5265,"qdb_cluster":[5265]},"id":2}]} 2024-04-25T01:42:00.489 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 23 2024-04-25T01:42:00.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.503+0000 7fbc5ac72640 1 -- 172.21.15.77:0/3778469813 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbc3406be30 msgr2=0x7fbc3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:00.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.503+0000 7fbc5ac72640 1 --2- 172.21.15.77:0/3778469813 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbc3406be30 0x7fbc3406e2f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbc5415a770 tx=0x7fbc44009040 comp rx=0 tx=0).stop 2024-04-25T01:42:00.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.503+0000 7fbc5ac72640 1 -- 172.21.15.77:0/3778469813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc5406c280 msgr2=0x7fbc541ec8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:00.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.503+0000 7fbc5ac72640 1 --2- 172.21.15.77:0/3778469813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc5406c280 0x7fbc541ec8e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c009d10 tx=0x7fbc4c00c490 comp rx=0 tx=0).stop 2024-04-25T01:42:00.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.503+0000 7fbc5ac72640 1 -- 172.21.15.77:0/3778469813 shutdown_connections 2024-04-25T01:42:00.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.503+0000 7fbc5ac72640 1 --2- 172.21.15.77:0/3778469813 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbc3406be30 0x7fbc3406e2f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:00.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.503+0000 7fbc5ac72640 1 --2- 172.21.15.77:0/3778469813 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc54150090 0x7fbc540c2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:00.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.503+0000 7fbc5ac72640 1 --2- 172.21.15.77:0/3778469813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc540c8200 0x7fbc540c1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:00.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.503+0000 7fbc5ac72640 1 --2- 172.21.15.77:0/3778469813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc5406c280 0x7fbc541ec8e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:00.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.503+0000 7fbc5ac72640 1 -- 172.21.15.77:0/3778469813 >> 172.21.15.77:0/3778469813 conn(0x7fbc540ad4d0 msgr2=0x7fbc540cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:42:00.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.503+0000 7fbc5ac72640 1 -- 172.21.15.77:0/3778469813 shutdown_connections 2024-04-25T01:42:00.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:00.503+0000 7fbc5ac72640 1 -- 172.21.15.77:0/3778469813 wait complete. 2024-04-25T01:42:00.502 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-25T01:42:02.502 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:42:02.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.622+0000 7f4630a2c640 1 Processor -- start 2024-04-25T01:42:02.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.622+0000 7f4630a2c640 1 -- start start 2024-04-25T01:42:02.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.623+0000 7f4630a2c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f462c06d0a0 0x7f462c06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:02.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.623+0000 7f4630a2c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f462c154380 0x7f462c154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:02.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.623+0000 7f4630a2c640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f462c153be0 con 0x7f462c150320 2024-04-25T01:42:02.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.623+0000 7f4630a2c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f462c152fd0 con 0x7f462c06d0a0 2024-04-25T01:42:02.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.623+0000 7f4630a2c640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f462c1532b0 con 0x7f462c154380 2024-04-25T01:42:02.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.623+0000 7f4623fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f462c06d0a0 0x7f462c06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:02.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.623+0000 7f4623fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f462c06d0a0 0x7f462c06d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44326/0 (socket says 172.21.15.77:44326) 2024-04-25T01:42:02.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.623+0000 7f4623fff640 1 -- 172.21.15.77:0/487369612 learned_addr learned my addr 172.21.15.77:0/487369612 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:42:02.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.624+0000 7f462ad9d640 1 --2- 172.21.15.77:0/487369612 >> v2:172.21.15.121:3300/0 conn(0x7f462c154380 0x7f462c154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:02.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.624+0000 7f4623fff640 1 -- 172.21.15.77:0/487369612 >> v2:172.21.15.121:3300/0 conn(0x7f462c154380 msgr2=0x7f462c154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:42:02.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.624+0000 7f4623fff640 1 --2- 172.21.15.77:0/487369612 >> v2:172.21.15.121:3300/0 conn(0x7f462c154380 0x7f462c154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:02.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.624+0000 7f4623fff640 1 -- 172.21.15.77:0/487369612 >> v1:172.21.15.121:6789/0 conn(0x7f462c150320 legacy=0x7f462c156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:42:02.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.624+0000 7f4623fff640 1 -- 172.21.15.77:0/487369612 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f462c153590 con 0x7f462c06d0a0 2024-04-25T01:42:02.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.624+0000 7f4623fff640 1 --2- 172.21.15.77:0/487369612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f462c06d0a0 0x7f462c06d4e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f462c0acf90 tx=0x7f461402c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f532259b8a088a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:42:02.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.625+0000 7f4629d9b640 1 -- 172.21.15.77:0/487369612 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4614033640 con 0x7f462c06d0a0 2024-04-25T01:42:02.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.625+0000 7f4629d9b640 1 -- 172.21.15.77:0/487369612 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4614038070 con 0x7f462c06d0a0 2024-04-25T01:42:02.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.625+0000 7f4629d9b640 1 -- 172.21.15.77:0/487369612 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4614033a00 con 0x7f462c06d0a0 2024-04-25T01:42:02.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.625+0000 7f4630a2c640 1 -- 172.21.15.77:0/487369612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f462c06d0a0 msgr2=0x7f462c06d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:02.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.625+0000 7f4630a2c640 1 --2- 172.21.15.77:0/487369612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f462c06d0a0 0x7f462c06d4e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f462c0acf90 tx=0x7f461402c8b0 comp rx=0 tx=0).stop 2024-04-25T01:42:02.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.625+0000 7f4630a2c640 1 -- 172.21.15.77:0/487369612 shutdown_connections 2024-04-25T01:42:02.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.625+0000 7f4630a2c640 1 --2- 172.21.15.77:0/487369612 >> v2:172.21.15.121:3300/0 conn(0x7f462c154380 0x7f462c154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:02.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.625+0000 7f4630a2c640 1 --2- 172.21.15.77:0/487369612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f462c06d0a0 0x7f462c06d4e0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:02.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.625+0000 7f4630a2c640 1 -- 172.21.15.77:0/487369612 >> 172.21.15.77:0/487369612 conn(0x7f462c0c3f80 msgr2=0x7f462c0c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:42:02.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.625+0000 7f4630a2c640 1 -- 172.21.15.77:0/487369612 shutdown_connections 2024-04-25T01:42:02.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.625+0000 7f4630a2c640 1 -- 172.21.15.77:0/487369612 wait complete. 2024-04-25T01:42:02.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.626+0000 7f4630a2c640 1 Processor -- start 2024-04-25T01:42:02.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.627+0000 7f4630a2c640 1 -- start start 2024-04-25T01:42:02.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.627+0000 7f4630a2c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f462c06d0a0 0x7f462c147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:02.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.627+0000 7f4630a2c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f462c150320 0x7f462c1eef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:02.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.627+0000 7f4630a2c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f462c154380 0x7f462c1ef490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:02.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.627+0000 7f4630a2c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f462c152d70 con 0x7f462c154380 2024-04-25T01:42:02.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.627+0000 7f4630a2c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f462c152bf0 con 0x7f462c150320 2024-04-25T01:42:02.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.627+0000 7f4630a2c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f462c0c3100 con 0x7f462c06d0a0 2024-04-25T01:42:02.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.627+0000 7f462ad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f462c154380 0x7f462c1ef490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:02.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.627+0000 7f462ad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f462c154380 0x7f462c1ef490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44334/0 (socket says 172.21.15.77:44334) 2024-04-25T01:42:02.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.627+0000 7f462ad9d640 1 -- 172.21.15.77:0/4038255272 learned_addr learned my addr 172.21.15.77:0/4038255272 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:42:02.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.628+0000 7f4623fff640 1 --2- 172.21.15.77:0/4038255272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f462c150320 0x7f462c1eef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:02.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.628+0000 7f462a59c640 1 --2- 172.21.15.77:0/4038255272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f462c06d0a0 0x7f462c147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:02.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.628+0000 7f462ad9d640 1 -- 172.21.15.77:0/4038255272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f462c06d0a0 msgr2=0x7f462c147b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:02.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.628+0000 7f462ad9d640 1 --2- 172.21.15.77:0/4038255272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f462c06d0a0 0x7f462c147b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:02.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.628+0000 7f462ad9d640 1 -- 172.21.15.77:0/4038255272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f462c150320 msgr2=0x7f462c1eef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:02.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.628+0000 7f462ad9d640 1 --2- 172.21.15.77:0/4038255272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f462c150320 0x7f462c1eef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:02.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.628+0000 7f462ad9d640 1 -- 172.21.15.77:0/4038255272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f462c0c7bd0 con 0x7f462c154380 2024-04-25T01:42:02.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.628+0000 7f462a59c640 1 --2- 172.21.15.77:0/4038255272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f462c06d0a0 0x7f462c147b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:42:02.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.628+0000 7f462ad9d640 1 --2- 172.21.15.77:0/4038255272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f462c154380 0x7f462c1ef490 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4624007e40 tx=0x7f462400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:42:02.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.628+0000 7f4622ffd640 1 -- 172.21.15.77:0/4038255272 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4624014620 con 0x7f462c154380 2024-04-25T01:42:02.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.628+0000 7f4622ffd640 1 -- 172.21.15.77:0/4038255272 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4624019070 con 0x7f462c154380 2024-04-25T01:42:02.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.628+0000 7f4622ffd640 1 -- 172.21.15.77:0/4038255272 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4624014a20 con 0x7f462c154380 2024-04-25T01:42:02.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.628+0000 7f4630a2c640 1 -- 172.21.15.77:0/4038255272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f462c0c5070 con 0x7f462c154380 2024-04-25T01:42:02.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.628+0000 7f4630a2c640 1 -- 172.21.15.77:0/4038255272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f462c0c5630 con 0x7f462c154380 2024-04-25T01:42:02.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.629+0000 7f4630a2c640 1 -- 172.21.15.77:0/4038255272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f462c0c5870 con 0x7f462c154380 2024-04-25T01:42:02.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.629+0000 7f4622ffd640 1 -- 172.21.15.77:0/4038255272 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4624014bc0 con 0x7f462c154380 2024-04-25T01:42:02.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.630+0000 7f4622ffd640 1 --2- 172.21.15.77:0/4038255272 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f460c06be30 0x7f460c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:02.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.630+0000 7f4622ffd640 1 -- 172.21.15.77:0/4038255272 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6895+0+0 (secure 0 0 0) 0x7f462408bb80 con 0x7f462c154380 2024-04-25T01:42:02.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.630+0000 7f462a59c640 1 --2- 172.21.15.77:0/4038255272 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f460c06be30 0x7f460c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:02.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.630+0000 7f462a59c640 1 --2- 172.21.15.77:0/4038255272 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f460c06be30 0x7f460c06e2f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f461c001680 tx=0x7f461c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:42:02.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.634+0000 7f4622ffd640 1 -- 172.21.15.77:0/4038255272 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f462405a120 con 0x7f462c154380 2024-04-25T01:42:02.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.842+0000 7f4630a2c640 1 -- 172.21.15.77:0/4038255272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f462c04f500 con 0x7f462c154380 2024-04-25T01:42:02.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.843+0000 7f4622ffd640 1 -- 172.21.15.77:0/4038255272 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+6488 (secure 0 0 0) 0x7f4624059a20 con 0x7f462c154380 2024-04-25T01:42:02.831 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:42:02.831 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5439,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:41:37.377243+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4250":{"gid":4250,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":38,"addr":"172.21.15.121:6834/1039950655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1039950655},{"type":"v1","addr":"172.21.15.121:6834","nonce":1039950655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4250,"qdb_cluster":[4250]},"id":1},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:37.377244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5265,"qdb_cluster":[5265]},"id":2}]} 2024-04-25T01:42:02.831 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 23 2024-04-25T01:42:02.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.845+0000 7f4630a2c640 1 -- 172.21.15.77:0/4038255272 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f460c06be30 msgr2=0x7f460c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:02.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.845+0000 7f4630a2c640 1 --2- 172.21.15.77:0/4038255272 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f460c06be30 0x7f460c06e2f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f461c001680 tx=0x7f461c009040 comp rx=0 tx=0).stop 2024-04-25T01:42:02.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.845+0000 7f4630a2c640 1 -- 172.21.15.77:0/4038255272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f462c154380 msgr2=0x7f462c1ef490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:02.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.845+0000 7f4630a2c640 1 --2- 172.21.15.77:0/4038255272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f462c154380 0x7f462c1ef490 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4624007e40 tx=0x7f462400e4b0 comp rx=0 tx=0).stop 2024-04-25T01:42:02.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.845+0000 7f4630a2c640 1 -- 172.21.15.77:0/4038255272 shutdown_connections 2024-04-25T01:42:02.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.845+0000 7f4630a2c640 1 --2- 172.21.15.77:0/4038255272 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f460c06be30 0x7f460c06e2f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:02.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.845+0000 7f4630a2c640 1 --2- 172.21.15.77:0/4038255272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f462c154380 0x7f462c1ef490 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:02.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.845+0000 7f4630a2c640 1 --2- 172.21.15.77:0/4038255272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f462c150320 0x7f462c1eef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:02.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.845+0000 7f4630a2c640 1 --2- 172.21.15.77:0/4038255272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f462c06d0a0 0x7f462c147b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:02.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.845+0000 7f4630a2c640 1 -- 172.21.15.77:0/4038255272 >> 172.21.15.77:0/4038255272 conn(0x7f462c0c3f80 msgr2=0x7f462c14f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:42:02.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.845+0000 7f4630a2c640 1 -- 172.21.15.77:0/4038255272 shutdown_connections 2024-04-25T01:42:02.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:02.845+0000 7f4630a2c640 1 -- 172.21.15.77:0/4038255272 wait complete. 2024-04-25T01:42:02.844 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-25T01:42:03.004 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:42:03.004 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:42:03.004 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:42:03.005 INFO:tasks.workunit.client.1.smithi121.stdout:iozone test complete. 2024-04-25T01:42:03.005 INFO:tasks.workunit.client.1.smithi121.stderr:+ iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-04-25T01:42:03.070 INFO:tasks.workunit.client.1.smithi121.stdout: Iozone: Performance Test of File I/O 2024-04-25T01:42:03.070 INFO:tasks.workunit.client.1.smithi121.stdout: Version $Revision: 3.494 $ 2024-04-25T01:42:03.071 INFO:tasks.workunit.client.1.smithi121.stdout: Compiled for 64 bit mode. 2024-04-25T01:42:03.071 INFO:tasks.workunit.client.1.smithi121.stdout: Build: linux-AMD64 2024-04-25T01:42:03.071 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:42:03.071 INFO:tasks.workunit.client.1.smithi121.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-04-25T01:42:03.071 INFO:tasks.workunit.client.1.smithi121.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-04-25T01:42:03.071 INFO:tasks.workunit.client.1.smithi121.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-04-25T01:42:03.071 INFO:tasks.workunit.client.1.smithi121.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-04-25T01:42:03.071 INFO:tasks.workunit.client.1.smithi121.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-04-25T01:42:03.071 INFO:tasks.workunit.client.1.smithi121.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-04-25T01:42:03.071 INFO:tasks.workunit.client.1.smithi121.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-04-25T01:42:03.072 INFO:tasks.workunit.client.1.smithi121.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-04-25T01:42:03.072 INFO:tasks.workunit.client.1.smithi121.stdout: Alexey Skidanov, Sudhir Kumar. 2024-04-25T01:42:03.072 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:42:03.072 INFO:tasks.workunit.client.1.smithi121.stdout: Run began: Thu Apr 25 01:42:03 2024 2024-04-25T01:42:03.072 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:42:03.072 INFO:tasks.workunit.client.1.smithi121.stdout: Include close in write timing 2024-04-25T01:42:03.072 INFO:tasks.workunit.client.1.smithi121.stdout: Include fsync in write timing 2024-04-25T01:42:03.072 INFO:tasks.workunit.client.1.smithi121.stdout: File size set to 1048576 kB 2024-04-25T01:42:03.072 INFO:tasks.workunit.client.1.smithi121.stdout: Record Size 1024 kB 2024-04-25T01:42:03.072 INFO:tasks.workunit.client.1.smithi121.stdout: Command line used: iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-04-25T01:42:03.073 INFO:tasks.workunit.client.1.smithi121.stdout: Output is in kBytes/sec 2024-04-25T01:42:03.073 INFO:tasks.workunit.client.1.smithi121.stdout: Time Resolution = 0.000001 seconds. 2024-04-25T01:42:03.073 INFO:tasks.workunit.client.1.smithi121.stdout: Processor cache size set to 1024 kBytes. 2024-04-25T01:42:03.073 INFO:tasks.workunit.client.1.smithi121.stdout: Processor cache line size set to 32 bytes. 2024-04-25T01:42:03.073 INFO:tasks.workunit.client.1.smithi121.stdout: File stride size set to 17 * record size. 2024-04-25T01:42:03.073 INFO:tasks.workunit.client.1.smithi121.stdout: Throughput test with 1 process 2024-04-25T01:42:03.073 INFO:tasks.workunit.client.1.smithi121.stdout: Each process writes a 1048576 kByte file in 1024 kByte records 2024-04-25T01:42:04.435 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:42:04.435 INFO:tasks.workunit.client.1.smithi121.stdout: Children see throughput for 1 initial writers = 786659.94 kB/sec 2024-04-25T01:42:04.435 INFO:tasks.workunit.client.1.smithi121.stdout: Parent sees throughput for 1 initial writers = 786540.79 kB/sec 2024-04-25T01:42:04.435 INFO:tasks.workunit.client.1.smithi121.stdout: Min throughput per process = 786659.94 kB/sec 2024-04-25T01:42:04.435 INFO:tasks.workunit.client.1.smithi121.stdout: Max throughput per process = 786659.94 kB/sec 2024-04-25T01:42:04.435 INFO:tasks.workunit.client.1.smithi121.stdout: Avg throughput per process = 786659.94 kB/sec 2024-04-25T01:42:04.435 INFO:tasks.workunit.client.1.smithi121.stdout: Min xfer = 1048576.00 kB 2024-04-25T01:42:04.845 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:42:04.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.954+0000 7f5b27eee640 1 Processor -- start 2024-04-25T01:42:04.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.954+0000 7f5b27eee640 1 -- start start 2024-04-25T01:42:04.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.955+0000 7f5b27eee640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5b2006d0a0 0x7f5b2006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:04.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.955+0000 7f5b27eee640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5b20154380 0x7f5b20154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:04.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.955+0000 7f5b27eee640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b20153be0 con 0x7f5b20150320 2024-04-25T01:42:04.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.955+0000 7f5b27eee640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f5b20152fd0 con 0x7f5b2006d0a0 2024-04-25T01:42:04.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.955+0000 7f5b27eee640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f5b201532b0 con 0x7f5b20154380 2024-04-25T01:42:04.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.955+0000 7f5b25489640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5b2006d0a0 0x7f5b2006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:04.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.955+0000 7f5b25489640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5b2006d0a0 0x7f5b2006d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44342/0 (socket says 172.21.15.77:44342) 2024-04-25T01:42:04.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.955+0000 7f5b25489640 1 -- 172.21.15.77:0/603747038 learned_addr learned my addr 172.21.15.77:0/603747038 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:42:04.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.955+0000 7f5b2648b640 1 --2- 172.21.15.77:0/603747038 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5b20154380 0x7f5b20154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:04.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.955+0000 7f5b25489640 1 -- 172.21.15.77:0/603747038 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5b20154380 msgr2=0x7f5b20154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:42:04.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.955+0000 7f5b25489640 1 --2- 172.21.15.77:0/603747038 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5b20154380 0x7f5b20154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:04.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.955+0000 7f5b25489640 1 -- 172.21.15.77:0/603747038 >> v1:172.21.15.121:6789/0 conn(0x7f5b20150320 legacy=0x7f5b20156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:42:04.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.955+0000 7f5b25489640 1 -- 172.21.15.77:0/603747038 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b20153590 con 0x7f5b2006d0a0 2024-04-25T01:42:04.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.955+0000 7f5b2648b640 1 --2- 172.21.15.77:0/603747038 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5b20154380 0x7f5b20154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:42:04.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.956+0000 7f5b25489640 1 --2- 172.21.15.77:0/603747038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b2006d0a0 0x7f5b2006d4e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009870 tx=0x7f5b1402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7ab95a8655a4d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:42:04.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.956+0000 7f5b24c88640 1 -- 172.21.15.77:0/603747038 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b14037070 con 0x7f5b2006d0a0 2024-04-25T01:42:04.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.956+0000 7f5b24c88640 1 -- 172.21.15.77:0/603747038 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b14032440 con 0x7f5b2006d0a0 2024-04-25T01:42:04.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.956+0000 7f5b24c88640 1 -- 172.21.15.77:0/603747038 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b14032810 con 0x7f5b2006d0a0 2024-04-25T01:42:04.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.957+0000 7f5b27eee640 1 -- 172.21.15.77:0/603747038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b2006d0a0 msgr2=0x7f5b2006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:04.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.957+0000 7f5b27eee640 1 --2- 172.21.15.77:0/603747038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b2006d0a0 0x7f5b2006d4e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009870 tx=0x7f5b1402a180 comp rx=0 tx=0).stop 2024-04-25T01:42:04.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.957+0000 7f5b27eee640 1 -- 172.21.15.77:0/603747038 shutdown_connections 2024-04-25T01:42:04.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.957+0000 7f5b27eee640 1 --2- 172.21.15.77:0/603747038 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5b20154380 0x7f5b20154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:04.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.957+0000 7f5b27eee640 1 --2- 172.21.15.77:0/603747038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b2006d0a0 0x7f5b2006d4e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:04.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.957+0000 7f5b27eee640 1 -- 172.21.15.77:0/603747038 >> 172.21.15.77:0/603747038 conn(0x7f5b200c3f80 msgr2=0x7f5b200c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:42:04.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.957+0000 7f5b27eee640 1 -- 172.21.15.77:0/603747038 shutdown_connections 2024-04-25T01:42:04.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.957+0000 7f5b27eee640 1 -- 172.21.15.77:0/603747038 wait complete. 2024-04-25T01:42:04.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.958+0000 7f5b27eee640 1 Processor -- start 2024-04-25T01:42:04.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.958+0000 7f5b27eee640 1 -- start start 2024-04-25T01:42:04.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.958+0000 7f5b27eee640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b2006d0a0 0x7f5b201e0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:04.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.958+0000 7f5b27eee640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b20150320 0x7f5b20151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:04.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.958+0000 7f5b27eee640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5b20154380 0x7f5b20147a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:04.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.958+0000 7f5b27eee640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5b20152d70 con 0x7f5b20150320 2024-04-25T01:42:04.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.958+0000 7f5b27eee640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5b20152bf0 con 0x7f5b2006d0a0 2024-04-25T01:42:04.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.958+0000 7f5b27eee640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f5b200c3100 con 0x7f5b20154380 2024-04-25T01:42:04.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.959+0000 7f5b25489640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b20150320 0x7f5b20151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:04.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.959+0000 7f5b25489640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b20150320 0x7f5b20151d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44358/0 (socket says 172.21.15.77:44358) 2024-04-25T01:42:04.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.959+0000 7f5b25489640 1 -- 172.21.15.77:0/1275202546 learned_addr learned my addr 172.21.15.77:0/1275202546 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:42:04.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.959+0000 7f5b25489640 1 -- 172.21.15.77:0/1275202546 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5b20154380 msgr2=0x7f5b20147a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:04.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.959+0000 7f5b25489640 1 --2- 172.21.15.77:0/1275202546 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5b20154380 0x7f5b20147a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:04.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.959+0000 7f5b25c8a640 1 --2- 172.21.15.77:0/1275202546 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b2006d0a0 0x7f5b201e0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:04.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.959+0000 7f5b25489640 1 -- 172.21.15.77:0/1275202546 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b2006d0a0 msgr2=0x7f5b201e0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:04.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.959+0000 7f5b25489640 1 --2- 172.21.15.77:0/1275202546 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b2006d0a0 0x7f5b201e0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:04.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.959+0000 7f5b25489640 1 -- 172.21.15.77:0/1275202546 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b20072210 con 0x7f5b20150320 2024-04-25T01:42:04.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.959+0000 7f5b25489640 1 --2- 172.21.15.77:0/1275202546 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b20150320 0x7f5b20151d20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009870 tx=0x7f5b140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:42:04.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.959+0000 7f5b1e7fc640 1 -- 172.21.15.77:0/1275202546 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b14041020 con 0x7f5b20150320 2024-04-25T01:42:04.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.959+0000 7f5b1e7fc640 1 -- 172.21.15.77:0/1275202546 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b14030970 con 0x7f5b20150320 2024-04-25T01:42:04.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.959+0000 7f5b1e7fc640 1 -- 172.21.15.77:0/1275202546 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b14037040 con 0x7f5b20150320 2024-04-25T01:42:04.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.959+0000 7f5b27eee640 1 -- 172.21.15.77:0/1275202546 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b20072d40 con 0x7f5b20150320 2024-04-25T01:42:04.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.959+0000 7f5b27eee640 1 -- 172.21.15.77:0/1275202546 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b20071ea0 con 0x7f5b20150320 2024-04-25T01:42:04.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.960+0000 7f5b27eee640 1 -- 172.21.15.77:0/1275202546 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b2004f500 con 0x7f5b20150320 2024-04-25T01:42:04.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.961+0000 7f5b1e7fc640 1 -- 172.21.15.77:0/1275202546 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5b14044020 con 0x7f5b20150320 2024-04-25T01:42:04.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.961+0000 7f5b1e7fc640 1 --2- 172.21.15.77:0/1275202546 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5b0c06be30 0x7f5b0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:04.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.961+0000 7f5b25c8a640 1 --2- 172.21.15.77:0/1275202546 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5b0c06be30 0x7f5b0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:04.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.961+0000 7f5b1e7fc640 1 -- 172.21.15.77:0/1275202546 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6981+0+0 (secure 0 0 0) 0x7f5b140abc90 con 0x7f5b20150320 2024-04-25T01:42:04.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.961+0000 7f5b25c8a640 1 --2- 172.21.15.77:0/1275202546 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5b0c06be30 0x7f5b0c06e2f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5b18007fd0 tx=0x7f5b18009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:42:04.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:04.965+0000 7f5b1e7fc640 1 -- 172.21.15.77:0/1275202546 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5b1404b030 con 0x7f5b20150320 2024-04-25T01:42:05.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.173+0000 7f5b27eee640 1 -- 172.21.15.77:0/1275202546 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b20068510 con 0x7f5b20150320 2024-04-25T01:42:05.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.174+0000 7f5b1e7fc640 1 -- 172.21.15.77:0/1275202546 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5652 (secure 0 0 0) 0x7f5b1407a1d0 con 0x7f5b20150320 2024-04-25T01:42:05.162 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:42:05.162 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:42:04.378300+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5439":{"gid":5439,"name":"a","rank":0,"incarnation":24,"state":"up:replay","state_seq":1,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:37.377244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5265,"qdb_cluster":[5265]},"id":2}]} 2024-04-25T01:42:05.162 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 24 2024-04-25T01:42:05.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.175+0000 7f5b27eee640 1 -- 172.21.15.77:0/1275202546 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5b0c06be30 msgr2=0x7f5b0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:05.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.175+0000 7f5b27eee640 1 --2- 172.21.15.77:0/1275202546 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5b0c06be30 0x7f5b0c06e2f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5b18007fd0 tx=0x7f5b18009040 comp rx=0 tx=0).stop 2024-04-25T01:42:05.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.175+0000 7f5b27eee640 1 -- 172.21.15.77:0/1275202546 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b20150320 msgr2=0x7f5b20151d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:05.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.175+0000 7f5b27eee640 1 --2- 172.21.15.77:0/1275202546 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b20150320 0x7f5b20151d20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009870 tx=0x7f5b140046c0 comp rx=0 tx=0).stop 2024-04-25T01:42:05.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.175+0000 7f5b27eee640 1 -- 172.21.15.77:0/1275202546 shutdown_connections 2024-04-25T01:42:05.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.175+0000 7f5b27eee640 1 --2- 172.21.15.77:0/1275202546 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5b0c06be30 0x7f5b0c06e2f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:05.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.175+0000 7f5b27eee640 1 --2- 172.21.15.77:0/1275202546 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b20150320 0x7f5b20151d20 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:05.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.175+0000 7f5b27eee640 1 --2- 172.21.15.77:0/1275202546 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5b20154380 0x7f5b20147a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:05.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.175+0000 7f5b27eee640 1 --2- 172.21.15.77:0/1275202546 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b2006d0a0 0x7f5b201e0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:05.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.176+0000 7f5b27eee640 1 -- 172.21.15.77:0/1275202546 >> 172.21.15.77:0/1275202546 conn(0x7f5b200c3f80 msgr2=0x7f5b2014cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:42:05.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.176+0000 7f5b27eee640 1 -- 172.21.15.77:0/1275202546 shutdown_connections 2024-04-25T01:42:05.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.176+0000 7f5b27eee640 1 -- 172.21.15.77:0/1275202546 wait complete. 2024-04-25T01:42:05.174 INFO:tasks.mds_thrash.fs.[a]:mds.b down, removed from mdsmap 2024-04-25T01:42:05.174 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2024-04-25T01:42:05.174 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:42:05.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.287+0000 7f3796095640 1 Processor -- start 2024-04-25T01:42:05.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.287+0000 7f3796095640 1 -- start start 2024-04-25T01:42:05.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.288+0000 7f3796095640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3790156c80 0x7f37900c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:05.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.288+0000 7f3796095640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3790157130 con 0x7f3790150090 2024-04-25T01:42:05.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.288+0000 7f3796095640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37900c9de0 con 0x7f379006c280 2024-04-25T01:42:05.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.288+0000 7f3796095640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f379006b830 con 0x7f3790156c80 2024-04-25T01:42:05.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.288+0000 7f378f7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3790150090 0x7f37900c8200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:48966/0 (socket says 172.21.15.77:48966) 2024-04-25T01:42:05.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.288+0000 7f378f7fe640 1 -- 172.21.15.77:0/2282221604 learned_addr learned my addr 172.21.15.77:0/2282221604 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:42:05.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.288+0000 7f378effd640 1 --2- 172.21.15.77:0/2282221604 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3790156c80 0x7f37900c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:05.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.288+0000 7f378e7fc640 1 -- 172.21.15.77:0/2282221604 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1742222598 0 0) 0x7f3780001110 con 0x7f3790150090 2024-04-25T01:42:05.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.288+0000 7f378e7fc640 1 -- 172.21.15.77:0/2282221604 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3778003520 con 0x7f3790150090 2024-04-25T01:42:05.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.288+0000 7f378e7fc640 1 -- 172.21.15.77:0/2282221604 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 472927156 0 0) 0x7f37900c9de0 con 0x7f379006c280 2024-04-25T01:42:05.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.288+0000 7f378e7fc640 1 -- 172.21.15.77:0/2282221604 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3780001110 con 0x7f379006c280 2024-04-25T01:42:05.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.289+0000 7f378effd640 1 -- 172.21.15.77:0/2282221604 >> v1:172.21.15.121:6789/0 conn(0x7f379006c280 legacy=0x7f37900c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:05.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.289+0000 7f378effd640 1 -- 172.21.15.77:0/2282221604 >> v1:172.21.15.77:6789/0 conn(0x7f3790150090 legacy=0x7f37900c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:05.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.289+0000 7f378effd640 1 -- 172.21.15.77:0/2282221604 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37900c89c0 con 0x7f3790156c80 2024-04-25T01:42:05.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.289+0000 7f378effd640 1 --2- 172.21.15.77:0/2282221604 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3790156c80 0x7f37900c98a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f379006b9b0 tx=0x7f378402a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd9b1491ca5e0b98 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:42:05.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.289+0000 7f378e7fc640 1 -- 172.21.15.77:0/2282221604 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3784037070 con 0x7f3790156c80 2024-04-25T01:42:05.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.289+0000 7f378e7fc640 1 -- 172.21.15.77:0/2282221604 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3784032440 con 0x7f3790156c80 2024-04-25T01:42:05.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.289+0000 7f378e7fc640 1 -- 172.21.15.77:0/2282221604 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3784032810 con 0x7f3790156c80 2024-04-25T01:42:05.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.290+0000 7f3796095640 1 -- 172.21.15.77:0/2282221604 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3790156c80 msgr2=0x7f37900c98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:05.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.290+0000 7f3796095640 1 --2- 172.21.15.77:0/2282221604 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3790156c80 0x7f37900c98a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f379006b9b0 tx=0x7f378402a200 comp rx=0 tx=0).stop 2024-04-25T01:42:05.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.290+0000 7f3796095640 1 -- 172.21.15.77:0/2282221604 shutdown_connections 2024-04-25T01:42:05.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.290+0000 7f3796095640 1 --2- 172.21.15.77:0/2282221604 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3790156c80 0x7f37900c98a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:05.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.290+0000 7f3796095640 1 -- 172.21.15.77:0/2282221604 >> 172.21.15.77:0/2282221604 conn(0x7f37900ad4d0 msgr2=0x7f37900ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:42:05.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.290+0000 7f3796095640 1 -- 172.21.15.77:0/2282221604 shutdown_connections 2024-04-25T01:42:05.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.290+0000 7f3796095640 1 -- 172.21.15.77:0/2282221604 wait complete. 2024-04-25T01:42:05.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.291+0000 7f3796095640 1 Processor -- start 2024-04-25T01:42:05.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.291+0000 7f3796095640 1 -- start start 2024-04-25T01:42:05.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.292+0000 7f3796095640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f379006c280 0x7f37901ec590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:05.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.292+0000 7f3796095640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3790150090 0x7f37900b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:05.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.292+0000 7f3796095640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3790156c80 0x7f3790157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:05.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.292+0000 7f3796095640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f379006bd60 con 0x7f379006c280 2024-04-25T01:42:05.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.292+0000 7f3796095640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f379006ba80 con 0x7f3790156c80 2024-04-25T01:42:05.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.292+0000 7f3796095640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f37900c6a30 con 0x7f3790150090 2024-04-25T01:42:05.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.292+0000 7f378f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f379006c280 0x7f37901ec590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:05.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.292+0000 7f378f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f379006c280 0x7f37901ec590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44370/0 (socket says 172.21.15.77:44370) 2024-04-25T01:42:05.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.292+0000 7f378f7fe640 1 -- 172.21.15.77:0/4079520772 learned_addr learned my addr 172.21.15.77:0/4079520772 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:42:05.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.292+0000 7f378effd640 1 --2- 172.21.15.77:0/4079520772 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3790150090 0x7f37900b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:05.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.292+0000 7f378ffff640 1 --2- 172.21.15.77:0/4079520772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3790156c80 0x7f3790157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:05.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.292+0000 7f378f7fe640 1 -- 172.21.15.77:0/4079520772 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3790150090 msgr2=0x7f37900b0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:05.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.292+0000 7f378f7fe640 1 --2- 172.21.15.77:0/4079520772 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3790150090 0x7f37900b0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:05.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.292+0000 7f378f7fe640 1 -- 172.21.15.77:0/4079520772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3790156c80 msgr2=0x7f3790157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:05.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.292+0000 7f378f7fe640 1 --2- 172.21.15.77:0/4079520772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3790156c80 0x7f3790157310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:05.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.292+0000 7f378f7fe640 1 -- 172.21.15.77:0/4079520772 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37901ebad0 con 0x7f379006c280 2024-04-25T01:42:05.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.293+0000 7f378f7fe640 1 --2- 172.21.15.77:0/4079520772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f379006c280 0x7f37901ec590 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f378000c730 tx=0x7f378000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:42:05.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.293+0000 7f3777fff640 1 -- 172.21.15.77:0/4079520772 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780017070 con 0x7f379006c280 2024-04-25T01:42:05.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.293+0000 7f3777fff640 1 -- 172.21.15.77:0/4079520772 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3780005ab0 con 0x7f379006c280 2024-04-25T01:42:05.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.293+0000 7f3777fff640 1 -- 172.21.15.77:0/4079520772 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780007070 con 0x7f379006c280 2024-04-25T01:42:05.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.293+0000 7f3796095640 1 -- 172.21.15.77:0/4079520772 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37901534d0 con 0x7f379006c280 2024-04-25T01:42:05.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.293+0000 7f3796095640 1 -- 172.21.15.77:0/4079520772 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37901ebd90 con 0x7f379006c280 2024-04-25T01:42:05.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.294+0000 7f3796095640 1 -- 172.21.15.77:0/4079520772 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f379004f500 con 0x7f379006c280 2024-04-25T01:42:05.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.295+0000 7f3777fff640 1 -- 172.21.15.77:0/4079520772 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f378001a070 con 0x7f379006c280 2024-04-25T01:42:05.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.295+0000 7f3777fff640 1 --2- 172.21.15.77:0/4079520772 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f377c06be30 0x7f377c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:05.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.295+0000 7f3777fff640 1 -- 172.21.15.77:0/4079520772 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6981+0+0 (secure 0 0 0) 0x7f378008aae0 con 0x7f379006c280 2024-04-25T01:42:05.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.295+0000 7f378effd640 1 --2- 172.21.15.77:0/4079520772 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f377c06be30 0x7f377c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:05.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.296+0000 7f378effd640 1 --2- 172.21.15.77:0/4079520772 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f377c06be30 0x7f377c06e2f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3784034000 tx=0x7f378402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:42:05.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.299+0000 7f3777fff640 1 -- 172.21.15.77:0/4079520772 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3790157130 con 0x7f379006c280 2024-04-25T01:42:05.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.574+0000 7f3796095640 1 -- 172.21.15.77:0/4079520772 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f379006cec0 con 0x7f379006c280 2024-04-25T01:42:05.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.575+0000 7f3777fff640 1 -- 172.21.15.77:0/4079520772 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5655 (secure 0 0 0) 0x7f3780059020 con 0x7f379006c280 2024-04-25T01:42:05.563 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:42:05.563 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:42:04.454598+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5439":{"gid":5439,"name":"a","rank":0,"incarnation":24,"state":"up:reconnect","state_seq":8,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:37.377244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5265,"qdb_cluster":[5265]},"id":2}]} 2024-04-25T01:42:05.563 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 25 2024-04-25T01:42:05.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.577+0000 7f3796095640 1 -- 172.21.15.77:0/4079520772 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f377c06be30 msgr2=0x7f377c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:05.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.577+0000 7f3796095640 1 --2- 172.21.15.77:0/4079520772 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f377c06be30 0x7f377c06e2f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3784034000 tx=0x7f378402e000 comp rx=0 tx=0).stop 2024-04-25T01:42:05.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.577+0000 7f3796095640 1 -- 172.21.15.77:0/4079520772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f379006c280 msgr2=0x7f37901ec590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:05.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.577+0000 7f3796095640 1 --2- 172.21.15.77:0/4079520772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f379006c280 0x7f37901ec590 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f378000c730 tx=0x7f378000cbf0 comp rx=0 tx=0).stop 2024-04-25T01:42:05.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.577+0000 7f3796095640 1 -- 172.21.15.77:0/4079520772 shutdown_connections 2024-04-25T01:42:05.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.577+0000 7f3796095640 1 --2- 172.21.15.77:0/4079520772 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f377c06be30 0x7f377c06e2f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:05.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.577+0000 7f3796095640 1 --2- 172.21.15.77:0/4079520772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3790156c80 0x7f3790157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:05.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.577+0000 7f3796095640 1 --2- 172.21.15.77:0/4079520772 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3790150090 0x7f37900b0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:05.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.577+0000 7f3796095640 1 --2- 172.21.15.77:0/4079520772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f379006c280 0x7f37901ec590 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:05.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.577+0000 7f3796095640 1 -- 172.21.15.77:0/4079520772 >> 172.21.15.77:0/4079520772 conn(0x7f37900ad4d0 msgr2=0x7f37901557c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:42:05.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.577+0000 7f3796095640 1 -- 172.21.15.77:0/4079520772 shutdown_connections 2024-04-25T01:42:05.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:05.577+0000 7f3796095640 1 -- 172.21.15.77:0/4079520772 wait complete. 2024-04-25T01:42:05.579 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 25, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T01:39:23.701997+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 25, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_5439": { "addr": "172.21.15.77:6835/1935321501", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6834", "nonce": 1935321501, "type": "v2" }, { "addr": "172.21.15.77:6835", "nonce": 1935321501, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5439, "incarnation": 24, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:reconnect", "state_seq": 8 } }, "last_failure": 0, "last_failure_osd_epoch": 29, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-25T01:42:04.454598+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5439 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T01:39:32.761220+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 21, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_5265": { "addr": "172.21.15.77:6837/2398109146", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6836", "nonce": 2398109146, "type": "v2" }, { "addr": "172.21.15.77:6837", "nonce": 2398109146, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5265, "incarnation": 18, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 28, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-04-25T01:41:37.377244+0000", "qdb_cluster": [ 5265 ], "qdb_leader": 5265, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5265 } } } ], "standbys": [ { "addr": "172.21.15.121:6835/1537604", "addrs": { "addrvec": [ { "addr": "172.21.15.121:6833", "nonce": 1537604, "type": "v2" }, { "addr": "172.21.15.121:6835", "nonce": 1537604, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 22, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5116, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-25T01:42:07.581 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:42:07.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.744+0000 7f04c1c38640 1 Processor -- start 2024-04-25T01:42:07.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.744+0000 7f04c1c38640 1 -- start start 2024-04-25T01:42:07.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.745+0000 7f04c1c38640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f04bc0c20f0 0x7f04bc0c33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:07.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.745+0000 7f04c1c38640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f04bc0c2b00 0x7f04bc0aaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.745+0000 7f04c1c38640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04bc0c3cb0 con 0x7f04bc0ac980 2024-04-25T01:42:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.745+0000 7f04c1c38640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f04bc0aa940 con 0x7f04bc0c20f0 2024-04-25T01:42:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.745+0000 7f04c1c38640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f04bc0c39d0 con 0x7f04bc0c2b00 2024-04-25T01:42:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.745+0000 7f04bbfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f04bc0ac980 0x7f04bc166830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36240/0 (socket says 172.21.15.77:36240) 2024-04-25T01:42:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.745+0000 7f04bbfff640 1 -- 172.21.15.77:0/454185100 learned_addr learned my addr 172.21.15.77:0/454185100 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:42:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.745+0000 7f04bb7fe640 1 --2- 172.21.15.77:0/454185100 >> v2:172.21.15.77:3300/0 conn(0x7f04bc0c20f0 0x7f04bc0c33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.746+0000 7f04ba7fc640 1 -- 172.21.15.77:0/454185100 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 530097849 0 0) 0x7f04b4001490 con 0x7f04bc0ac980 2024-04-25T01:42:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.746+0000 7f04baffd640 1 --2- 172.21.15.77:0/454185100 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f04bc0c2b00 0x7f04bc0aaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.809+0000 7f04ba7fc640 1 -- 172.21.15.77:0/454185100 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04a4003500 con 0x7f04bc0ac980 2024-04-25T01:42:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.809+0000 7f04bb7fe640 1 -- 172.21.15.77:0/454185100 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f04bc0c2b00 msgr2=0x7f04bc0aaaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:42:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.809+0000 7f04bb7fe640 1 --2- 172.21.15.77:0/454185100 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f04bc0c2b00 0x7f04bc0aaaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.809+0000 7f04bb7fe640 1 -- 172.21.15.77:0/454185100 >> v1:172.21.15.77:6789/0 conn(0x7f04bc0ac980 legacy=0x7f04bc166830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.809+0000 7f04ba7fc640 1 -- 172.21.15.77:0/454185100 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2541697494 0 0) 0x7f04a4003500 con 0x7f04bc0ac980 2024-04-25T01:42:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.809+0000 7f04bb7fe640 1 -- 172.21.15.77:0/454185100 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04bc0aa660 con 0x7f04bc0c20f0 2024-04-25T01:42:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.810+0000 7f04bb7fe640 1 --2- 172.21.15.77:0/454185100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04bc0c20f0 0x7f04bc0c33c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f04ac00a840 tx=0x7f04ac02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f551a2d6aff0e4ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:42:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.810+0000 7f04ba7fc640 1 -- 172.21.15.77:0/454185100 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ac037070 con 0x7f04bc0c20f0 2024-04-25T01:42:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.810+0000 7f04ba7fc640 1 -- 172.21.15.77:0/454185100 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04ac02ab20 con 0x7f04bc0c20f0 2024-04-25T01:42:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.810+0000 7f04ba7fc640 1 -- 172.21.15.77:0/454185100 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b4001bc0 con 0x7f04bc0c20f0 2024-04-25T01:42:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.812+0000 7f04c1c38640 1 -- 172.21.15.77:0/454185100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04bc0c20f0 msgr2=0x7f04bc0c33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.812+0000 7f04c1c38640 1 --2- 172.21.15.77:0/454185100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04bc0c20f0 0x7f04bc0c33c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f04ac00a840 tx=0x7f04ac02a2a0 comp rx=0 tx=0).stop 2024-04-25T01:42:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.812+0000 7f04c1c38640 1 -- 172.21.15.77:0/454185100 shutdown_connections 2024-04-25T01:42:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.812+0000 7f04c1c38640 1 --2- 172.21.15.77:0/454185100 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f04bc0c2b00 0x7f04bc0aaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.812+0000 7f04c1c38640 1 --2- 172.21.15.77:0/454185100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04bc0c20f0 0x7f04bc0c33c0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:07.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.812+0000 7f04c1c38640 1 -- 172.21.15.77:0/454185100 >> 172.21.15.77:0/454185100 conn(0x7f04bc0c3f80 msgr2=0x7f04bc0c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:42:07.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.812+0000 7f04c1c38640 1 -- 172.21.15.77:0/454185100 shutdown_connections 2024-04-25T01:42:07.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.812+0000 7f04c1c38640 1 -- 172.21.15.77:0/454185100 wait complete. 2024-04-25T01:42:07.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.814+0000 7f04c1c38640 1 Processor -- start 2024-04-25T01:42:07.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.815+0000 7f04c1c38640 1 -- start start 2024-04-25T01:42:07.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.816+0000 7f04c1c38640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04bc0ac980 0x7f04bc162ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:07.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.816+0000 7f04c1c38640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04bc0c20f0 0x7f04bc0720d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:07.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.816+0000 7f04c1c38640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f04bc0c2b00 0x7f04bc0bfc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:07.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.816+0000 7f04c1c38640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f04bc0c2650 con 0x7f04bc0ac980 2024-04-25T01:42:07.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.816+0000 7f04c1c38640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f04bc0c24d0 con 0x7f04bc0c20f0 2024-04-25T01:42:07.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.816+0000 7f04c1c38640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f04bc166f40 con 0x7f04bc0c2b00 2024-04-25T01:42:07.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.816+0000 7f04bb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04bc0ac980 0x7f04bc162ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:07.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.816+0000 7f04bb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04bc0ac980 0x7f04bc162ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59432/0 (socket says 172.21.15.77:59432) 2024-04-25T01:42:07.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.816+0000 7f04bb7fe640 1 -- 172.21.15.77:0/93752220 learned_addr learned my addr 172.21.15.77:0/93752220 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:42:07.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.816+0000 7f04bbfff640 1 --2- 172.21.15.77:0/93752220 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f04bc0c2b00 0x7f04bc0bfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:07.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.816+0000 7f04bb7fe640 1 -- 172.21.15.77:0/93752220 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f04bc0c2b00 msgr2=0x7f04bc0bfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:07.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.816+0000 7f04bb7fe640 1 --2- 172.21.15.77:0/93752220 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f04bc0c2b00 0x7f04bc0bfc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:07.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.816+0000 7f04bb7fe640 1 -- 172.21.15.77:0/93752220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04bc0c20f0 msgr2=0x7f04bc0720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:07.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.816+0000 7f04bb7fe640 1 --2- 172.21.15.77:0/93752220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04bc0c20f0 0x7f04bc0720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:07.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.816+0000 7f04bb7fe640 1 -- 172.21.15.77:0/93752220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04bc1fc370 con 0x7f04bc0ac980 2024-04-25T01:42:07.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.817+0000 7f04bb7fe640 1 --2- 172.21.15.77:0/93752220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04bc0ac980 0x7f04bc162ea0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f04ac00a840 tx=0x7f04ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:42:07.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.817+0000 7f04a3fff640 1 -- 172.21.15.77:0/93752220 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ac037040 con 0x7f04bc0ac980 2024-04-25T01:42:07.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.817+0000 7f04a3fff640 1 -- 172.21.15.77:0/93752220 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04ac042070 con 0x7f04bc0ac980 2024-04-25T01:42:07.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.817+0000 7f04c1c38640 1 -- 172.21.15.77:0/93752220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04bc1ef000 con 0x7f04bc0ac980 2024-04-25T01:42:07.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.817+0000 7f04c1c38640 1 -- 172.21.15.77:0/93752220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04bc072610 con 0x7f04bc0ac980 2024-04-25T01:42:07.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.817+0000 7f04a3fff640 1 -- 172.21.15.77:0/93752220 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ac00b040 con 0x7f04bc0ac980 2024-04-25T01:42:07.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.819+0000 7f04c1c38640 1 -- 172.21.15.77:0/93752220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f049c005290 con 0x7f04bc0ac980 2024-04-25T01:42:07.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.819+0000 7f04a3fff640 1 -- 172.21.15.77:0/93752220 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f04ac03d880 con 0x7f04bc0ac980 2024-04-25T01:42:07.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.820+0000 7f04a3fff640 1 --2- 172.21.15.77:0/93752220 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f04a806be30 0x7f04a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:07.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.820+0000 7f04a3fff640 1 -- 172.21.15.77:0/93752220 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6981+0+0 (secure 0 0 0) 0x7f04ac0aba90 con 0x7f04bc0ac980 2024-04-25T01:42:07.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.821+0000 7f04baffd640 1 --2- 172.21.15.77:0/93752220 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f04a806be30 0x7f04a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:07.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.821+0000 7f04baffd640 1 --2- 172.21.15.77:0/93752220 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f04a806be30 0x7f04a806e2f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f04b0006fd0 tx=0x7f04b0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:42:07.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:07.827+0000 7f04a3fff640 1 -- 172.21.15.77:0/93752220 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f04ac030e20 con 0x7f04bc0ac980 2024-04-25T01:42:07.866 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:42:07.866 INFO:tasks.workunit.client.1.smithi121.stdout: Children see throughput for 1 rewriters = 805317.62 kB/sec 2024-04-25T01:42:07.866 INFO:tasks.workunit.client.1.smithi121.stdout: Parent sees throughput for 1 rewriters = 805185.99 kB/sec 2024-04-25T01:42:07.866 INFO:tasks.workunit.client.1.smithi121.stdout: Min throughput per process = 805317.62 kB/sec 2024-04-25T01:42:07.866 INFO:tasks.workunit.client.1.smithi121.stdout: Max throughput per process = 805317.62 kB/sec 2024-04-25T01:42:07.866 INFO:tasks.workunit.client.1.smithi121.stdout: Avg throughput per process = 805317.62 kB/sec 2024-04-25T01:42:07.866 INFO:tasks.workunit.client.1.smithi121.stdout: Min xfer = 1048576.00 kB 2024-04-25T01:42:08.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:08.050+0000 7f04c1c38640 1 -- 172.21.15.77:0/93752220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f049c005850 con 0x7f04bc0ac980 2024-04-25T01:42:08.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:08.050+0000 7f04a3fff640 1 -- 172.21.15.77:0/93752220 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5660 (secure 0 0 0) 0x7f04ac079fd0 con 0x7f04bc0ac980 2024-04-25T01:42:08.039 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:42:08.039 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:42:07.395274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5439":{"gid":5439,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5439,"qdb_cluster":[5439]},"id":1},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:37.377244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5265,"qdb_cluster":[5265]},"id":2}]} 2024-04-25T01:42:08.039 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 27 2024-04-25T01:42:08.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:08.052+0000 7f04c1c38640 1 -- 172.21.15.77:0/93752220 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f04a806be30 msgr2=0x7f04a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:08.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:08.052+0000 7f04c1c38640 1 --2- 172.21.15.77:0/93752220 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f04a806be30 0x7f04a806e2f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f04b0006fd0 tx=0x7f04b0008040 comp rx=0 tx=0).stop 2024-04-25T01:42:08.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:08.052+0000 7f04c1c38640 1 -- 172.21.15.77:0/93752220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04bc0ac980 msgr2=0x7f04bc162ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:08.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:08.052+0000 7f04c1c38640 1 --2- 172.21.15.77:0/93752220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04bc0ac980 0x7f04bc162ea0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f04ac00a840 tx=0x7f04ac0046c0 comp rx=0 tx=0).stop 2024-04-25T01:42:08.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:08.052+0000 7f04c1c38640 1 -- 172.21.15.77:0/93752220 shutdown_connections 2024-04-25T01:42:08.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:08.053+0000 7f04c1c38640 1 --2- 172.21.15.77:0/93752220 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f04a806be30 0x7f04a806e2f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:08.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:08.053+0000 7f04c1c38640 1 --2- 172.21.15.77:0/93752220 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f04bc0c2b00 0x7f04bc0bfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:08.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:08.053+0000 7f04c1c38640 1 --2- 172.21.15.77:0/93752220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04bc0c20f0 0x7f04bc0720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:08.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:08.053+0000 7f04c1c38640 1 --2- 172.21.15.77:0/93752220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04bc0ac980 0x7f04bc162ea0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:08.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:08.053+0000 7f04c1c38640 1 -- 172.21.15.77:0/93752220 >> 172.21.15.77:0/93752220 conn(0x7f04bc0c3f80 msgr2=0x7f04bc08c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:42:08.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:08.053+0000 7f04c1c38640 1 -- 172.21.15.77:0/93752220 shutdown_connections 2024-04-25T01:42:08.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:08.053+0000 7f04c1c38640 1 -- 172.21.15.77:0/93752220 wait complete. 2024-04-25T01:42:08.052 INFO:tasks.mds_thrash.fs.[a]:mds.a has gained rank=0, replacing gid=4250 2024-04-25T01:42:08.052 INFO:tasks.mds_thrash.fs.[a]:waiting for 7 secs before reviving mds.b 2024-04-25T01:42:10.197 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:42:10.197 INFO:tasks.workunit.client.1.smithi121.stdout: Children see throughput for 1 readers = 7084062.00 kB/sec 2024-04-25T01:42:10.197 INFO:tasks.workunit.client.1.smithi121.stdout: Parent sees throughput for 1 readers = 7068112.02 kB/sec 2024-04-25T01:42:10.197 INFO:tasks.workunit.client.1.smithi121.stdout: Min throughput per process = 7084062.00 kB/sec 2024-04-25T01:42:10.197 INFO:tasks.workunit.client.1.smithi121.stdout: Max throughput per process = 7084062.00 kB/sec 2024-04-25T01:42:10.197 INFO:tasks.workunit.client.1.smithi121.stdout: Avg throughput per process = 7084062.00 kB/sec 2024-04-25T01:42:10.197 INFO:tasks.workunit.client.1.smithi121.stdout: Min xfer = 1048576.00 kB 2024-04-25T01:42:10.476 INFO:tasks.ceph.mds.a.smithi077.stderr:2024-04-25T01:42:10.487+0000 7fe41d624640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T01:42:11.869 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:42:11.870 INFO:tasks.workunit.client.0.smithi077.stdout: Children see throughput for 1 rewriters = 516391.06 kB/sec 2024-04-25T01:42:11.870 INFO:tasks.workunit.client.0.smithi077.stdout: Parent sees throughput for 1 rewriters = 516345.86 kB/sec 2024-04-25T01:42:11.870 INFO:tasks.workunit.client.0.smithi077.stdout: Min throughput per process = 516391.06 kB/sec 2024-04-25T01:42:11.870 INFO:tasks.workunit.client.0.smithi077.stdout: Max throughput per process = 516391.06 kB/sec 2024-04-25T01:42:11.870 INFO:tasks.workunit.client.0.smithi077.stdout: Avg throughput per process = 516391.06 kB/sec 2024-04-25T01:42:11.870 INFO:tasks.workunit.client.0.smithi077.stdout: Min xfer = 1048576.00 kB 2024-04-25T01:42:12.415 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:42:12.415 INFO:tasks.workunit.client.1.smithi121.stdout: Children see throughput for 1 re-readers = 7518943.00 kB/sec 2024-04-25T01:42:12.415 INFO:tasks.workunit.client.1.smithi121.stdout: Parent sees throughput for 1 re-readers = 7508122.56 kB/sec 2024-04-25T01:42:12.415 INFO:tasks.workunit.client.1.smithi121.stdout: Min throughput per process = 7518943.00 kB/sec 2024-04-25T01:42:12.416 INFO:tasks.workunit.client.1.smithi121.stdout: Max throughput per process = 7518943.00 kB/sec 2024-04-25T01:42:12.416 INFO:tasks.workunit.client.1.smithi121.stdout: Avg throughput per process = 7518943.00 kB/sec 2024-04-25T01:42:12.416 INFO:tasks.workunit.client.1.smithi121.stdout: Min xfer = 1048576.00 kB 2024-04-25T01:42:14.223 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:42:14.223 INFO:tasks.workunit.client.0.smithi077.stdout: Children see throughput for 1 readers = 6925634.00 kB/sec 2024-04-25T01:42:14.223 INFO:tasks.workunit.client.0.smithi077.stdout: Parent sees throughput for 1 readers = 6915724.15 kB/sec 2024-04-25T01:42:14.224 INFO:tasks.workunit.client.0.smithi077.stdout: Min throughput per process = 6925634.00 kB/sec 2024-04-25T01:42:14.224 INFO:tasks.workunit.client.0.smithi077.stdout: Max throughput per process = 6925634.00 kB/sec 2024-04-25T01:42:14.224 INFO:tasks.workunit.client.0.smithi077.stdout: Avg throughput per process = 6925634.00 kB/sec 2024-04-25T01:42:14.224 INFO:tasks.workunit.client.0.smithi077.stdout: Min xfer = 1048576.00 kB 2024-04-25T01:42:15.053 INFO:tasks.mds_thrash.fs.[a]:reviving mds.b 2024-04-25T01:42:15.053 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T01:42:15.053 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T01:42:15.056 INFO:tasks.ceph.mds.b:Started 2024-04-25T01:42:15.056 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:42:15.139 INFO:tasks.ceph.mds.b.smithi121.stdout:starting mds.b at 2024-04-25T01:42:15.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.167+0000 7f540075c640 1 Processor -- start 2024-04-25T01:42:15.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.167+0000 7f540075c640 1 -- start start 2024-04-25T01:42:15.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.168+0000 7f540075c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f53f8150090 0x7f53f8156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:15.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.168+0000 7f540075c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f53f806c280 0x7f53f80c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:15.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.168+0000 7f540075c640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53f80c89c0 con 0x7f53f80c8200 2024-04-25T01:42:15.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.168+0000 7f540075c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f53f806b830 con 0x7f53f8150090 2024-04-25T01:42:15.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.168+0000 7f540075c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f53f80c8ca0 con 0x7f53f806c280 2024-04-25T01:42:15.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.168+0000 7f53fe4f8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f53f8150090 0x7f53f8156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:15.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.168+0000 7f53fe4f8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f53f8150090 0x7f53f8156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59444/0 (socket says 172.21.15.77:59444) 2024-04-25T01:42:15.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.168+0000 7f53fe4f8640 1 -- 172.21.15.77:0/3613352261 learned_addr learned my addr 172.21.15.77:0/3613352261 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:42:15.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.168+0000 7f53fecf9640 1 --2- 172.21.15.77:0/3613352261 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f53f806c280 0x7f53f80c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:15.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.169+0000 7f53fe4f8640 1 -- 172.21.15.77:0/3613352261 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f53f806c280 msgr2=0x7f53f80c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:42:15.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.169+0000 7f53fe4f8640 1 --2- 172.21.15.77:0/3613352261 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f53f806c280 0x7f53f80c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:15.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.169+0000 7f53fe4f8640 1 -- 172.21.15.77:0/3613352261 >> v1:172.21.15.121:6789/0 conn(0x7f53f80c8200 legacy=0x7f53f80c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:15.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.169+0000 7f53fe4f8640 1 -- 172.21.15.77:0/3613352261 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f806ba80 con 0x7f53f8150090 2024-04-25T01:42:15.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.169+0000 7f53fe4f8640 1 --2- 172.21.15.77:0/3613352261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53f8150090 0x7f53f8156c80 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f53f4009e50 tx=0x7f53f402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a65c7e8e6b823887 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:42:15.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.169+0000 7f53fd4f6640 1 -- 172.21.15.77:0/3613352261 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f4036070 con 0x7f53f8150090 2024-04-25T01:42:15.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.169+0000 7f53fd4f6640 1 -- 172.21.15.77:0/3613352261 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53f4031600 con 0x7f53f8150090 2024-04-25T01:42:15.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.169+0000 7f53fd4f6640 1 -- 172.21.15.77:0/3613352261 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f40319d0 con 0x7f53f8150090 2024-04-25T01:42:15.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.170+0000 7f540075c640 1 -- 172.21.15.77:0/3613352261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53f8150090 msgr2=0x7f53f8156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:15.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.170+0000 7f540075c640 1 --2- 172.21.15.77:0/3613352261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53f8150090 0x7f53f8156c80 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f53f4009e50 tx=0x7f53f402a710 comp rx=0 tx=0).stop 2024-04-25T01:42:15.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.170+0000 7f540075c640 1 -- 172.21.15.77:0/3613352261 shutdown_connections 2024-04-25T01:42:15.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.170+0000 7f540075c640 1 --2- 172.21.15.77:0/3613352261 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f53f806c280 0x7f53f80c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:15.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.170+0000 7f540075c640 1 --2- 172.21.15.77:0/3613352261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53f8150090 0x7f53f8156c80 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:15.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.170+0000 7f540075c640 1 -- 172.21.15.77:0/3613352261 >> 172.21.15.77:0/3613352261 conn(0x7f53f80ad4d0 msgr2=0x7f53f80ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:42:15.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.170+0000 7f540075c640 1 -- 172.21.15.77:0/3613352261 shutdown_connections 2024-04-25T01:42:15.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.170+0000 7f540075c640 1 -- 172.21.15.77:0/3613352261 wait complete. 2024-04-25T01:42:15.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.171+0000 7f540075c640 1 Processor -- start 2024-04-25T01:42:15.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.171+0000 7f540075c640 1 -- start start 2024-04-25T01:42:15.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.172+0000 7f540075c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53f806c280 0x7f53f81ec0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:15.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.172+0000 7f540075c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f53f80c8200 0x7f53f80c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:15.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.172+0000 7f540075c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53f8150090 0x7f53f814cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:15.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.172+0000 7f540075c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f53f806c6b0 con 0x7f53f8150090 2024-04-25T01:42:15.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.172+0000 7f540075c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f53f80c86b0 con 0x7f53f806c280 2024-04-25T01:42:15.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.172+0000 7f540075c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f53f806c830 con 0x7f53f80c8200 2024-04-25T01:42:15.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.172+0000 7f53fecf9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53f8150090 0x7f53f814cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:15.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.172+0000 7f53fecf9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53f8150090 0x7f53f814cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59458/0 (socket says 172.21.15.77:59458) 2024-04-25T01:42:15.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.172+0000 7f53fecf9640 1 -- 172.21.15.77:0/2492401263 learned_addr learned my addr 172.21.15.77:0/2492401263 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:42:15.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.172+0000 7f53fe4f8640 1 --2- 172.21.15.77:0/2492401263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53f806c280 0x7f53f81ec0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:15.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.172+0000 7f53fdcf7640 1 --2- 172.21.15.77:0/2492401263 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f53f80c8200 0x7f53f80c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:15.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.172+0000 7f53fecf9640 1 -- 172.21.15.77:0/2492401263 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f53f80c8200 msgr2=0x7f53f80c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:15.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.172+0000 7f53fecf9640 1 --2- 172.21.15.77:0/2492401263 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f53f80c8200 0x7f53f80c4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:15.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.172+0000 7f53fecf9640 1 -- 172.21.15.77:0/2492401263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53f806c280 msgr2=0x7f53f81ec0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:15.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.172+0000 7f53fecf9640 1 --2- 172.21.15.77:0/2492401263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53f806c280 0x7f53f81ec0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:15.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.172+0000 7f53fecf9640 1 -- 172.21.15.77:0/2492401263 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f81e92b0 con 0x7f53f8150090 2024-04-25T01:42:15.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.172+0000 7f53fecf9640 1 --2- 172.21.15.77:0/2492401263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53f8150090 0x7f53f814cba0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f53f000d830 tx=0x7f53f000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:42:15.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.172+0000 7f53eeffd640 1 -- 172.21.15.77:0/2492401263 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f000b6c0 con 0x7f53f8150090 2024-04-25T01:42:15.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.172+0000 7f53eeffd640 1 -- 172.21.15.77:0/2492401263 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53f0019070 con 0x7f53f8150090 2024-04-25T01:42:15.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.172+0000 7f540075c640 1 -- 172.21.15.77:0/2492401263 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53f8152e50 con 0x7f53f8150090 2024-04-25T01:42:15.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.172+0000 7f53eeffd640 1 -- 172.21.15.77:0/2492401263 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f000bac0 con 0x7f53f8150090 2024-04-25T01:42:15.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.173+0000 7f540075c640 1 -- 172.21.15.77:0/2492401263 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53f81520d0 con 0x7f53f8150090 2024-04-25T01:42:15.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.173+0000 7f540075c640 1 -- 172.21.15.77:0/2492401263 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53f804f500 con 0x7f53f8150090 2024-04-25T01:42:15.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.174+0000 7f53eeffd640 1 -- 172.21.15.77:0/2492401263 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f53f001e460 con 0x7f53f8150090 2024-04-25T01:42:15.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.174+0000 7f53eeffd640 1 --2- 172.21.15.77:0/2492401263 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f53dc06be60 0x7f53dc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:15.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.175+0000 7f53fe4f8640 1 --2- 172.21.15.77:0/2492401263 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f53dc06be60 0x7f53dc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:15.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.175+0000 7f53eeffd640 1 -- 172.21.15.77:0/2492401263 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6981+0+0 (secure 0 0 0) 0x7f53f008b830 con 0x7f53f8150090 2024-04-25T01:42:15.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.175+0000 7f53fe4f8640 1 --2- 172.21.15.77:0/2492401263 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f53dc06be60 0x7f53dc06e320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f53f4033000 tx=0x7f53f4009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:42:15.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.179+0000 7f53eeffd640 1 -- 172.21.15.77:0/2492401263 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f53f81e92b0 con 0x7f53f8150090 2024-04-25T01:42:15.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.389+0000 7f540075c640 1 -- 172.21.15.77:0/2492401263 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f53f806cec0 con 0x7f53f8150090 2024-04-25T01:42:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.389+0000 7f53eeffd640 1 -- 172.21.15.77:0/2492401263 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5660 (secure 0 0 0) 0x7f53f0059690 con 0x7f53f8150090 2024-04-25T01:42:15.378 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:42:15.378 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:42:07.395274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5439":{"gid":5439,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5439,"qdb_cluster":[5439]},"id":1},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:37.377244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5265,"qdb_cluster":[5265]},"id":2}]} 2024-04-25T01:42:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 27 2024-04-25T01:42:15.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.391+0000 7f540075c640 1 -- 172.21.15.77:0/2492401263 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f53dc06be60 msgr2=0x7f53dc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:15.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.391+0000 7f540075c640 1 --2- 172.21.15.77:0/2492401263 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f53dc06be60 0x7f53dc06e320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f53f4033000 tx=0x7f53f4009000 comp rx=0 tx=0).stop 2024-04-25T01:42:15.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.391+0000 7f540075c640 1 -- 172.21.15.77:0/2492401263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53f8150090 msgr2=0x7f53f814cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:15.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.391+0000 7f540075c640 1 --2- 172.21.15.77:0/2492401263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53f8150090 0x7f53f814cba0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f53f000d830 tx=0x7f53f000dcf0 comp rx=0 tx=0).stop 2024-04-25T01:42:15.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.391+0000 7f540075c640 1 -- 172.21.15.77:0/2492401263 shutdown_connections 2024-04-25T01:42:15.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.391+0000 7f540075c640 1 --2- 172.21.15.77:0/2492401263 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f53dc06be60 0x7f53dc06e320 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:15.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.391+0000 7f540075c640 1 --2- 172.21.15.77:0/2492401263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53f8150090 0x7f53f814cba0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:15.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.391+0000 7f540075c640 1 --2- 172.21.15.77:0/2492401263 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f53f80c8200 0x7f53f80c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:15.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.391+0000 7f540075c640 1 --2- 172.21.15.77:0/2492401263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53f806c280 0x7f53f81ec0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:15.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.391+0000 7f540075c640 1 -- 172.21.15.77:0/2492401263 >> 172.21.15.77:0/2492401263 conn(0x7f53f80ad4d0 msgr2=0x7f53f80c6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:42:15.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.391+0000 7f540075c640 1 -- 172.21.15.77:0/2492401263 shutdown_connections 2024-04-25T01:42:15.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:15.391+0000 7f540075c640 1 -- 172.21.15.77:0/2492401263 wait complete. 2024-04-25T01:42:15.391 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is in active, standby or standby-replay 2024-04-25T01:42:16.520 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:42:16.520 INFO:tasks.workunit.client.0.smithi077.stdout: Children see throughput for 1 re-readers = 6930578.00 kB/sec 2024-04-25T01:42:16.521 INFO:tasks.workunit.client.0.smithi077.stdout: Parent sees throughput for 1 re-readers = 6921884.68 kB/sec 2024-04-25T01:42:16.521 INFO:tasks.workunit.client.0.smithi077.stdout: Min throughput per process = 6930578.00 kB/sec 2024-04-25T01:42:16.521 INFO:tasks.workunit.client.0.smithi077.stdout: Max throughput per process = 6930578.00 kB/sec 2024-04-25T01:42:16.521 INFO:tasks.workunit.client.0.smithi077.stdout: Avg throughput per process = 6930578.00 kB/sec 2024-04-25T01:42:16.521 INFO:tasks.workunit.client.0.smithi077.stdout: Min xfer = 1048576.00 kB 2024-04-25T01:42:17.391 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:42:17.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.509+0000 7f5582ea7640 1 Processor -- start 2024-04-25T01:42:17.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.509+0000 7f5582ea7640 1 -- start start 2024-04-25T01:42:17.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.509+0000 7f5582ea7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f557c06d0a0 0x7f557c06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:17.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.509+0000 7f5582ea7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f557c153be0 con 0x7f557c150320 2024-04-25T01:42:17.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.509+0000 7f5582ea7640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f557c152fd0 con 0x7f557c154380 2024-04-25T01:42:17.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.509+0000 7f5582ea7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f557c1532b0 con 0x7f557c06d0a0 2024-04-25T01:42:17.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.510+0000 7f557bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f557c06d0a0 0x7f557c06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:17.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.510+0000 7f557bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f557c06d0a0 0x7f557c06d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41128/0 (socket says 172.21.15.77:41128) 2024-04-25T01:42:17.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.510+0000 7f557bfff640 1 -- 172.21.15.77:0/1425069045 learned_addr learned my addr 172.21.15.77:0/1425069045 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:42:17.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.510+0000 7f557bfff640 1 -- 172.21.15.77:0/1425069045 >> v1:172.21.15.121:6789/0 conn(0x7f557c154380 legacy=0x7f557c154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:42:17.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.510+0000 7f557bfff640 1 -- 172.21.15.77:0/1425069045 >> v1:172.21.15.77:6789/0 conn(0x7f557c150320 legacy=0x7f557c156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:17.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.510+0000 7f557b7fe640 1 -- 172.21.15.77:0/1425069045 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2831946195 0 0) 0x7f557c153be0 con 0x7f557c150320 2024-04-25T01:42:17.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.510+0000 7f557bfff640 1 -- 172.21.15.77:0/1425069045 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f557c153590 con 0x7f557c06d0a0 2024-04-25T01:42:17.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.511+0000 7f557bfff640 1 --2- 172.21.15.77:0/1425069045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f557c06d0a0 0x7f557c06d4e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f557000bb10 tx=0x7f557002c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1ca3a85407fba6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:42:17.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.511+0000 7f557b7fe640 1 -- 172.21.15.77:0/1425069045 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5570032790 con 0x7f557c06d0a0 2024-04-25T01:42:17.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.511+0000 7f557b7fe640 1 -- 172.21.15.77:0/1425069045 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5570038070 con 0x7f557c06d0a0 2024-04-25T01:42:17.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.511+0000 7f557b7fe640 1 -- 172.21.15.77:0/1425069045 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5570032b50 con 0x7f557c06d0a0 2024-04-25T01:42:17.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.511+0000 7f5582ea7640 1 -- 172.21.15.77:0/1425069045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f557c06d0a0 msgr2=0x7f557c06d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:17.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.511+0000 7f5582ea7640 1 --2- 172.21.15.77:0/1425069045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f557c06d0a0 0x7f557c06d4e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f557000bb10 tx=0x7f557002c8d0 comp rx=0 tx=0).stop 2024-04-25T01:42:17.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.511+0000 7f5582ea7640 1 -- 172.21.15.77:0/1425069045 shutdown_connections 2024-04-25T01:42:17.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.511+0000 7f5582ea7640 1 --2- 172.21.15.77:0/1425069045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f557c06d0a0 0x7f557c06d4e0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:17.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.511+0000 7f5582ea7640 1 -- 172.21.15.77:0/1425069045 >> 172.21.15.77:0/1425069045 conn(0x7f557c0c3f80 msgr2=0x7f557c0c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:42:17.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.511+0000 7f5582ea7640 1 -- 172.21.15.77:0/1425069045 shutdown_connections 2024-04-25T01:42:17.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.511+0000 7f5582ea7640 1 -- 172.21.15.77:0/1425069045 wait complete. 2024-04-25T01:42:17.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.512+0000 7f5582ea7640 1 Processor -- start 2024-04-25T01:42:17.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.512+0000 7f5582ea7640 1 -- start start 2024-04-25T01:42:17.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.513+0000 7f5582ea7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f557c06d0a0 0x7f557c1e8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:17.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.513+0000 7f5582ea7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f557c150320 0x7f557c0ab3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:17.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.513+0000 7f5582ea7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f557c154380 0x7f557c1411e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:17.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.513+0000 7f5582ea7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f557c152bf0 con 0x7f557c150320 2024-04-25T01:42:17.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.513+0000 7f5582ea7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f557c154f40 con 0x7f557c06d0a0 2024-04-25T01:42:17.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.513+0000 7f5582ea7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f557c152d70 con 0x7f557c154380 2024-04-25T01:42:17.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.513+0000 7f557bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f557c150320 0x7f557c0ab3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:17.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.513+0000 7f557bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f557c150320 0x7f557c0ab3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41134/0 (socket says 172.21.15.77:41134) 2024-04-25T01:42:17.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.513+0000 7f557bfff640 1 -- 172.21.15.77:0/733022252 learned_addr learned my addr 172.21.15.77:0/733022252 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:42:17.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.514+0000 7f5580c43640 1 --2- 172.21.15.77:0/733022252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f557c06d0a0 0x7f557c1e8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:17.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.514+0000 7f5581444640 1 --2- 172.21.15.77:0/733022252 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f557c154380 0x7f557c1411e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:17.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.514+0000 7f557bfff640 1 -- 172.21.15.77:0/733022252 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f557c154380 msgr2=0x7f557c1411e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:17.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.514+0000 7f557bfff640 1 --2- 172.21.15.77:0/733022252 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f557c154380 0x7f557c1411e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:17.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.514+0000 7f557bfff640 1 -- 172.21.15.77:0/733022252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f557c06d0a0 msgr2=0x7f557c1e8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:17.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.514+0000 7f557bfff640 1 --2- 172.21.15.77:0/733022252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f557c06d0a0 0x7f557c1e8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:17.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.514+0000 7f557bfff640 1 -- 172.21.15.77:0/733022252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f557c14d6d0 con 0x7f557c150320 2024-04-25T01:42:17.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.514+0000 7f5580c43640 1 --2- 172.21.15.77:0/733022252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f557c06d0a0 0x7f557c1e8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:42:17.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.514+0000 7f5581444640 1 --2- 172.21.15.77:0/733022252 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f557c154380 0x7f557c1411e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:42:17.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.514+0000 7f557bfff640 1 --2- 172.21.15.77:0/733022252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f557c150320 0x7f557c0ab3f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f557000bb10 tx=0x7f55700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:42:17.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.514+0000 7f55797fa640 1 -- 172.21.15.77:0/733022252 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5570004230 con 0x7f557c150320 2024-04-25T01:42:17.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.514+0000 7f55797fa640 1 -- 172.21.15.77:0/733022252 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5570032e50 con 0x7f557c150320 2024-04-25T01:42:17.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.514+0000 7f5582ea7640 1 -- 172.21.15.77:0/733022252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f557c1eb5a0 con 0x7f557c150320 2024-04-25T01:42:17.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.514+0000 7f55797fa640 1 -- 172.21.15.77:0/733022252 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5570003610 con 0x7f557c150320 2024-04-25T01:42:17.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.514+0000 7f5582ea7640 1 -- 172.21.15.77:0/733022252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f557c1eb840 con 0x7f557c150320 2024-04-25T01:42:17.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.515+0000 7f5582ea7640 1 -- 172.21.15.77:0/733022252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f557c075330 con 0x7f557c150320 2024-04-25T01:42:17.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.515+0000 7f55797fa640 1 -- 172.21.15.77:0/733022252 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f557004d060 con 0x7f557c150320 2024-04-25T01:42:17.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.516+0000 7f55797fa640 1 --2- 172.21.15.77:0/733022252 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f556806be30 0x7f556806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:42:17.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.516+0000 7f55797fa640 1 -- 172.21.15.77:0/733022252 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6981+0+0 (secure 0 0 0) 0x7f55700adde0 con 0x7f557c150320 2024-04-25T01:42:17.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.516+0000 7f5580c43640 1 --2- 172.21.15.77:0/733022252 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f556806be30 0x7f556806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:42:17.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.516+0000 7f5580c43640 1 --2- 172.21.15.77:0/733022252 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f556806be30 0x7f556806e2f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f55740012e0 tx=0x7f5574009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:42:17.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.520+0000 7f55797fa640 1 -- 172.21.15.77:0/733022252 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f557c075330 con 0x7f557c150320 2024-04-25T01:42:17.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.738+0000 7f5582ea7640 1 -- 172.21.15.77:0/733022252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f557c04f500 con 0x7f557c150320 2024-04-25T01:42:17.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.739+0000 7f55797fa640 1 -- 172.21.15.77:0/733022252 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+6485 (secure 0 0 0) 0x7f557c14d6d0 con 0x7f557c150320 2024-04-25T01:42:17.727 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:42:17.727 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:42:07.395274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5439":{"gid":5439,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5439,"qdb_cluster":[5439]},"id":1},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:37.377244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5265,"qdb_cluster":[5265]},"id":2}]} 2024-04-25T01:42:17.728 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 28 2024-04-25T01:42:17.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.741+0000 7f5582ea7640 1 -- 172.21.15.77:0/733022252 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f556806be30 msgr2=0x7f556806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:17.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.741+0000 7f5582ea7640 1 --2- 172.21.15.77:0/733022252 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f556806be30 0x7f556806e2f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f55740012e0 tx=0x7f5574009040 comp rx=0 tx=0).stop 2024-04-25T01:42:17.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.741+0000 7f5582ea7640 1 -- 172.21.15.77:0/733022252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f557c150320 msgr2=0x7f557c0ab3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:42:17.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.741+0000 7f5582ea7640 1 --2- 172.21.15.77:0/733022252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f557c150320 0x7f557c0ab3f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f557000bb10 tx=0x7f55700046c0 comp rx=0 tx=0).stop 2024-04-25T01:42:17.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.741+0000 7f5582ea7640 1 -- 172.21.15.77:0/733022252 shutdown_connections 2024-04-25T01:42:17.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.741+0000 7f5582ea7640 1 --2- 172.21.15.77:0/733022252 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f556806be30 0x7f556806e2f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:17.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.741+0000 7f5582ea7640 1 --2- 172.21.15.77:0/733022252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f557c150320 0x7f557c0ab3f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:17.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.741+0000 7f5582ea7640 1 --2- 172.21.15.77:0/733022252 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f557c154380 0x7f557c1411e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:17.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.741+0000 7f5582ea7640 1 --2- 172.21.15.77:0/733022252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f557c06d0a0 0x7f557c1e8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:42:17.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.741+0000 7f5582ea7640 1 -- 172.21.15.77:0/733022252 >> 172.21.15.77:0/733022252 conn(0x7f557c0c3f80 msgr2=0x7f557c1519d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:42:17.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.741+0000 7f5582ea7640 1 -- 172.21.15.77:0/733022252 shutdown_connections 2024-04-25T01:42:17.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:42:17.741+0000 7f5582ea7640 1 -- 172.21.15.77:0/733022252 wait complete. 2024-04-25T01:42:17.740 INFO:tasks.mds_thrash.fs.[a]:mds.b reported in up:standby state 2024-04-25T01:42:17.741 INFO:tasks.mds_thrash.fs.[a]:waiting for 109 secs before thrashing 2024-04-25T01:42:19.161 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:42:19.161 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:42:19.161 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:42:19.161 INFO:tasks.workunit.client.1.smithi121.stdout:iozone test complete. 2024-04-25T01:42:19.161 INFO:tasks.workunit.client.1.smithi121.stderr:+ iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-04-25T01:42:19.226 INFO:tasks.workunit.client.1.smithi121.stdout: Iozone: Performance Test of File I/O 2024-04-25T01:42:19.226 INFO:tasks.workunit.client.1.smithi121.stdout: Version $Revision: 3.494 $ 2024-04-25T01:42:19.226 INFO:tasks.workunit.client.1.smithi121.stdout: Compiled for 64 bit mode. 2024-04-25T01:42:19.226 INFO:tasks.workunit.client.1.smithi121.stdout: Build: linux-AMD64 2024-04-25T01:42:19.226 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:42:19.226 INFO:tasks.workunit.client.1.smithi121.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-04-25T01:42:19.226 INFO:tasks.workunit.client.1.smithi121.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-04-25T01:42:19.227 INFO:tasks.workunit.client.1.smithi121.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-04-25T01:42:19.227 INFO:tasks.workunit.client.1.smithi121.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-04-25T01:42:19.227 INFO:tasks.workunit.client.1.smithi121.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-04-25T01:42:19.227 INFO:tasks.workunit.client.1.smithi121.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-04-25T01:42:19.227 INFO:tasks.workunit.client.1.smithi121.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-04-25T01:42:19.227 INFO:tasks.workunit.client.1.smithi121.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-04-25T01:42:19.227 INFO:tasks.workunit.client.1.smithi121.stdout: Alexey Skidanov, Sudhir Kumar. 2024-04-25T01:42:19.227 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:42:19.227 INFO:tasks.workunit.client.1.smithi121.stdout: Run began: Thu Apr 25 01:42:19 2024 2024-04-25T01:42:19.227 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:42:19.227 INFO:tasks.workunit.client.1.smithi121.stdout: Include close in write timing 2024-04-25T01:42:19.227 INFO:tasks.workunit.client.1.smithi121.stdout: Include fsync in write timing 2024-04-25T01:42:19.227 INFO:tasks.workunit.client.1.smithi121.stdout: File size set to 10485760 kB 2024-04-25T01:42:19.227 INFO:tasks.workunit.client.1.smithi121.stdout: Record Size 1024 kB 2024-04-25T01:42:19.228 INFO:tasks.workunit.client.1.smithi121.stdout: Command line used: iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-04-25T01:42:19.228 INFO:tasks.workunit.client.1.smithi121.stdout: Output is in kBytes/sec 2024-04-25T01:42:19.228 INFO:tasks.workunit.client.1.smithi121.stdout: Time Resolution = 0.000001 seconds. 2024-04-25T01:42:19.228 INFO:tasks.workunit.client.1.smithi121.stdout: Processor cache size set to 1024 kBytes. 2024-04-25T01:42:19.228 INFO:tasks.workunit.client.1.smithi121.stdout: Processor cache line size set to 32 bytes. 2024-04-25T01:42:19.228 INFO:tasks.workunit.client.1.smithi121.stdout: File stride size set to 17 * record size. 2024-04-25T01:42:19.228 INFO:tasks.workunit.client.1.smithi121.stdout: Throughput test with 1 process 2024-04-25T01:42:19.228 INFO:tasks.workunit.client.1.smithi121.stdout: Each process writes a 10485760 kByte file in 1024 kByte records 2024-04-25T01:42:20.191 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:42:20.195 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:42:24.377 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:42:24.377 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:42:24.378 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:42:24.378 INFO:tasks.workunit.client.0.smithi077.stdout:iozone test complete. 2024-04-25T01:42:24.378 INFO:tasks.workunit.client.0.smithi077.stderr:+ iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-04-25T01:42:24.453 INFO:tasks.workunit.client.0.smithi077.stdout: Iozone: Performance Test of File I/O 2024-04-25T01:42:24.453 INFO:tasks.workunit.client.0.smithi077.stdout: Version $Revision: 3.494 $ 2024-04-25T01:42:24.453 INFO:tasks.workunit.client.0.smithi077.stdout: Compiled for 64 bit mode. 2024-04-25T01:42:24.453 INFO:tasks.workunit.client.0.smithi077.stdout: Build: linux-AMD64 2024-04-25T01:42:24.453 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:42:24.454 INFO:tasks.workunit.client.0.smithi077.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-04-25T01:42:24.454 INFO:tasks.workunit.client.0.smithi077.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-04-25T01:42:24.454 INFO:tasks.workunit.client.0.smithi077.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-04-25T01:42:24.454 INFO:tasks.workunit.client.0.smithi077.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-04-25T01:42:24.454 INFO:tasks.workunit.client.0.smithi077.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-04-25T01:42:24.454 INFO:tasks.workunit.client.0.smithi077.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-04-25T01:42:24.454 INFO:tasks.workunit.client.0.smithi077.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-04-25T01:42:24.454 INFO:tasks.workunit.client.0.smithi077.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-04-25T01:42:24.454 INFO:tasks.workunit.client.0.smithi077.stdout: Alexey Skidanov, Sudhir Kumar. 2024-04-25T01:42:24.454 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:42:24.454 INFO:tasks.workunit.client.0.smithi077.stdout: Run began: Thu Apr 25 01:42:24 2024 2024-04-25T01:42:24.454 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:42:24.454 INFO:tasks.workunit.client.0.smithi077.stdout: Include close in write timing 2024-04-25T01:42:24.455 INFO:tasks.workunit.client.0.smithi077.stdout: Include fsync in write timing 2024-04-25T01:42:24.455 INFO:tasks.workunit.client.0.smithi077.stdout: File size set to 1048576 kB 2024-04-25T01:42:24.455 INFO:tasks.workunit.client.0.smithi077.stdout: Record Size 1024 kB 2024-04-25T01:42:24.455 INFO:tasks.workunit.client.0.smithi077.stdout: Command line used: iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-04-25T01:42:24.455 INFO:tasks.workunit.client.0.smithi077.stdout: Output is in kBytes/sec 2024-04-25T01:42:24.455 INFO:tasks.workunit.client.0.smithi077.stdout: Time Resolution = 0.000001 seconds. 2024-04-25T01:42:24.455 INFO:tasks.workunit.client.0.smithi077.stdout: Processor cache size set to 1024 kBytes. 2024-04-25T01:42:24.455 INFO:tasks.workunit.client.0.smithi077.stdout: Processor cache line size set to 32 bytes. 2024-04-25T01:42:24.455 INFO:tasks.workunit.client.0.smithi077.stdout: File stride size set to 17 * record size. 2024-04-25T01:42:24.455 INFO:tasks.workunit.client.0.smithi077.stdout: Throughput test with 1 process 2024-04-25T01:42:24.455 INFO:tasks.workunit.client.0.smithi077.stdout: Each process writes a 1048576 kByte file in 1024 kByte records 2024-04-25T01:42:28.033 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:42:28.034 INFO:tasks.workunit.client.0.smithi077.stdout: Children see throughput for 1 initial writers = 295865.50 kB/sec 2024-04-25T01:42:28.034 INFO:tasks.workunit.client.0.smithi077.stdout: Parent sees throughput for 1 initial writers = 295845.72 kB/sec 2024-04-25T01:42:28.034 INFO:tasks.workunit.client.0.smithi077.stdout: Min throughput per process = 295865.50 kB/sec 2024-04-25T01:42:28.034 INFO:tasks.workunit.client.0.smithi077.stdout: Max throughput per process = 295865.50 kB/sec 2024-04-25T01:42:28.034 INFO:tasks.workunit.client.0.smithi077.stdout: Avg throughput per process = 295865.50 kB/sec 2024-04-25T01:42:28.034 INFO:tasks.workunit.client.0.smithi077.stdout: Min xfer = 1048576.00 kB 2024-04-25T01:42:32.991 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:42:32.991 INFO:tasks.workunit.client.0.smithi077.stdout: Children see throughput for 1 rewriters = 442598.47 kB/sec 2024-04-25T01:42:32.991 INFO:tasks.workunit.client.0.smithi077.stdout: Parent sees throughput for 1 rewriters = 442533.85 kB/sec 2024-04-25T01:42:32.991 INFO:tasks.workunit.client.0.smithi077.stdout: Min throughput per process = 442598.47 kB/sec 2024-04-25T01:42:32.991 INFO:tasks.workunit.client.0.smithi077.stdout: Max throughput per process = 442598.47 kB/sec 2024-04-25T01:42:32.991 INFO:tasks.workunit.client.0.smithi077.stdout: Avg throughput per process = 442598.47 kB/sec 2024-04-25T01:42:32.991 INFO:tasks.workunit.client.0.smithi077.stdout: Min xfer = 1048576.00 kB 2024-04-25T01:42:33.484 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:42:33.485 INFO:tasks.workunit.client.1.smithi121.stdout: Children see throughput for 1 initial writers = 737080.44 kB/sec 2024-04-25T01:42:33.485 INFO:tasks.workunit.client.1.smithi121.stdout: Parent sees throughput for 1 initial writers = 737065.77 kB/sec 2024-04-25T01:42:33.485 INFO:tasks.workunit.client.1.smithi121.stdout: Min throughput per process = 737080.44 kB/sec 2024-04-25T01:42:33.485 INFO:tasks.workunit.client.1.smithi121.stdout: Max throughput per process = 737080.44 kB/sec 2024-04-25T01:42:33.485 INFO:tasks.workunit.client.1.smithi121.stdout: Avg throughput per process = 737080.44 kB/sec 2024-04-25T01:42:33.485 INFO:tasks.workunit.client.1.smithi121.stdout: Min xfer = 10485760.00 kB 2024-04-25T01:42:35.407 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:42:35.407 INFO:tasks.workunit.client.0.smithi077.stdout: Children see throughput for 1 readers = 7460046.50 kB/sec 2024-04-25T01:42:35.407 INFO:tasks.workunit.client.0.smithi077.stdout: Parent sees throughput for 1 readers = 7448549.10 kB/sec 2024-04-25T01:42:35.408 INFO:tasks.workunit.client.0.smithi077.stdout: Min throughput per process = 7460046.50 kB/sec 2024-04-25T01:42:35.408 INFO:tasks.workunit.client.0.smithi077.stdout: Max throughput per process = 7460046.50 kB/sec 2024-04-25T01:42:35.408 INFO:tasks.workunit.client.0.smithi077.stdout: Avg throughput per process = 7460046.50 kB/sec 2024-04-25T01:42:35.408 INFO:tasks.workunit.client.0.smithi077.stdout: Min xfer = 1048576.00 kB 2024-04-25T01:42:37.767 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:42:37.768 INFO:tasks.workunit.client.0.smithi077.stdout: Children see throughput for 1 re-readers = 5616395.50 kB/sec 2024-04-25T01:42:37.768 INFO:tasks.workunit.client.0.smithi077.stdout: Parent sees throughput for 1 re-readers = 5607687.47 kB/sec 2024-04-25T01:42:37.768 INFO:tasks.workunit.client.0.smithi077.stdout: Min throughput per process = 5616395.50 kB/sec 2024-04-25T01:42:37.768 INFO:tasks.workunit.client.0.smithi077.stdout: Max throughput per process = 5616395.50 kB/sec 2024-04-25T01:42:37.768 INFO:tasks.workunit.client.0.smithi077.stdout: Avg throughput per process = 5616395.50 kB/sec 2024-04-25T01:42:37.768 INFO:tasks.workunit.client.0.smithi077.stdout: Min xfer = 1048576.00 kB 2024-04-25T01:42:45.258 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:42:45.258 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:42:45.258 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:42:45.258 INFO:tasks.workunit.client.0.smithi077.stdout:iozone test complete. 2024-04-25T01:42:45.259 INFO:tasks.workunit.client.0.smithi077.stderr:+ iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-04-25T01:42:45.342 INFO:tasks.workunit.client.0.smithi077.stdout: Iozone: Performance Test of File I/O 2024-04-25T01:42:45.343 INFO:tasks.workunit.client.0.smithi077.stdout: Version $Revision: 3.494 $ 2024-04-25T01:42:45.343 INFO:tasks.workunit.client.0.smithi077.stdout: Compiled for 64 bit mode. 2024-04-25T01:42:45.343 INFO:tasks.workunit.client.0.smithi077.stdout: Build: linux-AMD64 2024-04-25T01:42:45.343 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:42:45.343 INFO:tasks.workunit.client.0.smithi077.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-04-25T01:42:45.343 INFO:tasks.workunit.client.0.smithi077.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-04-25T01:42:45.343 INFO:tasks.workunit.client.0.smithi077.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-04-25T01:42:45.343 INFO:tasks.workunit.client.0.smithi077.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-04-25T01:42:45.343 INFO:tasks.workunit.client.0.smithi077.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-04-25T01:42:45.343 INFO:tasks.workunit.client.0.smithi077.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-04-25T01:42:45.343 INFO:tasks.workunit.client.0.smithi077.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-04-25T01:42:45.343 INFO:tasks.workunit.client.0.smithi077.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-04-25T01:42:45.343 INFO:tasks.workunit.client.0.smithi077.stdout: Alexey Skidanov, Sudhir Kumar. 2024-04-25T01:42:45.344 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:42:45.344 INFO:tasks.workunit.client.0.smithi077.stdout: Run began: Thu Apr 25 01:42:45 2024 2024-04-25T01:42:45.344 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:42:45.344 INFO:tasks.workunit.client.0.smithi077.stdout: Include close in write timing 2024-04-25T01:42:45.344 INFO:tasks.workunit.client.0.smithi077.stdout: Include fsync in write timing 2024-04-25T01:42:45.344 INFO:tasks.workunit.client.0.smithi077.stdout: File size set to 10485760 kB 2024-04-25T01:42:45.344 INFO:tasks.workunit.client.0.smithi077.stdout: Record Size 1024 kB 2024-04-25T01:42:45.344 INFO:tasks.workunit.client.0.smithi077.stdout: Command line used: iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-04-25T01:42:45.344 INFO:tasks.workunit.client.0.smithi077.stdout: Output is in kBytes/sec 2024-04-25T01:42:45.344 INFO:tasks.workunit.client.0.smithi077.stdout: Time Resolution = 0.000001 seconds. 2024-04-25T01:42:45.344 INFO:tasks.workunit.client.0.smithi077.stdout: Processor cache size set to 1024 kBytes. 2024-04-25T01:42:45.344 INFO:tasks.workunit.client.0.smithi077.stdout: Processor cache line size set to 32 bytes. 2024-04-25T01:42:45.344 INFO:tasks.workunit.client.0.smithi077.stdout: File stride size set to 17 * record size. 2024-04-25T01:42:45.344 INFO:tasks.workunit.client.0.smithi077.stdout: Throughput test with 1 process 2024-04-25T01:42:45.344 INFO:tasks.workunit.client.0.smithi077.stdout: Each process writes a 10485760 kByte file in 1024 kByte records 2024-04-25T01:42:47.294 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:42:47.294 INFO:tasks.workunit.client.1.smithi121.stdout: Children see throughput for 1 rewriters = 902190.12 kB/sec 2024-04-25T01:42:47.294 INFO:tasks.workunit.client.1.smithi121.stdout: Parent sees throughput for 1 rewriters = 902169.66 kB/sec 2024-04-25T01:42:47.294 INFO:tasks.workunit.client.1.smithi121.stdout: Min throughput per process = 902190.12 kB/sec 2024-04-25T01:42:47.294 INFO:tasks.workunit.client.1.smithi121.stdout: Max throughput per process = 902190.12 kB/sec 2024-04-25T01:42:47.294 INFO:tasks.workunit.client.1.smithi121.stdout: Avg throughput per process = 902190.12 kB/sec 2024-04-25T01:42:47.294 INFO:tasks.workunit.client.1.smithi121.stdout: Min xfer = 10485760.00 kB 2024-04-25T01:42:50.608 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:42:50.612 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:42:51.463 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:42:51.464 INFO:tasks.workunit.client.1.smithi121.stdout: Children see throughput for 1 readers = 5588709.50 kB/sec 2024-04-25T01:42:51.464 INFO:tasks.workunit.client.1.smithi121.stdout: Parent sees throughput for 1 readers = 5587682.00 kB/sec 2024-04-25T01:42:51.464 INFO:tasks.workunit.client.1.smithi121.stdout: Min throughput per process = 5588709.50 kB/sec 2024-04-25T01:42:51.464 INFO:tasks.workunit.client.1.smithi121.stdout: Max throughput per process = 5588709.50 kB/sec 2024-04-25T01:42:51.464 INFO:tasks.workunit.client.1.smithi121.stdout: Avg throughput per process = 5588709.50 kB/sec 2024-04-25T01:42:51.464 INFO:tasks.workunit.client.1.smithi121.stdout: Min xfer = 10485760.00 kB 2024-04-25T01:42:55.843 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:42:55.843 INFO:tasks.workunit.client.1.smithi121.stdout: Children see throughput for 1 re-readers = 5883569.00 kB/sec 2024-04-25T01:42:55.843 INFO:tasks.workunit.client.1.smithi121.stdout: Parent sees throughput for 1 re-readers = 5882136.01 kB/sec 2024-04-25T01:42:55.843 INFO:tasks.workunit.client.1.smithi121.stdout: Min throughput per process = 5883569.00 kB/sec 2024-04-25T01:42:55.843 INFO:tasks.workunit.client.1.smithi121.stdout: Max throughput per process = 5883569.00 kB/sec 2024-04-25T01:42:55.843 INFO:tasks.workunit.client.1.smithi121.stdout: Avg throughput per process = 5883569.00 kB/sec 2024-04-25T01:42:55.843 INFO:tasks.workunit.client.1.smithi121.stdout: Min xfer = 10485760.00 kB 2024-04-25T01:42:59.296 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:42:59.296 INFO:tasks.workunit.client.0.smithi077.stdout: Children see throughput for 1 initial writers = 753573.19 kB/sec 2024-04-25T01:42:59.296 INFO:tasks.workunit.client.0.smithi077.stdout: Parent sees throughput for 1 initial writers = 753560.09 kB/sec 2024-04-25T01:42:59.296 INFO:tasks.workunit.client.0.smithi077.stdout: Min throughput per process = 753573.19 kB/sec 2024-04-25T01:42:59.296 INFO:tasks.workunit.client.0.smithi077.stdout: Max throughput per process = 753573.19 kB/sec 2024-04-25T01:42:59.296 INFO:tasks.workunit.client.0.smithi077.stdout: Avg throughput per process = 753573.19 kB/sec 2024-04-25T01:42:59.296 INFO:tasks.workunit.client.0.smithi077.stdout: Min xfer = 10485760.00 kB 2024-04-25T01:43:02.601 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:43:02.601 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:43:02.601 INFO:tasks.workunit.client.1.smithi121.stdout: 2024-04-25T01:43:02.601 INFO:tasks.workunit.client.1.smithi121.stdout:iozone test complete. 2024-04-25T01:43:02.602 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-25T01:43:02.602 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-04-25T01:43:02.650 INFO:tasks.workunit:Stopping ['suites/iozone.sh'] on client.1... 2024-04-25T01:43:02.650 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-04-25T01:43:03.148 DEBUG:teuthology.parallel:result is None 2024-04-25T01:43:13.797 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:43:13.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.940+0000 7fe44934c640 1 Processor -- start 2024-04-25T01:43:13.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.940+0000 7fe44934c640 1 -- start start 2024-04-25T01:43:13.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.941+0000 7fe44934c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe444071300 0x7fe444153800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:13.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.941+0000 7fe44934c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe44406ed60 con 0x7fe4440c3030 2024-04-25T01:43:13.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.941+0000 7fe44934c640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe44406f020 con 0x7fe44414ccd0 2024-04-25T01:43:13.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.941+0000 7fe44934c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe44406f300 con 0x7fe444071300 2024-04-25T01:43:13.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.941+0000 7fe4437fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe4440c3030 0x7fe4440c85c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:39016/0 (socket says 172.21.15.77:39016) 2024-04-25T01:43:13.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.941+0000 7fe4437fe640 1 -- 172.21.15.77:0/3473891885 learned_addr learned my addr 172.21.15.77:0/3473891885 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:43:13.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.942+0000 7fe43bfff640 1 --2- 172.21.15.77:0/3473891885 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe444071300 0x7fe444153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:13.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.942+0000 7fe4427fc640 1 -- 172.21.15.77:0/3473891885 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 695539823 0 0) 0x7fe44406ed60 con 0x7fe4440c3030 2024-04-25T01:43:13.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.942+0000 7fe4427fc640 1 -- 172.21.15.77:0/3473891885 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe430003520 con 0x7fe4440c3030 2024-04-25T01:43:13.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.942+0000 7fe4427fc640 1 -- 172.21.15.77:0/3473891885 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 240068470 0 0) 0x7fe44406f020 con 0x7fe44414ccd0 2024-04-25T01:43:13.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.942+0000 7fe4427fc640 1 -- 172.21.15.77:0/3473891885 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe44406ed60 con 0x7fe44414ccd0 2024-04-25T01:43:13.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.942+0000 7fe43bfff640 1 -- 172.21.15.77:0/3473891885 >> v1:172.21.15.121:6789/0 conn(0x7fe44414ccd0 legacy=0x7fe4441541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:13.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.942+0000 7fe43bfff640 1 -- 172.21.15.77:0/3473891885 >> v1:172.21.15.77:6789/0 conn(0x7fe4440c3030 legacy=0x7fe4440c85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:13.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.942+0000 7fe43bfff640 1 -- 172.21.15.77:0/3473891885 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe444153000 con 0x7fe444071300 2024-04-25T01:43:13.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.944+0000 7fe43bfff640 1 --2- 172.21.15.77:0/3473891885 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe444071300 0x7fe444153800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0097d0 tx=0x7fe42c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21854c2ee684769f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:13.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.944+0000 7fe4427fc640 1 -- 172.21.15.77:0/3473891885 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42c037070 con 0x7fe444071300 2024-04-25T01:43:13.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.944+0000 7fe4427fc640 1 -- 172.21.15.77:0/3473891885 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe42c02ae50 con 0x7fe444071300 2024-04-25T01:43:13.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.944+0000 7fe4427fc640 1 -- 172.21.15.77:0/3473891885 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42c032660 con 0x7fe444071300 2024-04-25T01:43:13.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.945+0000 7fe44934c640 1 -- 172.21.15.77:0/3473891885 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe444071300 msgr2=0x7fe444153800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:13.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.945+0000 7fe44934c640 1 --2- 172.21.15.77:0/3473891885 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe444071300 0x7fe444153800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0097d0 tx=0x7fe42c02a100 comp rx=0 tx=0).stop 2024-04-25T01:43:13.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.945+0000 7fe44934c640 1 -- 172.21.15.77:0/3473891885 shutdown_connections 2024-04-25T01:43:13.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.945+0000 7fe44934c640 1 --2- 172.21.15.77:0/3473891885 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe444071300 0x7fe444153800 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:13.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.945+0000 7fe44934c640 1 -- 172.21.15.77:0/3473891885 >> 172.21.15.77:0/3473891885 conn(0x7fe4440672f0 msgr2=0x7fe4440aa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:13.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.946+0000 7fe44934c640 1 -- 172.21.15.77:0/3473891885 shutdown_connections 2024-04-25T01:43:13.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.946+0000 7fe44934c640 1 -- 172.21.15.77:0/3473891885 wait complete. 2024-04-25T01:43:13.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.947+0000 7fe44934c640 1 Processor -- start 2024-04-25T01:43:13.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.947+0000 7fe44934c640 1 -- start start 2024-04-25T01:43:13.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.948+0000 7fe44934c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4440c3030 0x7fe4440c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:13.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.948+0000 7fe44934c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe44414ccd0 0x7fe4441dde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:13.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.948+0000 7fe44934c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4441de380 0x7fe4441dc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:13.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.948+0000 7fe44934c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe44414d0b0 con 0x7fe4440c3030 2024-04-25T01:43:13.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.948+0000 7fe44934c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe444152cf0 con 0x7fe4441de380 2024-04-25T01:43:13.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.948+0000 7fe44934c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe44414d230 con 0x7fe44414ccd0 2024-04-25T01:43:13.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.948+0000 7fe442ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4440c3030 0x7fe4440c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:13.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.948+0000 7fe442ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4440c3030 0x7fe4440c1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35240/0 (socket says 172.21.15.77:35240) 2024-04-25T01:43:13.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.948+0000 7fe442ffd640 1 -- 172.21.15.77:0/2176936445 learned_addr learned my addr 172.21.15.77:0/2176936445 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:13.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.948+0000 7fe43bfff640 1 --2- 172.21.15.77:0/2176936445 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe44414ccd0 0x7fe4441dde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:13.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.948+0000 7fe4437fe640 1 --2- 172.21.15.77:0/2176936445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4441de380 0x7fe4441dc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:13.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.948+0000 7fe442ffd640 1 -- 172.21.15.77:0/2176936445 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe44414ccd0 msgr2=0x7fe4441dde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:13.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.948+0000 7fe442ffd640 1 --2- 172.21.15.77:0/2176936445 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe44414ccd0 0x7fe4441dde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:13.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.948+0000 7fe442ffd640 1 -- 172.21.15.77:0/2176936445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4441de380 msgr2=0x7fe4441dc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:13.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.948+0000 7fe442ffd640 1 --2- 172.21.15.77:0/2176936445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4441de380 0x7fe4441dc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:13.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.948+0000 7fe442ffd640 1 -- 172.21.15.77:0/2176936445 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4441ef5f0 con 0x7fe4440c3030 2024-04-25T01:43:13.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.949+0000 7fe442ffd640 1 --2- 172.21.15.77:0/2176936445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4440c3030 0x7fe4440c1cd0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe43400c4c0 tx=0x7fe43400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:13.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.949+0000 7fe43b7fe640 1 -- 172.21.15.77:0/2176936445 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4340052d0 con 0x7fe4440c3030 2024-04-25T01:43:13.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.949+0000 7fe43b7fe640 1 -- 172.21.15.77:0/2176936445 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe434005470 con 0x7fe4440c3030 2024-04-25T01:43:13.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.949+0000 7fe43b7fe640 1 -- 172.21.15.77:0/2176936445 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe434012870 con 0x7fe4440c3030 2024-04-25T01:43:13.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.949+0000 7fe44934c640 1 -- 172.21.15.77:0/2176936445 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4441ef8d0 con 0x7fe4440c3030 2024-04-25T01:43:13.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.950+0000 7fe44934c640 1 -- 172.21.15.77:0/2176936445 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4441efe90 con 0x7fe4440c3030 2024-04-25T01:43:13.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.951+0000 7fe43b7fe640 1 -- 172.21.15.77:0/2176936445 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe434012a10 con 0x7fe4440c3030 2024-04-25T01:43:13.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.952+0000 7fe44934c640 1 -- 172.21.15.77:0/2176936445 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe444153800 con 0x7fe4440c3030 2024-04-25T01:43:13.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.952+0000 7fe43b7fe640 1 --2- 172.21.15.77:0/2176936445 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe42406be30 0x7fe42406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:13.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.952+0000 7fe43b7fe640 1 -- 172.21.15.77:0/2176936445 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6981+0+0 (secure 0 0 0) 0x7fe43408aff0 con 0x7fe4440c3030 2024-04-25T01:43:13.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.952+0000 7fe43bfff640 1 --2- 172.21.15.77:0/2176936445 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe42406be30 0x7fe42406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:13.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.953+0000 7fe43bfff640 1 --2- 172.21.15.77:0/2176936445 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe42406be30 0x7fe42406e2f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe42c034000 tx=0x7fe42c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:13.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:13.958+0000 7fe43b7fe640 1 -- 172.21.15.77:0/2176936445 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe444153800 con 0x7fe4440c3030 2024-04-25T01:43:14.027 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:43:14.027 INFO:tasks.workunit.client.0.smithi077.stdout: Children see throughput for 1 rewriters = 838153.88 kB/sec 2024-04-25T01:43:14.027 INFO:tasks.workunit.client.0.smithi077.stdout: Parent sees throughput for 1 rewriters = 838134.70 kB/sec 2024-04-25T01:43:14.027 INFO:tasks.workunit.client.0.smithi077.stdout: Min throughput per process = 838153.88 kB/sec 2024-04-25T01:43:14.027 INFO:tasks.workunit.client.0.smithi077.stdout: Max throughput per process = 838153.88 kB/sec 2024-04-25T01:43:14.028 INFO:tasks.workunit.client.0.smithi077.stdout: Avg throughput per process = 838153.88 kB/sec 2024-04-25T01:43:14.028 INFO:tasks.workunit.client.0.smithi077.stdout: Min xfer = 10485760.00 kB 2024-04-25T01:43:14.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.218+0000 7fe44934c640 1 -- 172.21.15.77:0/2176936445 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4441f01a0 con 0x7fe4440c3030 2024-04-25T01:43:14.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.219+0000 7fe43b7fe640 1 -- 172.21.15.77:0/2176936445 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+6485 (secure 0 0 0) 0x7fe434059410 con 0x7fe4440c3030 2024-04-25T01:43:14.209 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:43:14.209 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:42:07.395274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5439":{"gid":5439,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5439,"qdb_cluster":[5439]},"id":1},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:37.377244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5265,"qdb_cluster":[5265]},"id":2}]} 2024-04-25T01:43:14.210 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 28 2024-04-25T01:43:14.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.221+0000 7fe44934c640 1 -- 172.21.15.77:0/2176936445 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe42406be30 msgr2=0x7fe42406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:14.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.221+0000 7fe44934c640 1 --2- 172.21.15.77:0/2176936445 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe42406be30 0x7fe42406e2f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe42c034000 tx=0x7fe42c02e000 comp rx=0 tx=0).stop 2024-04-25T01:43:14.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.221+0000 7fe44934c640 1 -- 172.21.15.77:0/2176936445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4440c3030 msgr2=0x7fe4440c1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:14.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.221+0000 7fe44934c640 1 --2- 172.21.15.77:0/2176936445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4440c3030 0x7fe4440c1cd0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe43400c4c0 tx=0x7fe43400c980 comp rx=0 tx=0).stop 2024-04-25T01:43:14.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.221+0000 7fe44934c640 1 -- 172.21.15.77:0/2176936445 shutdown_connections 2024-04-25T01:43:14.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.221+0000 7fe44934c640 1 --2- 172.21.15.77:0/2176936445 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe42406be30 0x7fe42406e2f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:14.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.221+0000 7fe44934c640 1 --2- 172.21.15.77:0/2176936445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4441de380 0x7fe4441dc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:14.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.221+0000 7fe44934c640 1 --2- 172.21.15.77:0/2176936445 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe44414ccd0 0x7fe4441dde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:14.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.221+0000 7fe44934c640 1 --2- 172.21.15.77:0/2176936445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4440c3030 0x7fe4440c1cd0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:14.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.221+0000 7fe44934c640 1 -- 172.21.15.77:0/2176936445 >> 172.21.15.77:0/2176936445 conn(0x7fe4440672f0 msgr2=0x7fe4440c6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:14.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.222+0000 7fe44934c640 1 -- 172.21.15.77:0/2176936445 shutdown_connections 2024-04-25T01:43:14.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.222+0000 7fe44934c640 1 -- 172.21.15.77:0/2176936445 wait complete. 2024-04-25T01:43:14.224 INFO:tasks.mds_thrash.fs.[b]:kill mds.c (rank=0) 2024-04-25T01:43:14.225 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T01:43:14.225 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T01:43:14.240 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T01:43:14.241 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:43:14.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.388+0000 7fb842f42640 1 Processor -- start 2024-04-25T01:43:14.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.389+0000 7fb842f42640 1 -- start start 2024-04-25T01:43:14.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.389+0000 7fb842f42640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb83c06d0a0 0x7fb83c06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:14.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.389+0000 7fb842f42640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb83c154380 0x7fb83c154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:14.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.389+0000 7fb842f42640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb83c153be0 con 0x7fb83c150320 2024-04-25T01:43:14.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.389+0000 7fb842f42640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb83c152fd0 con 0x7fb83c154380 2024-04-25T01:43:14.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.389+0000 7fb842f42640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fb83c1532b0 con 0x7fb83c06d0a0 2024-04-25T01:43:14.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.389+0000 7fb8414df640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb83c154380 0x7fb83c154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:14.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.389+0000 7fb8414df640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb83c154380 0x7fb83c154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35256/0 (socket says 172.21.15.77:35256) 2024-04-25T01:43:14.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.389+0000 7fb8414df640 1 -- 172.21.15.77:0/2738579682 learned_addr learned my addr 172.21.15.77:0/2738579682 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:14.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.390+0000 7fb8414df640 1 -- 172.21.15.77:0/2738579682 >> v2:172.21.15.121:3300/0 conn(0x7fb83c06d0a0 msgr2=0x7fb83c06d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:14.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.390+0000 7fb8414df640 1 --2- 172.21.15.77:0/2738579682 >> v2:172.21.15.121:3300/0 conn(0x7fb83c06d0a0 0x7fb83c06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:14.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.390+0000 7fb8414df640 1 -- 172.21.15.77:0/2738579682 >> v1:172.21.15.121:6789/0 conn(0x7fb83c150320 legacy=0x7fb83c156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:14.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.390+0000 7fb8414df640 1 -- 172.21.15.77:0/2738579682 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb83c153590 con 0x7fb83c154380 2024-04-25T01:43:14.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.390+0000 7fb8414df640 1 --2- 172.21.15.77:0/2738579682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb83c154380 0x7fb83c154830 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb83c06e450 tx=0x7fb83402c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ddfc438a4533ef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:14.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.390+0000 7fb8337fe640 1 -- 172.21.15.77:0/2738579682 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb834039070 con 0x7fb83c154380 2024-04-25T01:43:14.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.390+0000 7fb8337fe640 1 -- 172.21.15.77:0/2738579682 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb83400b2e0 con 0x7fb83c154380 2024-04-25T01:43:14.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.390+0000 7fb8337fe640 1 -- 172.21.15.77:0/2738579682 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb834009820 con 0x7fb83c154380 2024-04-25T01:43:14.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.391+0000 7fb842f42640 1 -- 172.21.15.77:0/2738579682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb83c154380 msgr2=0x7fb83c154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:14.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.391+0000 7fb842f42640 1 --2- 172.21.15.77:0/2738579682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb83c154380 0x7fb83c154830 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb83c06e450 tx=0x7fb83402c860 comp rx=0 tx=0).stop 2024-04-25T01:43:14.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.391+0000 7fb842f42640 1 -- 172.21.15.77:0/2738579682 shutdown_connections 2024-04-25T01:43:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.391+0000 7fb842f42640 1 --2- 172.21.15.77:0/2738579682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb83c154380 0x7fb83c154830 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.391+0000 7fb842f42640 1 --2- 172.21.15.77:0/2738579682 >> v2:172.21.15.121:3300/0 conn(0x7fb83c06d0a0 0x7fb83c06d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.391+0000 7fb842f42640 1 -- 172.21.15.77:0/2738579682 >> 172.21.15.77:0/2738579682 conn(0x7fb83c0c3f80 msgr2=0x7fb83c0c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.391+0000 7fb842f42640 1 -- 172.21.15.77:0/2738579682 shutdown_connections 2024-04-25T01:43:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.391+0000 7fb842f42640 1 -- 172.21.15.77:0/2738579682 wait complete. 2024-04-25T01:43:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.392+0000 7fb842f42640 1 Processor -- start 2024-04-25T01:43:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.392+0000 7fb842f42640 1 -- start start 2024-04-25T01:43:14.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.393+0000 7fb842f42640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb83c06d0a0 0x7fb83c0c0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:14.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.393+0000 7fb842f42640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb83c150320 0x7fb83c143200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:14.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.393+0000 7fb842f42640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb83c154380 0x7fb83c143740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:14.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.393+0000 7fb842f42640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb83c152d70 con 0x7fb83c06d0a0 2024-04-25T01:43:14.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.393+0000 7fb842f42640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb83c152bf0 con 0x7fb83c150320 2024-04-25T01:43:14.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.393+0000 7fb842f42640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb83c0c3100 con 0x7fb83c154380 2024-04-25T01:43:14.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.393+0000 7fb840cde640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb83c06d0a0 0x7fb83c0c0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:14.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.393+0000 7fb840cde640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb83c06d0a0 0x7fb83c0c0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35260/0 (socket says 172.21.15.77:35260) 2024-04-25T01:43:14.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.393+0000 7fb840cde640 1 -- 172.21.15.77:0/3093986432 learned_addr learned my addr 172.21.15.77:0/3093986432 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:14.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.393+0000 7fb833fff640 1 --2- 172.21.15.77:0/3093986432 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb83c150320 0x7fb83c143200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:14.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.393+0000 7fb8414df640 1 --2- 172.21.15.77:0/3093986432 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb83c154380 0x7fb83c143740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:14.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.393+0000 7fb840cde640 1 -- 172.21.15.77:0/3093986432 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb83c154380 msgr2=0x7fb83c143740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:14.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.393+0000 7fb840cde640 1 --2- 172.21.15.77:0/3093986432 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb83c154380 0x7fb83c143740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:14.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.393+0000 7fb840cde640 1 -- 172.21.15.77:0/3093986432 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb83c150320 msgr2=0x7fb83c143200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:14.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.393+0000 7fb840cde640 1 --2- 172.21.15.77:0/3093986432 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb83c150320 0x7fb83c143200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:14.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.393+0000 7fb840cde640 1 -- 172.21.15.77:0/3093986432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb83c143c80 con 0x7fb83c06d0a0 2024-04-25T01:43:14.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.394+0000 7fb840cde640 1 --2- 172.21.15.77:0/3093986432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb83c06d0a0 0x7fb83c0c0b20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb83800c410 tx=0x7fb83800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:14.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.394+0000 7fb8317fa640 1 -- 172.21.15.77:0/3093986432 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb838017070 con 0x7fb83c06d0a0 2024-04-25T01:43:14.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.394+0000 7fb8317fa640 1 -- 172.21.15.77:0/3093986432 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8380035f0 con 0x7fb83c06d0a0 2024-04-25T01:43:14.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.394+0000 7fb842f42640 1 -- 172.21.15.77:0/3093986432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb83c1dc1e0 con 0x7fb83c06d0a0 2024-04-25T01:43:14.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.394+0000 7fb8317fa640 1 -- 172.21.15.77:0/3093986432 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb838003a20 con 0x7fb83c06d0a0 2024-04-25T01:43:14.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.394+0000 7fb842f42640 1 -- 172.21.15.77:0/3093986432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb83c146430 con 0x7fb83c06d0a0 2024-04-25T01:43:14.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.395+0000 7fb842f42640 1 -- 172.21.15.77:0/3093986432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb83c04f500 con 0x7fb83c06d0a0 2024-04-25T01:43:14.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.395+0000 7fb8317fa640 1 -- 172.21.15.77:0/3093986432 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb83801a070 con 0x7fb83c06d0a0 2024-04-25T01:43:14.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.396+0000 7fb8317fa640 1 --2- 172.21.15.77:0/3093986432 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb82806be30 0x7fb82806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:14.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.396+0000 7fb8317fa640 1 -- 172.21.15.77:0/3093986432 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6981+0+0 (secure 0 0 0) 0x7fb83808a6a0 con 0x7fb83c06d0a0 2024-04-25T01:43:14.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.396+0000 7fb833fff640 1 --2- 172.21.15.77:0/3093986432 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb82806be30 0x7fb82806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:14.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.396+0000 7fb833fff640 1 --2- 172.21.15.77:0/3093986432 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb82806be30 0x7fb82806e2f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb83c14f460 tx=0x7fb82c009060 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:14.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.400+0000 7fb8317fa640 1 -- 172.21.15.77:0/3093986432 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb8380010c0 con 0x7fb83c06d0a0 2024-04-25T01:43:14.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.611+0000 7fb842f42640 1 -- 172.21.15.77:0/3093986432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb83c1ebd50 con 0x7fb83c06d0a0 2024-04-25T01:43:14.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.612+0000 7fb8317fa640 1 -- 172.21.15.77:0/3093986432 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+6485 (secure 0 0 0) 0x7fb838058590 con 0x7fb83c06d0a0 2024-04-25T01:43:14.605 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:43:14.605 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:42:07.395274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5439":{"gid":5439,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5439,"qdb_cluster":[5439]},"id":1},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:37.377244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5265,"qdb_cluster":[5265]},"id":2}]} 2024-04-25T01:43:14.605 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 28 2024-04-25T01:43:14.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.614+0000 7fb842f42640 1 -- 172.21.15.77:0/3093986432 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb82806be30 msgr2=0x7fb82806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:14.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.614+0000 7fb842f42640 1 --2- 172.21.15.77:0/3093986432 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb82806be30 0x7fb82806e2f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb83c14f460 tx=0x7fb82c009060 comp rx=0 tx=0).stop 2024-04-25T01:43:14.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.614+0000 7fb842f42640 1 -- 172.21.15.77:0/3093986432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb83c06d0a0 msgr2=0x7fb83c0c0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:14.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.614+0000 7fb842f42640 1 --2- 172.21.15.77:0/3093986432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb83c06d0a0 0x7fb83c0c0b20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb83800c410 tx=0x7fb83800c8d0 comp rx=0 tx=0).stop 2024-04-25T01:43:14.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.614+0000 7fb842f42640 1 -- 172.21.15.77:0/3093986432 shutdown_connections 2024-04-25T01:43:14.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.614+0000 7fb842f42640 1 --2- 172.21.15.77:0/3093986432 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb82806be30 0x7fb82806e2f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:14.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.614+0000 7fb842f42640 1 --2- 172.21.15.77:0/3093986432 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb83c154380 0x7fb83c143740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:14.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.614+0000 7fb842f42640 1 --2- 172.21.15.77:0/3093986432 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb83c150320 0x7fb83c143200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:14.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.614+0000 7fb842f42640 1 --2- 172.21.15.77:0/3093986432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb83c06d0a0 0x7fb83c0c0b20 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:14.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.614+0000 7fb842f42640 1 -- 172.21.15.77:0/3093986432 >> 172.21.15.77:0/3093986432 conn(0x7fb83c0c3f80 msgr2=0x7fb83c14e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:14.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.614+0000 7fb842f42640 1 -- 172.21.15.77:0/3093986432 shutdown_connections 2024-04-25T01:43:14.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:14.614+0000 7fb842f42640 1 -- 172.21.15.77:0/3093986432 wait complete. 2024-04-25T01:43:14.617 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T01:43:16.618 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:43:16.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.736+0000 7fec93c8c640 1 Processor -- start 2024-04-25T01:43:16.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.737+0000 7fec93c8c640 1 -- start start 2024-04-25T01:43:16.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.737+0000 7fec93c8c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fec8c156c80 0x7fec8c0c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:16.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.737+0000 7fec93c8c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec8c157130 con 0x7fec8c150090 2024-04-25T01:43:16.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.737+0000 7fec93c8c640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec8c0c9de0 con 0x7fec8c06c280 2024-04-25T01:43:16.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.737+0000 7fec93c8c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fec8c06b830 con 0x7fec8c156c80 2024-04-25T01:43:16.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.737+0000 7fec91227640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fec8c156c80 0x7fec8c0c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:16.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.737+0000 7fec91a28640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fec8c150090 0x7fec8c0c8200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:39024/0 (socket says 172.21.15.77:39024) 2024-04-25T01:43:16.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.737+0000 7fec91a28640 1 -- 172.21.15.77:0/3511235119 learned_addr learned my addr 172.21.15.77:0/3511235119 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:43:16.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.738+0000 7fec91227640 1 -- 172.21.15.77:0/3511235119 >> v1:172.21.15.121:6789/0 conn(0x7fec8c06c280 legacy=0x7fec8c0c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:16.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.738+0000 7fec90a26640 1 -- 172.21.15.77:0/3511235119 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 694499803 0 0) 0x7fec88001110 con 0x7fec8c150090 2024-04-25T01:43:16.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.738+0000 7fec91227640 1 -- 172.21.15.77:0/3511235119 >> v1:172.21.15.77:6789/0 conn(0x7fec8c150090 legacy=0x7fec8c0c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:16.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.738+0000 7fec91227640 1 -- 172.21.15.77:0/3511235119 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec8c0c89c0 con 0x7fec8c156c80 2024-04-25T01:43:16.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.739+0000 7fec91227640 1 --2- 172.21.15.77:0/3511235119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec8c156c80 0x7fec8c0c98a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fec7c0097a0 tx=0x7fec7c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706393b771615512 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:16.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.739+0000 7fec90a26640 1 -- 172.21.15.77:0/3511235119 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7c037070 con 0x7fec8c156c80 2024-04-25T01:43:16.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.739+0000 7fec90a26640 1 -- 172.21.15.77:0/3511235119 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec7c032440 con 0x7fec8c156c80 2024-04-25T01:43:16.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.739+0000 7fec90a26640 1 -- 172.21.15.77:0/3511235119 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7c032810 con 0x7fec8c156c80 2024-04-25T01:43:16.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.740+0000 7fec93c8c640 1 -- 172.21.15.77:0/3511235119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec8c156c80 msgr2=0x7fec8c0c98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:16.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.740+0000 7fec93c8c640 1 --2- 172.21.15.77:0/3511235119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec8c156c80 0x7fec8c0c98a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fec7c0097a0 tx=0x7fec7c02a230 comp rx=0 tx=0).stop 2024-04-25T01:43:16.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.740+0000 7fec93c8c640 1 -- 172.21.15.77:0/3511235119 shutdown_connections 2024-04-25T01:43:16.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.740+0000 7fec93c8c640 1 --2- 172.21.15.77:0/3511235119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec8c156c80 0x7fec8c0c98a0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:16.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.740+0000 7fec93c8c640 1 -- 172.21.15.77:0/3511235119 >> 172.21.15.77:0/3511235119 conn(0x7fec8c0ad4d0 msgr2=0x7fec8c0ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:16.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.740+0000 7fec93c8c640 1 -- 172.21.15.77:0/3511235119 shutdown_connections 2024-04-25T01:43:16.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.740+0000 7fec93c8c640 1 -- 172.21.15.77:0/3511235119 wait complete. 2024-04-25T01:43:16.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.741+0000 7fec93c8c640 1 Processor -- start 2024-04-25T01:43:16.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.741+0000 7fec93c8c640 1 -- start start 2024-04-25T01:43:16.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.742+0000 7fec93c8c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fec8c06c280 0x7fec8c0ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:16.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.742+0000 7fec93c8c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec8c150090 0x7fec8c0c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:16.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.742+0000 7fec93c8c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec8c156c80 0x7fec8c0c4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:16.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.742+0000 7fec93c8c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fec8c06bd60 con 0x7fec8c156c80 2024-04-25T01:43:16.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.742+0000 7fec93c8c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fec8c06ba80 con 0x7fec8c150090 2024-04-25T01:43:16.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.742+0000 7fec93c8c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fec8c0c6a30 con 0x7fec8c06c280 2024-04-25T01:43:16.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.742+0000 7fec92229640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec8c156c80 0x7fec8c0c4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:16.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.742+0000 7fec92229640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec8c156c80 0x7fec8c0c4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35266/0 (socket says 172.21.15.77:35266) 2024-04-25T01:43:16.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.742+0000 7fec92229640 1 -- 172.21.15.77:0/226073296 learned_addr learned my addr 172.21.15.77:0/226073296 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:16.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.742+0000 7fec91227640 1 --2- 172.21.15.77:0/226073296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec8c150090 0x7fec8c0c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:16.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.742+0000 7fec91a28640 1 --2- 172.21.15.77:0/226073296 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fec8c06c280 0x7fec8c0ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:16.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.743+0000 7fec92229640 1 -- 172.21.15.77:0/226073296 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fec8c06c280 msgr2=0x7fec8c0ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:16.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.743+0000 7fec92229640 1 --2- 172.21.15.77:0/226073296 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fec8c06c280 0x7fec8c0ca250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:16.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.743+0000 7fec92229640 1 -- 172.21.15.77:0/226073296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec8c150090 msgr2=0x7fec8c0c3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:16.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.743+0000 7fec92229640 1 --2- 172.21.15.77:0/226073296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec8c150090 0x7fec8c0c3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:16.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.743+0000 7fec92229640 1 -- 172.21.15.77:0/226073296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec8c0c4930 con 0x7fec8c156c80 2024-04-25T01:43:16.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.743+0000 7fec91a28640 1 --2- 172.21.15.77:0/226073296 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fec8c06c280 0x7fec8c0ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:43:16.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.743+0000 7fec91227640 1 --2- 172.21.15.77:0/226073296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec8c150090 0x7fec8c0c3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:43:16.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.743+0000 7fec92229640 1 --2- 172.21.15.77:0/226073296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec8c156c80 0x7fec8c0c4de0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fec8400c6b0 tx=0x7fec8400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:16.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.743+0000 7fec827fc640 1 -- 172.21.15.77:0/226073296 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec84003b70 con 0x7fec8c156c80 2024-04-25T01:43:16.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.743+0000 7fec827fc640 1 -- 172.21.15.77:0/226073296 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec84003d30 con 0x7fec8c156c80 2024-04-25T01:43:16.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.743+0000 7fec93c8c640 1 -- 172.21.15.77:0/226073296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec8c14ee10 con 0x7fec8c156c80 2024-04-25T01:43:16.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.743+0000 7fec827fc640 1 -- 172.21.15.77:0/226073296 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec84005310 con 0x7fec8c156c80 2024-04-25T01:43:16.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.743+0000 7fec93c8c640 1 -- 172.21.15.77:0/226073296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec8c0b16b0 con 0x7fec8c156c80 2024-04-25T01:43:16.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.744+0000 7fec93c8c640 1 -- 172.21.15.77:0/226073296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec8c04f500 con 0x7fec8c156c80 2024-04-25T01:43:16.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.745+0000 7fec827fc640 1 -- 172.21.15.77:0/226073296 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fec840054b0 con 0x7fec8c156c80 2024-04-25T01:43:16.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.745+0000 7fec827fc640 1 --2- 172.21.15.77:0/226073296 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fec7006be30 0x7fec7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:16.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.745+0000 7fec827fc640 1 -- 172.21.15.77:0/226073296 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6981+0+0 (secure 0 0 0) 0x7fec8408b180 con 0x7fec8c156c80 2024-04-25T01:43:16.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.745+0000 7fec91a28640 1 --2- 172.21.15.77:0/226073296 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fec7006be30 0x7fec7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:16.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.746+0000 7fec91a28640 1 --2- 172.21.15.77:0/226073296 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fec7006be30 0x7fec7006e2f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fec88000f60 tx=0x7fec88007a10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:16.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.750+0000 7fec827fc640 1 -- 172.21.15.77:0/226073296 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fec840596c0 con 0x7fec8c156c80 2024-04-25T01:43:16.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.965+0000 7fec93c8c640 1 -- 172.21.15.77:0/226073296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec8c06cec0 con 0x7fec8c156c80 2024-04-25T01:43:16.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.965+0000 7fec827fc640 1 -- 172.21.15.77:0/226073296 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+6485 (secure 0 0 0) 0x7fec84058fc0 con 0x7fec8c156c80 2024-04-25T01:43:16.956 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:43:16.956 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:42:07.395274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5439":{"gid":5439,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5439,"qdb_cluster":[5439]},"id":1},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:37.377244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5265,"qdb_cluster":[5265]},"id":2}]} 2024-04-25T01:43:16.956 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 28 2024-04-25T01:43:16.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.968+0000 7fec93c8c640 1 -- 172.21.15.77:0/226073296 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fec7006be30 msgr2=0x7fec7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:16.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.968+0000 7fec93c8c640 1 --2- 172.21.15.77:0/226073296 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fec7006be30 0x7fec7006e2f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fec88000f60 tx=0x7fec88007a10 comp rx=0 tx=0).stop 2024-04-25T01:43:16.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.968+0000 7fec93c8c640 1 -- 172.21.15.77:0/226073296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec8c156c80 msgr2=0x7fec8c0c4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:16.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.968+0000 7fec93c8c640 1 --2- 172.21.15.77:0/226073296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec8c156c80 0x7fec8c0c4de0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fec8400c6b0 tx=0x7fec8400cb70 comp rx=0 tx=0).stop 2024-04-25T01:43:16.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.968+0000 7fec93c8c640 1 -- 172.21.15.77:0/226073296 shutdown_connections 2024-04-25T01:43:16.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.968+0000 7fec93c8c640 1 --2- 172.21.15.77:0/226073296 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fec7006be30 0x7fec7006e2f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:16.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.968+0000 7fec93c8c640 1 --2- 172.21.15.77:0/226073296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec8c156c80 0x7fec8c0c4de0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:16.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.968+0000 7fec93c8c640 1 --2- 172.21.15.77:0/226073296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec8c150090 0x7fec8c0c3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:16.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.968+0000 7fec93c8c640 1 --2- 172.21.15.77:0/226073296 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fec8c06c280 0x7fec8c0ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:16.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.968+0000 7fec93c8c640 1 -- 172.21.15.77:0/226073296 >> 172.21.15.77:0/226073296 conn(0x7fec8c0ad4d0 msgr2=0x7fec8c159320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:16.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.968+0000 7fec93c8c640 1 -- 172.21.15.77:0/226073296 shutdown_connections 2024-04-25T01:43:16.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:16.968+0000 7fec93c8c640 1 -- 172.21.15.77:0/226073296 wait complete. 2024-04-25T01:43:16.971 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T01:43:17.694 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:43:17.695 INFO:tasks.workunit.client.0.smithi077.stdout: Children see throughput for 1 readers = 7850955.50 kB/sec 2024-04-25T01:43:17.695 INFO:tasks.workunit.client.0.smithi077.stdout: Parent sees throughput for 1 readers = 7849404.86 kB/sec 2024-04-25T01:43:17.695 INFO:tasks.workunit.client.0.smithi077.stdout: Min throughput per process = 7850955.50 kB/sec 2024-04-25T01:43:17.695 INFO:tasks.workunit.client.0.smithi077.stdout: Max throughput per process = 7850955.50 kB/sec 2024-04-25T01:43:17.695 INFO:tasks.workunit.client.0.smithi077.stdout: Avg throughput per process = 7850955.50 kB/sec 2024-04-25T01:43:17.695 INFO:tasks.workunit.client.0.smithi077.stdout: Min xfer = 10485760.00 kB 2024-04-25T01:43:18.972 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:43:19.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.091+0000 7f459f177640 1 Processor -- start 2024-04-25T01:43:19.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.091+0000 7f459f177640 1 -- start start 2024-04-25T01:43:19.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.091+0000 7f459f177640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4598150090 0x7f4598156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:19.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.091+0000 7f459f177640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f459806c280 0x7f45980c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:19.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.091+0000 7f459f177640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45980c89c0 con 0x7f45980c8200 2024-04-25T01:43:19.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.091+0000 7f459f177640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f459806b830 con 0x7f4598150090 2024-04-25T01:43:19.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.091+0000 7f459f177640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f45980c8ca0 con 0x7f459806c280 2024-04-25T01:43:19.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.092+0000 7f459cf13640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4598150090 0x7f4598156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:19.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.092+0000 7f459cf13640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4598150090 0x7f4598156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42328/0 (socket says 172.21.15.77:42328) 2024-04-25T01:43:19.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.092+0000 7f459cf13640 1 -- 172.21.15.77:0/2014685463 learned_addr learned my addr 172.21.15.77:0/2014685463 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:19.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.092+0000 7f459d714640 1 --2- 172.21.15.77:0/2014685463 >> v2:172.21.15.121:3300/0 conn(0x7f459806c280 0x7f45980c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:19.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.092+0000 7f459cf13640 1 -- 172.21.15.77:0/2014685463 >> v2:172.21.15.121:3300/0 conn(0x7f459806c280 msgr2=0x7f45980c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:19.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.092+0000 7f459cf13640 1 --2- 172.21.15.77:0/2014685463 >> v2:172.21.15.121:3300/0 conn(0x7f459806c280 0x7f45980c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:19.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.092+0000 7f459cf13640 1 -- 172.21.15.77:0/2014685463 >> v1:172.21.15.121:6789/0 conn(0x7f45980c8200 legacy=0x7f45980c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:19.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.092+0000 7f459cf13640 1 -- 172.21.15.77:0/2014685463 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f459806ba80 con 0x7f4598150090 2024-04-25T01:43:19.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.092+0000 7f459d714640 1 --2- 172.21.15.77:0/2014685463 >> v2:172.21.15.121:3300/0 conn(0x7f459806c280 0x7f45980c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:43:19.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.093+0000 7f459cf13640 1 --2- 172.21.15.77:0/2014685463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4598150090 0x7f4598156c80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f45980cb860 tx=0x7f458c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395cd471158bf9cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:19.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.093+0000 7f45977fe640 1 -- 172.21.15.77:0/2014685463 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c037070 con 0x7f4598150090 2024-04-25T01:43:19.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.093+0000 7f45977fe640 1 -- 172.21.15.77:0/2014685463 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f458c032440 con 0x7f4598150090 2024-04-25T01:43:19.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.093+0000 7f45977fe640 1 -- 172.21.15.77:0/2014685463 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c032810 con 0x7f4598150090 2024-04-25T01:43:19.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.093+0000 7f459f177640 1 -- 172.21.15.77:0/2014685463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4598150090 msgr2=0x7f4598156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:19.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.093+0000 7f459f177640 1 --2- 172.21.15.77:0/2014685463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4598150090 0x7f4598156c80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f45980cb860 tx=0x7f458c02a230 comp rx=0 tx=0).stop 2024-04-25T01:43:19.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.093+0000 7f459f177640 1 -- 172.21.15.77:0/2014685463 shutdown_connections 2024-04-25T01:43:19.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.093+0000 7f459f177640 1 --2- 172.21.15.77:0/2014685463 >> v2:172.21.15.121:3300/0 conn(0x7f459806c280 0x7f45980c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:19.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.093+0000 7f459f177640 1 --2- 172.21.15.77:0/2014685463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4598150090 0x7f4598156c80 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:19.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.093+0000 7f459f177640 1 -- 172.21.15.77:0/2014685463 >> 172.21.15.77:0/2014685463 conn(0x7f45980ad4d0 msgr2=0x7f45980ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:19.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.093+0000 7f459f177640 1 -- 172.21.15.77:0/2014685463 shutdown_connections 2024-04-25T01:43:19.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.093+0000 7f459f177640 1 -- 172.21.15.77:0/2014685463 wait complete. 2024-04-25T01:43:19.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.094+0000 7f459f177640 1 Processor -- start 2024-04-25T01:43:19.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.094+0000 7f459f177640 1 -- start start 2024-04-25T01:43:19.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.095+0000 7f459f177640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f459806c280 0x7f45981ef820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:19.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.095+0000 7f459f177640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45980c8200 0x7f4598155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:19.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.095+0000 7f459f177640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4598150090 0x7f45981eb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:19.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.095+0000 7f459f177640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f459806c690 con 0x7f4598150090 2024-04-25T01:43:19.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.095+0000 7f459f177640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f45980c86b0 con 0x7f459806c280 2024-04-25T01:43:19.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.095+0000 7f459f177640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f459806c810 con 0x7f45980c8200 2024-04-25T01:43:19.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.095+0000 7f459d714640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4598150090 0x7f45981eb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:19.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.095+0000 7f459d714640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4598150090 0x7f45981eb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42330/0 (socket says 172.21.15.77:42330) 2024-04-25T01:43:19.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.095+0000 7f459d714640 1 -- 172.21.15.77:0/3942160382 learned_addr learned my addr 172.21.15.77:0/3942160382 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:19.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.096+0000 7f459cf13640 1 --2- 172.21.15.77:0/3942160382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f459806c280 0x7f45981ef820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:19.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.096+0000 7f4597fff640 1 --2- 172.21.15.77:0/3942160382 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45980c8200 0x7f4598155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:19.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.096+0000 7f459d714640 1 -- 172.21.15.77:0/3942160382 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45980c8200 msgr2=0x7f4598155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:19.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.096+0000 7f459d714640 1 --2- 172.21.15.77:0/3942160382 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45980c8200 0x7f4598155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:19.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.096+0000 7f459d714640 1 -- 172.21.15.77:0/3942160382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f459806c280 msgr2=0x7f45981ef820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:19.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.096+0000 7f459d714640 1 --2- 172.21.15.77:0/3942160382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f459806c280 0x7f45981ef820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:19.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.096+0000 7f459d714640 1 -- 172.21.15.77:0/3942160382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45980c1190 con 0x7f4598150090 2024-04-25T01:43:19.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.096+0000 7f4597fff640 1 --2- 172.21.15.77:0/3942160382 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45980c8200 0x7f4598155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:43:19.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.096+0000 7f459d714640 1 --2- 172.21.15.77:0/3942160382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4598150090 0x7f45981eb860 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f459000cef0 tx=0x7f459000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:19.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.096+0000 7f45957fa640 1 -- 172.21.15.77:0/3942160382 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459001a070 con 0x7f4598150090 2024-04-25T01:43:19.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.096+0000 7f45957fa640 1 -- 172.21.15.77:0/3942160382 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459000d860 con 0x7f4598150090 2024-04-25T01:43:19.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.096+0000 7f459f177640 1 -- 172.21.15.77:0/3942160382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45980c1470 con 0x7f4598150090 2024-04-25T01:43:19.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.096+0000 7f45957fa640 1 -- 172.21.15.77:0/3942160382 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459000dc50 con 0x7f4598150090 2024-04-25T01:43:19.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.096+0000 7f459f177640 1 -- 172.21.15.77:0/3942160382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45981ef020 con 0x7f4598150090 2024-04-25T01:43:19.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.097+0000 7f459f177640 1 -- 172.21.15.77:0/3942160382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f459804f500 con 0x7f4598150090 2024-04-25T01:43:19.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.098+0000 7f45957fa640 1 -- 172.21.15.77:0/3942160382 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f459001d070 con 0x7f4598150090 2024-04-25T01:43:19.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.098+0000 7f45957fa640 1 --2- 172.21.15.77:0/3942160382 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f457c06be30 0x7f457c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:19.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.098+0000 7f45957fa640 1 -- 172.21.15.77:0/3942160382 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6981+0+0 (secure 0 0 0) 0x7f459008bbb0 con 0x7f4598150090 2024-04-25T01:43:19.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.098+0000 7f459cf13640 1 --2- 172.21.15.77:0/3942160382 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f457c06be30 0x7f457c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:19.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.099+0000 7f459cf13640 1 --2- 172.21.15.77:0/3942160382 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f457c06be30 0x7f457c06e2f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f458c034000 tx=0x7f458c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:19.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.102+0000 7f45957fa640 1 -- 172.21.15.77:0/3942160382 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f459005a1b0 con 0x7f4598150090 2024-04-25T01:43:19.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.312+0000 7f459f177640 1 -- 172.21.15.77:0/3942160382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45980cb1e0 con 0x7f4598150090 2024-04-25T01:43:19.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.313+0000 7f45957fa640 1 -- 172.21.15.77:0/3942160382 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+6485 (secure 0 0 0) 0x7f4590059ab0 con 0x7f4598150090 2024-04-25T01:43:19.303 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:43:19.303 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:42:07.395274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5439":{"gid":5439,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5439,"qdb_cluster":[5439]},"id":1},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:37.377244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5265,"qdb_cluster":[5265]},"id":2}]} 2024-04-25T01:43:19.303 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 28 2024-04-25T01:43:19.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.315+0000 7f459f177640 1 -- 172.21.15.77:0/3942160382 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f457c06be30 msgr2=0x7f457c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:19.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.315+0000 7f459f177640 1 --2- 172.21.15.77:0/3942160382 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f457c06be30 0x7f457c06e2f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f458c034000 tx=0x7f458c02e000 comp rx=0 tx=0).stop 2024-04-25T01:43:19.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.315+0000 7f459f177640 1 -- 172.21.15.77:0/3942160382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4598150090 msgr2=0x7f45981eb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:19.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.315+0000 7f459f177640 1 --2- 172.21.15.77:0/3942160382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4598150090 0x7f45981eb860 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f459000cef0 tx=0x7f459000a710 comp rx=0 tx=0).stop 2024-04-25T01:43:19.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.315+0000 7f459f177640 1 -- 172.21.15.77:0/3942160382 shutdown_connections 2024-04-25T01:43:19.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.315+0000 7f459f177640 1 --2- 172.21.15.77:0/3942160382 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f457c06be30 0x7f457c06e2f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:19.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.315+0000 7f459f177640 1 --2- 172.21.15.77:0/3942160382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4598150090 0x7f45981eb860 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:19.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.315+0000 7f459f177640 1 --2- 172.21.15.77:0/3942160382 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45980c8200 0x7f4598155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:19.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.315+0000 7f459f177640 1 --2- 172.21.15.77:0/3942160382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f459806c280 0x7f45981ef820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:19.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.315+0000 7f459f177640 1 -- 172.21.15.77:0/3942160382 >> 172.21.15.77:0/3942160382 conn(0x7f45980ad4d0 msgr2=0x7f45980ad8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:19.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.315+0000 7f459f177640 1 -- 172.21.15.77:0/3942160382 shutdown_connections 2024-04-25T01:43:19.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:19.315+0000 7f459f177640 1 -- 172.21.15.77:0/3942160382 wait complete. 2024-04-25T01:43:19.316 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T01:43:20.729 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:43:20.732 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:43:21.099 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:43:21.099 INFO:tasks.workunit.client.0.smithi077.stdout: Children see throughput for 1 re-readers = 7983074.50 kB/sec 2024-04-25T01:43:21.100 INFO:tasks.workunit.client.0.smithi077.stdout: Parent sees throughput for 1 re-readers = 7981512.90 kB/sec 2024-04-25T01:43:21.100 INFO:tasks.workunit.client.0.smithi077.stdout: Min throughput per process = 7983074.50 kB/sec 2024-04-25T01:43:21.100 INFO:tasks.workunit.client.0.smithi077.stdout: Max throughput per process = 7983074.50 kB/sec 2024-04-25T01:43:21.100 INFO:tasks.workunit.client.0.smithi077.stdout: Avg throughput per process = 7983074.50 kB/sec 2024-04-25T01:43:21.100 INFO:tasks.workunit.client.0.smithi077.stdout: Min xfer = 10485760.00 kB 2024-04-25T01:43:21.318 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:43:21.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.425+0000 7ff6fbbb0640 1 Processor -- start 2024-04-25T01:43:21.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.425+0000 7ff6fbbb0640 1 -- start start 2024-04-25T01:43:21.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.426+0000 7ff6fbbb0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff6f4150090 0x7ff6f4156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:21.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.426+0000 7ff6fbbb0640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff6f406c280 0x7ff6f40c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:21.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.426+0000 7ff6fbbb0640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6f40c89c0 con 0x7ff6f40c8200 2024-04-25T01:43:21.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.426+0000 7ff6fbbb0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff6f406b830 con 0x7ff6f4150090 2024-04-25T01:43:21.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.426+0000 7ff6fbbb0640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7ff6f40c8ca0 con 0x7ff6f406c280 2024-04-25T01:43:21.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.426+0000 7ff6f994c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff6f4150090 0x7ff6f4156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:21.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.426+0000 7ff6f994c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff6f4150090 0x7ff6f4156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42338/0 (socket says 172.21.15.77:42338) 2024-04-25T01:43:21.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.426+0000 7ff6f994c640 1 -- 172.21.15.77:0/2258521303 learned_addr learned my addr 172.21.15.77:0/2258521303 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:21.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.427+0000 7ff6fa14d640 1 --2- 172.21.15.77:0/2258521303 >> v2:172.21.15.121:3300/0 conn(0x7ff6f406c280 0x7ff6f40c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:21.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.427+0000 7ff6f994c640 1 -- 172.21.15.77:0/2258521303 >> v2:172.21.15.121:3300/0 conn(0x7ff6f406c280 msgr2=0x7ff6f40c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:21.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.427+0000 7ff6f994c640 1 --2- 172.21.15.77:0/2258521303 >> v2:172.21.15.121:3300/0 conn(0x7ff6f406c280 0x7ff6f40c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:21.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.427+0000 7ff6f994c640 1 -- 172.21.15.77:0/2258521303 >> v1:172.21.15.121:6789/0 conn(0x7ff6f40c8200 legacy=0x7ff6f40c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:21.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.427+0000 7ff6f994c640 1 -- 172.21.15.77:0/2258521303 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f406ba80 con 0x7ff6f4150090 2024-04-25T01:43:21.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.427+0000 7ff6fa14d640 1 --2- 172.21.15.77:0/2258521303 >> v2:172.21.15.121:3300/0 conn(0x7ff6f406c280 0x7ff6f40c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:43:21.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.427+0000 7ff6f994c640 1 --2- 172.21.15.77:0/2258521303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6f4150090 0x7ff6f4156c80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff6f40cb860 tx=0x7ff6f002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6956f08af03a5d7a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:21.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.427+0000 7ff6f894a640 1 -- 172.21.15.77:0/2258521303 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0036070 con 0x7ff6f4150090 2024-04-25T01:43:21.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.428+0000 7ff6f894a640 1 -- 172.21.15.77:0/2258521303 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6f0031600 con 0x7ff6f4150090 2024-04-25T01:43:21.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.428+0000 7ff6f894a640 1 -- 172.21.15.77:0/2258521303 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f00319d0 con 0x7ff6f4150090 2024-04-25T01:43:21.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.428+0000 7ff6fbbb0640 1 -- 172.21.15.77:0/2258521303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6f4150090 msgr2=0x7ff6f4156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:21.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.428+0000 7ff6fbbb0640 1 --2- 172.21.15.77:0/2258521303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6f4150090 0x7ff6f4156c80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff6f40cb860 tx=0x7ff6f002a6f0 comp rx=0 tx=0).stop 2024-04-25T01:43:21.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.428+0000 7ff6fbbb0640 1 -- 172.21.15.77:0/2258521303 shutdown_connections 2024-04-25T01:43:21.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.428+0000 7ff6fbbb0640 1 --2- 172.21.15.77:0/2258521303 >> v2:172.21.15.121:3300/0 conn(0x7ff6f406c280 0x7ff6f40c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:21.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.428+0000 7ff6fbbb0640 1 --2- 172.21.15.77:0/2258521303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6f4150090 0x7ff6f4156c80 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:21.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.428+0000 7ff6fbbb0640 1 -- 172.21.15.77:0/2258521303 >> 172.21.15.77:0/2258521303 conn(0x7ff6f40ad4d0 msgr2=0x7ff6f40ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:21.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.428+0000 7ff6fbbb0640 1 -- 172.21.15.77:0/2258521303 shutdown_connections 2024-04-25T01:43:21.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.428+0000 7ff6fbbb0640 1 -- 172.21.15.77:0/2258521303 wait complete. 2024-04-25T01:43:21.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.429+0000 7ff6fbbb0640 1 Processor -- start 2024-04-25T01:43:21.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.429+0000 7ff6fbbb0640 1 -- start start 2024-04-25T01:43:21.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.430+0000 7ff6fbbb0640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff6f406c280 0x7ff6f41ef820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:21.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.430+0000 7ff6fbbb0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6f40c8200 0x7ff6f4155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:21.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.430+0000 7ff6fbbb0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6f4150090 0x7ff6f41eb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:21.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.430+0000 7ff6fbbb0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f406c690 con 0x7ff6f40c8200 2024-04-25T01:43:21.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.430+0000 7ff6fbbb0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f40c86b0 con 0x7ff6f4150090 2024-04-25T01:43:21.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.430+0000 7ff6fbbb0640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff6f406c810 con 0x7ff6f406c280 2024-04-25T01:43:21.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.430+0000 7ff6f914b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6f40c8200 0x7ff6f4155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:21.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.430+0000 7ff6f914b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6f40c8200 0x7ff6f4155520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42348/0 (socket says 172.21.15.77:42348) 2024-04-25T01:43:21.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.430+0000 7ff6f914b640 1 -- 172.21.15.77:0/3325215250 learned_addr learned my addr 172.21.15.77:0/3325215250 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:21.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.430+0000 7ff6f994c640 1 --2- 172.21.15.77:0/3325215250 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff6f406c280 0x7ff6f41ef820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:21.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.430+0000 7ff6fa14d640 1 --2- 172.21.15.77:0/3325215250 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6f4150090 0x7ff6f41eb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:21.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.430+0000 7ff6f914b640 1 -- 172.21.15.77:0/3325215250 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff6f406c280 msgr2=0x7ff6f41ef820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:21.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.430+0000 7ff6f914b640 1 --2- 172.21.15.77:0/3325215250 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff6f406c280 0x7ff6f41ef820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:21.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.430+0000 7ff6f914b640 1 -- 172.21.15.77:0/3325215250 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6f4150090 msgr2=0x7ff6f41eb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:21.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.430+0000 7ff6f914b640 1 --2- 172.21.15.77:0/3325215250 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6f4150090 0x7ff6f41eb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:21.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.430+0000 7ff6f914b640 1 -- 172.21.15.77:0/3325215250 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f40c1190 con 0x7ff6f40c8200 2024-04-25T01:43:21.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.430+0000 7ff6f914b640 1 --2- 172.21.15.77:0/3325215250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6f40c8200 0x7ff6f4155520 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff6e400c400 tx=0x7ff6e400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:21.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.431+0000 7ff6ea7fc640 1 -- 172.21.15.77:0/3325215250 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4011790 con 0x7ff6f40c8200 2024-04-25T01:43:21.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.431+0000 7ff6ea7fc640 1 -- 172.21.15.77:0/3325215250 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6e4017070 con 0x7ff6f40c8200 2024-04-25T01:43:21.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.431+0000 7ff6fbbb0640 1 -- 172.21.15.77:0/3325215250 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6f40c1470 con 0x7ff6f40c8200 2024-04-25T01:43:21.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.431+0000 7ff6ea7fc640 1 -- 172.21.15.77:0/3325215250 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4011bb0 con 0x7ff6f40c8200 2024-04-25T01:43:21.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.431+0000 7ff6fbbb0640 1 -- 172.21.15.77:0/3325215250 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6f41ef020 con 0x7ff6f40c8200 2024-04-25T01:43:21.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.432+0000 7ff6fbbb0640 1 -- 172.21.15.77:0/3325215250 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6f404f500 con 0x7ff6f40c8200 2024-04-25T01:43:21.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.432+0000 7ff6ea7fc640 1 -- 172.21.15.77:0/3325215250 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff6e401c460 con 0x7ff6f40c8200 2024-04-25T01:43:21.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.432+0000 7ff6ea7fc640 1 --2- 172.21.15.77:0/3325215250 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff6d806be30 0x7ff6d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:21.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.433+0000 7ff6ea7fc640 1 -- 172.21.15.77:0/3325215250 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6981+0+0 (secure 0 0 0) 0x7ff6e408afd0 con 0x7ff6f40c8200 2024-04-25T01:43:21.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.433+0000 7ff6f994c640 1 --2- 172.21.15.77:0/3325215250 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff6d806be30 0x7ff6d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:21.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.433+0000 7ff6f994c640 1 --2- 172.21.15.77:0/3325215250 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff6d806be30 0x7ff6d806e2f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0033000 tx=0x7ff6f0009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:21.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.437+0000 7ff6ea7fc640 1 -- 172.21.15.77:0/3325215250 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff6e4058ec0 con 0x7ff6f40c8200 2024-04-25T01:43:21.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.646+0000 7ff6fbbb0640 1 -- 172.21.15.77:0/3325215250 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6f40cb1e0 con 0x7ff6f40c8200 2024-04-25T01:43:21.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.646+0000 7ff6ea7fc640 1 -- 172.21.15.77:0/3325215250 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+6485 (secure 0 0 0) 0x7ff6e405d1c0 con 0x7ff6f40c8200 2024-04-25T01:43:21.637 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:43:21.637 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:42:07.395274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5439":{"gid":5439,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5439,"qdb_cluster":[5439]},"id":1},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:37.377244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5265,"qdb_cluster":[5265]},"id":2}]} 2024-04-25T01:43:21.637 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 28 2024-04-25T01:43:21.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.648+0000 7ff6fbbb0640 1 -- 172.21.15.77:0/3325215250 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff6d806be30 msgr2=0x7ff6d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:21.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.648+0000 7ff6fbbb0640 1 --2- 172.21.15.77:0/3325215250 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff6d806be30 0x7ff6d806e2f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0033000 tx=0x7ff6f0009000 comp rx=0 tx=0).stop 2024-04-25T01:43:21.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.648+0000 7ff6fbbb0640 1 -- 172.21.15.77:0/3325215250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6f40c8200 msgr2=0x7ff6f4155520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:21.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.648+0000 7ff6fbbb0640 1 --2- 172.21.15.77:0/3325215250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6f40c8200 0x7ff6f4155520 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff6e400c400 tx=0x7ff6e400c8c0 comp rx=0 tx=0).stop 2024-04-25T01:43:21.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.648+0000 7ff6fbbb0640 1 -- 172.21.15.77:0/3325215250 shutdown_connections 2024-04-25T01:43:21.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.648+0000 7ff6fbbb0640 1 --2- 172.21.15.77:0/3325215250 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff6d806be30 0x7ff6d806e2f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:21.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.648+0000 7ff6fbbb0640 1 --2- 172.21.15.77:0/3325215250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6f40c8200 0x7ff6f4155520 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:21.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.648+0000 7ff6fbbb0640 1 --2- 172.21.15.77:0/3325215250 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6f4150090 0x7ff6f41eb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:21.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.648+0000 7ff6fbbb0640 1 --2- 172.21.15.77:0/3325215250 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff6f406c280 0x7ff6f41ef820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:21.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.648+0000 7ff6fbbb0640 1 -- 172.21.15.77:0/3325215250 >> 172.21.15.77:0/3325215250 conn(0x7ff6f40ad4d0 msgr2=0x7ff6f40ad8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:21.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.649+0000 7ff6fbbb0640 1 -- 172.21.15.77:0/3325215250 shutdown_connections 2024-04-25T01:43:21.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:21.649+0000 7ff6fbbb0640 1 -- 172.21.15.77:0/3325215250 wait complete. 2024-04-25T01:43:21.650 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T01:43:23.651 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:43:23.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.770+0000 7fc40db63640 1 Processor -- start 2024-04-25T01:43:23.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.770+0000 7fc40db63640 1 -- start start 2024-04-25T01:43:23.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.771+0000 7fc40db63640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc40806d0a0 0x7fc40806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:23.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.771+0000 7fc40db63640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc408154380 0x7fc408154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:23.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.771+0000 7fc40db63640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc408153be0 con 0x7fc408150320 2024-04-25T01:43:23.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.771+0000 7fc40db63640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc408152fd0 con 0x7fc40806d0a0 2024-04-25T01:43:23.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.771+0000 7fc40db63640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fc4081532b0 con 0x7fc408154380 2024-04-25T01:43:23.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.771+0000 7fc406ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc40806d0a0 0x7fc40806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:23.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.771+0000 7fc4077fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc408150320 0x7fc408156bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45052/0 (socket says 172.21.15.77:45052) 2024-04-25T01:43:23.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.771+0000 7fc4077fe640 1 -- 172.21.15.77:0/2000526138 learned_addr learned my addr 172.21.15.77:0/2000526138 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:43:23.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.771+0000 7fc406ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc40806d0a0 0x7fc40806d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42362/0 (socket says 172.21.15.77:42362) 2024-04-25T01:43:23.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.771+0000 7fc407fff640 1 --2- 172.21.15.77:0/2000526138 >> v2:172.21.15.121:3300/0 conn(0x7fc408154380 0x7fc408154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:23.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.771+0000 7fc406ffd640 1 -- 172.21.15.77:0/2000526138 >> v2:172.21.15.121:3300/0 conn(0x7fc408154380 msgr2=0x7fc408154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:23.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.771+0000 7fc406ffd640 1 --2- 172.21.15.77:0/2000526138 >> v2:172.21.15.121:3300/0 conn(0x7fc408154380 0x7fc408154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:23.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.771+0000 7fc406ffd640 1 -- 172.21.15.77:0/2000526138 >> v1:172.21.15.77:6789/0 conn(0x7fc408150320 legacy=0x7fc408156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:23.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.771+0000 7fc4067fc640 1 -- 172.21.15.77:0/2000526138 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1641703101 0 0) 0x7fc408153be0 con 0x7fc408150320 2024-04-25T01:43:23.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.771+0000 7fc406ffd640 1 -- 172.21.15.77:0/2000526138 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc408153590 con 0x7fc40806d0a0 2024-04-25T01:43:23.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.772+0000 7fc406ffd640 1 --2- 172.21.15.77:0/2000526138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc40806d0a0 0x7fc40806d4e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc4080acf90 tx=0x7fc3fc02c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf2e11ce769b863 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:23.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.772+0000 7fc4067fc640 1 -- 172.21.15.77:0/2000526138 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc031710 con 0x7fc40806d0a0 2024-04-25T01:43:23.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.772+0000 7fc4067fc640 1 -- 172.21.15.77:0/2000526138 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3fc0318b0 con 0x7fc40806d0a0 2024-04-25T01:43:23.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.772+0000 7fc4067fc640 1 -- 172.21.15.77:0/2000526138 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc031c80 con 0x7fc40806d0a0 2024-04-25T01:43:23.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.773+0000 7fc40db63640 1 -- 172.21.15.77:0/2000526138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc40806d0a0 msgr2=0x7fc40806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:23.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.773+0000 7fc40db63640 1 --2- 172.21.15.77:0/2000526138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc40806d0a0 0x7fc40806d4e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc4080acf90 tx=0x7fc3fc02c7e0 comp rx=0 tx=0).stop 2024-04-25T01:43:23.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.773+0000 7fc40db63640 1 -- 172.21.15.77:0/2000526138 shutdown_connections 2024-04-25T01:43:23.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.773+0000 7fc40db63640 1 --2- 172.21.15.77:0/2000526138 >> v2:172.21.15.121:3300/0 conn(0x7fc408154380 0x7fc408154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:23.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.773+0000 7fc40db63640 1 --2- 172.21.15.77:0/2000526138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc40806d0a0 0x7fc40806d4e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:23.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.773+0000 7fc40db63640 1 -- 172.21.15.77:0/2000526138 >> 172.21.15.77:0/2000526138 conn(0x7fc4080c3f80 msgr2=0x7fc4080c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:23.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.773+0000 7fc40db63640 1 -- 172.21.15.77:0/2000526138 shutdown_connections 2024-04-25T01:43:23.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.773+0000 7fc40db63640 1 -- 172.21.15.77:0/2000526138 wait complete. 2024-04-25T01:43:23.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.774+0000 7fc40db63640 1 Processor -- start 2024-04-25T01:43:23.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.774+0000 7fc40db63640 1 -- start start 2024-04-25T01:43:23.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.775+0000 7fc40db63640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc40806d0a0 0x7fc4081455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:23.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.775+0000 7fc40db63640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc408150320 0x7fc4080abd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:23.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.775+0000 7fc40db63640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc408154380 0x7fc40814b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:23.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.775+0000 7fc40db63640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc408152d70 con 0x7fc408150320 2024-04-25T01:43:23.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.775+0000 7fc40db63640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc408152bf0 con 0x7fc408154380 2024-04-25T01:43:23.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.775+0000 7fc40db63640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc4080c3100 con 0x7fc40806d0a0 2024-04-25T01:43:23.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.775+0000 7fc406ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc408150320 0x7fc4080abd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:23.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.775+0000 7fc406ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc408150320 0x7fc4080abd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42370/0 (socket says 172.21.15.77:42370) 2024-04-25T01:43:23.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.775+0000 7fc406ffd640 1 -- 172.21.15.77:0/1613655646 learned_addr learned my addr 172.21.15.77:0/1613655646 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:23.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.775+0000 7fc407fff640 1 --2- 172.21.15.77:0/1613655646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc408154380 0x7fc40814b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:23.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.775+0000 7fc4077fe640 1 --2- 172.21.15.77:0/1613655646 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc40806d0a0 0x7fc4081455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:23.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.775+0000 7fc406ffd640 1 -- 172.21.15.77:0/1613655646 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc40806d0a0 msgr2=0x7fc4081455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:23.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.775+0000 7fc406ffd640 1 --2- 172.21.15.77:0/1613655646 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc40806d0a0 0x7fc4081455f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:23.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.775+0000 7fc406ffd640 1 -- 172.21.15.77:0/1613655646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc408154380 msgr2=0x7fc40814b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:23.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.775+0000 7fc406ffd640 1 --2- 172.21.15.77:0/1613655646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc408154380 0x7fc40814b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:23.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.775+0000 7fc406ffd640 1 -- 172.21.15.77:0/1613655646 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc408145b30 con 0x7fc408150320 2024-04-25T01:43:23.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.775+0000 7fc407fff640 1 --2- 172.21.15.77:0/1613655646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc408154380 0x7fc40814b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:43:23.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.775+0000 7fc406ffd640 1 --2- 172.21.15.77:0/1613655646 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc408150320 0x7fc4080abd30 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc02cdd0 tx=0x7fc3fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:23.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.775+0000 7fc3effff640 1 -- 172.21.15.77:0/1613655646 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc033d10 con 0x7fc408150320 2024-04-25T01:43:23.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.775+0000 7fc3effff640 1 -- 172.21.15.77:0/1613655646 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3fc03d410 con 0x7fc408150320 2024-04-25T01:43:23.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.775+0000 7fc40db63640 1 -- 172.21.15.77:0/1613655646 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4081442b0 con 0x7fc408150320 2024-04-25T01:43:23.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.775+0000 7fc3effff640 1 -- 172.21.15.77:0/1613655646 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc03d800 con 0x7fc408150320 2024-04-25T01:43:23.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.776+0000 7fc40db63640 1 -- 172.21.15.77:0/1613655646 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4080ab410 con 0x7fc408150320 2024-04-25T01:43:23.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.777+0000 7fc40db63640 1 -- 172.21.15.77:0/1613655646 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc40804f500 con 0x7fc408150320 2024-04-25T01:43:23.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.777+0000 7fc3effff640 1 -- 172.21.15.77:0/1613655646 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc3fc03d9a0 con 0x7fc408150320 2024-04-25T01:43:23.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.777+0000 7fc3effff640 1 --2- 172.21.15.77:0/1613655646 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc3f406be30 0x7fc3f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:23.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.777+0000 7fc3effff640 1 -- 172.21.15.77:0/1613655646 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6981+0+0 (secure 0 0 0) 0x7fc3fc0aea20 con 0x7fc408150320 2024-04-25T01:43:23.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.777+0000 7fc4077fe640 1 --2- 172.21.15.77:0/1613655646 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc3f406be30 0x7fc3f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:23.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.778+0000 7fc4077fe640 1 --2- 172.21.15.77:0/1613655646 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc3f406be30 0x7fc3f406e2f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8000f60 tx=0x7fc3f8007b50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:23.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.782+0000 7fc3effff640 1 -- 172.21.15.77:0/1613655646 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc3fc041030 con 0x7fc408150320 2024-04-25T01:43:23.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.994+0000 7fc40db63640 1 -- 172.21.15.77:0/1613655646 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc408073750 con 0x7fc408150320 2024-04-25T01:43:23.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.994+0000 7fc3effff640 1 -- 172.21.15.77:0/1613655646 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+6485 (secure 0 0 0) 0x7fc3fc07cf60 con 0x7fc408150320 2024-04-25T01:43:23.985 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:43:23.986 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:42:07.395274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5439":{"gid":5439,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5439,"qdb_cluster":[5439]},"id":1},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:37.377244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5265,"qdb_cluster":[5265]},"id":2}]} 2024-04-25T01:43:23.986 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 28 2024-04-25T01:43:23.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.996+0000 7fc40db63640 1 -- 172.21.15.77:0/1613655646 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc3f406be30 msgr2=0x7fc3f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:23.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.996+0000 7fc40db63640 1 --2- 172.21.15.77:0/1613655646 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc3f406be30 0x7fc3f406e2f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8000f60 tx=0x7fc3f8007b50 comp rx=0 tx=0).stop 2024-04-25T01:43:23.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.996+0000 7fc40db63640 1 -- 172.21.15.77:0/1613655646 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc408150320 msgr2=0x7fc4080abd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:23.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.996+0000 7fc40db63640 1 --2- 172.21.15.77:0/1613655646 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc408150320 0x7fc4080abd30 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc02cdd0 tx=0x7fc3fc0046c0 comp rx=0 tx=0).stop 2024-04-25T01:43:23.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.997+0000 7fc40db63640 1 -- 172.21.15.77:0/1613655646 shutdown_connections 2024-04-25T01:43:23.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.997+0000 7fc40db63640 1 --2- 172.21.15.77:0/1613655646 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc3f406be30 0x7fc3f406e2f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:23.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.997+0000 7fc40db63640 1 --2- 172.21.15.77:0/1613655646 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc408150320 0x7fc4080abd30 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:23.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.997+0000 7fc40db63640 1 --2- 172.21.15.77:0/1613655646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc408154380 0x7fc40814b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:23.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.997+0000 7fc40db63640 1 --2- 172.21.15.77:0/1613655646 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc40806d0a0 0x7fc4081455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:23.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.997+0000 7fc40db63640 1 -- 172.21.15.77:0/1613655646 >> 172.21.15.77:0/1613655646 conn(0x7fc4080c3f80 msgr2=0x7fc4080c2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:23.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.997+0000 7fc40db63640 1 -- 172.21.15.77:0/1613655646 shutdown_connections 2024-04-25T01:43:23.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:23.997+0000 7fc40db63640 1 -- 172.21.15.77:0/1613655646 wait complete. 2024-04-25T01:43:23.999 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T01:43:25.999 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:43:26.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.107+0000 7fd3785f9640 1 Processor -- start 2024-04-25T01:43:26.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.107+0000 7fd3785f9640 1 -- start start 2024-04-25T01:43:26.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.108+0000 7fd3785f9640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd37006d0a0 0x7fd37006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:26.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.108+0000 7fd3785f9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd370154380 0x7fd370154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:26.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.108+0000 7fd3785f9640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd370153be0 con 0x7fd370150320 2024-04-25T01:43:26.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.108+0000 7fd3785f9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd370152fd0 con 0x7fd370154380 2024-04-25T01:43:26.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.108+0000 7fd3785f9640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fd3701532b0 con 0x7fd37006d0a0 2024-04-25T01:43:26.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.108+0000 7fd376b96640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd370154380 0x7fd370154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:26.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.108+0000 7fd376b96640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd370154380 0x7fd370154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42384/0 (socket says 172.21.15.77:42384) 2024-04-25T01:43:26.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.108+0000 7fd376b96640 1 -- 172.21.15.77:0/47494959 learned_addr learned my addr 172.21.15.77:0/47494959 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:26.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.108+0000 7fd375b94640 1 --2- 172.21.15.77:0/47494959 >> v2:172.21.15.121:3300/0 conn(0x7fd37006d0a0 0x7fd37006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:26.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.109+0000 7fd376b96640 1 -- 172.21.15.77:0/47494959 >> v2:172.21.15.121:3300/0 conn(0x7fd37006d0a0 msgr2=0x7fd37006d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:26.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.109+0000 7fd376b96640 1 --2- 172.21.15.77:0/47494959 >> v2:172.21.15.121:3300/0 conn(0x7fd37006d0a0 0x7fd37006d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:26.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.109+0000 7fd376b96640 1 -- 172.21.15.77:0/47494959 >> v1:172.21.15.121:6789/0 conn(0x7fd370150320 legacy=0x7fd370156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:26.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.109+0000 7fd376b96640 1 -- 172.21.15.77:0/47494959 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd370153590 con 0x7fd370154380 2024-04-25T01:43:26.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.109+0000 7fd376b96640 1 --2- 172.21.15.77:0/47494959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd370154380 0x7fd370154830 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd37006e450 tx=0x7fd36802c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71c96458f2bc99b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:26.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.109+0000 7fd375393640 1 -- 172.21.15.77:0/47494959 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd368032710 con 0x7fd370154380 2024-04-25T01:43:26.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.109+0000 7fd375393640 1 -- 172.21.15.77:0/47494959 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3680328b0 con 0x7fd370154380 2024-04-25T01:43:26.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.109+0000 7fd375393640 1 -- 172.21.15.77:0/47494959 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd368032ca0 con 0x7fd370154380 2024-04-25T01:43:26.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.110+0000 7fd3785f9640 1 -- 172.21.15.77:0/47494959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd370154380 msgr2=0x7fd370154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:26.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.110+0000 7fd3785f9640 1 --2- 172.21.15.77:0/47494959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd370154380 0x7fd370154830 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd37006e450 tx=0x7fd36802c850 comp rx=0 tx=0).stop 2024-04-25T01:43:26.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.110+0000 7fd3785f9640 1 -- 172.21.15.77:0/47494959 shutdown_connections 2024-04-25T01:43:26.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.110+0000 7fd3785f9640 1 --2- 172.21.15.77:0/47494959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd370154380 0x7fd370154830 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:26.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.110+0000 7fd3785f9640 1 --2- 172.21.15.77:0/47494959 >> v2:172.21.15.121:3300/0 conn(0x7fd37006d0a0 0x7fd37006d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:26.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.110+0000 7fd3785f9640 1 -- 172.21.15.77:0/47494959 >> 172.21.15.77:0/47494959 conn(0x7fd3700c3f80 msgr2=0x7fd3700c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:26.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.110+0000 7fd3785f9640 1 -- 172.21.15.77:0/47494959 shutdown_connections 2024-04-25T01:43:26.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.110+0000 7fd3785f9640 1 -- 172.21.15.77:0/47494959 wait complete. 2024-04-25T01:43:26.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.111+0000 7fd3785f9640 1 Processor -- start 2024-04-25T01:43:26.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.111+0000 7fd3785f9640 1 -- start start 2024-04-25T01:43:26.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.112+0000 7fd3785f9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd37006d0a0 0x7fd370147df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:26.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.112+0000 7fd3785f9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd370150320 0x7fd370070490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:26.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.112+0000 7fd3785f9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd370154380 0x7fd370145d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:26.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.112+0000 7fd3785f9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd370152d70 con 0x7fd370150320 2024-04-25T01:43:26.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.112+0000 7fd3785f9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd370152bf0 con 0x7fd370154380 2024-04-25T01:43:26.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.112+0000 7fd3785f9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd3700c3100 con 0x7fd37006d0a0 2024-04-25T01:43:26.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.112+0000 7fd375b94640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd370150320 0x7fd370070490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:26.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.112+0000 7fd375b94640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd370150320 0x7fd370070490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42386/0 (socket says 172.21.15.77:42386) 2024-04-25T01:43:26.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.112+0000 7fd375b94640 1 -- 172.21.15.77:0/1653051037 learned_addr learned my addr 172.21.15.77:0/1653051037 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:26.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.112+0000 7fd376b96640 1 --2- 172.21.15.77:0/1653051037 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd370154380 0x7fd370145d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:26.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.112+0000 7fd376395640 1 --2- 172.21.15.77:0/1653051037 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd37006d0a0 0x7fd370147df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:26.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.112+0000 7fd375b94640 1 -- 172.21.15.77:0/1653051037 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd37006d0a0 msgr2=0x7fd370147df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:26.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.112+0000 7fd375b94640 1 --2- 172.21.15.77:0/1653051037 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd37006d0a0 0x7fd370147df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:26.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.112+0000 7fd375b94640 1 -- 172.21.15.77:0/1653051037 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd370154380 msgr2=0x7fd370145d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:26.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.112+0000 7fd375b94640 1 --2- 172.21.15.77:0/1653051037 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd370154380 0x7fd370145d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:26.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.112+0000 7fd375b94640 1 -- 172.21.15.77:0/1653051037 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd370072450 con 0x7fd370150320 2024-04-25T01:43:26.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.112+0000 7fd375b94640 1 --2- 172.21.15.77:0/1653051037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd370150320 0x7fd370070490 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd36000d600 tx=0x7fd36000dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:26.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.112+0000 7fd366ffd640 1 -- 172.21.15.77:0/1653051037 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd360004240 con 0x7fd370150320 2024-04-25T01:43:26.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.112+0000 7fd366ffd640 1 -- 172.21.15.77:0/1653051037 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3600043e0 con 0x7fd370150320 2024-04-25T01:43:26.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.112+0000 7fd3785f9640 1 -- 172.21.15.77:0/1653051037 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd370072730 con 0x7fd370150320 2024-04-25T01:43:26.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.112+0000 7fd366ffd640 1 -- 172.21.15.77:0/1653051037 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd360003830 con 0x7fd370150320 2024-04-25T01:43:26.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.112+0000 7fd3785f9640 1 -- 172.21.15.77:0/1653051037 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd370072cf0 con 0x7fd370150320 2024-04-25T01:43:26.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.113+0000 7fd3785f9640 1 -- 172.21.15.77:0/1653051037 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd37004f500 con 0x7fd370150320 2024-04-25T01:43:26.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.114+0000 7fd366ffd640 1 -- 172.21.15.77:0/1653051037 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd3600039d0 con 0x7fd370150320 2024-04-25T01:43:26.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.114+0000 7fd366ffd640 1 --2- 172.21.15.77:0/1653051037 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd35406be60 0x7fd35406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:26.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.115+0000 7fd376395640 1 --2- 172.21.15.77:0/1653051037 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd35406be60 0x7fd35406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:26.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.115+0000 7fd366ffd640 1 -- 172.21.15.77:0/1653051037 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6981+0+0 (secure 0 0 0) 0x7fd36008b580 con 0x7fd370150320 2024-04-25T01:43:26.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.115+0000 7fd376395640 1 --2- 172.21.15.77:0/1653051037 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd35406be60 0x7fd35406e320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd36c005520 tx=0x7fd36c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:26.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.119+0000 7fd366ffd640 1 -- 172.21.15.77:0/1653051037 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd360059ac0 con 0x7fd370150320 2024-04-25T01:43:26.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.329+0000 7fd3785f9640 1 -- 172.21.15.77:0/1653051037 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3701529a0 con 0x7fd370150320 2024-04-25T01:43:26.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.329+0000 7fd366ffd640 1 -- 172.21.15.77:0/1653051037 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+6485 (secure 0 0 0) 0x7fd3600593c0 con 0x7fd370150320 2024-04-25T01:43:26.320 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:43:26.320 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:42:07.395274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5439":{"gid":5439,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5439,"qdb_cluster":[5439]},"id":1},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:37.377244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5265,"qdb_cluster":[5265]},"id":2}]} 2024-04-25T01:43:26.320 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 28 2024-04-25T01:43:26.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.332+0000 7fd3785f9640 1 -- 172.21.15.77:0/1653051037 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd35406be60 msgr2=0x7fd35406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:26.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.332+0000 7fd3785f9640 1 --2- 172.21.15.77:0/1653051037 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd35406be60 0x7fd35406e320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd36c005520 tx=0x7fd36c009040 comp rx=0 tx=0).stop 2024-04-25T01:43:26.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.332+0000 7fd3785f9640 1 -- 172.21.15.77:0/1653051037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd370150320 msgr2=0x7fd370070490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:26.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.332+0000 7fd3785f9640 1 --2- 172.21.15.77:0/1653051037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd370150320 0x7fd370070490 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd36000d600 tx=0x7fd36000dac0 comp rx=0 tx=0).stop 2024-04-25T01:43:26.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.332+0000 7fd3785f9640 1 -- 172.21.15.77:0/1653051037 shutdown_connections 2024-04-25T01:43:26.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.332+0000 7fd3785f9640 1 --2- 172.21.15.77:0/1653051037 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd35406be60 0x7fd35406e320 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:26.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.332+0000 7fd3785f9640 1 --2- 172.21.15.77:0/1653051037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd370150320 0x7fd370070490 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:26.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.332+0000 7fd3785f9640 1 --2- 172.21.15.77:0/1653051037 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd370154380 0x7fd370145d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:26.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.332+0000 7fd3785f9640 1 --2- 172.21.15.77:0/1653051037 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd37006d0a0 0x7fd370147df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:26.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.332+0000 7fd3785f9640 1 -- 172.21.15.77:0/1653051037 >> 172.21.15.77:0/1653051037 conn(0x7fd3700c3f80 msgr2=0x7fd3700c1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:26.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.332+0000 7fd3785f9640 1 -- 172.21.15.77:0/1653051037 shutdown_connections 2024-04-25T01:43:26.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:26.332+0000 7fd3785f9640 1 -- 172.21.15.77:0/1653051037 wait complete. 2024-04-25T01:43:26.333 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T01:43:27.417 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:43:27.417 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:43:27.417 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-04-25T01:43:27.417 INFO:tasks.workunit.client.0.smithi077.stdout:iozone test complete. 2024-04-25T01:43:27.418 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-25T01:43:27.418 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-25T01:43:27.449 INFO:tasks.workunit:Stopping ['suites/iozone.sh'] on client.0... 2024-04-25T01:43:27.449 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-25T01:43:27.778 DEBUG:teuthology.parallel:result is None 2024-04-25T01:43:27.779 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T01:43:27.809 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T01:43:27.809 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-04-25T01:43:28.334 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:43:28.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.448+0000 7f7430831640 1 Processor -- start 2024-04-25T01:43:28.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.448+0000 7f7430831640 1 -- start start 2024-04-25T01:43:28.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.448+0000 7f7430831640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f742c150090 0x7f742c156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:28.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.448+0000 7f7430831640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f742c0c8200 0x7f742c0c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:28.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.448+0000 7f7430831640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f742c0c9de0 con 0x7f742c06c280 2024-04-25T01:43:28.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.448+0000 7f7430831640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f742c06b830 con 0x7f742c0c8200 2024-04-25T01:43:28.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.448+0000 7f7430831640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f742c0c89c0 con 0x7f742c150090 2024-04-25T01:43:28.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.448+0000 7f7429d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f742c0c8200 0x7f742c0c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:28.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.449+0000 7f7429d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f742c0c8200 0x7f742c0c98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35770/0 (socket says 172.21.15.77:35770) 2024-04-25T01:43:28.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.449+0000 7f7429d9b640 1 -- 172.21.15.77:0/234028280 learned_addr learned my addr 172.21.15.77:0/234028280 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:28.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.449+0000 7f742a59c640 1 --2- 172.21.15.77:0/234028280 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f742c150090 0x7f742c156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:28.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.449+0000 7f7429d9b640 1 -- 172.21.15.77:0/234028280 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f742c150090 msgr2=0x7f742c156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:28.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.449+0000 7f7429d9b640 1 --2- 172.21.15.77:0/234028280 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f742c150090 0x7f742c156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:28.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.449+0000 7f7429d9b640 1 -- 172.21.15.77:0/234028280 >> v1:172.21.15.121:6789/0 conn(0x7f742c06c280 legacy=0x7f742c0c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:28.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.449+0000 7f7429d9b640 1 -- 172.21.15.77:0/234028280 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f742c0c8ca0 con 0x7f742c0c8200 2024-04-25T01:43:28.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.449+0000 7f7429d9b640 1 --2- 172.21.15.77:0/234028280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f742c0c8200 0x7f742c0c98a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7414009870 tx=0x7f741402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818d58c9474cd588 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:28.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.450+0000 7f742959a640 1 -- 172.21.15.77:0/234028280 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7414037070 con 0x7f742c0c8200 2024-04-25T01:43:28.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.450+0000 7f742959a640 1 -- 172.21.15.77:0/234028280 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7414032440 con 0x7f742c0c8200 2024-04-25T01:43:28.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.450+0000 7f742959a640 1 -- 172.21.15.77:0/234028280 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7414032810 con 0x7f742c0c8200 2024-04-25T01:43:28.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.450+0000 7f7430831640 1 -- 172.21.15.77:0/234028280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f742c0c8200 msgr2=0x7f742c0c98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:28.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.450+0000 7f7430831640 1 --2- 172.21.15.77:0/234028280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f742c0c8200 0x7f742c0c98a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7414009870 tx=0x7f741402a270 comp rx=0 tx=0).stop 2024-04-25T01:43:28.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.450+0000 7f7430831640 1 -- 172.21.15.77:0/234028280 shutdown_connections 2024-04-25T01:43:28.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.450+0000 7f7430831640 1 --2- 172.21.15.77:0/234028280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f742c0c8200 0x7f742c0c98a0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:28.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.450+0000 7f7430831640 1 --2- 172.21.15.77:0/234028280 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f742c150090 0x7f742c156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:28.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.450+0000 7f7430831640 1 -- 172.21.15.77:0/234028280 >> 172.21.15.77:0/234028280 conn(0x7f742c0ad4d0 msgr2=0x7f742c0ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:28.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.450+0000 7f7430831640 1 -- 172.21.15.77:0/234028280 shutdown_connections 2024-04-25T01:43:28.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.450+0000 7f7430831640 1 -- 172.21.15.77:0/234028280 wait complete. 2024-04-25T01:43:28.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.452+0000 7f7430831640 1 Processor -- start 2024-04-25T01:43:28.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.452+0000 7f7430831640 1 -- start start 2024-04-25T01:43:28.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.452+0000 7f7430831640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f742c06c280 0x7f742c152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:28.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.452+0000 7f7430831640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f742c0c8200 0x7f742c153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:28.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.452+0000 7f7430831640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f742c150090 0x7f742c0c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:28.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.452+0000 7f7430831640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f742c0c8680 con 0x7f742c0c8200 2024-04-25T01:43:28.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.452+0000 7f7430831640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f742c06bd60 con 0x7f742c06c280 2024-04-25T01:43:28.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.452+0000 7f7430831640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f742c0c6a30 con 0x7f742c150090 2024-04-25T01:43:28.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.452+0000 7f7429d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f742c0c8200 0x7f742c153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:28.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.452+0000 7f7429d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f742c0c8200 0x7f742c153e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35778/0 (socket says 172.21.15.77:35778) 2024-04-25T01:43:28.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.452+0000 7f7429d9b640 1 -- 172.21.15.77:0/336175970 learned_addr learned my addr 172.21.15.77:0/336175970 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:28.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.453+0000 7f742a59c640 1 --2- 172.21.15.77:0/336175970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f742c06c280 0x7f742c152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:28.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.453+0000 7f742ad9d640 1 --2- 172.21.15.77:0/336175970 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f742c150090 0x7f742c0c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:28.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.453+0000 7f7429d9b640 1 -- 172.21.15.77:0/336175970 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f742c150090 msgr2=0x7f742c0c31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:28.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.453+0000 7f7429d9b640 1 --2- 172.21.15.77:0/336175970 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f742c150090 0x7f742c0c31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:28.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.453+0000 7f7429d9b640 1 -- 172.21.15.77:0/336175970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f742c06c280 msgr2=0x7f742c152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:28.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.453+0000 7f7429d9b640 1 --2- 172.21.15.77:0/336175970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f742c06c280 0x7f742c152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:28.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.453+0000 7f7429d9b640 1 -- 172.21.15.77:0/336175970 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f742c1ec3c0 con 0x7f742c0c8200 2024-04-25T01:43:28.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.453+0000 7f742a59c640 1 --2- 172.21.15.77:0/336175970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f742c06c280 0x7f742c152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:43:28.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.453+0000 7f742ad9d640 1 --2- 172.21.15.77:0/336175970 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f742c150090 0x7f742c0c31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:43:28.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.453+0000 7f7429d9b640 1 --2- 172.21.15.77:0/336175970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f742c0c8200 0x7f742c153e80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7414000c00 tx=0x7f74140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:28.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.453+0000 7f7422ffd640 1 -- 172.21.15.77:0/336175970 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7414041020 con 0x7f742c0c8200 2024-04-25T01:43:28.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.453+0000 7f7422ffd640 1 -- 172.21.15.77:0/336175970 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74140306c0 con 0x7f742c0c8200 2024-04-25T01:43:28.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.453+0000 7f7430831640 1 -- 172.21.15.77:0/336175970 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f742c152f20 con 0x7f742c0c8200 2024-04-25T01:43:28.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.453+0000 7f7422ffd640 1 -- 172.21.15.77:0/336175970 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7414037040 con 0x7f742c0c8200 2024-04-25T01:43:28.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.453+0000 7f7430831640 1 -- 172.21.15.77:0/336175970 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f742c0c5160 con 0x7f742c0c8200 2024-04-25T01:43:28.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.454+0000 7f7430831640 1 -- 172.21.15.77:0/336175970 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f742c04f500 con 0x7f742c0c8200 2024-04-25T01:43:28.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.454+0000 7f7422ffd640 1 -- 172.21.15.77:0/336175970 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7414044020 con 0x7f742c0c8200 2024-04-25T01:43:28.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.455+0000 7f7422ffd640 1 --2- 172.21.15.77:0/336175970 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f740c06be30 0x7f740c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:28.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.455+0000 7f7422ffd640 1 -- 172.21.15.77:0/336175970 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6981+0+0 (secure 0 0 0) 0x7f74140ab7a0 con 0x7f742c0c8200 2024-04-25T01:43:28.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.455+0000 7f742a59c640 1 --2- 172.21.15.77:0/336175970 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f740c06be30 0x7f740c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:28.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.455+0000 7f742a59c640 1 --2- 172.21.15.77:0/336175970 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f740c06be30 0x7f740c06e2f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f741c006fd0 tx=0x7f741c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:28.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.459+0000 7f7422ffd640 1 -- 172.21.15.77:0/336175970 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f741404b070 con 0x7f742c0c8200 2024-04-25T01:43:28.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.668+0000 7f7430831640 1 -- 172.21.15.77:0/336175970 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f742c06cec0 con 0x7f742c0c8200 2024-04-25T01:43:28.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.668+0000 7f7422ffd640 1 -- 172.21.15.77:0/336175970 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+6485 (secure 0 0 0) 0x7f7414079ce0 con 0x7f742c0c8200 2024-04-25T01:43:28.659 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:43:28.659 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:42:07.395274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5439":{"gid":5439,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5439,"qdb_cluster":[5439]},"id":1},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:41:37.377244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5265":{"gid":5265,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6837/2398109146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2398109146},{"type":"v1","addr":"172.21.15.77:6837","nonce":2398109146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5265,"qdb_cluster":[5265]},"id":2}]} 2024-04-25T01:43:28.659 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 28 2024-04-25T01:43:28.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.670+0000 7f7430831640 1 -- 172.21.15.77:0/336175970 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f740c06be30 msgr2=0x7f740c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:28.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.670+0000 7f7430831640 1 --2- 172.21.15.77:0/336175970 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f740c06be30 0x7f740c06e2f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f741c006fd0 tx=0x7f741c008040 comp rx=0 tx=0).stop 2024-04-25T01:43:28.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.670+0000 7f7430831640 1 -- 172.21.15.77:0/336175970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f742c0c8200 msgr2=0x7f742c153e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:28.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.670+0000 7f7430831640 1 --2- 172.21.15.77:0/336175970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f742c0c8200 0x7f742c153e80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7414000c00 tx=0x7f74140046c0 comp rx=0 tx=0).stop 2024-04-25T01:43:28.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.670+0000 7f7430831640 1 -- 172.21.15.77:0/336175970 shutdown_connections 2024-04-25T01:43:28.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.670+0000 7f7430831640 1 --2- 172.21.15.77:0/336175970 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f740c06be30 0x7f740c06e2f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:28.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.670+0000 7f7430831640 1 --2- 172.21.15.77:0/336175970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f742c0c8200 0x7f742c153e80 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:28.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.670+0000 7f7430831640 1 --2- 172.21.15.77:0/336175970 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f742c150090 0x7f742c0c31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:28.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.670+0000 7f7430831640 1 --2- 172.21.15.77:0/336175970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f742c06c280 0x7f742c152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:28.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.670+0000 7f7430831640 1 -- 172.21.15.77:0/336175970 >> 172.21.15.77:0/336175970 conn(0x7f742c0ad4d0 msgr2=0x7f742c0ad8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:28.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.671+0000 7f7430831640 1 -- 172.21.15.77:0/336175970 shutdown_connections 2024-04-25T01:43:28.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:28.671+0000 7f7430831640 1 -- 172.21.15.77:0/336175970 wait complete. 2024-04-25T01:43:28.672 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T01:43:30.673 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:43:30.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.792+0000 7f40f939e640 1 Processor -- start 2024-04-25T01:43:30.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.792+0000 7f40f939e640 1 -- start start 2024-04-25T01:43:30.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.793+0000 7f40f939e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f40f41537c0 0x7f40f40c6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:30.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.793+0000 7f40f939e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40f40c6780 0x7f40f40c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:30.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.793+0000 7f40f939e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40f4153ba0 con 0x7f40f40c8810 2024-04-25T01:43:30.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.793+0000 7f40f939e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f40f40ca3f0 con 0x7f40f41537c0 2024-04-25T01:43:30.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.793+0000 7f40f939e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f40f4156e20 con 0x7f40f40c6780 2024-04-25T01:43:30.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.793+0000 7f40f2ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f40f41537c0 0x7f40f40c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:30.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.793+0000 7f40f37fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f40f40c8810 0x7f40f40ca590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45552/0 (socket says 172.21.15.77:45552) 2024-04-25T01:43:30.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.793+0000 7f40f37fe640 1 -- 172.21.15.77:0/2627544884 learned_addr learned my addr 172.21.15.77:0/2627544884 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:43:30.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.793+0000 7f40f27fc640 1 --2- 172.21.15.77:0/2627544884 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40f40c6780 0x7f40f40c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:30.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.794+0000 7f40f2ffd640 1 -- 172.21.15.77:0/2627544884 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40f40c6780 msgr2=0x7f40f40c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:30.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.794+0000 7f40f2ffd640 1 --2- 172.21.15.77:0/2627544884 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40f40c6780 0x7f40f40c82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:30.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.794+0000 7f40f2ffd640 1 -- 172.21.15.77:0/2627544884 >> v1:172.21.15.77:6789/0 conn(0x7f40f40c8810 legacy=0x7f40f40ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:30.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.794+0000 7f40f1ffb640 1 -- 172.21.15.77:0/2627544884 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3364920123 0 0) 0x7f40ec001110 con 0x7f40f40c8810 2024-04-25T01:43:30.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.794+0000 7f40f2ffd640 1 -- 172.21.15.77:0/2627544884 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f4156250 con 0x7f40f41537c0 2024-04-25T01:43:30.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.794+0000 7f40f2ffd640 1 --2- 172.21.15.77:0/2627544884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40f41537c0 0x7f40f40c6240 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f40e4009d90 tx=0x7f40e402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12fa76c8a72f4493 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:30.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.795+0000 7f40f1ffb640 1 -- 172.21.15.77:0/2627544884 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e4007740 con 0x7f40f41537c0 2024-04-25T01:43:30.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.795+0000 7f40f1ffb640 1 -- 172.21.15.77:0/2627544884 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e40078e0 con 0x7f40f41537c0 2024-04-25T01:43:30.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.795+0000 7f40f1ffb640 1 -- 172.21.15.77:0/2627544884 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e4007cb0 con 0x7f40f41537c0 2024-04-25T01:43:30.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.795+0000 7f40f939e640 1 -- 172.21.15.77:0/2627544884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40f41537c0 msgr2=0x7f40f40c6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:30.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.795+0000 7f40f939e640 1 --2- 172.21.15.77:0/2627544884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40f41537c0 0x7f40f40c6240 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f40e4009d90 tx=0x7f40e402a6f0 comp rx=0 tx=0).stop 2024-04-25T01:43:30.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.795+0000 7f40f939e640 1 -- 172.21.15.77:0/2627544884 shutdown_connections 2024-04-25T01:43:30.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.795+0000 7f40f939e640 1 --2- 172.21.15.77:0/2627544884 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40f40c6780 0x7f40f40c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:30.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.795+0000 7f40f939e640 1 --2- 172.21.15.77:0/2627544884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40f41537c0 0x7f40f40c6240 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:30.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.795+0000 7f40f939e640 1 -- 172.21.15.77:0/2627544884 >> 172.21.15.77:0/2627544884 conn(0x7f40f40ad490 msgr2=0x7f40f40ad870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:30.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.795+0000 7f40f939e640 1 -- 172.21.15.77:0/2627544884 shutdown_connections 2024-04-25T01:43:30.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.795+0000 7f40f939e640 1 -- 172.21.15.77:0/2627544884 wait complete. 2024-04-25T01:43:30.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.796+0000 7f40f939e640 1 Processor -- start 2024-04-25T01:43:30.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.797+0000 7f40f939e640 1 -- start start 2024-04-25T01:43:30.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.797+0000 7f40f939e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40f40c6780 0x7f40f4159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:30.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.797+0000 7f40f939e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40f40c8810 0x7f40f4158010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:30.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.797+0000 7f40f939e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40f41537c0 0x7f40f40ab300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:30.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.797+0000 7f40f939e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f40f41567d0 con 0x7f40f40c6780 2024-04-25T01:43:30.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.797+0000 7f40f939e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f40f41564f0 con 0x7f40f40c8810 2024-04-25T01:43:30.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.797+0000 7f40f939e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f40f4156ab0 con 0x7f40f41537c0 2024-04-25T01:43:30.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.797+0000 7f40f2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40f40c6780 0x7f40f4159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:30.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.797+0000 7f40f2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40f40c6780 0x7f40f4159210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35796/0 (socket says 172.21.15.77:35796) 2024-04-25T01:43:30.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.797+0000 7f40f2ffd640 1 -- 172.21.15.77:0/1362170181 learned_addr learned my addr 172.21.15.77:0/1362170181 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:30.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.797+0000 7f40f37fe640 1 --2- 172.21.15.77:0/1362170181 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40f41537c0 0x7f40f40ab300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:30.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.797+0000 7f40f27fc640 1 --2- 172.21.15.77:0/1362170181 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40f40c8810 0x7f40f4158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:30.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.798+0000 7f40f2ffd640 1 -- 172.21.15.77:0/1362170181 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40f41537c0 msgr2=0x7f40f40ab300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:30.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.798+0000 7f40f2ffd640 1 --2- 172.21.15.77:0/1362170181 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40f41537c0 0x7f40f40ab300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:30.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.798+0000 7f40f2ffd640 1 -- 172.21.15.77:0/1362170181 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40f40c8810 msgr2=0x7f40f4158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:30.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.798+0000 7f40f2ffd640 1 --2- 172.21.15.77:0/1362170181 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40f40c8810 0x7f40f4158010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:30.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.798+0000 7f40f2ffd640 1 -- 172.21.15.77:0/1362170181 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f415a0f0 con 0x7f40f40c6780 2024-04-25T01:43:30.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.798+0000 7f40f37fe640 1 --2- 172.21.15.77:0/1362170181 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40f41537c0 0x7f40f40ab300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:43:30.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.798+0000 7f40f2ffd640 1 --2- 172.21.15.77:0/1362170181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40f40c6780 0x7f40f4159210 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f40e4009eb0 tx=0x7f40e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:30.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.798+0000 7f40db7fe640 1 -- 172.21.15.77:0/1362170181 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e403f070 con 0x7f40f40c6780 2024-04-25T01:43:30.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.798+0000 7f40db7fe640 1 -- 172.21.15.77:0/1362170181 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e4031c40 con 0x7f40f40c6780 2024-04-25T01:43:30.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.798+0000 7f40f939e640 1 -- 172.21.15.77:0/1362170181 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40f4155070 con 0x7f40f40c6780 2024-04-25T01:43:30.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.798+0000 7f40db7fe640 1 -- 172.21.15.77:0/1362170181 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e4009450 con 0x7f40f40c6780 2024-04-25T01:43:30.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.798+0000 7f40f939e640 1 -- 172.21.15.77:0/1362170181 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40f4158550 con 0x7f40f40c6780 2024-04-25T01:43:30.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.799+0000 7f40f939e640 1 -- 172.21.15.77:0/1362170181 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40f40688e0 con 0x7f40f40c6780 2024-04-25T01:43:30.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.799+0000 7f40db7fe640 1 -- 172.21.15.77:0/1362170181 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f40e4043410 con 0x7f40f40c6780 2024-04-25T01:43:30.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.800+0000 7f40db7fe640 1 --2- 172.21.15.77:0/1362170181 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f40e006be60 0x7f40e006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:30.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.800+0000 7f40db7fe640 1 -- 172.21.15.77:0/1362170181 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7f40e40ac720 con 0x7f40f40c6780 2024-04-25T01:43:30.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.800+0000 7f40f27fc640 1 --2- 172.21.15.77:0/1362170181 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f40e006be60 0x7f40e006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:30.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.800+0000 7f40f27fc640 1 --2- 172.21.15.77:0/1362170181 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f40e006be60 0x7f40e006e320 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f40f40c2730 tx=0x7f40e8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:30.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:30.804+0000 7f40db7fe640 1 -- 172.21.15.77:0/1362170181 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f40e407ac10 con 0x7f40f40c6780 2024-04-25T01:43:31.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.012+0000 7f40f939e640 1 -- 172.21.15.77:0/1362170181 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40f404f500 con 0x7f40f40c6780 2024-04-25T01:43:31.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.013+0000 7f40db7fe640 1 -- 172.21.15.77:0/1362170181 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5656 (secure 0 0 0) 0x7f40e407a510 con 0x7f40f40c6780 2024-04-25T01:43:31.002 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:43:31.003 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:42:07.395274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5439":{"gid":5439,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5439,"qdb_cluster":[5439]},"id":1},{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:43:29.611567+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":29,"state":"up:reconnect","state_seq":20,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-25T01:43:31.005 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 30 2024-04-25T01:43:31.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.015+0000 7f40f939e640 1 -- 172.21.15.77:0/1362170181 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f40e006be60 msgr2=0x7f40e006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:31.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.015+0000 7f40f939e640 1 --2- 172.21.15.77:0/1362170181 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f40e006be60 0x7f40e006e320 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f40f40c2730 tx=0x7f40e8008040 comp rx=0 tx=0).stop 2024-04-25T01:43:31.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.015+0000 7f40f939e640 1 -- 172.21.15.77:0/1362170181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40f40c6780 msgr2=0x7f40f4159210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:31.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.015+0000 7f40f939e640 1 --2- 172.21.15.77:0/1362170181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40f40c6780 0x7f40f4159210 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f40e4009eb0 tx=0x7f40e4004a40 comp rx=0 tx=0).stop 2024-04-25T01:43:31.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.015+0000 7f40f939e640 1 -- 172.21.15.77:0/1362170181 shutdown_connections 2024-04-25T01:43:31.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.015+0000 7f40f939e640 1 --2- 172.21.15.77:0/1362170181 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f40e006be60 0x7f40e006e320 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:31.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.015+0000 7f40f939e640 1 --2- 172.21.15.77:0/1362170181 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40f41537c0 0x7f40f40ab300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:31.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.015+0000 7f40f939e640 1 --2- 172.21.15.77:0/1362170181 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40f40c8810 0x7f40f4158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:31.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.015+0000 7f40f939e640 1 --2- 172.21.15.77:0/1362170181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40f40c6780 0x7f40f4159210 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:31.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.015+0000 7f40f939e640 1 -- 172.21.15.77:0/1362170181 >> 172.21.15.77:0/1362170181 conn(0x7f40f40ad490 msgr2=0x7f40f414c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:31.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.015+0000 7f40f939e640 1 -- 172.21.15.77:0/1362170181 shutdown_connections 2024-04-25T01:43:31.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.015+0000 7f40f939e640 1 -- 172.21.15.77:0/1362170181 wait complete. 2024-04-25T01:43:31.015 INFO:tasks.mds_thrash.fs.[b]:mds.c down, removed from mdsmap 2024-04-25T01:43:31.016 INFO:tasks.mds_thrash.fs.[b]:waiting for mds cluster to stabilize... 2024-04-25T01:43:31.016 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:43:31.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.122+0000 7f4546f63640 1 Processor -- start 2024-04-25T01:43:31.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.122+0000 7f4546f63640 1 -- start start 2024-04-25T01:43:31.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.123+0000 7f4546f63640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4540153cf0 0x7f45400acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:31.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.123+0000 7f4546f63640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4540155d60 con 0x7f45400ac840 2024-04-25T01:43:31.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.123+0000 7f4546f63640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f454006b480 con 0x7f45401558f0 2024-04-25T01:43:31.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.123+0000 7f4546f63640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f4540151780 con 0x7f4540153cf0 2024-04-25T01:43:31.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.123+0000 7f453ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4540153cf0 0x7f45400acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:31.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.123+0000 7f4544cff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f45400ac840 0x7f45401551e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45564/0 (socket says 172.21.15.77:45564) 2024-04-25T01:43:31.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.123+0000 7f4544cff640 1 -- 172.21.15.77:0/2931415615 learned_addr learned my addr 172.21.15.77:0/2931415615 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:43:31.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.123+0000 7f453ffff640 1 -- 172.21.15.77:0/2931415615 >> v1:172.21.15.121:6789/0 conn(0x7f45401558f0 legacy=0x7f454015e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:31.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.123+0000 7f453ffff640 1 -- 172.21.15.77:0/2931415615 >> v1:172.21.15.77:6789/0 conn(0x7f45400ac840 legacy=0x7f45401551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:31.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.123+0000 7f453ffff640 1 -- 172.21.15.77:0/2931415615 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f454006d2f0 con 0x7f4540153cf0 2024-04-25T01:43:31.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.124+0000 7f453ffff640 1 --2- 172.21.15.77:0/2931415615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4540153cf0 0x7f45400acc20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f45340097a0 tx=0x7f453402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c8af6131c307bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:31.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.124+0000 7f453f7fe640 1 -- 172.21.15.77:0/2931415615 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4534037070 con 0x7f4540153cf0 2024-04-25T01:43:31.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.124+0000 7f453f7fe640 1 -- 172.21.15.77:0/2931415615 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f453402ae50 con 0x7f4540153cf0 2024-04-25T01:43:31.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.124+0000 7f453f7fe640 1 -- 172.21.15.77:0/2931415615 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4534032660 con 0x7f4540153cf0 2024-04-25T01:43:31.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.125+0000 7f4546f63640 1 -- 172.21.15.77:0/2931415615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4540153cf0 msgr2=0x7f45400acc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:31.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.125+0000 7f4546f63640 1 --2- 172.21.15.77:0/2931415615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4540153cf0 0x7f45400acc20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f45340097a0 tx=0x7f453402a140 comp rx=0 tx=0).stop 2024-04-25T01:43:31.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.125+0000 7f4546f63640 1 -- 172.21.15.77:0/2931415615 shutdown_connections 2024-04-25T01:43:31.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.125+0000 7f4546f63640 1 --2- 172.21.15.77:0/2931415615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4540153cf0 0x7f45400acc20 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:31.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.125+0000 7f4546f63640 1 -- 172.21.15.77:0/2931415615 >> 172.21.15.77:0/2931415615 conn(0x7f45400c3f80 msgr2=0x7f45400c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:31.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.125+0000 7f4546f63640 1 -- 172.21.15.77:0/2931415615 shutdown_connections 2024-04-25T01:43:31.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.125+0000 7f4546f63640 1 -- 172.21.15.77:0/2931415615 wait complete. 2024-04-25T01:43:31.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.126+0000 7f4546f63640 1 Processor -- start 2024-04-25T01:43:31.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.126+0000 7f4546f63640 1 -- start start 2024-04-25T01:43:31.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.127+0000 7f4546f63640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45400ac840 0x7f45400c0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:31.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.127+0000 7f4546f63640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4540153cf0 0x7f45401ebb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:31.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.127+0000 7f4546f63640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45401558f0 0x7f45401ec0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:31.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.127+0000 7f4546f63640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f454006dc20 con 0x7f45401558f0 2024-04-25T01:43:31.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.127+0000 7f4546f63640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f454006d0a0 con 0x7f4540153cf0 2024-04-25T01:43:31.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.127+0000 7f4546f63640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f454006d8b0 con 0x7f45400ac840 2024-04-25T01:43:31.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.127+0000 7f4545500640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45401558f0 0x7f45401ec0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:31.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.127+0000 7f4545500640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45401558f0 0x7f45401ec0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35810/0 (socket says 172.21.15.77:35810) 2024-04-25T01:43:31.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.127+0000 7f4545500640 1 -- 172.21.15.77:0/623970977 learned_addr learned my addr 172.21.15.77:0/623970977 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:31.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.127+0000 7f453ffff640 1 --2- 172.21.15.77:0/623970977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4540153cf0 0x7f45401ebb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:31.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.127+0000 7f4544cff640 1 --2- 172.21.15.77:0/623970977 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45400ac840 0x7f45400c0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:31.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.127+0000 7f4545500640 1 -- 172.21.15.77:0/623970977 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45400ac840 msgr2=0x7f45400c0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:31.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.127+0000 7f4545500640 1 --2- 172.21.15.77:0/623970977 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45400ac840 0x7f45400c0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:31.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.127+0000 7f4545500640 1 -- 172.21.15.77:0/623970977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4540153cf0 msgr2=0x7f45401ebb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:31.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.127+0000 7f4545500640 1 --2- 172.21.15.77:0/623970977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4540153cf0 0x7f45401ebb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:31.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.127+0000 7f4545500640 1 -- 172.21.15.77:0/623970977 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45401efca0 con 0x7f45401558f0 2024-04-25T01:43:31.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.127+0000 7f4544cff640 1 --2- 172.21.15.77:0/623970977 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45400ac840 0x7f45400c0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:43:31.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.127+0000 7f453ffff640 1 --2- 172.21.15.77:0/623970977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4540153cf0 0x7f45401ebb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:43:31.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.127+0000 7f4545500640 1 --2- 172.21.15.77:0/623970977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45401558f0 0x7f45401ec0c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f453800c780 tx=0x7f453800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:31.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.127+0000 7f453d7fa640 1 -- 172.21.15.77:0/623970977 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4538004b60 con 0x7f45401558f0 2024-04-25T01:43:31.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.127+0000 7f453d7fa640 1 -- 172.21.15.77:0/623970977 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4538004d00 con 0x7f45401558f0 2024-04-25T01:43:31.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.127+0000 7f4546f63640 1 -- 172.21.15.77:0/623970977 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45401535e0 con 0x7f45401558f0 2024-04-25T01:43:31.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.128+0000 7f453d7fa640 1 -- 172.21.15.77:0/623970977 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453800aa90 con 0x7f45401558f0 2024-04-25T01:43:31.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.128+0000 7f4546f63640 1 -- 172.21.15.77:0/623970977 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f454014ba80 con 0x7f45401558f0 2024-04-25T01:43:31.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.128+0000 7f4546f63640 1 -- 172.21.15.77:0/623970977 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f454004f500 con 0x7f45401558f0 2024-04-25T01:43:31.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.129+0000 7f453d7fa640 1 -- 172.21.15.77:0/623970977 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f453800ac30 con 0x7f45401558f0 2024-04-25T01:43:31.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.129+0000 7f453d7fa640 1 --2- 172.21.15.77:0/623970977 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f452c06be30 0x7f452c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:31.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.130+0000 7f4544cff640 1 --2- 172.21.15.77:0/623970977 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f452c06be30 0x7f452c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:31.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.130+0000 7f453d7fa640 1 -- 172.21.15.77:0/623970977 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7f453808b5b0 con 0x7f45401558f0 2024-04-25T01:43:31.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.130+0000 7f4544cff640 1 --2- 172.21.15.77:0/623970977 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f452c06be30 0x7f452c06e2f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4530000f60 tx=0x7f4530009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:31.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.134+0000 7f453d7fa640 1 -- 172.21.15.77:0/623970977 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4538020070 con 0x7f45401558f0 2024-04-25T01:43:31.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.342+0000 7f4546f63640 1 -- 172.21.15.77:0/623970977 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f454006b6e0 con 0x7f45401558f0 2024-04-25T01:43:31.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.342+0000 7f453d7fa640 1 -- 172.21.15.77:0/623970977 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5656 (secure 0 0 0) 0x7f4538059aa0 con 0x7f45401558f0 2024-04-25T01:43:31.333 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:43:31.333 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:42:07.395274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5439":{"gid":5439,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5439,"qdb_cluster":[5439]},"id":1},{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:43:29.611567+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":29,"state":"up:reconnect","state_seq":20,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-25T01:43:31.333 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 30 2024-04-25T01:43:31.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.344+0000 7f4546f63640 1 -- 172.21.15.77:0/623970977 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f452c06be30 msgr2=0x7f452c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:31.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.344+0000 7f4546f63640 1 --2- 172.21.15.77:0/623970977 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f452c06be30 0x7f452c06e2f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4530000f60 tx=0x7f4530009040 comp rx=0 tx=0).stop 2024-04-25T01:43:31.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.344+0000 7f4546f63640 1 -- 172.21.15.77:0/623970977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45401558f0 msgr2=0x7f45401ec0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:31.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.344+0000 7f4546f63640 1 --2- 172.21.15.77:0/623970977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45401558f0 0x7f45401ec0c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f453800c780 tx=0x7f453800cc40 comp rx=0 tx=0).stop 2024-04-25T01:43:31.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.345+0000 7f4546f63640 1 -- 172.21.15.77:0/623970977 shutdown_connections 2024-04-25T01:43:31.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.345+0000 7f4546f63640 1 --2- 172.21.15.77:0/623970977 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f452c06be30 0x7f452c06e2f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:31.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.345+0000 7f4546f63640 1 --2- 172.21.15.77:0/623970977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45401558f0 0x7f45401ec0c0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:31.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.345+0000 7f4546f63640 1 --2- 172.21.15.77:0/623970977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4540153cf0 0x7f45401ebb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:31.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.345+0000 7f4546f63640 1 --2- 172.21.15.77:0/623970977 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45400ac840 0x7f45400c0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:31.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.345+0000 7f4546f63640 1 -- 172.21.15.77:0/623970977 >> 172.21.15.77:0/623970977 conn(0x7f45400c3f80 msgr2=0x7f4540150230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:31.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.345+0000 7f4546f63640 1 -- 172.21.15.77:0/623970977 shutdown_connections 2024-04-25T01:43:31.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:31.345+0000 7f4546f63640 1 -- 172.21.15.77:0/623970977 wait complete. 2024-04-25T01:43:31.347 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 30, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T01:39:23.701997+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 27, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_5439": { "addr": "172.21.15.77:6835/1935321501", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6834", "nonce": 1935321501, "type": "v2" }, { "addr": "172.21.15.77:6835", "nonce": 1935321501, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5439, "incarnation": 24, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:active", "state_seq": 10 } }, "last_failure": 0, "last_failure_osd_epoch": 29, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-25T01:42:07.395274+0000", "qdb_cluster": [ 5439 ], "qdb_leader": 5439, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5439 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T01:39:32.761220+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 30, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_5179": { "addr": "172.21.15.121:6834/747036410", "addrs": { "addrvec": [ { "addr": "172.21.15.121:6832", "nonce": 747036410, "type": "v2" }, { "addr": "172.21.15.121:6834", "nonce": 747036410, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5179, "incarnation": 29, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:reconnect", "state_seq": 20 } }, "last_failure": 0, "last_failure_osd_epoch": 30, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-04-25T01:43:29.611567+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5179 } } } ], "standbys": [ { "addr": "172.21.15.121:6835/1537604", "addrs": { "addrvec": [ { "addr": "172.21.15.121:6833", "nonce": 1537604, "type": "v2" }, { "addr": "172.21.15.121:6835", "nonce": 1537604, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 22, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5116, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-25T01:43:32.421 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-04-25T01:43:32.422 DEBUG:teuthology.run_tasks:Unwinding manager mds_thrash 2024-04-25T01:43:32.432 INFO:tasks.mds_thrash:joining mds_thrasher 2024-04-25T01:43:33.348 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:43:33.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.486+0000 7f119a3e7640 1 Processor -- start 2024-04-25T01:43:33.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.487+0000 7f119a3e7640 1 -- start start 2024-04-25T01:43:33.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.488+0000 7f119a3e7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1194150090 0x7f1194156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:33.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.488+0000 7f119a3e7640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f11940c8200 0x7f11940c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:33.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.488+0000 7f119a3e7640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11940c9de0 con 0x7f119406c280 2024-04-25T01:43:33.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.488+0000 7f119a3e7640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f119406b830 con 0x7f11940c8200 2024-04-25T01:43:33.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.488+0000 7f119a3e7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f11940c89c0 con 0x7f1194150090 2024-04-25T01:43:33.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.488+0000 7f11937fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f11940c8200 0x7f11940c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:33.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.488+0000 7f1193fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1194150090 0x7f1194156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:33.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.488+0000 7f1193fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1194150090 0x7f1194156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.77:52792/0 (socket says 172.21.15.77:52792) 2024-04-25T01:43:33.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.488+0000 7f1193fff640 1 -- 172.21.15.77:0/3005724356 learned_addr learned my addr 172.21.15.77:0/3005724356 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:33.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.488+0000 7f11937fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f11940c8200 0x7f11940c98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:51554/0 (socket says 172.21.15.77:51554) 2024-04-25T01:43:33.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.489+0000 7f11937fe640 1 -- 172.21.15.77:0/3005724356 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1194150090 msgr2=0x7f1194156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:33.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.489+0000 7f11937fe640 1 --2- 172.21.15.77:0/3005724356 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1194150090 0x7f1194156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:33.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.489+0000 7f11937fe640 1 -- 172.21.15.77:0/3005724356 >> v1:172.21.15.121:6789/0 conn(0x7f119406c280 legacy=0x7f11940c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:33.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.489+0000 7f11937fe640 1 -- 172.21.15.77:0/3005724356 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11940c8ca0 con 0x7f11940c8200 2024-04-25T01:43:33.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.490+0000 7f11937fe640 1 --2- 172.21.15.77:0/3005724356 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11940c8200 0x7f11940c98a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f11880097a0 tx=0x7f118802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6da8694d6092d1a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:33.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.490+0000 7f1192ffd640 1 -- 172.21.15.77:0/3005724356 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1188037070 con 0x7f11940c8200 2024-04-25T01:43:33.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.490+0000 7f1192ffd640 1 -- 172.21.15.77:0/3005724356 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1188032440 con 0x7f11940c8200 2024-04-25T01:43:33.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.490+0000 7f1192ffd640 1 -- 172.21.15.77:0/3005724356 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1188032810 con 0x7f11940c8200 2024-04-25T01:43:33.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.491+0000 7f119a3e7640 1 -- 172.21.15.77:0/3005724356 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11940c8200 msgr2=0x7f11940c98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:33.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.491+0000 7f119a3e7640 1 --2- 172.21.15.77:0/3005724356 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11940c8200 0x7f11940c98a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f11880097a0 tx=0x7f118802a180 comp rx=0 tx=0).stop 2024-04-25T01:43:33.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.491+0000 7f119a3e7640 1 -- 172.21.15.77:0/3005724356 shutdown_connections 2024-04-25T01:43:33.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.491+0000 7f119a3e7640 1 --2- 172.21.15.77:0/3005724356 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11940c8200 0x7f11940c98a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:33.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.491+0000 7f119a3e7640 1 --2- 172.21.15.77:0/3005724356 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1194150090 0x7f1194156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:33.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.491+0000 7f119a3e7640 1 -- 172.21.15.77:0/3005724356 >> 172.21.15.77:0/3005724356 conn(0x7f11940ad4d0 msgr2=0x7f11940ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:33.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.491+0000 7f119a3e7640 1 -- 172.21.15.77:0/3005724356 shutdown_connections 2024-04-25T01:43:33.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.491+0000 7f119a3e7640 1 -- 172.21.15.77:0/3005724356 wait complete. 2024-04-25T01:43:33.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.492+0000 7f119a3e7640 1 Processor -- start 2024-04-25T01:43:33.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.493+0000 7f119a3e7640 1 -- start start 2024-04-25T01:43:33.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.494+0000 7f119a3e7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f119406c280 0x7f11940c2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:33.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.494+0000 7f119a3e7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11940c8200 0x7f11941ec380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:33.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.494+0000 7f119a3e7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1194150090 0x7f1194154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:33.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.494+0000 7f119a3e7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f11940c8680 con 0x7f119406c280 2024-04-25T01:43:33.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.494+0000 7f119a3e7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f119406bd60 con 0x7f11940c8200 2024-04-25T01:43:33.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.494+0000 7f119a3e7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f11940c6a30 con 0x7f1194150090 2024-04-25T01:43:33.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.494+0000 7f1198984640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1194150090 0x7f1194154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:33.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.494+0000 7f1198984640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1194150090 0x7f1194154d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.77:52796/0 (socket says 172.21.15.77:52796) 2024-04-25T01:43:33.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.494+0000 7f1198984640 1 -- 172.21.15.77:0/237852975 learned_addr learned my addr 172.21.15.77:0/237852975 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:33.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.494+0000 7f1193fff640 1 --2- 172.21.15.77:0/237852975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f119406c280 0x7f11940c2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:33.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.494+0000 7f11937fe640 1 --2- 172.21.15.77:0/237852975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11940c8200 0x7f11941ec380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:33.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.494+0000 7f1198984640 1 -- 172.21.15.77:0/237852975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11940c8200 msgr2=0x7f11941ec380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:33.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.494+0000 7f1198984640 1 --2- 172.21.15.77:0/237852975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11940c8200 0x7f11941ec380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:33.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.494+0000 7f1198984640 1 -- 172.21.15.77:0/237852975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f119406c280 msgr2=0x7f11940c2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:33.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.495+0000 7f1198984640 1 --2- 172.21.15.77:0/237852975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f119406c280 0x7f11940c2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:33.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.495+0000 7f1198984640 1 -- 172.21.15.77:0/237852975 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1194152280 con 0x7f1194150090 2024-04-25T01:43:33.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.495+0000 7f1193fff640 1 --2- 172.21.15.77:0/237852975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f119406c280 0x7f11940c2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:43:33.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.495+0000 7f1198984640 1 --2- 172.21.15.77:0/237852975 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1194150090 0x7f1194154d90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f118c00c740 tx=0x7f118c00cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:33.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.495+0000 7f1190ff9640 1 -- 172.21.15.77:0/237852975 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118c016020 con 0x7f1194150090 2024-04-25T01:43:33.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.495+0000 7f119a3e7640 1 -- 172.21.15.77:0/237852975 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1194152560 con 0x7f1194150090 2024-04-25T01:43:33.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.496+0000 7f119a3e7640 1 -- 172.21.15.77:0/237852975 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f11941eeed0 con 0x7f1194150090 2024-04-25T01:43:33.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.496+0000 7f1190ff9640 1 -- 172.21.15.77:0/237852975 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f118c00ce50 con 0x7f1194150090 2024-04-25T01:43:33.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.496+0000 7f1190ff9640 1 -- 172.21.15.77:0/237852975 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118c003970 con 0x7f1194150090 2024-04-25T01:43:33.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.499+0000 7f1190ff9640 1 -- 172.21.15.77:0/237852975 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f118c003b10 con 0x7f1194150090 2024-04-25T01:43:33.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.499+0000 7f119a3e7640 1 -- 172.21.15.77:0/237852975 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1174005290 con 0x7f1194150090 2024-04-25T01:43:33.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.500+0000 7f1190ff9640 1 --2- 172.21.15.77:0/237852975 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f118006be60 0x7f118006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:33.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.500+0000 7f1190ff9640 1 -- 172.21.15.77:0/237852975 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7f118c08af70 con 0x7f1194150090 2024-04-25T01:43:33.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.500+0000 7f1193fff640 1 --2- 172.21.15.77:0/237852975 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f118006be60 0x7f118006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:33.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.501+0000 7f1193fff640 1 --2- 172.21.15.77:0/237852975 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f118006be60 0x7f118006e320 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1184009f20 tx=0x7f1184009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:33.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.508+0000 7f1190ff9640 1 -- 172.21.15.77:0/237852975 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f118c020020 con 0x7f1194150090 2024-04-25T01:43:33.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.896+0000 7f119a3e7640 1 -- 172.21.15.77:0/237852975 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1174005580 con 0x7f1194150090 2024-04-25T01:43:33.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.897+0000 7f1190ff9640 1 -- 172.21.15.77:0/237852975 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5660 (secure 0 0 0) 0x7f118c0593c0 con 0x7f1194150090 2024-04-25T01:43:33.888 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:43:33.888 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:42:07.395274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5439":{"gid":5439,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5439,"qdb_cluster":[5439]},"id":1},{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:43:32.407370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":22,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5179,"qdb_cluster":[5179]},"id":2}]} 2024-04-25T01:43:33.890 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 32 2024-04-25T01:43:33.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.899+0000 7f119a3e7640 1 -- 172.21.15.77:0/237852975 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f118006be60 msgr2=0x7f118006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:33.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.899+0000 7f119a3e7640 1 --2- 172.21.15.77:0/237852975 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f118006be60 0x7f118006e320 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1184009f20 tx=0x7f1184009240 comp rx=0 tx=0).stop 2024-04-25T01:43:33.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.899+0000 7f119a3e7640 1 -- 172.21.15.77:0/237852975 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1194150090 msgr2=0x7f1194154d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:33.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.899+0000 7f119a3e7640 1 --2- 172.21.15.77:0/237852975 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1194150090 0x7f1194154d90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f118c00c740 tx=0x7f118c00cc00 comp rx=0 tx=0).stop 2024-04-25T01:43:33.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.899+0000 7f119a3e7640 1 -- 172.21.15.77:0/237852975 shutdown_connections 2024-04-25T01:43:33.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.899+0000 7f119a3e7640 1 --2- 172.21.15.77:0/237852975 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f118006be60 0x7f118006e320 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:33.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.899+0000 7f119a3e7640 1 --2- 172.21.15.77:0/237852975 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1194150090 0x7f1194154d90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:33.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.899+0000 7f119a3e7640 1 --2- 172.21.15.77:0/237852975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11940c8200 0x7f11941ec380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:33.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.899+0000 7f119a3e7640 1 --2- 172.21.15.77:0/237852975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f119406c280 0x7f11940c2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:33.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.899+0000 7f119a3e7640 1 -- 172.21.15.77:0/237852975 >> 172.21.15.77:0/237852975 conn(0x7f11940ad4d0 msgr2=0x7f11940ad8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:33.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.899+0000 7f119a3e7640 1 -- 172.21.15.77:0/237852975 shutdown_connections 2024-04-25T01:43:33.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:33.899+0000 7f119a3e7640 1 -- 172.21.15.77:0/237852975 wait complete. 2024-04-25T01:43:33.906 INFO:tasks.mds_thrash.fs.[b]:mds.b has gained rank=0, replacing gid=5265 2024-04-25T01:43:33.906 INFO:tasks.mds_thrash.fs.[b]:waiting for 8 secs before reviving mds.c 2024-04-25T01:43:36.055 INFO:tasks.ceph.mds.b.smithi121.stderr:2024-04-25T01:43:36.065+0000 7f9f56d18640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T01:43:41.907 INFO:tasks.mds_thrash.fs.[b]:reviving mds.c 2024-04-25T01:43:41.907 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T01:43:41.907 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T01:43:41.910 INFO:tasks.ceph.mds.c:Started 2024-04-25T01:43:41.910 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:43:41.993 INFO:tasks.ceph.mds.c.smithi077.stdout:starting mds.c at 2024-04-25T01:43:42.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.029+0000 7f617929e640 1 Processor -- start 2024-04-25T01:43:42.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.029+0000 7f617929e640 1 -- start start 2024-04-25T01:43:42.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.030+0000 7f617929e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f61740ac840 0x7f61740acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:42.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.030+0000 7f617929e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61741558f0 0x7f617415e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:42.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.030+0000 7f617929e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f617406b480 con 0x7f6174153cf0 2024-04-25T01:43:42.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.030+0000 7f617929e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f6174155da0 con 0x7f61740ac840 2024-04-25T01:43:42.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.030+0000 7f617929e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f6174151780 con 0x7f61741558f0 2024-04-25T01:43:42.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.030+0000 7f6172ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f61740ac840 0x7f61740acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:42.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.030+0000 7f616bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6174153cf0 0x7f61741551e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57376/0 (socket says 172.21.15.77:57376) 2024-04-25T01:43:42.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.030+0000 7f616bfff640 1 -- 172.21.15.77:0/2976399657 learned_addr learned my addr 172.21.15.77:0/2976399657 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:43:42.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.030+0000 7f61737fe640 1 --2- 172.21.15.77:0/2976399657 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61741558f0 0x7f617415e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:42.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.030+0000 7f6172ffd640 1 -- 172.21.15.77:0/2976399657 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61741558f0 msgr2=0x7f617415e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:42.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.030+0000 7f6172ffd640 1 --2- 172.21.15.77:0/2976399657 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61741558f0 0x7f617415e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:42.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.030+0000 7f6172ffd640 1 -- 172.21.15.77:0/2976399657 >> v1:172.21.15.77:6789/0 conn(0x7f6174153cf0 legacy=0x7f61741551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:42.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.030+0000 7f6172ffd640 1 -- 172.21.15.77:0/2976399657 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f617406d2f0 con 0x7f61740ac840 2024-04-25T01:43:42.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.030+0000 7f61727fc640 1 -- 172.21.15.77:0/2976399657 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 778239097 0 0) 0x7f617406b480 con 0x7f6174153cf0 2024-04-25T01:43:42.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.031+0000 7f6172ffd640 1 --2- 172.21.15.77:0/2976399657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61740ac840 0x7f61740acc20 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f61640097a0 tx=0x7f616402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1019620fa4849925 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:42.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.031+0000 7f61727fc640 1 -- 172.21.15.77:0/2976399657 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6164037070 con 0x7f61740ac840 2024-04-25T01:43:42.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.031+0000 7f61727fc640 1 -- 172.21.15.77:0/2976399657 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f616402ae50 con 0x7f61740ac840 2024-04-25T01:43:42.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.031+0000 7f61727fc640 1 -- 172.21.15.77:0/2976399657 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6164032660 con 0x7f61740ac840 2024-04-25T01:43:42.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.031+0000 7f617929e640 1 -- 172.21.15.77:0/2976399657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61740ac840 msgr2=0x7f61740acc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:42.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.031+0000 7f617929e640 1 --2- 172.21.15.77:0/2976399657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61740ac840 0x7f61740acc20 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f61640097a0 tx=0x7f616402a100 comp rx=0 tx=0).stop 2024-04-25T01:43:42.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.032+0000 7f617929e640 1 -- 172.21.15.77:0/2976399657 shutdown_connections 2024-04-25T01:43:42.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.032+0000 7f617929e640 1 --2- 172.21.15.77:0/2976399657 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61741558f0 0x7f617415e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:42.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.032+0000 7f617929e640 1 --2- 172.21.15.77:0/2976399657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61740ac840 0x7f61740acc20 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:42.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.032+0000 7f617929e640 1 -- 172.21.15.77:0/2976399657 >> 172.21.15.77:0/2976399657 conn(0x7f61740c3f80 msgr2=0x7f61740c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:42.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.032+0000 7f617929e640 1 -- 172.21.15.77:0/2976399657 shutdown_connections 2024-04-25T01:43:42.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.032+0000 7f617929e640 1 -- 172.21.15.77:0/2976399657 wait complete. 2024-04-25T01:43:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.033+0000 7f617929e640 1 Processor -- start 2024-04-25T01:43:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.033+0000 7f617929e640 1 -- start start 2024-04-25T01:43:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.033+0000 7f617929e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61740ac840 0x7f61740c2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.033+0000 7f617929e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6174153cf0 0x7f61741ed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.033+0000 7f617929e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61741558f0 0x7f61741ed910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.033+0000 7f617929e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f617406dc20 con 0x7f61740ac840 2024-04-25T01:43:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.033+0000 7f617929e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f617406d0a0 con 0x7f61741558f0 2024-04-25T01:43:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.033+0000 7f617929e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f617406d8b0 con 0x7f6174153cf0 2024-04-25T01:43:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.033+0000 7f6172ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61740ac840 0x7f61740c2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.033+0000 7f6172ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61740ac840 0x7f61740c2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56046/0 (socket says 172.21.15.77:56046) 2024-04-25T01:43:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.033+0000 7f6172ffd640 1 -- 172.21.15.77:0/1115476300 learned_addr learned my addr 172.21.15.77:0/1115476300 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.034+0000 7f61737fe640 1 --2- 172.21.15.77:0/1115476300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61741558f0 0x7f61741ed910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.034+0000 7f616bfff640 1 --2- 172.21.15.77:0/1115476300 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6174153cf0 0x7f61741ed3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.034+0000 7f6172ffd640 1 -- 172.21.15.77:0/1115476300 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6174153cf0 msgr2=0x7f61741ed3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.034+0000 7f6172ffd640 1 --2- 172.21.15.77:0/1115476300 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6174153cf0 0x7f61741ed3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.034+0000 7f6172ffd640 1 -- 172.21.15.77:0/1115476300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61741558f0 msgr2=0x7f61741ed910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.034+0000 7f6172ffd640 1 --2- 172.21.15.77:0/1115476300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61741558f0 0x7f61741ed910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.034+0000 7f6172ffd640 1 -- 172.21.15.77:0/1115476300 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61741ede50 con 0x7f61740ac840 2024-04-25T01:43:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.034+0000 7f616bfff640 1 --2- 172.21.15.77:0/1115476300 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6174153cf0 0x7f61741ed3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:43:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.034+0000 7f6172ffd640 1 --2- 172.21.15.77:0/1115476300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61740ac840 0x7f61740c2b10 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f61640098c0 tx=0x7f61640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.034+0000 7f616b7fe640 1 -- 172.21.15.77:0/1115476300 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6164041030 con 0x7f61740ac840 2024-04-25T01:43:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.034+0000 7f616b7fe640 1 -- 172.21.15.77:0/1115476300 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f616402ac50 con 0x7f61740ac840 2024-04-25T01:43:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.034+0000 7f616b7fe640 1 -- 172.21.15.77:0/1115476300 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6164037040 con 0x7f61740ac840 2024-04-25T01:43:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.034+0000 7f617929e640 1 -- 172.21.15.77:0/1115476300 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61740c30f0 con 0x7f61740ac840 2024-04-25T01:43:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.034+0000 7f617929e640 1 -- 172.21.15.77:0/1115476300 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6174071990 con 0x7f61740ac840 2024-04-25T01:43:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.035+0000 7f617929e640 1 -- 172.21.15.77:0/1115476300 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f617404f500 con 0x7f61740ac840 2024-04-25T01:43:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.036+0000 7f616b7fe640 1 -- 172.21.15.77:0/1115476300 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6164044070 con 0x7f61740ac840 2024-04-25T01:43:42.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.036+0000 7f616b7fe640 1 --2- 172.21.15.77:0/1115476300 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f615406be30 0x7f615406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:42.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.036+0000 7f616b7fe640 1 -- 172.21.15.77:0/1115476300 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7f61640aba80 con 0x7f61740ac840 2024-04-25T01:43:42.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.036+0000 7f616bfff640 1 --2- 172.21.15.77:0/1115476300 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f615406be30 0x7f615406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:42.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.036+0000 7f616bfff640 1 --2- 172.21.15.77:0/1115476300 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f615406be30 0x7f615406e2f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f617414bad0 tx=0x7f615c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:42.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.041+0000 7f616b7fe640 1 -- 172.21.15.77:0/1115476300 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6164044e40 con 0x7f61740ac840 2024-04-25T01:43:42.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.250+0000 7f617929e640 1 -- 172.21.15.77:0/1115476300 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f617406b6e0 con 0x7f61740ac840 2024-04-25T01:43:42.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.250+0000 7f616b7fe640 1 -- 172.21.15.77:0/1115476300 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5660 (secure 0 0 0) 0x7f616407a090 con 0x7f61740ac840 2024-04-25T01:43:42.241 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:43:42.241 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:42:07.395274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5439":{"gid":5439,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5439,"qdb_cluster":[5439]},"id":1},{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:43:32.407370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":22,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5179,"qdb_cluster":[5179]},"id":2}]} 2024-04-25T01:43:42.241 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 32 2024-04-25T01:43:42.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.252+0000 7f617929e640 1 -- 172.21.15.77:0/1115476300 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f615406be30 msgr2=0x7f615406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:42.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.252+0000 7f617929e640 1 --2- 172.21.15.77:0/1115476300 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f615406be30 0x7f615406e2f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f617414bad0 tx=0x7f615c009040 comp rx=0 tx=0).stop 2024-04-25T01:43:42.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.252+0000 7f617929e640 1 -- 172.21.15.77:0/1115476300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61740ac840 msgr2=0x7f61740c2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:42.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.252+0000 7f617929e640 1 --2- 172.21.15.77:0/1115476300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61740ac840 0x7f61740c2b10 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f61640098c0 tx=0x7f61640046c0 comp rx=0 tx=0).stop 2024-04-25T01:43:42.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.252+0000 7f617929e640 1 -- 172.21.15.77:0/1115476300 shutdown_connections 2024-04-25T01:43:42.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.252+0000 7f617929e640 1 --2- 172.21.15.77:0/1115476300 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f615406be30 0x7f615406e2f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:42.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.252+0000 7f617929e640 1 --2- 172.21.15.77:0/1115476300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61741558f0 0x7f61741ed910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:42.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.252+0000 7f617929e640 1 --2- 172.21.15.77:0/1115476300 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6174153cf0 0x7f61741ed3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:42.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.252+0000 7f617929e640 1 --2- 172.21.15.77:0/1115476300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61740ac840 0x7f61740c2b10 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:42.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.252+0000 7f617929e640 1 -- 172.21.15.77:0/1115476300 >> 172.21.15.77:0/1115476300 conn(0x7f61740c3f80 msgr2=0x7f61740c4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:42.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.252+0000 7f617929e640 1 -- 172.21.15.77:0/1115476300 shutdown_connections 2024-04-25T01:43:42.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:42.252+0000 7f617929e640 1 -- 172.21.15.77:0/1115476300 wait complete. 2024-04-25T01:43:42.254 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is in active, standby or standby-replay 2024-04-25T01:43:44.254 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:43:44.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.373+0000 7f266c693640 1 Processor -- start 2024-04-25T01:43:44.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.373+0000 7f266c693640 1 -- start start 2024-04-25T01:43:44.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.374+0000 7f266c693640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2664151450 0x7f266406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:44.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.374+0000 7f266c693640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2664072260 0x7f2664154120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:44.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.374+0000 7f266c693640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2664151830 con 0x7f2664071a60 2024-04-25T01:43:44.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.374+0000 7f266c693640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f2664154d70 con 0x7f2664072260 2024-04-25T01:43:44.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.374+0000 7f266c693640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f2664071800 con 0x7f2664151450 2024-04-25T01:43:44.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.374+0000 7f2669c2e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2664072260 0x7f2664154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:44.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.374+0000 7f2669c2e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2664072260 0x7f2664154120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56062/0 (socket says 172.21.15.77:56062) 2024-04-25T01:43:44.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.374+0000 7f2669c2e640 1 -- 172.21.15.77:0/2826238691 learned_addr learned my addr 172.21.15.77:0/2826238691 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:44.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.375+0000 7f2669c2e640 1 -- 172.21.15.77:0/2826238691 >> v2:172.21.15.121:3300/0 conn(0x7f2664151450 msgr2=0x7f266406ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:44.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.375+0000 7f266a42f640 1 --2- 172.21.15.77:0/2826238691 >> v2:172.21.15.121:3300/0 conn(0x7f2664151450 0x7f266406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:44.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.375+0000 7f2669c2e640 1 --2- 172.21.15.77:0/2826238691 >> v2:172.21.15.121:3300/0 conn(0x7f2664151450 0x7f266406ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:44.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.375+0000 7f2669c2e640 1 -- 172.21.15.77:0/2826238691 >> v1:172.21.15.121:6789/0 conn(0x7f2664071a60 legacy=0x7f2664154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:44.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.375+0000 7f2669c2e640 1 -- 172.21.15.77:0/2826238691 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2664072c10 con 0x7f2664072260 2024-04-25T01:43:44.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.375+0000 7f2669c2e640 1 --2- 172.21.15.77:0/2826238691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2664072260 0x7f2664154120 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f2664151a00 tx=0x7f265402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f10d14495ffbf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:44.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.375+0000 7f266942d640 1 -- 172.21.15.77:0/2826238691 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2654037070 con 0x7f2664072260 2024-04-25T01:43:44.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.375+0000 7f266942d640 1 -- 172.21.15.77:0/2826238691 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2654032440 con 0x7f2664072260 2024-04-25T01:43:44.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.375+0000 7f266942d640 1 -- 172.21.15.77:0/2826238691 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2654032810 con 0x7f2664072260 2024-04-25T01:43:44.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.376+0000 7f266c693640 1 -- 172.21.15.77:0/2826238691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2664072260 msgr2=0x7f2664154120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:44.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.376+0000 7f266c693640 1 --2- 172.21.15.77:0/2826238691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2664072260 0x7f2664154120 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f2664151a00 tx=0x7f265402a180 comp rx=0 tx=0).stop 2024-04-25T01:43:44.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.376+0000 7f266c693640 1 -- 172.21.15.77:0/2826238691 shutdown_connections 2024-04-25T01:43:44.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.376+0000 7f266c693640 1 --2- 172.21.15.77:0/2826238691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2664072260 0x7f2664154120 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:44.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.376+0000 7f266c693640 1 --2- 172.21.15.77:0/2826238691 >> v2:172.21.15.121:3300/0 conn(0x7f2664151450 0x7f266406ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:44.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.376+0000 7f266c693640 1 -- 172.21.15.77:0/2826238691 >> 172.21.15.77:0/2826238691 conn(0x7f26640c4970 msgr2=0x7f26640c4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:44.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.376+0000 7f266c693640 1 -- 172.21.15.77:0/2826238691 shutdown_connections 2024-04-25T01:43:44.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.376+0000 7f266c693640 1 -- 172.21.15.77:0/2826238691 wait complete. 2024-04-25T01:43:44.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.377+0000 7f266c693640 1 Processor -- start 2024-04-25T01:43:44.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.377+0000 7f266c693640 1 -- start start 2024-04-25T01:43:44.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.378+0000 7f266c693640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2664071a60 0x7f2664147a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:44.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.378+0000 7f266c693640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2664072260 0x7f2664147fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:44.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.378+0000 7f266c693640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2664151450 0x7f26641ecb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:44.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.378+0000 7f266c693640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f26640adf20 con 0x7f2664151450 2024-04-25T01:43:44.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.378+0000 7f266c693640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2664071490 con 0x7f2664071a60 2024-04-25T01:43:44.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.378+0000 7f266c693640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f266406f1c0 con 0x7f2664072260 2024-04-25T01:43:44.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.378+0000 7f266ac30640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2664151450 0x7f26641ecb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:44.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.378+0000 7f266ac30640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2664151450 0x7f26641ecb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56072/0 (socket says 172.21.15.77:56072) 2024-04-25T01:43:44.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.378+0000 7f266ac30640 1 -- 172.21.15.77:0/1741643079 learned_addr learned my addr 172.21.15.77:0/1741643079 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:44.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.378+0000 7f266a42f640 1 --2- 172.21.15.77:0/1741643079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2664071a60 0x7f2664147a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:44.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.378+0000 7f2669c2e640 1 --2- 172.21.15.77:0/1741643079 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2664072260 0x7f2664147fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:44.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.378+0000 7f266ac30640 1 -- 172.21.15.77:0/1741643079 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2664072260 msgr2=0x7f2664147fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:44.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.378+0000 7f266ac30640 1 --2- 172.21.15.77:0/1741643079 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2664072260 0x7f2664147fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:44.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.378+0000 7f266ac30640 1 -- 172.21.15.77:0/1741643079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2664071a60 msgr2=0x7f2664147a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:44.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.378+0000 7f266ac30640 1 --2- 172.21.15.77:0/1741643079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2664071a60 0x7f2664147a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:44.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.378+0000 7f266ac30640 1 -- 172.21.15.77:0/1741643079 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26641464f0 con 0x7f2664151450 2024-04-25T01:43:44.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.379+0000 7f266ac30640 1 --2- 172.21.15.77:0/1741643079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2664151450 0x7f26641ecb50 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f265c00c410 tx=0x7f265c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:44.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.379+0000 7f265affd640 1 -- 172.21.15.77:0/1741643079 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c011790 con 0x7f2664151450 2024-04-25T01:43:44.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.379+0000 7f265affd640 1 -- 172.21.15.77:0/1741643079 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f265c017070 con 0x7f2664151450 2024-04-25T01:43:44.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.379+0000 7f266c693640 1 -- 172.21.15.77:0/1741643079 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26641ed700 con 0x7f2664151450 2024-04-25T01:43:44.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.379+0000 7f265affd640 1 -- 172.21.15.77:0/1741643079 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c011bb0 con 0x7f2664151450 2024-04-25T01:43:44.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.379+0000 7f266c693640 1 -- 172.21.15.77:0/1741643079 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26641ed9e0 con 0x7f2664151450 2024-04-25T01:43:44.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.380+0000 7f266c693640 1 -- 172.21.15.77:0/1741643079 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f266404f500 con 0x7f2664151450 2024-04-25T01:43:44.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.380+0000 7f265affd640 1 -- 172.21.15.77:0/1741643079 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f265c01c460 con 0x7f2664151450 2024-04-25T01:43:44.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.380+0000 7f265affd640 1 --2- 172.21.15.77:0/1741643079 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f264806be30 0x7f264806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:44.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.381+0000 7f265affd640 1 -- 172.21.15.77:0/1741643079 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7f265c08ad80 con 0x7f2664151450 2024-04-25T01:43:44.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.381+0000 7f266a42f640 1 --2- 172.21.15.77:0/1741643079 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f264806be30 0x7f264806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:44.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.381+0000 7f266a42f640 1 --2- 172.21.15.77:0/1741643079 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f264806be30 0x7f264806e2f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f266000f360 tx=0x7f2660007710 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:44.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.385+0000 7f265affd640 1 -- 172.21.15.77:0/1741643079 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f265c021020 con 0x7f2664151450 2024-04-25T01:43:44.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.597+0000 7f266c693640 1 -- 172.21.15.77:0/1741643079 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2664071060 con 0x7f2664151450 2024-04-25T01:43:44.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.597+0000 7f265affd640 1 -- 172.21.15.77:0/1741643079 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+6485 (secure 0 0 0) 0x7f265c058c20 con 0x7f2664151450 2024-04-25T01:43:44.588 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:43:44.588 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1570919706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1570919706},{"type":"v1","addr":"172.21.15.77:6837","nonce":1570919706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:42:07.395274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5439":{"gid":5439,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5439,"qdb_cluster":[5439]},"id":1},{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:43:32.407370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":22,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5179,"qdb_cluster":[5179]},"id":2}]} 2024-04-25T01:43:44.588 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 33 2024-04-25T01:43:44.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.599+0000 7f266c693640 1 -- 172.21.15.77:0/1741643079 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f264806be30 msgr2=0x7f264806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:44.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.599+0000 7f266c693640 1 --2- 172.21.15.77:0/1741643079 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f264806be30 0x7f264806e2f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f266000f360 tx=0x7f2660007710 comp rx=0 tx=0).stop 2024-04-25T01:43:44.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.599+0000 7f266c693640 1 -- 172.21.15.77:0/1741643079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2664151450 msgr2=0x7f26641ecb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:44.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.599+0000 7f266c693640 1 --2- 172.21.15.77:0/1741643079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2664151450 0x7f26641ecb50 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f265c00c410 tx=0x7f265c00c8d0 comp rx=0 tx=0).stop 2024-04-25T01:43:44.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.599+0000 7f266c693640 1 -- 172.21.15.77:0/1741643079 shutdown_connections 2024-04-25T01:43:44.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.599+0000 7f266c693640 1 --2- 172.21.15.77:0/1741643079 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f264806be30 0x7f264806e2f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:44.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.599+0000 7f266c693640 1 --2- 172.21.15.77:0/1741643079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2664151450 0x7f26641ecb50 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:44.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.599+0000 7f266c693640 1 --2- 172.21.15.77:0/1741643079 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2664072260 0x7f2664147fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:44.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.599+0000 7f266c693640 1 --2- 172.21.15.77:0/1741643079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2664071a60 0x7f2664147a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:44.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.599+0000 7f266c693640 1 -- 172.21.15.77:0/1741643079 >> 172.21.15.77:0/1741643079 conn(0x7f26640c4970 msgr2=0x7f26640c4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:44.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.599+0000 7f266c693640 1 -- 172.21.15.77:0/1741643079 shutdown_connections 2024-04-25T01:43:44.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.599+0000 7f266c693640 1 -- 172.21.15.77:0/1741643079 wait complete. 2024-04-25T01:43:44.601 INFO:tasks.mds_thrash.fs.[b]:mds.c reported in up:standby state 2024-04-25T01:43:44.601 INFO:tasks.mds_thrash.fs.[b]:stat['max_mds'] = 0 2024-04-25T01:43:44.601 INFO:tasks.mds_thrash.fs.[b]:stat['deactivate'] = 0 2024-04-25T01:43:44.601 INFO:tasks.mds_thrash.fs.[b]:stat['kill'] = 3 2024-04-25T01:43:44.602 INFO:tasks.mds_thrash:done joining 2024-04-25T01:43:44.602 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-25T01:43:44.610 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-25T01:43:44.611 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:43:44.611 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T01:43:44.626 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-25T01:43:44.627 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T01:43:44.681 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T01:43:44.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.827+0000 7f51a8390640 1 Processor -- start 2024-04-25T01:43:44.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.827+0000 7f51a8390640 1 -- start start 2024-04-25T01:43:44.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.828+0000 7f51a8390640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f51a0150320 0x7f51a0156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:44.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.828+0000 7f51a8390640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f51a006d0a0 0x7f51a006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:44.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.828+0000 7f51a8390640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51a0153be0 con 0x7f51a0154380 2024-04-25T01:43:44.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.828+0000 7f51a8390640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f51a0152fd0 con 0x7f51a006d0a0 2024-04-25T01:43:44.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.828+0000 7f51a8390640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f51a01532b0 con 0x7f51a0150320 2024-04-25T01:43:44.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.828+0000 7f51a592b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f51a006d0a0 0x7f51a006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:44.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.828+0000 7f51a592b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f51a006d0a0 0x7f51a006d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56078/0 (socket says 172.21.15.77:56078) 2024-04-25T01:43:44.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.828+0000 7f51a592b640 1 -- 172.21.15.77:0/3294322629 learned_addr learned my addr 172.21.15.77:0/3294322629 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:44.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.828+0000 7f51a612c640 1 --2- 172.21.15.77:0/3294322629 >> v2:172.21.15.121:3300/0 conn(0x7f51a0150320 0x7f51a0156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:44.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.828+0000 7f51a592b640 1 -- 172.21.15.77:0/3294322629 >> v2:172.21.15.121:3300/0 conn(0x7f51a0150320 msgr2=0x7f51a0156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:44.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.829+0000 7f51a592b640 1 --2- 172.21.15.77:0/3294322629 >> v2:172.21.15.121:3300/0 conn(0x7f51a0150320 0x7f51a0156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:44.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.829+0000 7f51a592b640 1 -- 172.21.15.77:0/3294322629 >> v1:172.21.15.121:6789/0 conn(0x7f51a0154380 legacy=0x7f51a0154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:44.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.829+0000 7f51a592b640 1 -- 172.21.15.77:0/3294322629 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a0157100 con 0x7f51a006d0a0 2024-04-25T01:43:44.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.829+0000 7f51a612c640 1 --2- 172.21.15.77:0/3294322629 >> v2:172.21.15.121:3300/0 conn(0x7f51a0150320 0x7f51a0156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:43:44.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.829+0000 7f51a592b640 1 --2- 172.21.15.77:0/3294322629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51a006d0a0 0x7f51a006d4e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f51a006db60 tx=0x7f519002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f26c7d1617623529 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:44.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.829+0000 7f51a512a640 1 -- 172.21.15.77:0/3294322629 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5190037070 con 0x7f51a006d0a0 2024-04-25T01:43:44.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.829+0000 7f51a512a640 1 -- 172.21.15.77:0/3294322629 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5190032440 con 0x7f51a006d0a0 2024-04-25T01:43:44.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.829+0000 7f51a512a640 1 -- 172.21.15.77:0/3294322629 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5190032810 con 0x7f51a006d0a0 2024-04-25T01:43:44.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.830+0000 7f51a8390640 1 -- 172.21.15.77:0/3294322629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51a006d0a0 msgr2=0x7f51a006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:44.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.830+0000 7f51a8390640 1 --2- 172.21.15.77:0/3294322629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51a006d0a0 0x7f51a006d4e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f51a006db60 tx=0x7f519002a1a0 comp rx=0 tx=0).stop 2024-04-25T01:43:44.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.830+0000 7f51a8390640 1 -- 172.21.15.77:0/3294322629 shutdown_connections 2024-04-25T01:43:44.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.830+0000 7f51a8390640 1 --2- 172.21.15.77:0/3294322629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51a006d0a0 0x7f51a006d4e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:44.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.830+0000 7f51a8390640 1 --2- 172.21.15.77:0/3294322629 >> v2:172.21.15.121:3300/0 conn(0x7f51a0150320 0x7f51a0156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:44.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.830+0000 7f51a8390640 1 -- 172.21.15.77:0/3294322629 >> 172.21.15.77:0/3294322629 conn(0x7f51a00c3f80 msgr2=0x7f51a00c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:44.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.830+0000 7f51a8390640 1 -- 172.21.15.77:0/3294322629 shutdown_connections 2024-04-25T01:43:44.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.830+0000 7f51a8390640 1 -- 172.21.15.77:0/3294322629 wait complete. 2024-04-25T01:43:44.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.831+0000 7f51a8390640 1 Processor -- start 2024-04-25T01:43:44.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.831+0000 7f51a8390640 1 -- start start 2024-04-25T01:43:44.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.832+0000 7f51a8390640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51a006d0a0 0x7f51a014a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:44.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.832+0000 7f51a8390640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f51a0150320 0x7f51a01eb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:44.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.832+0000 7f51a8390640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51a0154380 0x7f51a0140930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:44.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.832+0000 7f51a8390640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f51a0154f40 con 0x7f51a0154380 2024-04-25T01:43:44.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.832+0000 7f51a8390640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f51a0153870 con 0x7f51a006d0a0 2024-04-25T01:43:44.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.832+0000 7f51a8390640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f51a0152bf0 con 0x7f51a0150320 2024-04-25T01:43:44.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.832+0000 7f51a692d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51a0154380 0x7f51a0140930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:44.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.832+0000 7f51a692d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51a0154380 0x7f51a0140930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56082/0 (socket says 172.21.15.77:56082) 2024-04-25T01:43:44.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.832+0000 7f51a692d640 1 -- 172.21.15.77:0/2648100628 learned_addr learned my addr 172.21.15.77:0/2648100628 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:44.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.832+0000 7f51a612c640 1 --2- 172.21.15.77:0/2648100628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51a006d0a0 0x7f51a014a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:44.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.832+0000 7f51a592b640 1 --2- 172.21.15.77:0/2648100628 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f51a0150320 0x7f51a01eb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:44.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.832+0000 7f51a692d640 1 -- 172.21.15.77:0/2648100628 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f51a0150320 msgr2=0x7f51a01eb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:44.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.832+0000 7f51a692d640 1 --2- 172.21.15.77:0/2648100628 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f51a0150320 0x7f51a01eb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:44.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.832+0000 7f51a692d640 1 -- 172.21.15.77:0/2648100628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51a006d0a0 msgr2=0x7f51a014a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:44.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.832+0000 7f51a692d640 1 --2- 172.21.15.77:0/2648100628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51a006d0a0 0x7f51a014a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:44.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.832+0000 7f51a692d640 1 -- 172.21.15.77:0/2648100628 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a00c8280 con 0x7f51a0154380 2024-04-25T01:43:44.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.832+0000 7f51a692d640 1 --2- 172.21.15.77:0/2648100628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51a0154380 0x7f51a0140930 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f519800c780 tx=0x7f519800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:44.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.832+0000 7f5196ffd640 1 -- 172.21.15.77:0/2648100628 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5198004b60 con 0x7f51a0154380 2024-04-25T01:43:44.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.832+0000 7f5196ffd640 1 -- 172.21.15.77:0/2648100628 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5198004d00 con 0x7f51a0154380 2024-04-25T01:43:44.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.832+0000 7f5196ffd640 1 -- 172.21.15.77:0/2648100628 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519800aa90 con 0x7f51a0154380 2024-04-25T01:43:44.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.832+0000 7f51a8390640 1 -- 172.21.15.77:0/2648100628 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51a01ef720 con 0x7f51a0154380 2024-04-25T01:43:44.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.832+0000 7f51a8390640 1 -- 172.21.15.77:0/2648100628 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51a01413b0 con 0x7f51a0154380 2024-04-25T01:43:44.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.833+0000 7f51a8390640 1 -- 172.21.15.77:0/2648100628 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51a004f500 con 0x7f51a0154380 2024-04-25T01:43:44.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.834+0000 7f5196ffd640 1 -- 172.21.15.77:0/2648100628 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f519800ac30 con 0x7f51a0154380 2024-04-25T01:43:44.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.834+0000 7f5196ffd640 1 --2- 172.21.15.77:0/2648100628 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f518406be30 0x7f518406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:44.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.834+0000 7f5196ffd640 1 -- 172.21.15.77:0/2648100628 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7f519808b610 con 0x7f51a0154380 2024-04-25T01:43:44.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.834+0000 7f51a612c640 1 --2- 172.21.15.77:0/2648100628 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f518406be30 0x7f518406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:44.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.835+0000 7f51a612c640 1 --2- 172.21.15.77:0/2648100628 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f518406be30 0x7f518406e2f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f519c00a950 tx=0x7f519c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:44.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:44.839+0000 7f5196ffd640 1 -- 172.21.15.77:0/2648100628 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5198020070 con 0x7f51a0154380 2024-04-25T01:43:45.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.012+0000 7f51a8390640 1 -- 172.21.15.77:0/2648100628 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f51a0073750 con 0x7f51a0154380 2024-04-25T01:43:45.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.013+0000 7f5196ffd640 1 -- 172.21.15.77:0/2648100628 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+21172 (secure 0 0 0) 0x7f5198059a80 con 0x7f51a0154380 2024-04-25T01:43:45.005 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:43:45.005 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":30,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:43:29.392580+0000","last_up_change":"2024-04-25T01:39:10.729600+0000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T01:39:11.681151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T01:39:21.606752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T01:39:22.677664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T01:39:30.501700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T01:39:31.740717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6811","nonce":3366980158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6817","nonce":3366980158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6828","nonce":3366980158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6825","nonce":3366980158}]},"public_addr":"172.21.15.77:6811/3366980158","cluster_addr":"172.21.15.77:6817/3366980158","heartbeat_back_addr":"172.21.15.77:6828/3366980158","heartbeat_front_addr":"172.21.15.77:6825/3366980158","state":["exists","up"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6801","nonce":3971619298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6803","nonce":3971619298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6807","nonce":3971619298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6805","nonce":3971619298}]},"public_addr":"172.21.15.77:6801/3971619298","cluster_addr":"172.21.15.77:6803/3971619298","heartbeat_back_addr":"172.21.15.77:6807/3971619298","heartbeat_front_addr":"172.21.15.77:6805/3971619298","state":["exists","up"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6810","nonce":4103452689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6813","nonce":4103452689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6823","nonce":4103452689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6818","nonce":4103452689}]},"public_addr":"172.21.15.77:6810/4103452689","cluster_addr":"172.21.15.77:6813/4103452689","heartbeat_back_addr":"172.21.15.77:6823/4103452689","heartbeat_front_addr":"172.21.15.77:6818/4103452689","state":["exists","up"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6819","nonce":217398906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6824","nonce":217398906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6831","nonce":217398906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6829","nonce":217398906}]},"public_addr":"172.21.15.77:6819/217398906","cluster_addr":"172.21.15.77:6824/217398906","heartbeat_back_addr":"172.21.15.77:6831/217398906","heartbeat_front_addr":"172.21.15.77:6829/217398906","state":["exists","up"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6801","nonce":2565483070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6803","nonce":2565483070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6810","nonce":2565483070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6806","nonce":2565483070}]},"public_addr":"172.21.15.121:6801/2565483070","cluster_addr":"172.21.15.121:6803/2565483070","heartbeat_back_addr":"172.21.15.121:6810/2565483070","heartbeat_front_addr":"172.21.15.121:6806/2565483070","state":["exists","up"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6807","nonce":2785294752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6809","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6811","nonce":2785294752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6815","nonce":2785294752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6813","nonce":2785294752}]},"public_addr":"172.21.15.121:6807/2785294752","cluster_addr":"172.21.15.121:6811/2785294752","heartbeat_back_addr":"172.21.15.121:6815/2785294752","heartbeat_front_addr":"172.21.15.121:6813/2785294752","state":["exists","up"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6820","nonce":523906818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6824","nonce":523906818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6831","nonce":523906818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6828","nonce":523906818}]},"public_addr":"172.21.15.121:6820/523906818","cluster_addr":"172.21.15.121:6824/523906818","heartbeat_back_addr":"172.21.15.121:6831/523906818","heartbeat_front_addr":"172.21.15.121:6828/523906818","state":["exists","up"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6817","nonce":1683602459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6819","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6821","nonce":1683602459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6829","nonce":1683602459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6823","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6825","nonce":1683602459}]},"public_addr":"172.21.15.121:6817/1683602459","cluster_addr":"172.21.15.121:6821/1683602459","heartbeat_back_addr":"172.21.15.121:6829/1683602459","heartbeat_front_addr":"172.21.15.121:6825/1683602459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.839443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.818842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.776243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.793085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.822396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.907311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.918374+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.848430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:6837/2398109146":"2024-04-26T01:43:29.392514+0000","172.21.15.77:6836/2398109146":"2024-04-26T01:43:29.392514+0000","172.21.15.121:6834/1039950655":"2024-04-26T01:42:04.378069+0000","172.21.15.77:6835/1958322306":"2024-04-26T01:41:34.373188+0000","172.21.15.77:6834/1958322306":"2024-04-26T01:41:34.373188+0000","172.21.15.121:6835/2449150984":"2024-04-26T01:41:34.373282+0000","172.21.15.121:6832/1039950655":"2024-04-26T01:42:04.378069+0000","172.21.15.121:6833/2449150984":"2024-04-26T01:41:34.373282+0000","172.21.15.77:6837/3454203695":"2024-04-26T01:40:59.368156+0000","172.21.15.77:6836/3454203695":"2024-04-26T01:40:59.368156+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:43:45.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.015+0000 7f51a8390640 1 -- 172.21.15.77:0/2648100628 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f518406be30 msgr2=0x7f518406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:45.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.015+0000 7f51a8390640 1 --2- 172.21.15.77:0/2648100628 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f518406be30 0x7f518406e2f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f519c00a950 tx=0x7f519c008040 comp rx=0 tx=0).stop 2024-04-25T01:43:45.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.016+0000 7f51a8390640 1 -- 172.21.15.77:0/2648100628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51a0154380 msgr2=0x7f51a0140930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:45.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.016+0000 7f51a8390640 1 --2- 172.21.15.77:0/2648100628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51a0154380 0x7f51a0140930 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f519800c780 tx=0x7f519800cc40 comp rx=0 tx=0).stop 2024-04-25T01:43:45.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.016+0000 7f51a8390640 1 -- 172.21.15.77:0/2648100628 shutdown_connections 2024-04-25T01:43:45.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.016+0000 7f51a8390640 1 --2- 172.21.15.77:0/2648100628 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f518406be30 0x7f518406e2f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.016+0000 7f51a8390640 1 --2- 172.21.15.77:0/2648100628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51a0154380 0x7f51a0140930 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.016+0000 7f51a8390640 1 --2- 172.21.15.77:0/2648100628 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f51a0150320 0x7f51a01eb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.016+0000 7f51a8390640 1 --2- 172.21.15.77:0/2648100628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51a006d0a0 0x7f51a014a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.016+0000 7f51a8390640 1 -- 172.21.15.77:0/2648100628 >> 172.21.15.77:0/2648100628 conn(0x7f51a00c3f80 msgr2=0x7f51a00c1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:45.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.016+0000 7f51a8390640 1 -- 172.21.15.77:0/2648100628 shutdown_connections 2024-04-25T01:43:45.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.016+0000 7f51a8390640 1 -- 172.21.15.77:0/2648100628 wait complete. 2024-04-25T01:43:45.018 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T01:39:11.681151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-25T01:39:21.606752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-25T01:39:22.677664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-25T01:39:30.501700+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-25T01:39:31.740717+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T01:43:45.018 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T01:43:45.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.127+0000 7f3d14d42640 1 Processor -- start 2024-04-25T01:43:45.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.127+0000 7f3d14d42640 1 -- start start 2024-04-25T01:43:45.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.128+0000 7f3d14d42640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3d100c4280 0x7f3d101538f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:45.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.128+0000 7f3d14d42640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d10073450 0x7f3d10153e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:45.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.128+0000 7f3d14d42640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d100c7040 con 0x7f3d100c4cb0 2024-04-25T01:43:45.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.128+0000 7f3d14d42640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f3d100c1cd0 con 0x7f3d100c4280 2024-04-25T01:43:45.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.128+0000 7f3d14d42640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f3d100ac010 con 0x7f3d10073450 2024-04-25T01:43:45.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.128+0000 7f3d0ed9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3d100c4cb0 0x7f3d100c5480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57386/0 (socket says 172.21.15.77:57386) 2024-04-25T01:43:45.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.128+0000 7f3d0ed9d640 1 -- 172.21.15.77:0/2367748741 learned_addr learned my addr 172.21.15.77:0/2367748741 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:43:45.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.128+0000 7f3d0e59c640 1 --2- 172.21.15.77:0/2367748741 >> v2:172.21.15.121:3300/0 conn(0x7f3d100c4280 0x7f3d101538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:45.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.128+0000 7f3d0dd9b640 1 --2- 172.21.15.77:0/2367748741 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d10073450 0x7f3d10153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:45.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.128+0000 7f3d0d59a640 1 -- 172.21.15.77:0/2367748741 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3526164582 0 0) 0x7f3d100c7040 con 0x7f3d100c4cb0 2024-04-25T01:43:45.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.128+0000 7f3d0d59a640 1 -- 172.21.15.77:0/2367748741 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cf8003520 con 0x7f3d100c4cb0 2024-04-25T01:43:45.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.129+0000 7f3d0d59a640 1 -- 172.21.15.77:0/2367748741 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3559484248 0 0) 0x7f3cf8003520 con 0x7f3d100c4cb0 2024-04-25T01:43:45.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.129+0000 7f3d0d59a640 1 -- 172.21.15.77:0/2367748741 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d10073450 msgr2=0x7f3d10153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:45.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.129+0000 7f3d0d59a640 1 --2- 172.21.15.77:0/2367748741 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d10073450 0x7f3d10153e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.129+0000 7f3d0d59a640 1 -- 172.21.15.77:0/2367748741 >> v2:172.21.15.121:3300/0 conn(0x7f3d100c4280 msgr2=0x7f3d101538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:45.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.129+0000 7f3d0d59a640 1 --2- 172.21.15.77:0/2367748741 >> v2:172.21.15.121:3300/0 conn(0x7f3d100c4280 0x7f3d101538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.129+0000 7f3d0d59a640 1 -- 172.21.15.77:0/2367748741 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d100ac2f0 con 0x7f3d100c4cb0 2024-04-25T01:43:45.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.129+0000 7f3d0d59a640 1 -- 172.21.15.77:0/2367748741 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7f3d080019f0 con 0x7f3d100c4cb0 2024-04-25T01:43:45.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.129+0000 7f3d0d59a640 1 -- 172.21.15.77:0/2367748741 >> v1:172.21.15.77:6789/0 conn(0x7f3d100c4cb0 legacy=0x7f3d100c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:45.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.129+0000 7f3d0d59a640 1 --2- 172.21.15.77:0/2367748741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cf80039b0 0x7f3cf8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:45.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.129+0000 7f3d0d59a640 1 --2- 172.21.15.77:0/2367748741 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d10073450 0x7f3cf8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:45.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.129+0000 7f3d0d59a640 1 --2- 172.21.15.77:0/2367748741 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3cf8004d40 0x7f3cf80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:45.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.129+0000 7f3d0d59a640 1 -- 172.21.15.77:0/2367748741 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3d100c1cd0 con 0x7f3cf80039b0 2024-04-25T01:43:45.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.129+0000 7f3d0d59a640 1 -- 172.21.15.77:0/2367748741 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3d100ac010 con 0x7f3cf8004d40 2024-04-25T01:43:45.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.129+0000 7f3d0d59a640 1 -- 172.21.15.77:0/2367748741 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f3cf800b9c0 con 0x7f3d10073450 2024-04-25T01:43:45.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.129+0000 7f3d0e59c640 1 --2- 172.21.15.77:0/2367748741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cf80039b0 0x7f3cf8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:45.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.129+0000 7f3d0dd9b640 1 --2- 172.21.15.77:0/2367748741 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d10073450 0x7f3cf8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:45.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.129+0000 7f3d0ed9d640 1 --2- 172.21.15.77:0/2367748741 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3cf8004d40 0x7f3cf80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:45.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.129+0000 7f3d0e59c640 1 -- 172.21.15.77:0/2367748741 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d10073450 msgr2=0x7f3cf8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:45.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.129+0000 7f3d0e59c640 1 --2- 172.21.15.77:0/2367748741 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d10073450 0x7f3cf8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.129+0000 7f3d0e59c640 1 -- 172.21.15.77:0/2367748741 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3cf8004d40 msgr2=0x7f3cf80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:45.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.129+0000 7f3d0e59c640 1 --2- 172.21.15.77:0/2367748741 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3cf8004d40 0x7f3cf80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.129+0000 7f3d0e59c640 1 -- 172.21.15.77:0/2367748741 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf8003520 con 0x7f3cf80039b0 2024-04-25T01:43:45.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.130+0000 7f3d0e59c640 1 --2- 172.21.15.77:0/2367748741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cf80039b0 0x7f3cf8003dd0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3d00009ac0 tx=0x7f3cf8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b52e7d0f29719a5f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:45.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.130+0000 7f3d0d59a640 1 -- 172.21.15.77:0/2367748741 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d00036070 con 0x7f3cf80039b0 2024-04-25T01:43:45.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.130+0000 7f3d0d59a640 1 -- 172.21.15.77:0/2367748741 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d00031400 con 0x7f3cf80039b0 2024-04-25T01:43:45.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.130+0000 7f3d0d59a640 1 -- 172.21.15.77:0/2367748741 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d00009690 con 0x7f3cf80039b0 2024-04-25T01:43:45.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.130+0000 7f3d14d42640 1 -- 172.21.15.77:0/2367748741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cf80039b0 msgr2=0x7f3cf8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:45.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.130+0000 7f3d14d42640 1 --2- 172.21.15.77:0/2367748741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cf80039b0 0x7f3cf8003dd0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3d00009ac0 tx=0x7f3cf8005830 comp rx=0 tx=0).stop 2024-04-25T01:43:45.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.130+0000 7f3d0ed9d640 1 -- 172.21.15.77:0/2367748741 reap_dead start 2024-04-25T01:43:45.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.130+0000 7f3d14d42640 1 -- 172.21.15.77:0/2367748741 shutdown_connections 2024-04-25T01:43:45.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.130+0000 7f3d14d42640 1 -- 172.21.15.77:0/2367748741 >> 172.21.15.77:0/2367748741 conn(0x7f3d100c7580 msgr2=0x7f3d100c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:45.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.130+0000 7f3d14d42640 1 -- 172.21.15.77:0/2367748741 shutdown_connections 2024-04-25T01:43:45.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.130+0000 7f3d14d42640 1 -- 172.21.15.77:0/2367748741 wait complete. 2024-04-25T01:43:45.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.132+0000 7f3d14d42640 1 Processor -- start 2024-04-25T01:43:45.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.132+0000 7f3d14d42640 1 -- start start 2024-04-25T01:43:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.132+0000 7f3d14d42640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3cf80039b0 0x7f3d100c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.132+0000 7f3d14d42640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d100a7a50 0x7f3d101ef5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.132+0000 7f3d14d42640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d101eb9e0 0x7f3d10145810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.132+0000 7f3d14d42640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3d100c1a90 con 0x7f3d100a7a50 2024-04-25T01:43:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.132+0000 7f3d14d42640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3d100c1910 con 0x7f3d101eb9e0 2024-04-25T01:43:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.132+0000 7f3d14d42640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f3d100c4660 con 0x7f3cf80039b0 2024-04-25T01:43:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.132+0000 7f3d0dd9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d100a7a50 0x7f3d101ef5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.132+0000 7f3d0dd9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d100a7a50 0x7f3d101ef5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56104/0 (socket says 172.21.15.77:56104) 2024-04-25T01:43:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.132+0000 7f3d0dd9b640 1 -- 172.21.15.77:0/3788453344 learned_addr learned my addr 172.21.15.77:0/3788453344 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.133+0000 7f3d0ed9d640 1 --2- 172.21.15.77:0/3788453344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d101eb9e0 0x7f3d10145810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.133+0000 7f3d0dd9b640 1 -- 172.21.15.77:0/3788453344 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3cf80039b0 msgr2=0x7f3d100c0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.133+0000 7f3d0dd9b640 1 --2- 172.21.15.77:0/3788453344 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3cf80039b0 0x7f3d100c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.133+0000 7f3d0dd9b640 1 -- 172.21.15.77:0/3788453344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d101eb9e0 msgr2=0x7f3d10145810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.133+0000 7f3d0dd9b640 1 --2- 172.21.15.77:0/3788453344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d101eb9e0 0x7f3d10145810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.133+0000 7f3d0dd9b640 1 -- 172.21.15.77:0/3788453344 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d100c1430 con 0x7f3d100a7a50 2024-04-25T01:43:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.133+0000 7f3d0dd9b640 1 --2- 172.21.15.77:0/3788453344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d100a7a50 0x7f3d101ef5a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f3d04011560 tx=0x7f3d04011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.133+0000 7f3cfeffd640 1 -- 172.21.15.77:0/3788453344 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d04004220 con 0x7f3d100a7a50 2024-04-25T01:43:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.133+0000 7f3cfeffd640 1 -- 172.21.15.77:0/3788453344 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d040043c0 con 0x7f3d100a7a50 2024-04-25T01:43:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.133+0000 7f3cfeffd640 1 -- 172.21.15.77:0/3788453344 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d04015870 con 0x7f3d100a7a50 2024-04-25T01:43:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.133+0000 7f3d14d42640 1 -- 172.21.15.77:0/3788453344 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d101ef0c0 con 0x7f3d100a7a50 2024-04-25T01:43:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.133+0000 7f3d14d42640 1 -- 172.21.15.77:0/3788453344 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d100702b0 con 0x7f3d100a7a50 2024-04-25T01:43:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.134+0000 7f3d14d42640 1 -- 172.21.15.77:0/3788453344 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d1004f500 con 0x7f3d100a7a50 2024-04-25T01:43:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.134+0000 7f3cfeffd640 1 -- 172.21.15.77:0/3788453344 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d04015a10 con 0x7f3d100a7a50 2024-04-25T01:43:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.135+0000 7f3cfeffd640 1 --2- 172.21.15.77:0/3788453344 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3cf006be30 0x7f3cf006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.135+0000 7f3cfeffd640 1 -- 172.21.15.77:0/3788453344 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7f3d0408b630 con 0x7f3d100a7a50 2024-04-25T01:43:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.135+0000 7f3d0e59c640 1 --2- 172.21.15.77:0/3788453344 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3cf006be30 0x7f3cf006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.135+0000 7f3d0e59c640 1 --2- 172.21.15.77:0/3788453344 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3cf006be30 0x7f3cf006e2f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3d00033000 tx=0x7f3d0002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.139+0000 7f3cfeffd640 1 -- 172.21.15.77:0/3788453344 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3d04019030 con 0x7f3d100a7a50 2024-04-25T01:43:45.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.311+0000 7f3d14d42640 1 -- 172.21.15.77:0/3788453344 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3d100c6bf0 con 0x7f3d100a7a50 2024-04-25T01:43:45.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.311+0000 7f3cfeffd640 1 -- 172.21.15.77:0/3788453344 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) ==== 93+0+10 (secure 0 0 0) 0x7f3d04059b20 con 0x7f3d100a7a50 2024-04-25T01:43:45.302 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-25T01:43:45.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.313+0000 7f3d14d42640 1 -- 172.21.15.77:0/3788453344 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3cf006be30 msgr2=0x7f3cf006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:45.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.313+0000 7f3d14d42640 1 --2- 172.21.15.77:0/3788453344 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3cf006be30 0x7f3cf006e2f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3d00033000 tx=0x7f3d0002e000 comp rx=0 tx=0).stop 2024-04-25T01:43:45.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.313+0000 7f3d14d42640 1 -- 172.21.15.77:0/3788453344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d100a7a50 msgr2=0x7f3d101ef5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:45.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.313+0000 7f3d14d42640 1 --2- 172.21.15.77:0/3788453344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d100a7a50 0x7f3d101ef5a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f3d04011560 tx=0x7f3d04011a20 comp rx=0 tx=0).stop 2024-04-25T01:43:45.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.313+0000 7f3d14d42640 1 -- 172.21.15.77:0/3788453344 shutdown_connections 2024-04-25T01:43:45.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.313+0000 7f3d14d42640 1 --2- 172.21.15.77:0/3788453344 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3cf006be30 0x7f3cf006e2f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.313+0000 7f3d14d42640 1 --2- 172.21.15.77:0/3788453344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d100a7a50 0x7f3d101ef5a0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.313+0000 7f3d14d42640 1 --2- 172.21.15.77:0/3788453344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d101eb9e0 0x7f3d10145810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.313+0000 7f3d14d42640 1 --2- 172.21.15.77:0/3788453344 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3cf80039b0 0x7f3d100c0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.313+0000 7f3d14d42640 1 -- 172.21.15.77:0/3788453344 >> 172.21.15.77:0/3788453344 conn(0x7f3d100c7580 msgr2=0x7f3d100ab120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:45.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.313+0000 7f3d14d42640 1 -- 172.21.15.77:0/3788453344 shutdown_connections 2024-04-25T01:43:45.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.313+0000 7f3d14d42640 1 -- 172.21.15.77:0/3788453344 wait complete. 2024-04-25T01:43:45.315 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-25T01:43:45.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.423+0000 7fbfc4b09640 1 Processor -- start 2024-04-25T01:43:45.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.423+0000 7fbfc4b09640 1 -- start start 2024-04-25T01:43:45.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.424+0000 7fbfc4b09640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbfc006d470 0x7fbfc006d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:45.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.424+0000 7fbfc4b09640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbfc00c6c50 0x7fbfc00abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:45.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.424+0000 7fbfc4b09640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfc00acf70 con 0x7fbfc00c4d10 2024-04-25T01:43:45.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.424+0000 7fbfc4b09640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fbfc00acd20 con 0x7fbfc00c6c50 2024-04-25T01:43:45.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.424+0000 7fbfc4b09640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fbfc0153120 con 0x7fbfc006d470 2024-04-25T01:43:45.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.424+0000 7fbfbdd9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbfc00c6c50 0x7fbfc00abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:45.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.424+0000 7fbfbdd9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbfc00c6c50 0x7fbfc00abf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56110/0 (socket says 172.21.15.77:56110) 2024-04-25T01:43:45.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.424+0000 7fbfbdd9b640 1 -- 172.21.15.77:0/2153080650 learned_addr learned my addr 172.21.15.77:0/2153080650 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:45.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.424+0000 7fbfbdd9b640 1 -- 172.21.15.77:0/2153080650 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbfc006d470 msgr2=0x7fbfc006d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:45.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.424+0000 7fbfbdd9b640 1 --2- 172.21.15.77:0/2153080650 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbfc006d470 0x7fbfc006d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.424+0000 7fbfbdd9b640 1 -- 172.21.15.77:0/2153080650 >> v1:172.21.15.121:6789/0 conn(0x7fbfc00c4d10 legacy=0x7fbfc00c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.424+0000 7fbfbdd9b640 1 -- 172.21.15.77:0/2153080650 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc0153400 con 0x7fbfc00c6c50 2024-04-25T01:43:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.425+0000 7fbfbdd9b640 1 --2- 172.21.15.77:0/2153080650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfc00c6c50 0x7fbfc00abf90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400bb00 tx=0x7fbfb402c570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a105253430d22f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.425+0000 7fbfbd59a640 1 -- 172.21.15.77:0/2153080650 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb403a070 con 0x7fbfc00c6c50 2024-04-25T01:43:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.425+0000 7fbfbd59a640 1 -- 172.21.15.77:0/2153080650 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfb4032480 con 0x7fbfc00c6c50 2024-04-25T01:43:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.425+0000 7fbfbd59a640 1 -- 172.21.15.77:0/2153080650 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4032850 con 0x7fbfc00c6c50 2024-04-25T01:43:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.426+0000 7fbfc4b09640 1 -- 172.21.15.77:0/2153080650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfc00c6c50 msgr2=0x7fbfc00abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.426+0000 7fbfc4b09640 1 --2- 172.21.15.77:0/2153080650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfc00c6c50 0x7fbfc00abf90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400bb00 tx=0x7fbfb402c570 comp rx=0 tx=0).stop 2024-04-25T01:43:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.426+0000 7fbfc4b09640 1 -- 172.21.15.77:0/2153080650 shutdown_connections 2024-04-25T01:43:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.426+0000 7fbfc4b09640 1 --2- 172.21.15.77:0/2153080650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfc00c6c50 0x7fbfc00abf90 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.426+0000 7fbfc4b09640 1 --2- 172.21.15.77:0/2153080650 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbfc006d470 0x7fbfc006d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.426+0000 7fbfc4b09640 1 -- 172.21.15.77:0/2153080650 >> 172.21.15.77:0/2153080650 conn(0x7fbfc00c7580 msgr2=0x7fbfc00c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.426+0000 7fbfc4b09640 1 -- 172.21.15.77:0/2153080650 shutdown_connections 2024-04-25T01:43:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.426+0000 7fbfc4b09640 1 -- 172.21.15.77:0/2153080650 wait complete. 2024-04-25T01:43:45.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.427+0000 7fbfc4b09640 1 Processor -- start 2024-04-25T01:43:45.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.427+0000 7fbfc4b09640 1 -- start start 2024-04-25T01:43:45.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.428+0000 7fbfc4b09640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfc006d470 0x7fbfc0071950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:45.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.428+0000 7fbfc4b09640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbfc00c4d10 0x7fbfc00c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:45.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.428+0000 7fbfc4b09640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfc00c6c50 0x7fbfc01eefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:45.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.428+0000 7fbfc4b09640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc00ac650 con 0x7fbfc006d470 2024-04-25T01:43:45.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.428+0000 7fbfc4b09640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc00ac4d0 con 0x7fbfc00c6c50 2024-04-25T01:43:45.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.428+0000 7fbfc4b09640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fbfc00ac7d0 con 0x7fbfc00c4d10 2024-04-25T01:43:45.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.428+0000 7fbfbe59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfc006d470 0x7fbfc0071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:45.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.428+0000 7fbfbe59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfc006d470 0x7fbfc0071950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56114/0 (socket says 172.21.15.77:56114) 2024-04-25T01:43:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.428+0000 7fbfbe59c640 1 -- 172.21.15.77:0/489187999 learned_addr learned my addr 172.21.15.77:0/489187999 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.428+0000 7fbfbed9d640 1 --2- 172.21.15.77:0/489187999 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfc00c6c50 0x7fbfc01eefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.428+0000 7fbfbdd9b640 1 --2- 172.21.15.77:0/489187999 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbfc00c4d10 0x7fbfc00c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.428+0000 7fbfbe59c640 1 -- 172.21.15.77:0/489187999 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbfc00c4d10 msgr2=0x7fbfc00c0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.428+0000 7fbfbe59c640 1 --2- 172.21.15.77:0/489187999 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbfc00c4d10 0x7fbfc00c0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.428+0000 7fbfbe59c640 1 -- 172.21.15.77:0/489187999 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfc00c6c50 msgr2=0x7fbfc01eefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.428+0000 7fbfbe59c640 1 --2- 172.21.15.77:0/489187999 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfc00c6c50 0x7fbfc01eefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.428+0000 7fbfbe59c640 1 -- 172.21.15.77:0/489187999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc0070180 con 0x7fbfc006d470 2024-04-25T01:43:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.428+0000 7fbfbed9d640 1 --2- 172.21.15.77:0/489187999 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfc00c6c50 0x7fbfc01eefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:43:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.428+0000 7fbfbe59c640 1 --2- 172.21.15.77:0/489187999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfc006d470 0x7fbfc0071950 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000b4d0 tx=0x7fbfb000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.428+0000 7fbfaeffd640 1 -- 172.21.15.77:0/489187999 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0014070 con 0x7fbfc006d470 2024-04-25T01:43:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.428+0000 7fbfaeffd640 1 -- 172.21.15.77:0/489187999 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfb0010870 con 0x7fbfc006d470 2024-04-25T01:43:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.428+0000 7fbfaeffd640 1 -- 172.21.15.77:0/489187999 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0010c60 con 0x7fbfc006d470 2024-04-25T01:43:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.428+0000 7fbfc4b09640 1 -- 172.21.15.77:0/489187999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfc0070460 con 0x7fbfc006d470 2024-04-25T01:43:45.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.429+0000 7fbfc4b09640 1 -- 172.21.15.77:0/489187999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfc01db990 con 0x7fbfc006d470 2024-04-25T01:43:45.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.430+0000 7fbfc4b09640 1 -- 172.21.15.77:0/489187999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfc004f500 con 0x7fbfc006d470 2024-04-25T01:43:45.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.430+0000 7fbfaeffd640 1 -- 172.21.15.77:0/489187999 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbfb0017070 con 0x7fbfc006d470 2024-04-25T01:43:45.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.430+0000 7fbfaeffd640 1 --2- 172.21.15.77:0/489187999 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbfa006be60 0x7fbfa006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:45.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.430+0000 7fbfaeffd640 1 -- 172.21.15.77:0/489187999 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7fbfb008b120 con 0x7fbfc006d470 2024-04-25T01:43:45.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.430+0000 7fbfbdd9b640 1 --2- 172.21.15.77:0/489187999 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbfa006be60 0x7fbfa006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:45.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.431+0000 7fbfbdd9b640 1 --2- 172.21.15.77:0/489187999 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbfa006be60 0x7fbfa006e320 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4037000 tx=0x7fbfb4030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:45.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.435+0000 7fbfaeffd640 1 -- 172.21.15.77:0/489187999 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbfb0059610 con 0x7fbfc006d470 2024-04-25T01:43:45.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.606+0000 7fbfc4b09640 1 -- 172.21.15.77:0/489187999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7fbfc00c7960 con 0x7fbfc006d470 2024-04-25T01:43:45.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.607+0000 7fbfaeffd640 1 -- 172.21.15.77:0/489187999 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v30) ==== 99+0+11 (secure 0 0 0) 0x7fbfb0058f10 con 0x7fbfc006d470 2024-04-25T01:43:45.598 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T01:43:45.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.609+0000 7fbfc4b09640 1 -- 172.21.15.77:0/489187999 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbfa006be60 msgr2=0x7fbfa006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:45.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.609+0000 7fbfc4b09640 1 --2- 172.21.15.77:0/489187999 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbfa006be60 0x7fbfa006e320 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4037000 tx=0x7fbfb4030000 comp rx=0 tx=0).stop 2024-04-25T01:43:45.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.609+0000 7fbfc4b09640 1 -- 172.21.15.77:0/489187999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfc006d470 msgr2=0x7fbfc0071950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:45.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.609+0000 7fbfc4b09640 1 --2- 172.21.15.77:0/489187999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfc006d470 0x7fbfc0071950 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000b4d0 tx=0x7fbfb000b990 comp rx=0 tx=0).stop 2024-04-25T01:43:45.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.609+0000 7fbfc4b09640 1 -- 172.21.15.77:0/489187999 shutdown_connections 2024-04-25T01:43:45.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.609+0000 7fbfc4b09640 1 --2- 172.21.15.77:0/489187999 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbfa006be60 0x7fbfa006e320 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.609+0000 7fbfc4b09640 1 --2- 172.21.15.77:0/489187999 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfc00c6c50 0x7fbfc01eefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.609+0000 7fbfc4b09640 1 --2- 172.21.15.77:0/489187999 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbfc00c4d10 0x7fbfc00c0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.609+0000 7fbfc4b09640 1 --2- 172.21.15.77:0/489187999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfc006d470 0x7fbfc0071950 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.609+0000 7fbfc4b09640 1 -- 172.21.15.77:0/489187999 >> 172.21.15.77:0/489187999 conn(0x7fbfc00c7580 msgr2=0x7fbfc014fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:45.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.609+0000 7fbfc4b09640 1 -- 172.21.15.77:0/489187999 shutdown_connections 2024-04-25T01:43:45.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.609+0000 7fbfc4b09640 1 -- 172.21.15.77:0/489187999 wait complete. 2024-04-25T01:43:45.611 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-25T01:43:45.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.719+0000 7fae47f4f640 1 Processor -- start 2024-04-25T01:43:45.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.720+0000 7fae47f4f640 1 -- start start 2024-04-25T01:43:45.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.720+0000 7fae47f4f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae400c1270 0x7fae400c1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:45.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.720+0000 7fae47f4f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fae400c3b40 0x7fae400c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:45.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.720+0000 7fae47f4f640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae400c6de0 con 0x7fae400c1fe0 2024-04-25T01:43:45.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.720+0000 7fae47f4f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fae400c1b90 con 0x7fae400c3b40 2024-04-25T01:43:45.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.720+0000 7fae47f4f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fae400c7580 con 0x7fae400c1270 2024-04-25T01:43:45.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.720+0000 7fae464ec640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fae400c3b40 0x7fae400c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:45.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.721+0000 7fae464ec640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fae400c3b40 0x7fae400c5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56130/0 (socket says 172.21.15.77:56130) 2024-04-25T01:43:45.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.721+0000 7fae464ec640 1 -- 172.21.15.77:0/3614812751 learned_addr learned my addr 172.21.15.77:0/3614812751 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:45.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.721+0000 7fae464ec640 1 -- 172.21.15.77:0/3614812751 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae400c1270 msgr2=0x7fae400c1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:45.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.721+0000 7fae464ec640 1 --2- 172.21.15.77:0/3614812751 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae400c1270 0x7fae400c1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.721+0000 7fae464ec640 1 -- 172.21.15.77:0/3614812751 >> v1:172.21.15.121:6789/0 conn(0x7fae400c1fe0 legacy=0x7fae400c3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:45.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.721+0000 7fae464ec640 1 -- 172.21.15.77:0/3614812751 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae400c7860 con 0x7fae400c3b40 2024-04-25T01:43:45.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.721+0000 7fae464ec640 1 --2- 172.21.15.77:0/3614812751 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae400c3b40 0x7fae400c5b10 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fae3c009870 tx=0x7fae3c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe324c16b7a61f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:45.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.722+0000 7fae44ce9640 1 -- 172.21.15.77:0/3614812751 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3c037070 con 0x7fae400c3b40 2024-04-25T01:43:45.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.722+0000 7fae44ce9640 1 -- 172.21.15.77:0/3614812751 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae3c032440 con 0x7fae400c3b40 2024-04-25T01:43:45.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.722+0000 7fae44ce9640 1 -- 172.21.15.77:0/3614812751 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3c032810 con 0x7fae400c3b40 2024-04-25T01:43:45.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.722+0000 7fae47f4f640 1 -- 172.21.15.77:0/3614812751 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae400c3b40 msgr2=0x7fae400c5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:45.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.722+0000 7fae47f4f640 1 --2- 172.21.15.77:0/3614812751 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae400c3b40 0x7fae400c5b10 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fae3c009870 tx=0x7fae3c02a210 comp rx=0 tx=0).stop 2024-04-25T01:43:45.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.722+0000 7fae47f4f640 1 -- 172.21.15.77:0/3614812751 shutdown_connections 2024-04-25T01:43:45.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.722+0000 7fae47f4f640 1 --2- 172.21.15.77:0/3614812751 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae400c3b40 0x7fae400c5b10 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.722+0000 7fae47f4f640 1 --2- 172.21.15.77:0/3614812751 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae400c1270 0x7fae400c1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.722+0000 7fae47f4f640 1 -- 172.21.15.77:0/3614812751 >> 172.21.15.77:0/3614812751 conn(0x7fae400c46d0 msgr2=0x7fae400c4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:45.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.722+0000 7fae47f4f640 1 -- 172.21.15.77:0/3614812751 shutdown_connections 2024-04-25T01:43:45.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.722+0000 7fae47f4f640 1 -- 172.21.15.77:0/3614812751 wait complete. 2024-04-25T01:43:45.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.723+0000 7fae47f4f640 1 Processor -- start 2024-04-25T01:43:45.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.724+0000 7fae47f4f640 1 -- start start 2024-04-25T01:43:45.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.724+0000 7fae47f4f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae400c1270 0x7fae4014bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:45.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.724+0000 7fae47f4f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae400c1fe0 0x7fae400ab370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:45.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.724+0000 7fae47f4f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae400c3b40 0x7fae400ac310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:45.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.724+0000 7fae47f4f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fae4006d980 con 0x7fae400c3b40 2024-04-25T01:43:45.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.724+0000 7fae47f4f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fae400a7300 con 0x7fae400c1270 2024-04-25T01:43:45.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.724+0000 7fae47f4f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fae4006db00 con 0x7fae400c1fe0 2024-04-25T01:43:45.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.724+0000 7fae464ec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae400c3b40 0x7fae400ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:45.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.724+0000 7fae464ec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae400c3b40 0x7fae400ac310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56144/0 (socket says 172.21.15.77:56144) 2024-04-25T01:43:45.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.724+0000 7fae464ec640 1 -- 172.21.15.77:0/2276310313 learned_addr learned my addr 172.21.15.77:0/2276310313 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:45.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.725+0000 7fae45ceb640 1 --2- 172.21.15.77:0/2276310313 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae400c1270 0x7fae4014bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:45.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.725+0000 7fae464ec640 1 -- 172.21.15.77:0/2276310313 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae400c1fe0 msgr2=0x7fae400ab370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:45.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.725+0000 7fae454ea640 1 --2- 172.21.15.77:0/2276310313 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae400c1fe0 0x7fae400ab370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:45.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.725+0000 7fae464ec640 1 --2- 172.21.15.77:0/2276310313 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae400c1fe0 0x7fae400ab370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.725+0000 7fae464ec640 1 -- 172.21.15.77:0/2276310313 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae400c1270 msgr2=0x7fae4014bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:45.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.725+0000 7fae464ec640 1 --2- 172.21.15.77:0/2276310313 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae400c1270 0x7fae4014bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.725+0000 7fae464ec640 1 -- 172.21.15.77:0/2276310313 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae4014e820 con 0x7fae400c3b40 2024-04-25T01:43:45.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.725+0000 7fae45ceb640 1 --2- 172.21.15.77:0/2276310313 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae400c1270 0x7fae4014bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:43:45.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.725+0000 7fae454ea640 1 --2- 172.21.15.77:0/2276310313 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae400c1fe0 0x7fae400ab370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:43:45.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.725+0000 7fae464ec640 1 --2- 172.21.15.77:0/2276310313 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae400c3b40 0x7fae400ac310 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fae3c02a250 tx=0x7fae3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:45.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.725+0000 7fae367fc640 1 -- 172.21.15.77:0/2276310313 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3c041070 con 0x7fae400c3b40 2024-04-25T01:43:45.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.725+0000 7fae367fc640 1 -- 172.21.15.77:0/2276310313 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae3c03c890 con 0x7fae400c3b40 2024-04-25T01:43:45.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.725+0000 7fae47f4f640 1 -- 172.21.15.77:0/2276310313 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae401efea0 con 0x7fae400c3b40 2024-04-25T01:43:45.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.725+0000 7fae367fc640 1 -- 172.21.15.77:0/2276310313 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3c037040 con 0x7fae400c3b40 2024-04-25T01:43:45.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.725+0000 7fae47f4f640 1 -- 172.21.15.77:0/2276310313 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae4014e4b0 con 0x7fae400c3b40 2024-04-25T01:43:45.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.726+0000 7fae47f4f640 1 -- 172.21.15.77:0/2276310313 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae4004f500 con 0x7fae400c3b40 2024-04-25T01:43:45.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.726+0000 7fae367fc640 1 -- 172.21.15.77:0/2276310313 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fae3c044070 con 0x7fae400c3b40 2024-04-25T01:43:45.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.727+0000 7fae367fc640 1 --2- 172.21.15.77:0/2276310313 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fae2406be60 0x7fae2406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:45.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.727+0000 7fae367fc640 1 -- 172.21.15.77:0/2276310313 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7fae3c0abe10 con 0x7fae400c3b40 2024-04-25T01:43:45.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.727+0000 7fae45ceb640 1 --2- 172.21.15.77:0/2276310313 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fae2406be60 0x7fae2406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:45.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.727+0000 7fae45ceb640 1 --2- 172.21.15.77:0/2276310313 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fae2406be60 0x7fae2406e320 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fae38007eb0 tx=0x7fae380073c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:45.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.731+0000 7fae367fc640 1 -- 172.21.15.77:0/2276310313 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fae3c07a420 con 0x7fae400c3b40 2024-04-25T01:43:45.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.903+0000 7fae47f4f640 1 -- 172.21.15.77:0/2276310313 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7fae400c1d50 con 0x7fae400c3b40 2024-04-25T01:43:45.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.903+0000 7fae367fc640 1 -- 172.21.15.77:0/2276310313 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v30) ==== 95+0+11 (secure 0 0 0) 0x7fae3c079d20 con 0x7fae400c3b40 2024-04-25T01:43:45.894 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-25T01:43:45.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.905+0000 7fae47f4f640 1 -- 172.21.15.77:0/2276310313 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fae2406be60 msgr2=0x7fae2406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:45.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.905+0000 7fae47f4f640 1 --2- 172.21.15.77:0/2276310313 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fae2406be60 0x7fae2406e320 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fae38007eb0 tx=0x7fae380073c0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.905+0000 7fae47f4f640 1 -- 172.21.15.77:0/2276310313 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae400c3b40 msgr2=0x7fae400ac310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:45.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.905+0000 7fae47f4f640 1 --2- 172.21.15.77:0/2276310313 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae400c3b40 0x7fae400ac310 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fae3c02a250 tx=0x7fae3c0046c0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.905+0000 7fae47f4f640 1 -- 172.21.15.77:0/2276310313 shutdown_connections 2024-04-25T01:43:45.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.905+0000 7fae47f4f640 1 --2- 172.21.15.77:0/2276310313 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fae2406be60 0x7fae2406e320 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.905+0000 7fae47f4f640 1 --2- 172.21.15.77:0/2276310313 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae400c3b40 0x7fae400ac310 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.905+0000 7fae47f4f640 1 --2- 172.21.15.77:0/2276310313 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae400c1fe0 0x7fae400ab370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.905+0000 7fae47f4f640 1 --2- 172.21.15.77:0/2276310313 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae400c1270 0x7fae4014bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:45.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.905+0000 7fae47f4f640 1 -- 172.21.15.77:0/2276310313 >> 172.21.15.77:0/2276310313 conn(0x7fae400c46d0 msgr2=0x7fae40070960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:45.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.905+0000 7fae47f4f640 1 -- 172.21.15.77:0/2276310313 shutdown_connections 2024-04-25T01:43:45.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:45.905+0000 7fae47f4f640 1 -- 172.21.15.77:0/2276310313 wait complete. 2024-04-25T01:43:45.907 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-25T01:43:46.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.015+0000 7f2fc6288640 1 Processor -- start 2024-04-25T01:43:46.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.015+0000 7f2fc6288640 1 -- start start 2024-04-25T01:43:46.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.016+0000 7f2fc6288640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2fc0153530 0x7f2fc00c6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:46.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.016+0000 7f2fc6288640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2fc00bef50 0x7f2fc01595f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:46.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.016+0000 7f2fc6288640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fc006d110 con 0x7f2fc00c97c0 2024-04-25T01:43:46.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.016+0000 7f2fc6288640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f2fc0153910 con 0x7f2fc0153530 2024-04-25T01:43:46.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.016+0000 7f2fc6288640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f2fc0156980 con 0x7f2fc00bef50 2024-04-25T01:43:46.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.016+0000 7f2fbffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2fc0153530 0x7f2fc00c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:46.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.016+0000 7f2fbffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2fc0153530 0x7f2fc00c6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56154/0 (socket says 172.21.15.77:56154) 2024-04-25T01:43:46.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.016+0000 7f2fbffff640 1 -- 172.21.15.77:0/3627585149 learned_addr learned my addr 172.21.15.77:0/3627585149 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:46.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.017+0000 7f2fbf7fe640 1 --2- 172.21.15.77:0/3627585149 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2fc00bef50 0x7f2fc01595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:46.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.017+0000 7f2fbffff640 1 -- 172.21.15.77:0/3627585149 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2fc00bef50 msgr2=0x7f2fc01595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:46.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.017+0000 7f2fbffff640 1 --2- 172.21.15.77:0/3627585149 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2fc00bef50 0x7f2fc01595f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:46.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.017+0000 7f2fbffff640 1 -- 172.21.15.77:0/3627585149 >> v1:172.21.15.121:6789/0 conn(0x7f2fc00c97c0 legacy=0x7f2fc0159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:46.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.017+0000 7f2fbffff640 1 -- 172.21.15.77:0/3627585149 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc0156c60 con 0x7f2fc0153530 2024-04-25T01:43:46.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.017+0000 7f2fbffff640 1 --2- 172.21.15.77:0/3627585149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fc0153530 0x7f2fc00c6240 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0009870 tx=0x7f2fb002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3e4d3c818c1cd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:46.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.017+0000 7f2fbeffd640 1 -- 172.21.15.77:0/3627585149 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0037070 con 0x7f2fc0153530 2024-04-25T01:43:46.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.018+0000 7f2fbeffd640 1 -- 172.21.15.77:0/3627585149 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb0032440 con 0x7f2fc0153530 2024-04-25T01:43:46.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.018+0000 7f2fbeffd640 1 -- 172.21.15.77:0/3627585149 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0032810 con 0x7f2fc0153530 2024-04-25T01:43:46.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.018+0000 7f2fc6288640 1 -- 172.21.15.77:0/3627585149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fc0153530 msgr2=0x7f2fc00c6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:46.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.018+0000 7f2fc6288640 1 --2- 172.21.15.77:0/3627585149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fc0153530 0x7f2fc00c6240 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0009870 tx=0x7f2fb002a180 comp rx=0 tx=0).stop 2024-04-25T01:43:46.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.018+0000 7f2fc6288640 1 -- 172.21.15.77:0/3627585149 shutdown_connections 2024-04-25T01:43:46.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.018+0000 7f2fc6288640 1 --2- 172.21.15.77:0/3627585149 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2fc00bef50 0x7f2fc01595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:46.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.018+0000 7f2fc6288640 1 --2- 172.21.15.77:0/3627585149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fc0153530 0x7f2fc00c6240 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:46.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.018+0000 7f2fc6288640 1 -- 172.21.15.77:0/3627585149 >> 172.21.15.77:0/3627585149 conn(0x7f2fc00672c0 msgr2=0x7f2fc00676d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:46.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.018+0000 7f2fc6288640 1 -- 172.21.15.77:0/3627585149 shutdown_connections 2024-04-25T01:43:46.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.018+0000 7f2fc6288640 1 -- 172.21.15.77:0/3627585149 wait complete. 2024-04-25T01:43:46.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.019+0000 7f2fc6288640 1 Processor -- start 2024-04-25T01:43:46.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.019+0000 7f2fc6288640 1 -- start start 2024-04-25T01:43:46.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.020+0000 7f2fc6288640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2fc00bef50 0x7f2fc01ef1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:46.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.020+0000 7f2fc6288640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2fc00c97c0 0x7f2fc00abb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:46.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.020+0000 7f2fc6288640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fc0153530 0x7f2fc0151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:46.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.020+0000 7f2fc6288640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc015a240 con 0x7f2fc0153530 2024-04-25T01:43:46.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.020+0000 7f2fc6288640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc00cc250 con 0x7f2fc00c97c0 2024-04-25T01:43:46.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.020+0000 7f2fc6288640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f2fc00c6780 con 0x7f2fc00bef50 2024-04-25T01:43:46.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.020+0000 7f2fc4825640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fc0153530 0x7f2fc0151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:46.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.020+0000 7f2fc4825640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fc0153530 0x7f2fc0151f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56170/0 (socket says 172.21.15.77:56170) 2024-04-25T01:43:46.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.020+0000 7f2fc4825640 1 -- 172.21.15.77:0/2218880292 learned_addr learned my addr 172.21.15.77:0/2218880292 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:46.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.020+0000 7f2fbf7fe640 1 --2- 172.21.15.77:0/2218880292 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2fc00c97c0 0x7f2fc00abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:46.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.020+0000 7f2fbffff640 1 --2- 172.21.15.77:0/2218880292 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2fc00bef50 0x7f2fc01ef1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:46.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.020+0000 7f2fc4825640 1 -- 172.21.15.77:0/2218880292 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2fc00bef50 msgr2=0x7f2fc01ef1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:46.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.020+0000 7f2fc4825640 1 --2- 172.21.15.77:0/2218880292 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2fc00bef50 0x7f2fc01ef1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:46.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.020+0000 7f2fc4825640 1 -- 172.21.15.77:0/2218880292 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2fc00c97c0 msgr2=0x7f2fc00abb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:46.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.020+0000 7f2fc4825640 1 --2- 172.21.15.77:0/2218880292 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2fc00c97c0 0x7f2fc00abb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:46.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.020+0000 7f2fc4825640 1 -- 172.21.15.77:0/2218880292 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc01ef700 con 0x7f2fc0153530 2024-04-25T01:43:46.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.021+0000 7f2fc4825640 1 --2- 172.21.15.77:0/2218880292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fc0153530 0x7f2fc0151f20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800c780 tx=0x7f2fb800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:46.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.021+0000 7f2fbcff9640 1 -- 172.21.15.77:0/2218880292 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8004b60 con 0x7f2fc0153530 2024-04-25T01:43:46.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.021+0000 7f2fbcff9640 1 -- 172.21.15.77:0/2218880292 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb8004d00 con 0x7f2fc0153530 2024-04-25T01:43:46.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.021+0000 7f2fc6288640 1 -- 172.21.15.77:0/2218880292 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fc00ab360 con 0x7f2fc0153530 2024-04-25T01:43:46.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.021+0000 7f2fbcff9640 1 -- 172.21.15.77:0/2218880292 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb800aa90 con 0x7f2fc0153530 2024-04-25T01:43:46.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.021+0000 7f2fc6288640 1 -- 172.21.15.77:0/2218880292 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fc00ac850 con 0x7f2fc0153530 2024-04-25T01:43:46.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.022+0000 7f2fc6288640 1 -- 172.21.15.77:0/2218880292 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fc004f500 con 0x7f2fc0153530 2024-04-25T01:43:46.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.022+0000 7f2fbcff9640 1 -- 172.21.15.77:0/2218880292 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2fb800ac30 con 0x7f2fc0153530 2024-04-25T01:43:46.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.022+0000 7f2fbcff9640 1 --2- 172.21.15.77:0/2218880292 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2fac06be30 0x7f2fac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:46.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.022+0000 7f2fbcff9640 1 -- 172.21.15.77:0/2218880292 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7f2fb808b5a0 con 0x7f2fc0153530 2024-04-25T01:43:46.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.023+0000 7f2fbffff640 1 --2- 172.21.15.77:0/2218880292 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2fac06be30 0x7f2fac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:46.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.023+0000 7f2fbffff640 1 --2- 172.21.15.77:0/2218880292 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2fac06be30 0x7f2fac06e2f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0034000 tx=0x7f2fb002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:46.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.027+0000 7f2fbcff9640 1 -- 172.21.15.77:0/2218880292 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2fb8020070 con 0x7f2fc0153530 2024-04-25T01:43:46.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.198+0000 7f2fc6288640 1 -- 172.21.15.77:0/2218880292 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7f2fc006cac0 con 0x7f2fc0153530 2024-04-25T01:43:46.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.198+0000 7f2fbcff9640 1 -- 172.21.15.77:0/2218880292 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v30) ==== 99+0+11 (secure 0 0 0) 0x7f2fb8059a90 con 0x7f2fc0153530 2024-04-25T01:43:46.189 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T01:43:46.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.200+0000 7f2fc6288640 1 -- 172.21.15.77:0/2218880292 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2fac06be30 msgr2=0x7f2fac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:46.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.200+0000 7f2fc6288640 1 --2- 172.21.15.77:0/2218880292 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2fac06be30 0x7f2fac06e2f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0034000 tx=0x7f2fb002e000 comp rx=0 tx=0).stop 2024-04-25T01:43:46.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.200+0000 7f2fc6288640 1 -- 172.21.15.77:0/2218880292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fc0153530 msgr2=0x7f2fc0151f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:46.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.200+0000 7f2fc6288640 1 --2- 172.21.15.77:0/2218880292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fc0153530 0x7f2fc0151f20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800c780 tx=0x7f2fb800cc40 comp rx=0 tx=0).stop 2024-04-25T01:43:46.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.200+0000 7f2fc6288640 1 -- 172.21.15.77:0/2218880292 shutdown_connections 2024-04-25T01:43:46.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.200+0000 7f2fc6288640 1 --2- 172.21.15.77:0/2218880292 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f2fac06be30 0x7f2fac06e2f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:46.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.200+0000 7f2fc6288640 1 --2- 172.21.15.77:0/2218880292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fc0153530 0x7f2fc0151f20 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:46.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.200+0000 7f2fc6288640 1 --2- 172.21.15.77:0/2218880292 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2fc00c97c0 0x7f2fc00abb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:46.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.200+0000 7f2fc6288640 1 --2- 172.21.15.77:0/2218880292 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2fc00bef50 0x7f2fc01ef1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:46.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.200+0000 7f2fc6288640 1 -- 172.21.15.77:0/2218880292 >> 172.21.15.77:0/2218880292 conn(0x7f2fc00672c0 msgr2=0x7f2fc01595f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:46.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.200+0000 7f2fc6288640 1 -- 172.21.15.77:0/2218880292 shutdown_connections 2024-04-25T01:43:46.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.200+0000 7f2fc6288640 1 -- 172.21.15.77:0/2218880292 wait complete. 2024-04-25T01:43:46.202 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-25T01:43:46.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.311+0000 7f653f3f4640 1 Processor -- start 2024-04-25T01:43:46.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.311+0000 7f653f3f4640 1 -- start start 2024-04-25T01:43:46.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.312+0000 7f653f3f4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f65380bef50 0x7f65381595f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:46.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.312+0000 7f653f3f4640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f65380c97c0 0x7f6538159b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:46.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.312+0000 7f653f3f4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f653806d110 con 0x7f6538153530 2024-04-25T01:43:46.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.312+0000 7f653f3f4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f6538153910 con 0x7f65380bef50 2024-04-25T01:43:46.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.312+0000 7f653f3f4640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f6538156980 con 0x7f65380c97c0 2024-04-25T01:43:46.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.312+0000 7f653d190640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6538153530 0x7f65380c6240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57392/0 (socket says 172.21.15.77:57392) 2024-04-25T01:43:46.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.312+0000 7f653d190640 1 -- 172.21.15.77:0/472285396 learned_addr learned my addr 172.21.15.77:0/472285396 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:43:46.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.312+0000 7f653c98f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f65380bef50 0x7f65381595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:46.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.312+0000 7f653d991640 1 --2- 172.21.15.77:0/472285396 >> v2:172.21.15.121:3300/0 conn(0x7f65380c97c0 0x7f6538159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:46.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.313+0000 7f653c98f640 1 -- 172.21.15.77:0/472285396 >> v2:172.21.15.121:3300/0 conn(0x7f65380c97c0 msgr2=0x7f6538159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:46.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.313+0000 7f653c98f640 1 --2- 172.21.15.77:0/472285396 >> v2:172.21.15.121:3300/0 conn(0x7f65380c97c0 0x7f6538159b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:46.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.313+0000 7f653c98f640 1 -- 172.21.15.77:0/472285396 >> v1:172.21.15.77:6789/0 conn(0x7f6538153530 legacy=0x7f65380c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:46.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.313+0000 7f652ffff640 1 -- 172.21.15.77:0/472285396 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2788661514 0 0) 0x7f653806d110 con 0x7f6538153530 2024-04-25T01:43:46.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.313+0000 7f653c98f640 1 -- 172.21.15.77:0/472285396 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6538156c60 con 0x7f65380bef50 2024-04-25T01:43:46.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.313+0000 7f653c98f640 1 --2- 172.21.15.77:0/472285396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65380bef50 0x7f65381595f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f653806c880 tx=0x7f652802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc357c2bc63fbc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:46.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.313+0000 7f652ffff640 1 -- 172.21.15.77:0/472285396 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6528037070 con 0x7f65380bef50 2024-04-25T01:43:46.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.313+0000 7f652ffff640 1 -- 172.21.15.77:0/472285396 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6528032440 con 0x7f65380bef50 2024-04-25T01:43:46.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.313+0000 7f652ffff640 1 -- 172.21.15.77:0/472285396 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652802ae60 con 0x7f65380bef50 2024-04-25T01:43:46.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.314+0000 7f653f3f4640 1 -- 172.21.15.77:0/472285396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65380bef50 msgr2=0x7f65381595f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:46.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.314+0000 7f653f3f4640 1 --2- 172.21.15.77:0/472285396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65380bef50 0x7f65381595f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f653806c880 tx=0x7f652802a110 comp rx=0 tx=0).stop 2024-04-25T01:43:46.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.314+0000 7f653f3f4640 1 -- 172.21.15.77:0/472285396 shutdown_connections 2024-04-25T01:43:46.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.314+0000 7f653f3f4640 1 --2- 172.21.15.77:0/472285396 >> v2:172.21.15.121:3300/0 conn(0x7f65380c97c0 0x7f6538159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:46.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.314+0000 7f653f3f4640 1 --2- 172.21.15.77:0/472285396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65380bef50 0x7f65381595f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:46.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.314+0000 7f653f3f4640 1 -- 172.21.15.77:0/472285396 >> 172.21.15.77:0/472285396 conn(0x7f65380672c0 msgr2=0x7f65380676d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:46.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.314+0000 7f653f3f4640 1 -- 172.21.15.77:0/472285396 shutdown_connections 2024-04-25T01:43:46.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.314+0000 7f653f3f4640 1 -- 172.21.15.77:0/472285396 wait complete. 2024-04-25T01:43:46.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.315+0000 7f653f3f4640 1 Processor -- start 2024-04-25T01:43:46.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.315+0000 7f653f3f4640 1 -- start start 2024-04-25T01:43:46.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.316+0000 7f653f3f4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65380bef50 0x7f65381ec610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:46.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.316+0000 7f653f3f4640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f65380c97c0 0x7f653814a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:46.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.316+0000 7f653f3f4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6538153530 0x7f6538151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:46.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.316+0000 7f653f3f4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f65380c6950 con 0x7f65380bef50 2024-04-25T01:43:46.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.316+0000 7f653f3f4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f65380cc250 con 0x7f6538153530 2024-04-25T01:43:46.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.316+0000 7f653f3f4640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f65380c6ad0 con 0x7f65380c97c0 2024-04-25T01:43:46.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.316+0000 7f653d190640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65380bef50 0x7f65381ec610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:46.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.316+0000 7f653d190640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65380bef50 0x7f65381ec610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56186/0 (socket says 172.21.15.77:56186) 2024-04-25T01:43:46.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.316+0000 7f653d190640 1 -- 172.21.15.77:0/1937303460 learned_addr learned my addr 172.21.15.77:0/1937303460 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:46.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.316+0000 7f653c98f640 1 --2- 172.21.15.77:0/1937303460 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f65380c97c0 0x7f653814a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:46.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.316+0000 7f653d991640 1 --2- 172.21.15.77:0/1937303460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6538153530 0x7f6538151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:46.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.316+0000 7f653d190640 1 -- 172.21.15.77:0/1937303460 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f65380c97c0 msgr2=0x7f653814a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:46.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.316+0000 7f653d190640 1 --2- 172.21.15.77:0/1937303460 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f65380c97c0 0x7f653814a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:46.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.316+0000 7f653d190640 1 -- 172.21.15.77:0/1937303460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6538153530 msgr2=0x7f6538151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:46.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.316+0000 7f653d190640 1 --2- 172.21.15.77:0/1937303460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6538153530 0x7f6538151250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:46.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.316+0000 7f653d190640 1 -- 172.21.15.77:0/1937303460 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65381554b0 con 0x7f65380bef50 2024-04-25T01:43:46.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.316+0000 7f653d991640 1 --2- 172.21.15.77:0/1937303460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6538153530 0x7f6538151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:43:46.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.316+0000 7f653d190640 1 --2- 172.21.15.77:0/1937303460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65380bef50 0x7f65381ec610 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f653400c7c0 tx=0x7f653400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:46.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.316+0000 7f652dffb640 1 -- 172.21.15.77:0/1937303460 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6534018070 con 0x7f65380bef50 2024-04-25T01:43:46.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.316+0000 7f652dffb640 1 -- 172.21.15.77:0/1937303460 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f653400a640 con 0x7f65380bef50 2024-04-25T01:43:46.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.316+0000 7f652dffb640 1 -- 172.21.15.77:0/1937303460 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653400aa30 con 0x7f65380bef50 2024-04-25T01:43:46.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.317+0000 7f653f3f4640 1 -- 172.21.15.77:0/1937303460 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f653814ae20 con 0x7f65380bef50 2024-04-25T01:43:46.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.317+0000 7f653f3f4640 1 -- 172.21.15.77:0/1937303460 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6538159060 con 0x7f65380bef50 2024-04-25T01:43:46.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.318+0000 7f653f3f4640 1 -- 172.21.15.77:0/1937303460 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f653804f500 con 0x7f65380bef50 2024-04-25T01:43:46.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.318+0000 7f652dffb640 1 -- 172.21.15.77:0/1937303460 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f653400abd0 con 0x7f65380bef50 2024-04-25T01:43:46.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.319+0000 7f652dffb640 1 --2- 172.21.15.77:0/1937303460 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f651c06be30 0x7f651c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:46.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.319+0000 7f653c98f640 1 --2- 172.21.15.77:0/1937303460 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f651c06be30 0x7f651c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:46.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.319+0000 7f652dffb640 1 -- 172.21.15.77:0/1937303460 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7f653408aa50 con 0x7f65380bef50 2024-04-25T01:43:46.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.319+0000 7f653c98f640 1 --2- 172.21.15.77:0/1937303460 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f651c06be30 0x7f651c06e2f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6528034000 tx=0x7f652802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:46.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.323+0000 7f652dffb640 1 -- 172.21.15.77:0/1937303460 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6534058eb0 con 0x7f65380bef50 2024-04-25T01:43:46.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.498+0000 7f653f3f4640 1 -- 172.21.15.77:0/1937303460 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7f653806cd20 con 0x7f65380bef50 2024-04-25T01:43:46.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.498+0000 7f652dffb640 1 -- 172.21.15.77:0/1937303460 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v30) ==== 95+0+11 (secure 0 0 0) 0x7f653405f080 con 0x7f65380bef50 2024-04-25T01:43:46.489 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-25T01:43:46.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.500+0000 7f653f3f4640 1 -- 172.21.15.77:0/1937303460 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f651c06be30 msgr2=0x7f651c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:46.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.500+0000 7f653f3f4640 1 --2- 172.21.15.77:0/1937303460 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f651c06be30 0x7f651c06e2f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6528034000 tx=0x7f652802e000 comp rx=0 tx=0).stop 2024-04-25T01:43:46.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.500+0000 7f653f3f4640 1 -- 172.21.15.77:0/1937303460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65380bef50 msgr2=0x7f65381ec610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:46.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.500+0000 7f653f3f4640 1 --2- 172.21.15.77:0/1937303460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65380bef50 0x7f65381ec610 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f653400c7c0 tx=0x7f653400cc80 comp rx=0 tx=0).stop 2024-04-25T01:43:46.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.500+0000 7f653f3f4640 1 -- 172.21.15.77:0/1937303460 shutdown_connections 2024-04-25T01:43:46.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.500+0000 7f653f3f4640 1 --2- 172.21.15.77:0/1937303460 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f651c06be30 0x7f651c06e2f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:46.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.500+0000 7f653f3f4640 1 --2- 172.21.15.77:0/1937303460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6538153530 0x7f6538151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:46.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.500+0000 7f653f3f4640 1 --2- 172.21.15.77:0/1937303460 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f65380c97c0 0x7f653814a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:46.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.500+0000 7f653f3f4640 1 --2- 172.21.15.77:0/1937303460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65380bef50 0x7f65381ec610 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:46.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.500+0000 7f653f3f4640 1 -- 172.21.15.77:0/1937303460 >> 172.21.15.77:0/1937303460 conn(0x7f65380672c0 msgr2=0x7f65380676a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:46.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.500+0000 7f653f3f4640 1 -- 172.21.15.77:0/1937303460 shutdown_connections 2024-04-25T01:43:46.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.500+0000 7f653f3f4640 1 -- 172.21.15.77:0/1937303460 wait complete. 2024-04-25T01:43:46.502 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T01:43:46.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.608+0000 7f248f83f640 1 Processor -- start 2024-04-25T01:43:46.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.608+0000 7f248f83f640 1 -- start start 2024-04-25T01:43:46.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.609+0000 7f248f83f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f24880c4280 0x7f2488153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:46.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.609+0000 7f248f83f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2488151900 0x7f248806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:46.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.609+0000 7f248f83f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2488154430 con 0x7f24880aca40 2024-04-25T01:43:46.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.609+0000 7f248f83f640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f24881546b0 con 0x7f24880c4280 2024-04-25T01:43:46.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.609+0000 7f248f83f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f2488154990 con 0x7f2488151900 2024-04-25T01:43:46.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.609+0000 7f248cdda640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f24880aca40 0x7f24881511f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57396/0 (socket says 172.21.15.77:57396) 2024-04-25T01:43:46.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.609+0000 7f248cdda640 1 -- 172.21.15.77:0/2892877517 learned_addr learned my addr 172.21.15.77:0/2892877517 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:43:46.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.609+0000 7f248dddc640 1 --2- 172.21.15.77:0/2892877517 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2488151900 0x7f248806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:46.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.609+0000 7f248d5db640 1 --2- 172.21.15.77:0/2892877517 >> v2:172.21.15.121:3300/0 conn(0x7f24880c4280 0x7f2488153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:46.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.610+0000 7f2487fff640 1 -- 172.21.15.77:0/2892877517 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1668607945 0 0) 0x7f247c001110 con 0x7f24880aca40 2024-04-25T01:43:46.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.610+0000 7f2487fff640 1 -- 172.21.15.77:0/2892877517 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2470003520 con 0x7f24880aca40 2024-04-25T01:43:46.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.610+0000 7f2487fff640 1 -- 172.21.15.77:0/2892877517 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2888674370 0 0) 0x7f2470003520 con 0x7f24880aca40 2024-04-25T01:43:46.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.610+0000 7f2487fff640 1 -- 172.21.15.77:0/2892877517 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2488151900 msgr2=0x7f248806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:46.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.610+0000 7f2487fff640 1 --2- 172.21.15.77:0/2892877517 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2488151900 0x7f248806d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:46.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.610+0000 7f2487fff640 1 -- 172.21.15.77:0/2892877517 >> v2:172.21.15.121:3300/0 conn(0x7f24880c4280 msgr2=0x7f2488153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:46.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.610+0000 7f2487fff640 1 --2- 172.21.15.77:0/2892877517 >> v2:172.21.15.121:3300/0 conn(0x7f24880c4280 0x7f2488153ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:46.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.610+0000 7f2487fff640 1 -- 172.21.15.77:0/2892877517 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2488154c70 con 0x7f24880aca40 2024-04-25T01:43:46.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.610+0000 7f2487fff640 1 -- 172.21.15.77:0/2892877517 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7f247c001840 con 0x7f24880aca40 2024-04-25T01:43:46.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.610+0000 7f2487fff640 1 -- 172.21.15.77:0/2892877517 >> v1:172.21.15.77:6789/0 conn(0x7f24880aca40 legacy=0x7f24881511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:46.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.610+0000 7f2487fff640 1 --2- 172.21.15.77:0/2892877517 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2488151900 0x7f24700039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:46.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.610+0000 7f2487fff640 1 --2- 172.21.15.77:0/2892877517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2470003f30 0x7f2470004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:46.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.610+0000 7f2487fff640 1 --2- 172.21.15.77:0/2892877517 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2470004d40 0x7f24700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:46.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.610+0000 7f2487fff640 1 -- 172.21.15.77:0/2892877517 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f24881546b0 con 0x7f2470003f30 2024-04-25T01:43:46.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.610+0000 7f2487fff640 1 -- 172.21.15.77:0/2892877517 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2488154990 con 0x7f2470004d40 2024-04-25T01:43:46.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.610+0000 7f2487fff640 1 -- 172.21.15.77:0/2892877517 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f2470007a20 con 0x7f2488151900 2024-04-25T01:43:46.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.610+0000 7f248cdda640 1 --2- 172.21.15.77:0/2892877517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2470003f30 0x7f2470004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:46.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.610+0000 7f248d5db640 1 --2- 172.21.15.77:0/2892877517 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2488151900 0x7f24700039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:46.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.610+0000 7f248dddc640 1 --2- 172.21.15.77:0/2892877517 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2470004d40 0x7f24700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:46.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.610+0000 7f248cdda640 1 -- 172.21.15.77:0/2892877517 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2488151900 msgr2=0x7f24700039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:46.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.610+0000 7f248cdda640 1 --2- 172.21.15.77:0/2892877517 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2488151900 0x7f24700039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:46.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.610+0000 7f248cdda640 1 -- 172.21.15.77:0/2892877517 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2470004d40 msgr2=0x7f24700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:46.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.610+0000 7f248cdda640 1 --2- 172.21.15.77:0/2892877517 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2470004d40 0x7f24700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:46.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.610+0000 7f248cdda640 1 -- 172.21.15.77:0/2892877517 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2470003520 con 0x7f2470003f30 2024-04-25T01:43:46.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.611+0000 7f248cdda640 1 --2- 172.21.15.77:0/2892877517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2470003f30 0x7f2470004800 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f247c00c3e0 tx=0x7f2470005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49bd72e9c292063b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:46.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.611+0000 7f2487fff640 1 -- 172.21.15.77:0/2892877517 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c032020 con 0x7f2470003f30 2024-04-25T01:43:46.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.611+0000 7f2487fff640 1 -- 172.21.15.77:0/2892877517 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f247c005af0 con 0x7f2470003f30 2024-04-25T01:43:46.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.611+0000 7f2487fff640 1 -- 172.21.15.77:0/2892877517 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c00c0e0 con 0x7f2470003f30 2024-04-25T01:43:46.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.612+0000 7f248f83f640 1 -- 172.21.15.77:0/2892877517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2470003f30 msgr2=0x7f2470004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:46.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.612+0000 7f248f83f640 1 --2- 172.21.15.77:0/2892877517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2470003f30 0x7f2470004800 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f247c00c3e0 tx=0x7f2470005830 comp rx=0 tx=0).stop 2024-04-25T01:43:46.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.612+0000 7f248dddc640 1 -- 172.21.15.77:0/2892877517 reap_dead start 2024-04-25T01:43:46.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.612+0000 7f248f83f640 1 -- 172.21.15.77:0/2892877517 shutdown_connections 2024-04-25T01:43:46.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.612+0000 7f248f83f640 1 -- 172.21.15.77:0/2892877517 >> 172.21.15.77:0/2892877517 conn(0x7f24880c7580 msgr2=0x7f24880c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:46.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.612+0000 7f248f83f640 1 -- 172.21.15.77:0/2892877517 shutdown_connections 2024-04-25T01:43:46.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.612+0000 7f248f83f640 1 -- 172.21.15.77:0/2892877517 wait complete. 2024-04-25T01:43:46.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.613+0000 7f248f83f640 1 Processor -- start 2024-04-25T01:43:46.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.613+0000 7f248f83f640 1 -- start start 2024-04-25T01:43:46.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.613+0000 7f248f83f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2470003f30 0x7f24881eb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:46.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.613+0000 7f248f83f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24880c5750 0x7f2488147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:46.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.613+0000 7f248f83f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2488143780 0x7f2488143c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:46.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.613+0000 7f248f83f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f24880c47e0 con 0x7f2470003f30 2024-04-25T01:43:46.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.613+0000 7f248f83f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f24880c4660 con 0x7f24880c5750 2024-04-25T01:43:46.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.614+0000 7f248f83f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f248806d8c0 con 0x7f2488143780 2024-04-25T01:43:46.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.614+0000 7f248d5db640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2470003f30 0x7f24881eb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:46.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.614+0000 7f248d5db640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2470003f30 0x7f24881eb1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56202/0 (socket says 172.21.15.77:56202) 2024-04-25T01:43:46.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.614+0000 7f248d5db640 1 -- 172.21.15.77:0/3704577230 learned_addr learned my addr 172.21.15.77:0/3704577230 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:46.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.614+0000 7f248d5db640 1 -- 172.21.15.77:0/3704577230 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2488143780 msgr2=0x7f2488143c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:46.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.614+0000 7f248d5db640 1 --2- 172.21.15.77:0/3704577230 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2488143780 0x7f2488143c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:46.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.614+0000 7f248d5db640 1 -- 172.21.15.77:0/3704577230 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24880c5750 msgr2=0x7f2488147060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:46.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.614+0000 7f248d5db640 1 --2- 172.21.15.77:0/3704577230 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24880c5750 0x7f2488147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:46.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.614+0000 7f248d5db640 1 -- 172.21.15.77:0/3704577230 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24881eb700 con 0x7f2470003f30 2024-04-25T01:43:46.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.614+0000 7f248d5db640 1 --2- 172.21.15.77:0/3704577230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2470003f30 0x7f24881eb1c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2480011e60 tx=0x7f248000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:46.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.614+0000 7f2485ffb640 1 -- 172.21.15.77:0/3704577230 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2480015630 con 0x7f2470003f30 2024-04-25T01:43:46.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.614+0000 7f2485ffb640 1 -- 172.21.15.77:0/3704577230 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24800157d0 con 0x7f2470003f30 2024-04-25T01:43:46.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.614+0000 7f2485ffb640 1 -- 172.21.15.77:0/3704577230 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2480015ba0 con 0x7f2470003f30 2024-04-25T01:43:46.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.614+0000 7f248f83f640 1 -- 172.21.15.77:0/3704577230 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24881e8870 con 0x7f2470003f30 2024-04-25T01:43:46.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.614+0000 7f248f83f640 1 -- 172.21.15.77:0/3704577230 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24880ac2e0 con 0x7f2470003f30 2024-04-25T01:43:46.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.615+0000 7f248f83f640 1 -- 172.21.15.77:0/3704577230 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f248804f500 con 0x7f2470003f30 2024-04-25T01:43:46.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.616+0000 7f2485ffb640 1 -- 172.21.15.77:0/3704577230 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f248001d400 con 0x7f2470003f30 2024-04-25T01:43:46.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.616+0000 7f2485ffb640 1 --2- 172.21.15.77:0/3704577230 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f247406be30 0x7f247406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:46.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.616+0000 7f2485ffb640 1 -- 172.21.15.77:0/3704577230 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7f248008c4a0 con 0x7f2470003f30 2024-04-25T01:43:46.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.616+0000 7f248cdda640 1 --2- 172.21.15.77:0/3704577230 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f247406be30 0x7f247406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:46.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.617+0000 7f248cdda640 1 --2- 172.21.15.77:0/3704577230 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f247406be30 0x7f247406e2f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f247c00c3b0 tx=0x7f247c007000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:46.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.621+0000 7f2485ffb640 1 -- 172.21.15.77:0/3704577230 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2480019030 con 0x7f2470003f30 2024-04-25T01:43:46.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.805+0000 7f248f83f640 1 -- 172.21.15.77:0/3704577230 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f248814f680 con 0x7f2470003f30 2024-04-25T01:43:46.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.806+0000 7f2485ffb640 1 -- 172.21.15.77:0/3704577230 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v30) ==== 81+0+614 (secure 0 0 0) 0x7f2480010040 con 0x7f2470003f30 2024-04-25T01:43:46.797 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6837/2398109146 2024-04-26T01:43:29.392514+0000 2024-04-25T01:43:46.797 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6836/2398109146 2024-04-26T01:43:29.392514+0000 2024-04-25T01:43:46.797 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.121:6834/1039950655 2024-04-26T01:42:04.378069+0000 2024-04-25T01:43:46.797 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6835/1958322306 2024-04-26T01:41:34.373188+0000 2024-04-25T01:43:46.797 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6834/1958322306 2024-04-26T01:41:34.373188+0000 2024-04-25T01:43:46.797 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.121:6835/2449150984 2024-04-26T01:41:34.373282+0000 2024-04-25T01:43:46.797 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.121:6832/1039950655 2024-04-26T01:42:04.378069+0000 2024-04-25T01:43:46.797 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.121:6833/2449150984 2024-04-26T01:41:34.373282+0000 2024-04-25T01:43:46.797 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6837/3454203695 2024-04-26T01:40:59.368156+0000 2024-04-25T01:43:46.798 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6836/3454203695 2024-04-26T01:40:59.368156+0000 2024-04-25T01:43:46.798 INFO:teuthology.orchestra.run.smithi077.stderr:listed 10 entries 2024-04-25T01:43:46.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.808+0000 7f248f83f640 1 -- 172.21.15.77:0/3704577230 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f247406be30 msgr2=0x7f247406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:46.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.808+0000 7f248f83f640 1 --2- 172.21.15.77:0/3704577230 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f247406be30 0x7f247406e2f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f247c00c3b0 tx=0x7f247c007000 comp rx=0 tx=0).stop 2024-04-25T01:43:46.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.808+0000 7f248f83f640 1 -- 172.21.15.77:0/3704577230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2470003f30 msgr2=0x7f24881eb1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:46.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.808+0000 7f248f83f640 1 --2- 172.21.15.77:0/3704577230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2470003f30 0x7f24881eb1c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2480011e60 tx=0x7f248000f580 comp rx=0 tx=0).stop 2024-04-25T01:43:46.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.808+0000 7f248f83f640 1 -- 172.21.15.77:0/3704577230 shutdown_connections 2024-04-25T01:43:46.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.808+0000 7f248f83f640 1 --2- 172.21.15.77:0/3704577230 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f247406be30 0x7f247406e2f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:46.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.808+0000 7f248f83f640 1 --2- 172.21.15.77:0/3704577230 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2488143780 0x7f2488143c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:46.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.808+0000 7f248f83f640 1 --2- 172.21.15.77:0/3704577230 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24880c5750 0x7f2488147060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:46.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.808+0000 7f248f83f640 1 --2- 172.21.15.77:0/3704577230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2470003f30 0x7f24881eb1c0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:46.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.808+0000 7f248f83f640 1 -- 172.21.15.77:0/3704577230 >> 172.21.15.77:0/3704577230 conn(0x7f24880c7580 msgr2=0x7f24881483d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:46.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.808+0000 7f248f83f640 1 -- 172.21.15.77:0/3704577230 shutdown_connections 2024-04-25T01:43:46.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:46.808+0000 7f248f83f640 1 -- 172.21.15.77:0/3704577230 wait complete. 2024-04-25T01:43:46.810 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T01:43:46.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T01:43:46.810 DEBUG:teuthology.orchestra.run.smithi077:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T01:43:46.850 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T01:43:46.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T01:43:46.850 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T01:43:46.910 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-25T01:43:46.910 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T01:43:46.927 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-04-25T01:43:46.927 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T01:43:46.984 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T01:43:47.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.090+0000 7fcba1534640 1 Processor -- start 2024-04-25T01:43:47.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.090+0000 7fcba1534640 1 -- start start 2024-04-25T01:43:47.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.091+0000 7fcba1534640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcb9c156c80 0x7fcb9c0c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:47.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.091+0000 7fcba1534640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcb9c06c280 0x7fcb9c0c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:47.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.091+0000 7fcba1534640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb9c157130 con 0x7fcb9c150090 2024-04-25T01:43:47.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.091+0000 7fcba1534640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fcb9c06b830 con 0x7fcb9c06c280 2024-04-25T01:43:47.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.091+0000 7fcba1534640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fcb9c0c9de0 con 0x7fcb9c156c80 2024-04-25T01:43:47.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.091+0000 7fcb9b7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcb9c06c280 0x7fcb9c0c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:47.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.091+0000 7fcb9b7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcb9c06c280 0x7fcb9c0c6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56208/0 (socket says 172.21.15.77:56208) 2024-04-25T01:43:47.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.091+0000 7fcb9affd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fcb9c150090 0x7fcb9c0c8200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57406/0 (socket says 172.21.15.77:57406) 2024-04-25T01:43:47.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.091+0000 7fcb9b7fe640 1 -- 172.21.15.77:0/2045387598 learned_addr learned my addr 172.21.15.77:0/2045387598 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:47.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.091+0000 7fcb9a7fc640 1 --2- 172.21.15.77:0/2045387598 >> v2:172.21.15.121:3300/0 conn(0x7fcb9c156c80 0x7fcb9c0c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:47.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.091+0000 7fcb9b7fe640 1 -- 172.21.15.77:0/2045387598 >> v2:172.21.15.121:3300/0 conn(0x7fcb9c156c80 msgr2=0x7fcb9c0c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:47.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.091+0000 7fcb9b7fe640 1 --2- 172.21.15.77:0/2045387598 >> v2:172.21.15.121:3300/0 conn(0x7fcb9c156c80 0x7fcb9c0c98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.091+0000 7fcb9b7fe640 1 -- 172.21.15.77:0/2045387598 >> v1:172.21.15.77:6789/0 conn(0x7fcb9c150090 legacy=0x7fcb9c0c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:47.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.091+0000 7fcb9b7fe640 1 -- 172.21.15.77:0/2045387598 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb9c0c89c0 con 0x7fcb9c06c280 2024-04-25T01:43:47.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.092+0000 7fcb9b7fe640 1 --2- 172.21.15.77:0/2045387598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb9c06c280 0x7fcb9c0c6320 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c06d370 tx=0x7fcb9402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b73c47bed0af34 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:47.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.092+0000 7fcb99ffb640 1 -- 172.21.15.77:0/2045387598 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb94036070 con 0x7fcb9c06c280 2024-04-25T01:43:47.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.092+0000 7fcb99ffb640 1 -- 172.21.15.77:0/2045387598 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb94031600 con 0x7fcb9c06c280 2024-04-25T01:43:47.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.092+0000 7fcb99ffb640 1 -- 172.21.15.77:0/2045387598 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb940319d0 con 0x7fcb9c06c280 2024-04-25T01:43:47.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.093+0000 7fcba1534640 1 -- 172.21.15.77:0/2045387598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb9c06c280 msgr2=0x7fcb9c0c6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:47.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.093+0000 7fcba1534640 1 --2- 172.21.15.77:0/2045387598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb9c06c280 0x7fcb9c0c6320 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c06d370 tx=0x7fcb9402a730 comp rx=0 tx=0).stop 2024-04-25T01:43:47.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.093+0000 7fcba1534640 1 -- 172.21.15.77:0/2045387598 shutdown_connections 2024-04-25T01:43:47.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.093+0000 7fcba1534640 1 --2- 172.21.15.77:0/2045387598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb9c06c280 0x7fcb9c0c6320 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.093+0000 7fcba1534640 1 --2- 172.21.15.77:0/2045387598 >> v2:172.21.15.121:3300/0 conn(0x7fcb9c156c80 0x7fcb9c0c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.093+0000 7fcba1534640 1 -- 172.21.15.77:0/2045387598 >> 172.21.15.77:0/2045387598 conn(0x7fcb9c0ad4d0 msgr2=0x7fcb9c0ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:47.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.093+0000 7fcba1534640 1 -- 172.21.15.77:0/2045387598 shutdown_connections 2024-04-25T01:43:47.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.093+0000 7fcba1534640 1 -- 172.21.15.77:0/2045387598 wait complete. 2024-04-25T01:43:47.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.094+0000 7fcba1534640 1 Processor -- start 2024-04-25T01:43:47.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.094+0000 7fcba1534640 1 -- start start 2024-04-25T01:43:47.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.095+0000 7fcba1534640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb9c06c280 0x7fcb9c0c4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:47.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.095+0000 7fcba1534640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcb9c150090 0x7fcb9c0c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:47.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.095+0000 7fcba1534640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb9c156c80 0x7fcb9c152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:47.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.095+0000 7fcba1534640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcb9c06bd60 con 0x7fcb9c06c280 2024-04-25T01:43:47.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.095+0000 7fcba1534640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcb9c06ba80 con 0x7fcb9c156c80 2024-04-25T01:43:47.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.095+0000 7fcba1534640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fcb9c06c690 con 0x7fcb9c150090 2024-04-25T01:43:47.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.095+0000 7fcb9affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb9c06c280 0x7fcb9c0c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:47.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.095+0000 7fcb9affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb9c06c280 0x7fcb9c0c4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56212/0 (socket says 172.21.15.77:56212) 2024-04-25T01:43:47.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.095+0000 7fcb9affd640 1 -- 172.21.15.77:0/3626791847 learned_addr learned my addr 172.21.15.77:0/3626791847 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:47.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.095+0000 7fcb9b7fe640 1 --2- 172.21.15.77:0/3626791847 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb9c156c80 0x7fcb9c152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:47.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.095+0000 7fcb9a7fc640 1 --2- 172.21.15.77:0/3626791847 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcb9c150090 0x7fcb9c0c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:47.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.095+0000 7fcb9affd640 1 -- 172.21.15.77:0/3626791847 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcb9c150090 msgr2=0x7fcb9c0c1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:47.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.095+0000 7fcb9affd640 1 --2- 172.21.15.77:0/3626791847 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcb9c150090 0x7fcb9c0c1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.095+0000 7fcb9affd640 1 -- 172.21.15.77:0/3626791847 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb9c156c80 msgr2=0x7fcb9c152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:47.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.095+0000 7fcb9affd640 1 --2- 172.21.15.77:0/3626791847 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb9c156c80 0x7fcb9c152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.095+0000 7fcb9affd640 1 -- 172.21.15.77:0/3626791847 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb9c0c1010 con 0x7fcb9c06c280 2024-04-25T01:43:47.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.095+0000 7fcb9b7fe640 1 --2- 172.21.15.77:0/3626791847 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb9c156c80 0x7fcb9c152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:43:47.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.095+0000 7fcb9a7fc640 1 --2- 172.21.15.77:0/3626791847 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcb9c150090 0x7fcb9c0c1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:43:47.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.095+0000 7fcb9affd640 1 --2- 172.21.15.77:0/3626791847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb9c06c280 0x7fcb9c0c4970 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c00c430 tx=0x7fcb8c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:47.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.095+0000 7fcb837fe640 1 -- 172.21.15.77:0/3626791847 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c0074e0 con 0x7fcb9c06c280 2024-04-25T01:43:47.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.095+0000 7fcb837fe640 1 -- 172.21.15.77:0/3626791847 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb8c007680 con 0x7fcb9c06c280 2024-04-25T01:43:47.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.095+0000 7fcb837fe640 1 -- 172.21.15.77:0/3626791847 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c004a00 con 0x7fcb9c06c280 2024-04-25T01:43:47.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.095+0000 7fcba1534640 1 -- 172.21.15.77:0/3626791847 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb9c153af0 con 0x7fcb9c06c280 2024-04-25T01:43:47.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.095+0000 7fcba1534640 1 -- 172.21.15.77:0/3626791847 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb9c0c3fe0 con 0x7fcb9c06c280 2024-04-25T01:43:47.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.096+0000 7fcba1534640 1 -- 172.21.15.77:0/3626791847 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb9c04f500 con 0x7fcb9c06c280 2024-04-25T01:43:47.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.097+0000 7fcb837fe640 1 -- 172.21.15.77:0/3626791847 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb8c01a020 con 0x7fcb9c06c280 2024-04-25T01:43:47.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.097+0000 7fcb837fe640 1 --2- 172.21.15.77:0/3626791847 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fcb8806be30 0x7fcb8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:47.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.097+0000 7fcb837fe640 1 -- 172.21.15.77:0/3626791847 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7fcb8c08ac50 con 0x7fcb9c06c280 2024-04-25T01:43:47.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.097+0000 7fcb9a7fc640 1 --2- 172.21.15.77:0/3626791847 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fcb8806be30 0x7fcb8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:47.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.098+0000 7fcb9a7fc640 1 --2- 172.21.15.77:0/3626791847 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fcb8806be30 0x7fcb8806e2f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0c1910 tx=0x7fcb90008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:47.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.101+0000 7fcb837fe640 1 -- 172.21.15.77:0/3626791847 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcb8c090020 con 0x7fcb9c06c280 2024-04-25T01:43:47.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.274+0000 7fcba1534640 1 -- 172.21.15.77:0/3626791847 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb9c06cea0 con 0x7fcb9c06c280 2024-04-25T01:43:47.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.276+0000 7fcb837fe640 1 -- 172.21.15.77:0/3626791847 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+21172 (secure 0 0 0) 0x7fcb9c157130 con 0x7fcb9c06c280 2024-04-25T01:43:47.267 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:43:47.267 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":30,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:43:29.392580+0000","last_up_change":"2024-04-25T01:39:10.729600+0000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T01:39:11.681151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T01:39:21.606752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T01:39:22.677664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T01:39:30.501700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T01:39:31.740717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6811","nonce":3366980158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6817","nonce":3366980158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6828","nonce":3366980158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6825","nonce":3366980158}]},"public_addr":"172.21.15.77:6811/3366980158","cluster_addr":"172.21.15.77:6817/3366980158","heartbeat_back_addr":"172.21.15.77:6828/3366980158","heartbeat_front_addr":"172.21.15.77:6825/3366980158","state":["exists","up"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6801","nonce":3971619298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6803","nonce":3971619298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6807","nonce":3971619298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6805","nonce":3971619298}]},"public_addr":"172.21.15.77:6801/3971619298","cluster_addr":"172.21.15.77:6803/3971619298","heartbeat_back_addr":"172.21.15.77:6807/3971619298","heartbeat_front_addr":"172.21.15.77:6805/3971619298","state":["exists","up"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6810","nonce":4103452689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6813","nonce":4103452689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6823","nonce":4103452689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6818","nonce":4103452689}]},"public_addr":"172.21.15.77:6810/4103452689","cluster_addr":"172.21.15.77:6813/4103452689","heartbeat_back_addr":"172.21.15.77:6823/4103452689","heartbeat_front_addr":"172.21.15.77:6818/4103452689","state":["exists","up"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6819","nonce":217398906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6824","nonce":217398906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6831","nonce":217398906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6829","nonce":217398906}]},"public_addr":"172.21.15.77:6819/217398906","cluster_addr":"172.21.15.77:6824/217398906","heartbeat_back_addr":"172.21.15.77:6831/217398906","heartbeat_front_addr":"172.21.15.77:6829/217398906","state":["exists","up"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6801","nonce":2565483070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6803","nonce":2565483070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6810","nonce":2565483070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6806","nonce":2565483070}]},"public_addr":"172.21.15.121:6801/2565483070","cluster_addr":"172.21.15.121:6803/2565483070","heartbeat_back_addr":"172.21.15.121:6810/2565483070","heartbeat_front_addr":"172.21.15.121:6806/2565483070","state":["exists","up"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6807","nonce":2785294752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6809","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6811","nonce":2785294752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6815","nonce":2785294752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6813","nonce":2785294752}]},"public_addr":"172.21.15.121:6807/2785294752","cluster_addr":"172.21.15.121:6811/2785294752","heartbeat_back_addr":"172.21.15.121:6815/2785294752","heartbeat_front_addr":"172.21.15.121:6813/2785294752","state":["exists","up"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6820","nonce":523906818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6824","nonce":523906818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6831","nonce":523906818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6828","nonce":523906818}]},"public_addr":"172.21.15.121:6820/523906818","cluster_addr":"172.21.15.121:6824/523906818","heartbeat_back_addr":"172.21.15.121:6831/523906818","heartbeat_front_addr":"172.21.15.121:6828/523906818","state":["exists","up"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6817","nonce":1683602459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6819","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6821","nonce":1683602459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6829","nonce":1683602459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6823","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6825","nonce":1683602459}]},"public_addr":"172.21.15.121:6817/1683602459","cluster_addr":"172.21.15.121:6821/1683602459","heartbeat_back_addr":"172.21.15.121:6829/1683602459","heartbeat_front_addr":"172.21.15.121:6825/1683602459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.839443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.818842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.776243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.793085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.822396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.907311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.918374+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.848430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:6837/2398109146":"2024-04-26T01:43:29.392514+0000","172.21.15.77:6836/2398109146":"2024-04-26T01:43:29.392514+0000","172.21.15.121:6834/1039950655":"2024-04-26T01:42:04.378069+0000","172.21.15.77:6835/1958322306":"2024-04-26T01:41:34.373188+0000","172.21.15.77:6834/1958322306":"2024-04-26T01:41:34.373188+0000","172.21.15.121:6835/2449150984":"2024-04-26T01:41:34.373282+0000","172.21.15.121:6832/1039950655":"2024-04-26T01:42:04.378069+0000","172.21.15.121:6833/2449150984":"2024-04-26T01:41:34.373282+0000","172.21.15.77:6837/3454203695":"2024-04-26T01:40:59.368156+0000","172.21.15.77:6836/3454203695":"2024-04-26T01:40:59.368156+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:43:47.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.278+0000 7fcba1534640 1 -- 172.21.15.77:0/3626791847 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fcb8806be30 msgr2=0x7fcb8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:47.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.278+0000 7fcba1534640 1 --2- 172.21.15.77:0/3626791847 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fcb8806be30 0x7fcb8806e2f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0c1910 tx=0x7fcb90008040 comp rx=0 tx=0).stop 2024-04-25T01:43:47.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.278+0000 7fcba1534640 1 -- 172.21.15.77:0/3626791847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb9c06c280 msgr2=0x7fcb9c0c4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:47.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.278+0000 7fcba1534640 1 --2- 172.21.15.77:0/3626791847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb9c06c280 0x7fcb9c0c4970 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c00c430 tx=0x7fcb8c00c8f0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.278+0000 7fcba1534640 1 -- 172.21.15.77:0/3626791847 shutdown_connections 2024-04-25T01:43:47.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.278+0000 7fcba1534640 1 --2- 172.21.15.77:0/3626791847 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fcb8806be30 0x7fcb8806e2f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.278+0000 7fcba1534640 1 --2- 172.21.15.77:0/3626791847 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb9c156c80 0x7fcb9c152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.278+0000 7fcba1534640 1 --2- 172.21.15.77:0/3626791847 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcb9c150090 0x7fcb9c0c1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.278+0000 7fcba1534640 1 --2- 172.21.15.77:0/3626791847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb9c06c280 0x7fcb9c0c4970 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.278+0000 7fcba1534640 1 -- 172.21.15.77:0/3626791847 >> 172.21.15.77:0/3626791847 conn(0x7fcb9c0ad4d0 msgr2=0x7fcb9c1552b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:47.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.278+0000 7fcba1534640 1 -- 172.21.15.77:0/3626791847 shutdown_connections 2024-04-25T01:43:47.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.278+0000 7fcba1534640 1 -- 172.21.15.77:0/3626791847 wait complete. 2024-04-25T01:43:47.280 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T01:39:11.681151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-25T01:39:21.606752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-25T01:39:22.677664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-25T01:39:30.501700+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-25T01:39:31.740717+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T01:43:47.281 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T01:43:47.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.390+0000 7faa9bf96640 1 Processor -- start 2024-04-25T01:43:47.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.390+0000 7faa9bf96640 1 -- start start 2024-04-25T01:43:47.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.391+0000 7faa9bf96640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa9406d470 0x7faa9406d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:47.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.391+0000 7faa9bf96640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faa940c6c50 0x7faa940abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:47.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.391+0000 7faa9bf96640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7faa940c4d10 0x7faa940ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:47.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.391+0000 7faa9bf96640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7faa940acd20 con 0x7faa940c6c50 2024-04-25T01:43:47.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.391+0000 7faa9bf96640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7faa940acf70 con 0x7faa940c4d10 2024-04-25T01:43:47.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.391+0000 7faa9bf96640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7faa94153120 con 0x7faa9406d470 2024-04-25T01:43:47.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.391+0000 7faa99531640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faa940c6c50 0x7faa940abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:47.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.391+0000 7faa99531640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faa940c6c50 0x7faa940abf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56226/0 (socket says 172.21.15.77:56226) 2024-04-25T01:43:47.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.391+0000 7faa99531640 1 -- 172.21.15.77:0/1316691772 learned_addr learned my addr 172.21.15.77:0/1316691772 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:47.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.391+0000 7faa99d32640 1 --2- 172.21.15.77:0/1316691772 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa9406d470 0x7faa9406d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:47.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.391+0000 7faa9a533640 1 --2- 172.21.15.77:0/1316691772 >> v2:172.21.15.121:3300/0 conn(0x7faa940c4d10 0x7faa940ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:47.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.391+0000 7faa99531640 1 -- 172.21.15.77:0/1316691772 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa9406d470 msgr2=0x7faa9406d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:47.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.391+0000 7faa99531640 1 --2- 172.21.15.77:0/1316691772 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa9406d470 0x7faa9406d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.391+0000 7faa99531640 1 -- 172.21.15.77:0/1316691772 >> v2:172.21.15.121:3300/0 conn(0x7faa940c4d10 msgr2=0x7faa940ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:47.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.391+0000 7faa99531640 1 --2- 172.21.15.77:0/1316691772 >> v2:172.21.15.121:3300/0 conn(0x7faa940c4d10 0x7faa940ac4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.391+0000 7faa99531640 1 -- 172.21.15.77:0/1316691772 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa94153400 con 0x7faa940c6c50 2024-04-25T01:43:47.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.392+0000 7faa99531640 1 --2- 172.21.15.77:0/1316691772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa940c6c50 0x7faa940abf90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7faa940ad250 tx=0x7faa8402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458ef55942e0c4ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:47.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.392+0000 7faa98d30640 1 -- 172.21.15.77:0/1316691772 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa84037070 con 0x7faa940c6c50 2024-04-25T01:43:47.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.392+0000 7faa98d30640 1 -- 172.21.15.77:0/1316691772 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa8402ae00 con 0x7faa940c6c50 2024-04-25T01:43:47.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.392+0000 7faa98d30640 1 -- 172.21.15.77:0/1316691772 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa84032660 con 0x7faa940c6c50 2024-04-25T01:43:47.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.392+0000 7faa9bf96640 1 -- 172.21.15.77:0/1316691772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa940c6c50 msgr2=0x7faa940abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:47.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.392+0000 7faa9bf96640 1 --2- 172.21.15.77:0/1316691772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa940c6c50 0x7faa940abf90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7faa940ad250 tx=0x7faa8402a0b0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.392+0000 7faa9bf96640 1 -- 172.21.15.77:0/1316691772 shutdown_connections 2024-04-25T01:43:47.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.392+0000 7faa9bf96640 1 --2- 172.21.15.77:0/1316691772 >> v2:172.21.15.121:3300/0 conn(0x7faa940c4d10 0x7faa940ac4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.392+0000 7faa9bf96640 1 --2- 172.21.15.77:0/1316691772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa940c6c50 0x7faa940abf90 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.392+0000 7faa9bf96640 1 --2- 172.21.15.77:0/1316691772 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa9406d470 0x7faa9406d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.392+0000 7faa9bf96640 1 -- 172.21.15.77:0/1316691772 >> 172.21.15.77:0/1316691772 conn(0x7faa940c7580 msgr2=0x7faa940c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:47.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.393+0000 7faa9bf96640 1 -- 172.21.15.77:0/1316691772 shutdown_connections 2024-04-25T01:43:47.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.393+0000 7faa9bf96640 1 -- 172.21.15.77:0/1316691772 wait complete. 2024-04-25T01:43:47.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.394+0000 7faa9bf96640 1 Processor -- start 2024-04-25T01:43:47.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.394+0000 7faa9bf96640 1 -- start start 2024-04-25T01:43:47.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.394+0000 7faa9bf96640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa9406d470 0x7faa941e2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:47.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.394+0000 7faa9bf96640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa940c4d10 0x7faa94149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:47.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.394+0000 7faa9bf96640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa940c6c50 0x7faa941414b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:47.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.394+0000 7faa9bf96640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faa940c4200 con 0x7faa940c4d10 2024-04-25T01:43:47.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.394+0000 7faa9bf96640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faa940c4080 con 0x7faa940c6c50 2024-04-25T01:43:47.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.394+0000 7faa9bf96640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7faa940c4380 con 0x7faa9406d470 2024-04-25T01:43:47.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.394+0000 7faa99531640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa940c4d10 0x7faa94149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:47.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.394+0000 7faa99531640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa940c4d10 0x7faa94149e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56230/0 (socket says 172.21.15.77:56230) 2024-04-25T01:43:47.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.394+0000 7faa99531640 1 -- 172.21.15.77:0/171749938 learned_addr learned my addr 172.21.15.77:0/171749938 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:47.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.395+0000 7faa99d32640 1 --2- 172.21.15.77:0/171749938 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa9406d470 0x7faa941e2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:47.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.395+0000 7faa9a533640 1 --2- 172.21.15.77:0/171749938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa940c6c50 0x7faa941414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:47.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.395+0000 7faa99531640 1 -- 172.21.15.77:0/171749938 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa9406d470 msgr2=0x7faa941e2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:47.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.395+0000 7faa99531640 1 --2- 172.21.15.77:0/171749938 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa9406d470 0x7faa941e2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.395+0000 7faa99531640 1 -- 172.21.15.77:0/171749938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa940c6c50 msgr2=0x7faa941414b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:47.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.395+0000 7faa99531640 1 --2- 172.21.15.77:0/171749938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa940c6c50 0x7faa941414b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.395+0000 7faa99531640 1 -- 172.21.15.77:0/171749938 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa941e3340 con 0x7faa940c4d10 2024-04-25T01:43:47.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.395+0000 7faa99531640 1 --2- 172.21.15.77:0/171749938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa940c4d10 0x7faa94149e30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7faa8402a0f0 tx=0x7faa840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:47.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.395+0000 7faa8a7fc640 1 -- 172.21.15.77:0/171749938 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa84041070 con 0x7faa940c4d10 2024-04-25T01:43:47.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.395+0000 7faa8a7fc640 1 -- 172.21.15.77:0/171749938 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa84032e30 con 0x7faa940c4d10 2024-04-25T01:43:47.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.395+0000 7faa9bf96640 1 -- 172.21.15.77:0/171749938 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa941e3620 con 0x7faa940c4d10 2024-04-25T01:43:47.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.395+0000 7faa8a7fc640 1 -- 172.21.15.77:0/171749938 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa84037040 con 0x7faa940c4d10 2024-04-25T01:43:47.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.395+0000 7faa9bf96640 1 -- 172.21.15.77:0/171749938 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa941e3be0 con 0x7faa940c4d10 2024-04-25T01:43:47.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.396+0000 7faa9bf96640 1 -- 172.21.15.77:0/171749938 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa9404f500 con 0x7faa940c4d10 2024-04-25T01:43:47.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.396+0000 7faa8a7fc640 1 -- 172.21.15.77:0/171749938 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa8403a070 con 0x7faa940c4d10 2024-04-25T01:43:47.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.397+0000 7faa8a7fc640 1 --2- 172.21.15.77:0/171749938 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7faa7806be30 0x7faa7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:47.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.397+0000 7faa8a7fc640 1 -- 172.21.15.77:0/171749938 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7faa840ab4b0 con 0x7faa940c4d10 2024-04-25T01:43:47.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.397+0000 7faa99d32640 1 --2- 172.21.15.77:0/171749938 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7faa7806be30 0x7faa7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:47.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.397+0000 7faa99d32640 1 --2- 172.21.15.77:0/171749938 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7faa7806be30 0x7faa7806e2f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7faa90009a50 tx=0x7faa90008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:47.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.401+0000 7faa8a7fc640 1 -- 172.21.15.77:0/171749938 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7faa84079ac0 con 0x7faa940c4d10 2024-04-25T01:43:47.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.576+0000 7faa9bf96640 1 -- 172.21.15.77:0/171749938 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7faa940a81b0 con 0x7faa940c4d10 2024-04-25T01:43:47.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.577+0000 7faa8a7fc640 1 -- 172.21.15.77:0/171749938 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) ==== 93+0+10 (secure 0 0 0) 0x7faa840793c0 con 0x7faa940c4d10 2024-04-25T01:43:47.568 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-04-25T01:43:47.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.579+0000 7faa9bf96640 1 -- 172.21.15.77:0/171749938 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7faa7806be30 msgr2=0x7faa7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:47.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.579+0000 7faa9bf96640 1 --2- 172.21.15.77:0/171749938 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7faa7806be30 0x7faa7806e2f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7faa90009a50 tx=0x7faa90008040 comp rx=0 tx=0).stop 2024-04-25T01:43:47.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.579+0000 7faa9bf96640 1 -- 172.21.15.77:0/171749938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa940c4d10 msgr2=0x7faa94149e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:47.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.579+0000 7faa9bf96640 1 --2- 172.21.15.77:0/171749938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa940c4d10 0x7faa94149e30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7faa8402a0f0 tx=0x7faa840046c0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.579+0000 7faa9bf96640 1 -- 172.21.15.77:0/171749938 shutdown_connections 2024-04-25T01:43:47.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.579+0000 7faa9bf96640 1 --2- 172.21.15.77:0/171749938 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7faa7806be30 0x7faa7806e2f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.579+0000 7faa9bf96640 1 --2- 172.21.15.77:0/171749938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa940c4d10 0x7faa94149e30 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.579+0000 7faa9bf96640 1 --2- 172.21.15.77:0/171749938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa940c6c50 0x7faa941414b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.579+0000 7faa9bf96640 1 --2- 172.21.15.77:0/171749938 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa9406d470 0x7faa941e2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.579+0000 7faa9bf96640 1 -- 172.21.15.77:0/171749938 >> 172.21.15.77:0/171749938 conn(0x7faa940c7580 msgr2=0x7faa940abbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:47.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.579+0000 7faa9bf96640 1 -- 172.21.15.77:0/171749938 shutdown_connections 2024-04-25T01:43:47.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.579+0000 7faa9bf96640 1 -- 172.21.15.77:0/171749938 wait complete. 2024-04-25T01:43:47.580 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-25T01:43:47.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.690+0000 7fa2dc0ba640 1 Processor -- start 2024-04-25T01:43:47.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.690+0000 7fa2dc0ba640 1 -- start start 2024-04-25T01:43:47.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.691+0000 7fa2dc0ba640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa2d4073450 0x7fa2d40c5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:47.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.691+0000 7fa2dc0ba640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa2d40c4cb0 0x7fa2d40c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:47.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.691+0000 7fa2dc0ba640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2d40c7040 con 0x7fa2d40c4280 2024-04-25T01:43:47.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.691+0000 7fa2dc0ba640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa2d40c1cd0 con 0x7fa2d4073450 2024-04-25T01:43:47.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.691+0000 7fa2dc0ba640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fa2d40c5f00 con 0x7fa2d40c4cb0 2024-04-25T01:43:47.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.691+0000 7fa2d9655640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa2d4073450 0x7fa2d40c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:47.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.691+0000 7fa2d9655640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa2d4073450 0x7fa2d40c5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58862/0 (socket says 172.21.15.77:58862) 2024-04-25T01:43:47.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.691+0000 7fa2d9655640 1 -- 172.21.15.77:0/3366514495 learned_addr learned my addr 172.21.15.77:0/3366514495 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:47.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.691+0000 7fa2da657640 1 --2- 172.21.15.77:0/3366514495 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa2d40c4cb0 0x7fa2d40c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:47.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.691+0000 7fa2d9655640 1 -- 172.21.15.77:0/3366514495 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa2d40c4cb0 msgr2=0x7fa2d40c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:47.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.691+0000 7fa2d9655640 1 --2- 172.21.15.77:0/3366514495 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa2d40c4cb0 0x7fa2d40c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.691+0000 7fa2d9655640 1 -- 172.21.15.77:0/3366514495 >> v1:172.21.15.77:6789/0 conn(0x7fa2d40c4280 legacy=0x7fa2d41538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:47.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.691+0000 7fa2d9655640 1 -- 172.21.15.77:0/3366514495 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d40ac010 con 0x7fa2d4073450 2024-04-25T01:43:47.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.692+0000 7fa2d9655640 1 --2- 172.21.15.77:0/3366514495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2d4073450 0x7fa2d40c5480 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400bb10 tx=0x7fa2c402c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ae393d03aa8cac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:47.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.692+0000 7fa2d8e54640 1 -- 172.21.15.77:0/3366514495 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c4032790 con 0x7fa2d4073450 2024-04-25T01:43:47.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.692+0000 7fa2d8e54640 1 -- 172.21.15.77:0/3366514495 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2c4038070 con 0x7fa2d4073450 2024-04-25T01:43:47.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.692+0000 7fa2d8e54640 1 -- 172.21.15.77:0/3366514495 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c4032b50 con 0x7fa2d4073450 2024-04-25T01:43:47.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.693+0000 7fa2dc0ba640 1 -- 172.21.15.77:0/3366514495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2d4073450 msgr2=0x7fa2d40c5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:47.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.693+0000 7fa2dc0ba640 1 --2- 172.21.15.77:0/3366514495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2d4073450 0x7fa2d40c5480 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400bb10 tx=0x7fa2c402c890 comp rx=0 tx=0).stop 2024-04-25T01:43:47.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.693+0000 7fa2dc0ba640 1 -- 172.21.15.77:0/3366514495 shutdown_connections 2024-04-25T01:43:47.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.693+0000 7fa2dc0ba640 1 --2- 172.21.15.77:0/3366514495 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa2d40c4cb0 0x7fa2d40c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.693+0000 7fa2dc0ba640 1 --2- 172.21.15.77:0/3366514495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2d4073450 0x7fa2d40c5480 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.693+0000 7fa2dc0ba640 1 -- 172.21.15.77:0/3366514495 >> 172.21.15.77:0/3366514495 conn(0x7fa2d40c7580 msgr2=0x7fa2d40c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:47.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.693+0000 7fa2dc0ba640 1 -- 172.21.15.77:0/3366514495 shutdown_connections 2024-04-25T01:43:47.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.693+0000 7fa2dc0ba640 1 -- 172.21.15.77:0/3366514495 wait complete. 2024-04-25T01:43:47.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.694+0000 7fa2dc0ba640 1 Processor -- start 2024-04-25T01:43:47.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.694+0000 7fa2dc0ba640 1 -- start start 2024-04-25T01:43:47.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.695+0000 7fa2dc0ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2d4073450 0x7fa2d4146200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:47.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.695+0000 7fa2dc0ba640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2d40c4280 0x7fa2d41eb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:47.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.695+0000 7fa2dc0ba640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa2d40c4cb0 0x7fa2d4154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:47.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.695+0000 7fa2dc0ba640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d40c1910 con 0x7fa2d4073450 2024-04-25T01:43:47.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.695+0000 7fa2dc0ba640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d40ac810 con 0x7fa2d40c4280 2024-04-25T01:43:47.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.695+0000 7fa2dc0ba640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fa2d40c1a90 con 0x7fa2d40c4cb0 2024-04-25T01:43:47.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.695+0000 7fa2d9e56640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2d4073450 0x7fa2d4146200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:47.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.695+0000 7fa2d9e56640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2d4073450 0x7fa2d4146200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58876/0 (socket says 172.21.15.77:58876) 2024-04-25T01:43:47.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.695+0000 7fa2d9e56640 1 -- 172.21.15.77:0/308463470 learned_addr learned my addr 172.21.15.77:0/308463470 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:47.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.695+0000 7fa2da657640 1 --2- 172.21.15.77:0/308463470 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa2d40c4cb0 0x7fa2d4154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:47.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.695+0000 7fa2d9655640 1 --2- 172.21.15.77:0/308463470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2d40c4280 0x7fa2d41eb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:47.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.695+0000 7fa2d9e56640 1 -- 172.21.15.77:0/308463470 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa2d40c4cb0 msgr2=0x7fa2d4154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:47.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.695+0000 7fa2d9e56640 1 --2- 172.21.15.77:0/308463470 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa2d40c4cb0 0x7fa2d4154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.695+0000 7fa2d9e56640 1 -- 172.21.15.77:0/308463470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2d40c4280 msgr2=0x7fa2d41eb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:47.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.695+0000 7fa2d9e56640 1 --2- 172.21.15.77:0/308463470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2d40c4280 0x7fa2d41eb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.695+0000 7fa2d9e56640 1 -- 172.21.15.77:0/308463470 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d4146950 con 0x7fa2d4073450 2024-04-25T01:43:47.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.695+0000 7fa2d9e56640 1 --2- 172.21.15.77:0/308463470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2d4073450 0x7fa2d4146200 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa2d000c430 tx=0x7fa2d000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:47.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.695+0000 7fa2ca7fc640 1 -- 172.21.15.77:0/308463470 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0017070 con 0x7fa2d4073450 2024-04-25T01:43:47.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.695+0000 7fa2ca7fc640 1 -- 172.21.15.77:0/308463470 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2d00052d0 con 0x7fa2d4073450 2024-04-25T01:43:47.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.695+0000 7fa2dc0ba640 1 -- 172.21.15.77:0/308463470 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2d41ebb90 con 0x7fa2d4073450 2024-04-25T01:43:47.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.695+0000 7fa2ca7fc640 1 -- 172.21.15.77:0/308463470 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0003850 con 0x7fa2d4073450 2024-04-25T01:43:47.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.695+0000 7fa2dc0ba640 1 -- 172.21.15.77:0/308463470 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2d4147050 con 0x7fa2d4073450 2024-04-25T01:43:47.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.696+0000 7fa2dc0ba640 1 -- 172.21.15.77:0/308463470 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2d40c3cb0 con 0x7fa2d4073450 2024-04-25T01:43:47.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.697+0000 7fa2ca7fc640 1 -- 172.21.15.77:0/308463470 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa2d001a070 con 0x7fa2d4073450 2024-04-25T01:43:47.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.697+0000 7fa2ca7fc640 1 --2- 172.21.15.77:0/308463470 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa2b806be30 0x7fa2b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:47.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.697+0000 7fa2ca7fc640 1 -- 172.21.15.77:0/308463470 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7fa2d008a640 con 0x7fa2d4073450 2024-04-25T01:43:47.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.697+0000 7fa2d9655640 1 --2- 172.21.15.77:0/308463470 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa2b806be30 0x7fa2b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:47.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.698+0000 7fa2d9655640 1 --2- 172.21.15.77:0/308463470 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa2b806be30 0x7fa2b806e2f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4037000 tx=0x7fa2c403e040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:47.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.701+0000 7fa2ca7fc640 1 -- 172.21.15.77:0/308463470 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa2d40c3cb0 con 0x7fa2d4073450 2024-04-25T01:43:47.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.876+0000 7fa2dc0ba640 1 -- 172.21.15.77:0/308463470 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7fa2d404f500 con 0x7fa2d4073450 2024-04-25T01:43:47.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.877+0000 7fa2ca7fc640 1 -- 172.21.15.77:0/308463470 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v30) ==== 99+0+11 (secure 0 0 0) 0x7fa2d0058b30 con 0x7fa2d4073450 2024-04-25T01:43:47.868 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T01:43:47.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.878+0000 7fa2dc0ba640 1 -- 172.21.15.77:0/308463470 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa2b806be30 msgr2=0x7fa2b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:47.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.878+0000 7fa2dc0ba640 1 --2- 172.21.15.77:0/308463470 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa2b806be30 0x7fa2b806e2f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4037000 tx=0x7fa2c403e040 comp rx=0 tx=0).stop 2024-04-25T01:43:47.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.878+0000 7fa2dc0ba640 1 -- 172.21.15.77:0/308463470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2d4073450 msgr2=0x7fa2d4146200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:47.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.878+0000 7fa2dc0ba640 1 --2- 172.21.15.77:0/308463470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2d4073450 0x7fa2d4146200 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa2d000c430 tx=0x7fa2d000c8f0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.879+0000 7fa2dc0ba640 1 -- 172.21.15.77:0/308463470 shutdown_connections 2024-04-25T01:43:47.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.879+0000 7fa2dc0ba640 1 --2- 172.21.15.77:0/308463470 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa2b806be30 0x7fa2b806e2f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.879+0000 7fa2dc0ba640 1 --2- 172.21.15.77:0/308463470 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa2d40c4cb0 0x7fa2d4154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.879+0000 7fa2dc0ba640 1 --2- 172.21.15.77:0/308463470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2d40c4280 0x7fa2d41eb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.879+0000 7fa2dc0ba640 1 --2- 172.21.15.77:0/308463470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2d4073450 0x7fa2d4146200 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.879+0000 7fa2dc0ba640 1 -- 172.21.15.77:0/308463470 >> 172.21.15.77:0/308463470 conn(0x7fa2d40c7580 msgr2=0x7fa2d4151820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:47.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.879+0000 7fa2dc0ba640 1 -- 172.21.15.77:0/308463470 shutdown_connections 2024-04-25T01:43:47.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.879+0000 7fa2dc0ba640 1 -- 172.21.15.77:0/308463470 wait complete. 2024-04-25T01:43:47.880 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-25T01:43:47.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.989+0000 7f8649df9640 1 Processor -- start 2024-04-25T01:43:47.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.989+0000 7f8649df9640 1 -- start start 2024-04-25T01:43:47.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.990+0000 7f8649df9640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f86440c97c0 0x7f8644159d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:47.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.990+0000 7f8649df9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f864406d110 con 0x7f86440bef50 2024-04-25T01:43:47.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.990+0000 7f8649df9640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8644153910 con 0x7f8644153530 2024-04-25T01:43:47.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.990+0000 7f8649df9640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f8644156980 con 0x7f86440c97c0 2024-04-25T01:43:47.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.990+0000 7f8642ffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f86440bef50 0x7f86441595f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52224/0 (socket says 172.21.15.77:52224) 2024-04-25T01:43:47.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.990+0000 7f8642ffd640 1 -- 172.21.15.77:0/3926589816 learned_addr learned my addr 172.21.15.77:0/3926589816 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:43:47.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.990+0000 7f86427fc640 1 -- 172.21.15.77:0/3926589816 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3773159466 0 0) 0x7f864406d110 con 0x7f86440bef50 2024-04-25T01:43:47.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.990+0000 7f8643fff640 1 --2- 172.21.15.77:0/3926589816 >> v2:172.21.15.121:3300/0 conn(0x7f86440c97c0 0x7f8644159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:47.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.990+0000 7f86427fc640 1 -- 172.21.15.77:0/3926589816 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f862c003520 con 0x7f86440bef50 2024-04-25T01:43:47.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.991+0000 7f86427fc640 1 -- 172.21.15.77:0/3926589816 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3069058958 0 0) 0x7f862c003520 con 0x7f86440bef50 2024-04-25T01:43:47.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.991+0000 7f86427fc640 1 -- 172.21.15.77:0/3926589816 >> v2:172.21.15.121:3300/0 conn(0x7f86440c97c0 msgr2=0x7f8644159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:47.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.991+0000 7f86427fc640 1 --2- 172.21.15.77:0/3926589816 >> v2:172.21.15.121:3300/0 conn(0x7f86440c97c0 0x7f8644159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.991+0000 7f86427fc640 1 -- 172.21.15.77:0/3926589816 >> v1:172.21.15.121:6789/0 conn(0x7f8644153530 legacy=0x7f86440c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:47.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.991+0000 7f86427fc640 1 -- 172.21.15.77:0/3926589816 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8644156c60 con 0x7f86440bef50 2024-04-25T01:43:47.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.991+0000 7f86427fc640 1 -- 172.21.15.77:0/3926589816 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7f86380017f0 con 0x7f86440bef50 2024-04-25T01:43:47.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.991+0000 7f8643fff640 1 --2- 172.21.15.77:0/3926589816 >> v2:172.21.15.121:3300/0 conn(0x7f86440c97c0 0x7f8644159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:43:47.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.991+0000 7f86427fc640 1 -- 172.21.15.77:0/3926589816 >> v1:172.21.15.77:6789/0 conn(0x7f86440bef50 legacy=0x7f86441595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:47.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.991+0000 7f86427fc640 1 --2- 172.21.15.77:0/3926589816 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f862c0039b0 0x7f862c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:47.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.991+0000 7f86427fc640 1 --2- 172.21.15.77:0/3926589816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f862c004800 0x7f862c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:47.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.991+0000 7f86427fc640 1 --2- 172.21.15.77:0/3926589816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f862c0052e0 0x7f862c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:47.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.991+0000 7f86427fc640 1 -- 172.21.15.77:0/3926589816 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8644156980 con 0x7f862c0052e0 2024-04-25T01:43:47.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.991+0000 7f86427fc640 1 -- 172.21.15.77:0/3926589816 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f862c00c1b0 con 0x7f862c004800 2024-04-25T01:43:47.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.991+0000 7f86427fc640 1 -- 172.21.15.77:0/3926589816 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f862c00c3b0 con 0x7f862c0039b0 2024-04-25T01:43:47.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.991+0000 7f8643fff640 1 --2- 172.21.15.77:0/3926589816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f862c0052e0 0x7f862c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:47.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.991+0000 7f8642ffd640 1 --2- 172.21.15.77:0/3926589816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f862c004800 0x7f862c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:47.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.991+0000 7f86437fe640 1 --2- 172.21.15.77:0/3926589816 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f862c0039b0 0x7f862c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:47.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.991+0000 7f8643fff640 1 -- 172.21.15.77:0/3926589816 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f862c0039b0 msgr2=0x7f862c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:47.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.991+0000 7f8643fff640 1 --2- 172.21.15.77:0/3926589816 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f862c0039b0 0x7f862c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.991+0000 7f8643fff640 1 -- 172.21.15.77:0/3926589816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f862c004800 msgr2=0x7f862c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:47.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.991+0000 7f8643fff640 1 --2- 172.21.15.77:0/3926589816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f862c004800 0x7f862c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.991+0000 7f8643fff640 1 -- 172.21.15.77:0/3926589816 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f862c003520 con 0x7f862c0052e0 2024-04-25T01:43:47.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.992+0000 7f8643fff640 1 -- 172.21.15.77:0/3926589816 reap_dead start 2024-04-25T01:43:47.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.992+0000 7f8643fff640 1 --2- 172.21.15.77:0/3926589816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f862c0052e0 0x7f862c00b9c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f863c0073b0 tx=0x7f862c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12844cad8d7b474c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:47.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.992+0000 7f86427fc640 1 -- 172.21.15.77:0/3926589816 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c009c80 con 0x7f862c0052e0 2024-04-25T01:43:47.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.992+0000 7f86427fc640 1 -- 172.21.15.77:0/3926589816 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f863c02c650 con 0x7f862c0052e0 2024-04-25T01:43:47.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.992+0000 7f86427fc640 1 -- 172.21.15.77:0/3926589816 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c02ca40 con 0x7f862c0052e0 2024-04-25T01:43:47.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.992+0000 7f8649df9640 1 -- 172.21.15.77:0/3926589816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f862c0052e0 msgr2=0x7f862c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:47.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.992+0000 7f8649df9640 1 --2- 172.21.15.77:0/3926589816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f862c0052e0 0x7f862c00b9c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f863c0073b0 tx=0x7f862c005830 comp rx=0 tx=0).stop 2024-04-25T01:43:47.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.992+0000 7f8649df9640 1 -- 172.21.15.77:0/3926589816 shutdown_connections 2024-04-25T01:43:47.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.992+0000 7f8649df9640 1 --2- 172.21.15.77:0/3926589816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f862c0052e0 0x7f862c00b9c0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.993+0000 7f8649df9640 1 -- 172.21.15.77:0/3926589816 >> 172.21.15.77:0/3926589816 conn(0x7f86440672c0 msgr2=0x7f86440676d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:47.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.993+0000 7f8649df9640 1 -- 172.21.15.77:0/3926589816 shutdown_connections 2024-04-25T01:43:47.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.993+0000 7f8649df9640 1 -- 172.21.15.77:0/3926589816 wait complete. 2024-04-25T01:43:47.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.994+0000 7f8649df9640 1 Processor -- start 2024-04-25T01:43:47.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.994+0000 7f8649df9640 1 -- start start 2024-04-25T01:43:47.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.994+0000 7f8649df9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f862c0052e0 0x7f8644158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:47.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.994+0000 7f8649df9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f864414d140 0x7f86440ab9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:47.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.994+0000 7f8649df9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86440abf00 0x7f86441ec350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:47.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.994+0000 7f8649df9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f86440c6240 con 0x7f864414d140 2024-04-25T01:43:47.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.994+0000 7f8649df9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f86440cc250 con 0x7f86440abf00 2024-04-25T01:43:47.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.994+0000 7f8649df9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f86440c63c0 con 0x7f862c0052e0 2024-04-25T01:43:47.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.995+0000 7f8642ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f864414d140 0x7f86440ab9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:47.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.995+0000 7f8642ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f864414d140 0x7f86440ab9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58896/0 (socket says 172.21.15.77:58896) 2024-04-25T01:43:47.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.995+0000 7f8642ffd640 1 -- 172.21.15.77:0/3821662484 learned_addr learned my addr 172.21.15.77:0/3821662484 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:47.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.995+0000 7f8643fff640 1 --2- 172.21.15.77:0/3821662484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86440abf00 0x7f86441ec350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:47.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.995+0000 7f86437fe640 1 --2- 172.21.15.77:0/3821662484 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f862c0052e0 0x7f8644158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:47.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.995+0000 7f8642ffd640 1 -- 172.21.15.77:0/3821662484 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f862c0052e0 msgr2=0x7f8644158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:47.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.995+0000 7f8642ffd640 1 --2- 172.21.15.77:0/3821662484 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f862c0052e0 0x7f8644158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.995+0000 7f8642ffd640 1 -- 172.21.15.77:0/3821662484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86440abf00 msgr2=0x7f86441ec350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:47.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.995+0000 7f8642ffd640 1 --2- 172.21.15.77:0/3821662484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86440abf00 0x7f86441ec350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:47.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.995+0000 7f8642ffd640 1 -- 172.21.15.77:0/3821662484 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86441482b0 con 0x7f864414d140 2024-04-25T01:43:47.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.995+0000 7f8643fff640 1 --2- 172.21.15.77:0/3821662484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86440abf00 0x7f86441ec350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:43:47.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.995+0000 7f8642ffd640 1 --2- 172.21.15.77:0/3821662484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f864414d140 0x7f86440ab9c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f863800f810 tx=0x7f863800fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:47.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.995+0000 7f862bfff640 1 -- 172.21.15.77:0/3821662484 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86380072e0 con 0x7f864414d140 2024-04-25T01:43:47.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.995+0000 7f862bfff640 1 -- 172.21.15.77:0/3821662484 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8638018070 con 0x7f864414d140 2024-04-25T01:43:47.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.995+0000 7f8649df9640 1 -- 172.21.15.77:0/3821662484 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86441ebe50 con 0x7f864414d140 2024-04-25T01:43:47.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.995+0000 7f862bfff640 1 -- 172.21.15.77:0/3821662484 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86380057a0 con 0x7f864414d140 2024-04-25T01:43:47.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.995+0000 7f8649df9640 1 -- 172.21.15.77:0/3821662484 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86440aca20 con 0x7f864414d140 2024-04-25T01:43:47.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.996+0000 7f8649df9640 1 -- 172.21.15.77:0/3821662484 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86440cb0f0 con 0x7f864414d140 2024-04-25T01:43:47.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.997+0000 7f862bfff640 1 -- 172.21.15.77:0/3821662484 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8638005940 con 0x7f864414d140 2024-04-25T01:43:47.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.997+0000 7f862bfff640 1 --2- 172.21.15.77:0/3821662484 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f863006be30 0x7f863006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:47.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.997+0000 7f86437fe640 1 --2- 172.21.15.77:0/3821662484 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f863006be30 0x7f863006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:47.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.997+0000 7f862bfff640 1 -- 172.21.15.77:0/3821662484 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7f863808b270 con 0x7f864414d140 2024-04-25T01:43:47.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:47.998+0000 7f86437fe640 1 --2- 172.21.15.77:0/3821662484 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f863006be30 0x7f863006e2f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8634000c00 tx=0x7f8634009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:47.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.002+0000 7f862bfff640 1 -- 172.21.15.77:0/3821662484 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f86440cb0f0 con 0x7f864414d140 2024-04-25T01:43:48.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.175+0000 7f8649df9640 1 -- 172.21.15.77:0/3821662484 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7f86440ac2e0 con 0x7f864414d140 2024-04-25T01:43:48.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.175+0000 7f862bfff640 1 -- 172.21.15.77:0/3821662484 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v30) ==== 95+0+11 (secure 0 0 0) 0x7f863801a310 con 0x7f864414d140 2024-04-25T01:43:48.166 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-25T01:43:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.177+0000 7f8649df9640 1 -- 172.21.15.77:0/3821662484 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f863006be30 msgr2=0x7f863006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.177+0000 7f8649df9640 1 --2- 172.21.15.77:0/3821662484 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f863006be30 0x7f863006e2f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8634000c00 tx=0x7f8634009040 comp rx=0 tx=0).stop 2024-04-25T01:43:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.177+0000 7f8649df9640 1 -- 172.21.15.77:0/3821662484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f864414d140 msgr2=0x7f86440ab9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.177+0000 7f8649df9640 1 --2- 172.21.15.77:0/3821662484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f864414d140 0x7f86440ab9c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f863800f810 tx=0x7f863800fcd0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.177+0000 7f8649df9640 1 -- 172.21.15.77:0/3821662484 shutdown_connections 2024-04-25T01:43:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.177+0000 7f8649df9640 1 --2- 172.21.15.77:0/3821662484 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f863006be30 0x7f863006e2f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.177+0000 7f8649df9640 1 --2- 172.21.15.77:0/3821662484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f864414d140 0x7f86440ab9c0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.177+0000 7f8649df9640 1 --2- 172.21.15.77:0/3821662484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86440abf00 0x7f86441ec350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.177+0000 7f8649df9640 1 --2- 172.21.15.77:0/3821662484 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f862c0052e0 0x7f8644158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.177+0000 7f8649df9640 1 -- 172.21.15.77:0/3821662484 >> 172.21.15.77:0/3821662484 conn(0x7f86440672c0 msgr2=0x7f8644150260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.177+0000 7f8649df9640 1 -- 172.21.15.77:0/3821662484 shutdown_connections 2024-04-25T01:43:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.177+0000 7f8649df9640 1 -- 172.21.15.77:0/3821662484 wait complete. 2024-04-25T01:43:48.179 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-25T01:43:48.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.289+0000 7f846e928640 1 Processor -- start 2024-04-25T01:43:48.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.289+0000 7f846e928640 1 -- start start 2024-04-25T01:43:48.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.289+0000 7f846e928640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f84680c4280 0x7f8468153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:48.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.289+0000 7f846e928640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f84680aca40 0x7f84681511f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:48.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.289+0000 7f846e928640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8468151730 0x7f846806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:48.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.289+0000 7f846e928640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f8468151ba0 con 0x7f8468151730 2024-04-25T01:43:48.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.289+0000 7f846e928640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f8468154430 con 0x7f84680c4280 2024-04-25T01:43:48.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.289+0000 7f846e928640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f84681546b0 con 0x7f84680aca40 2024-04-25T01:43:48.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.290+0000 7f846cec5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8468151730 0x7f846806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:48.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.290+0000 7f846cec5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8468151730 0x7f846806d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58912/0 (socket says 172.21.15.77:58912) 2024-04-25T01:43:48.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.290+0000 7f846cec5640 1 -- 172.21.15.77:0/139420563 learned_addr learned my addr 172.21.15.77:0/139420563 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:48.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.290+0000 7f846cec5640 1 -- 172.21.15.77:0/139420563 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f84680aca40 msgr2=0x7f84681511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:48.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.290+0000 7f8467fff640 1 --2- 172.21.15.77:0/139420563 >> v2:172.21.15.121:3300/0 conn(0x7f84680c4280 0x7f8468153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:48.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.290+0000 7f84677fe640 1 --2- 172.21.15.77:0/139420563 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f84680aca40 0x7f84681511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:48.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.290+0000 7f846cec5640 1 --2- 172.21.15.77:0/139420563 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f84680aca40 0x7f84681511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.290+0000 7f846cec5640 1 -- 172.21.15.77:0/139420563 >> v2:172.21.15.121:3300/0 conn(0x7f84680c4280 msgr2=0x7f8468153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:48.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.290+0000 7f846cec5640 1 --2- 172.21.15.77:0/139420563 >> v2:172.21.15.121:3300/0 conn(0x7f84680c4280 0x7f8468153ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.290+0000 7f846cec5640 1 -- 172.21.15.77:0/139420563 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8468154990 con 0x7f8468151730 2024-04-25T01:43:48.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.290+0000 7f8467fff640 1 --2- 172.21.15.77:0/139420563 >> v2:172.21.15.121:3300/0 conn(0x7f84680c4280 0x7f8468153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:43:48.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.290+0000 7f84677fe640 1 --2- 172.21.15.77:0/139420563 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f84680aca40 0x7f84681511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:43:48.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.291+0000 7f846cec5640 1 --2- 172.21.15.77:0/139420563 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8468151730 0x7f846806d8c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8468073c70 tx=0x7f846002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f71eecee4245d56 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:48.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.291+0000 7f8466ffd640 1 -- 172.21.15.77:0/139420563 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8460036070 con 0x7f8468151730 2024-04-25T01:43:48.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.291+0000 7f8466ffd640 1 -- 172.21.15.77:0/139420563 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8460031600 con 0x7f8468151730 2024-04-25T01:43:48.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.291+0000 7f8466ffd640 1 -- 172.21.15.77:0/139420563 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84600319d0 con 0x7f8468151730 2024-04-25T01:43:48.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.291+0000 7f846e928640 1 -- 172.21.15.77:0/139420563 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8468151730 msgr2=0x7f846806d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:48.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.291+0000 7f846e928640 1 --2- 172.21.15.77:0/139420563 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8468151730 0x7f846806d8c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8468073c70 tx=0x7f846002a610 comp rx=0 tx=0).stop 2024-04-25T01:43:48.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.291+0000 7f846e928640 1 -- 172.21.15.77:0/139420563 shutdown_connections 2024-04-25T01:43:48.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.291+0000 7f846e928640 1 --2- 172.21.15.77:0/139420563 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8468151730 0x7f846806d8c0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.291+0000 7f846e928640 1 --2- 172.21.15.77:0/139420563 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f84680aca40 0x7f84681511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.291+0000 7f846e928640 1 --2- 172.21.15.77:0/139420563 >> v2:172.21.15.121:3300/0 conn(0x7f84680c4280 0x7f8468153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.291+0000 7f846e928640 1 -- 172.21.15.77:0/139420563 >> 172.21.15.77:0/139420563 conn(0x7f84680c7580 msgr2=0x7f84680c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:48.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.291+0000 7f846e928640 1 -- 172.21.15.77:0/139420563 shutdown_connections 2024-04-25T01:43:48.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.291+0000 7f846e928640 1 -- 172.21.15.77:0/139420563 wait complete. 2024-04-25T01:43:48.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.292+0000 7f846e928640 1 Processor -- start 2024-04-25T01:43:48.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.293+0000 7f846e928640 1 -- start start 2024-04-25T01:43:48.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.293+0000 7f846e928640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f84680aca40 0x7f846814d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:48.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.293+0000 7f846e928640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84680c4280 0x7f8468157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:48.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.293+0000 7f846e928640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8468151730 0x7f8468157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:48.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.293+0000 7f846e928640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f84680c4660 con 0x7f8468151730 2024-04-25T01:43:48.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.293+0000 7f846e928640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f846806d3a0 con 0x7f84680c4280 2024-04-25T01:43:48.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.293+0000 7f846e928640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f84680c47e0 con 0x7f84680aca40 2024-04-25T01:43:48.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.293+0000 7f846cec5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8468151730 0x7f8468157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:48.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.293+0000 7f846cec5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8468151730 0x7f8468157c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58924/0 (socket says 172.21.15.77:58924) 2024-04-25T01:43:48.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.293+0000 7f846cec5640 1 -- 172.21.15.77:0/1820536604 learned_addr learned my addr 172.21.15.77:0/1820536604 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:48.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.294+0000 7f84677fe640 1 --2- 172.21.15.77:0/1820536604 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84680c4280 0x7f8468157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:48.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.294+0000 7f8467fff640 1 --2- 172.21.15.77:0/1820536604 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f84680aca40 0x7f846814d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:48.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.294+0000 7f846cec5640 1 -- 172.21.15.77:0/1820536604 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f84680aca40 msgr2=0x7f846814d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:48.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.294+0000 7f846cec5640 1 --2- 172.21.15.77:0/1820536604 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f84680aca40 0x7f846814d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.294+0000 7f846cec5640 1 -- 172.21.15.77:0/1820536604 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84680c4280 msgr2=0x7f8468157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:48.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.294+0000 7f846cec5640 1 --2- 172.21.15.77:0/1820536604 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84680c4280 0x7f8468157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.294+0000 7f846cec5640 1 -- 172.21.15.77:0/1820536604 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84681ef470 con 0x7f8468151730 2024-04-25T01:43:48.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.294+0000 7f84677fe640 1 --2- 172.21.15.77:0/1820536604 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84680c4280 0x7f8468157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:43:48.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.294+0000 7f8467fff640 1 --2- 172.21.15.77:0/1820536604 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f84680aca40 0x7f846814d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:43:48.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.294+0000 7f846cec5640 1 --2- 172.21.15.77:0/1820536604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8468151730 0x7f8468157c70 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8460009f40 tx=0x7f8460004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:48.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.294+0000 7f8464ff9640 1 -- 172.21.15.77:0/1820536604 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8460036050 con 0x7f8468151730 2024-04-25T01:43:48.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.294+0000 7f8464ff9640 1 -- 172.21.15.77:0/1820536604 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8460042070 con 0x7f8468151730 2024-04-25T01:43:48.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.294+0000 7f846e928640 1 -- 172.21.15.77:0/1820536604 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84681ef750 con 0x7f8468151730 2024-04-25T01:43:48.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.294+0000 7f8464ff9640 1 -- 172.21.15.77:0/1820536604 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8460009510 con 0x7f8468151730 2024-04-25T01:43:48.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.294+0000 7f846e928640 1 -- 172.21.15.77:0/1820536604 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8468073570 con 0x7f8468151730 2024-04-25T01:43:48.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.295+0000 7f846e928640 1 -- 172.21.15.77:0/1820536604 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f846804f500 con 0x7f8468151730 2024-04-25T01:43:48.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.295+0000 7f8464ff9640 1 -- 172.21.15.77:0/1820536604 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8460007bd0 con 0x7f8468151730 2024-04-25T01:43:48.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.296+0000 7f8464ff9640 1 --2- 172.21.15.77:0/1820536604 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f845406be30 0x7f845406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:48.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.296+0000 7f8467fff640 1 --2- 172.21.15.77:0/1820536604 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f845406be30 0x7f845406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:48.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.296+0000 7f8464ff9640 1 -- 172.21.15.77:0/1820536604 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7f84600ac2e0 con 0x7f8468151730 2024-04-25T01:43:48.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.296+0000 7f8467fff640 1 --2- 172.21.15.77:0/1820536604 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f845406be30 0x7f845406e2f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f845c006fd0 tx=0x7f845c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:48.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.300+0000 7f8464ff9640 1 -- 172.21.15.77:0/1820536604 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8460045360 con 0x7f8468151730 2024-04-25T01:43:48.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.479+0000 7f846e928640 1 -- 172.21.15.77:0/1820536604 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7f846814e830 con 0x7f8468151730 2024-04-25T01:43:48.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.480+0000 7f8464ff9640 1 -- 172.21.15.77:0/1820536604 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v30) ==== 99+0+11 (secure 0 0 0) 0x7f846007a7d0 con 0x7f8468151730 2024-04-25T01:43:48.471 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-04-25T01:43:48.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.482+0000 7f846e928640 1 -- 172.21.15.77:0/1820536604 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f845406be30 msgr2=0x7f845406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:48.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.482+0000 7f846e928640 1 --2- 172.21.15.77:0/1820536604 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f845406be30 0x7f845406e2f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f845c006fd0 tx=0x7f845c008040 comp rx=0 tx=0).stop 2024-04-25T01:43:48.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.482+0000 7f846e928640 1 -- 172.21.15.77:0/1820536604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8468151730 msgr2=0x7f8468157c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:48.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.482+0000 7f846e928640 1 --2- 172.21.15.77:0/1820536604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8468151730 0x7f8468157c70 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8460009f40 tx=0x7f8460004a40 comp rx=0 tx=0).stop 2024-04-25T01:43:48.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.482+0000 7f846e928640 1 -- 172.21.15.77:0/1820536604 shutdown_connections 2024-04-25T01:43:48.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.482+0000 7f846e928640 1 --2- 172.21.15.77:0/1820536604 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f845406be30 0x7f845406e2f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.482+0000 7f846e928640 1 --2- 172.21.15.77:0/1820536604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8468151730 0x7f8468157c70 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.482+0000 7f846e928640 1 --2- 172.21.15.77:0/1820536604 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84680c4280 0x7f8468157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.482+0000 7f846e928640 1 --2- 172.21.15.77:0/1820536604 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f84680aca40 0x7f846814d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.482+0000 7f846e928640 1 -- 172.21.15.77:0/1820536604 >> 172.21.15.77:0/1820536604 conn(0x7f84680c7580 msgr2=0x7f8468149a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:48.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.482+0000 7f846e928640 1 -- 172.21.15.77:0/1820536604 shutdown_connections 2024-04-25T01:43:48.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.482+0000 7f846e928640 1 -- 172.21.15.77:0/1820536604 wait complete. 2024-04-25T01:43:48.484 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-25T01:43:48.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.593+0000 7fd51c0ba640 1 Processor -- start 2024-04-25T01:43:48.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.593+0000 7fd51c0ba640 1 -- start start 2024-04-25T01:43:48.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.593+0000 7fd51c0ba640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd5140c4280 0x7fd514153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:48.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.593+0000 7fd51c0ba640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd5140aca40 0x7fd5141511f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:48.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.593+0000 7fd51c0ba640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd514151730 0x7fd51406d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:48.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.594+0000 7fd51c0ba640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd514151ba0 con 0x7fd514151730 2024-04-25T01:43:48.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.594+0000 7fd51c0ba640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fd514154430 con 0x7fd5140c4280 2024-04-25T01:43:48.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.594+0000 7fd51c0ba640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd5141546b0 con 0x7fd5140aca40 2024-04-25T01:43:48.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.594+0000 7fd51a657640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd514151730 0x7fd51406d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:48.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.594+0000 7fd51a657640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd514151730 0x7fd51406d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58934/0 (socket says 172.21.15.77:58934) 2024-04-25T01:43:48.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.594+0000 7fd51a657640 1 -- 172.21.15.77:0/1103408499 learned_addr learned my addr 172.21.15.77:0/1103408499 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:48.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.594+0000 7fd519655640 1 --2- 172.21.15.77:0/1103408499 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd5140aca40 0x7fd5141511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:48.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.594+0000 7fd519e56640 1 --2- 172.21.15.77:0/1103408499 >> v2:172.21.15.121:3300/0 conn(0x7fd5140c4280 0x7fd514153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:48.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.594+0000 7fd51a657640 1 -- 172.21.15.77:0/1103408499 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd5140aca40 msgr2=0x7fd5141511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:48.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.594+0000 7fd51a657640 1 --2- 172.21.15.77:0/1103408499 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd5140aca40 0x7fd5141511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.594+0000 7fd51a657640 1 -- 172.21.15.77:0/1103408499 >> v2:172.21.15.121:3300/0 conn(0x7fd5140c4280 msgr2=0x7fd514153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:48.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.594+0000 7fd51a657640 1 --2- 172.21.15.77:0/1103408499 >> v2:172.21.15.121:3300/0 conn(0x7fd5140c4280 0x7fd514153ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.594+0000 7fd51a657640 1 -- 172.21.15.77:0/1103408499 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd514154990 con 0x7fd514151730 2024-04-25T01:43:48.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.595+0000 7fd51a657640 1 --2- 172.21.15.77:0/1103408499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd514151730 0x7fd51406d8c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd514073c70 tx=0x7fd50c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6458470c2e0e3d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:48.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.595+0000 7fd518e54640 1 -- 172.21.15.77:0/1103408499 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c036070 con 0x7fd514151730 2024-04-25T01:43:48.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.595+0000 7fd518e54640 1 -- 172.21.15.77:0/1103408499 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd50c031600 con 0x7fd514151730 2024-04-25T01:43:48.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.595+0000 7fd518e54640 1 -- 172.21.15.77:0/1103408499 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c0319d0 con 0x7fd514151730 2024-04-25T01:43:48.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.595+0000 7fd51c0ba640 1 -- 172.21.15.77:0/1103408499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd514151730 msgr2=0x7fd51406d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:48.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.595+0000 7fd51c0ba640 1 --2- 172.21.15.77:0/1103408499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd514151730 0x7fd51406d8c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd514073c70 tx=0x7fd50c02a610 comp rx=0 tx=0).stop 2024-04-25T01:43:48.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.595+0000 7fd51c0ba640 1 -- 172.21.15.77:0/1103408499 shutdown_connections 2024-04-25T01:43:48.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.595+0000 7fd51c0ba640 1 --2- 172.21.15.77:0/1103408499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd514151730 0x7fd51406d8c0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.595+0000 7fd51c0ba640 1 --2- 172.21.15.77:0/1103408499 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd5140aca40 0x7fd5141511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.595+0000 7fd51c0ba640 1 --2- 172.21.15.77:0/1103408499 >> v2:172.21.15.121:3300/0 conn(0x7fd5140c4280 0x7fd514153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.595+0000 7fd51c0ba640 1 -- 172.21.15.77:0/1103408499 >> 172.21.15.77:0/1103408499 conn(0x7fd5140c7580 msgr2=0x7fd5140c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:48.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.596+0000 7fd51c0ba640 1 -- 172.21.15.77:0/1103408499 shutdown_connections 2024-04-25T01:43:48.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.596+0000 7fd51c0ba640 1 -- 172.21.15.77:0/1103408499 wait complete. 2024-04-25T01:43:48.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.597+0000 7fd51c0ba640 1 Processor -- start 2024-04-25T01:43:48.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.597+0000 7fd51c0ba640 1 -- start start 2024-04-25T01:43:48.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.597+0000 7fd51c0ba640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd5140aca40 0x7fd514153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:48.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.597+0000 7fd51c0ba640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5140c4280 0x7fd514152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:48.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.597+0000 7fd51c0ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd514151730 0x7fd514152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:48.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.597+0000 7fd51c0ba640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd5140c4660 con 0x7fd514151730 2024-04-25T01:43:48.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.597+0000 7fd51c0ba640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd51406d3a0 con 0x7fd5140c4280 2024-04-25T01:43:48.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.597+0000 7fd51c0ba640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd5140c47e0 con 0x7fd5140aca40 2024-04-25T01:43:48.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.597+0000 7fd51a657640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd514151730 0x7fd514152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:48.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.597+0000 7fd51a657640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd514151730 0x7fd514152eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58950/0 (socket says 172.21.15.77:58950) 2024-04-25T01:43:48.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.597+0000 7fd51a657640 1 -- 172.21.15.77:0/188923715 learned_addr learned my addr 172.21.15.77:0/188923715 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:48.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.598+0000 7fd519655640 1 --2- 172.21.15.77:0/188923715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5140c4280 0x7fd514152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:48.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.598+0000 7fd51a657640 1 -- 172.21.15.77:0/188923715 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd5140aca40 msgr2=0x7fd514153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:48.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.598+0000 7fd519e56640 1 --2- 172.21.15.77:0/188923715 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd5140aca40 0x7fd514153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:48.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.598+0000 7fd51a657640 1 --2- 172.21.15.77:0/188923715 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd5140aca40 0x7fd514153b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.598+0000 7fd51a657640 1 -- 172.21.15.77:0/188923715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5140c4280 msgr2=0x7fd514152970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:48.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.598+0000 7fd51a657640 1 --2- 172.21.15.77:0/188923715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5140c4280 0x7fd514152970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.598+0000 7fd51a657640 1 -- 172.21.15.77:0/188923715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd51414dbb0 con 0x7fd514151730 2024-04-25T01:43:48.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.598+0000 7fd51a657640 1 --2- 172.21.15.77:0/188923715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd514151730 0x7fd514152eb0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd50c02ac00 tx=0x7fd50c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:48.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.598+0000 7fd50a7fc640 1 -- 172.21.15.77:0/188923715 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c03f020 con 0x7fd514151730 2024-04-25T01:43:48.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.598+0000 7fd50a7fc640 1 -- 172.21.15.77:0/188923715 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd50c037040 con 0x7fd514151730 2024-04-25T01:43:48.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.598+0000 7fd50a7fc640 1 -- 172.21.15.77:0/188923715 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c036070 con 0x7fd514151730 2024-04-25T01:43:48.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.598+0000 7fd51c0ba640 1 -- 172.21.15.77:0/188923715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd514151e00 con 0x7fd514151730 2024-04-25T01:43:48.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.598+0000 7fd51c0ba640 1 -- 172.21.15.77:0/188923715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5141523c0 con 0x7fd514151730 2024-04-25T01:43:48.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.599+0000 7fd51c0ba640 1 -- 172.21.15.77:0/188923715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd51414e040 con 0x7fd514151730 2024-04-25T01:43:48.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.599+0000 7fd50a7fc640 1 -- 172.21.15.77:0/188923715 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd50c042020 con 0x7fd514151730 2024-04-25T01:43:48.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.600+0000 7fd50a7fc640 1 --2- 172.21.15.77:0/188923715 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd4f806be30 0x7fd4f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:48.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.600+0000 7fd519e56640 1 --2- 172.21.15.77:0/188923715 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd4f806be30 0x7fd4f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:48.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.600+0000 7fd50a7fc640 1 -- 172.21.15.77:0/188923715 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7fd50c0ab820 con 0x7fd514151730 2024-04-25T01:43:48.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.600+0000 7fd519e56640 1 --2- 172.21.15.77:0/188923715 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd4f806be30 0x7fd4f806e2f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd510006fd0 tx=0x7fd510008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:48.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.604+0000 7fd50a7fc640 1 -- 172.21.15.77:0/188923715 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd50c049030 con 0x7fd514151730 2024-04-25T01:43:48.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.780+0000 7fd51c0ba640 1 -- 172.21.15.77:0/188923715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7fd51404f500 con 0x7fd514151730 2024-04-25T01:43:48.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.780+0000 7fd50a7fc640 1 -- 172.21.15.77:0/188923715 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v30) ==== 95+0+11 (secure 0 0 0) 0x7fd50c079d10 con 0x7fd514151730 2024-04-25T01:43:48.771 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-04-25T01:43:48.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.782+0000 7fd51c0ba640 1 -- 172.21.15.77:0/188923715 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd4f806be30 msgr2=0x7fd4f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:48.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.782+0000 7fd51c0ba640 1 --2- 172.21.15.77:0/188923715 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd4f806be30 0x7fd4f806e2f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd510006fd0 tx=0x7fd510008040 comp rx=0 tx=0).stop 2024-04-25T01:43:48.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.782+0000 7fd51c0ba640 1 -- 172.21.15.77:0/188923715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd514151730 msgr2=0x7fd514152eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:48.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.782+0000 7fd51c0ba640 1 --2- 172.21.15.77:0/188923715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd514151730 0x7fd514152eb0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd50c02ac00 tx=0x7fd50c004a40 comp rx=0 tx=0).stop 2024-04-25T01:43:48.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.782+0000 7fd51c0ba640 1 -- 172.21.15.77:0/188923715 shutdown_connections 2024-04-25T01:43:48.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.782+0000 7fd51c0ba640 1 --2- 172.21.15.77:0/188923715 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd4f806be30 0x7fd4f806e2f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.782+0000 7fd51c0ba640 1 --2- 172.21.15.77:0/188923715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd514151730 0x7fd514152eb0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.782+0000 7fd51c0ba640 1 --2- 172.21.15.77:0/188923715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5140c4280 0x7fd514152970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.782+0000 7fd51c0ba640 1 --2- 172.21.15.77:0/188923715 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd5140aca40 0x7fd514153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.782+0000 7fd51c0ba640 1 -- 172.21.15.77:0/188923715 >> 172.21.15.77:0/188923715 conn(0x7fd5140c7580 msgr2=0x7fd5140a6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:48.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.782+0000 7fd51c0ba640 1 -- 172.21.15.77:0/188923715 shutdown_connections 2024-04-25T01:43:48.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.782+0000 7fd51c0ba640 1 -- 172.21.15.77:0/188923715 wait complete. 2024-04-25T01:43:48.784 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T01:43:48.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.891+0000 7f9e6f31b640 1 Processor -- start 2024-04-25T01:43:48.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.892+0000 7f9e6f31b640 1 -- start start 2024-04-25T01:43:48.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.892+0000 7f9e6f31b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9e6806d470 0x7f9e6806d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:48.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.892+0000 7f9e6f31b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9e680c4d10 0x7f9e680c2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.892+0000 7f9e6f31b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e680acf70 con 0x7f9e680c6c50 2024-04-25T01:43:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.892+0000 7f9e6f31b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9e680acd20 con 0x7f9e6806d470 2024-04-25T01:43:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.892+0000 7f9e6f31b640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f9e68153120 con 0x7f9e680c4d10 2024-04-25T01:43:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.892+0000 7f9e6d0b7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9e6806d470 0x7f9e6806d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.892+0000 7f9e6d0b7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9e6806d470 0x7f9e6806d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58962/0 (socket says 172.21.15.77:58962) 2024-04-25T01:43:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.892+0000 7f9e6d0b7640 1 -- 172.21.15.77:0/1918413716 learned_addr learned my addr 172.21.15.77:0/1918413716 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.892+0000 7f9e6c8b6640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9e680c6c50 0x7f9e680abf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52240/0 (socket says 172.21.15.77:52240) 2024-04-25T01:43:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.893+0000 7f9e6d8b8640 1 --2- 172.21.15.77:0/1918413716 >> v2:172.21.15.121:3300/0 conn(0x7f9e680c4d10 0x7f9e680c2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.893+0000 7f9e6d0b7640 1 -- 172.21.15.77:0/1918413716 >> v2:172.21.15.121:3300/0 conn(0x7f9e680c4d10 msgr2=0x7f9e680c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.893+0000 7f9e6d0b7640 1 --2- 172.21.15.77:0/1918413716 >> v2:172.21.15.121:3300/0 conn(0x7f9e680c4d10 0x7f9e680c2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.893+0000 7f9e6d0b7640 1 -- 172.21.15.77:0/1918413716 >> v1:172.21.15.77:6789/0 conn(0x7f9e680c6c50 legacy=0x7f9e680abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.893+0000 7f9e6d0b7640 1 -- 172.21.15.77:0/1918413716 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e68153400 con 0x7f9e6806d470 2024-04-25T01:43:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.893+0000 7f9e5ffff640 1 -- 172.21.15.77:0/1918413716 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1486080622 0 0) 0x7f9e680acf70 con 0x7f9e680c6c50 2024-04-25T01:43:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.893+0000 7f9e6d8b8640 1 --2- 172.21.15.77:0/1918413716 >> v2:172.21.15.121:3300/0 conn(0x7f9e680c4d10 0x7f9e680c2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:43:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.893+0000 7f9e6d0b7640 1 --2- 172.21.15.77:0/1918413716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e6806d470 0x7f9e6806d850 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9e680c3d50 tx=0x7f9e5802a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd3e2fb7466824f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.893+0000 7f9e5ffff640 1 -- 172.21.15.77:0/1918413716 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e58037070 con 0x7f9e6806d470 2024-04-25T01:43:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.894+0000 7f9e5ffff640 1 -- 172.21.15.77:0/1918413716 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e58032440 con 0x7f9e6806d470 2024-04-25T01:43:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.894+0000 7f9e5ffff640 1 -- 172.21.15.77:0/1918413716 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e58032810 con 0x7f9e6806d470 2024-04-25T01:43:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.894+0000 7f9e6f31b640 1 -- 172.21.15.77:0/1918413716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e6806d470 msgr2=0x7f9e6806d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.894+0000 7f9e6f31b640 1 --2- 172.21.15.77:0/1918413716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e6806d470 0x7f9e6806d850 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9e680c3d50 tx=0x7f9e5802a150 comp rx=0 tx=0).stop 2024-04-25T01:43:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.894+0000 7f9e6f31b640 1 -- 172.21.15.77:0/1918413716 shutdown_connections 2024-04-25T01:43:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.894+0000 7f9e6f31b640 1 --2- 172.21.15.77:0/1918413716 >> v2:172.21.15.121:3300/0 conn(0x7f9e680c4d10 0x7f9e680c2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.894+0000 7f9e6f31b640 1 --2- 172.21.15.77:0/1918413716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e6806d470 0x7f9e6806d850 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.894+0000 7f9e6f31b640 1 -- 172.21.15.77:0/1918413716 >> 172.21.15.77:0/1918413716 conn(0x7f9e680c7580 msgr2=0x7f9e680c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:48.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.894+0000 7f9e6f31b640 1 -- 172.21.15.77:0/1918413716 shutdown_connections 2024-04-25T01:43:48.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.894+0000 7f9e6f31b640 1 -- 172.21.15.77:0/1918413716 wait complete. 2024-04-25T01:43:48.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.895+0000 7f9e6f31b640 1 Processor -- start 2024-04-25T01:43:48.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.895+0000 7f9e6f31b640 1 -- start start 2024-04-25T01:43:48.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.896+0000 7f9e6f31b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e6806d470 0x7f9e681ec880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:48.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.896+0000 7f9e6f31b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e680c4d10 0x7f9e681ecdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:48.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.896+0000 7f9e6f31b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e680c6c50 0x7f9e6814d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:48.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.896+0000 7f9e6f31b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9e680ac820 con 0x7f9e680c4d10 2024-04-25T01:43:48.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.896+0000 7f9e6f31b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9e680ac6a0 con 0x7f9e680c6c50 2024-04-25T01:43:48.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.896+0000 7f9e6f31b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9e680c4080 con 0x7f9e6806d470 2024-04-25T01:43:48.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.896+0000 7f9e6c8b6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e680c4d10 0x7f9e681ecdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:48.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.896+0000 7f9e6c8b6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e680c4d10 0x7f9e681ecdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58968/0 (socket says 172.21.15.77:58968) 2024-04-25T01:43:48.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.896+0000 7f9e6c8b6640 1 -- 172.21.15.77:0/3682365385 learned_addr learned my addr 172.21.15.77:0/3682365385 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:48.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.896+0000 7f9e6d8b8640 1 --2- 172.21.15.77:0/3682365385 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e680c6c50 0x7f9e6814d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:48.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.896+0000 7f9e6d0b7640 1 --2- 172.21.15.77:0/3682365385 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e6806d470 0x7f9e681ec880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:48.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.896+0000 7f9e6c8b6640 1 -- 172.21.15.77:0/3682365385 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e6806d470 msgr2=0x7f9e681ec880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:48.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.896+0000 7f9e6c8b6640 1 --2- 172.21.15.77:0/3682365385 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e6806d470 0x7f9e681ec880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.896+0000 7f9e6c8b6640 1 -- 172.21.15.77:0/3682365385 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e680c6c50 msgr2=0x7f9e6814d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:48.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.896+0000 7f9e6c8b6640 1 --2- 172.21.15.77:0/3682365385 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e680c6c50 0x7f9e6814d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:48.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.896+0000 7f9e6c8b6640 1 -- 172.21.15.77:0/3682365385 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e6814e1b0 con 0x7f9e680c4d10 2024-04-25T01:43:48.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.896+0000 7f9e6c8b6640 1 --2- 172.21.15.77:0/3682365385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e680c4d10 0x7f9e681ecdc0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9e6400c460 tx=0x7f9e6400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:48.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.896+0000 7f9e5dffb640 1 -- 172.21.15.77:0/3682365385 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e64018070 con 0x7f9e680c4d10 2024-04-25T01:43:48.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.897+0000 7f9e5dffb640 1 -- 172.21.15.77:0/3682365385 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e64007500 con 0x7f9e680c4d10 2024-04-25T01:43:48.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.897+0000 7f9e6f31b640 1 -- 172.21.15.77:0/3682365385 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e68150780 con 0x7f9e680c4d10 2024-04-25T01:43:48.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.897+0000 7f9e5dffb640 1 -- 172.21.15.77:0/3682365385 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e64004a20 con 0x7f9e680c4d10 2024-04-25T01:43:48.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.897+0000 7f9e6f31b640 1 -- 172.21.15.77:0/3682365385 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e6814e450 con 0x7f9e680c4d10 2024-04-25T01:43:48.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.898+0000 7f9e6f31b640 1 -- 172.21.15.77:0/3682365385 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e6804f500 con 0x7f9e680c4d10 2024-04-25T01:43:48.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.898+0000 7f9e5dffb640 1 -- 172.21.15.77:0/3682365385 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e6401b070 con 0x7f9e680c4d10 2024-04-25T01:43:48.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.898+0000 7f9e5dffb640 1 --2- 172.21.15.77:0/3682365385 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9e4c06be30 0x7f9e4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:48.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.898+0000 7f9e6d0b7640 1 --2- 172.21.15.77:0/3682365385 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9e4c06be30 0x7f9e4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:48.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.899+0000 7f9e5dffb640 1 -- 172.21.15.77:0/3682365385 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7f9e6408a520 con 0x7f9e680c4d10 2024-04-25T01:43:48.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.899+0000 7f9e6d0b7640 1 --2- 172.21.15.77:0/3682365385 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9e4c06be30 0x7f9e4c06e2f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9e58034000 tx=0x7f9e5802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:48.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:48.903+0000 7f9e5dffb640 1 -- 172.21.15.77:0/3682365385 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9e640583c0 con 0x7f9e680c4d10 2024-04-25T01:43:49.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.087+0000 7f9e6f31b640 1 -- 172.21.15.77:0/3682365385 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9e680678b0 con 0x7f9e680c4d10 2024-04-25T01:43:49.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.087+0000 7f9e5dffb640 1 -- 172.21.15.77:0/3682365385 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v30) ==== 81+0+614 (secure 0 0 0) 0x7f9e6405c6c0 con 0x7f9e680c4d10 2024-04-25T01:43:49.079 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6837/2398109146 2024-04-26T01:43:29.392514+0000 2024-04-25T01:43:49.079 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6836/2398109146 2024-04-26T01:43:29.392514+0000 2024-04-25T01:43:49.079 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.121:6834/1039950655 2024-04-26T01:42:04.378069+0000 2024-04-25T01:43:49.079 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6835/1958322306 2024-04-26T01:41:34.373188+0000 2024-04-25T01:43:49.079 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6834/1958322306 2024-04-26T01:41:34.373188+0000 2024-04-25T01:43:49.079 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.121:6835/2449150984 2024-04-26T01:41:34.373282+0000 2024-04-25T01:43:49.079 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.121:6832/1039950655 2024-04-26T01:42:04.378069+0000 2024-04-25T01:43:49.079 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.121:6833/2449150984 2024-04-26T01:41:34.373282+0000 2024-04-25T01:43:49.079 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6837/3454203695 2024-04-26T01:40:59.368156+0000 2024-04-25T01:43:49.079 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6836/3454203695 2024-04-26T01:40:59.368156+0000 2024-04-25T01:43:49.080 INFO:teuthology.orchestra.run.smithi077.stderr:listed 10 entries 2024-04-25T01:43:49.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.089+0000 7f9e6f31b640 1 -- 172.21.15.77:0/3682365385 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9e4c06be30 msgr2=0x7f9e4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:49.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.089+0000 7f9e6f31b640 1 --2- 172.21.15.77:0/3682365385 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9e4c06be30 0x7f9e4c06e2f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9e58034000 tx=0x7f9e5802e000 comp rx=0 tx=0).stop 2024-04-25T01:43:49.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.089+0000 7f9e6f31b640 1 -- 172.21.15.77:0/3682365385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e680c4d10 msgr2=0x7f9e681ecdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:49.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.089+0000 7f9e6f31b640 1 --2- 172.21.15.77:0/3682365385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e680c4d10 0x7f9e681ecdc0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9e6400c460 tx=0x7f9e6400c920 comp rx=0 tx=0).stop 2024-04-25T01:43:49.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.090+0000 7f9e6f31b640 1 -- 172.21.15.77:0/3682365385 shutdown_connections 2024-04-25T01:43:49.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.090+0000 7f9e6f31b640 1 --2- 172.21.15.77:0/3682365385 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9e4c06be30 0x7f9e4c06e2f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:49.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.090+0000 7f9e6f31b640 1 --2- 172.21.15.77:0/3682365385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e680c4d10 0x7f9e681ecdc0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:49.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.090+0000 7f9e6f31b640 1 --2- 172.21.15.77:0/3682365385 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e680c6c50 0x7f9e6814d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:49.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.090+0000 7f9e6f31b640 1 --2- 172.21.15.77:0/3682365385 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e6806d470 0x7f9e681ec880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:49.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.090+0000 7f9e6f31b640 1 -- 172.21.15.77:0/3682365385 >> 172.21.15.77:0/3682365385 conn(0x7f9e680c7580 msgr2=0x7f9e680c2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:49.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.090+0000 7f9e6f31b640 1 -- 172.21.15.77:0/3682365385 shutdown_connections 2024-04-25T01:43:49.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.090+0000 7f9e6f31b640 1 -- 172.21.15.77:0/3682365385 wait complete. 2024-04-25T01:43:49.091 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-25T01:43:49.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T01:43:49.092 DEBUG:teuthology.orchestra.run.smithi121:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-04-25T01:43:49.125 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-04-25T01:43:49.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T01:43:49.125 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-25T01:43:49.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T01:43:49.260 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2024-04-25T01:43:49.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T01:43:49.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T01:43:49.276 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T01:43:49.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T01:43:49.340 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link delete ceph-brx 2024-04-25T01:43:49.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T01:43:49.435 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-04-25T01:43:49.453 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T01:43:49.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T01:43:49.454 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T01:43:49.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T01:43:49.522 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link delete ceph-brx 2024-04-25T01:43:49.624 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T01:43:49.633 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T01:43:49.633 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T01:43:49.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.742+0000 7f72ff62c640 1 Processor -- start 2024-04-25T01:43:49.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.742+0000 7f72ff62c640 1 -- start start 2024-04-25T01:43:49.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.743+0000 7f72ff62c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f72f80c5d10 0x7f72f80aa030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:49.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.743+0000 7f72ff62c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f72f80a7180 0x7f72f80c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:49.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.743+0000 7f72ff62c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72f8157c50 con 0x7f72f81517e0 2024-04-25T01:43:49.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.743+0000 7f72ff62c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f72f80ad6b0 con 0x7f72f80a7180 2024-04-25T01:43:49.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.743+0000 7f72ff62c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f72f80a95e0 con 0x7f72f80c5d10 2024-04-25T01:43:49.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.743+0000 7f72fd3c8640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f72f81517e0 0x7f72f8157540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52250/0 (socket says 172.21.15.77:52250) 2024-04-25T01:43:49.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.743+0000 7f72fd3c8640 1 -- 172.21.15.77:0/2035593390 learned_addr learned my addr 172.21.15.77:0/2035593390 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:43:49.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.743+0000 7f72fdbc9640 1 --2- 172.21.15.77:0/2035593390 >> v2:172.21.15.77:3300/0 conn(0x7f72f80a7180 0x7f72f80c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:49.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.744+0000 7f72fdbc9640 1 -- 172.21.15.77:0/2035593390 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f72f80c5d10 msgr2=0x7f72f80aa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:49.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.744+0000 7f72fdbc9640 1 --2- 172.21.15.77:0/2035593390 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f72f80c5d10 0x7f72f80aa030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:49.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.744+0000 7f72fdbc9640 1 -- 172.21.15.77:0/2035593390 >> v1:172.21.15.77:6789/0 conn(0x7f72f81517e0 legacy=0x7f72f8157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:49.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.744+0000 7f72effff640 1 -- 172.21.15.77:0/2035593390 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3209538449 0 0) 0x7f72f8157c50 con 0x7f72f81517e0 2024-04-25T01:43:49.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.744+0000 7f72fdbc9640 1 -- 172.21.15.77:0/2035593390 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f80ad900 con 0x7f72f80a7180 2024-04-25T01:43:49.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.744+0000 7f72fdbc9640 1 --2- 172.21.15.77:0/2035593390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72f80a7180 0x7f72f80c67b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009d90 tx=0x7f72f002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba1421bc1743dbf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:49.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.744+0000 7f72effff640 1 -- 172.21.15.77:0/2035593390 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f0007740 con 0x7f72f80a7180 2024-04-25T01:43:49.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.744+0000 7f72effff640 1 -- 172.21.15.77:0/2035593390 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f00078e0 con 0x7f72f80a7180 2024-04-25T01:43:49.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.744+0000 7f72effff640 1 -- 172.21.15.77:0/2035593390 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f0007cb0 con 0x7f72f80a7180 2024-04-25T01:43:49.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.745+0000 7f72ff62c640 1 -- 172.21.15.77:0/2035593390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72f80a7180 msgr2=0x7f72f80c67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:49.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.745+0000 7f72ff62c640 1 --2- 172.21.15.77:0/2035593390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72f80a7180 0x7f72f80c67b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009d90 tx=0x7f72f002a660 comp rx=0 tx=0).stop 2024-04-25T01:43:49.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.745+0000 7f72ff62c640 1 -- 172.21.15.77:0/2035593390 shutdown_connections 2024-04-25T01:43:49.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.745+0000 7f72ff62c640 1 --2- 172.21.15.77:0/2035593390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72f80a7180 0x7f72f80c67b0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:49.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.745+0000 7f72ff62c640 1 --2- 172.21.15.77:0/2035593390 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f72f80c5d10 0x7f72f80aa030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:49.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.745+0000 7f72ff62c640 1 -- 172.21.15.77:0/2035593390 >> 172.21.15.77:0/2035593390 conn(0x7f72f80c4440 msgr2=0x7f72f80c4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:49.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.745+0000 7f72ff62c640 1 -- 172.21.15.77:0/2035593390 shutdown_connections 2024-04-25T01:43:49.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.745+0000 7f72ff62c640 1 -- 172.21.15.77:0/2035593390 wait complete. 2024-04-25T01:43:49.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.746+0000 7f72ff62c640 1 Processor -- start 2024-04-25T01:43:49.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.746+0000 7f72ff62c640 1 -- start start 2024-04-25T01:43:49.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.747+0000 7f72ff62c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f72f80a7180 0x7f72f814c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:49.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.747+0000 7f72ff62c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f81517e0 0x7f72f8072f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:49.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.747+0000 7f72ff62c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72f81507d0 0x7f72f8070520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:49.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.747+0000 7f72ff62c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f72f80c6cf0 con 0x7f72f81507d0 2024-04-25T01:43:49.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.747+0000 7f72ff62c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f72f80a9b10 con 0x7f72f81517e0 2024-04-25T01:43:49.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.747+0000 7f72ff62c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f72f80c6e70 con 0x7f72f80a7180 2024-04-25T01:43:49.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.747+0000 7f72fdbc9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72f81507d0 0x7f72f8070520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:49.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.747+0000 7f72fdbc9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72f81507d0 0x7f72f8070520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58986/0 (socket says 172.21.15.77:58986) 2024-04-25T01:43:49.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.747+0000 7f72fdbc9640 1 -- 172.21.15.77:0/4289322396 learned_addr learned my addr 172.21.15.77:0/4289322396 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:49.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.747+0000 7f72fd3c8640 1 --2- 172.21.15.77:0/4289322396 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f72f80a7180 0x7f72f814c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:49.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.747+0000 7f72fcbc7640 1 --2- 172.21.15.77:0/4289322396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f81517e0 0x7f72f8072f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:49.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.747+0000 7f72fdbc9640 1 -- 172.21.15.77:0/4289322396 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f72f80a7180 msgr2=0x7f72f814c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:49.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.747+0000 7f72fdbc9640 1 --2- 172.21.15.77:0/4289322396 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f72f80a7180 0x7f72f814c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:49.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.747+0000 7f72fdbc9640 1 -- 172.21.15.77:0/4289322396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f81517e0 msgr2=0x7f72f8072f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:49.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.747+0000 7f72fdbc9640 1 --2- 172.21.15.77:0/4289322396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f81517e0 0x7f72f8072f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:49.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.747+0000 7f72fdbc9640 1 -- 172.21.15.77:0/4289322396 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f814d430 con 0x7f72f81507d0 2024-04-25T01:43:49.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.747+0000 7f72fd3c8640 1 --2- 172.21.15.77:0/4289322396 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f72f80a7180 0x7f72f814c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:43:49.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.747+0000 7f72fdbc9640 1 --2- 172.21.15.77:0/4289322396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72f81507d0 0x7f72f8070520 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f72f002ac50 tx=0x7f72f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:49.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.747+0000 7f72edffb640 1 -- 172.21.15.77:0/4289322396 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f0040070 con 0x7f72f81507d0 2024-04-25T01:43:49.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.748+0000 7f72edffb640 1 -- 172.21.15.77:0/4289322396 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f0031c90 con 0x7f72f81507d0 2024-04-25T01:43:49.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.748+0000 7f72ff62c640 1 -- 172.21.15.77:0/4289322396 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f814bc20 con 0x7f72f81507d0 2024-04-25T01:43:49.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.748+0000 7f72edffb640 1 -- 172.21.15.77:0/4289322396 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f0045680 con 0x7f72f81507d0 2024-04-25T01:43:49.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.748+0000 7f72ff62c640 1 -- 172.21.15.77:0/4289322396 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f8151f20 con 0x7f72f81507d0 2024-04-25T01:43:49.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.749+0000 7f72ff62c640 1 -- 172.21.15.77:0/4289322396 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72f804f500 con 0x7f72f81507d0 2024-04-25T01:43:49.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.749+0000 7f72edffb640 1 -- 172.21.15.77:0/4289322396 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f72f0039040 con 0x7f72f81507d0 2024-04-25T01:43:49.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.750+0000 7f72edffb640 1 --2- 172.21.15.77:0/4289322396 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f72dc06be30 0x7f72dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:49.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.750+0000 7f72fd3c8640 1 --2- 172.21.15.77:0/4289322396 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f72dc06be30 0x7f72dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:49.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.750+0000 7f72edffb640 1 -- 172.21.15.77:0/4289322396 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7f72f00acda0 con 0x7f72f81507d0 2024-04-25T01:43:49.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.750+0000 7f72fd3c8640 1 --2- 172.21.15.77:0/4289322396 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f72dc06be30 0x7f72dc06e2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f72e8000f60 tx=0x7f72e8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:49.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.754+0000 7f72edffb640 1 -- 172.21.15.77:0/4289322396 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f72f007b350 con 0x7f72f81507d0 2024-04-25T01:43:49.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.925+0000 7f72ff62c640 1 -- 172.21.15.77:0/4289322396 --> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f72f8073750 con 0x7f72dc06be30 2024-04-25T01:43:49.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.937+0000 7f72edffb640 1 -- 172.21.15.77:0/4289322396 <== mgr.4098 v2:172.21.15.77:6832/4208232183 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+492656 (secure 0 0 0) 0x7f72f8073750 con 0x7f72dc06be30 2024-04-25T01:43:49.933 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:43:49.937 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-25T01:43:49.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.941+0000 7f72ff62c640 1 -- 172.21.15.77:0/4289322396 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f72dc06be30 msgr2=0x7f72dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:49.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.941+0000 7f72ff62c640 1 --2- 172.21.15.77:0/4289322396 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f72dc06be30 0x7f72dc06e2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f72e8000f60 tx=0x7f72e8009040 comp rx=0 tx=0).stop 2024-04-25T01:43:49.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.941+0000 7f72ff62c640 1 -- 172.21.15.77:0/4289322396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72f81507d0 msgr2=0x7f72f8070520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:49.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.941+0000 7f72ff62c640 1 --2- 172.21.15.77:0/4289322396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72f81507d0 0x7f72f8070520 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f72f002ac50 tx=0x7f72f0004a40 comp rx=0 tx=0).stop 2024-04-25T01:43:49.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.941+0000 7f72ff62c640 1 -- 172.21.15.77:0/4289322396 shutdown_connections 2024-04-25T01:43:49.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.941+0000 7f72ff62c640 1 --2- 172.21.15.77:0/4289322396 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f72dc06be30 0x7f72dc06e2f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:49.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.941+0000 7f72ff62c640 1 --2- 172.21.15.77:0/4289322396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72f81507d0 0x7f72f8070520 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:49.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.941+0000 7f72ff62c640 1 --2- 172.21.15.77:0/4289322396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f81517e0 0x7f72f8072f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:49.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.941+0000 7f72ff62c640 1 --2- 172.21.15.77:0/4289322396 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f72f80a7180 0x7f72f814c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:49.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.941+0000 7f72ff62c640 1 -- 172.21.15.77:0/4289322396 >> 172.21.15.77:0/4289322396 conn(0x7f72f80c4440 msgr2=0x7f72f80c4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:49.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.941+0000 7f72ff62c640 1 -- 172.21.15.77:0/4289322396 shutdown_connections 2024-04-25T01:43:49.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:49.941+0000 7f72ff62c640 1 -- 172.21.15.77:0/4289322396 wait complete. 2024-04-25T01:43:49.943 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2024-04-25T01:43:49.724066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16552905,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":520,"num_read_kb":8330,"num_write":26446,"num_write_kb":50357087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31315,"ondisk_log_size":31315,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":552148,"kb_used_data":35028,"kb_used_omap":12,"kb_used_meta":517043,"kb_avail":754422572,"statfs":{"total":773094113280,"available":772528713728,"internally_reserved":0,"allocated":35868672,"data_stored":34241341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":529452592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1623193311,"num_objects":-387,"num_object_clones":0,"num_object_copies":-774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-387,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":391,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003598"},"pg_stats":[{"pgid":"5.18","version":"30'210","reported_seq":235,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.740479+0000","last_change":"2024-04-25T01:39:33.445614+0000","last_active":"2024-04-25T01:43:34.740479+0000","last_peered":"2024-04-25T01:43:34.740479+0000","last_clean":"2024-04-25T01:43:34.740479+0000","last_became_active":"2024-04-25T01:39:33.445090+0000","last_became_peered":"2024-04-25T01:39:33.445090+0000","last_unstale":"2024-04-25T01:43:34.740479+0000","last_undegraded":"2024-04-25T01:43:34.740479+0000","last_fullsized":"2024-04-25T01:43:34.740479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:50.951488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"29'6","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403369+0000","last_change":"2024-04-25T01:39:23.377096+0000","last_active":"2024-04-25T01:43:29.403369+0000","last_peered":"2024-04-25T01:43:29.403369+0000","last_clean":"2024-04-25T01:43:29.403369+0000","last_became_active":"2024-04-25T01:39:23.376811+0000","last_became_peered":"2024-04-25T01:39:23.376811+0000","last_unstale":"2024-04-25T01:43:29.403369+0000","last_undegraded":"2024-04-25T01:43:29.403369+0000","last_fullsized":"2024-04-25T01:43:29.403369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:26.888605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"30'181","reported_seq":215,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.883447+0000","last_change":"2024-04-25T01:39:24.394317+0000","last_active":"2024-04-25T01:43:46.883447+0000","last_peered":"2024-04-25T01:43:46.883447+0000","last_clean":"2024-04-25T01:43:46.883447+0000","last_became_active":"2024-04-25T01:39:24.394032+0000","last_became_peered":"2024-04-25T01:39:24.394032+0000","last_unstale":"2024-04-25T01:43:46.883447+0000","last_undegraded":"2024-04-25T01:43:46.883447+0000","last_fullsized":"2024-04-25T01:43:46.883447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:11.795443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.407597+0000","last_change":"2024-04-25T01:39:32.421607+0000","last_active":"2024-04-25T01:43:29.407597+0000","last_peered":"2024-04-25T01:43:29.407597+0000","last_clean":"2024-04-25T01:43:29.407597+0000","last_became_active":"2024-04-25T01:39:32.421355+0000","last_became_peered":"2024-04-25T01:39:32.421355+0000","last_unstale":"2024-04-25T01:43:29.407597+0000","last_undegraded":"2024-04-25T01:43:29.407597+0000","last_fullsized":"2024-04-25T01:43:29.407597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:12:14.019262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"30'203","reported_seq":228,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.744955+0000","last_change":"2024-04-25T01:39:33.436651+0000","last_active":"2024-04-25T01:43:34.744955+0000","last_peered":"2024-04-25T01:43:34.744955+0000","last_clean":"2024-04-25T01:43:34.744955+0000","last_became_active":"2024-04-25T01:39:33.436370+0000","last_became_peered":"2024-04-25T01:39:33.436370+0000","last_unstale":"2024-04-25T01:43:34.744955+0000","last_undegraded":"2024-04-25T01:43:34.744955+0000","last_fullsized":"2024-04-25T01:43:34.744955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:57:10.341738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"29'3","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.408859+0000","last_change":"2024-04-25T01:39:23.369400+0000","last_active":"2024-04-25T01:43:29.408859+0000","last_peered":"2024-04-25T01:43:29.408859+0000","last_clean":"2024-04-25T01:43:29.408859+0000","last_became_active":"2024-04-25T01:39:23.368726+0000","last_became_peered":"2024-04-25T01:39:23.368726+0000","last_unstale":"2024-04-25T01:43:29.408859+0000","last_undegraded":"2024-04-25T01:43:29.408859+0000","last_fullsized":"2024-04-25T01:43:29.408859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:35:42.971179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"30'177","reported_seq":211,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.894898+0000","last_change":"2024-04-25T01:39:24.403873+0000","last_active":"2024-04-25T01:43:46.894898+0000","last_peered":"2024-04-25T01:43:46.894898+0000","last_clean":"2024-04-25T01:43:46.894898+0000","last_became_active":"2024-04-25T01:39:24.403623+0000","last_became_peered":"2024-04-25T01:39:24.403623+0000","last_unstale":"2024-04-25T01:43:46.894898+0000","last_undegraded":"2024-04-25T01:43:46.894898+0000","last_fullsized":"2024-04-25T01:43:46.894898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:49.360933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.402853+0000","last_change":"2024-04-25T01:39:32.430985+0000","last_active":"2024-04-25T01:43:29.402853+0000","last_peered":"2024-04-25T01:43:29.402853+0000","last_clean":"2024-04-25T01:43:29.402853+0000","last_became_active":"2024-04-25T01:39:32.430617+0000","last_became_peered":"2024-04-25T01:39:32.430617+0000","last_unstale":"2024-04-25T01:43:29.402853+0000","last_undegraded":"2024-04-25T01:43:29.402853+0000","last_fullsized":"2024-04-25T01:43:29.402853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:13.938619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"30'163","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.712918+0000","last_change":"2024-04-25T01:39:33.444043+0000","last_active":"2024-04-25T01:43:34.712918+0000","last_peered":"2024-04-25T01:43:34.712918+0000","last_clean":"2024-04-25T01:43:34.712918+0000","last_became_active":"2024-04-25T01:39:33.443737+0000","last_became_peered":"2024-04-25T01:39:33.443737+0000","last_unstale":"2024-04-25T01:43:34.712918+0000","last_undegraded":"2024-04-25T01:43:34.712918+0000","last_fullsized":"2024-04-25T01:43:34.712918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:02:50.401910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"29'4","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.398875+0000","last_change":"2024-04-25T01:39:23.377963+0000","last_active":"2024-04-25T01:43:29.398875+0000","last_peered":"2024-04-25T01:43:29.398875+0000","last_clean":"2024-04-25T01:43:29.398875+0000","last_became_active":"2024-04-25T01:39:23.377402+0000","last_became_peered":"2024-04-25T01:39:23.377402+0000","last_unstale":"2024-04-25T01:43:29.398875+0000","last_undegraded":"2024-04-25T01:43:29.398875+0000","last_fullsized":"2024-04-25T01:43:29.398875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:15.873450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"30'160","reported_seq":193,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.895882+0000","last_change":"2024-04-25T01:39:24.394512+0000","last_active":"2024-04-25T01:43:46.895882+0000","last_peered":"2024-04-25T01:43:46.895882+0000","last_clean":"2024-04-25T01:43:46.895882+0000","last_became_active":"2024-04-25T01:39:24.393954+0000","last_became_peered":"2024-04-25T01:39:24.393954+0000","last_unstale":"2024-04-25T01:43:46.895882+0000","last_undegraded":"2024-04-25T01:43:46.895882+0000","last_fullsized":"2024-04-25T01:43:46.895882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:30.534400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1806","reported_seq":1835,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:35.171137+0000","last_change":"2024-04-25T01:39:32.428198+0000","last_active":"2024-04-25T01:43:35.171137+0000","last_peered":"2024-04-25T01:43:35.171137+0000","last_clean":"2024-04-25T01:43:35.171137+0000","last_became_active":"2024-04-25T01:39:32.427955+0000","last_became_peered":"2024-04-25T01:39:32.427955+0000","last_unstale":"2024-04-25T01:43:35.171137+0000","last_undegraded":"2024-04-25T01:43:35.171137+0000","last_fullsized":"2024-04-25T01:43:35.171137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1806,"log_dups_size":0,"ondisk_log_size":1806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:07.684150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3764872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":3663,"num_write":1802,"num_write_kb":5410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"30'173","reported_seq":198,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.693724+0000","last_change":"2024-04-25T01:39:33.439854+0000","last_active":"2024-04-25T01:43:34.693724+0000","last_peered":"2024-04-25T01:43:34.693724+0000","last_clean":"2024-04-25T01:43:34.693724+0000","last_became_active":"2024-04-25T01:39:33.439555+0000","last_became_peered":"2024-04-25T01:39:33.439555+0000","last_unstale":"2024-04-25T01:43:34.693724+0000","last_undegraded":"2024-04-25T01:43:34.693724+0000","last_fullsized":"2024-04-25T01:43:34.693724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:50.250748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.397933+0000","last_change":"2024-04-25T01:39:23.377093+0000","last_active":"2024-04-25T01:43:29.397933+0000","last_peered":"2024-04-25T01:43:29.397933+0000","last_clean":"2024-04-25T01:43:29.397933+0000","last_became_active":"2024-04-25T01:39:23.376744+0000","last_became_peered":"2024-04-25T01:39:23.376744+0000","last_unstale":"2024-04-25T01:43:29.397933+0000","last_undegraded":"2024-04-25T01:43:29.397933+0000","last_fullsized":"2024-04-25T01:43:29.397933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:43.529618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"30'198","reported_seq":231,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.898863+0000","last_change":"2024-04-25T01:39:24.393293+0000","last_active":"2024-04-25T01:43:46.898863+0000","last_peered":"2024-04-25T01:43:46.898863+0000","last_clean":"2024-04-25T01:43:46.898863+0000","last_became_active":"2024-04-25T01:39:24.393005+0000","last_became_peered":"2024-04-25T01:39:24.393005+0000","last_unstale":"2024-04-25T01:43:46.898863+0000","last_undegraded":"2024-04-25T01:43:46.898863+0000","last_fullsized":"2024-04-25T01:43:46.898863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:32.070747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'4","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403096+0000","last_change":"2024-04-25T01:39:32.428956+0000","last_active":"2024-04-25T01:43:29.403096+0000","last_peered":"2024-04-25T01:43:29.403096+0000","last_clean":"2024-04-25T01:43:29.403096+0000","last_became_active":"2024-04-25T01:39:32.428705+0000","last_became_peered":"2024-04-25T01:39:32.428705+0000","last_unstale":"2024-04-25T01:43:29.403096+0000","last_undegraded":"2024-04-25T01:43:29.403096+0000","last_fullsized":"2024-04-25T01:43:29.403096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:06:22.998986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"30'179","reported_seq":204,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.750752+0000","last_change":"2024-04-25T01:39:33.446571+0000","last_active":"2024-04-25T01:43:34.750752+0000","last_peered":"2024-04-25T01:43:34.750752+0000","last_clean":"2024-04-25T01:43:34.750752+0000","last_became_active":"2024-04-25T01:39:33.446234+0000","last_became_peered":"2024-04-25T01:39:33.446234+0000","last_unstale":"2024-04-25T01:43:34.750752+0000","last_undegraded":"2024-04-25T01:43:34.750752+0000","last_fullsized":"2024-04-25T01:43:34.750752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:12.742092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"30'156","reported_seq":190,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.887578+0000","last_change":"2024-04-25T01:39:24.398859+0000","last_active":"2024-04-25T01:43:46.887578+0000","last_peered":"2024-04-25T01:43:46.887578+0000","last_clean":"2024-04-25T01:43:46.887578+0000","last_became_active":"2024-04-25T01:39:24.398618+0000","last_became_peered":"2024-04-25T01:39:24.398618+0000","last_unstale":"2024-04-25T01:43:46.887578+0000","last_undegraded":"2024-04-25T01:43:46.887578+0000","last_fullsized":"2024-04-25T01:43:46.887578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:15.278376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'5","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.397841+0000","last_change":"2024-04-25T01:39:23.377717+0000","last_active":"2024-04-25T01:43:29.397841+0000","last_peered":"2024-04-25T01:43:29.397841+0000","last_clean":"2024-04-25T01:43:29.397841+0000","last_became_active":"2024-04-25T01:39:23.377291+0000","last_became_peered":"2024-04-25T01:39:23.377291+0000","last_unstale":"2024-04-25T01:43:29.397841+0000","last_undegraded":"2024-04-25T01:43:29.397841+0000","last_fullsized":"2024-04-25T01:43:29.397841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:06.402745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403630+0000","last_change":"2024-04-25T01:39:32.426840+0000","last_active":"2024-04-25T01:43:29.403630+0000","last_peered":"2024-04-25T01:43:29.403630+0000","last_clean":"2024-04-25T01:43:29.403630+0000","last_became_active":"2024-04-25T01:39:32.426529+0000","last_became_peered":"2024-04-25T01:39:32.426529+0000","last_unstale":"2024-04-25T01:43:29.403630+0000","last_undegraded":"2024-04-25T01:43:29.403630+0000","last_fullsized":"2024-04-25T01:43:29.403630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:57.097685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"30'193","reported_seq":218,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.726718+0000","last_change":"2024-04-25T01:39:33.437767+0000","last_active":"2024-04-25T01:43:34.726718+0000","last_peered":"2024-04-25T01:43:34.726718+0000","last_clean":"2024-04-25T01:43:34.726718+0000","last_became_active":"2024-04-25T01:39:33.437483+0000","last_became_peered":"2024-04-25T01:39:33.437483+0000","last_unstale":"2024-04-25T01:43:34.726718+0000","last_undegraded":"2024-04-25T01:43:34.726718+0000","last_fullsized":"2024-04-25T01:43:34.726718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:44.321779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"30'164","reported_seq":197,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.877665+0000","last_change":"2024-04-25T01:39:24.387100+0000","last_active":"2024-04-25T01:43:46.877665+0000","last_peered":"2024-04-25T01:43:46.877665+0000","last_clean":"2024-04-25T01:43:46.877665+0000","last_became_active":"2024-04-25T01:39:24.386782+0000","last_became_peered":"2024-04-25T01:39:24.386782+0000","last_unstale":"2024-04-25T01:43:46.877665+0000","last_undegraded":"2024-04-25T01:43:46.877665+0000","last_fullsized":"2024-04-25T01:43:46.877665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:48.789139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.402653+0000","last_change":"2024-04-25T01:39:23.368446+0000","last_active":"2024-04-25T01:43:29.402653+0000","last_peered":"2024-04-25T01:43:29.402653+0000","last_clean":"2024-04-25T01:43:29.402653+0000","last_became_active":"2024-04-25T01:39:23.368183+0000","last_became_peered":"2024-04-25T01:39:23.368183+0000","last_unstale":"2024-04-25T01:43:29.402653+0000","last_undegraded":"2024-04-25T01:43:29.402653+0000","last_fullsized":"2024-04-25T01:43:29.402653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:13.738756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403500+0000","last_change":"2024-04-25T01:39:32.427589+0000","last_active":"2024-04-25T01:43:29.403500+0000","last_peered":"2024-04-25T01:43:29.403500+0000","last_clean":"2024-04-25T01:43:29.403500+0000","last_became_active":"2024-04-25T01:39:32.427328+0000","last_became_peered":"2024-04-25T01:39:32.427328+0000","last_unstale":"2024-04-25T01:43:29.403500+0000","last_undegraded":"2024-04-25T01:43:29.403500+0000","last_fullsized":"2024-04-25T01:43:29.403500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:12.328303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"30'191","reported_seq":216,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.768647+0000","last_change":"2024-04-25T01:39:33.447634+0000","last_active":"2024-04-25T01:43:34.768647+0000","last_peered":"2024-04-25T01:43:34.768647+0000","last_clean":"2024-04-25T01:43:34.768647+0000","last_became_active":"2024-04-25T01:39:33.445908+0000","last_became_peered":"2024-04-25T01:39:33.445908+0000","last_unstale":"2024-04-25T01:43:34.768647+0000","last_undegraded":"2024-04-25T01:43:34.768647+0000","last_fullsized":"2024-04-25T01:43:34.768647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:13.586396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"30'170","reported_seq":204,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.880762+0000","last_change":"2024-04-25T01:39:24.373600+0000","last_active":"2024-04-25T01:43:46.880762+0000","last_peered":"2024-04-25T01:43:46.880762+0000","last_clean":"2024-04-25T01:43:46.880762+0000","last_became_active":"2024-04-25T01:39:24.373311+0000","last_became_peered":"2024-04-25T01:39:24.373311+0000","last_unstale":"2024-04-25T01:43:46.880762+0000","last_undegraded":"2024-04-25T01:43:46.880762+0000","last_fullsized":"2024-04-25T01:43:46.880762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:46.338959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.402749+0000","last_change":"2024-04-25T01:39:23.377103+0000","last_active":"2024-04-25T01:43:29.402749+0000","last_peered":"2024-04-25T01:43:29.402749+0000","last_clean":"2024-04-25T01:43:29.402749+0000","last_became_active":"2024-04-25T01:39:23.376826+0000","last_became_peered":"2024-04-25T01:39:23.376826+0000","last_unstale":"2024-04-25T01:43:29.402749+0000","last_undegraded":"2024-04-25T01:43:29.402749+0000","last_fullsized":"2024-04-25T01:43:29.402749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:46.663754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.404054+0000","last_change":"2024-04-25T01:39:32.426839+0000","last_active":"2024-04-25T01:43:29.404054+0000","last_peered":"2024-04-25T01:43:29.404054+0000","last_clean":"2024-04-25T01:43:29.404054+0000","last_became_active":"2024-04-25T01:39:32.426545+0000","last_became_peered":"2024-04-25T01:39:32.426545+0000","last_unstale":"2024-04-25T01:43:29.404054+0000","last_undegraded":"2024-04-25T01:43:29.404054+0000","last_fullsized":"2024-04-25T01:43:29.404054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:22.161839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"30'171","reported_seq":196,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.686031+0000","last_change":"2024-04-25T01:39:33.444616+0000","last_active":"2024-04-25T01:43:34.686031+0000","last_peered":"2024-04-25T01:43:34.686031+0000","last_clean":"2024-04-25T01:43:34.686031+0000","last_became_active":"2024-04-25T01:39:33.444350+0000","last_became_peered":"2024-04-25T01:39:33.444350+0000","last_unstale":"2024-04-25T01:43:34.686031+0000","last_undegraded":"2024-04-25T01:43:34.686031+0000","last_fullsized":"2024-04-25T01:43:34.686031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:47:15.686320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"30'147","reported_seq":181,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.868654+0000","last_change":"2024-04-25T01:39:24.386969+0000","last_active":"2024-04-25T01:43:46.868654+0000","last_peered":"2024-04-25T01:43:46.868654+0000","last_clean":"2024-04-25T01:43:46.868654+0000","last_became_active":"2024-04-25T01:39:24.386376+0000","last_became_peered":"2024-04-25T01:39:24.386376+0000","last_unstale":"2024-04-25T01:43:46.868654+0000","last_undegraded":"2024-04-25T01:43:46.868654+0000","last_fullsized":"2024-04-25T01:43:46.868654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:13:31.585462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.397503+0000","last_change":"2024-04-25T01:39:23.378993+0000","last_active":"2024-04-25T01:43:29.397503+0000","last_peered":"2024-04-25T01:43:29.397503+0000","last_clean":"2024-04-25T01:43:29.397503+0000","last_became_active":"2024-04-25T01:39:23.376908+0000","last_became_peered":"2024-04-25T01:39:23.376908+0000","last_unstale":"2024-04-25T01:43:29.397503+0000","last_undegraded":"2024-04-25T01:43:29.397503+0000","last_fullsized":"2024-04-25T01:43:29.397503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:13:18.370559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.424880+0000","last_change":"2024-04-25T01:39:32.433597+0000","last_active":"2024-04-25T01:43:32.424880+0000","last_peered":"2024-04-25T01:43:32.424880+0000","last_clean":"2024-04-25T01:43:32.424880+0000","last_became_active":"2024-04-25T01:39:32.433307+0000","last_became_peered":"2024-04-25T01:39:32.433307+0000","last_unstale":"2024-04-25T01:43:32.424880+0000","last_undegraded":"2024-04-25T01:43:32.424880+0000","last_fullsized":"2024-04-25T01:43:32.424880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:20.784385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"30'175","reported_seq":201,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.754290+0000","last_change":"2024-04-25T01:39:33.427297+0000","last_active":"2024-04-25T01:43:34.754290+0000","last_peered":"2024-04-25T01:43:34.754290+0000","last_clean":"2024-04-25T01:43:34.754290+0000","last_became_active":"2024-04-25T01:39:33.426132+0000","last_became_peered":"2024-04-25T01:39:33.426132+0000","last_unstale":"2024-04-25T01:43:34.754290+0000","last_undegraded":"2024-04-25T01:43:34.754290+0000","last_fullsized":"2024-04-25T01:43:34.754290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:04.147341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"30'175","reported_seq":209,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.879746+0000","last_change":"2024-04-25T01:39:24.393003+0000","last_active":"2024-04-25T01:43:46.879746+0000","last_peered":"2024-04-25T01:43:46.879746+0000","last_clean":"2024-04-25T01:43:46.879746+0000","last_became_active":"2024-04-25T01:39:24.392209+0000","last_became_peered":"2024-04-25T01:39:24.392209+0000","last_unstale":"2024-04-25T01:43:46.879746+0000","last_undegraded":"2024-04-25T01:43:46.879746+0000","last_fullsized":"2024-04-25T01:43:46.879746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:44:58.432859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"30'3","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:35.181348+0000","last_change":"2024-04-25T01:39:23.379804+0000","last_active":"2024-04-25T01:43:35.181348+0000","last_peered":"2024-04-25T01:43:35.181348+0000","last_clean":"2024-04-25T01:43:35.181348+0000","last_became_active":"2024-04-25T01:39:23.379430+0000","last_became_peered":"2024-04-25T01:39:23.379430+0000","last_unstale":"2024-04-25T01:43:35.181348+0000","last_undegraded":"2024-04-25T01:43:35.181348+0000","last_fullsized":"2024-04-25T01:43:35.181348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:42:23.254767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.426420+0000","last_change":"2024-04-25T01:39:32.432763+0000","last_active":"2024-04-25T01:43:32.426420+0000","last_peered":"2024-04-25T01:43:32.426420+0000","last_clean":"2024-04-25T01:43:32.426420+0000","last_became_active":"2024-04-25T01:39:32.432482+0000","last_became_peered":"2024-04-25T01:39:32.432482+0000","last_unstale":"2024-04-25T01:43:32.426420+0000","last_undegraded":"2024-04-25T01:43:32.426420+0000","last_fullsized":"2024-04-25T01:43:32.426420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:04.848726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"30'176","reported_seq":202,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.767725+0000","last_change":"2024-04-25T01:39:33.445800+0000","last_active":"2024-04-25T01:43:34.767725+0000","last_peered":"2024-04-25T01:43:34.767725+0000","last_clean":"2024-04-25T01:43:34.767725+0000","last_became_active":"2024-04-25T01:39:33.445500+0000","last_became_peered":"2024-04-25T01:39:33.445500+0000","last_unstale":"2024-04-25T01:43:34.767725+0000","last_undegraded":"2024-04-25T01:43:34.767725+0000","last_fullsized":"2024-04-25T01:43:34.767725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:06:36.800043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"30'154","reported_seq":173,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.886331+0000","last_change":"2024-04-25T01:40:06.055331+0000","last_active":"2024-04-25T01:43:46.886331+0000","last_peered":"2024-04-25T01:43:46.886331+0000","last_clean":"2024-04-25T01:43:46.886331+0000","last_became_active":"2024-04-25T01:40:06.055084+0000","last_became_peered":"2024-04-25T01:40:06.055084+0000","last_unstale":"2024-04-25T01:43:46.886331+0000","last_undegraded":"2024-04-25T01:43:46.886331+0000","last_fullsized":"2024-04-25T01:43:46.886331+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:15:15.409515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"30'29","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:35.407199+0000","last_change":"2024-04-25T01:39:23.377687+0000","last_active":"2024-04-25T01:43:35.407199+0000","last_peered":"2024-04-25T01:43:35.407199+0000","last_clean":"2024-04-25T01:43:35.407199+0000","last_became_active":"2024-04-25T01:39:23.377372+0000","last_became_peered":"2024-04-25T01:39:23.377372+0000","last_unstale":"2024-04-25T01:43:35.407199+0000","last_undegraded":"2024-04-25T01:43:35.407199+0000","last_fullsized":"2024-04-25T01:43:35.407199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:51.983659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":54,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.407473+0000","last_change":"2024-04-25T01:39:32.430816+0000","last_active":"2024-04-25T01:43:29.407473+0000","last_peered":"2024-04-25T01:43:29.407473+0000","last_clean":"2024-04-25T01:43:29.407473+0000","last_became_active":"2024-04-25T01:39:32.430537+0000","last_became_peered":"2024-04-25T01:39:32.430537+0000","last_unstale":"2024-04-25T01:43:29.407473+0000","last_undegraded":"2024-04-25T01:43:29.407473+0000","last_fullsized":"2024-04-25T01:43:29.407473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:58.939453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"30'198","reported_seq":224,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.725529+0000","last_change":"2024-04-25T01:39:33.440287+0000","last_active":"2024-04-25T01:43:34.725529+0000","last_peered":"2024-04-25T01:43:34.725529+0000","last_clean":"2024-04-25T01:43:34.725529+0000","last_became_active":"2024-04-25T01:39:33.439796+0000","last_became_peered":"2024-04-25T01:39:33.439796+0000","last_unstale":"2024-04-25T01:43:34.725529+0000","last_undegraded":"2024-04-25T01:43:34.725529+0000","last_fullsized":"2024-04-25T01:43:34.725529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:08.515401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"30'173","reported_seq":207,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.867380+0000","last_change":"2024-04-25T01:39:24.376933+0000","last_active":"2024-04-25T01:43:46.867380+0000","last_peered":"2024-04-25T01:43:46.867380+0000","last_clean":"2024-04-25T01:43:46.867380+0000","last_became_active":"2024-04-25T01:39:24.376612+0000","last_became_peered":"2024-04-25T01:39:24.376612+0000","last_unstale":"2024-04-25T01:43:46.867380+0000","last_undegraded":"2024-04-25T01:43:46.867380+0000","last_fullsized":"2024-04-25T01:43:46.867380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:56:55.534200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.399082+0000","last_change":"2024-04-25T01:39:23.378190+0000","last_active":"2024-04-25T01:43:29.399082+0000","last_peered":"2024-04-25T01:43:29.399082+0000","last_clean":"2024-04-25T01:43:29.399082+0000","last_became_active":"2024-04-25T01:39:23.377677+0000","last_became_peered":"2024-04-25T01:39:23.377677+0000","last_unstale":"2024-04-25T01:43:29.399082+0000","last_undegraded":"2024-04-25T01:43:29.399082+0000","last_fullsized":"2024-04-25T01:43:29.399082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:09.516058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403847+0000","last_change":"2024-04-25T01:39:32.431542+0000","last_active":"2024-04-25T01:43:29.403847+0000","last_peered":"2024-04-25T01:43:29.403847+0000","last_clean":"2024-04-25T01:43:29.403847+0000","last_became_active":"2024-04-25T01:39:32.431253+0000","last_became_peered":"2024-04-25T01:39:32.431253+0000","last_unstale":"2024-04-25T01:43:29.403847+0000","last_undegraded":"2024-04-25T01:43:29.403847+0000","last_fullsized":"2024-04-25T01:43:29.403847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:36.723239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"30'188","reported_seq":214,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.770510+0000","last_change":"2024-04-25T01:39:33.448529+0000","last_active":"2024-04-25T01:43:34.770510+0000","last_peered":"2024-04-25T01:43:34.770510+0000","last_clean":"2024-04-25T01:43:34.770510+0000","last_became_active":"2024-04-25T01:39:33.448266+0000","last_became_peered":"2024-04-25T01:39:33.448266+0000","last_unstale":"2024-04-25T01:43:34.770510+0000","last_undegraded":"2024-04-25T01:43:34.770510+0000","last_fullsized":"2024-04-25T01:43:34.770510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:18.788470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"30'155","reported_seq":189,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.897294+0000","last_change":"2024-04-25T01:39:24.390844+0000","last_active":"2024-04-25T01:43:46.897294+0000","last_peered":"2024-04-25T01:43:46.897294+0000","last_clean":"2024-04-25T01:43:46.897294+0000","last_became_active":"2024-04-25T01:39:24.390543+0000","last_became_peered":"2024-04-25T01:39:24.390543+0000","last_unstale":"2024-04-25T01:43:46.897294+0000","last_undegraded":"2024-04-25T01:43:46.897294+0000","last_fullsized":"2024-04-25T01:43:46.897294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:01:03.804058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403980+0000","last_change":"2024-04-25T01:39:23.368562+0000","last_active":"2024-04-25T01:43:29.403980+0000","last_peered":"2024-04-25T01:43:29.403980+0000","last_clean":"2024-04-25T01:43:29.403980+0000","last_became_active":"2024-04-25T01:39:23.368272+0000","last_became_peered":"2024-04-25T01:39:23.368272+0000","last_unstale":"2024-04-25T01:43:29.403980+0000","last_undegraded":"2024-04-25T01:43:29.403980+0000","last_fullsized":"2024-04-25T01:43:29.403980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:15.464993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.402026+0000","last_change":"2024-04-25T01:39:32.430196+0000","last_active":"2024-04-25T01:43:29.402026+0000","last_peered":"2024-04-25T01:43:29.402026+0000","last_clean":"2024-04-25T01:43:29.402026+0000","last_became_active":"2024-04-25T01:39:32.429759+0000","last_became_peered":"2024-04-25T01:39:32.429759+0000","last_unstale":"2024-04-25T01:43:29.402026+0000","last_undegraded":"2024-04-25T01:43:29.402026+0000","last_fullsized":"2024-04-25T01:43:29.402026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:58:09.299194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"30'171","reported_seq":197,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.746690+0000","last_change":"2024-04-25T01:39:33.440935+0000","last_active":"2024-04-25T01:43:34.746690+0000","last_peered":"2024-04-25T01:43:34.746690+0000","last_clean":"2024-04-25T01:43:34.746690+0000","last_became_active":"2024-04-25T01:39:33.439344+0000","last_became_peered":"2024-04-25T01:39:33.439344+0000","last_unstale":"2024-04-25T01:43:34.746690+0000","last_undegraded":"2024-04-25T01:43:34.746690+0000","last_fullsized":"2024-04-25T01:43:34.746690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:23.928991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"30'179","reported_seq":213,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.876122+0000","last_change":"2024-04-25T01:39:24.389203+0000","last_active":"2024-04-25T01:43:46.876122+0000","last_peered":"2024-04-25T01:43:46.876122+0000","last_clean":"2024-04-25T01:43:46.876122+0000","last_became_active":"2024-04-25T01:39:24.388306+0000","last_became_peered":"2024-04-25T01:39:24.388306+0000","last_unstale":"2024-04-25T01:43:46.876122+0000","last_undegraded":"2024-04-25T01:43:46.876122+0000","last_fullsized":"2024-04-25T01:43:46.876122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:59:33.951161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.406645+0000","last_change":"2024-04-25T01:39:23.375729+0000","last_active":"2024-04-25T01:43:29.406645+0000","last_peered":"2024-04-25T01:43:29.406645+0000","last_clean":"2024-04-25T01:43:29.406645+0000","last_became_active":"2024-04-25T01:39:23.375488+0000","last_became_peered":"2024-04-25T01:39:23.375488+0000","last_unstale":"2024-04-25T01:43:29.406645+0000","last_undegraded":"2024-04-25T01:43:29.406645+0000","last_fullsized":"2024-04-25T01:43:29.406645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:00.039083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403502+0000","last_change":"2024-04-25T01:39:32.427586+0000","last_active":"2024-04-25T01:43:29.403502+0000","last_peered":"2024-04-25T01:43:29.403502+0000","last_clean":"2024-04-25T01:43:29.403502+0000","last_became_active":"2024-04-25T01:39:32.427282+0000","last_became_peered":"2024-04-25T01:39:32.427282+0000","last_unstale":"2024-04-25T01:43:29.403502+0000","last_undegraded":"2024-04-25T01:43:29.403502+0000","last_fullsized":"2024-04-25T01:43:29.403502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:35.956279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'200","reported_seq":225,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.753861+0000","last_change":"2024-04-25T01:39:33.438949+0000","last_active":"2024-04-25T01:43:34.753861+0000","last_peered":"2024-04-25T01:43:34.753861+0000","last_clean":"2024-04-25T01:43:34.753861+0000","last_became_active":"2024-04-25T01:39:33.438669+0000","last_became_peered":"2024-04-25T01:39:33.438669+0000","last_unstale":"2024-04-25T01:43:34.753861+0000","last_undegraded":"2024-04-25T01:43:34.753861+0000","last_fullsized":"2024-04-25T01:43:34.753861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:07.849060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"30'162","reported_seq":196,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.873816+0000","last_change":"2024-04-25T01:39:24.377438+0000","last_active":"2024-04-25T01:43:46.873816+0000","last_peered":"2024-04-25T01:43:46.873816+0000","last_clean":"2024-04-25T01:43:46.873816+0000","last_became_active":"2024-04-25T01:39:24.377146+0000","last_became_peered":"2024-04-25T01:39:24.377146+0000","last_unstale":"2024-04-25T01:43:46.873816+0000","last_undegraded":"2024-04-25T01:43:46.873816+0000","last_fullsized":"2024-04-25T01:43:46.873816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:54:17.698561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":327680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"30'5","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:31.449181+0000","last_change":"2024-04-25T01:39:23.371019+0000","last_active":"2024-04-25T01:43:31.449181+0000","last_peered":"2024-04-25T01:43:31.449181+0000","last_clean":"2024-04-25T01:43:31.449181+0000","last_became_active":"2024-04-25T01:39:23.370727+0000","last_became_peered":"2024-04-25T01:39:23.370727+0000","last_unstale":"2024-04-25T01:43:31.449181+0000","last_undegraded":"2024-04-25T01:43:31.449181+0000","last_fullsized":"2024-04-25T01:43:31.449181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:10.714475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'3","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.435640+0000","last_change":"2024-04-25T01:39:32.431610+0000","last_active":"2024-04-25T01:43:32.435640+0000","last_peered":"2024-04-25T01:43:32.435640+0000","last_clean":"2024-04-25T01:43:32.435640+0000","last_became_active":"2024-04-25T01:39:32.431335+0000","last_became_peered":"2024-04-25T01:39:32.431335+0000","last_unstale":"2024-04-25T01:43:32.435640+0000","last_undegraded":"2024-04-25T01:43:32.435640+0000","last_fullsized":"2024-04-25T01:43:32.435640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:54.882078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"30'173","reported_seq":198,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.747273+0000","last_change":"2024-04-25T01:39:33.438896+0000","last_active":"2024-04-25T01:43:34.747273+0000","last_peered":"2024-04-25T01:43:34.747273+0000","last_clean":"2024-04-25T01:43:34.747273+0000","last_became_active":"2024-04-25T01:39:33.438622+0000","last_became_peered":"2024-04-25T01:39:33.438622+0000","last_unstale":"2024-04-25T01:43:34.747273+0000","last_undegraded":"2024-04-25T01:43:34.747273+0000","last_fullsized":"2024-04-25T01:43:34.747273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:40:47.408809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"30'157","reported_seq":191,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.873335+0000","last_change":"2024-04-25T01:39:24.391366+0000","last_active":"2024-04-25T01:43:46.873335+0000","last_peered":"2024-04-25T01:43:46.873335+0000","last_clean":"2024-04-25T01:43:46.873335+0000","last_became_active":"2024-04-25T01:39:24.391093+0000","last_became_peered":"2024-04-25T01:39:24.391093+0000","last_unstale":"2024-04-25T01:43:46.873335+0000","last_undegraded":"2024-04-25T01:43:46.873335+0000","last_fullsized":"2024-04-25T01:43:46.873335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:10.906935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":311296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.397493+0000","last_change":"2024-04-25T01:39:23.379767+0000","last_active":"2024-04-25T01:43:29.397493+0000","last_peered":"2024-04-25T01:43:29.397493+0000","last_clean":"2024-04-25T01:43:29.397493+0000","last_became_active":"2024-04-25T01:39:23.379294+0000","last_became_peered":"2024-04-25T01:39:23.379294+0000","last_unstale":"2024-04-25T01:43:29.397493+0000","last_undegraded":"2024-04-25T01:43:29.397493+0000","last_fullsized":"2024-04-25T01:43:29.397493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:36:37.823796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"30'25","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:35.399094+0000","last_change":"2024-04-25T01:39:32.429452+0000","last_active":"2024-04-25T01:43:35.399094+0000","last_peered":"2024-04-25T01:43:35.399094+0000","last_clean":"2024-04-25T01:43:35.399094+0000","last_became_active":"2024-04-25T01:39:32.429189+0000","last_became_peered":"2024-04-25T01:39:32.429189+0000","last_unstale":"2024-04-25T01:43:35.399094+0000","last_undegraded":"2024-04-25T01:43:35.399094+0000","last_fullsized":"2024-04-25T01:43:35.399094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:58:02.723851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"30'171","reported_seq":197,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.770009+0000","last_change":"2024-04-25T01:39:33.438945+0000","last_active":"2024-04-25T01:43:34.770009+0000","last_peered":"2024-04-25T01:43:34.770009+0000","last_clean":"2024-04-25T01:43:34.770009+0000","last_became_active":"2024-04-25T01:39:33.438233+0000","last_became_peered":"2024-04-25T01:39:33.438233+0000","last_unstale":"2024-04-25T01:43:34.770009+0000","last_undegraded":"2024-04-25T01:43:34.770009+0000","last_fullsized":"2024-04-25T01:43:34.770009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:50.545311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"30'209","reported_seq":243,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.896362+0000","last_change":"2024-04-25T01:39:24.401208+0000","last_active":"2024-04-25T01:43:46.896362+0000","last_peered":"2024-04-25T01:43:46.896362+0000","last_clean":"2024-04-25T01:43:46.896362+0000","last_became_active":"2024-04-25T01:39:24.400502+0000","last_became_peered":"2024-04-25T01:39:24.400502+0000","last_unstale":"2024-04-25T01:43:46.896362+0000","last_undegraded":"2024-04-25T01:43:46.896362+0000","last_fullsized":"2024-04-25T01:43:46.896362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:55:09.076617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403950+0000","last_change":"2024-04-25T01:39:23.367826+0000","last_active":"2024-04-25T01:43:29.403950+0000","last_peered":"2024-04-25T01:43:29.403950+0000","last_clean":"2024-04-25T01:43:29.403950+0000","last_became_active":"2024-04-25T01:39:23.367520+0000","last_became_peered":"2024-04-25T01:39:23.367520+0000","last_unstale":"2024-04-25T01:43:29.403950+0000","last_undegraded":"2024-04-25T01:43:29.403950+0000","last_fullsized":"2024-04-25T01:43:29.403950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:05.997166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":192,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.397641+0000","last_change":"2024-04-25T01:39:12.918495+0000","last_active":"2024-04-25T01:43:29.397641+0000","last_peered":"2024-04-25T01:43:29.397641+0000","last_clean":"2024-04-25T01:43:29.397641+0000","last_became_active":"2024-04-25T01:39:12.917330+0000","last_became_peered":"2024-04-25T01:39:12.917330+0000","last_unstale":"2024-04-25T01:43:29.397641+0000","last_undegraded":"2024-04-25T01:43:29.397641+0000","last_fullsized":"2024-04-25T01:43:29.397641+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:11.731178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:11.731178+0000","last_clean_scrub_stamp":"2024-04-25T01:39:11.731178+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:26:14.153244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.412547+0000","last_change":"2024-04-25T01:39:32.431797+0000","last_active":"2024-04-25T01:43:29.412547+0000","last_peered":"2024-04-25T01:43:29.412547+0000","last_clean":"2024-04-25T01:43:29.412547+0000","last_became_active":"2024-04-25T01:39:32.431523+0000","last_became_peered":"2024-04-25T01:39:32.431523+0000","last_unstale":"2024-04-25T01:43:29.412547+0000","last_undegraded":"2024-04-25T01:43:29.412547+0000","last_fullsized":"2024-04-25T01:43:29.412547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:45.752128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"30'174","reported_seq":199,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.741855+0000","last_change":"2024-04-25T01:39:33.440488+0000","last_active":"2024-04-25T01:43:34.741855+0000","last_peered":"2024-04-25T01:43:34.741855+0000","last_clean":"2024-04-25T01:43:34.741855+0000","last_became_active":"2024-04-25T01:39:33.440161+0000","last_became_peered":"2024-04-25T01:39:33.440161+0000","last_unstale":"2024-04-25T01:43:34.741855+0000","last_undegraded":"2024-04-25T01:43:34.741855+0000","last_fullsized":"2024-04-25T01:43:34.741855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:45.542876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"30'168","reported_seq":201,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.899419+0000","last_change":"2024-04-25T01:39:24.394350+0000","last_active":"2024-04-25T01:43:46.899419+0000","last_peered":"2024-04-25T01:43:46.899419+0000","last_clean":"2024-04-25T01:43:46.899419+0000","last_became_active":"2024-04-25T01:39:24.393235+0000","last_became_peered":"2024-04-25T01:39:24.393235+0000","last_unstale":"2024-04-25T01:43:46.899419+0000","last_undegraded":"2024-04-25T01:43:46.899419+0000","last_fullsized":"2024-04-25T01:43:46.899419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:00:48.588700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.397643+0000","last_change":"2024-04-25T01:39:23.368352+0000","last_active":"2024-04-25T01:43:29.397643+0000","last_peered":"2024-04-25T01:43:29.397643+0000","last_clean":"2024-04-25T01:43:29.397643+0000","last_became_active":"2024-04-25T01:39:23.368075+0000","last_became_peered":"2024-04-25T01:39:23.368075+0000","last_unstale":"2024-04-25T01:43:29.397643+0000","last_undegraded":"2024-04-25T01:43:29.397643+0000","last_fullsized":"2024-04-25T01:43:29.397643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:11.300091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.412211+0000","last_change":"2024-04-25T01:39:32.430007+0000","last_active":"2024-04-25T01:43:29.412211+0000","last_peered":"2024-04-25T01:43:29.412211+0000","last_clean":"2024-04-25T01:43:29.412211+0000","last_became_active":"2024-04-25T01:39:32.429721+0000","last_became_peered":"2024-04-25T01:39:32.429721+0000","last_unstale":"2024-04-25T01:43:29.412211+0000","last_undegraded":"2024-04-25T01:43:29.412211+0000","last_fullsized":"2024-04-25T01:43:29.412211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:47.409375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"30'171","reported_seq":196,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.755135+0000","last_change":"2024-04-25T01:39:33.447230+0000","last_active":"2024-04-25T01:43:34.755135+0000","last_peered":"2024-04-25T01:43:34.755135+0000","last_clean":"2024-04-25T01:43:34.755135+0000","last_became_active":"2024-04-25T01:39:33.446930+0000","last_became_peered":"2024-04-25T01:39:33.446930+0000","last_unstale":"2024-04-25T01:43:34.755135+0000","last_undegraded":"2024-04-25T01:43:34.755135+0000","last_fullsized":"2024-04-25T01:43:34.755135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:51:40.920560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'173","reported_seq":206,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.895588+0000","last_change":"2024-04-25T01:39:24.394286+0000","last_active":"2024-04-25T01:43:46.895588+0000","last_peered":"2024-04-25T01:43:46.895588+0000","last_clean":"2024-04-25T01:43:46.895588+0000","last_became_active":"2024-04-25T01:39:24.393558+0000","last_became_peered":"2024-04-25T01:39:24.393558+0000","last_unstale":"2024-04-25T01:43:46.895588+0000","last_undegraded":"2024-04-25T01:43:46.895588+0000","last_fullsized":"2024-04-25T01:43:46.895588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:59.100947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.404678+0000","last_change":"2024-04-25T01:39:23.370690+0000","last_active":"2024-04-25T01:43:29.404678+0000","last_peered":"2024-04-25T01:43:29.404678+0000","last_clean":"2024-04-25T01:43:29.404678+0000","last_became_active":"2024-04-25T01:39:23.370391+0000","last_became_peered":"2024-04-25T01:39:23.370391+0000","last_unstale":"2024-04-25T01:43:29.404678+0000","last_undegraded":"2024-04-25T01:43:29.404678+0000","last_fullsized":"2024-04-25T01:43:29.404678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:29.647636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"30'6","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.404958+0000","last_change":"2024-04-25T01:39:32.429412+0000","last_active":"2024-04-25T01:43:29.404958+0000","last_peered":"2024-04-25T01:43:29.404958+0000","last_clean":"2024-04-25T01:43:29.404958+0000","last_became_active":"2024-04-25T01:39:32.429143+0000","last_became_peered":"2024-04-25T01:39:32.429143+0000","last_unstale":"2024-04-25T01:43:29.404958+0000","last_undegraded":"2024-04-25T01:43:29.404958+0000","last_fullsized":"2024-04-25T01:43:29.404958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:53.637245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"30'173","reported_seq":198,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.766305+0000","last_change":"2024-04-25T01:39:33.437128+0000","last_active":"2024-04-25T01:43:34.766305+0000","last_peered":"2024-04-25T01:43:34.766305+0000","last_clean":"2024-04-25T01:43:34.766305+0000","last_became_active":"2024-04-25T01:39:33.436861+0000","last_became_peered":"2024-04-25T01:39:33.436861+0000","last_unstale":"2024-04-25T01:43:34.766305+0000","last_undegraded":"2024-04-25T01:43:34.766305+0000","last_fullsized":"2024-04-25T01:43:34.766305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:41.746373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"30'168","reported_seq":201,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.889452+0000","last_change":"2024-04-25T01:39:24.392170+0000","last_active":"2024-04-25T01:43:46.889452+0000","last_peered":"2024-04-25T01:43:46.889452+0000","last_clean":"2024-04-25T01:43:46.889452+0000","last_became_active":"2024-04-25T01:39:24.391811+0000","last_became_peered":"2024-04-25T01:39:24.391811+0000","last_unstale":"2024-04-25T01:43:46.889452+0000","last_undegraded":"2024-04-25T01:43:46.889452+0000","last_fullsized":"2024-04-25T01:43:46.889452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:32.859676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.398084+0000","last_change":"2024-04-25T01:39:23.369872+0000","last_active":"2024-04-25T01:43:29.398084+0000","last_peered":"2024-04-25T01:43:29.398084+0000","last_clean":"2024-04-25T01:43:29.398084+0000","last_became_active":"2024-04-25T01:39:23.369314+0000","last_became_peered":"2024-04-25T01:39:23.369314+0000","last_unstale":"2024-04-25T01:43:29.398084+0000","last_undegraded":"2024-04-25T01:43:29.398084+0000","last_fullsized":"2024-04-25T01:43:29.398084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:14.571148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.402389+0000","last_change":"2024-04-25T01:39:32.429664+0000","last_active":"2024-04-25T01:43:29.402389+0000","last_peered":"2024-04-25T01:43:29.402389+0000","last_clean":"2024-04-25T01:43:29.402389+0000","last_became_active":"2024-04-25T01:39:32.429358+0000","last_became_peered":"2024-04-25T01:39:32.429358+0000","last_unstale":"2024-04-25T01:43:29.402389+0000","last_undegraded":"2024-04-25T01:43:29.402389+0000","last_fullsized":"2024-04-25T01:43:29.402389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:57:10.913056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"30'178","reported_seq":203,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.682457+0000","last_change":"2024-04-25T01:39:33.440419+0000","last_active":"2024-04-25T01:43:34.682457+0000","last_peered":"2024-04-25T01:43:34.682457+0000","last_clean":"2024-04-25T01:43:34.682457+0000","last_became_active":"2024-04-25T01:39:33.440054+0000","last_became_peered":"2024-04-25T01:39:33.440054+0000","last_unstale":"2024-04-25T01:43:34.682457+0000","last_undegraded":"2024-04-25T01:43:34.682457+0000","last_fullsized":"2024-04-25T01:43:34.682457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:42.321235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"30'179","reported_seq":198,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.877749+0000","last_change":"2024-04-25T01:40:05.826359+0000","last_active":"2024-04-25T01:43:46.877749+0000","last_peered":"2024-04-25T01:43:46.877749+0000","last_clean":"2024-04-25T01:43:46.877749+0000","last_became_active":"2024-04-25T01:40:05.826076+0000","last_became_peered":"2024-04-25T01:40:05.826076+0000","last_unstale":"2024-04-25T01:43:46.877749+0000","last_undegraded":"2024-04-25T01:43:46.877749+0000","last_fullsized":"2024-04-25T01:43:46.877749+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:42:53.707094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.404466+0000","last_change":"2024-04-25T01:39:23.367322+0000","last_active":"2024-04-25T01:43:29.404466+0000","last_peered":"2024-04-25T01:43:29.404466+0000","last_clean":"2024-04-25T01:43:29.404466+0000","last_became_active":"2024-04-25T01:39:23.367054+0000","last_became_peered":"2024-04-25T01:39:23.367054+0000","last_unstale":"2024-04-25T01:43:29.404466+0000","last_undegraded":"2024-04-25T01:43:29.404466+0000","last_fullsized":"2024-04-25T01:43:29.404466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:10.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.402979+0000","last_change":"2024-04-25T01:39:32.426874+0000","last_active":"2024-04-25T01:43:29.402979+0000","last_peered":"2024-04-25T01:43:29.402979+0000","last_clean":"2024-04-25T01:43:29.402979+0000","last_became_active":"2024-04-25T01:39:32.426599+0000","last_became_peered":"2024-04-25T01:39:32.426599+0000","last_unstale":"2024-04-25T01:43:29.402979+0000","last_undegraded":"2024-04-25T01:43:29.402979+0000","last_fullsized":"2024-04-25T01:43:29.402979+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:27.672277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"30'164","reported_seq":189,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.722453+0000","last_change":"2024-04-25T01:39:33.428909+0000","last_active":"2024-04-25T01:43:34.722453+0000","last_peered":"2024-04-25T01:43:34.722453+0000","last_clean":"2024-04-25T01:43:34.722453+0000","last_became_active":"2024-04-25T01:39:33.428626+0000","last_became_peered":"2024-04-25T01:39:33.428626+0000","last_unstale":"2024-04-25T01:43:34.722453+0000","last_undegraded":"2024-04-25T01:43:34.722453+0000","last_fullsized":"2024-04-25T01:43:34.722453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:21.188264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'204","reported_seq":237,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.879392+0000","last_change":"2024-04-25T01:39:24.389946+0000","last_active":"2024-04-25T01:43:46.879392+0000","last_peered":"2024-04-25T01:43:46.879392+0000","last_clean":"2024-04-25T01:43:46.879392+0000","last_became_active":"2024-04-25T01:39:24.389656+0000","last_became_peered":"2024-04-25T01:39:24.389656+0000","last_unstale":"2024-04-25T01:43:46.879392+0000","last_undegraded":"2024-04-25T01:43:46.879392+0000","last_fullsized":"2024-04-25T01:43:46.879392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:55.943639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"30'9","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.397557+0000","last_change":"2024-04-25T01:39:23.373599+0000","last_active":"2024-04-25T01:43:29.397557+0000","last_peered":"2024-04-25T01:43:29.397557+0000","last_clean":"2024-04-25T01:43:29.397557+0000","last_became_active":"2024-04-25T01:39:23.373281+0000","last_became_peered":"2024-04-25T01:39:23.373281+0000","last_unstale":"2024-04-25T01:43:29.397557+0000","last_undegraded":"2024-04-25T01:43:29.397557+0000","last_fullsized":"2024-04-25T01:43:29.397557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:40.850925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403096+0000","last_change":"2024-04-25T01:39:32.427502+0000","last_active":"2024-04-25T01:43:29.403096+0000","last_peered":"2024-04-25T01:43:29.403096+0000","last_clean":"2024-04-25T01:43:29.403096+0000","last_became_active":"2024-04-25T01:39:32.426499+0000","last_became_peered":"2024-04-25T01:39:32.426499+0000","last_unstale":"2024-04-25T01:43:29.403096+0000","last_undegraded":"2024-04-25T01:43:29.403096+0000","last_fullsized":"2024-04-25T01:43:29.403096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:26.977416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"30'274","reported_seq":299,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.747979+0000","last_change":"2024-04-25T01:39:33.436901+0000","last_active":"2024-04-25T01:43:34.747979+0000","last_peered":"2024-04-25T01:43:34.747979+0000","last_clean":"2024-04-25T01:43:34.747979+0000","last_became_active":"2024-04-25T01:39:33.436001+0000","last_became_peered":"2024-04-25T01:39:33.436001+0000","last_unstale":"2024-04-25T01:43:34.747979+0000","last_undegraded":"2024-04-25T01:43:34.747979+0000","last_fullsized":"2024-04-25T01:43:34.747979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:34:41.678663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"30'176","reported_seq":209,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.874522+0000","last_change":"2024-04-25T01:39:24.394248+0000","last_active":"2024-04-25T01:43:46.874522+0000","last_peered":"2024-04-25T01:43:46.874522+0000","last_clean":"2024-04-25T01:43:46.874522+0000","last_became_active":"2024-04-25T01:39:24.393958+0000","last_became_peered":"2024-04-25T01:39:24.393958+0000","last_unstale":"2024-04-25T01:43:46.874522+0000","last_undegraded":"2024-04-25T01:43:46.874522+0000","last_fullsized":"2024-04-25T01:43:46.874522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:35.087577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.412806+0000","last_change":"2024-04-25T01:39:23.372939+0000","last_active":"2024-04-25T01:43:29.412806+0000","last_peered":"2024-04-25T01:43:29.412806+0000","last_clean":"2024-04-25T01:43:29.412806+0000","last_became_active":"2024-04-25T01:39:23.372648+0000","last_became_peered":"2024-04-25T01:39:23.372648+0000","last_unstale":"2024-04-25T01:43:29.412806+0000","last_undegraded":"2024-04-25T01:43:29.412806+0000","last_fullsized":"2024-04-25T01:43:29.412806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:02:13.283096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'1","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.408083+0000","last_change":"2024-04-25T01:39:32.432218+0000","last_active":"2024-04-25T01:43:29.408083+0000","last_peered":"2024-04-25T01:43:29.408083+0000","last_clean":"2024-04-25T01:43:29.408083+0000","last_became_active":"2024-04-25T01:39:32.431938+0000","last_became_peered":"2024-04-25T01:39:32.431938+0000","last_unstale":"2024-04-25T01:43:29.408083+0000","last_undegraded":"2024-04-25T01:43:29.408083+0000","last_fullsized":"2024-04-25T01:43:29.408083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:56:15.053817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"30'185","reported_seq":210,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.742694+0000","last_change":"2024-04-25T01:39:33.441342+0000","last_active":"2024-04-25T01:43:34.742694+0000","last_peered":"2024-04-25T01:43:34.742694+0000","last_clean":"2024-04-25T01:43:34.742694+0000","last_became_active":"2024-04-25T01:39:33.441074+0000","last_became_peered":"2024-04-25T01:39:33.441074+0000","last_unstale":"2024-04-25T01:43:34.742694+0000","last_undegraded":"2024-04-25T01:43:34.742694+0000","last_fullsized":"2024-04-25T01:43:34.742694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:22:43.000112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'214","reported_seq":247,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.879311+0000","last_change":"2024-04-25T01:39:24.390114+0000","last_active":"2024-04-25T01:43:46.879311+0000","last_peered":"2024-04-25T01:43:46.879311+0000","last_clean":"2024-04-25T01:43:46.879311+0000","last_became_active":"2024-04-25T01:39:24.389841+0000","last_became_peered":"2024-04-25T01:39:24.389841+0000","last_unstale":"2024-04-25T01:43:46.879311+0000","last_undegraded":"2024-04-25T01:43:46.879311+0000","last_fullsized":"2024-04-25T01:43:46.879311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:34.950624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.406513+0000","last_change":"2024-04-25T01:39:23.369440+0000","last_active":"2024-04-25T01:43:29.406513+0000","last_peered":"2024-04-25T01:43:29.406513+0000","last_clean":"2024-04-25T01:43:29.406513+0000","last_became_active":"2024-04-25T01:39:23.369151+0000","last_became_peered":"2024-04-25T01:39:23.369151+0000","last_unstale":"2024-04-25T01:43:29.406513+0000","last_undegraded":"2024-04-25T01:43:29.406513+0000","last_fullsized":"2024-04-25T01:43:29.406513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:31:46.921287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'2024","reported_seq":2068,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.423122+0000","last_change":"2024-04-25T01:39:32.430701+0000","last_active":"2024-04-25T01:43:32.423122+0000","last_peered":"2024-04-25T01:43:32.423122+0000","last_clean":"2024-04-25T01:43:32.423122+0000","last_became_active":"2024-04-25T01:39:32.430187+0000","last_became_peered":"2024-04-25T01:39:32.430187+0000","last_unstale":"2024-04-25T01:43:32.423122+0000","last_undegraded":"2024-04-25T01:43:32.423122+0000","last_fullsized":"2024-04-25T01:43:32.423122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2024,"log_dups_size":0,"ondisk_log_size":2024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:57.148375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":4133,"num_write":2021,"num_write_kb":6037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"30'182","reported_seq":207,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.699488+0000","last_change":"2024-04-25T01:39:33.427429+0000","last_active":"2024-04-25T01:43:34.699488+0000","last_peered":"2024-04-25T01:43:34.699488+0000","last_clean":"2024-04-25T01:43:34.699488+0000","last_became_active":"2024-04-25T01:39:33.427164+0000","last_became_peered":"2024-04-25T01:39:33.427164+0000","last_unstale":"2024-04-25T01:43:34.699488+0000","last_undegraded":"2024-04-25T01:43:34.699488+0000","last_fullsized":"2024-04-25T01:43:34.699488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:33:59.664252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"30'179","reported_seq":212,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.881499+0000","last_change":"2024-04-25T01:39:24.388852+0000","last_active":"2024-04-25T01:43:46.881499+0000","last_peered":"2024-04-25T01:43:46.881499+0000","last_clean":"2024-04-25T01:43:46.881499+0000","last_became_active":"2024-04-25T01:39:24.388594+0000","last_became_peered":"2024-04-25T01:39:24.388594+0000","last_unstale":"2024-04-25T01:43:46.881499+0000","last_undegraded":"2024-04-25T01:43:46.881499+0000","last_fullsized":"2024-04-25T01:43:46.881499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:46:49.718182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.404791+0000","last_change":"2024-04-25T01:39:23.372903+0000","last_active":"2024-04-25T01:43:29.404791+0000","last_peered":"2024-04-25T01:43:29.404791+0000","last_clean":"2024-04-25T01:43:29.404791+0000","last_became_active":"2024-04-25T01:39:23.372617+0000","last_became_peered":"2024-04-25T01:39:23.372617+0000","last_unstale":"2024-04-25T01:43:29.404791+0000","last_undegraded":"2024-04-25T01:43:29.404791+0000","last_fullsized":"2024-04-25T01:43:29.404791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:54:58.506432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"30'8","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:35.564703+0000","last_change":"2024-04-25T01:39:32.430218+0000","last_active":"2024-04-25T01:43:35.564703+0000","last_peered":"2024-04-25T01:43:35.564703+0000","last_clean":"2024-04-25T01:43:35.564703+0000","last_became_active":"2024-04-25T01:39:32.429900+0000","last_became_peered":"2024-04-25T01:39:32.429900+0000","last_unstale":"2024-04-25T01:43:35.564703+0000","last_undegraded":"2024-04-25T01:43:35.564703+0000","last_fullsized":"2024-04-25T01:43:35.564703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:52.253045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"30'217","reported_seq":242,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.745610+0000","last_change":"2024-04-25T01:39:33.440325+0000","last_active":"2024-04-25T01:43:34.745610+0000","last_peered":"2024-04-25T01:43:34.745610+0000","last_clean":"2024-04-25T01:43:34.745610+0000","last_became_active":"2024-04-25T01:39:33.439961+0000","last_became_peered":"2024-04-25T01:39:33.439961+0000","last_unstale":"2024-04-25T01:43:34.745610+0000","last_undegraded":"2024-04-25T01:43:34.745610+0000","last_fullsized":"2024-04-25T01:43:34.745610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:01.846576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'159","reported_seq":192,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.885824+0000","last_change":"2024-04-25T01:39:24.380617+0000","last_active":"2024-04-25T01:43:46.885824+0000","last_peered":"2024-04-25T01:43:46.885824+0000","last_clean":"2024-04-25T01:43:46.885824+0000","last_became_active":"2024-04-25T01:39:24.380330+0000","last_became_peered":"2024-04-25T01:39:24.380330+0000","last_unstale":"2024-04-25T01:43:46.885824+0000","last_undegraded":"2024-04-25T01:43:46.885824+0000","last_fullsized":"2024-04-25T01:43:46.885824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:24.010569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"30'2022","reported_seq":2070,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.412675+0000","last_change":"2024-04-25T01:39:23.373295+0000","last_active":"2024-04-25T01:43:29.412675+0000","last_peered":"2024-04-25T01:43:29.412675+0000","last_clean":"2024-04-25T01:43:29.412675+0000","last_became_active":"2024-04-25T01:39:23.372984+0000","last_became_peered":"2024-04-25T01:39:23.372984+0000","last_unstale":"2024-04-25T01:43:29.412675+0000","last_undegraded":"2024-04-25T01:43:29.412675+0000","last_fullsized":"2024-04-25T01:43:29.412675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2022,"log_dups_size":0,"ondisk_log_size":2022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:10.854190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":65,"num_write":2019,"num_write_kb":6035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.401920+0000","last_change":"2024-04-25T01:39:32.433589+0000","last_active":"2024-04-25T01:43:29.401920+0000","last_peered":"2024-04-25T01:43:29.401920+0000","last_clean":"2024-04-25T01:43:29.401920+0000","last_became_active":"2024-04-25T01:39:32.433408+0000","last_became_peered":"2024-04-25T01:39:32.433408+0000","last_unstale":"2024-04-25T01:43:29.401920+0000","last_undegraded":"2024-04-25T01:43:29.401920+0000","last_fullsized":"2024-04-25T01:43:29.401920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:25.789951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"30'189","reported_seq":214,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.688751+0000","last_change":"2024-04-25T01:39:33.433449+0000","last_active":"2024-04-25T01:43:34.688751+0000","last_peered":"2024-04-25T01:43:34.688751+0000","last_clean":"2024-04-25T01:43:34.688751+0000","last_became_active":"2024-04-25T01:39:33.432690+0000","last_became_peered":"2024-04-25T01:39:33.432690+0000","last_unstale":"2024-04-25T01:43:34.688751+0000","last_undegraded":"2024-04-25T01:43:34.688751+0000","last_fullsized":"2024-04-25T01:43:34.688751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:30.046453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"30'179","reported_seq":212,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.886230+0000","last_change":"2024-04-25T01:39:24.391245+0000","last_active":"2024-04-25T01:43:46.886230+0000","last_peered":"2024-04-25T01:43:46.886230+0000","last_clean":"2024-04-25T01:43:46.886230+0000","last_became_active":"2024-04-25T01:39:24.390941+0000","last_became_peered":"2024-04-25T01:39:24.390941+0000","last_unstale":"2024-04-25T01:43:46.886230+0000","last_undegraded":"2024-04-25T01:43:46.886230+0000","last_fullsized":"2024-04-25T01:43:46.886230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:55.182405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"30'8","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:35.181358+0000","last_change":"2024-04-25T01:39:23.369043+0000","last_active":"2024-04-25T01:43:35.181358+0000","last_peered":"2024-04-25T01:43:35.181358+0000","last_clean":"2024-04-25T01:43:35.181358+0000","last_became_active":"2024-04-25T01:39:23.368778+0000","last_became_peered":"2024-04-25T01:39:23.368778+0000","last_unstale":"2024-04-25T01:43:35.181358+0000","last_undegraded":"2024-04-25T01:43:35.181358+0000","last_fullsized":"2024-04-25T01:43:35.181358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:59.501724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.404425+0000","last_change":"2024-04-25T01:39:32.431530+0000","last_active":"2024-04-25T01:43:29.404425+0000","last_peered":"2024-04-25T01:43:29.404425+0000","last_clean":"2024-04-25T01:43:29.404425+0000","last_became_active":"2024-04-25T01:39:32.431247+0000","last_became_peered":"2024-04-25T01:39:32.431247+0000","last_unstale":"2024-04-25T01:43:29.404425+0000","last_undegraded":"2024-04-25T01:43:29.404425+0000","last_fullsized":"2024-04-25T01:43:29.404425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:46:02.014508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":24,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"30'233","reported_seq":258,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.697325+0000","last_change":"2024-04-25T01:39:33.446545+0000","last_active":"2024-04-25T01:43:34.697325+0000","last_peered":"2024-04-25T01:43:34.697325+0000","last_clean":"2024-04-25T01:43:34.697325+0000","last_became_active":"2024-04-25T01:39:33.446263+0000","last_became_peered":"2024-04-25T01:39:33.446263+0000","last_unstale":"2024-04-25T01:43:34.697325+0000","last_undegraded":"2024-04-25T01:43:34.697325+0000","last_fullsized":"2024-04-25T01:43:34.697325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:27.026460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"30'153","reported_seq":186,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.894871+0000","last_change":"2024-04-25T01:39:24.403875+0000","last_active":"2024-04-25T01:43:46.894871+0000","last_peered":"2024-04-25T01:43:46.894871+0000","last_clean":"2024-04-25T01:43:46.894871+0000","last_became_active":"2024-04-25T01:39:24.403591+0000","last_became_peered":"2024-04-25T01:39:24.403591+0000","last_unstale":"2024-04-25T01:43:46.894871+0000","last_undegraded":"2024-04-25T01:43:46.894871+0000","last_fullsized":"2024-04-25T01:43:46.894871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:45.276173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.406434+0000","last_change":"2024-04-25T01:39:23.378968+0000","last_active":"2024-04-25T01:43:29.406434+0000","last_peered":"2024-04-25T01:43:29.406434+0000","last_clean":"2024-04-25T01:43:29.406434+0000","last_became_active":"2024-04-25T01:39:23.378635+0000","last_became_peered":"2024-04-25T01:39:23.378635+0000","last_unstale":"2024-04-25T01:43:29.406434+0000","last_undegraded":"2024-04-25T01:43:29.406434+0000","last_fullsized":"2024-04-25T01:43:29.406434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:39.780544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.431179+0000","last_change":"2024-04-25T01:39:32.427357+0000","last_active":"2024-04-25T01:43:32.431179+0000","last_peered":"2024-04-25T01:43:32.431179+0000","last_clean":"2024-04-25T01:43:32.431179+0000","last_became_active":"2024-04-25T01:39:32.427105+0000","last_became_peered":"2024-04-25T01:39:32.427105+0000","last_unstale":"2024-04-25T01:43:32.431179+0000","last_undegraded":"2024-04-25T01:43:32.431179+0000","last_fullsized":"2024-04-25T01:43:32.431179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:04.848726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":66,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'217","reported_seq":242,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.751559+0000","last_change":"2024-04-25T01:39:33.444814+0000","last_active":"2024-04-25T01:43:34.751559+0000","last_peered":"2024-04-25T01:43:34.751559+0000","last_clean":"2024-04-25T01:43:34.751559+0000","last_became_active":"2024-04-25T01:39:33.444489+0000","last_became_peered":"2024-04-25T01:39:33.444489+0000","last_unstale":"2024-04-25T01:43:34.751559+0000","last_undegraded":"2024-04-25T01:43:34.751559+0000","last_fullsized":"2024-04-25T01:43:34.751559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:06.718940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"30'235","reported_seq":268,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.898877+0000","last_change":"2024-04-25T01:39:24.392642+0000","last_active":"2024-04-25T01:43:46.898877+0000","last_peered":"2024-04-25T01:43:46.898877+0000","last_clean":"2024-04-25T01:43:46.898877+0000","last_became_active":"2024-04-25T01:39:24.391605+0000","last_became_peered":"2024-04-25T01:39:24.391605+0000","last_unstale":"2024-04-25T01:43:46.898877+0000","last_undegraded":"2024-04-25T01:43:46.898877+0000","last_fullsized":"2024-04-25T01:43:46.898877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:01:23.217074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":565248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.413394+0000","last_change":"2024-04-25T01:39:23.377236+0000","last_active":"2024-04-25T01:43:29.413394+0000","last_peered":"2024-04-25T01:43:29.413394+0000","last_clean":"2024-04-25T01:43:29.413394+0000","last_became_active":"2024-04-25T01:39:23.376727+0000","last_became_peered":"2024-04-25T01:39:23.376727+0000","last_unstale":"2024-04-25T01:43:29.413394+0000","last_undegraded":"2024-04-25T01:43:29.413394+0000","last_fullsized":"2024-04-25T01:43:29.413394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:08.103707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.407470+0000","last_change":"2024-04-25T01:39:32.424457+0000","last_active":"2024-04-25T01:43:29.407470+0000","last_peered":"2024-04-25T01:43:29.407470+0000","last_clean":"2024-04-25T01:43:29.407470+0000","last_became_active":"2024-04-25T01:39:32.424203+0000","last_became_peered":"2024-04-25T01:39:32.424203+0000","last_unstale":"2024-04-25T01:43:29.407470+0000","last_undegraded":"2024-04-25T01:43:29.407470+0000","last_fullsized":"2024-04-25T01:43:29.407470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:12:20.824070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"30'172","reported_seq":198,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.723551+0000","last_change":"2024-04-25T01:39:33.445948+0000","last_active":"2024-04-25T01:43:34.723551+0000","last_peered":"2024-04-25T01:43:34.723551+0000","last_clean":"2024-04-25T01:43:34.723551+0000","last_became_active":"2024-04-25T01:39:33.445654+0000","last_became_peered":"2024-04-25T01:39:33.445654+0000","last_unstale":"2024-04-25T01:43:34.723551+0000","last_undegraded":"2024-04-25T01:43:34.723551+0000","last_fullsized":"2024-04-25T01:43:34.723551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:51.323909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'4","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.612487+0000","last_change":"2024-04-25T01:39:32.430484+0000","last_active":"2024-04-25T01:43:29.612487+0000","last_peered":"2024-04-25T01:43:29.612487+0000","last_clean":"2024-04-25T01:43:29.612487+0000","last_became_active":"2024-04-25T01:39:32.430220+0000","last_became_peered":"2024-04-25T01:39:32.430220+0000","last_unstale":"2024-04-25T01:43:29.612487+0000","last_undegraded":"2024-04-25T01:43:29.612487+0000","last_fullsized":"2024-04-25T01:43:29.612487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:36:53.152442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"30'187","reported_seq":220,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.879565+0000","last_change":"2024-04-25T01:39:24.375457+0000","last_active":"2024-04-25T01:43:46.879565+0000","last_peered":"2024-04-25T01:43:46.879565+0000","last_clean":"2024-04-25T01:43:46.879565+0000","last_became_active":"2024-04-25T01:39:24.375178+0000","last_became_peered":"2024-04-25T01:39:24.375178+0000","last_unstale":"2024-04-25T01:43:46.879565+0000","last_undegraded":"2024-04-25T01:43:46.879565+0000","last_fullsized":"2024-04-25T01:43:46.879565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:58:15.640882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.402961+0000","last_change":"2024-04-25T01:39:23.369998+0000","last_active":"2024-04-25T01:43:29.402961+0000","last_peered":"2024-04-25T01:43:29.402961+0000","last_clean":"2024-04-25T01:43:29.402961+0000","last_became_active":"2024-04-25T01:39:23.369710+0000","last_became_peered":"2024-04-25T01:39:23.369710+0000","last_unstale":"2024-04-25T01:43:29.402961+0000","last_undegraded":"2024-04-25T01:43:29.402961+0000","last_fullsized":"2024-04-25T01:43:29.402961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:32:34.329452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"30'192","reported_seq":218,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.763527+0000","last_change":"2024-04-25T01:39:33.447666+0000","last_active":"2024-04-25T01:43:34.763527+0000","last_peered":"2024-04-25T01:43:34.763527+0000","last_clean":"2024-04-25T01:43:34.763527+0000","last_became_active":"2024-04-25T01:39:33.447436+0000","last_became_peered":"2024-04-25T01:39:33.447436+0000","last_unstale":"2024-04-25T01:43:34.763527+0000","last_undegraded":"2024-04-25T01:43:34.763527+0000","last_fullsized":"2024-04-25T01:43:34.763527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:25:20.440422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'7","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.420309+0000","last_change":"2024-04-25T01:39:32.436300+0000","last_active":"2024-04-25T01:43:32.420309+0000","last_peered":"2024-04-25T01:43:32.420309+0000","last_clean":"2024-04-25T01:43:32.420309+0000","last_became_active":"2024-04-25T01:39:32.436000+0000","last_became_peered":"2024-04-25T01:39:32.436000+0000","last_unstale":"2024-04-25T01:43:32.420309+0000","last_undegraded":"2024-04-25T01:43:32.420309+0000","last_fullsized":"2024-04-25T01:43:32.420309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:38.044992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"30'190","reported_seq":223,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.876992+0000","last_change":"2024-04-25T01:39:24.387708+0000","last_active":"2024-04-25T01:43:46.876992+0000","last_peered":"2024-04-25T01:43:46.876992+0000","last_clean":"2024-04-25T01:43:46.876992+0000","last_became_active":"2024-04-25T01:39:24.387433+0000","last_became_peered":"2024-04-25T01:39:24.387433+0000","last_unstale":"2024-04-25T01:43:46.876992+0000","last_undegraded":"2024-04-25T01:43:46.876992+0000","last_fullsized":"2024-04-25T01:43:46.876992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:34.312066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.407793+0000","last_change":"2024-04-25T01:39:23.377487+0000","last_active":"2024-04-25T01:43:29.407793+0000","last_peered":"2024-04-25T01:43:29.407793+0000","last_clean":"2024-04-25T01:43:29.407793+0000","last_became_active":"2024-04-25T01:39:23.377181+0000","last_became_peered":"2024-04-25T01:39:23.377181+0000","last_unstale":"2024-04-25T01:43:29.407793+0000","last_undegraded":"2024-04-25T01:43:29.407793+0000","last_fullsized":"2024-04-25T01:43:29.407793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:17.434141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"30'209","reported_seq":234,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.752030+0000","last_change":"2024-04-25T01:39:33.444973+0000","last_active":"2024-04-25T01:43:34.752030+0000","last_peered":"2024-04-25T01:43:34.752030+0000","last_clean":"2024-04-25T01:43:34.752030+0000","last_became_active":"2024-04-25T01:39:33.444673+0000","last_became_peered":"2024-04-25T01:39:33.444673+0000","last_unstale":"2024-04-25T01:43:34.752030+0000","last_undegraded":"2024-04-25T01:43:34.752030+0000","last_fullsized":"2024-04-25T01:43:34.752030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:08.372714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"29'3","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.412813+0000","last_change":"2024-04-25T01:39:23.372975+0000","last_active":"2024-04-25T01:43:29.412813+0000","last_peered":"2024-04-25T01:43:29.412813+0000","last_clean":"2024-04-25T01:43:29.412813+0000","last_became_active":"2024-04-25T01:39:23.372688+0000","last_became_peered":"2024-04-25T01:39:23.372688+0000","last_unstale":"2024-04-25T01:43:29.412813+0000","last_undegraded":"2024-04-25T01:43:29.412813+0000","last_fullsized":"2024-04-25T01:43:29.412813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:42:57.195844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"30'157","reported_seq":190,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.882990+0000","last_change":"2024-04-25T01:39:24.388095+0000","last_active":"2024-04-25T01:43:46.882990+0000","last_peered":"2024-04-25T01:43:46.882990+0000","last_clean":"2024-04-25T01:43:46.882990+0000","last_became_active":"2024-04-25T01:39:24.387797+0000","last_became_peered":"2024-04-25T01:39:24.387797+0000","last_unstale":"2024-04-25T01:43:46.882990+0000","last_undegraded":"2024-04-25T01:43:46.882990+0000","last_fullsized":"2024-04-25T01:43:46.882990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:43:16.385957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.424303+0000","last_change":"2024-04-25T01:39:32.427081+0000","last_active":"2024-04-25T01:43:32.424303+0000","last_peered":"2024-04-25T01:43:32.424303+0000","last_clean":"2024-04-25T01:43:32.424303+0000","last_became_active":"2024-04-25T01:39:32.426626+0000","last_became_peered":"2024-04-25T01:39:32.426626+0000","last_unstale":"2024-04-25T01:43:32.424303+0000","last_undegraded":"2024-04-25T01:43:32.424303+0000","last_fullsized":"2024-04-25T01:43:32.424303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:45.358400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"30'170","reported_seq":195,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.728867+0000","last_change":"2024-04-25T01:39:33.446301+0000","last_active":"2024-04-25T01:43:34.728867+0000","last_peered":"2024-04-25T01:43:34.728867+0000","last_clean":"2024-04-25T01:43:34.728867+0000","last_became_active":"2024-04-25T01:39:33.445158+0000","last_became_peered":"2024-04-25T01:39:33.445158+0000","last_unstale":"2024-04-25T01:43:34.728867+0000","last_undegraded":"2024-04-25T01:43:34.728867+0000","last_fullsized":"2024-04-25T01:43:34.728867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:53:26.017968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"30'1824","reported_seq":1859,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:35.275648+0000","last_change":"2024-04-25T01:39:23.371716+0000","last_active":"2024-04-25T01:43:35.275648+0000","last_peered":"2024-04-25T01:43:35.275648+0000","last_clean":"2024-04-25T01:43:35.275648+0000","last_became_active":"2024-04-25T01:39:23.371475+0000","last_became_peered":"2024-04-25T01:39:23.371475+0000","last_unstale":"2024-04-25T01:43:35.275648+0000","last_undegraded":"2024-04-25T01:43:35.275648+0000","last_fullsized":"2024-04-25T01:43:35.275648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1824,"log_dups_size":0,"ondisk_log_size":1824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:10.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3805208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1821,"num_write_kb":5470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"30'150","reported_seq":183,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.870889+0000","last_change":"2024-04-25T01:39:24.388083+0000","last_active":"2024-04-25T01:43:46.870889+0000","last_peered":"2024-04-25T01:43:46.870889+0000","last_clean":"2024-04-25T01:43:46.870889+0000","last_became_active":"2024-04-25T01:39:24.387789+0000","last_became_peered":"2024-04-25T01:39:24.387789+0000","last_unstale":"2024-04-25T01:43:46.870889+0000","last_undegraded":"2024-04-25T01:43:46.870889+0000","last_fullsized":"2024-04-25T01:43:46.870889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:31.760631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'5","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.422640+0000","last_change":"2024-04-25T01:39:32.429613+0000","last_active":"2024-04-25T01:43:32.422640+0000","last_peered":"2024-04-25T01:43:32.422640+0000","last_clean":"2024-04-25T01:43:32.422640+0000","last_became_active":"2024-04-25T01:39:32.429361+0000","last_became_peered":"2024-04-25T01:39:32.429361+0000","last_unstale":"2024-04-25T01:43:32.422640+0000","last_undegraded":"2024-04-25T01:43:32.422640+0000","last_fullsized":"2024-04-25T01:43:32.422640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:04:59.928602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"30'221","reported_seq":246,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.683570+0000","last_change":"2024-04-25T01:39:33.426384+0000","last_active":"2024-04-25T01:43:34.683570+0000","last_peered":"2024-04-25T01:43:34.683570+0000","last_clean":"2024-04-25T01:43:34.683570+0000","last_became_active":"2024-04-25T01:39:33.426101+0000","last_became_peered":"2024-04-25T01:39:33.426101+0000","last_unstale":"2024-04-25T01:43:34.683570+0000","last_undegraded":"2024-04-25T01:43:34.683570+0000","last_fullsized":"2024-04-25T01:43:34.683570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:36.820458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"30'172","reported_seq":206,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.884138+0000","last_change":"2024-04-25T01:39:24.395618+0000","last_active":"2024-04-25T01:43:46.884138+0000","last_peered":"2024-04-25T01:43:46.884138+0000","last_clean":"2024-04-25T01:43:46.884138+0000","last_became_active":"2024-04-25T01:39:24.394816+0000","last_became_peered":"2024-04-25T01:39:24.394816+0000","last_unstale":"2024-04-25T01:43:46.884138+0000","last_undegraded":"2024-04-25T01:43:46.884138+0000","last_fullsized":"2024-04-25T01:43:46.884138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:01.025135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"30'174","reported_seq":199,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.719246+0000","last_change":"2024-04-25T01:39:33.432537+0000","last_active":"2024-04-25T01:43:34.719246+0000","last_peered":"2024-04-25T01:43:34.719246+0000","last_clean":"2024-04-25T01:43:34.719246+0000","last_became_active":"2024-04-25T01:39:33.432266+0000","last_became_peered":"2024-04-25T01:39:33.432266+0000","last_unstale":"2024-04-25T01:43:34.719246+0000","last_undegraded":"2024-04-25T01:43:34.719246+0000","last_fullsized":"2024-04-25T01:43:34.719246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:31.703689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"30'158","reported_seq":197,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.876820+0000","last_change":"2024-04-25T01:40:06.450805+0000","last_active":"2024-04-25T01:43:46.876820+0000","last_peered":"2024-04-25T01:43:46.876820+0000","last_clean":"2024-04-25T01:43:46.876820+0000","last_became_active":"2024-04-25T01:40:06.450447+0000","last_became_peered":"2024-04-25T01:40:06.450447+0000","last_unstale":"2024-04-25T01:43:46.876820+0000","last_undegraded":"2024-04-25T01:43:46.876820+0000","last_fullsized":"2024-04-25T01:43:46.876820+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:37:30.384756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"30'168","reported_seq":193,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.705486+0000","last_change":"2024-04-25T01:39:33.439086+0000","last_active":"2024-04-25T01:43:34.705486+0000","last_peered":"2024-04-25T01:43:34.705486+0000","last_clean":"2024-04-25T01:43:34.705486+0000","last_became_active":"2024-04-25T01:39:33.438811+0000","last_became_peered":"2024-04-25T01:39:33.438811+0000","last_unstale":"2024-04-25T01:43:34.705486+0000","last_undegraded":"2024-04-25T01:43:34.705486+0000","last_fullsized":"2024-04-25T01:43:34.705486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:49:23.604749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"30'143","reported_seq":177,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.895840+0000","last_change":"2024-04-25T01:39:24.399738+0000","last_active":"2024-04-25T01:43:46.895840+0000","last_peered":"2024-04-25T01:43:46.895840+0000","last_clean":"2024-04-25T01:43:46.895840+0000","last_became_active":"2024-04-25T01:39:24.399499+0000","last_became_peered":"2024-04-25T01:39:24.399499+0000","last_unstale":"2024-04-25T01:43:46.895840+0000","last_undegraded":"2024-04-25T01:43:46.895840+0000","last_fullsized":"2024-04-25T01:43:46.895840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:58.646669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":311296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"30'184","reported_seq":209,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.728870+0000","last_change":"2024-04-25T01:39:33.444074+0000","last_active":"2024-04-25T01:43:34.728870+0000","last_peered":"2024-04-25T01:43:34.728870+0000","last_clean":"2024-04-25T01:43:34.728870+0000","last_became_active":"2024-04-25T01:39:33.443796+0000","last_became_peered":"2024-04-25T01:39:33.443796+0000","last_unstale":"2024-04-25T01:43:34.728870+0000","last_undegraded":"2024-04-25T01:43:34.728870+0000","last_fullsized":"2024-04-25T01:43:34.728870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:56.379211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"30'124","reported_seq":158,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.880255+0000","last_change":"2024-04-25T01:39:24.390631+0000","last_active":"2024-04-25T01:43:46.880255+0000","last_peered":"2024-04-25T01:43:46.880255+0000","last_clean":"2024-04-25T01:43:46.880255+0000","last_became_active":"2024-04-25T01:39:24.390363+0000","last_became_peered":"2024-04-25T01:39:24.390363+0000","last_unstale":"2024-04-25T01:43:46.880255+0000","last_undegraded":"2024-04-25T01:43:46.880255+0000","last_fullsized":"2024-04-25T01:43:46.880255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:48.830416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"30'162","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.716155+0000","last_change":"2024-04-25T01:39:33.437787+0000","last_active":"2024-04-25T01:43:34.716155+0000","last_peered":"2024-04-25T01:43:34.716155+0000","last_clean":"2024-04-25T01:43:34.716155+0000","last_became_active":"2024-04-25T01:39:33.436131+0000","last_became_peered":"2024-04-25T01:39:33.436131+0000","last_unstale":"2024-04-25T01:43:34.716155+0000","last_undegraded":"2024-04-25T01:43:34.716155+0000","last_fullsized":"2024-04-25T01:43:34.716155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:29:13.213643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"30'148","reported_seq":182,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.875617+0000","last_change":"2024-04-25T01:39:24.389645+0000","last_active":"2024-04-25T01:43:46.875617+0000","last_peered":"2024-04-25T01:43:46.875617+0000","last_clean":"2024-04-25T01:43:46.875617+0000","last_became_active":"2024-04-25T01:39:24.389375+0000","last_became_peered":"2024-04-25T01:39:24.389375+0000","last_unstale":"2024-04-25T01:43:46.875617+0000","last_undegraded":"2024-04-25T01:43:46.875617+0000","last_fullsized":"2024-04-25T01:43:46.875617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:13:12.753893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"30'141","reported_seq":167,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.743053+0000","last_change":"2024-04-25T01:39:33.448177+0000","last_active":"2024-04-25T01:43:34.743053+0000","last_peered":"2024-04-25T01:43:34.743053+0000","last_clean":"2024-04-25T01:43:34.743053+0000","last_became_active":"2024-04-25T01:39:33.447588+0000","last_became_peered":"2024-04-25T01:39:33.447588+0000","last_unstale":"2024-04-25T01:43:34.743053+0000","last_undegraded":"2024-04-25T01:43:34.743053+0000","last_fullsized":"2024-04-25T01:43:34.743053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:11:20.466189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"30'156","reported_seq":190,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.878803+0000","last_change":"2024-04-25T01:39:24.374082+0000","last_active":"2024-04-25T01:43:46.878803+0000","last_peered":"2024-04-25T01:43:46.878803+0000","last_clean":"2024-04-25T01:43:46.878803+0000","last_became_active":"2024-04-25T01:39:24.373731+0000","last_became_peered":"2024-04-25T01:39:24.373731+0000","last_unstale":"2024-04-25T01:43:46.878803+0000","last_undegraded":"2024-04-25T01:43:46.878803+0000","last_fullsized":"2024-04-25T01:43:46.878803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:45.817483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"30'188","reported_seq":214,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.753852+0000","last_change":"2024-04-25T01:39:33.446992+0000","last_active":"2024-04-25T01:43:34.753852+0000","last_peered":"2024-04-25T01:43:34.753852+0000","last_clean":"2024-04-25T01:43:34.753852+0000","last_became_active":"2024-04-25T01:39:33.446652+0000","last_became_peered":"2024-04-25T01:39:33.446652+0000","last_unstale":"2024-04-25T01:43:34.753852+0000","last_undegraded":"2024-04-25T01:43:34.753852+0000","last_fullsized":"2024-04-25T01:43:34.753852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:43:52.959274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"30'224","reported_seq":258,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.886451+0000","last_change":"2024-04-25T01:39:24.398614+0000","last_active":"2024-04-25T01:43:46.886451+0000","last_peered":"2024-04-25T01:43:46.886451+0000","last_clean":"2024-04-25T01:43:46.886451+0000","last_became_active":"2024-04-25T01:39:24.398299+0000","last_became_peered":"2024-04-25T01:39:24.398299+0000","last_unstale":"2024-04-25T01:43:46.886451+0000","last_undegraded":"2024-04-25T01:43:46.886451+0000","last_fullsized":"2024-04-25T01:43:46.886451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:54:51.191225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":516096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"30'167","reported_seq":193,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.764139+0000","last_change":"2024-04-25T01:39:33.441401+0000","last_active":"2024-04-25T01:43:34.764139+0000","last_peered":"2024-04-25T01:43:34.764139+0000","last_clean":"2024-04-25T01:43:34.764139+0000","last_became_active":"2024-04-25T01:39:33.441104+0000","last_became_peered":"2024-04-25T01:39:33.441104+0000","last_unstale":"2024-04-25T01:43:34.764139+0000","last_undegraded":"2024-04-25T01:43:34.764139+0000","last_fullsized":"2024-04-25T01:43:34.764139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:51.503340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"30'161","reported_seq":195,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.874331+0000","last_change":"2024-04-25T01:39:24.390352+0000","last_active":"2024-04-25T01:43:46.874331+0000","last_peered":"2024-04-25T01:43:46.874331+0000","last_clean":"2024-04-25T01:43:46.874331+0000","last_became_active":"2024-04-25T01:39:24.389809+0000","last_became_peered":"2024-04-25T01:39:24.389809+0000","last_unstale":"2024-04-25T01:43:46.874331+0000","last_undegraded":"2024-04-25T01:43:46.874331+0000","last_fullsized":"2024-04-25T01:43:46.874331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:22:44.221898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"30'188","reported_seq":213,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.738058+0000","last_change":"2024-04-25T01:39:33.426710+0000","last_active":"2024-04-25T01:43:34.738058+0000","last_peered":"2024-04-25T01:43:34.738058+0000","last_clean":"2024-04-25T01:43:34.738058+0000","last_became_active":"2024-04-25T01:39:33.426056+0000","last_became_peered":"2024-04-25T01:39:33.426056+0000","last_unstale":"2024-04-25T01:43:34.738058+0000","last_undegraded":"2024-04-25T01:43:34.738058+0000","last_fullsized":"2024-04-25T01:43:34.738058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:53:41.174851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"30'220","reported_seq":254,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.895157+0000","last_change":"2024-04-25T01:39:24.387093+0000","last_active":"2024-04-25T01:43:46.895157+0000","last_peered":"2024-04-25T01:43:46.895157+0000","last_clean":"2024-04-25T01:43:46.895157+0000","last_became_active":"2024-04-25T01:39:24.386809+0000","last_became_peered":"2024-04-25T01:39:24.386809+0000","last_unstale":"2024-04-25T01:43:46.895157+0000","last_undegraded":"2024-04-25T01:43:46.895157+0000","last_fullsized":"2024-04-25T01:43:46.895157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:46:05.313828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"30'189","reported_seq":214,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.730046+0000","last_change":"2024-04-25T01:39:33.436499+0000","last_active":"2024-04-25T01:43:34.730046+0000","last_peered":"2024-04-25T01:43:34.730046+0000","last_clean":"2024-04-25T01:43:34.730046+0000","last_became_active":"2024-04-25T01:39:33.436017+0000","last_became_peered":"2024-04-25T01:39:33.436017+0000","last_unstale":"2024-04-25T01:43:34.730046+0000","last_undegraded":"2024-04-25T01:43:34.730046+0000","last_fullsized":"2024-04-25T01:43:34.730046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:46:09.302012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"30'149","reported_seq":182,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.874684+0000","last_change":"2024-04-25T01:39:24.389039+0000","last_active":"2024-04-25T01:43:46.874684+0000","last_peered":"2024-04-25T01:43:46.874684+0000","last_clean":"2024-04-25T01:43:46.874684+0000","last_became_active":"2024-04-25T01:39:24.388793+0000","last_became_peered":"2024-04-25T01:39:24.388793+0000","last_unstale":"2024-04-25T01:43:46.874684+0000","last_undegraded":"2024-04-25T01:43:46.874684+0000","last_fullsized":"2024-04-25T01:43:46.874684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:13.093550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"30'196","reported_seq":221,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.759968+0000","last_change":"2024-04-25T01:39:33.441122+0000","last_active":"2024-04-25T01:43:34.759968+0000","last_peered":"2024-04-25T01:43:34.759968+0000","last_clean":"2024-04-25T01:43:34.759968+0000","last_became_active":"2024-04-25T01:39:33.440760+0000","last_became_peered":"2024-04-25T01:39:33.440760+0000","last_unstale":"2024-04-25T01:43:34.759968+0000","last_undegraded":"2024-04-25T01:43:34.759968+0000","last_fullsized":"2024-04-25T01:43:34.759968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:30:12.603789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"30'194","reported_seq":227,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.899298+0000","last_change":"2024-04-25T01:39:24.390884+0000","last_active":"2024-04-25T01:43:46.899298+0000","last_peered":"2024-04-25T01:43:46.899298+0000","last_clean":"2024-04-25T01:43:46.899298+0000","last_became_active":"2024-04-25T01:39:24.390591+0000","last_became_peered":"2024-04-25T01:39:24.390591+0000","last_unstale":"2024-04-25T01:43:46.899298+0000","last_undegraded":"2024-04-25T01:43:46.899298+0000","last_fullsized":"2024-04-25T01:43:46.899298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:51.274363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"30'233","reported_seq":258,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.751644+0000","last_change":"2024-04-25T01:39:33.429482+0000","last_active":"2024-04-25T01:43:34.751644+0000","last_peered":"2024-04-25T01:43:34.751644+0000","last_clean":"2024-04-25T01:43:34.751644+0000","last_became_active":"2024-04-25T01:39:33.429158+0000","last_became_peered":"2024-04-25T01:39:33.429158+0000","last_unstale":"2024-04-25T01:43:34.751644+0000","last_undegraded":"2024-04-25T01:43:34.751644+0000","last_fullsized":"2024-04-25T01:43:34.751644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:58:07.372868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"30'168","reported_seq":201,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.886803+0000","last_change":"2024-04-25T01:39:24.388891+0000","last_active":"2024-04-25T01:43:46.886803+0000","last_peered":"2024-04-25T01:43:46.886803+0000","last_clean":"2024-04-25T01:43:46.886803+0000","last_became_active":"2024-04-25T01:39:24.388619+0000","last_became_peered":"2024-04-25T01:39:24.388619+0000","last_unstale":"2024-04-25T01:43:46.886803+0000","last_undegraded":"2024-04-25T01:43:46.886803+0000","last_fullsized":"2024-04-25T01:43:46.886803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:05.176386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"30'215","reported_seq":240,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.728559+0000","last_change":"2024-04-25T01:39:33.443534+0000","last_active":"2024-04-25T01:43:34.728559+0000","last_peered":"2024-04-25T01:43:34.728559+0000","last_clean":"2024-04-25T01:43:34.728559+0000","last_became_active":"2024-04-25T01:39:33.443257+0000","last_became_peered":"2024-04-25T01:39:33.443257+0000","last_unstale":"2024-04-25T01:43:34.728559+0000","last_undegraded":"2024-04-25T01:43:34.728559+0000","last_fullsized":"2024-04-25T01:43:34.728559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:44:30.154519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"30'188","reported_seq":221,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.888562+0000","last_change":"2024-04-25T01:39:24.395109+0000","last_active":"2024-04-25T01:43:46.888562+0000","last_peered":"2024-04-25T01:43:46.888562+0000","last_clean":"2024-04-25T01:43:46.888562+0000","last_became_active":"2024-04-25T01:39:24.394784+0000","last_became_peered":"2024-04-25T01:39:24.394784+0000","last_unstale":"2024-04-25T01:43:46.888562+0000","last_undegraded":"2024-04-25T01:43:46.888562+0000","last_fullsized":"2024-04-25T01:43:46.888562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:44:09.102603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"30'159","reported_seq":184,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.714401+0000","last_change":"2024-04-25T01:39:33.446683+0000","last_active":"2024-04-25T01:43:34.714401+0000","last_peered":"2024-04-25T01:43:34.714401+0000","last_clean":"2024-04-25T01:43:34.714401+0000","last_became_active":"2024-04-25T01:39:33.445949+0000","last_became_peered":"2024-04-25T01:39:33.445949+0000","last_unstale":"2024-04-25T01:43:34.714401+0000","last_undegraded":"2024-04-25T01:43:34.714401+0000","last_fullsized":"2024-04-25T01:43:34.714401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:28.864821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"30'196","reported_seq":229,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.868887+0000","last_change":"2024-04-25T01:39:24.380199+0000","last_active":"2024-04-25T01:43:46.868887+0000","last_peered":"2024-04-25T01:43:46.868887+0000","last_clean":"2024-04-25T01:43:46.868887+0000","last_became_active":"2024-04-25T01:39:24.379591+0000","last_became_peered":"2024-04-25T01:39:24.379591+0000","last_unstale":"2024-04-25T01:43:46.868887+0000","last_undegraded":"2024-04-25T01:43:46.868887+0000","last_fullsized":"2024-04-25T01:43:46.868887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:54.534683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"30'233","reported_seq":258,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.760480+0000","last_change":"2024-04-25T01:39:33.439702+0000","last_active":"2024-04-25T01:43:34.760480+0000","last_peered":"2024-04-25T01:43:34.760480+0000","last_clean":"2024-04-25T01:43:34.760480+0000","last_became_active":"2024-04-25T01:39:33.439424+0000","last_became_peered":"2024-04-25T01:39:33.439424+0000","last_unstale":"2024-04-25T01:43:34.760480+0000","last_undegraded":"2024-04-25T01:43:34.760480+0000","last_fullsized":"2024-04-25T01:43:34.760480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:31.528140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"30'179","reported_seq":212,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.883530+0000","last_change":"2024-04-25T01:39:24.395125+0000","last_active":"2024-04-25T01:43:46.883530+0000","last_peered":"2024-04-25T01:43:46.883530+0000","last_clean":"2024-04-25T01:43:46.883530+0000","last_became_active":"2024-04-25T01:39:24.392605+0000","last_became_peered":"2024-04-25T01:39:24.392605+0000","last_unstale":"2024-04-25T01:43:46.883530+0000","last_undegraded":"2024-04-25T01:43:46.883530+0000","last_fullsized":"2024-04-25T01:43:46.883530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:53.333616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"30'166","reported_seq":191,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.710900+0000","last_change":"2024-04-25T01:39:33.438104+0000","last_active":"2024-04-25T01:43:34.710900+0000","last_peered":"2024-04-25T01:43:34.710900+0000","last_clean":"2024-04-25T01:43:34.710900+0000","last_became_active":"2024-04-25T01:39:33.437795+0000","last_became_peered":"2024-04-25T01:39:33.437795+0000","last_unstale":"2024-04-25T01:43:34.710900+0000","last_undegraded":"2024-04-25T01:43:34.710900+0000","last_fullsized":"2024-04-25T01:43:34.710900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:32.294104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"30'199","reported_seq":232,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.899022+0000","last_change":"2024-04-25T01:39:24.391312+0000","last_active":"2024-04-25T01:43:46.899022+0000","last_peered":"2024-04-25T01:43:46.899022+0000","last_clean":"2024-04-25T01:43:46.899022+0000","last_became_active":"2024-04-25T01:39:24.390978+0000","last_became_peered":"2024-04-25T01:39:24.390978+0000","last_unstale":"2024-04-25T01:43:46.899022+0000","last_undegraded":"2024-04-25T01:43:46.899022+0000","last_fullsized":"2024-04-25T01:43:46.899022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:38:25.637031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"30'197","reported_seq":222,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.738370+0000","last_change":"2024-04-25T01:39:33.431262+0000","last_active":"2024-04-25T01:43:34.738370+0000","last_peered":"2024-04-25T01:43:34.738370+0000","last_clean":"2024-04-25T01:43:34.738370+0000","last_became_active":"2024-04-25T01:39:33.430982+0000","last_became_peered":"2024-04-25T01:39:33.430982+0000","last_unstale":"2024-04-25T01:43:34.738370+0000","last_undegraded":"2024-04-25T01:43:34.738370+0000","last_fullsized":"2024-04-25T01:43:34.738370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:11.821542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"30'161","reported_seq":194,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.892591+0000","last_change":"2024-04-25T01:39:24.399270+0000","last_active":"2024-04-25T01:43:46.892591+0000","last_peered":"2024-04-25T01:43:46.892591+0000","last_clean":"2024-04-25T01:43:46.892591+0000","last_became_active":"2024-04-25T01:39:24.399011+0000","last_became_peered":"2024-04-25T01:39:24.399011+0000","last_unstale":"2024-04-25T01:43:46.892591+0000","last_undegraded":"2024-04-25T01:43:46.892591+0000","last_fullsized":"2024-04-25T01:43:46.892591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:00.987674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"30'187","reported_seq":212,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.706034+0000","last_change":"2024-04-25T01:39:33.443939+0000","last_active":"2024-04-25T01:43:34.706034+0000","last_peered":"2024-04-25T01:43:34.706034+0000","last_clean":"2024-04-25T01:43:34.706034+0000","last_became_active":"2024-04-25T01:39:33.443608+0000","last_became_peered":"2024-04-25T01:39:33.443608+0000","last_unstale":"2024-04-25T01:43:34.706034+0000","last_undegraded":"2024-04-25T01:43:34.706034+0000","last_fullsized":"2024-04-25T01:43:34.706034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:35.561173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"30'178","reported_seq":211,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.872334+0000","last_change":"2024-04-25T01:39:24.388943+0000","last_active":"2024-04-25T01:43:46.872334+0000","last_peered":"2024-04-25T01:43:46.872334+0000","last_clean":"2024-04-25T01:43:46.872334+0000","last_became_active":"2024-04-25T01:39:24.388690+0000","last_became_peered":"2024-04-25T01:39:24.388690+0000","last_unstale":"2024-04-25T01:43:46.872334+0000","last_undegraded":"2024-04-25T01:43:46.872334+0000","last_fullsized":"2024-04-25T01:43:46.872334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:42:18.260701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"30'175","reported_seq":200,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.762256+0000","last_change":"2024-04-25T01:39:33.438460+0000","last_active":"2024-04-25T01:43:34.762256+0000","last_peered":"2024-04-25T01:43:34.762256+0000","last_clean":"2024-04-25T01:43:34.762256+0000","last_became_active":"2024-04-25T01:39:33.436581+0000","last_became_peered":"2024-04-25T01:39:33.436581+0000","last_unstale":"2024-04-25T01:43:34.762256+0000","last_undegraded":"2024-04-25T01:43:34.762256+0000","last_fullsized":"2024-04-25T01:43:34.762256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:03:27.382925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"30'181","reported_seq":214,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.879616+0000","last_change":"2024-04-25T01:39:24.389556+0000","last_active":"2024-04-25T01:43:46.879616+0000","last_peered":"2024-04-25T01:43:46.879616+0000","last_clean":"2024-04-25T01:43:46.879616+0000","last_became_active":"2024-04-25T01:39:24.389254+0000","last_became_peered":"2024-04-25T01:39:24.389254+0000","last_unstale":"2024-04-25T01:43:46.879616+0000","last_undegraded":"2024-04-25T01:43:46.879616+0000","last_fullsized":"2024-04-25T01:43:46.879616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:56.208172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"30'237","reported_seq":262,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.748129+0000","last_change":"2024-04-25T01:39:33.433893+0000","last_active":"2024-04-25T01:43:34.748129+0000","last_peered":"2024-04-25T01:43:34.748129+0000","last_clean":"2024-04-25T01:43:34.748129+0000","last_became_active":"2024-04-25T01:39:33.433577+0000","last_became_peered":"2024-04-25T01:39:33.433577+0000","last_unstale":"2024-04-25T01:43:34.748129+0000","last_undegraded":"2024-04-25T01:43:34.748129+0000","last_fullsized":"2024-04-25T01:43:34.748129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:16.371837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"30'187","reported_seq":220,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.884139+0000","last_change":"2024-04-25T01:39:24.392021+0000","last_active":"2024-04-25T01:43:46.884139+0000","last_peered":"2024-04-25T01:43:46.884139+0000","last_clean":"2024-04-25T01:43:46.884139+0000","last_became_active":"2024-04-25T01:39:24.391352+0000","last_became_peered":"2024-04-25T01:39:24.391352+0000","last_unstale":"2024-04-25T01:43:46.884139+0000","last_undegraded":"2024-04-25T01:43:46.884139+0000","last_fullsized":"2024-04-25T01:43:46.884139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:44.434749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"30'186","reported_seq":211,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.683783+0000","last_change":"2024-04-25T01:39:33.436641+0000","last_active":"2024-04-25T01:43:34.683783+0000","last_peered":"2024-04-25T01:43:34.683783+0000","last_clean":"2024-04-25T01:43:34.683783+0000","last_became_active":"2024-04-25T01:39:33.436389+0000","last_became_peered":"2024-04-25T01:39:33.436389+0000","last_unstale":"2024-04-25T01:43:34.683783+0000","last_undegraded":"2024-04-25T01:43:34.683783+0000","last_fullsized":"2024-04-25T01:43:34.683783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:19:51.940088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"30'169","reported_seq":202,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.883979+0000","last_change":"2024-04-25T01:39:24.396300+0000","last_active":"2024-04-25T01:43:46.883979+0000","last_peered":"2024-04-25T01:43:46.883979+0000","last_clean":"2024-04-25T01:43:46.883979+0000","last_became_active":"2024-04-25T01:39:24.396023+0000","last_became_peered":"2024-04-25T01:39:24.396023+0000","last_unstale":"2024-04-25T01:43:46.883979+0000","last_undegraded":"2024-04-25T01:43:46.883979+0000","last_fullsized":"2024-04-25T01:43:46.883979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:21.500721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"30'186","reported_seq":211,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.733553+0000","last_change":"2024-04-25T01:39:33.443419+0000","last_active":"2024-04-25T01:43:34.733553+0000","last_peered":"2024-04-25T01:43:34.733553+0000","last_clean":"2024-04-25T01:43:34.733553+0000","last_became_active":"2024-04-25T01:39:33.443163+0000","last_became_peered":"2024-04-25T01:39:33.443163+0000","last_unstale":"2024-04-25T01:43:34.733553+0000","last_undegraded":"2024-04-25T01:43:34.733553+0000","last_fullsized":"2024-04-25T01:43:34.733553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:22.156410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"30'212","reported_seq":245,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.897937+0000","last_change":"2024-04-25T01:39:24.404047+0000","last_active":"2024-04-25T01:43:46.897937+0000","last_peered":"2024-04-25T01:43:46.897937+0000","last_clean":"2024-04-25T01:43:46.897937+0000","last_became_active":"2024-04-25T01:39:24.403700+0000","last_became_peered":"2024-04-25T01:39:24.403700+0000","last_unstale":"2024-04-25T01:43:46.897937+0000","last_undegraded":"2024-04-25T01:43:46.897937+0000","last_fullsized":"2024-04-25T01:43:46.897937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:53.123061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":491520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"30'177","reported_seq":202,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.712967+0000","last_change":"2024-04-25T01:39:33.435520+0000","last_active":"2024-04-25T01:43:34.712967+0000","last_peered":"2024-04-25T01:43:34.712967+0000","last_clean":"2024-04-25T01:43:34.712967+0000","last_became_active":"2024-04-25T01:39:33.434446+0000","last_became_peered":"2024-04-25T01:39:33.434446+0000","last_unstale":"2024-04-25T01:43:34.712967+0000","last_undegraded":"2024-04-25T01:43:34.712967+0000","last_fullsized":"2024-04-25T01:43:34.712967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:59.696009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"30'183","reported_seq":221,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.883554+0000","last_change":"2024-04-25T01:40:05.559200+0000","last_active":"2024-04-25T01:43:46.883554+0000","last_peered":"2024-04-25T01:43:46.883554+0000","last_clean":"2024-04-25T01:43:46.883554+0000","last_became_active":"2024-04-25T01:40:05.558954+0000","last_became_peered":"2024-04-25T01:40:05.558954+0000","last_unstale":"2024-04-25T01:43:46.883554+0000","last_undegraded":"2024-04-25T01:43:46.883554+0000","last_fullsized":"2024-04-25T01:43:46.883554+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:30.998037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"30'191","reported_seq":216,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.740677+0000","last_change":"2024-04-25T01:39:33.436479+0000","last_active":"2024-04-25T01:43:34.740677+0000","last_peered":"2024-04-25T01:43:34.740677+0000","last_clean":"2024-04-25T01:43:34.740677+0000","last_became_active":"2024-04-25T01:39:33.436193+0000","last_became_peered":"2024-04-25T01:39:33.436193+0000","last_unstale":"2024-04-25T01:43:34.740677+0000","last_undegraded":"2024-04-25T01:43:34.740677+0000","last_fullsized":"2024-04-25T01:43:34.740677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:20:03.455536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"30'179","reported_seq":212,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.896948+0000","last_change":"2024-04-25T01:39:24.393362+0000","last_active":"2024-04-25T01:43:46.896948+0000","last_peered":"2024-04-25T01:43:46.896948+0000","last_clean":"2024-04-25T01:43:46.896948+0000","last_became_active":"2024-04-25T01:39:24.392836+0000","last_became_peered":"2024-04-25T01:39:24.392836+0000","last_unstale":"2024-04-25T01:43:46.896948+0000","last_undegraded":"2024-04-25T01:43:46.896948+0000","last_fullsized":"2024-04-25T01:43:46.896948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:58.871777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"30'168","reported_seq":194,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.765220+0000","last_change":"2024-04-25T01:39:33.440164+0000","last_active":"2024-04-25T01:43:34.765220+0000","last_peered":"2024-04-25T01:43:34.765220+0000","last_clean":"2024-04-25T01:43:34.765220+0000","last_became_active":"2024-04-25T01:39:33.439878+0000","last_became_peered":"2024-04-25T01:39:33.439878+0000","last_unstale":"2024-04-25T01:43:34.765220+0000","last_undegraded":"2024-04-25T01:43:34.765220+0000","last_fullsized":"2024-04-25T01:43:34.765220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:44:52.817169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"30'207","reported_seq":240,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.896113+0000","last_change":"2024-04-25T01:39:24.401765+0000","last_active":"2024-04-25T01:43:46.896113+0000","last_peered":"2024-04-25T01:43:46.896113+0000","last_clean":"2024-04-25T01:43:46.896113+0000","last_became_active":"2024-04-25T01:39:24.400509+0000","last_became_peered":"2024-04-25T01:39:24.400509+0000","last_unstale":"2024-04-25T01:43:46.896113+0000","last_undegraded":"2024-04-25T01:43:46.896113+0000","last_fullsized":"2024-04-25T01:43:46.896113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:25.031622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":491520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"30'180","reported_seq":206,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.734853+0000","last_change":"2024-04-25T01:39:33.439353+0000","last_active":"2024-04-25T01:43:34.734853+0000","last_peered":"2024-04-25T01:43:34.734853+0000","last_clean":"2024-04-25T01:43:34.734853+0000","last_became_active":"2024-04-25T01:39:33.438915+0000","last_became_peered":"2024-04-25T01:39:33.438915+0000","last_unstale":"2024-04-25T01:43:34.734853+0000","last_undegraded":"2024-04-25T01:43:34.734853+0000","last_fullsized":"2024-04-25T01:43:34.734853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:19.180919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"30'197","reported_seq":230,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.885409+0000","last_change":"2024-04-25T01:39:24.387941+0000","last_active":"2024-04-25T01:43:46.885409+0000","last_peered":"2024-04-25T01:43:46.885409+0000","last_clean":"2024-04-25T01:43:46.885409+0000","last_became_active":"2024-04-25T01:39:24.387674+0000","last_became_peered":"2024-04-25T01:39:24.387674+0000","last_unstale":"2024-04-25T01:43:46.885409+0000","last_undegraded":"2024-04-25T01:43:46.885409+0000","last_fullsized":"2024-04-25T01:43:46.885409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:05.676143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"30'205","reported_seq":231,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.768022+0000","last_change":"2024-04-25T01:39:33.444917+0000","last_active":"2024-04-25T01:43:34.768022+0000","last_peered":"2024-04-25T01:43:34.768022+0000","last_clean":"2024-04-25T01:43:34.768022+0000","last_became_active":"2024-04-25T01:39:33.444636+0000","last_became_peered":"2024-04-25T01:39:33.444636+0000","last_unstale":"2024-04-25T01:43:34.768022+0000","last_undegraded":"2024-04-25T01:43:34.768022+0000","last_fullsized":"2024-04-25T01:43:34.768022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:31.531502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"30'159","reported_seq":192,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.895208+0000","last_change":"2024-04-25T01:39:24.399950+0000","last_active":"2024-04-25T01:43:46.895208+0000","last_peered":"2024-04-25T01:43:46.895208+0000","last_clean":"2024-04-25T01:43:46.895208+0000","last_became_active":"2024-04-25T01:39:24.399701+0000","last_became_peered":"2024-04-25T01:39:24.399701+0000","last_unstale":"2024-04-25T01:43:46.895208+0000","last_undegraded":"2024-04-25T01:43:46.895208+0000","last_fullsized":"2024-04-25T01:43:46.895208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:49.618370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"30'193","reported_seq":219,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.907697+0000","last_change":"2024-04-25T01:39:33.440936+0000","last_active":"2024-04-25T01:43:34.907697+0000","last_peered":"2024-04-25T01:43:34.907697+0000","last_clean":"2024-04-25T01:43:34.907697+0000","last_became_active":"2024-04-25T01:39:33.440679+0000","last_became_peered":"2024-04-25T01:39:33.440679+0000","last_unstale":"2024-04-25T01:43:34.907697+0000","last_undegraded":"2024-04-25T01:43:34.907697+0000","last_fullsized":"2024-04-25T01:43:34.907697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:08:53.629572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"30'177","reported_seq":210,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.876988+0000","last_change":"2024-04-25T01:39:24.380318+0000","last_active":"2024-04-25T01:43:46.876988+0000","last_peered":"2024-04-25T01:43:46.876988+0000","last_clean":"2024-04-25T01:43:46.876988+0000","last_became_active":"2024-04-25T01:39:24.379573+0000","last_became_peered":"2024-04-25T01:39:24.379573+0000","last_unstale":"2024-04-25T01:43:46.876988+0000","last_undegraded":"2024-04-25T01:43:46.876988+0000","last_fullsized":"2024-04-25T01:43:46.876988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:12.089917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"30'176","reported_seq":201,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.756355+0000","last_change":"2024-04-25T01:39:33.426380+0000","last_active":"2024-04-25T01:43:34.756355+0000","last_peered":"2024-04-25T01:43:34.756355+0000","last_clean":"2024-04-25T01:43:34.756355+0000","last_became_active":"2024-04-25T01:39:33.426090+0000","last_became_peered":"2024-04-25T01:39:33.426090+0000","last_unstale":"2024-04-25T01:43:34.756355+0000","last_undegraded":"2024-04-25T01:43:34.756355+0000","last_fullsized":"2024-04-25T01:43:34.756355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:34.329217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"30'192","reported_seq":226,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.896768+0000","last_change":"2024-04-25T01:39:24.398726+0000","last_active":"2024-04-25T01:43:46.896768+0000","last_peered":"2024-04-25T01:43:46.896768+0000","last_clean":"2024-04-25T01:43:46.896768+0000","last_became_active":"2024-04-25T01:39:24.398449+0000","last_became_peered":"2024-04-25T01:39:24.398449+0000","last_unstale":"2024-04-25T01:43:46.896768+0000","last_undegraded":"2024-04-25T01:43:46.896768+0000","last_fullsized":"2024-04-25T01:43:46.896768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:41:38.230939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"30'187","reported_seq":212,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.731406+0000","last_change":"2024-04-25T01:39:33.436488+0000","last_active":"2024-04-25T01:43:34.731406+0000","last_peered":"2024-04-25T01:43:34.731406+0000","last_clean":"2024-04-25T01:43:34.731406+0000","last_became_active":"2024-04-25T01:39:33.436224+0000","last_became_peered":"2024-04-25T01:39:33.436224+0000","last_unstale":"2024-04-25T01:43:34.731406+0000","last_undegraded":"2024-04-25T01:43:34.731406+0000","last_fullsized":"2024-04-25T01:43:34.731406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:38.227206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"30'175","reported_seq":209,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.871923+0000","last_change":"2024-04-25T01:39:24.386909+0000","last_active":"2024-04-25T01:43:46.871923+0000","last_peered":"2024-04-25T01:43:46.871923+0000","last_clean":"2024-04-25T01:43:46.871923+0000","last_became_active":"2024-04-25T01:39:24.386568+0000","last_became_peered":"2024-04-25T01:39:24.386568+0000","last_unstale":"2024-04-25T01:43:46.871923+0000","last_undegraded":"2024-04-25T01:43:46.871923+0000","last_fullsized":"2024-04-25T01:43:46.871923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:29.904064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"30'223","reported_seq":248,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.755445+0000","last_change":"2024-04-25T01:39:33.440753+0000","last_active":"2024-04-25T01:43:34.755445+0000","last_peered":"2024-04-25T01:43:34.755445+0000","last_clean":"2024-04-25T01:43:34.755445+0000","last_became_active":"2024-04-25T01:39:33.440480+0000","last_became_peered":"2024-04-25T01:39:33.440480+0000","last_unstale":"2024-04-25T01:43:34.755445+0000","last_undegraded":"2024-04-25T01:43:34.755445+0000","last_fullsized":"2024-04-25T01:43:34.755445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:18.113293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"30'159","reported_seq":193,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.877584+0000","last_change":"2024-04-25T01:39:24.386803+0000","last_active":"2024-04-25T01:43:46.877584+0000","last_peered":"2024-04-25T01:43:46.877584+0000","last_clean":"2024-04-25T01:43:46.877584+0000","last_became_active":"2024-04-25T01:39:24.386531+0000","last_became_peered":"2024-04-25T01:39:24.386531+0000","last_unstale":"2024-04-25T01:43:46.877584+0000","last_undegraded":"2024-04-25T01:43:46.877584+0000","last_fullsized":"2024-04-25T01:43:46.877584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:19.160345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"30'214","reported_seq":239,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.689935+0000","last_change":"2024-04-25T01:39:33.436433+0000","last_active":"2024-04-25T01:43:34.689935+0000","last_peered":"2024-04-25T01:43:34.689935+0000","last_clean":"2024-04-25T01:43:34.689935+0000","last_became_active":"2024-04-25T01:39:33.436134+0000","last_became_peered":"2024-04-25T01:39:33.436134+0000","last_unstale":"2024-04-25T01:43:34.689935+0000","last_undegraded":"2024-04-25T01:43:34.689935+0000","last_fullsized":"2024-04-25T01:43:34.689935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:08:30.641790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"30'170","reported_seq":204,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.888991+0000","last_change":"2024-04-25T01:39:24.396231+0000","last_active":"2024-04-25T01:43:46.888991+0000","last_peered":"2024-04-25T01:43:46.888991+0000","last_clean":"2024-04-25T01:43:46.888991+0000","last_became_active":"2024-04-25T01:39:24.395958+0000","last_became_peered":"2024-04-25T01:39:24.395958+0000","last_unstale":"2024-04-25T01:43:46.888991+0000","last_undegraded":"2024-04-25T01:43:46.888991+0000","last_fullsized":"2024-04-25T01:43:46.888991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:54.898765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12101,"ondisk_log_size":12101,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":7961050,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":239,"num_read_kb":8015,"num_write":3914,"num_write_kb":11480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15990784,"data_stored":15922100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3914,"ondisk_log_size":3914,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11253,"ondisk_log_size":11253,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8001487,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":165,"num_read_kb":215,"num_write":3941,"num_write_kb":11543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16072704,"data_stored":16002974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3930,"ondisk_log_size":3930,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67676,"kb_used_data":4628,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94304164,"statfs":{"total":96636764160,"available":96567463936,"internally_reserved":0,"allocated":4739072,"data_stored":4538211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":64551370},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61976,"kb_used_data":4432,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94309864,"statfs":{"total":96636764160,"available":96573300736,"internally_reserved":0,"allocated":4538368,"data_stored":4337555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574907,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62040,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94309800,"statfs":{"total":96636764160,"available":96573235200,"internally_reserved":0,"allocated":344064,"data_stored":143129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574907,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67072,"kb_used_data":4024,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94304768,"statfs":{"total":96636764160,"available":96568082432,"internally_reserved":0,"allocated":4120576,"data_stored":3907469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123396,"kb_used_data":15932,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94248444,"statfs":{"total":96636764160,"available":96510406656,"internally_reserved":0,"allocated":16314368,"data_stored":16102349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":110033351},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574907,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57872,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313968,"statfs":{"total":96636764160,"available":96577503232,"internally_reserved":0,"allocated":335872,"data_stored":142538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49500,"kb_used_data":4436,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94322340,"statfs":{"total":96636764160,"available":96586076160,"internally_reserved":0,"allocated":4542464,"data_stored":4337121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574907,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62616,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94309224,"statfs":{"total":96636764160,"available":96572645376,"internally_reserved":0,"allocated":933888,"data_stored":732969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8015872,"data_stored":8000689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3813376,"data_stored":3805790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4194998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7974912,"data_stored":7959870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3780608,"data_stored":3765380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T01:43:49.952 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T01:43:50.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.089+0000 7fd906eb3640 1 Processor -- start 2024-04-25T01:43:50.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.089+0000 7fd906eb3640 1 -- start start 2024-04-25T01:43:50.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.090+0000 7fd906eb3640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd900150320 0x7fd900156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:50.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.090+0000 7fd906eb3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd90006d0a0 0x7fd90006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:50.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.090+0000 7fd906eb3640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd900153be0 con 0x7fd900154380 2024-04-25T01:43:50.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.090+0000 7fd906eb3640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd900152fd0 con 0x7fd900150320 2024-04-25T01:43:50.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.090+0000 7fd906eb3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd9001532b0 con 0x7fd90006d0a0 2024-04-25T01:43:50.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.090+0000 7fd904c4f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd900150320 0x7fd900156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:50.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.090+0000 7fd904c4f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd900150320 0x7fd900156bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58996/0 (socket says 172.21.15.77:58996) 2024-04-25T01:43:50.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.090+0000 7fd904c4f640 1 -- 172.21.15.77:0/2546494824 learned_addr learned my addr 172.21.15.77:0/2546494824 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:50.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.090+0000 7fd8fffff640 1 --2- 172.21.15.77:0/2546494824 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd90006d0a0 0x7fd90006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:50.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.090+0000 7fd904c4f640 1 -- 172.21.15.77:0/2546494824 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd90006d0a0 msgr2=0x7fd90006d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:50.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.090+0000 7fd904c4f640 1 --2- 172.21.15.77:0/2546494824 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd90006d0a0 0x7fd90006d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.090+0000 7fd904c4f640 1 -- 172.21.15.77:0/2546494824 >> v1:172.21.15.121:6789/0 conn(0x7fd900154380 legacy=0x7fd900154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:50.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.090+0000 7fd904c4f640 1 -- 172.21.15.77:0/2546494824 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd900157100 con 0x7fd900150320 2024-04-25T01:43:50.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.091+0000 7fd904c4f640 1 --2- 172.21.15.77:0/2546494824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd900150320 0x7fd900156bc0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009870 tx=0x7fd8f002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=413db62af00fb14d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:50.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.091+0000 7fd8ff7fe640 1 -- 172.21.15.77:0/2546494824 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0037070 con 0x7fd900150320 2024-04-25T01:43:50.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.091+0000 7fd8ff7fe640 1 -- 172.21.15.77:0/2546494824 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f0032440 con 0x7fd900150320 2024-04-25T01:43:50.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.091+0000 7fd8ff7fe640 1 -- 172.21.15.77:0/2546494824 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0032810 con 0x7fd900150320 2024-04-25T01:43:50.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.092+0000 7fd906eb3640 1 -- 172.21.15.77:0/2546494824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd900150320 msgr2=0x7fd900156bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:50.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.092+0000 7fd906eb3640 1 --2- 172.21.15.77:0/2546494824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd900150320 0x7fd900156bc0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009870 tx=0x7fd8f002a1c0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.092+0000 7fd906eb3640 1 -- 172.21.15.77:0/2546494824 shutdown_connections 2024-04-25T01:43:50.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.092+0000 7fd906eb3640 1 --2- 172.21.15.77:0/2546494824 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd90006d0a0 0x7fd90006d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.092+0000 7fd906eb3640 1 --2- 172.21.15.77:0/2546494824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd900150320 0x7fd900156bc0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.092+0000 7fd906eb3640 1 -- 172.21.15.77:0/2546494824 >> 172.21.15.77:0/2546494824 conn(0x7fd9000c3f80 msgr2=0x7fd9000c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:50.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.092+0000 7fd906eb3640 1 -- 172.21.15.77:0/2546494824 shutdown_connections 2024-04-25T01:43:50.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.092+0000 7fd906eb3640 1 -- 172.21.15.77:0/2546494824 wait complete. 2024-04-25T01:43:50.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.093+0000 7fd906eb3640 1 Processor -- start 2024-04-25T01:43:50.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.093+0000 7fd906eb3640 1 -- start start 2024-04-25T01:43:50.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.094+0000 7fd906eb3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd90006d0a0 0x7fd9000c1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:50.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.094+0000 7fd906eb3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd900150320 0x7fd9001436c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:50.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.094+0000 7fd906eb3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd900154380 0x7fd900143c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:50.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.094+0000 7fd906eb3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd900154f10 con 0x7fd900154380 2024-04-25T01:43:50.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.094+0000 7fd906eb3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd900153870 con 0x7fd900150320 2024-04-25T01:43:50.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.094+0000 7fd906eb3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd900155090 con 0x7fd90006d0a0 2024-04-25T01:43:50.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.094+0000 7fd905450640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd900154380 0x7fd900143c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:50.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.094+0000 7fd905450640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd900154380 0x7fd900143c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59010/0 (socket says 172.21.15.77:59010) 2024-04-25T01:43:50.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.094+0000 7fd905450640 1 -- 172.21.15.77:0/1432945350 learned_addr learned my addr 172.21.15.77:0/1432945350 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:50.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.094+0000 7fd8fffff640 1 --2- 172.21.15.77:0/1432945350 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd900150320 0x7fd9001436c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:50.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.094+0000 7fd904c4f640 1 --2- 172.21.15.77:0/1432945350 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd90006d0a0 0x7fd9000c1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:50.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.094+0000 7fd905450640 1 -- 172.21.15.77:0/1432945350 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd90006d0a0 msgr2=0x7fd9000c1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:50.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.094+0000 7fd905450640 1 --2- 172.21.15.77:0/1432945350 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd90006d0a0 0x7fd9000c1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.094+0000 7fd905450640 1 -- 172.21.15.77:0/1432945350 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd900150320 msgr2=0x7fd9001436c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:50.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.094+0000 7fd905450640 1 --2- 172.21.15.77:0/1432945350 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd900150320 0x7fd9001436c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.094+0000 7fd905450640 1 -- 172.21.15.77:0/1432945350 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd900144140 con 0x7fd900154380 2024-04-25T01:43:50.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.094+0000 7fd905450640 1 --2- 172.21.15.77:0/1432945350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd900154380 0x7fd900143c00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800c6e0 tx=0x7fd8f800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:50.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.094+0000 7fd8fd7fa640 1 -- 172.21.15.77:0/1432945350 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8003b70 con 0x7fd900154380 2024-04-25T01:43:50.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.094+0000 7fd8fd7fa640 1 -- 172.21.15.77:0/1432945350 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f8003d30 con 0x7fd900154380 2024-04-25T01:43:50.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.094+0000 7fd906eb3640 1 -- 172.21.15.77:0/1432945350 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd900072790 con 0x7fd900154380 2024-04-25T01:43:50.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.094+0000 7fd8fd7fa640 1 -- 172.21.15.77:0/1432945350 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8005310 con 0x7fd900154380 2024-04-25T01:43:50.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.094+0000 7fd906eb3640 1 -- 172.21.15.77:0/1432945350 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd900072d50 con 0x7fd900154380 2024-04-25T01:43:50.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.095+0000 7fd906eb3640 1 -- 172.21.15.77:0/1432945350 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd90004f500 con 0x7fd900154380 2024-04-25T01:43:50.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.096+0000 7fd8fd7fa640 1 -- 172.21.15.77:0/1432945350 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd8f80054b0 con 0x7fd900154380 2024-04-25T01:43:50.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.096+0000 7fd8fd7fa640 1 --2- 172.21.15.77:0/1432945350 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd8ec06be60 0x7fd8ec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:50.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.096+0000 7fd904c4f640 1 --2- 172.21.15.77:0/1432945350 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd8ec06be60 0x7fd8ec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:50.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.096+0000 7fd8fd7fa640 1 -- 172.21.15.77:0/1432945350 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7fd8f808b000 con 0x7fd900154380 2024-04-25T01:43:50.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.097+0000 7fd904c4f640 1 --2- 172.21.15.77:0/1432945350 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd8ec06be60 0x7fd8ec06e320 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0034000 tx=0x7fd8f002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:50.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.101+0000 7fd8fd7fa640 1 -- 172.21.15.77:0/1432945350 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd8f8058ea0 con 0x7fd900154380 2024-04-25T01:43:50.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.270+0000 7fd906eb3640 1 -- 172.21.15.77:0/1432945350 --> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd900073750 con 0x7fd8ec06be60 2024-04-25T01:43:50.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.281+0000 7fd8fd7fa640 1 -- 172.21.15.77:0/1432945350 <== mgr.4098 v2:172.21.15.77:6832/4208232183 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+492656 (secure 0 0 0) 0x7fd900073750 con 0x7fd8ec06be60 2024-04-25T01:43:50.277 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:43:50.280 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-25T01:43:50.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.285+0000 7fd906eb3640 1 -- 172.21.15.77:0/1432945350 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd8ec06be60 msgr2=0x7fd8ec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:50.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.285+0000 7fd906eb3640 1 --2- 172.21.15.77:0/1432945350 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd8ec06be60 0x7fd8ec06e320 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0034000 tx=0x7fd8f002e000 comp rx=0 tx=0).stop 2024-04-25T01:43:50.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.285+0000 7fd906eb3640 1 -- 172.21.15.77:0/1432945350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd900154380 msgr2=0x7fd900143c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:50.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.285+0000 7fd906eb3640 1 --2- 172.21.15.77:0/1432945350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd900154380 0x7fd900143c00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800c6e0 tx=0x7fd8f800cba0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.285+0000 7fd906eb3640 1 -- 172.21.15.77:0/1432945350 shutdown_connections 2024-04-25T01:43:50.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.285+0000 7fd906eb3640 1 --2- 172.21.15.77:0/1432945350 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd8ec06be60 0x7fd8ec06e320 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.285+0000 7fd906eb3640 1 --2- 172.21.15.77:0/1432945350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd900154380 0x7fd900143c00 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.285+0000 7fd906eb3640 1 --2- 172.21.15.77:0/1432945350 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd900150320 0x7fd9001436c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.285+0000 7fd906eb3640 1 --2- 172.21.15.77:0/1432945350 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd90006d0a0 0x7fd9000c1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.285+0000 7fd906eb3640 1 -- 172.21.15.77:0/1432945350 >> 172.21.15.77:0/1432945350 conn(0x7fd9000c3f80 msgr2=0x7fd9001559c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:50.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.285+0000 7fd906eb3640 1 -- 172.21.15.77:0/1432945350 shutdown_connections 2024-04-25T01:43:50.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.285+0000 7fd906eb3640 1 -- 172.21.15.77:0/1432945350 wait complete. 2024-04-25T01:43:50.287 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2024-04-25T01:43:49.724066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16552905,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":520,"num_read_kb":8330,"num_write":26446,"num_write_kb":50357087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31315,"ondisk_log_size":31315,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":552148,"kb_used_data":35028,"kb_used_omap":12,"kb_used_meta":517043,"kb_avail":754422572,"statfs":{"total":773094113280,"available":772528713728,"internally_reserved":0,"allocated":35868672,"data_stored":34241341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":529452592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1623193311,"num_objects":-387,"num_object_clones":0,"num_object_copies":-774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-387,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":391,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003598"},"pg_stats":[{"pgid":"5.18","version":"30'210","reported_seq":235,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.740479+0000","last_change":"2024-04-25T01:39:33.445614+0000","last_active":"2024-04-25T01:43:34.740479+0000","last_peered":"2024-04-25T01:43:34.740479+0000","last_clean":"2024-04-25T01:43:34.740479+0000","last_became_active":"2024-04-25T01:39:33.445090+0000","last_became_peered":"2024-04-25T01:39:33.445090+0000","last_unstale":"2024-04-25T01:43:34.740479+0000","last_undegraded":"2024-04-25T01:43:34.740479+0000","last_fullsized":"2024-04-25T01:43:34.740479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:50.951488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"29'6","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403369+0000","last_change":"2024-04-25T01:39:23.377096+0000","last_active":"2024-04-25T01:43:29.403369+0000","last_peered":"2024-04-25T01:43:29.403369+0000","last_clean":"2024-04-25T01:43:29.403369+0000","last_became_active":"2024-04-25T01:39:23.376811+0000","last_became_peered":"2024-04-25T01:39:23.376811+0000","last_unstale":"2024-04-25T01:43:29.403369+0000","last_undegraded":"2024-04-25T01:43:29.403369+0000","last_fullsized":"2024-04-25T01:43:29.403369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:26.888605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"30'181","reported_seq":215,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.883447+0000","last_change":"2024-04-25T01:39:24.394317+0000","last_active":"2024-04-25T01:43:46.883447+0000","last_peered":"2024-04-25T01:43:46.883447+0000","last_clean":"2024-04-25T01:43:46.883447+0000","last_became_active":"2024-04-25T01:39:24.394032+0000","last_became_peered":"2024-04-25T01:39:24.394032+0000","last_unstale":"2024-04-25T01:43:46.883447+0000","last_undegraded":"2024-04-25T01:43:46.883447+0000","last_fullsized":"2024-04-25T01:43:46.883447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:11.795443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.407597+0000","last_change":"2024-04-25T01:39:32.421607+0000","last_active":"2024-04-25T01:43:29.407597+0000","last_peered":"2024-04-25T01:43:29.407597+0000","last_clean":"2024-04-25T01:43:29.407597+0000","last_became_active":"2024-04-25T01:39:32.421355+0000","last_became_peered":"2024-04-25T01:39:32.421355+0000","last_unstale":"2024-04-25T01:43:29.407597+0000","last_undegraded":"2024-04-25T01:43:29.407597+0000","last_fullsized":"2024-04-25T01:43:29.407597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:12:14.019262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"30'203","reported_seq":228,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.744955+0000","last_change":"2024-04-25T01:39:33.436651+0000","last_active":"2024-04-25T01:43:34.744955+0000","last_peered":"2024-04-25T01:43:34.744955+0000","last_clean":"2024-04-25T01:43:34.744955+0000","last_became_active":"2024-04-25T01:39:33.436370+0000","last_became_peered":"2024-04-25T01:39:33.436370+0000","last_unstale":"2024-04-25T01:43:34.744955+0000","last_undegraded":"2024-04-25T01:43:34.744955+0000","last_fullsized":"2024-04-25T01:43:34.744955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:57:10.341738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"29'3","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.408859+0000","last_change":"2024-04-25T01:39:23.369400+0000","last_active":"2024-04-25T01:43:29.408859+0000","last_peered":"2024-04-25T01:43:29.408859+0000","last_clean":"2024-04-25T01:43:29.408859+0000","last_became_active":"2024-04-25T01:39:23.368726+0000","last_became_peered":"2024-04-25T01:39:23.368726+0000","last_unstale":"2024-04-25T01:43:29.408859+0000","last_undegraded":"2024-04-25T01:43:29.408859+0000","last_fullsized":"2024-04-25T01:43:29.408859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:35:42.971179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"30'177","reported_seq":211,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.894898+0000","last_change":"2024-04-25T01:39:24.403873+0000","last_active":"2024-04-25T01:43:46.894898+0000","last_peered":"2024-04-25T01:43:46.894898+0000","last_clean":"2024-04-25T01:43:46.894898+0000","last_became_active":"2024-04-25T01:39:24.403623+0000","last_became_peered":"2024-04-25T01:39:24.403623+0000","last_unstale":"2024-04-25T01:43:46.894898+0000","last_undegraded":"2024-04-25T01:43:46.894898+0000","last_fullsized":"2024-04-25T01:43:46.894898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:49.360933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.402853+0000","last_change":"2024-04-25T01:39:32.430985+0000","last_active":"2024-04-25T01:43:29.402853+0000","last_peered":"2024-04-25T01:43:29.402853+0000","last_clean":"2024-04-25T01:43:29.402853+0000","last_became_active":"2024-04-25T01:39:32.430617+0000","last_became_peered":"2024-04-25T01:39:32.430617+0000","last_unstale":"2024-04-25T01:43:29.402853+0000","last_undegraded":"2024-04-25T01:43:29.402853+0000","last_fullsized":"2024-04-25T01:43:29.402853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:13.938619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"30'163","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.712918+0000","last_change":"2024-04-25T01:39:33.444043+0000","last_active":"2024-04-25T01:43:34.712918+0000","last_peered":"2024-04-25T01:43:34.712918+0000","last_clean":"2024-04-25T01:43:34.712918+0000","last_became_active":"2024-04-25T01:39:33.443737+0000","last_became_peered":"2024-04-25T01:39:33.443737+0000","last_unstale":"2024-04-25T01:43:34.712918+0000","last_undegraded":"2024-04-25T01:43:34.712918+0000","last_fullsized":"2024-04-25T01:43:34.712918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:02:50.401910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"29'4","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.398875+0000","last_change":"2024-04-25T01:39:23.377963+0000","last_active":"2024-04-25T01:43:29.398875+0000","last_peered":"2024-04-25T01:43:29.398875+0000","last_clean":"2024-04-25T01:43:29.398875+0000","last_became_active":"2024-04-25T01:39:23.377402+0000","last_became_peered":"2024-04-25T01:39:23.377402+0000","last_unstale":"2024-04-25T01:43:29.398875+0000","last_undegraded":"2024-04-25T01:43:29.398875+0000","last_fullsized":"2024-04-25T01:43:29.398875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:15.873450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"30'160","reported_seq":193,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.895882+0000","last_change":"2024-04-25T01:39:24.394512+0000","last_active":"2024-04-25T01:43:46.895882+0000","last_peered":"2024-04-25T01:43:46.895882+0000","last_clean":"2024-04-25T01:43:46.895882+0000","last_became_active":"2024-04-25T01:39:24.393954+0000","last_became_peered":"2024-04-25T01:39:24.393954+0000","last_unstale":"2024-04-25T01:43:46.895882+0000","last_undegraded":"2024-04-25T01:43:46.895882+0000","last_fullsized":"2024-04-25T01:43:46.895882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:30.534400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1806","reported_seq":1835,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:35.171137+0000","last_change":"2024-04-25T01:39:32.428198+0000","last_active":"2024-04-25T01:43:35.171137+0000","last_peered":"2024-04-25T01:43:35.171137+0000","last_clean":"2024-04-25T01:43:35.171137+0000","last_became_active":"2024-04-25T01:39:32.427955+0000","last_became_peered":"2024-04-25T01:39:32.427955+0000","last_unstale":"2024-04-25T01:43:35.171137+0000","last_undegraded":"2024-04-25T01:43:35.171137+0000","last_fullsized":"2024-04-25T01:43:35.171137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1806,"log_dups_size":0,"ondisk_log_size":1806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:07.684150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3764872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":3663,"num_write":1802,"num_write_kb":5410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"30'173","reported_seq":198,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.693724+0000","last_change":"2024-04-25T01:39:33.439854+0000","last_active":"2024-04-25T01:43:34.693724+0000","last_peered":"2024-04-25T01:43:34.693724+0000","last_clean":"2024-04-25T01:43:34.693724+0000","last_became_active":"2024-04-25T01:39:33.439555+0000","last_became_peered":"2024-04-25T01:39:33.439555+0000","last_unstale":"2024-04-25T01:43:34.693724+0000","last_undegraded":"2024-04-25T01:43:34.693724+0000","last_fullsized":"2024-04-25T01:43:34.693724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:50.250748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.397933+0000","last_change":"2024-04-25T01:39:23.377093+0000","last_active":"2024-04-25T01:43:29.397933+0000","last_peered":"2024-04-25T01:43:29.397933+0000","last_clean":"2024-04-25T01:43:29.397933+0000","last_became_active":"2024-04-25T01:39:23.376744+0000","last_became_peered":"2024-04-25T01:39:23.376744+0000","last_unstale":"2024-04-25T01:43:29.397933+0000","last_undegraded":"2024-04-25T01:43:29.397933+0000","last_fullsized":"2024-04-25T01:43:29.397933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:43.529618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"30'198","reported_seq":231,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.898863+0000","last_change":"2024-04-25T01:39:24.393293+0000","last_active":"2024-04-25T01:43:46.898863+0000","last_peered":"2024-04-25T01:43:46.898863+0000","last_clean":"2024-04-25T01:43:46.898863+0000","last_became_active":"2024-04-25T01:39:24.393005+0000","last_became_peered":"2024-04-25T01:39:24.393005+0000","last_unstale":"2024-04-25T01:43:46.898863+0000","last_undegraded":"2024-04-25T01:43:46.898863+0000","last_fullsized":"2024-04-25T01:43:46.898863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:32.070747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'4","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403096+0000","last_change":"2024-04-25T01:39:32.428956+0000","last_active":"2024-04-25T01:43:29.403096+0000","last_peered":"2024-04-25T01:43:29.403096+0000","last_clean":"2024-04-25T01:43:29.403096+0000","last_became_active":"2024-04-25T01:39:32.428705+0000","last_became_peered":"2024-04-25T01:39:32.428705+0000","last_unstale":"2024-04-25T01:43:29.403096+0000","last_undegraded":"2024-04-25T01:43:29.403096+0000","last_fullsized":"2024-04-25T01:43:29.403096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:06:22.998986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"30'179","reported_seq":204,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.750752+0000","last_change":"2024-04-25T01:39:33.446571+0000","last_active":"2024-04-25T01:43:34.750752+0000","last_peered":"2024-04-25T01:43:34.750752+0000","last_clean":"2024-04-25T01:43:34.750752+0000","last_became_active":"2024-04-25T01:39:33.446234+0000","last_became_peered":"2024-04-25T01:39:33.446234+0000","last_unstale":"2024-04-25T01:43:34.750752+0000","last_undegraded":"2024-04-25T01:43:34.750752+0000","last_fullsized":"2024-04-25T01:43:34.750752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:12.742092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"30'156","reported_seq":190,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.887578+0000","last_change":"2024-04-25T01:39:24.398859+0000","last_active":"2024-04-25T01:43:46.887578+0000","last_peered":"2024-04-25T01:43:46.887578+0000","last_clean":"2024-04-25T01:43:46.887578+0000","last_became_active":"2024-04-25T01:39:24.398618+0000","last_became_peered":"2024-04-25T01:39:24.398618+0000","last_unstale":"2024-04-25T01:43:46.887578+0000","last_undegraded":"2024-04-25T01:43:46.887578+0000","last_fullsized":"2024-04-25T01:43:46.887578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:15.278376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'5","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.397841+0000","last_change":"2024-04-25T01:39:23.377717+0000","last_active":"2024-04-25T01:43:29.397841+0000","last_peered":"2024-04-25T01:43:29.397841+0000","last_clean":"2024-04-25T01:43:29.397841+0000","last_became_active":"2024-04-25T01:39:23.377291+0000","last_became_peered":"2024-04-25T01:39:23.377291+0000","last_unstale":"2024-04-25T01:43:29.397841+0000","last_undegraded":"2024-04-25T01:43:29.397841+0000","last_fullsized":"2024-04-25T01:43:29.397841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:06.402745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403630+0000","last_change":"2024-04-25T01:39:32.426840+0000","last_active":"2024-04-25T01:43:29.403630+0000","last_peered":"2024-04-25T01:43:29.403630+0000","last_clean":"2024-04-25T01:43:29.403630+0000","last_became_active":"2024-04-25T01:39:32.426529+0000","last_became_peered":"2024-04-25T01:39:32.426529+0000","last_unstale":"2024-04-25T01:43:29.403630+0000","last_undegraded":"2024-04-25T01:43:29.403630+0000","last_fullsized":"2024-04-25T01:43:29.403630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:57.097685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"30'193","reported_seq":218,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.726718+0000","last_change":"2024-04-25T01:39:33.437767+0000","last_active":"2024-04-25T01:43:34.726718+0000","last_peered":"2024-04-25T01:43:34.726718+0000","last_clean":"2024-04-25T01:43:34.726718+0000","last_became_active":"2024-04-25T01:39:33.437483+0000","last_became_peered":"2024-04-25T01:39:33.437483+0000","last_unstale":"2024-04-25T01:43:34.726718+0000","last_undegraded":"2024-04-25T01:43:34.726718+0000","last_fullsized":"2024-04-25T01:43:34.726718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:44.321779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"30'164","reported_seq":197,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.877665+0000","last_change":"2024-04-25T01:39:24.387100+0000","last_active":"2024-04-25T01:43:46.877665+0000","last_peered":"2024-04-25T01:43:46.877665+0000","last_clean":"2024-04-25T01:43:46.877665+0000","last_became_active":"2024-04-25T01:39:24.386782+0000","last_became_peered":"2024-04-25T01:39:24.386782+0000","last_unstale":"2024-04-25T01:43:46.877665+0000","last_undegraded":"2024-04-25T01:43:46.877665+0000","last_fullsized":"2024-04-25T01:43:46.877665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:48.789139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.402653+0000","last_change":"2024-04-25T01:39:23.368446+0000","last_active":"2024-04-25T01:43:29.402653+0000","last_peered":"2024-04-25T01:43:29.402653+0000","last_clean":"2024-04-25T01:43:29.402653+0000","last_became_active":"2024-04-25T01:39:23.368183+0000","last_became_peered":"2024-04-25T01:39:23.368183+0000","last_unstale":"2024-04-25T01:43:29.402653+0000","last_undegraded":"2024-04-25T01:43:29.402653+0000","last_fullsized":"2024-04-25T01:43:29.402653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:13.738756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403500+0000","last_change":"2024-04-25T01:39:32.427589+0000","last_active":"2024-04-25T01:43:29.403500+0000","last_peered":"2024-04-25T01:43:29.403500+0000","last_clean":"2024-04-25T01:43:29.403500+0000","last_became_active":"2024-04-25T01:39:32.427328+0000","last_became_peered":"2024-04-25T01:39:32.427328+0000","last_unstale":"2024-04-25T01:43:29.403500+0000","last_undegraded":"2024-04-25T01:43:29.403500+0000","last_fullsized":"2024-04-25T01:43:29.403500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:12.328303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"30'191","reported_seq":216,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.768647+0000","last_change":"2024-04-25T01:39:33.447634+0000","last_active":"2024-04-25T01:43:34.768647+0000","last_peered":"2024-04-25T01:43:34.768647+0000","last_clean":"2024-04-25T01:43:34.768647+0000","last_became_active":"2024-04-25T01:39:33.445908+0000","last_became_peered":"2024-04-25T01:39:33.445908+0000","last_unstale":"2024-04-25T01:43:34.768647+0000","last_undegraded":"2024-04-25T01:43:34.768647+0000","last_fullsized":"2024-04-25T01:43:34.768647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:13.586396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"30'170","reported_seq":204,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.880762+0000","last_change":"2024-04-25T01:39:24.373600+0000","last_active":"2024-04-25T01:43:46.880762+0000","last_peered":"2024-04-25T01:43:46.880762+0000","last_clean":"2024-04-25T01:43:46.880762+0000","last_became_active":"2024-04-25T01:39:24.373311+0000","last_became_peered":"2024-04-25T01:39:24.373311+0000","last_unstale":"2024-04-25T01:43:46.880762+0000","last_undegraded":"2024-04-25T01:43:46.880762+0000","last_fullsized":"2024-04-25T01:43:46.880762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:46.338959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.402749+0000","last_change":"2024-04-25T01:39:23.377103+0000","last_active":"2024-04-25T01:43:29.402749+0000","last_peered":"2024-04-25T01:43:29.402749+0000","last_clean":"2024-04-25T01:43:29.402749+0000","last_became_active":"2024-04-25T01:39:23.376826+0000","last_became_peered":"2024-04-25T01:39:23.376826+0000","last_unstale":"2024-04-25T01:43:29.402749+0000","last_undegraded":"2024-04-25T01:43:29.402749+0000","last_fullsized":"2024-04-25T01:43:29.402749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:46.663754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.404054+0000","last_change":"2024-04-25T01:39:32.426839+0000","last_active":"2024-04-25T01:43:29.404054+0000","last_peered":"2024-04-25T01:43:29.404054+0000","last_clean":"2024-04-25T01:43:29.404054+0000","last_became_active":"2024-04-25T01:39:32.426545+0000","last_became_peered":"2024-04-25T01:39:32.426545+0000","last_unstale":"2024-04-25T01:43:29.404054+0000","last_undegraded":"2024-04-25T01:43:29.404054+0000","last_fullsized":"2024-04-25T01:43:29.404054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:22.161839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"30'171","reported_seq":196,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.686031+0000","last_change":"2024-04-25T01:39:33.444616+0000","last_active":"2024-04-25T01:43:34.686031+0000","last_peered":"2024-04-25T01:43:34.686031+0000","last_clean":"2024-04-25T01:43:34.686031+0000","last_became_active":"2024-04-25T01:39:33.444350+0000","last_became_peered":"2024-04-25T01:39:33.444350+0000","last_unstale":"2024-04-25T01:43:34.686031+0000","last_undegraded":"2024-04-25T01:43:34.686031+0000","last_fullsized":"2024-04-25T01:43:34.686031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:47:15.686320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"30'147","reported_seq":181,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.868654+0000","last_change":"2024-04-25T01:39:24.386969+0000","last_active":"2024-04-25T01:43:46.868654+0000","last_peered":"2024-04-25T01:43:46.868654+0000","last_clean":"2024-04-25T01:43:46.868654+0000","last_became_active":"2024-04-25T01:39:24.386376+0000","last_became_peered":"2024-04-25T01:39:24.386376+0000","last_unstale":"2024-04-25T01:43:46.868654+0000","last_undegraded":"2024-04-25T01:43:46.868654+0000","last_fullsized":"2024-04-25T01:43:46.868654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:13:31.585462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.397503+0000","last_change":"2024-04-25T01:39:23.378993+0000","last_active":"2024-04-25T01:43:29.397503+0000","last_peered":"2024-04-25T01:43:29.397503+0000","last_clean":"2024-04-25T01:43:29.397503+0000","last_became_active":"2024-04-25T01:39:23.376908+0000","last_became_peered":"2024-04-25T01:39:23.376908+0000","last_unstale":"2024-04-25T01:43:29.397503+0000","last_undegraded":"2024-04-25T01:43:29.397503+0000","last_fullsized":"2024-04-25T01:43:29.397503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:13:18.370559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.424880+0000","last_change":"2024-04-25T01:39:32.433597+0000","last_active":"2024-04-25T01:43:32.424880+0000","last_peered":"2024-04-25T01:43:32.424880+0000","last_clean":"2024-04-25T01:43:32.424880+0000","last_became_active":"2024-04-25T01:39:32.433307+0000","last_became_peered":"2024-04-25T01:39:32.433307+0000","last_unstale":"2024-04-25T01:43:32.424880+0000","last_undegraded":"2024-04-25T01:43:32.424880+0000","last_fullsized":"2024-04-25T01:43:32.424880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:20.784385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"30'175","reported_seq":201,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.754290+0000","last_change":"2024-04-25T01:39:33.427297+0000","last_active":"2024-04-25T01:43:34.754290+0000","last_peered":"2024-04-25T01:43:34.754290+0000","last_clean":"2024-04-25T01:43:34.754290+0000","last_became_active":"2024-04-25T01:39:33.426132+0000","last_became_peered":"2024-04-25T01:39:33.426132+0000","last_unstale":"2024-04-25T01:43:34.754290+0000","last_undegraded":"2024-04-25T01:43:34.754290+0000","last_fullsized":"2024-04-25T01:43:34.754290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:04.147341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"30'175","reported_seq":209,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.879746+0000","last_change":"2024-04-25T01:39:24.393003+0000","last_active":"2024-04-25T01:43:46.879746+0000","last_peered":"2024-04-25T01:43:46.879746+0000","last_clean":"2024-04-25T01:43:46.879746+0000","last_became_active":"2024-04-25T01:39:24.392209+0000","last_became_peered":"2024-04-25T01:39:24.392209+0000","last_unstale":"2024-04-25T01:43:46.879746+0000","last_undegraded":"2024-04-25T01:43:46.879746+0000","last_fullsized":"2024-04-25T01:43:46.879746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:44:58.432859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"30'3","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:35.181348+0000","last_change":"2024-04-25T01:39:23.379804+0000","last_active":"2024-04-25T01:43:35.181348+0000","last_peered":"2024-04-25T01:43:35.181348+0000","last_clean":"2024-04-25T01:43:35.181348+0000","last_became_active":"2024-04-25T01:39:23.379430+0000","last_became_peered":"2024-04-25T01:39:23.379430+0000","last_unstale":"2024-04-25T01:43:35.181348+0000","last_undegraded":"2024-04-25T01:43:35.181348+0000","last_fullsized":"2024-04-25T01:43:35.181348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:42:23.254767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.426420+0000","last_change":"2024-04-25T01:39:32.432763+0000","last_active":"2024-04-25T01:43:32.426420+0000","last_peered":"2024-04-25T01:43:32.426420+0000","last_clean":"2024-04-25T01:43:32.426420+0000","last_became_active":"2024-04-25T01:39:32.432482+0000","last_became_peered":"2024-04-25T01:39:32.432482+0000","last_unstale":"2024-04-25T01:43:32.426420+0000","last_undegraded":"2024-04-25T01:43:32.426420+0000","last_fullsized":"2024-04-25T01:43:32.426420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:04.848726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"30'176","reported_seq":202,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.767725+0000","last_change":"2024-04-25T01:39:33.445800+0000","last_active":"2024-04-25T01:43:34.767725+0000","last_peered":"2024-04-25T01:43:34.767725+0000","last_clean":"2024-04-25T01:43:34.767725+0000","last_became_active":"2024-04-25T01:39:33.445500+0000","last_became_peered":"2024-04-25T01:39:33.445500+0000","last_unstale":"2024-04-25T01:43:34.767725+0000","last_undegraded":"2024-04-25T01:43:34.767725+0000","last_fullsized":"2024-04-25T01:43:34.767725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:06:36.800043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"30'154","reported_seq":173,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.886331+0000","last_change":"2024-04-25T01:40:06.055331+0000","last_active":"2024-04-25T01:43:46.886331+0000","last_peered":"2024-04-25T01:43:46.886331+0000","last_clean":"2024-04-25T01:43:46.886331+0000","last_became_active":"2024-04-25T01:40:06.055084+0000","last_became_peered":"2024-04-25T01:40:06.055084+0000","last_unstale":"2024-04-25T01:43:46.886331+0000","last_undegraded":"2024-04-25T01:43:46.886331+0000","last_fullsized":"2024-04-25T01:43:46.886331+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:15:15.409515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"30'29","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:35.407199+0000","last_change":"2024-04-25T01:39:23.377687+0000","last_active":"2024-04-25T01:43:35.407199+0000","last_peered":"2024-04-25T01:43:35.407199+0000","last_clean":"2024-04-25T01:43:35.407199+0000","last_became_active":"2024-04-25T01:39:23.377372+0000","last_became_peered":"2024-04-25T01:39:23.377372+0000","last_unstale":"2024-04-25T01:43:35.407199+0000","last_undegraded":"2024-04-25T01:43:35.407199+0000","last_fullsized":"2024-04-25T01:43:35.407199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:51.983659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":54,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.407473+0000","last_change":"2024-04-25T01:39:32.430816+0000","last_active":"2024-04-25T01:43:29.407473+0000","last_peered":"2024-04-25T01:43:29.407473+0000","last_clean":"2024-04-25T01:43:29.407473+0000","last_became_active":"2024-04-25T01:39:32.430537+0000","last_became_peered":"2024-04-25T01:39:32.430537+0000","last_unstale":"2024-04-25T01:43:29.407473+0000","last_undegraded":"2024-04-25T01:43:29.407473+0000","last_fullsized":"2024-04-25T01:43:29.407473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:58.939453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"30'198","reported_seq":224,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.725529+0000","last_change":"2024-04-25T01:39:33.440287+0000","last_active":"2024-04-25T01:43:34.725529+0000","last_peered":"2024-04-25T01:43:34.725529+0000","last_clean":"2024-04-25T01:43:34.725529+0000","last_became_active":"2024-04-25T01:39:33.439796+0000","last_became_peered":"2024-04-25T01:39:33.439796+0000","last_unstale":"2024-04-25T01:43:34.725529+0000","last_undegraded":"2024-04-25T01:43:34.725529+0000","last_fullsized":"2024-04-25T01:43:34.725529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:08.515401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"30'173","reported_seq":207,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.867380+0000","last_change":"2024-04-25T01:39:24.376933+0000","last_active":"2024-04-25T01:43:46.867380+0000","last_peered":"2024-04-25T01:43:46.867380+0000","last_clean":"2024-04-25T01:43:46.867380+0000","last_became_active":"2024-04-25T01:39:24.376612+0000","last_became_peered":"2024-04-25T01:39:24.376612+0000","last_unstale":"2024-04-25T01:43:46.867380+0000","last_undegraded":"2024-04-25T01:43:46.867380+0000","last_fullsized":"2024-04-25T01:43:46.867380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:56:55.534200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.399082+0000","last_change":"2024-04-25T01:39:23.378190+0000","last_active":"2024-04-25T01:43:29.399082+0000","last_peered":"2024-04-25T01:43:29.399082+0000","last_clean":"2024-04-25T01:43:29.399082+0000","last_became_active":"2024-04-25T01:39:23.377677+0000","last_became_peered":"2024-04-25T01:39:23.377677+0000","last_unstale":"2024-04-25T01:43:29.399082+0000","last_undegraded":"2024-04-25T01:43:29.399082+0000","last_fullsized":"2024-04-25T01:43:29.399082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:09.516058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403847+0000","last_change":"2024-04-25T01:39:32.431542+0000","last_active":"2024-04-25T01:43:29.403847+0000","last_peered":"2024-04-25T01:43:29.403847+0000","last_clean":"2024-04-25T01:43:29.403847+0000","last_became_active":"2024-04-25T01:39:32.431253+0000","last_became_peered":"2024-04-25T01:39:32.431253+0000","last_unstale":"2024-04-25T01:43:29.403847+0000","last_undegraded":"2024-04-25T01:43:29.403847+0000","last_fullsized":"2024-04-25T01:43:29.403847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:36.723239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"30'188","reported_seq":214,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.770510+0000","last_change":"2024-04-25T01:39:33.448529+0000","last_active":"2024-04-25T01:43:34.770510+0000","last_peered":"2024-04-25T01:43:34.770510+0000","last_clean":"2024-04-25T01:43:34.770510+0000","last_became_active":"2024-04-25T01:39:33.448266+0000","last_became_peered":"2024-04-25T01:39:33.448266+0000","last_unstale":"2024-04-25T01:43:34.770510+0000","last_undegraded":"2024-04-25T01:43:34.770510+0000","last_fullsized":"2024-04-25T01:43:34.770510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:18.788470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"30'155","reported_seq":189,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.897294+0000","last_change":"2024-04-25T01:39:24.390844+0000","last_active":"2024-04-25T01:43:46.897294+0000","last_peered":"2024-04-25T01:43:46.897294+0000","last_clean":"2024-04-25T01:43:46.897294+0000","last_became_active":"2024-04-25T01:39:24.390543+0000","last_became_peered":"2024-04-25T01:39:24.390543+0000","last_unstale":"2024-04-25T01:43:46.897294+0000","last_undegraded":"2024-04-25T01:43:46.897294+0000","last_fullsized":"2024-04-25T01:43:46.897294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:01:03.804058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403980+0000","last_change":"2024-04-25T01:39:23.368562+0000","last_active":"2024-04-25T01:43:29.403980+0000","last_peered":"2024-04-25T01:43:29.403980+0000","last_clean":"2024-04-25T01:43:29.403980+0000","last_became_active":"2024-04-25T01:39:23.368272+0000","last_became_peered":"2024-04-25T01:39:23.368272+0000","last_unstale":"2024-04-25T01:43:29.403980+0000","last_undegraded":"2024-04-25T01:43:29.403980+0000","last_fullsized":"2024-04-25T01:43:29.403980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:15.464993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.402026+0000","last_change":"2024-04-25T01:39:32.430196+0000","last_active":"2024-04-25T01:43:29.402026+0000","last_peered":"2024-04-25T01:43:29.402026+0000","last_clean":"2024-04-25T01:43:29.402026+0000","last_became_active":"2024-04-25T01:39:32.429759+0000","last_became_peered":"2024-04-25T01:39:32.429759+0000","last_unstale":"2024-04-25T01:43:29.402026+0000","last_undegraded":"2024-04-25T01:43:29.402026+0000","last_fullsized":"2024-04-25T01:43:29.402026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:58:09.299194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"30'171","reported_seq":197,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.746690+0000","last_change":"2024-04-25T01:39:33.440935+0000","last_active":"2024-04-25T01:43:34.746690+0000","last_peered":"2024-04-25T01:43:34.746690+0000","last_clean":"2024-04-25T01:43:34.746690+0000","last_became_active":"2024-04-25T01:39:33.439344+0000","last_became_peered":"2024-04-25T01:39:33.439344+0000","last_unstale":"2024-04-25T01:43:34.746690+0000","last_undegraded":"2024-04-25T01:43:34.746690+0000","last_fullsized":"2024-04-25T01:43:34.746690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:23.928991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"30'179","reported_seq":213,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.876122+0000","last_change":"2024-04-25T01:39:24.389203+0000","last_active":"2024-04-25T01:43:46.876122+0000","last_peered":"2024-04-25T01:43:46.876122+0000","last_clean":"2024-04-25T01:43:46.876122+0000","last_became_active":"2024-04-25T01:39:24.388306+0000","last_became_peered":"2024-04-25T01:39:24.388306+0000","last_unstale":"2024-04-25T01:43:46.876122+0000","last_undegraded":"2024-04-25T01:43:46.876122+0000","last_fullsized":"2024-04-25T01:43:46.876122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:59:33.951161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.406645+0000","last_change":"2024-04-25T01:39:23.375729+0000","last_active":"2024-04-25T01:43:29.406645+0000","last_peered":"2024-04-25T01:43:29.406645+0000","last_clean":"2024-04-25T01:43:29.406645+0000","last_became_active":"2024-04-25T01:39:23.375488+0000","last_became_peered":"2024-04-25T01:39:23.375488+0000","last_unstale":"2024-04-25T01:43:29.406645+0000","last_undegraded":"2024-04-25T01:43:29.406645+0000","last_fullsized":"2024-04-25T01:43:29.406645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:00.039083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403502+0000","last_change":"2024-04-25T01:39:32.427586+0000","last_active":"2024-04-25T01:43:29.403502+0000","last_peered":"2024-04-25T01:43:29.403502+0000","last_clean":"2024-04-25T01:43:29.403502+0000","last_became_active":"2024-04-25T01:39:32.427282+0000","last_became_peered":"2024-04-25T01:39:32.427282+0000","last_unstale":"2024-04-25T01:43:29.403502+0000","last_undegraded":"2024-04-25T01:43:29.403502+0000","last_fullsized":"2024-04-25T01:43:29.403502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:35.956279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'200","reported_seq":225,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.753861+0000","last_change":"2024-04-25T01:39:33.438949+0000","last_active":"2024-04-25T01:43:34.753861+0000","last_peered":"2024-04-25T01:43:34.753861+0000","last_clean":"2024-04-25T01:43:34.753861+0000","last_became_active":"2024-04-25T01:39:33.438669+0000","last_became_peered":"2024-04-25T01:39:33.438669+0000","last_unstale":"2024-04-25T01:43:34.753861+0000","last_undegraded":"2024-04-25T01:43:34.753861+0000","last_fullsized":"2024-04-25T01:43:34.753861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:07.849060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"30'162","reported_seq":196,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.873816+0000","last_change":"2024-04-25T01:39:24.377438+0000","last_active":"2024-04-25T01:43:46.873816+0000","last_peered":"2024-04-25T01:43:46.873816+0000","last_clean":"2024-04-25T01:43:46.873816+0000","last_became_active":"2024-04-25T01:39:24.377146+0000","last_became_peered":"2024-04-25T01:39:24.377146+0000","last_unstale":"2024-04-25T01:43:46.873816+0000","last_undegraded":"2024-04-25T01:43:46.873816+0000","last_fullsized":"2024-04-25T01:43:46.873816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:54:17.698561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":327680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"30'5","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:31.449181+0000","last_change":"2024-04-25T01:39:23.371019+0000","last_active":"2024-04-25T01:43:31.449181+0000","last_peered":"2024-04-25T01:43:31.449181+0000","last_clean":"2024-04-25T01:43:31.449181+0000","last_became_active":"2024-04-25T01:39:23.370727+0000","last_became_peered":"2024-04-25T01:39:23.370727+0000","last_unstale":"2024-04-25T01:43:31.449181+0000","last_undegraded":"2024-04-25T01:43:31.449181+0000","last_fullsized":"2024-04-25T01:43:31.449181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:10.714475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'3","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.435640+0000","last_change":"2024-04-25T01:39:32.431610+0000","last_active":"2024-04-25T01:43:32.435640+0000","last_peered":"2024-04-25T01:43:32.435640+0000","last_clean":"2024-04-25T01:43:32.435640+0000","last_became_active":"2024-04-25T01:39:32.431335+0000","last_became_peered":"2024-04-25T01:39:32.431335+0000","last_unstale":"2024-04-25T01:43:32.435640+0000","last_undegraded":"2024-04-25T01:43:32.435640+0000","last_fullsized":"2024-04-25T01:43:32.435640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:54.882078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"30'173","reported_seq":198,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.747273+0000","last_change":"2024-04-25T01:39:33.438896+0000","last_active":"2024-04-25T01:43:34.747273+0000","last_peered":"2024-04-25T01:43:34.747273+0000","last_clean":"2024-04-25T01:43:34.747273+0000","last_became_active":"2024-04-25T01:39:33.438622+0000","last_became_peered":"2024-04-25T01:39:33.438622+0000","last_unstale":"2024-04-25T01:43:34.747273+0000","last_undegraded":"2024-04-25T01:43:34.747273+0000","last_fullsized":"2024-04-25T01:43:34.747273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:40:47.408809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"30'157","reported_seq":191,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.873335+0000","last_change":"2024-04-25T01:39:24.391366+0000","last_active":"2024-04-25T01:43:46.873335+0000","last_peered":"2024-04-25T01:43:46.873335+0000","last_clean":"2024-04-25T01:43:46.873335+0000","last_became_active":"2024-04-25T01:39:24.391093+0000","last_became_peered":"2024-04-25T01:39:24.391093+0000","last_unstale":"2024-04-25T01:43:46.873335+0000","last_undegraded":"2024-04-25T01:43:46.873335+0000","last_fullsized":"2024-04-25T01:43:46.873335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:10.906935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":311296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.397493+0000","last_change":"2024-04-25T01:39:23.379767+0000","last_active":"2024-04-25T01:43:29.397493+0000","last_peered":"2024-04-25T01:43:29.397493+0000","last_clean":"2024-04-25T01:43:29.397493+0000","last_became_active":"2024-04-25T01:39:23.379294+0000","last_became_peered":"2024-04-25T01:39:23.379294+0000","last_unstale":"2024-04-25T01:43:29.397493+0000","last_undegraded":"2024-04-25T01:43:29.397493+0000","last_fullsized":"2024-04-25T01:43:29.397493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:36:37.823796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"30'25","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:35.399094+0000","last_change":"2024-04-25T01:39:32.429452+0000","last_active":"2024-04-25T01:43:35.399094+0000","last_peered":"2024-04-25T01:43:35.399094+0000","last_clean":"2024-04-25T01:43:35.399094+0000","last_became_active":"2024-04-25T01:39:32.429189+0000","last_became_peered":"2024-04-25T01:39:32.429189+0000","last_unstale":"2024-04-25T01:43:35.399094+0000","last_undegraded":"2024-04-25T01:43:35.399094+0000","last_fullsized":"2024-04-25T01:43:35.399094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:58:02.723851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"30'171","reported_seq":197,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.770009+0000","last_change":"2024-04-25T01:39:33.438945+0000","last_active":"2024-04-25T01:43:34.770009+0000","last_peered":"2024-04-25T01:43:34.770009+0000","last_clean":"2024-04-25T01:43:34.770009+0000","last_became_active":"2024-04-25T01:39:33.438233+0000","last_became_peered":"2024-04-25T01:39:33.438233+0000","last_unstale":"2024-04-25T01:43:34.770009+0000","last_undegraded":"2024-04-25T01:43:34.770009+0000","last_fullsized":"2024-04-25T01:43:34.770009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:50.545311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"30'209","reported_seq":243,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.896362+0000","last_change":"2024-04-25T01:39:24.401208+0000","last_active":"2024-04-25T01:43:46.896362+0000","last_peered":"2024-04-25T01:43:46.896362+0000","last_clean":"2024-04-25T01:43:46.896362+0000","last_became_active":"2024-04-25T01:39:24.400502+0000","last_became_peered":"2024-04-25T01:39:24.400502+0000","last_unstale":"2024-04-25T01:43:46.896362+0000","last_undegraded":"2024-04-25T01:43:46.896362+0000","last_fullsized":"2024-04-25T01:43:46.896362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:55:09.076617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403950+0000","last_change":"2024-04-25T01:39:23.367826+0000","last_active":"2024-04-25T01:43:29.403950+0000","last_peered":"2024-04-25T01:43:29.403950+0000","last_clean":"2024-04-25T01:43:29.403950+0000","last_became_active":"2024-04-25T01:39:23.367520+0000","last_became_peered":"2024-04-25T01:39:23.367520+0000","last_unstale":"2024-04-25T01:43:29.403950+0000","last_undegraded":"2024-04-25T01:43:29.403950+0000","last_fullsized":"2024-04-25T01:43:29.403950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:05.997166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":192,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.397641+0000","last_change":"2024-04-25T01:39:12.918495+0000","last_active":"2024-04-25T01:43:29.397641+0000","last_peered":"2024-04-25T01:43:29.397641+0000","last_clean":"2024-04-25T01:43:29.397641+0000","last_became_active":"2024-04-25T01:39:12.917330+0000","last_became_peered":"2024-04-25T01:39:12.917330+0000","last_unstale":"2024-04-25T01:43:29.397641+0000","last_undegraded":"2024-04-25T01:43:29.397641+0000","last_fullsized":"2024-04-25T01:43:29.397641+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:11.731178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:11.731178+0000","last_clean_scrub_stamp":"2024-04-25T01:39:11.731178+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:26:14.153244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.412547+0000","last_change":"2024-04-25T01:39:32.431797+0000","last_active":"2024-04-25T01:43:29.412547+0000","last_peered":"2024-04-25T01:43:29.412547+0000","last_clean":"2024-04-25T01:43:29.412547+0000","last_became_active":"2024-04-25T01:39:32.431523+0000","last_became_peered":"2024-04-25T01:39:32.431523+0000","last_unstale":"2024-04-25T01:43:29.412547+0000","last_undegraded":"2024-04-25T01:43:29.412547+0000","last_fullsized":"2024-04-25T01:43:29.412547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:45.752128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"30'174","reported_seq":199,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.741855+0000","last_change":"2024-04-25T01:39:33.440488+0000","last_active":"2024-04-25T01:43:34.741855+0000","last_peered":"2024-04-25T01:43:34.741855+0000","last_clean":"2024-04-25T01:43:34.741855+0000","last_became_active":"2024-04-25T01:39:33.440161+0000","last_became_peered":"2024-04-25T01:39:33.440161+0000","last_unstale":"2024-04-25T01:43:34.741855+0000","last_undegraded":"2024-04-25T01:43:34.741855+0000","last_fullsized":"2024-04-25T01:43:34.741855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:45.542876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"30'168","reported_seq":201,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.899419+0000","last_change":"2024-04-25T01:39:24.394350+0000","last_active":"2024-04-25T01:43:46.899419+0000","last_peered":"2024-04-25T01:43:46.899419+0000","last_clean":"2024-04-25T01:43:46.899419+0000","last_became_active":"2024-04-25T01:39:24.393235+0000","last_became_peered":"2024-04-25T01:39:24.393235+0000","last_unstale":"2024-04-25T01:43:46.899419+0000","last_undegraded":"2024-04-25T01:43:46.899419+0000","last_fullsized":"2024-04-25T01:43:46.899419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:00:48.588700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.397643+0000","last_change":"2024-04-25T01:39:23.368352+0000","last_active":"2024-04-25T01:43:29.397643+0000","last_peered":"2024-04-25T01:43:29.397643+0000","last_clean":"2024-04-25T01:43:29.397643+0000","last_became_active":"2024-04-25T01:39:23.368075+0000","last_became_peered":"2024-04-25T01:39:23.368075+0000","last_unstale":"2024-04-25T01:43:29.397643+0000","last_undegraded":"2024-04-25T01:43:29.397643+0000","last_fullsized":"2024-04-25T01:43:29.397643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:11.300091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.412211+0000","last_change":"2024-04-25T01:39:32.430007+0000","last_active":"2024-04-25T01:43:29.412211+0000","last_peered":"2024-04-25T01:43:29.412211+0000","last_clean":"2024-04-25T01:43:29.412211+0000","last_became_active":"2024-04-25T01:39:32.429721+0000","last_became_peered":"2024-04-25T01:39:32.429721+0000","last_unstale":"2024-04-25T01:43:29.412211+0000","last_undegraded":"2024-04-25T01:43:29.412211+0000","last_fullsized":"2024-04-25T01:43:29.412211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:47.409375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"30'171","reported_seq":196,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.755135+0000","last_change":"2024-04-25T01:39:33.447230+0000","last_active":"2024-04-25T01:43:34.755135+0000","last_peered":"2024-04-25T01:43:34.755135+0000","last_clean":"2024-04-25T01:43:34.755135+0000","last_became_active":"2024-04-25T01:39:33.446930+0000","last_became_peered":"2024-04-25T01:39:33.446930+0000","last_unstale":"2024-04-25T01:43:34.755135+0000","last_undegraded":"2024-04-25T01:43:34.755135+0000","last_fullsized":"2024-04-25T01:43:34.755135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:51:40.920560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'173","reported_seq":206,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.895588+0000","last_change":"2024-04-25T01:39:24.394286+0000","last_active":"2024-04-25T01:43:46.895588+0000","last_peered":"2024-04-25T01:43:46.895588+0000","last_clean":"2024-04-25T01:43:46.895588+0000","last_became_active":"2024-04-25T01:39:24.393558+0000","last_became_peered":"2024-04-25T01:39:24.393558+0000","last_unstale":"2024-04-25T01:43:46.895588+0000","last_undegraded":"2024-04-25T01:43:46.895588+0000","last_fullsized":"2024-04-25T01:43:46.895588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:59.100947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.404678+0000","last_change":"2024-04-25T01:39:23.370690+0000","last_active":"2024-04-25T01:43:29.404678+0000","last_peered":"2024-04-25T01:43:29.404678+0000","last_clean":"2024-04-25T01:43:29.404678+0000","last_became_active":"2024-04-25T01:39:23.370391+0000","last_became_peered":"2024-04-25T01:39:23.370391+0000","last_unstale":"2024-04-25T01:43:29.404678+0000","last_undegraded":"2024-04-25T01:43:29.404678+0000","last_fullsized":"2024-04-25T01:43:29.404678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:29.647636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"30'6","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.404958+0000","last_change":"2024-04-25T01:39:32.429412+0000","last_active":"2024-04-25T01:43:29.404958+0000","last_peered":"2024-04-25T01:43:29.404958+0000","last_clean":"2024-04-25T01:43:29.404958+0000","last_became_active":"2024-04-25T01:39:32.429143+0000","last_became_peered":"2024-04-25T01:39:32.429143+0000","last_unstale":"2024-04-25T01:43:29.404958+0000","last_undegraded":"2024-04-25T01:43:29.404958+0000","last_fullsized":"2024-04-25T01:43:29.404958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:53.637245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"30'173","reported_seq":198,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.766305+0000","last_change":"2024-04-25T01:39:33.437128+0000","last_active":"2024-04-25T01:43:34.766305+0000","last_peered":"2024-04-25T01:43:34.766305+0000","last_clean":"2024-04-25T01:43:34.766305+0000","last_became_active":"2024-04-25T01:39:33.436861+0000","last_became_peered":"2024-04-25T01:39:33.436861+0000","last_unstale":"2024-04-25T01:43:34.766305+0000","last_undegraded":"2024-04-25T01:43:34.766305+0000","last_fullsized":"2024-04-25T01:43:34.766305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:41.746373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"30'168","reported_seq":201,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.889452+0000","last_change":"2024-04-25T01:39:24.392170+0000","last_active":"2024-04-25T01:43:46.889452+0000","last_peered":"2024-04-25T01:43:46.889452+0000","last_clean":"2024-04-25T01:43:46.889452+0000","last_became_active":"2024-04-25T01:39:24.391811+0000","last_became_peered":"2024-04-25T01:39:24.391811+0000","last_unstale":"2024-04-25T01:43:46.889452+0000","last_undegraded":"2024-04-25T01:43:46.889452+0000","last_fullsized":"2024-04-25T01:43:46.889452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:32.859676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.398084+0000","last_change":"2024-04-25T01:39:23.369872+0000","last_active":"2024-04-25T01:43:29.398084+0000","last_peered":"2024-04-25T01:43:29.398084+0000","last_clean":"2024-04-25T01:43:29.398084+0000","last_became_active":"2024-04-25T01:39:23.369314+0000","last_became_peered":"2024-04-25T01:39:23.369314+0000","last_unstale":"2024-04-25T01:43:29.398084+0000","last_undegraded":"2024-04-25T01:43:29.398084+0000","last_fullsized":"2024-04-25T01:43:29.398084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:14.571148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.402389+0000","last_change":"2024-04-25T01:39:32.429664+0000","last_active":"2024-04-25T01:43:29.402389+0000","last_peered":"2024-04-25T01:43:29.402389+0000","last_clean":"2024-04-25T01:43:29.402389+0000","last_became_active":"2024-04-25T01:39:32.429358+0000","last_became_peered":"2024-04-25T01:39:32.429358+0000","last_unstale":"2024-04-25T01:43:29.402389+0000","last_undegraded":"2024-04-25T01:43:29.402389+0000","last_fullsized":"2024-04-25T01:43:29.402389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:57:10.913056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"30'178","reported_seq":203,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.682457+0000","last_change":"2024-04-25T01:39:33.440419+0000","last_active":"2024-04-25T01:43:34.682457+0000","last_peered":"2024-04-25T01:43:34.682457+0000","last_clean":"2024-04-25T01:43:34.682457+0000","last_became_active":"2024-04-25T01:39:33.440054+0000","last_became_peered":"2024-04-25T01:39:33.440054+0000","last_unstale":"2024-04-25T01:43:34.682457+0000","last_undegraded":"2024-04-25T01:43:34.682457+0000","last_fullsized":"2024-04-25T01:43:34.682457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:42.321235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"30'179","reported_seq":198,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.877749+0000","last_change":"2024-04-25T01:40:05.826359+0000","last_active":"2024-04-25T01:43:46.877749+0000","last_peered":"2024-04-25T01:43:46.877749+0000","last_clean":"2024-04-25T01:43:46.877749+0000","last_became_active":"2024-04-25T01:40:05.826076+0000","last_became_peered":"2024-04-25T01:40:05.826076+0000","last_unstale":"2024-04-25T01:43:46.877749+0000","last_undegraded":"2024-04-25T01:43:46.877749+0000","last_fullsized":"2024-04-25T01:43:46.877749+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:42:53.707094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.404466+0000","last_change":"2024-04-25T01:39:23.367322+0000","last_active":"2024-04-25T01:43:29.404466+0000","last_peered":"2024-04-25T01:43:29.404466+0000","last_clean":"2024-04-25T01:43:29.404466+0000","last_became_active":"2024-04-25T01:39:23.367054+0000","last_became_peered":"2024-04-25T01:39:23.367054+0000","last_unstale":"2024-04-25T01:43:29.404466+0000","last_undegraded":"2024-04-25T01:43:29.404466+0000","last_fullsized":"2024-04-25T01:43:29.404466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:10.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.402979+0000","last_change":"2024-04-25T01:39:32.426874+0000","last_active":"2024-04-25T01:43:29.402979+0000","last_peered":"2024-04-25T01:43:29.402979+0000","last_clean":"2024-04-25T01:43:29.402979+0000","last_became_active":"2024-04-25T01:39:32.426599+0000","last_became_peered":"2024-04-25T01:39:32.426599+0000","last_unstale":"2024-04-25T01:43:29.402979+0000","last_undegraded":"2024-04-25T01:43:29.402979+0000","last_fullsized":"2024-04-25T01:43:29.402979+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:27.672277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"30'164","reported_seq":189,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.722453+0000","last_change":"2024-04-25T01:39:33.428909+0000","last_active":"2024-04-25T01:43:34.722453+0000","last_peered":"2024-04-25T01:43:34.722453+0000","last_clean":"2024-04-25T01:43:34.722453+0000","last_became_active":"2024-04-25T01:39:33.428626+0000","last_became_peered":"2024-04-25T01:39:33.428626+0000","last_unstale":"2024-04-25T01:43:34.722453+0000","last_undegraded":"2024-04-25T01:43:34.722453+0000","last_fullsized":"2024-04-25T01:43:34.722453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:21.188264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'204","reported_seq":237,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.879392+0000","last_change":"2024-04-25T01:39:24.389946+0000","last_active":"2024-04-25T01:43:46.879392+0000","last_peered":"2024-04-25T01:43:46.879392+0000","last_clean":"2024-04-25T01:43:46.879392+0000","last_became_active":"2024-04-25T01:39:24.389656+0000","last_became_peered":"2024-04-25T01:39:24.389656+0000","last_unstale":"2024-04-25T01:43:46.879392+0000","last_undegraded":"2024-04-25T01:43:46.879392+0000","last_fullsized":"2024-04-25T01:43:46.879392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:55.943639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"30'9","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.397557+0000","last_change":"2024-04-25T01:39:23.373599+0000","last_active":"2024-04-25T01:43:29.397557+0000","last_peered":"2024-04-25T01:43:29.397557+0000","last_clean":"2024-04-25T01:43:29.397557+0000","last_became_active":"2024-04-25T01:39:23.373281+0000","last_became_peered":"2024-04-25T01:39:23.373281+0000","last_unstale":"2024-04-25T01:43:29.397557+0000","last_undegraded":"2024-04-25T01:43:29.397557+0000","last_fullsized":"2024-04-25T01:43:29.397557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:40.850925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403096+0000","last_change":"2024-04-25T01:39:32.427502+0000","last_active":"2024-04-25T01:43:29.403096+0000","last_peered":"2024-04-25T01:43:29.403096+0000","last_clean":"2024-04-25T01:43:29.403096+0000","last_became_active":"2024-04-25T01:39:32.426499+0000","last_became_peered":"2024-04-25T01:39:32.426499+0000","last_unstale":"2024-04-25T01:43:29.403096+0000","last_undegraded":"2024-04-25T01:43:29.403096+0000","last_fullsized":"2024-04-25T01:43:29.403096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:26.977416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"30'274","reported_seq":299,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.747979+0000","last_change":"2024-04-25T01:39:33.436901+0000","last_active":"2024-04-25T01:43:34.747979+0000","last_peered":"2024-04-25T01:43:34.747979+0000","last_clean":"2024-04-25T01:43:34.747979+0000","last_became_active":"2024-04-25T01:39:33.436001+0000","last_became_peered":"2024-04-25T01:39:33.436001+0000","last_unstale":"2024-04-25T01:43:34.747979+0000","last_undegraded":"2024-04-25T01:43:34.747979+0000","last_fullsized":"2024-04-25T01:43:34.747979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:34:41.678663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"30'176","reported_seq":209,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.874522+0000","last_change":"2024-04-25T01:39:24.394248+0000","last_active":"2024-04-25T01:43:46.874522+0000","last_peered":"2024-04-25T01:43:46.874522+0000","last_clean":"2024-04-25T01:43:46.874522+0000","last_became_active":"2024-04-25T01:39:24.393958+0000","last_became_peered":"2024-04-25T01:39:24.393958+0000","last_unstale":"2024-04-25T01:43:46.874522+0000","last_undegraded":"2024-04-25T01:43:46.874522+0000","last_fullsized":"2024-04-25T01:43:46.874522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:35.087577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.412806+0000","last_change":"2024-04-25T01:39:23.372939+0000","last_active":"2024-04-25T01:43:29.412806+0000","last_peered":"2024-04-25T01:43:29.412806+0000","last_clean":"2024-04-25T01:43:29.412806+0000","last_became_active":"2024-04-25T01:39:23.372648+0000","last_became_peered":"2024-04-25T01:39:23.372648+0000","last_unstale":"2024-04-25T01:43:29.412806+0000","last_undegraded":"2024-04-25T01:43:29.412806+0000","last_fullsized":"2024-04-25T01:43:29.412806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:02:13.283096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'1","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.408083+0000","last_change":"2024-04-25T01:39:32.432218+0000","last_active":"2024-04-25T01:43:29.408083+0000","last_peered":"2024-04-25T01:43:29.408083+0000","last_clean":"2024-04-25T01:43:29.408083+0000","last_became_active":"2024-04-25T01:39:32.431938+0000","last_became_peered":"2024-04-25T01:39:32.431938+0000","last_unstale":"2024-04-25T01:43:29.408083+0000","last_undegraded":"2024-04-25T01:43:29.408083+0000","last_fullsized":"2024-04-25T01:43:29.408083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:56:15.053817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"30'185","reported_seq":210,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.742694+0000","last_change":"2024-04-25T01:39:33.441342+0000","last_active":"2024-04-25T01:43:34.742694+0000","last_peered":"2024-04-25T01:43:34.742694+0000","last_clean":"2024-04-25T01:43:34.742694+0000","last_became_active":"2024-04-25T01:39:33.441074+0000","last_became_peered":"2024-04-25T01:39:33.441074+0000","last_unstale":"2024-04-25T01:43:34.742694+0000","last_undegraded":"2024-04-25T01:43:34.742694+0000","last_fullsized":"2024-04-25T01:43:34.742694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:22:43.000112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'214","reported_seq":247,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.879311+0000","last_change":"2024-04-25T01:39:24.390114+0000","last_active":"2024-04-25T01:43:46.879311+0000","last_peered":"2024-04-25T01:43:46.879311+0000","last_clean":"2024-04-25T01:43:46.879311+0000","last_became_active":"2024-04-25T01:39:24.389841+0000","last_became_peered":"2024-04-25T01:39:24.389841+0000","last_unstale":"2024-04-25T01:43:46.879311+0000","last_undegraded":"2024-04-25T01:43:46.879311+0000","last_fullsized":"2024-04-25T01:43:46.879311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:34.950624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.406513+0000","last_change":"2024-04-25T01:39:23.369440+0000","last_active":"2024-04-25T01:43:29.406513+0000","last_peered":"2024-04-25T01:43:29.406513+0000","last_clean":"2024-04-25T01:43:29.406513+0000","last_became_active":"2024-04-25T01:39:23.369151+0000","last_became_peered":"2024-04-25T01:39:23.369151+0000","last_unstale":"2024-04-25T01:43:29.406513+0000","last_undegraded":"2024-04-25T01:43:29.406513+0000","last_fullsized":"2024-04-25T01:43:29.406513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:31:46.921287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'2024","reported_seq":2068,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.423122+0000","last_change":"2024-04-25T01:39:32.430701+0000","last_active":"2024-04-25T01:43:32.423122+0000","last_peered":"2024-04-25T01:43:32.423122+0000","last_clean":"2024-04-25T01:43:32.423122+0000","last_became_active":"2024-04-25T01:39:32.430187+0000","last_became_peered":"2024-04-25T01:39:32.430187+0000","last_unstale":"2024-04-25T01:43:32.423122+0000","last_undegraded":"2024-04-25T01:43:32.423122+0000","last_fullsized":"2024-04-25T01:43:32.423122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2024,"log_dups_size":0,"ondisk_log_size":2024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:57.148375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":4133,"num_write":2021,"num_write_kb":6037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"30'182","reported_seq":207,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.699488+0000","last_change":"2024-04-25T01:39:33.427429+0000","last_active":"2024-04-25T01:43:34.699488+0000","last_peered":"2024-04-25T01:43:34.699488+0000","last_clean":"2024-04-25T01:43:34.699488+0000","last_became_active":"2024-04-25T01:39:33.427164+0000","last_became_peered":"2024-04-25T01:39:33.427164+0000","last_unstale":"2024-04-25T01:43:34.699488+0000","last_undegraded":"2024-04-25T01:43:34.699488+0000","last_fullsized":"2024-04-25T01:43:34.699488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:33:59.664252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"30'179","reported_seq":212,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.881499+0000","last_change":"2024-04-25T01:39:24.388852+0000","last_active":"2024-04-25T01:43:46.881499+0000","last_peered":"2024-04-25T01:43:46.881499+0000","last_clean":"2024-04-25T01:43:46.881499+0000","last_became_active":"2024-04-25T01:39:24.388594+0000","last_became_peered":"2024-04-25T01:39:24.388594+0000","last_unstale":"2024-04-25T01:43:46.881499+0000","last_undegraded":"2024-04-25T01:43:46.881499+0000","last_fullsized":"2024-04-25T01:43:46.881499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:46:49.718182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.404791+0000","last_change":"2024-04-25T01:39:23.372903+0000","last_active":"2024-04-25T01:43:29.404791+0000","last_peered":"2024-04-25T01:43:29.404791+0000","last_clean":"2024-04-25T01:43:29.404791+0000","last_became_active":"2024-04-25T01:39:23.372617+0000","last_became_peered":"2024-04-25T01:39:23.372617+0000","last_unstale":"2024-04-25T01:43:29.404791+0000","last_undegraded":"2024-04-25T01:43:29.404791+0000","last_fullsized":"2024-04-25T01:43:29.404791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:54:58.506432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"30'8","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:35.564703+0000","last_change":"2024-04-25T01:39:32.430218+0000","last_active":"2024-04-25T01:43:35.564703+0000","last_peered":"2024-04-25T01:43:35.564703+0000","last_clean":"2024-04-25T01:43:35.564703+0000","last_became_active":"2024-04-25T01:39:32.429900+0000","last_became_peered":"2024-04-25T01:39:32.429900+0000","last_unstale":"2024-04-25T01:43:35.564703+0000","last_undegraded":"2024-04-25T01:43:35.564703+0000","last_fullsized":"2024-04-25T01:43:35.564703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:52.253045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"30'217","reported_seq":242,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.745610+0000","last_change":"2024-04-25T01:39:33.440325+0000","last_active":"2024-04-25T01:43:34.745610+0000","last_peered":"2024-04-25T01:43:34.745610+0000","last_clean":"2024-04-25T01:43:34.745610+0000","last_became_active":"2024-04-25T01:39:33.439961+0000","last_became_peered":"2024-04-25T01:39:33.439961+0000","last_unstale":"2024-04-25T01:43:34.745610+0000","last_undegraded":"2024-04-25T01:43:34.745610+0000","last_fullsized":"2024-04-25T01:43:34.745610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:01.846576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'159","reported_seq":192,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.885824+0000","last_change":"2024-04-25T01:39:24.380617+0000","last_active":"2024-04-25T01:43:46.885824+0000","last_peered":"2024-04-25T01:43:46.885824+0000","last_clean":"2024-04-25T01:43:46.885824+0000","last_became_active":"2024-04-25T01:39:24.380330+0000","last_became_peered":"2024-04-25T01:39:24.380330+0000","last_unstale":"2024-04-25T01:43:46.885824+0000","last_undegraded":"2024-04-25T01:43:46.885824+0000","last_fullsized":"2024-04-25T01:43:46.885824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:24.010569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"30'2022","reported_seq":2070,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.412675+0000","last_change":"2024-04-25T01:39:23.373295+0000","last_active":"2024-04-25T01:43:29.412675+0000","last_peered":"2024-04-25T01:43:29.412675+0000","last_clean":"2024-04-25T01:43:29.412675+0000","last_became_active":"2024-04-25T01:39:23.372984+0000","last_became_peered":"2024-04-25T01:39:23.372984+0000","last_unstale":"2024-04-25T01:43:29.412675+0000","last_undegraded":"2024-04-25T01:43:29.412675+0000","last_fullsized":"2024-04-25T01:43:29.412675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2022,"log_dups_size":0,"ondisk_log_size":2022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:10.854190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":65,"num_write":2019,"num_write_kb":6035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.401920+0000","last_change":"2024-04-25T01:39:32.433589+0000","last_active":"2024-04-25T01:43:29.401920+0000","last_peered":"2024-04-25T01:43:29.401920+0000","last_clean":"2024-04-25T01:43:29.401920+0000","last_became_active":"2024-04-25T01:39:32.433408+0000","last_became_peered":"2024-04-25T01:39:32.433408+0000","last_unstale":"2024-04-25T01:43:29.401920+0000","last_undegraded":"2024-04-25T01:43:29.401920+0000","last_fullsized":"2024-04-25T01:43:29.401920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:25.789951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"30'189","reported_seq":214,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.688751+0000","last_change":"2024-04-25T01:39:33.433449+0000","last_active":"2024-04-25T01:43:34.688751+0000","last_peered":"2024-04-25T01:43:34.688751+0000","last_clean":"2024-04-25T01:43:34.688751+0000","last_became_active":"2024-04-25T01:39:33.432690+0000","last_became_peered":"2024-04-25T01:39:33.432690+0000","last_unstale":"2024-04-25T01:43:34.688751+0000","last_undegraded":"2024-04-25T01:43:34.688751+0000","last_fullsized":"2024-04-25T01:43:34.688751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:30.046453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"30'179","reported_seq":212,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.886230+0000","last_change":"2024-04-25T01:39:24.391245+0000","last_active":"2024-04-25T01:43:46.886230+0000","last_peered":"2024-04-25T01:43:46.886230+0000","last_clean":"2024-04-25T01:43:46.886230+0000","last_became_active":"2024-04-25T01:39:24.390941+0000","last_became_peered":"2024-04-25T01:39:24.390941+0000","last_unstale":"2024-04-25T01:43:46.886230+0000","last_undegraded":"2024-04-25T01:43:46.886230+0000","last_fullsized":"2024-04-25T01:43:46.886230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:55.182405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"30'8","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:35.181358+0000","last_change":"2024-04-25T01:39:23.369043+0000","last_active":"2024-04-25T01:43:35.181358+0000","last_peered":"2024-04-25T01:43:35.181358+0000","last_clean":"2024-04-25T01:43:35.181358+0000","last_became_active":"2024-04-25T01:39:23.368778+0000","last_became_peered":"2024-04-25T01:39:23.368778+0000","last_unstale":"2024-04-25T01:43:35.181358+0000","last_undegraded":"2024-04-25T01:43:35.181358+0000","last_fullsized":"2024-04-25T01:43:35.181358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:59.501724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.404425+0000","last_change":"2024-04-25T01:39:32.431530+0000","last_active":"2024-04-25T01:43:29.404425+0000","last_peered":"2024-04-25T01:43:29.404425+0000","last_clean":"2024-04-25T01:43:29.404425+0000","last_became_active":"2024-04-25T01:39:32.431247+0000","last_became_peered":"2024-04-25T01:39:32.431247+0000","last_unstale":"2024-04-25T01:43:29.404425+0000","last_undegraded":"2024-04-25T01:43:29.404425+0000","last_fullsized":"2024-04-25T01:43:29.404425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:46:02.014508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":24,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"30'233","reported_seq":258,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.697325+0000","last_change":"2024-04-25T01:39:33.446545+0000","last_active":"2024-04-25T01:43:34.697325+0000","last_peered":"2024-04-25T01:43:34.697325+0000","last_clean":"2024-04-25T01:43:34.697325+0000","last_became_active":"2024-04-25T01:39:33.446263+0000","last_became_peered":"2024-04-25T01:39:33.446263+0000","last_unstale":"2024-04-25T01:43:34.697325+0000","last_undegraded":"2024-04-25T01:43:34.697325+0000","last_fullsized":"2024-04-25T01:43:34.697325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:27.026460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"30'153","reported_seq":186,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.894871+0000","last_change":"2024-04-25T01:39:24.403875+0000","last_active":"2024-04-25T01:43:46.894871+0000","last_peered":"2024-04-25T01:43:46.894871+0000","last_clean":"2024-04-25T01:43:46.894871+0000","last_became_active":"2024-04-25T01:39:24.403591+0000","last_became_peered":"2024-04-25T01:39:24.403591+0000","last_unstale":"2024-04-25T01:43:46.894871+0000","last_undegraded":"2024-04-25T01:43:46.894871+0000","last_fullsized":"2024-04-25T01:43:46.894871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:45.276173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.406434+0000","last_change":"2024-04-25T01:39:23.378968+0000","last_active":"2024-04-25T01:43:29.406434+0000","last_peered":"2024-04-25T01:43:29.406434+0000","last_clean":"2024-04-25T01:43:29.406434+0000","last_became_active":"2024-04-25T01:39:23.378635+0000","last_became_peered":"2024-04-25T01:39:23.378635+0000","last_unstale":"2024-04-25T01:43:29.406434+0000","last_undegraded":"2024-04-25T01:43:29.406434+0000","last_fullsized":"2024-04-25T01:43:29.406434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:39.780544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.431179+0000","last_change":"2024-04-25T01:39:32.427357+0000","last_active":"2024-04-25T01:43:32.431179+0000","last_peered":"2024-04-25T01:43:32.431179+0000","last_clean":"2024-04-25T01:43:32.431179+0000","last_became_active":"2024-04-25T01:39:32.427105+0000","last_became_peered":"2024-04-25T01:39:32.427105+0000","last_unstale":"2024-04-25T01:43:32.431179+0000","last_undegraded":"2024-04-25T01:43:32.431179+0000","last_fullsized":"2024-04-25T01:43:32.431179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:04.848726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":66,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'217","reported_seq":242,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.751559+0000","last_change":"2024-04-25T01:39:33.444814+0000","last_active":"2024-04-25T01:43:34.751559+0000","last_peered":"2024-04-25T01:43:34.751559+0000","last_clean":"2024-04-25T01:43:34.751559+0000","last_became_active":"2024-04-25T01:39:33.444489+0000","last_became_peered":"2024-04-25T01:39:33.444489+0000","last_unstale":"2024-04-25T01:43:34.751559+0000","last_undegraded":"2024-04-25T01:43:34.751559+0000","last_fullsized":"2024-04-25T01:43:34.751559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:06.718940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"30'235","reported_seq":268,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.898877+0000","last_change":"2024-04-25T01:39:24.392642+0000","last_active":"2024-04-25T01:43:46.898877+0000","last_peered":"2024-04-25T01:43:46.898877+0000","last_clean":"2024-04-25T01:43:46.898877+0000","last_became_active":"2024-04-25T01:39:24.391605+0000","last_became_peered":"2024-04-25T01:39:24.391605+0000","last_unstale":"2024-04-25T01:43:46.898877+0000","last_undegraded":"2024-04-25T01:43:46.898877+0000","last_fullsized":"2024-04-25T01:43:46.898877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:01:23.217074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":565248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.413394+0000","last_change":"2024-04-25T01:39:23.377236+0000","last_active":"2024-04-25T01:43:29.413394+0000","last_peered":"2024-04-25T01:43:29.413394+0000","last_clean":"2024-04-25T01:43:29.413394+0000","last_became_active":"2024-04-25T01:39:23.376727+0000","last_became_peered":"2024-04-25T01:39:23.376727+0000","last_unstale":"2024-04-25T01:43:29.413394+0000","last_undegraded":"2024-04-25T01:43:29.413394+0000","last_fullsized":"2024-04-25T01:43:29.413394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:08.103707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.407470+0000","last_change":"2024-04-25T01:39:32.424457+0000","last_active":"2024-04-25T01:43:29.407470+0000","last_peered":"2024-04-25T01:43:29.407470+0000","last_clean":"2024-04-25T01:43:29.407470+0000","last_became_active":"2024-04-25T01:39:32.424203+0000","last_became_peered":"2024-04-25T01:39:32.424203+0000","last_unstale":"2024-04-25T01:43:29.407470+0000","last_undegraded":"2024-04-25T01:43:29.407470+0000","last_fullsized":"2024-04-25T01:43:29.407470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:12:20.824070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"30'172","reported_seq":198,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.723551+0000","last_change":"2024-04-25T01:39:33.445948+0000","last_active":"2024-04-25T01:43:34.723551+0000","last_peered":"2024-04-25T01:43:34.723551+0000","last_clean":"2024-04-25T01:43:34.723551+0000","last_became_active":"2024-04-25T01:39:33.445654+0000","last_became_peered":"2024-04-25T01:39:33.445654+0000","last_unstale":"2024-04-25T01:43:34.723551+0000","last_undegraded":"2024-04-25T01:43:34.723551+0000","last_fullsized":"2024-04-25T01:43:34.723551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:51.323909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'4","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.612487+0000","last_change":"2024-04-25T01:39:32.430484+0000","last_active":"2024-04-25T01:43:29.612487+0000","last_peered":"2024-04-25T01:43:29.612487+0000","last_clean":"2024-04-25T01:43:29.612487+0000","last_became_active":"2024-04-25T01:39:32.430220+0000","last_became_peered":"2024-04-25T01:39:32.430220+0000","last_unstale":"2024-04-25T01:43:29.612487+0000","last_undegraded":"2024-04-25T01:43:29.612487+0000","last_fullsized":"2024-04-25T01:43:29.612487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:36:53.152442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"30'187","reported_seq":220,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.879565+0000","last_change":"2024-04-25T01:39:24.375457+0000","last_active":"2024-04-25T01:43:46.879565+0000","last_peered":"2024-04-25T01:43:46.879565+0000","last_clean":"2024-04-25T01:43:46.879565+0000","last_became_active":"2024-04-25T01:39:24.375178+0000","last_became_peered":"2024-04-25T01:39:24.375178+0000","last_unstale":"2024-04-25T01:43:46.879565+0000","last_undegraded":"2024-04-25T01:43:46.879565+0000","last_fullsized":"2024-04-25T01:43:46.879565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:58:15.640882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.402961+0000","last_change":"2024-04-25T01:39:23.369998+0000","last_active":"2024-04-25T01:43:29.402961+0000","last_peered":"2024-04-25T01:43:29.402961+0000","last_clean":"2024-04-25T01:43:29.402961+0000","last_became_active":"2024-04-25T01:39:23.369710+0000","last_became_peered":"2024-04-25T01:39:23.369710+0000","last_unstale":"2024-04-25T01:43:29.402961+0000","last_undegraded":"2024-04-25T01:43:29.402961+0000","last_fullsized":"2024-04-25T01:43:29.402961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:32:34.329452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"30'192","reported_seq":218,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.763527+0000","last_change":"2024-04-25T01:39:33.447666+0000","last_active":"2024-04-25T01:43:34.763527+0000","last_peered":"2024-04-25T01:43:34.763527+0000","last_clean":"2024-04-25T01:43:34.763527+0000","last_became_active":"2024-04-25T01:39:33.447436+0000","last_became_peered":"2024-04-25T01:39:33.447436+0000","last_unstale":"2024-04-25T01:43:34.763527+0000","last_undegraded":"2024-04-25T01:43:34.763527+0000","last_fullsized":"2024-04-25T01:43:34.763527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:25:20.440422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'7","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.420309+0000","last_change":"2024-04-25T01:39:32.436300+0000","last_active":"2024-04-25T01:43:32.420309+0000","last_peered":"2024-04-25T01:43:32.420309+0000","last_clean":"2024-04-25T01:43:32.420309+0000","last_became_active":"2024-04-25T01:39:32.436000+0000","last_became_peered":"2024-04-25T01:39:32.436000+0000","last_unstale":"2024-04-25T01:43:32.420309+0000","last_undegraded":"2024-04-25T01:43:32.420309+0000","last_fullsized":"2024-04-25T01:43:32.420309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:38.044992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"30'190","reported_seq":223,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.876992+0000","last_change":"2024-04-25T01:39:24.387708+0000","last_active":"2024-04-25T01:43:46.876992+0000","last_peered":"2024-04-25T01:43:46.876992+0000","last_clean":"2024-04-25T01:43:46.876992+0000","last_became_active":"2024-04-25T01:39:24.387433+0000","last_became_peered":"2024-04-25T01:39:24.387433+0000","last_unstale":"2024-04-25T01:43:46.876992+0000","last_undegraded":"2024-04-25T01:43:46.876992+0000","last_fullsized":"2024-04-25T01:43:46.876992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:34.312066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.407793+0000","last_change":"2024-04-25T01:39:23.377487+0000","last_active":"2024-04-25T01:43:29.407793+0000","last_peered":"2024-04-25T01:43:29.407793+0000","last_clean":"2024-04-25T01:43:29.407793+0000","last_became_active":"2024-04-25T01:39:23.377181+0000","last_became_peered":"2024-04-25T01:39:23.377181+0000","last_unstale":"2024-04-25T01:43:29.407793+0000","last_undegraded":"2024-04-25T01:43:29.407793+0000","last_fullsized":"2024-04-25T01:43:29.407793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:17.434141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"30'209","reported_seq":234,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.752030+0000","last_change":"2024-04-25T01:39:33.444973+0000","last_active":"2024-04-25T01:43:34.752030+0000","last_peered":"2024-04-25T01:43:34.752030+0000","last_clean":"2024-04-25T01:43:34.752030+0000","last_became_active":"2024-04-25T01:39:33.444673+0000","last_became_peered":"2024-04-25T01:39:33.444673+0000","last_unstale":"2024-04-25T01:43:34.752030+0000","last_undegraded":"2024-04-25T01:43:34.752030+0000","last_fullsized":"2024-04-25T01:43:34.752030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:08.372714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"29'3","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.412813+0000","last_change":"2024-04-25T01:39:23.372975+0000","last_active":"2024-04-25T01:43:29.412813+0000","last_peered":"2024-04-25T01:43:29.412813+0000","last_clean":"2024-04-25T01:43:29.412813+0000","last_became_active":"2024-04-25T01:39:23.372688+0000","last_became_peered":"2024-04-25T01:39:23.372688+0000","last_unstale":"2024-04-25T01:43:29.412813+0000","last_undegraded":"2024-04-25T01:43:29.412813+0000","last_fullsized":"2024-04-25T01:43:29.412813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:42:57.195844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"30'157","reported_seq":190,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.882990+0000","last_change":"2024-04-25T01:39:24.388095+0000","last_active":"2024-04-25T01:43:46.882990+0000","last_peered":"2024-04-25T01:43:46.882990+0000","last_clean":"2024-04-25T01:43:46.882990+0000","last_became_active":"2024-04-25T01:39:24.387797+0000","last_became_peered":"2024-04-25T01:39:24.387797+0000","last_unstale":"2024-04-25T01:43:46.882990+0000","last_undegraded":"2024-04-25T01:43:46.882990+0000","last_fullsized":"2024-04-25T01:43:46.882990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:43:16.385957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.424303+0000","last_change":"2024-04-25T01:39:32.427081+0000","last_active":"2024-04-25T01:43:32.424303+0000","last_peered":"2024-04-25T01:43:32.424303+0000","last_clean":"2024-04-25T01:43:32.424303+0000","last_became_active":"2024-04-25T01:39:32.426626+0000","last_became_peered":"2024-04-25T01:39:32.426626+0000","last_unstale":"2024-04-25T01:43:32.424303+0000","last_undegraded":"2024-04-25T01:43:32.424303+0000","last_fullsized":"2024-04-25T01:43:32.424303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:45.358400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"30'170","reported_seq":195,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.728867+0000","last_change":"2024-04-25T01:39:33.446301+0000","last_active":"2024-04-25T01:43:34.728867+0000","last_peered":"2024-04-25T01:43:34.728867+0000","last_clean":"2024-04-25T01:43:34.728867+0000","last_became_active":"2024-04-25T01:39:33.445158+0000","last_became_peered":"2024-04-25T01:39:33.445158+0000","last_unstale":"2024-04-25T01:43:34.728867+0000","last_undegraded":"2024-04-25T01:43:34.728867+0000","last_fullsized":"2024-04-25T01:43:34.728867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:53:26.017968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"30'1824","reported_seq":1859,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:35.275648+0000","last_change":"2024-04-25T01:39:23.371716+0000","last_active":"2024-04-25T01:43:35.275648+0000","last_peered":"2024-04-25T01:43:35.275648+0000","last_clean":"2024-04-25T01:43:35.275648+0000","last_became_active":"2024-04-25T01:39:23.371475+0000","last_became_peered":"2024-04-25T01:39:23.371475+0000","last_unstale":"2024-04-25T01:43:35.275648+0000","last_undegraded":"2024-04-25T01:43:35.275648+0000","last_fullsized":"2024-04-25T01:43:35.275648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1824,"log_dups_size":0,"ondisk_log_size":1824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:10.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3805208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1821,"num_write_kb":5470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"30'150","reported_seq":183,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.870889+0000","last_change":"2024-04-25T01:39:24.388083+0000","last_active":"2024-04-25T01:43:46.870889+0000","last_peered":"2024-04-25T01:43:46.870889+0000","last_clean":"2024-04-25T01:43:46.870889+0000","last_became_active":"2024-04-25T01:39:24.387789+0000","last_became_peered":"2024-04-25T01:39:24.387789+0000","last_unstale":"2024-04-25T01:43:46.870889+0000","last_undegraded":"2024-04-25T01:43:46.870889+0000","last_fullsized":"2024-04-25T01:43:46.870889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:31.760631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'5","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.422640+0000","last_change":"2024-04-25T01:39:32.429613+0000","last_active":"2024-04-25T01:43:32.422640+0000","last_peered":"2024-04-25T01:43:32.422640+0000","last_clean":"2024-04-25T01:43:32.422640+0000","last_became_active":"2024-04-25T01:39:32.429361+0000","last_became_peered":"2024-04-25T01:39:32.429361+0000","last_unstale":"2024-04-25T01:43:32.422640+0000","last_undegraded":"2024-04-25T01:43:32.422640+0000","last_fullsized":"2024-04-25T01:43:32.422640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:04:59.928602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"30'221","reported_seq":246,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.683570+0000","last_change":"2024-04-25T01:39:33.426384+0000","last_active":"2024-04-25T01:43:34.683570+0000","last_peered":"2024-04-25T01:43:34.683570+0000","last_clean":"2024-04-25T01:43:34.683570+0000","last_became_active":"2024-04-25T01:39:33.426101+0000","last_became_peered":"2024-04-25T01:39:33.426101+0000","last_unstale":"2024-04-25T01:43:34.683570+0000","last_undegraded":"2024-04-25T01:43:34.683570+0000","last_fullsized":"2024-04-25T01:43:34.683570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:36.820458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"30'172","reported_seq":206,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.884138+0000","last_change":"2024-04-25T01:39:24.395618+0000","last_active":"2024-04-25T01:43:46.884138+0000","last_peered":"2024-04-25T01:43:46.884138+0000","last_clean":"2024-04-25T01:43:46.884138+0000","last_became_active":"2024-04-25T01:39:24.394816+0000","last_became_peered":"2024-04-25T01:39:24.394816+0000","last_unstale":"2024-04-25T01:43:46.884138+0000","last_undegraded":"2024-04-25T01:43:46.884138+0000","last_fullsized":"2024-04-25T01:43:46.884138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:01.025135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"30'174","reported_seq":199,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.719246+0000","last_change":"2024-04-25T01:39:33.432537+0000","last_active":"2024-04-25T01:43:34.719246+0000","last_peered":"2024-04-25T01:43:34.719246+0000","last_clean":"2024-04-25T01:43:34.719246+0000","last_became_active":"2024-04-25T01:39:33.432266+0000","last_became_peered":"2024-04-25T01:39:33.432266+0000","last_unstale":"2024-04-25T01:43:34.719246+0000","last_undegraded":"2024-04-25T01:43:34.719246+0000","last_fullsized":"2024-04-25T01:43:34.719246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:31.703689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"30'158","reported_seq":197,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.876820+0000","last_change":"2024-04-25T01:40:06.450805+0000","last_active":"2024-04-25T01:43:46.876820+0000","last_peered":"2024-04-25T01:43:46.876820+0000","last_clean":"2024-04-25T01:43:46.876820+0000","last_became_active":"2024-04-25T01:40:06.450447+0000","last_became_peered":"2024-04-25T01:40:06.450447+0000","last_unstale":"2024-04-25T01:43:46.876820+0000","last_undegraded":"2024-04-25T01:43:46.876820+0000","last_fullsized":"2024-04-25T01:43:46.876820+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:37:30.384756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"30'168","reported_seq":193,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.705486+0000","last_change":"2024-04-25T01:39:33.439086+0000","last_active":"2024-04-25T01:43:34.705486+0000","last_peered":"2024-04-25T01:43:34.705486+0000","last_clean":"2024-04-25T01:43:34.705486+0000","last_became_active":"2024-04-25T01:39:33.438811+0000","last_became_peered":"2024-04-25T01:39:33.438811+0000","last_unstale":"2024-04-25T01:43:34.705486+0000","last_undegraded":"2024-04-25T01:43:34.705486+0000","last_fullsized":"2024-04-25T01:43:34.705486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:49:23.604749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"30'143","reported_seq":177,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.895840+0000","last_change":"2024-04-25T01:39:24.399738+0000","last_active":"2024-04-25T01:43:46.895840+0000","last_peered":"2024-04-25T01:43:46.895840+0000","last_clean":"2024-04-25T01:43:46.895840+0000","last_became_active":"2024-04-25T01:39:24.399499+0000","last_became_peered":"2024-04-25T01:39:24.399499+0000","last_unstale":"2024-04-25T01:43:46.895840+0000","last_undegraded":"2024-04-25T01:43:46.895840+0000","last_fullsized":"2024-04-25T01:43:46.895840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:58.646669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":311296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"30'184","reported_seq":209,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.728870+0000","last_change":"2024-04-25T01:39:33.444074+0000","last_active":"2024-04-25T01:43:34.728870+0000","last_peered":"2024-04-25T01:43:34.728870+0000","last_clean":"2024-04-25T01:43:34.728870+0000","last_became_active":"2024-04-25T01:39:33.443796+0000","last_became_peered":"2024-04-25T01:39:33.443796+0000","last_unstale":"2024-04-25T01:43:34.728870+0000","last_undegraded":"2024-04-25T01:43:34.728870+0000","last_fullsized":"2024-04-25T01:43:34.728870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:56.379211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"30'124","reported_seq":158,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.880255+0000","last_change":"2024-04-25T01:39:24.390631+0000","last_active":"2024-04-25T01:43:46.880255+0000","last_peered":"2024-04-25T01:43:46.880255+0000","last_clean":"2024-04-25T01:43:46.880255+0000","last_became_active":"2024-04-25T01:39:24.390363+0000","last_became_peered":"2024-04-25T01:39:24.390363+0000","last_unstale":"2024-04-25T01:43:46.880255+0000","last_undegraded":"2024-04-25T01:43:46.880255+0000","last_fullsized":"2024-04-25T01:43:46.880255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:48.830416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"30'162","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.716155+0000","last_change":"2024-04-25T01:39:33.437787+0000","last_active":"2024-04-25T01:43:34.716155+0000","last_peered":"2024-04-25T01:43:34.716155+0000","last_clean":"2024-04-25T01:43:34.716155+0000","last_became_active":"2024-04-25T01:39:33.436131+0000","last_became_peered":"2024-04-25T01:39:33.436131+0000","last_unstale":"2024-04-25T01:43:34.716155+0000","last_undegraded":"2024-04-25T01:43:34.716155+0000","last_fullsized":"2024-04-25T01:43:34.716155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:29:13.213643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"30'148","reported_seq":182,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.875617+0000","last_change":"2024-04-25T01:39:24.389645+0000","last_active":"2024-04-25T01:43:46.875617+0000","last_peered":"2024-04-25T01:43:46.875617+0000","last_clean":"2024-04-25T01:43:46.875617+0000","last_became_active":"2024-04-25T01:39:24.389375+0000","last_became_peered":"2024-04-25T01:39:24.389375+0000","last_unstale":"2024-04-25T01:43:46.875617+0000","last_undegraded":"2024-04-25T01:43:46.875617+0000","last_fullsized":"2024-04-25T01:43:46.875617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:13:12.753893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"30'141","reported_seq":167,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.743053+0000","last_change":"2024-04-25T01:39:33.448177+0000","last_active":"2024-04-25T01:43:34.743053+0000","last_peered":"2024-04-25T01:43:34.743053+0000","last_clean":"2024-04-25T01:43:34.743053+0000","last_became_active":"2024-04-25T01:39:33.447588+0000","last_became_peered":"2024-04-25T01:39:33.447588+0000","last_unstale":"2024-04-25T01:43:34.743053+0000","last_undegraded":"2024-04-25T01:43:34.743053+0000","last_fullsized":"2024-04-25T01:43:34.743053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:11:20.466189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"30'156","reported_seq":190,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.878803+0000","last_change":"2024-04-25T01:39:24.374082+0000","last_active":"2024-04-25T01:43:46.878803+0000","last_peered":"2024-04-25T01:43:46.878803+0000","last_clean":"2024-04-25T01:43:46.878803+0000","last_became_active":"2024-04-25T01:39:24.373731+0000","last_became_peered":"2024-04-25T01:39:24.373731+0000","last_unstale":"2024-04-25T01:43:46.878803+0000","last_undegraded":"2024-04-25T01:43:46.878803+0000","last_fullsized":"2024-04-25T01:43:46.878803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:45.817483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"30'188","reported_seq":214,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.753852+0000","last_change":"2024-04-25T01:39:33.446992+0000","last_active":"2024-04-25T01:43:34.753852+0000","last_peered":"2024-04-25T01:43:34.753852+0000","last_clean":"2024-04-25T01:43:34.753852+0000","last_became_active":"2024-04-25T01:39:33.446652+0000","last_became_peered":"2024-04-25T01:39:33.446652+0000","last_unstale":"2024-04-25T01:43:34.753852+0000","last_undegraded":"2024-04-25T01:43:34.753852+0000","last_fullsized":"2024-04-25T01:43:34.753852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:43:52.959274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"30'224","reported_seq":258,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.886451+0000","last_change":"2024-04-25T01:39:24.398614+0000","last_active":"2024-04-25T01:43:46.886451+0000","last_peered":"2024-04-25T01:43:46.886451+0000","last_clean":"2024-04-25T01:43:46.886451+0000","last_became_active":"2024-04-25T01:39:24.398299+0000","last_became_peered":"2024-04-25T01:39:24.398299+0000","last_unstale":"2024-04-25T01:43:46.886451+0000","last_undegraded":"2024-04-25T01:43:46.886451+0000","last_fullsized":"2024-04-25T01:43:46.886451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:54:51.191225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":516096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"30'167","reported_seq":193,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.764139+0000","last_change":"2024-04-25T01:39:33.441401+0000","last_active":"2024-04-25T01:43:34.764139+0000","last_peered":"2024-04-25T01:43:34.764139+0000","last_clean":"2024-04-25T01:43:34.764139+0000","last_became_active":"2024-04-25T01:39:33.441104+0000","last_became_peered":"2024-04-25T01:39:33.441104+0000","last_unstale":"2024-04-25T01:43:34.764139+0000","last_undegraded":"2024-04-25T01:43:34.764139+0000","last_fullsized":"2024-04-25T01:43:34.764139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:51.503340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"30'161","reported_seq":195,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.874331+0000","last_change":"2024-04-25T01:39:24.390352+0000","last_active":"2024-04-25T01:43:46.874331+0000","last_peered":"2024-04-25T01:43:46.874331+0000","last_clean":"2024-04-25T01:43:46.874331+0000","last_became_active":"2024-04-25T01:39:24.389809+0000","last_became_peered":"2024-04-25T01:39:24.389809+0000","last_unstale":"2024-04-25T01:43:46.874331+0000","last_undegraded":"2024-04-25T01:43:46.874331+0000","last_fullsized":"2024-04-25T01:43:46.874331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:22:44.221898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"30'188","reported_seq":213,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.738058+0000","last_change":"2024-04-25T01:39:33.426710+0000","last_active":"2024-04-25T01:43:34.738058+0000","last_peered":"2024-04-25T01:43:34.738058+0000","last_clean":"2024-04-25T01:43:34.738058+0000","last_became_active":"2024-04-25T01:39:33.426056+0000","last_became_peered":"2024-04-25T01:39:33.426056+0000","last_unstale":"2024-04-25T01:43:34.738058+0000","last_undegraded":"2024-04-25T01:43:34.738058+0000","last_fullsized":"2024-04-25T01:43:34.738058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:53:41.174851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"30'220","reported_seq":254,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.895157+0000","last_change":"2024-04-25T01:39:24.387093+0000","last_active":"2024-04-25T01:43:46.895157+0000","last_peered":"2024-04-25T01:43:46.895157+0000","last_clean":"2024-04-25T01:43:46.895157+0000","last_became_active":"2024-04-25T01:39:24.386809+0000","last_became_peered":"2024-04-25T01:39:24.386809+0000","last_unstale":"2024-04-25T01:43:46.895157+0000","last_undegraded":"2024-04-25T01:43:46.895157+0000","last_fullsized":"2024-04-25T01:43:46.895157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:46:05.313828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"30'189","reported_seq":214,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.730046+0000","last_change":"2024-04-25T01:39:33.436499+0000","last_active":"2024-04-25T01:43:34.730046+0000","last_peered":"2024-04-25T01:43:34.730046+0000","last_clean":"2024-04-25T01:43:34.730046+0000","last_became_active":"2024-04-25T01:39:33.436017+0000","last_became_peered":"2024-04-25T01:39:33.436017+0000","last_unstale":"2024-04-25T01:43:34.730046+0000","last_undegraded":"2024-04-25T01:43:34.730046+0000","last_fullsized":"2024-04-25T01:43:34.730046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:46:09.302012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"30'149","reported_seq":182,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.874684+0000","last_change":"2024-04-25T01:39:24.389039+0000","last_active":"2024-04-25T01:43:46.874684+0000","last_peered":"2024-04-25T01:43:46.874684+0000","last_clean":"2024-04-25T01:43:46.874684+0000","last_became_active":"2024-04-25T01:39:24.388793+0000","last_became_peered":"2024-04-25T01:39:24.388793+0000","last_unstale":"2024-04-25T01:43:46.874684+0000","last_undegraded":"2024-04-25T01:43:46.874684+0000","last_fullsized":"2024-04-25T01:43:46.874684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:13.093550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"30'196","reported_seq":221,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.759968+0000","last_change":"2024-04-25T01:39:33.441122+0000","last_active":"2024-04-25T01:43:34.759968+0000","last_peered":"2024-04-25T01:43:34.759968+0000","last_clean":"2024-04-25T01:43:34.759968+0000","last_became_active":"2024-04-25T01:39:33.440760+0000","last_became_peered":"2024-04-25T01:39:33.440760+0000","last_unstale":"2024-04-25T01:43:34.759968+0000","last_undegraded":"2024-04-25T01:43:34.759968+0000","last_fullsized":"2024-04-25T01:43:34.759968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:30:12.603789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"30'194","reported_seq":227,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.899298+0000","last_change":"2024-04-25T01:39:24.390884+0000","last_active":"2024-04-25T01:43:46.899298+0000","last_peered":"2024-04-25T01:43:46.899298+0000","last_clean":"2024-04-25T01:43:46.899298+0000","last_became_active":"2024-04-25T01:39:24.390591+0000","last_became_peered":"2024-04-25T01:39:24.390591+0000","last_unstale":"2024-04-25T01:43:46.899298+0000","last_undegraded":"2024-04-25T01:43:46.899298+0000","last_fullsized":"2024-04-25T01:43:46.899298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:51.274363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"30'233","reported_seq":258,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.751644+0000","last_change":"2024-04-25T01:39:33.429482+0000","last_active":"2024-04-25T01:43:34.751644+0000","last_peered":"2024-04-25T01:43:34.751644+0000","last_clean":"2024-04-25T01:43:34.751644+0000","last_became_active":"2024-04-25T01:39:33.429158+0000","last_became_peered":"2024-04-25T01:39:33.429158+0000","last_unstale":"2024-04-25T01:43:34.751644+0000","last_undegraded":"2024-04-25T01:43:34.751644+0000","last_fullsized":"2024-04-25T01:43:34.751644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:58:07.372868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"30'168","reported_seq":201,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.886803+0000","last_change":"2024-04-25T01:39:24.388891+0000","last_active":"2024-04-25T01:43:46.886803+0000","last_peered":"2024-04-25T01:43:46.886803+0000","last_clean":"2024-04-25T01:43:46.886803+0000","last_became_active":"2024-04-25T01:39:24.388619+0000","last_became_peered":"2024-04-25T01:39:24.388619+0000","last_unstale":"2024-04-25T01:43:46.886803+0000","last_undegraded":"2024-04-25T01:43:46.886803+0000","last_fullsized":"2024-04-25T01:43:46.886803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:05.176386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"30'215","reported_seq":240,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.728559+0000","last_change":"2024-04-25T01:39:33.443534+0000","last_active":"2024-04-25T01:43:34.728559+0000","last_peered":"2024-04-25T01:43:34.728559+0000","last_clean":"2024-04-25T01:43:34.728559+0000","last_became_active":"2024-04-25T01:39:33.443257+0000","last_became_peered":"2024-04-25T01:39:33.443257+0000","last_unstale":"2024-04-25T01:43:34.728559+0000","last_undegraded":"2024-04-25T01:43:34.728559+0000","last_fullsized":"2024-04-25T01:43:34.728559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:44:30.154519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"30'188","reported_seq":221,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.888562+0000","last_change":"2024-04-25T01:39:24.395109+0000","last_active":"2024-04-25T01:43:46.888562+0000","last_peered":"2024-04-25T01:43:46.888562+0000","last_clean":"2024-04-25T01:43:46.888562+0000","last_became_active":"2024-04-25T01:39:24.394784+0000","last_became_peered":"2024-04-25T01:39:24.394784+0000","last_unstale":"2024-04-25T01:43:46.888562+0000","last_undegraded":"2024-04-25T01:43:46.888562+0000","last_fullsized":"2024-04-25T01:43:46.888562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:44:09.102603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"30'159","reported_seq":184,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.714401+0000","last_change":"2024-04-25T01:39:33.446683+0000","last_active":"2024-04-25T01:43:34.714401+0000","last_peered":"2024-04-25T01:43:34.714401+0000","last_clean":"2024-04-25T01:43:34.714401+0000","last_became_active":"2024-04-25T01:39:33.445949+0000","last_became_peered":"2024-04-25T01:39:33.445949+0000","last_unstale":"2024-04-25T01:43:34.714401+0000","last_undegraded":"2024-04-25T01:43:34.714401+0000","last_fullsized":"2024-04-25T01:43:34.714401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:28.864821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"30'196","reported_seq":229,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.868887+0000","last_change":"2024-04-25T01:39:24.380199+0000","last_active":"2024-04-25T01:43:46.868887+0000","last_peered":"2024-04-25T01:43:46.868887+0000","last_clean":"2024-04-25T01:43:46.868887+0000","last_became_active":"2024-04-25T01:39:24.379591+0000","last_became_peered":"2024-04-25T01:39:24.379591+0000","last_unstale":"2024-04-25T01:43:46.868887+0000","last_undegraded":"2024-04-25T01:43:46.868887+0000","last_fullsized":"2024-04-25T01:43:46.868887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:54.534683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"30'233","reported_seq":258,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.760480+0000","last_change":"2024-04-25T01:39:33.439702+0000","last_active":"2024-04-25T01:43:34.760480+0000","last_peered":"2024-04-25T01:43:34.760480+0000","last_clean":"2024-04-25T01:43:34.760480+0000","last_became_active":"2024-04-25T01:39:33.439424+0000","last_became_peered":"2024-04-25T01:39:33.439424+0000","last_unstale":"2024-04-25T01:43:34.760480+0000","last_undegraded":"2024-04-25T01:43:34.760480+0000","last_fullsized":"2024-04-25T01:43:34.760480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:31.528140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"30'179","reported_seq":212,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.883530+0000","last_change":"2024-04-25T01:39:24.395125+0000","last_active":"2024-04-25T01:43:46.883530+0000","last_peered":"2024-04-25T01:43:46.883530+0000","last_clean":"2024-04-25T01:43:46.883530+0000","last_became_active":"2024-04-25T01:39:24.392605+0000","last_became_peered":"2024-04-25T01:39:24.392605+0000","last_unstale":"2024-04-25T01:43:46.883530+0000","last_undegraded":"2024-04-25T01:43:46.883530+0000","last_fullsized":"2024-04-25T01:43:46.883530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:53.333616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"30'166","reported_seq":191,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.710900+0000","last_change":"2024-04-25T01:39:33.438104+0000","last_active":"2024-04-25T01:43:34.710900+0000","last_peered":"2024-04-25T01:43:34.710900+0000","last_clean":"2024-04-25T01:43:34.710900+0000","last_became_active":"2024-04-25T01:39:33.437795+0000","last_became_peered":"2024-04-25T01:39:33.437795+0000","last_unstale":"2024-04-25T01:43:34.710900+0000","last_undegraded":"2024-04-25T01:43:34.710900+0000","last_fullsized":"2024-04-25T01:43:34.710900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:32.294104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"30'199","reported_seq":232,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.899022+0000","last_change":"2024-04-25T01:39:24.391312+0000","last_active":"2024-04-25T01:43:46.899022+0000","last_peered":"2024-04-25T01:43:46.899022+0000","last_clean":"2024-04-25T01:43:46.899022+0000","last_became_active":"2024-04-25T01:39:24.390978+0000","last_became_peered":"2024-04-25T01:39:24.390978+0000","last_unstale":"2024-04-25T01:43:46.899022+0000","last_undegraded":"2024-04-25T01:43:46.899022+0000","last_fullsized":"2024-04-25T01:43:46.899022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:38:25.637031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"30'197","reported_seq":222,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.738370+0000","last_change":"2024-04-25T01:39:33.431262+0000","last_active":"2024-04-25T01:43:34.738370+0000","last_peered":"2024-04-25T01:43:34.738370+0000","last_clean":"2024-04-25T01:43:34.738370+0000","last_became_active":"2024-04-25T01:39:33.430982+0000","last_became_peered":"2024-04-25T01:39:33.430982+0000","last_unstale":"2024-04-25T01:43:34.738370+0000","last_undegraded":"2024-04-25T01:43:34.738370+0000","last_fullsized":"2024-04-25T01:43:34.738370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:11.821542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"30'161","reported_seq":194,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.892591+0000","last_change":"2024-04-25T01:39:24.399270+0000","last_active":"2024-04-25T01:43:46.892591+0000","last_peered":"2024-04-25T01:43:46.892591+0000","last_clean":"2024-04-25T01:43:46.892591+0000","last_became_active":"2024-04-25T01:39:24.399011+0000","last_became_peered":"2024-04-25T01:39:24.399011+0000","last_unstale":"2024-04-25T01:43:46.892591+0000","last_undegraded":"2024-04-25T01:43:46.892591+0000","last_fullsized":"2024-04-25T01:43:46.892591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:00.987674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"30'187","reported_seq":212,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.706034+0000","last_change":"2024-04-25T01:39:33.443939+0000","last_active":"2024-04-25T01:43:34.706034+0000","last_peered":"2024-04-25T01:43:34.706034+0000","last_clean":"2024-04-25T01:43:34.706034+0000","last_became_active":"2024-04-25T01:39:33.443608+0000","last_became_peered":"2024-04-25T01:39:33.443608+0000","last_unstale":"2024-04-25T01:43:34.706034+0000","last_undegraded":"2024-04-25T01:43:34.706034+0000","last_fullsized":"2024-04-25T01:43:34.706034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:35.561173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"30'178","reported_seq":211,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.872334+0000","last_change":"2024-04-25T01:39:24.388943+0000","last_active":"2024-04-25T01:43:46.872334+0000","last_peered":"2024-04-25T01:43:46.872334+0000","last_clean":"2024-04-25T01:43:46.872334+0000","last_became_active":"2024-04-25T01:39:24.388690+0000","last_became_peered":"2024-04-25T01:39:24.388690+0000","last_unstale":"2024-04-25T01:43:46.872334+0000","last_undegraded":"2024-04-25T01:43:46.872334+0000","last_fullsized":"2024-04-25T01:43:46.872334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:42:18.260701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"30'175","reported_seq":200,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.762256+0000","last_change":"2024-04-25T01:39:33.438460+0000","last_active":"2024-04-25T01:43:34.762256+0000","last_peered":"2024-04-25T01:43:34.762256+0000","last_clean":"2024-04-25T01:43:34.762256+0000","last_became_active":"2024-04-25T01:39:33.436581+0000","last_became_peered":"2024-04-25T01:39:33.436581+0000","last_unstale":"2024-04-25T01:43:34.762256+0000","last_undegraded":"2024-04-25T01:43:34.762256+0000","last_fullsized":"2024-04-25T01:43:34.762256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:03:27.382925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"30'181","reported_seq":214,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.879616+0000","last_change":"2024-04-25T01:39:24.389556+0000","last_active":"2024-04-25T01:43:46.879616+0000","last_peered":"2024-04-25T01:43:46.879616+0000","last_clean":"2024-04-25T01:43:46.879616+0000","last_became_active":"2024-04-25T01:39:24.389254+0000","last_became_peered":"2024-04-25T01:39:24.389254+0000","last_unstale":"2024-04-25T01:43:46.879616+0000","last_undegraded":"2024-04-25T01:43:46.879616+0000","last_fullsized":"2024-04-25T01:43:46.879616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:56.208172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"30'237","reported_seq":262,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.748129+0000","last_change":"2024-04-25T01:39:33.433893+0000","last_active":"2024-04-25T01:43:34.748129+0000","last_peered":"2024-04-25T01:43:34.748129+0000","last_clean":"2024-04-25T01:43:34.748129+0000","last_became_active":"2024-04-25T01:39:33.433577+0000","last_became_peered":"2024-04-25T01:39:33.433577+0000","last_unstale":"2024-04-25T01:43:34.748129+0000","last_undegraded":"2024-04-25T01:43:34.748129+0000","last_fullsized":"2024-04-25T01:43:34.748129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:16.371837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"30'187","reported_seq":220,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.884139+0000","last_change":"2024-04-25T01:39:24.392021+0000","last_active":"2024-04-25T01:43:46.884139+0000","last_peered":"2024-04-25T01:43:46.884139+0000","last_clean":"2024-04-25T01:43:46.884139+0000","last_became_active":"2024-04-25T01:39:24.391352+0000","last_became_peered":"2024-04-25T01:39:24.391352+0000","last_unstale":"2024-04-25T01:43:46.884139+0000","last_undegraded":"2024-04-25T01:43:46.884139+0000","last_fullsized":"2024-04-25T01:43:46.884139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:44.434749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"30'186","reported_seq":211,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.683783+0000","last_change":"2024-04-25T01:39:33.436641+0000","last_active":"2024-04-25T01:43:34.683783+0000","last_peered":"2024-04-25T01:43:34.683783+0000","last_clean":"2024-04-25T01:43:34.683783+0000","last_became_active":"2024-04-25T01:39:33.436389+0000","last_became_peered":"2024-04-25T01:39:33.436389+0000","last_unstale":"2024-04-25T01:43:34.683783+0000","last_undegraded":"2024-04-25T01:43:34.683783+0000","last_fullsized":"2024-04-25T01:43:34.683783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:19:51.940088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"30'169","reported_seq":202,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.883979+0000","last_change":"2024-04-25T01:39:24.396300+0000","last_active":"2024-04-25T01:43:46.883979+0000","last_peered":"2024-04-25T01:43:46.883979+0000","last_clean":"2024-04-25T01:43:46.883979+0000","last_became_active":"2024-04-25T01:39:24.396023+0000","last_became_peered":"2024-04-25T01:39:24.396023+0000","last_unstale":"2024-04-25T01:43:46.883979+0000","last_undegraded":"2024-04-25T01:43:46.883979+0000","last_fullsized":"2024-04-25T01:43:46.883979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:21.500721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"30'186","reported_seq":211,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.733553+0000","last_change":"2024-04-25T01:39:33.443419+0000","last_active":"2024-04-25T01:43:34.733553+0000","last_peered":"2024-04-25T01:43:34.733553+0000","last_clean":"2024-04-25T01:43:34.733553+0000","last_became_active":"2024-04-25T01:39:33.443163+0000","last_became_peered":"2024-04-25T01:39:33.443163+0000","last_unstale":"2024-04-25T01:43:34.733553+0000","last_undegraded":"2024-04-25T01:43:34.733553+0000","last_fullsized":"2024-04-25T01:43:34.733553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:22.156410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"30'212","reported_seq":245,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.897937+0000","last_change":"2024-04-25T01:39:24.404047+0000","last_active":"2024-04-25T01:43:46.897937+0000","last_peered":"2024-04-25T01:43:46.897937+0000","last_clean":"2024-04-25T01:43:46.897937+0000","last_became_active":"2024-04-25T01:39:24.403700+0000","last_became_peered":"2024-04-25T01:39:24.403700+0000","last_unstale":"2024-04-25T01:43:46.897937+0000","last_undegraded":"2024-04-25T01:43:46.897937+0000","last_fullsized":"2024-04-25T01:43:46.897937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:53.123061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":491520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"30'177","reported_seq":202,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.712967+0000","last_change":"2024-04-25T01:39:33.435520+0000","last_active":"2024-04-25T01:43:34.712967+0000","last_peered":"2024-04-25T01:43:34.712967+0000","last_clean":"2024-04-25T01:43:34.712967+0000","last_became_active":"2024-04-25T01:39:33.434446+0000","last_became_peered":"2024-04-25T01:39:33.434446+0000","last_unstale":"2024-04-25T01:43:34.712967+0000","last_undegraded":"2024-04-25T01:43:34.712967+0000","last_fullsized":"2024-04-25T01:43:34.712967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:59.696009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"30'183","reported_seq":221,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.883554+0000","last_change":"2024-04-25T01:40:05.559200+0000","last_active":"2024-04-25T01:43:46.883554+0000","last_peered":"2024-04-25T01:43:46.883554+0000","last_clean":"2024-04-25T01:43:46.883554+0000","last_became_active":"2024-04-25T01:40:05.558954+0000","last_became_peered":"2024-04-25T01:40:05.558954+0000","last_unstale":"2024-04-25T01:43:46.883554+0000","last_undegraded":"2024-04-25T01:43:46.883554+0000","last_fullsized":"2024-04-25T01:43:46.883554+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:30.998037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"30'191","reported_seq":216,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.740677+0000","last_change":"2024-04-25T01:39:33.436479+0000","last_active":"2024-04-25T01:43:34.740677+0000","last_peered":"2024-04-25T01:43:34.740677+0000","last_clean":"2024-04-25T01:43:34.740677+0000","last_became_active":"2024-04-25T01:39:33.436193+0000","last_became_peered":"2024-04-25T01:39:33.436193+0000","last_unstale":"2024-04-25T01:43:34.740677+0000","last_undegraded":"2024-04-25T01:43:34.740677+0000","last_fullsized":"2024-04-25T01:43:34.740677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:20:03.455536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"30'179","reported_seq":212,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.896948+0000","last_change":"2024-04-25T01:39:24.393362+0000","last_active":"2024-04-25T01:43:46.896948+0000","last_peered":"2024-04-25T01:43:46.896948+0000","last_clean":"2024-04-25T01:43:46.896948+0000","last_became_active":"2024-04-25T01:39:24.392836+0000","last_became_peered":"2024-04-25T01:39:24.392836+0000","last_unstale":"2024-04-25T01:43:46.896948+0000","last_undegraded":"2024-04-25T01:43:46.896948+0000","last_fullsized":"2024-04-25T01:43:46.896948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:58.871777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"30'168","reported_seq":194,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.765220+0000","last_change":"2024-04-25T01:39:33.440164+0000","last_active":"2024-04-25T01:43:34.765220+0000","last_peered":"2024-04-25T01:43:34.765220+0000","last_clean":"2024-04-25T01:43:34.765220+0000","last_became_active":"2024-04-25T01:39:33.439878+0000","last_became_peered":"2024-04-25T01:39:33.439878+0000","last_unstale":"2024-04-25T01:43:34.765220+0000","last_undegraded":"2024-04-25T01:43:34.765220+0000","last_fullsized":"2024-04-25T01:43:34.765220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:44:52.817169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"30'207","reported_seq":240,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.896113+0000","last_change":"2024-04-25T01:39:24.401765+0000","last_active":"2024-04-25T01:43:46.896113+0000","last_peered":"2024-04-25T01:43:46.896113+0000","last_clean":"2024-04-25T01:43:46.896113+0000","last_became_active":"2024-04-25T01:39:24.400509+0000","last_became_peered":"2024-04-25T01:39:24.400509+0000","last_unstale":"2024-04-25T01:43:46.896113+0000","last_undegraded":"2024-04-25T01:43:46.896113+0000","last_fullsized":"2024-04-25T01:43:46.896113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:25.031622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":491520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"30'180","reported_seq":206,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.734853+0000","last_change":"2024-04-25T01:39:33.439353+0000","last_active":"2024-04-25T01:43:34.734853+0000","last_peered":"2024-04-25T01:43:34.734853+0000","last_clean":"2024-04-25T01:43:34.734853+0000","last_became_active":"2024-04-25T01:39:33.438915+0000","last_became_peered":"2024-04-25T01:39:33.438915+0000","last_unstale":"2024-04-25T01:43:34.734853+0000","last_undegraded":"2024-04-25T01:43:34.734853+0000","last_fullsized":"2024-04-25T01:43:34.734853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:19.180919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"30'197","reported_seq":230,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.885409+0000","last_change":"2024-04-25T01:39:24.387941+0000","last_active":"2024-04-25T01:43:46.885409+0000","last_peered":"2024-04-25T01:43:46.885409+0000","last_clean":"2024-04-25T01:43:46.885409+0000","last_became_active":"2024-04-25T01:39:24.387674+0000","last_became_peered":"2024-04-25T01:39:24.387674+0000","last_unstale":"2024-04-25T01:43:46.885409+0000","last_undegraded":"2024-04-25T01:43:46.885409+0000","last_fullsized":"2024-04-25T01:43:46.885409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:05.676143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"30'205","reported_seq":231,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.768022+0000","last_change":"2024-04-25T01:39:33.444917+0000","last_active":"2024-04-25T01:43:34.768022+0000","last_peered":"2024-04-25T01:43:34.768022+0000","last_clean":"2024-04-25T01:43:34.768022+0000","last_became_active":"2024-04-25T01:39:33.444636+0000","last_became_peered":"2024-04-25T01:39:33.444636+0000","last_unstale":"2024-04-25T01:43:34.768022+0000","last_undegraded":"2024-04-25T01:43:34.768022+0000","last_fullsized":"2024-04-25T01:43:34.768022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:31.531502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"30'159","reported_seq":192,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.895208+0000","last_change":"2024-04-25T01:39:24.399950+0000","last_active":"2024-04-25T01:43:46.895208+0000","last_peered":"2024-04-25T01:43:46.895208+0000","last_clean":"2024-04-25T01:43:46.895208+0000","last_became_active":"2024-04-25T01:39:24.399701+0000","last_became_peered":"2024-04-25T01:39:24.399701+0000","last_unstale":"2024-04-25T01:43:46.895208+0000","last_undegraded":"2024-04-25T01:43:46.895208+0000","last_fullsized":"2024-04-25T01:43:46.895208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:49.618370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"30'193","reported_seq":219,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.907697+0000","last_change":"2024-04-25T01:39:33.440936+0000","last_active":"2024-04-25T01:43:34.907697+0000","last_peered":"2024-04-25T01:43:34.907697+0000","last_clean":"2024-04-25T01:43:34.907697+0000","last_became_active":"2024-04-25T01:39:33.440679+0000","last_became_peered":"2024-04-25T01:39:33.440679+0000","last_unstale":"2024-04-25T01:43:34.907697+0000","last_undegraded":"2024-04-25T01:43:34.907697+0000","last_fullsized":"2024-04-25T01:43:34.907697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:08:53.629572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"30'177","reported_seq":210,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.876988+0000","last_change":"2024-04-25T01:39:24.380318+0000","last_active":"2024-04-25T01:43:46.876988+0000","last_peered":"2024-04-25T01:43:46.876988+0000","last_clean":"2024-04-25T01:43:46.876988+0000","last_became_active":"2024-04-25T01:39:24.379573+0000","last_became_peered":"2024-04-25T01:39:24.379573+0000","last_unstale":"2024-04-25T01:43:46.876988+0000","last_undegraded":"2024-04-25T01:43:46.876988+0000","last_fullsized":"2024-04-25T01:43:46.876988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:12.089917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"30'176","reported_seq":201,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.756355+0000","last_change":"2024-04-25T01:39:33.426380+0000","last_active":"2024-04-25T01:43:34.756355+0000","last_peered":"2024-04-25T01:43:34.756355+0000","last_clean":"2024-04-25T01:43:34.756355+0000","last_became_active":"2024-04-25T01:39:33.426090+0000","last_became_peered":"2024-04-25T01:39:33.426090+0000","last_unstale":"2024-04-25T01:43:34.756355+0000","last_undegraded":"2024-04-25T01:43:34.756355+0000","last_fullsized":"2024-04-25T01:43:34.756355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:34.329217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"30'192","reported_seq":226,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.896768+0000","last_change":"2024-04-25T01:39:24.398726+0000","last_active":"2024-04-25T01:43:46.896768+0000","last_peered":"2024-04-25T01:43:46.896768+0000","last_clean":"2024-04-25T01:43:46.896768+0000","last_became_active":"2024-04-25T01:39:24.398449+0000","last_became_peered":"2024-04-25T01:39:24.398449+0000","last_unstale":"2024-04-25T01:43:46.896768+0000","last_undegraded":"2024-04-25T01:43:46.896768+0000","last_fullsized":"2024-04-25T01:43:46.896768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:41:38.230939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"30'187","reported_seq":212,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.731406+0000","last_change":"2024-04-25T01:39:33.436488+0000","last_active":"2024-04-25T01:43:34.731406+0000","last_peered":"2024-04-25T01:43:34.731406+0000","last_clean":"2024-04-25T01:43:34.731406+0000","last_became_active":"2024-04-25T01:39:33.436224+0000","last_became_peered":"2024-04-25T01:39:33.436224+0000","last_unstale":"2024-04-25T01:43:34.731406+0000","last_undegraded":"2024-04-25T01:43:34.731406+0000","last_fullsized":"2024-04-25T01:43:34.731406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:38.227206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"30'175","reported_seq":209,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.871923+0000","last_change":"2024-04-25T01:39:24.386909+0000","last_active":"2024-04-25T01:43:46.871923+0000","last_peered":"2024-04-25T01:43:46.871923+0000","last_clean":"2024-04-25T01:43:46.871923+0000","last_became_active":"2024-04-25T01:39:24.386568+0000","last_became_peered":"2024-04-25T01:39:24.386568+0000","last_unstale":"2024-04-25T01:43:46.871923+0000","last_undegraded":"2024-04-25T01:43:46.871923+0000","last_fullsized":"2024-04-25T01:43:46.871923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:29.904064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"30'223","reported_seq":248,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.755445+0000","last_change":"2024-04-25T01:39:33.440753+0000","last_active":"2024-04-25T01:43:34.755445+0000","last_peered":"2024-04-25T01:43:34.755445+0000","last_clean":"2024-04-25T01:43:34.755445+0000","last_became_active":"2024-04-25T01:39:33.440480+0000","last_became_peered":"2024-04-25T01:39:33.440480+0000","last_unstale":"2024-04-25T01:43:34.755445+0000","last_undegraded":"2024-04-25T01:43:34.755445+0000","last_fullsized":"2024-04-25T01:43:34.755445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:18.113293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"30'159","reported_seq":193,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.877584+0000","last_change":"2024-04-25T01:39:24.386803+0000","last_active":"2024-04-25T01:43:46.877584+0000","last_peered":"2024-04-25T01:43:46.877584+0000","last_clean":"2024-04-25T01:43:46.877584+0000","last_became_active":"2024-04-25T01:39:24.386531+0000","last_became_peered":"2024-04-25T01:39:24.386531+0000","last_unstale":"2024-04-25T01:43:46.877584+0000","last_undegraded":"2024-04-25T01:43:46.877584+0000","last_fullsized":"2024-04-25T01:43:46.877584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:19.160345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"30'214","reported_seq":239,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.689935+0000","last_change":"2024-04-25T01:39:33.436433+0000","last_active":"2024-04-25T01:43:34.689935+0000","last_peered":"2024-04-25T01:43:34.689935+0000","last_clean":"2024-04-25T01:43:34.689935+0000","last_became_active":"2024-04-25T01:39:33.436134+0000","last_became_peered":"2024-04-25T01:39:33.436134+0000","last_unstale":"2024-04-25T01:43:34.689935+0000","last_undegraded":"2024-04-25T01:43:34.689935+0000","last_fullsized":"2024-04-25T01:43:34.689935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:08:30.641790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"30'170","reported_seq":204,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.888991+0000","last_change":"2024-04-25T01:39:24.396231+0000","last_active":"2024-04-25T01:43:46.888991+0000","last_peered":"2024-04-25T01:43:46.888991+0000","last_clean":"2024-04-25T01:43:46.888991+0000","last_became_active":"2024-04-25T01:39:24.395958+0000","last_became_peered":"2024-04-25T01:39:24.395958+0000","last_unstale":"2024-04-25T01:43:46.888991+0000","last_undegraded":"2024-04-25T01:43:46.888991+0000","last_fullsized":"2024-04-25T01:43:46.888991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:54.898765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12101,"ondisk_log_size":12101,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":7961050,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":239,"num_read_kb":8015,"num_write":3914,"num_write_kb":11480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15990784,"data_stored":15922100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3914,"ondisk_log_size":3914,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11253,"ondisk_log_size":11253,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8001487,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":165,"num_read_kb":215,"num_write":3941,"num_write_kb":11543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16072704,"data_stored":16002974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3930,"ondisk_log_size":3930,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67676,"kb_used_data":4628,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94304164,"statfs":{"total":96636764160,"available":96567463936,"internally_reserved":0,"allocated":4739072,"data_stored":4538211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":64551370},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61976,"kb_used_data":4432,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94309864,"statfs":{"total":96636764160,"available":96573300736,"internally_reserved":0,"allocated":4538368,"data_stored":4337555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574907,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62040,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94309800,"statfs":{"total":96636764160,"available":96573235200,"internally_reserved":0,"allocated":344064,"data_stored":143129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574907,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67072,"kb_used_data":4024,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94304768,"statfs":{"total":96636764160,"available":96568082432,"internally_reserved":0,"allocated":4120576,"data_stored":3907469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123396,"kb_used_data":15932,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94248444,"statfs":{"total":96636764160,"available":96510406656,"internally_reserved":0,"allocated":16314368,"data_stored":16102349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":110033351},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574907,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57872,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313968,"statfs":{"total":96636764160,"available":96577503232,"internally_reserved":0,"allocated":335872,"data_stored":142538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49500,"kb_used_data":4436,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94322340,"statfs":{"total":96636764160,"available":96586076160,"internally_reserved":0,"allocated":4542464,"data_stored":4337121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574907,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62616,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94309224,"statfs":{"total":96636764160,"available":96572645376,"internally_reserved":0,"allocated":933888,"data_stored":732969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8015872,"data_stored":8000689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3813376,"data_stored":3805790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4194998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7974912,"data_stored":7959870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3780608,"data_stored":3765380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T01:43:50.294 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T01:43:50.294 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T01:43:50.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.433+0000 7f624311d640 1 Processor -- start 2024-04-25T01:43:50.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.433+0000 7f624311d640 1 -- start start 2024-04-25T01:43:50.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.434+0000 7f624311d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f623c0c3af0 0x7f623c070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:50.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.434+0000 7f624311d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f623c0adb60 0x7f623c156b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:50.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.434+0000 7f624311d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f623c1596b0 0x7f623c14c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:50.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.434+0000 7f624311d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f623c06c870 con 0x7f623c0c3af0 2024-04-25T01:43:50.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.434+0000 7f624311d640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f623c157080 con 0x7f623c1596b0 2024-04-25T01:43:50.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.434+0000 7f624311d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f623c072c30 con 0x7f623c0adb60 2024-04-25T01:43:50.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.434+0000 7f6240eb9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f623c0c3af0 0x7f623c070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:50.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.434+0000 7f6240eb9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f623c0c3af0 0x7f623c070e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59018/0 (socket says 172.21.15.77:59018) 2024-04-25T01:43:50.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.434+0000 7f6240eb9640 1 -- 172.21.15.77:0/1430021958 learned_addr learned my addr 172.21.15.77:0/1430021958 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:50.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.434+0000 7f6240eb9640 1 -- 172.21.15.77:0/1430021958 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f623c0adb60 msgr2=0x7f623c156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:50.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.434+0000 7f6240eb9640 1 --2- 172.21.15.77:0/1430021958 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f623c0adb60 0x7f623c156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.434+0000 7f6240eb9640 1 -- 172.21.15.77:0/1430021958 >> v2:172.21.15.121:3300/0 conn(0x7f623c1596b0 msgr2=0x7f623c14c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:50.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.434+0000 7f62416ba640 1 --2- 172.21.15.77:0/1430021958 >> v2:172.21.15.121:3300/0 conn(0x7f623c1596b0 0x7f623c14c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:50.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.434+0000 7f6240eb9640 1 --2- 172.21.15.77:0/1430021958 >> v2:172.21.15.121:3300/0 conn(0x7f623c1596b0 0x7f623c14c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.434+0000 7f6240eb9640 1 -- 172.21.15.77:0/1430021958 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623c072f10 con 0x7f623c0c3af0 2024-04-25T01:43:50.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.435+0000 7f6240eb9640 1 --2- 172.21.15.77:0/1430021958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f623c0c3af0 0x7f623c070e00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f623c072a20 tx=0x7f623002a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae8d96a6e93c952 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:50.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.435+0000 7f623b7fe640 1 -- 172.21.15.77:0/1430021958 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6230036070 con 0x7f623c0c3af0 2024-04-25T01:43:50.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.435+0000 7f623b7fe640 1 -- 172.21.15.77:0/1430021958 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6230031600 con 0x7f623c0c3af0 2024-04-25T01:43:50.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.435+0000 7f623b7fe640 1 -- 172.21.15.77:0/1430021958 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62300319d0 con 0x7f623c0c3af0 2024-04-25T01:43:50.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.435+0000 7f624311d640 1 -- 172.21.15.77:0/1430021958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f623c0c3af0 msgr2=0x7f623c070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:50.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.435+0000 7f624311d640 1 --2- 172.21.15.77:0/1430021958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f623c0c3af0 0x7f623c070e00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f623c072a20 tx=0x7f623002a570 comp rx=0 tx=0).stop 2024-04-25T01:43:50.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.435+0000 7f624311d640 1 -- 172.21.15.77:0/1430021958 shutdown_connections 2024-04-25T01:43:50.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.435+0000 7f624311d640 1 --2- 172.21.15.77:0/1430021958 >> v2:172.21.15.121:3300/0 conn(0x7f623c1596b0 0x7f623c14c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.435+0000 7f624311d640 1 --2- 172.21.15.77:0/1430021958 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f623c0adb60 0x7f623c156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.435+0000 7f624311d640 1 --2- 172.21.15.77:0/1430021958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f623c0c3af0 0x7f623c070e00 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.436+0000 7f624311d640 1 -- 172.21.15.77:0/1430021958 >> 172.21.15.77:0/1430021958 conn(0x7f623c0c4970 msgr2=0x7f623c0c4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:50.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.436+0000 7f624311d640 1 -- 172.21.15.77:0/1430021958 shutdown_connections 2024-04-25T01:43:50.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.436+0000 7f624311d640 1 -- 172.21.15.77:0/1430021958 wait complete. 2024-04-25T01:43:50.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.437+0000 7f624311d640 1 Processor -- start 2024-04-25T01:43:50.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.437+0000 7f624311d640 1 -- start start 2024-04-25T01:43:50.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.437+0000 7f624311d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f623c0adb60 0x7f623c155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:50.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.437+0000 7f624311d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f623c0c3af0 0x7f623c1eedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:50.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.437+0000 7f624311d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f623c1596b0 0x7f623c154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:50.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.437+0000 7f624311d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f623c06cf20 con 0x7f623c1596b0 2024-04-25T01:43:50.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.437+0000 7f624311d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f623c06cda0 con 0x7f623c0adb60 2024-04-25T01:43:50.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.437+0000 7f624311d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f623c0c3ed0 con 0x7f623c0c3af0 2024-04-25T01:43:50.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.437+0000 7f62416ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f623c1596b0 0x7f623c154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:50.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.438+0000 7f62416ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f623c1596b0 0x7f623c154f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59026/0 (socket says 172.21.15.77:59026) 2024-04-25T01:43:50.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.438+0000 7f62416ba640 1 -- 172.21.15.77:0/1689920048 learned_addr learned my addr 172.21.15.77:0/1689920048 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:50.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.438+0000 7f6240eb9640 1 --2- 172.21.15.77:0/1689920048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f623c0adb60 0x7f623c155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:50.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.438+0000 7f623bfff640 1 --2- 172.21.15.77:0/1689920048 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f623c0c3af0 0x7f623c1eedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:50.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.438+0000 7f62416ba640 1 -- 172.21.15.77:0/1689920048 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f623c0c3af0 msgr2=0x7f623c1eedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:50.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.438+0000 7f62416ba640 1 --2- 172.21.15.77:0/1689920048 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f623c0c3af0 0x7f623c1eedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.438+0000 7f62416ba640 1 -- 172.21.15.77:0/1689920048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f623c0adb60 msgr2=0x7f623c155ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:50.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.438+0000 7f62416ba640 1 --2- 172.21.15.77:0/1689920048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f623c0adb60 0x7f623c155ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.438+0000 7f62416ba640 1 -- 172.21.15.77:0/1689920048 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623c0aa960 con 0x7f623c1596b0 2024-04-25T01:43:50.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.438+0000 7f62416ba640 1 --2- 172.21.15.77:0/1689920048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f623c1596b0 0x7f623c154f10 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f623400c550 tx=0x7f623400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:50.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.438+0000 7f62397fa640 1 -- 172.21.15.77:0/1689920048 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6234015070 con 0x7f623c1596b0 2024-04-25T01:43:50.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.438+0000 7f62397fa640 1 -- 172.21.15.77:0/1689920048 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6234004220 con 0x7f623c1596b0 2024-04-25T01:43:50.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.438+0000 7f62397fa640 1 -- 172.21.15.77:0/1689920048 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6234003610 con 0x7f623c1596b0 2024-04-25T01:43:50.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.438+0000 7f624311d640 1 -- 172.21.15.77:0/1689920048 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f623c1ef630 con 0x7f623c1596b0 2024-04-25T01:43:50.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.438+0000 7f624311d640 1 -- 172.21.15.77:0/1689920048 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f623c1ef330 con 0x7f623c1596b0 2024-04-25T01:43:50.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.439+0000 7f624311d640 1 -- 172.21.15.77:0/1689920048 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f623c04f500 con 0x7f623c1596b0 2024-04-25T01:43:50.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.440+0000 7f62397fa640 1 -- 172.21.15.77:0/1689920048 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f62340037b0 con 0x7f623c1596b0 2024-04-25T01:43:50.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.440+0000 7f62397fa640 1 --2- 172.21.15.77:0/1689920048 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f622006be30 0x7f622006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:50.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.440+0000 7f62397fa640 1 -- 172.21.15.77:0/1689920048 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7f623408afa0 con 0x7f623c1596b0 2024-04-25T01:43:50.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.440+0000 7f6240eb9640 1 --2- 172.21.15.77:0/1689920048 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f622006be30 0x7f622006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:50.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.440+0000 7f6240eb9640 1 --2- 172.21.15.77:0/1689920048 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f622006be30 0x7f622006e2f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6230033000 tx=0x7f6230009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:50.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.444+0000 7f62397fa640 1 -- 172.21.15.77:0/1689920048 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6234058e40 con 0x7f623c1596b0 2024-04-25T01:43:50.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.616+0000 7f624311d640 1 -- 172.21.15.77:0/1689920048 --> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f623c1e9250 con 0x7f622006be30 2024-04-25T01:43:50.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.626+0000 7f62397fa640 1 -- 172.21.15.77:0/1689920048 <== mgr.4098 v2:172.21.15.77:6832/4208232183 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+492656 (secure 0 0 0) 0x7f623c1e9250 con 0x7f622006be30 2024-04-25T01:43:50.622 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:43:50.626 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-25T01:43:50.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.630+0000 7f624311d640 1 -- 172.21.15.77:0/1689920048 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f622006be30 msgr2=0x7f622006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:50.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.630+0000 7f624311d640 1 --2- 172.21.15.77:0/1689920048 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f622006be30 0x7f622006e2f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6230033000 tx=0x7f6230009000 comp rx=0 tx=0).stop 2024-04-25T01:43:50.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.630+0000 7f624311d640 1 -- 172.21.15.77:0/1689920048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f623c1596b0 msgr2=0x7f623c154f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:50.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.630+0000 7f624311d640 1 --2- 172.21.15.77:0/1689920048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f623c1596b0 0x7f623c154f10 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f623400c550 tx=0x7f623400ca10 comp rx=0 tx=0).stop 2024-04-25T01:43:50.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.630+0000 7f624311d640 1 -- 172.21.15.77:0/1689920048 shutdown_connections 2024-04-25T01:43:50.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.630+0000 7f624311d640 1 --2- 172.21.15.77:0/1689920048 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f622006be30 0x7f622006e2f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.630+0000 7f624311d640 1 --2- 172.21.15.77:0/1689920048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f623c1596b0 0x7f623c154f10 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.630+0000 7f624311d640 1 --2- 172.21.15.77:0/1689920048 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f623c0c3af0 0x7f623c1eedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.630+0000 7f624311d640 1 --2- 172.21.15.77:0/1689920048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f623c0adb60 0x7f623c155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.630+0000 7f624311d640 1 -- 172.21.15.77:0/1689920048 >> 172.21.15.77:0/1689920048 conn(0x7f623c0c4970 msgr2=0x7f623c070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:50.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.631+0000 7f624311d640 1 -- 172.21.15.77:0/1689920048 shutdown_connections 2024-04-25T01:43:50.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.631+0000 7f624311d640 1 -- 172.21.15.77:0/1689920048 wait complete. 2024-04-25T01:43:50.632 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2024-04-25T01:43:49.724066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16552905,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":520,"num_read_kb":8330,"num_write":26446,"num_write_kb":50357087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31315,"ondisk_log_size":31315,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":552148,"kb_used_data":35028,"kb_used_omap":12,"kb_used_meta":517043,"kb_avail":754422572,"statfs":{"total":773094113280,"available":772528713728,"internally_reserved":0,"allocated":35868672,"data_stored":34241341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":529452592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1623193311,"num_objects":-387,"num_object_clones":0,"num_object_copies":-774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-387,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":391,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003598"},"pg_stats":[{"pgid":"5.18","version":"30'210","reported_seq":235,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.740479+0000","last_change":"2024-04-25T01:39:33.445614+0000","last_active":"2024-04-25T01:43:34.740479+0000","last_peered":"2024-04-25T01:43:34.740479+0000","last_clean":"2024-04-25T01:43:34.740479+0000","last_became_active":"2024-04-25T01:39:33.445090+0000","last_became_peered":"2024-04-25T01:39:33.445090+0000","last_unstale":"2024-04-25T01:43:34.740479+0000","last_undegraded":"2024-04-25T01:43:34.740479+0000","last_fullsized":"2024-04-25T01:43:34.740479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:50.951488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"29'6","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403369+0000","last_change":"2024-04-25T01:39:23.377096+0000","last_active":"2024-04-25T01:43:29.403369+0000","last_peered":"2024-04-25T01:43:29.403369+0000","last_clean":"2024-04-25T01:43:29.403369+0000","last_became_active":"2024-04-25T01:39:23.376811+0000","last_became_peered":"2024-04-25T01:39:23.376811+0000","last_unstale":"2024-04-25T01:43:29.403369+0000","last_undegraded":"2024-04-25T01:43:29.403369+0000","last_fullsized":"2024-04-25T01:43:29.403369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:26.888605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"30'181","reported_seq":215,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.883447+0000","last_change":"2024-04-25T01:39:24.394317+0000","last_active":"2024-04-25T01:43:46.883447+0000","last_peered":"2024-04-25T01:43:46.883447+0000","last_clean":"2024-04-25T01:43:46.883447+0000","last_became_active":"2024-04-25T01:39:24.394032+0000","last_became_peered":"2024-04-25T01:39:24.394032+0000","last_unstale":"2024-04-25T01:43:46.883447+0000","last_undegraded":"2024-04-25T01:43:46.883447+0000","last_fullsized":"2024-04-25T01:43:46.883447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:11.795443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.407597+0000","last_change":"2024-04-25T01:39:32.421607+0000","last_active":"2024-04-25T01:43:29.407597+0000","last_peered":"2024-04-25T01:43:29.407597+0000","last_clean":"2024-04-25T01:43:29.407597+0000","last_became_active":"2024-04-25T01:39:32.421355+0000","last_became_peered":"2024-04-25T01:39:32.421355+0000","last_unstale":"2024-04-25T01:43:29.407597+0000","last_undegraded":"2024-04-25T01:43:29.407597+0000","last_fullsized":"2024-04-25T01:43:29.407597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:12:14.019262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"30'203","reported_seq":228,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.744955+0000","last_change":"2024-04-25T01:39:33.436651+0000","last_active":"2024-04-25T01:43:34.744955+0000","last_peered":"2024-04-25T01:43:34.744955+0000","last_clean":"2024-04-25T01:43:34.744955+0000","last_became_active":"2024-04-25T01:39:33.436370+0000","last_became_peered":"2024-04-25T01:39:33.436370+0000","last_unstale":"2024-04-25T01:43:34.744955+0000","last_undegraded":"2024-04-25T01:43:34.744955+0000","last_fullsized":"2024-04-25T01:43:34.744955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:57:10.341738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"29'3","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.408859+0000","last_change":"2024-04-25T01:39:23.369400+0000","last_active":"2024-04-25T01:43:29.408859+0000","last_peered":"2024-04-25T01:43:29.408859+0000","last_clean":"2024-04-25T01:43:29.408859+0000","last_became_active":"2024-04-25T01:39:23.368726+0000","last_became_peered":"2024-04-25T01:39:23.368726+0000","last_unstale":"2024-04-25T01:43:29.408859+0000","last_undegraded":"2024-04-25T01:43:29.408859+0000","last_fullsized":"2024-04-25T01:43:29.408859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:35:42.971179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"30'177","reported_seq":211,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.894898+0000","last_change":"2024-04-25T01:39:24.403873+0000","last_active":"2024-04-25T01:43:46.894898+0000","last_peered":"2024-04-25T01:43:46.894898+0000","last_clean":"2024-04-25T01:43:46.894898+0000","last_became_active":"2024-04-25T01:39:24.403623+0000","last_became_peered":"2024-04-25T01:39:24.403623+0000","last_unstale":"2024-04-25T01:43:46.894898+0000","last_undegraded":"2024-04-25T01:43:46.894898+0000","last_fullsized":"2024-04-25T01:43:46.894898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:49.360933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.402853+0000","last_change":"2024-04-25T01:39:32.430985+0000","last_active":"2024-04-25T01:43:29.402853+0000","last_peered":"2024-04-25T01:43:29.402853+0000","last_clean":"2024-04-25T01:43:29.402853+0000","last_became_active":"2024-04-25T01:39:32.430617+0000","last_became_peered":"2024-04-25T01:39:32.430617+0000","last_unstale":"2024-04-25T01:43:29.402853+0000","last_undegraded":"2024-04-25T01:43:29.402853+0000","last_fullsized":"2024-04-25T01:43:29.402853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:13.938619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"30'163","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.712918+0000","last_change":"2024-04-25T01:39:33.444043+0000","last_active":"2024-04-25T01:43:34.712918+0000","last_peered":"2024-04-25T01:43:34.712918+0000","last_clean":"2024-04-25T01:43:34.712918+0000","last_became_active":"2024-04-25T01:39:33.443737+0000","last_became_peered":"2024-04-25T01:39:33.443737+0000","last_unstale":"2024-04-25T01:43:34.712918+0000","last_undegraded":"2024-04-25T01:43:34.712918+0000","last_fullsized":"2024-04-25T01:43:34.712918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:02:50.401910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"29'4","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.398875+0000","last_change":"2024-04-25T01:39:23.377963+0000","last_active":"2024-04-25T01:43:29.398875+0000","last_peered":"2024-04-25T01:43:29.398875+0000","last_clean":"2024-04-25T01:43:29.398875+0000","last_became_active":"2024-04-25T01:39:23.377402+0000","last_became_peered":"2024-04-25T01:39:23.377402+0000","last_unstale":"2024-04-25T01:43:29.398875+0000","last_undegraded":"2024-04-25T01:43:29.398875+0000","last_fullsized":"2024-04-25T01:43:29.398875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:15.873450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"30'160","reported_seq":193,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.895882+0000","last_change":"2024-04-25T01:39:24.394512+0000","last_active":"2024-04-25T01:43:46.895882+0000","last_peered":"2024-04-25T01:43:46.895882+0000","last_clean":"2024-04-25T01:43:46.895882+0000","last_became_active":"2024-04-25T01:39:24.393954+0000","last_became_peered":"2024-04-25T01:39:24.393954+0000","last_unstale":"2024-04-25T01:43:46.895882+0000","last_undegraded":"2024-04-25T01:43:46.895882+0000","last_fullsized":"2024-04-25T01:43:46.895882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:30.534400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1806","reported_seq":1835,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:35.171137+0000","last_change":"2024-04-25T01:39:32.428198+0000","last_active":"2024-04-25T01:43:35.171137+0000","last_peered":"2024-04-25T01:43:35.171137+0000","last_clean":"2024-04-25T01:43:35.171137+0000","last_became_active":"2024-04-25T01:39:32.427955+0000","last_became_peered":"2024-04-25T01:39:32.427955+0000","last_unstale":"2024-04-25T01:43:35.171137+0000","last_undegraded":"2024-04-25T01:43:35.171137+0000","last_fullsized":"2024-04-25T01:43:35.171137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1806,"log_dups_size":0,"ondisk_log_size":1806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:07.684150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3764872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":3663,"num_write":1802,"num_write_kb":5410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"30'173","reported_seq":198,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.693724+0000","last_change":"2024-04-25T01:39:33.439854+0000","last_active":"2024-04-25T01:43:34.693724+0000","last_peered":"2024-04-25T01:43:34.693724+0000","last_clean":"2024-04-25T01:43:34.693724+0000","last_became_active":"2024-04-25T01:39:33.439555+0000","last_became_peered":"2024-04-25T01:39:33.439555+0000","last_unstale":"2024-04-25T01:43:34.693724+0000","last_undegraded":"2024-04-25T01:43:34.693724+0000","last_fullsized":"2024-04-25T01:43:34.693724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:50.250748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.397933+0000","last_change":"2024-04-25T01:39:23.377093+0000","last_active":"2024-04-25T01:43:29.397933+0000","last_peered":"2024-04-25T01:43:29.397933+0000","last_clean":"2024-04-25T01:43:29.397933+0000","last_became_active":"2024-04-25T01:39:23.376744+0000","last_became_peered":"2024-04-25T01:39:23.376744+0000","last_unstale":"2024-04-25T01:43:29.397933+0000","last_undegraded":"2024-04-25T01:43:29.397933+0000","last_fullsized":"2024-04-25T01:43:29.397933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:43.529618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"30'198","reported_seq":231,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.898863+0000","last_change":"2024-04-25T01:39:24.393293+0000","last_active":"2024-04-25T01:43:46.898863+0000","last_peered":"2024-04-25T01:43:46.898863+0000","last_clean":"2024-04-25T01:43:46.898863+0000","last_became_active":"2024-04-25T01:39:24.393005+0000","last_became_peered":"2024-04-25T01:39:24.393005+0000","last_unstale":"2024-04-25T01:43:46.898863+0000","last_undegraded":"2024-04-25T01:43:46.898863+0000","last_fullsized":"2024-04-25T01:43:46.898863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:32.070747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'4","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403096+0000","last_change":"2024-04-25T01:39:32.428956+0000","last_active":"2024-04-25T01:43:29.403096+0000","last_peered":"2024-04-25T01:43:29.403096+0000","last_clean":"2024-04-25T01:43:29.403096+0000","last_became_active":"2024-04-25T01:39:32.428705+0000","last_became_peered":"2024-04-25T01:39:32.428705+0000","last_unstale":"2024-04-25T01:43:29.403096+0000","last_undegraded":"2024-04-25T01:43:29.403096+0000","last_fullsized":"2024-04-25T01:43:29.403096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:06:22.998986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"30'179","reported_seq":204,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.750752+0000","last_change":"2024-04-25T01:39:33.446571+0000","last_active":"2024-04-25T01:43:34.750752+0000","last_peered":"2024-04-25T01:43:34.750752+0000","last_clean":"2024-04-25T01:43:34.750752+0000","last_became_active":"2024-04-25T01:39:33.446234+0000","last_became_peered":"2024-04-25T01:39:33.446234+0000","last_unstale":"2024-04-25T01:43:34.750752+0000","last_undegraded":"2024-04-25T01:43:34.750752+0000","last_fullsized":"2024-04-25T01:43:34.750752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:12.742092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"30'156","reported_seq":190,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.887578+0000","last_change":"2024-04-25T01:39:24.398859+0000","last_active":"2024-04-25T01:43:46.887578+0000","last_peered":"2024-04-25T01:43:46.887578+0000","last_clean":"2024-04-25T01:43:46.887578+0000","last_became_active":"2024-04-25T01:39:24.398618+0000","last_became_peered":"2024-04-25T01:39:24.398618+0000","last_unstale":"2024-04-25T01:43:46.887578+0000","last_undegraded":"2024-04-25T01:43:46.887578+0000","last_fullsized":"2024-04-25T01:43:46.887578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:15.278376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'5","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.397841+0000","last_change":"2024-04-25T01:39:23.377717+0000","last_active":"2024-04-25T01:43:29.397841+0000","last_peered":"2024-04-25T01:43:29.397841+0000","last_clean":"2024-04-25T01:43:29.397841+0000","last_became_active":"2024-04-25T01:39:23.377291+0000","last_became_peered":"2024-04-25T01:39:23.377291+0000","last_unstale":"2024-04-25T01:43:29.397841+0000","last_undegraded":"2024-04-25T01:43:29.397841+0000","last_fullsized":"2024-04-25T01:43:29.397841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:06.402745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403630+0000","last_change":"2024-04-25T01:39:32.426840+0000","last_active":"2024-04-25T01:43:29.403630+0000","last_peered":"2024-04-25T01:43:29.403630+0000","last_clean":"2024-04-25T01:43:29.403630+0000","last_became_active":"2024-04-25T01:39:32.426529+0000","last_became_peered":"2024-04-25T01:39:32.426529+0000","last_unstale":"2024-04-25T01:43:29.403630+0000","last_undegraded":"2024-04-25T01:43:29.403630+0000","last_fullsized":"2024-04-25T01:43:29.403630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:57.097685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"30'193","reported_seq":218,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.726718+0000","last_change":"2024-04-25T01:39:33.437767+0000","last_active":"2024-04-25T01:43:34.726718+0000","last_peered":"2024-04-25T01:43:34.726718+0000","last_clean":"2024-04-25T01:43:34.726718+0000","last_became_active":"2024-04-25T01:39:33.437483+0000","last_became_peered":"2024-04-25T01:39:33.437483+0000","last_unstale":"2024-04-25T01:43:34.726718+0000","last_undegraded":"2024-04-25T01:43:34.726718+0000","last_fullsized":"2024-04-25T01:43:34.726718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:44.321779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"30'164","reported_seq":197,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.877665+0000","last_change":"2024-04-25T01:39:24.387100+0000","last_active":"2024-04-25T01:43:46.877665+0000","last_peered":"2024-04-25T01:43:46.877665+0000","last_clean":"2024-04-25T01:43:46.877665+0000","last_became_active":"2024-04-25T01:39:24.386782+0000","last_became_peered":"2024-04-25T01:39:24.386782+0000","last_unstale":"2024-04-25T01:43:46.877665+0000","last_undegraded":"2024-04-25T01:43:46.877665+0000","last_fullsized":"2024-04-25T01:43:46.877665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:48.789139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.402653+0000","last_change":"2024-04-25T01:39:23.368446+0000","last_active":"2024-04-25T01:43:29.402653+0000","last_peered":"2024-04-25T01:43:29.402653+0000","last_clean":"2024-04-25T01:43:29.402653+0000","last_became_active":"2024-04-25T01:39:23.368183+0000","last_became_peered":"2024-04-25T01:39:23.368183+0000","last_unstale":"2024-04-25T01:43:29.402653+0000","last_undegraded":"2024-04-25T01:43:29.402653+0000","last_fullsized":"2024-04-25T01:43:29.402653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:13.738756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403500+0000","last_change":"2024-04-25T01:39:32.427589+0000","last_active":"2024-04-25T01:43:29.403500+0000","last_peered":"2024-04-25T01:43:29.403500+0000","last_clean":"2024-04-25T01:43:29.403500+0000","last_became_active":"2024-04-25T01:39:32.427328+0000","last_became_peered":"2024-04-25T01:39:32.427328+0000","last_unstale":"2024-04-25T01:43:29.403500+0000","last_undegraded":"2024-04-25T01:43:29.403500+0000","last_fullsized":"2024-04-25T01:43:29.403500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:12.328303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"30'191","reported_seq":216,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.768647+0000","last_change":"2024-04-25T01:39:33.447634+0000","last_active":"2024-04-25T01:43:34.768647+0000","last_peered":"2024-04-25T01:43:34.768647+0000","last_clean":"2024-04-25T01:43:34.768647+0000","last_became_active":"2024-04-25T01:39:33.445908+0000","last_became_peered":"2024-04-25T01:39:33.445908+0000","last_unstale":"2024-04-25T01:43:34.768647+0000","last_undegraded":"2024-04-25T01:43:34.768647+0000","last_fullsized":"2024-04-25T01:43:34.768647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:13.586396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"30'170","reported_seq":204,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.880762+0000","last_change":"2024-04-25T01:39:24.373600+0000","last_active":"2024-04-25T01:43:46.880762+0000","last_peered":"2024-04-25T01:43:46.880762+0000","last_clean":"2024-04-25T01:43:46.880762+0000","last_became_active":"2024-04-25T01:39:24.373311+0000","last_became_peered":"2024-04-25T01:39:24.373311+0000","last_unstale":"2024-04-25T01:43:46.880762+0000","last_undegraded":"2024-04-25T01:43:46.880762+0000","last_fullsized":"2024-04-25T01:43:46.880762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:46.338959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.402749+0000","last_change":"2024-04-25T01:39:23.377103+0000","last_active":"2024-04-25T01:43:29.402749+0000","last_peered":"2024-04-25T01:43:29.402749+0000","last_clean":"2024-04-25T01:43:29.402749+0000","last_became_active":"2024-04-25T01:39:23.376826+0000","last_became_peered":"2024-04-25T01:39:23.376826+0000","last_unstale":"2024-04-25T01:43:29.402749+0000","last_undegraded":"2024-04-25T01:43:29.402749+0000","last_fullsized":"2024-04-25T01:43:29.402749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:46.663754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.404054+0000","last_change":"2024-04-25T01:39:32.426839+0000","last_active":"2024-04-25T01:43:29.404054+0000","last_peered":"2024-04-25T01:43:29.404054+0000","last_clean":"2024-04-25T01:43:29.404054+0000","last_became_active":"2024-04-25T01:39:32.426545+0000","last_became_peered":"2024-04-25T01:39:32.426545+0000","last_unstale":"2024-04-25T01:43:29.404054+0000","last_undegraded":"2024-04-25T01:43:29.404054+0000","last_fullsized":"2024-04-25T01:43:29.404054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:22.161839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"30'171","reported_seq":196,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.686031+0000","last_change":"2024-04-25T01:39:33.444616+0000","last_active":"2024-04-25T01:43:34.686031+0000","last_peered":"2024-04-25T01:43:34.686031+0000","last_clean":"2024-04-25T01:43:34.686031+0000","last_became_active":"2024-04-25T01:39:33.444350+0000","last_became_peered":"2024-04-25T01:39:33.444350+0000","last_unstale":"2024-04-25T01:43:34.686031+0000","last_undegraded":"2024-04-25T01:43:34.686031+0000","last_fullsized":"2024-04-25T01:43:34.686031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:47:15.686320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"30'147","reported_seq":181,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.868654+0000","last_change":"2024-04-25T01:39:24.386969+0000","last_active":"2024-04-25T01:43:46.868654+0000","last_peered":"2024-04-25T01:43:46.868654+0000","last_clean":"2024-04-25T01:43:46.868654+0000","last_became_active":"2024-04-25T01:39:24.386376+0000","last_became_peered":"2024-04-25T01:39:24.386376+0000","last_unstale":"2024-04-25T01:43:46.868654+0000","last_undegraded":"2024-04-25T01:43:46.868654+0000","last_fullsized":"2024-04-25T01:43:46.868654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:13:31.585462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.397503+0000","last_change":"2024-04-25T01:39:23.378993+0000","last_active":"2024-04-25T01:43:29.397503+0000","last_peered":"2024-04-25T01:43:29.397503+0000","last_clean":"2024-04-25T01:43:29.397503+0000","last_became_active":"2024-04-25T01:39:23.376908+0000","last_became_peered":"2024-04-25T01:39:23.376908+0000","last_unstale":"2024-04-25T01:43:29.397503+0000","last_undegraded":"2024-04-25T01:43:29.397503+0000","last_fullsized":"2024-04-25T01:43:29.397503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:13:18.370559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.424880+0000","last_change":"2024-04-25T01:39:32.433597+0000","last_active":"2024-04-25T01:43:32.424880+0000","last_peered":"2024-04-25T01:43:32.424880+0000","last_clean":"2024-04-25T01:43:32.424880+0000","last_became_active":"2024-04-25T01:39:32.433307+0000","last_became_peered":"2024-04-25T01:39:32.433307+0000","last_unstale":"2024-04-25T01:43:32.424880+0000","last_undegraded":"2024-04-25T01:43:32.424880+0000","last_fullsized":"2024-04-25T01:43:32.424880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:20.784385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"30'175","reported_seq":201,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.754290+0000","last_change":"2024-04-25T01:39:33.427297+0000","last_active":"2024-04-25T01:43:34.754290+0000","last_peered":"2024-04-25T01:43:34.754290+0000","last_clean":"2024-04-25T01:43:34.754290+0000","last_became_active":"2024-04-25T01:39:33.426132+0000","last_became_peered":"2024-04-25T01:39:33.426132+0000","last_unstale":"2024-04-25T01:43:34.754290+0000","last_undegraded":"2024-04-25T01:43:34.754290+0000","last_fullsized":"2024-04-25T01:43:34.754290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:04.147341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"30'175","reported_seq":209,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.879746+0000","last_change":"2024-04-25T01:39:24.393003+0000","last_active":"2024-04-25T01:43:46.879746+0000","last_peered":"2024-04-25T01:43:46.879746+0000","last_clean":"2024-04-25T01:43:46.879746+0000","last_became_active":"2024-04-25T01:39:24.392209+0000","last_became_peered":"2024-04-25T01:39:24.392209+0000","last_unstale":"2024-04-25T01:43:46.879746+0000","last_undegraded":"2024-04-25T01:43:46.879746+0000","last_fullsized":"2024-04-25T01:43:46.879746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:44:58.432859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"30'3","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:35.181348+0000","last_change":"2024-04-25T01:39:23.379804+0000","last_active":"2024-04-25T01:43:35.181348+0000","last_peered":"2024-04-25T01:43:35.181348+0000","last_clean":"2024-04-25T01:43:35.181348+0000","last_became_active":"2024-04-25T01:39:23.379430+0000","last_became_peered":"2024-04-25T01:39:23.379430+0000","last_unstale":"2024-04-25T01:43:35.181348+0000","last_undegraded":"2024-04-25T01:43:35.181348+0000","last_fullsized":"2024-04-25T01:43:35.181348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:42:23.254767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.426420+0000","last_change":"2024-04-25T01:39:32.432763+0000","last_active":"2024-04-25T01:43:32.426420+0000","last_peered":"2024-04-25T01:43:32.426420+0000","last_clean":"2024-04-25T01:43:32.426420+0000","last_became_active":"2024-04-25T01:39:32.432482+0000","last_became_peered":"2024-04-25T01:39:32.432482+0000","last_unstale":"2024-04-25T01:43:32.426420+0000","last_undegraded":"2024-04-25T01:43:32.426420+0000","last_fullsized":"2024-04-25T01:43:32.426420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:04.848726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"30'176","reported_seq":202,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.767725+0000","last_change":"2024-04-25T01:39:33.445800+0000","last_active":"2024-04-25T01:43:34.767725+0000","last_peered":"2024-04-25T01:43:34.767725+0000","last_clean":"2024-04-25T01:43:34.767725+0000","last_became_active":"2024-04-25T01:39:33.445500+0000","last_became_peered":"2024-04-25T01:39:33.445500+0000","last_unstale":"2024-04-25T01:43:34.767725+0000","last_undegraded":"2024-04-25T01:43:34.767725+0000","last_fullsized":"2024-04-25T01:43:34.767725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:06:36.800043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"30'154","reported_seq":173,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.886331+0000","last_change":"2024-04-25T01:40:06.055331+0000","last_active":"2024-04-25T01:43:46.886331+0000","last_peered":"2024-04-25T01:43:46.886331+0000","last_clean":"2024-04-25T01:43:46.886331+0000","last_became_active":"2024-04-25T01:40:06.055084+0000","last_became_peered":"2024-04-25T01:40:06.055084+0000","last_unstale":"2024-04-25T01:43:46.886331+0000","last_undegraded":"2024-04-25T01:43:46.886331+0000","last_fullsized":"2024-04-25T01:43:46.886331+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:15:15.409515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"30'29","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:35.407199+0000","last_change":"2024-04-25T01:39:23.377687+0000","last_active":"2024-04-25T01:43:35.407199+0000","last_peered":"2024-04-25T01:43:35.407199+0000","last_clean":"2024-04-25T01:43:35.407199+0000","last_became_active":"2024-04-25T01:39:23.377372+0000","last_became_peered":"2024-04-25T01:39:23.377372+0000","last_unstale":"2024-04-25T01:43:35.407199+0000","last_undegraded":"2024-04-25T01:43:35.407199+0000","last_fullsized":"2024-04-25T01:43:35.407199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:51.983659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":54,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.407473+0000","last_change":"2024-04-25T01:39:32.430816+0000","last_active":"2024-04-25T01:43:29.407473+0000","last_peered":"2024-04-25T01:43:29.407473+0000","last_clean":"2024-04-25T01:43:29.407473+0000","last_became_active":"2024-04-25T01:39:32.430537+0000","last_became_peered":"2024-04-25T01:39:32.430537+0000","last_unstale":"2024-04-25T01:43:29.407473+0000","last_undegraded":"2024-04-25T01:43:29.407473+0000","last_fullsized":"2024-04-25T01:43:29.407473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:58.939453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"30'198","reported_seq":224,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.725529+0000","last_change":"2024-04-25T01:39:33.440287+0000","last_active":"2024-04-25T01:43:34.725529+0000","last_peered":"2024-04-25T01:43:34.725529+0000","last_clean":"2024-04-25T01:43:34.725529+0000","last_became_active":"2024-04-25T01:39:33.439796+0000","last_became_peered":"2024-04-25T01:39:33.439796+0000","last_unstale":"2024-04-25T01:43:34.725529+0000","last_undegraded":"2024-04-25T01:43:34.725529+0000","last_fullsized":"2024-04-25T01:43:34.725529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:08.515401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"30'173","reported_seq":207,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.867380+0000","last_change":"2024-04-25T01:39:24.376933+0000","last_active":"2024-04-25T01:43:46.867380+0000","last_peered":"2024-04-25T01:43:46.867380+0000","last_clean":"2024-04-25T01:43:46.867380+0000","last_became_active":"2024-04-25T01:39:24.376612+0000","last_became_peered":"2024-04-25T01:39:24.376612+0000","last_unstale":"2024-04-25T01:43:46.867380+0000","last_undegraded":"2024-04-25T01:43:46.867380+0000","last_fullsized":"2024-04-25T01:43:46.867380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:56:55.534200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.399082+0000","last_change":"2024-04-25T01:39:23.378190+0000","last_active":"2024-04-25T01:43:29.399082+0000","last_peered":"2024-04-25T01:43:29.399082+0000","last_clean":"2024-04-25T01:43:29.399082+0000","last_became_active":"2024-04-25T01:39:23.377677+0000","last_became_peered":"2024-04-25T01:39:23.377677+0000","last_unstale":"2024-04-25T01:43:29.399082+0000","last_undegraded":"2024-04-25T01:43:29.399082+0000","last_fullsized":"2024-04-25T01:43:29.399082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:09.516058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403847+0000","last_change":"2024-04-25T01:39:32.431542+0000","last_active":"2024-04-25T01:43:29.403847+0000","last_peered":"2024-04-25T01:43:29.403847+0000","last_clean":"2024-04-25T01:43:29.403847+0000","last_became_active":"2024-04-25T01:39:32.431253+0000","last_became_peered":"2024-04-25T01:39:32.431253+0000","last_unstale":"2024-04-25T01:43:29.403847+0000","last_undegraded":"2024-04-25T01:43:29.403847+0000","last_fullsized":"2024-04-25T01:43:29.403847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:36.723239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"30'188","reported_seq":214,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.770510+0000","last_change":"2024-04-25T01:39:33.448529+0000","last_active":"2024-04-25T01:43:34.770510+0000","last_peered":"2024-04-25T01:43:34.770510+0000","last_clean":"2024-04-25T01:43:34.770510+0000","last_became_active":"2024-04-25T01:39:33.448266+0000","last_became_peered":"2024-04-25T01:39:33.448266+0000","last_unstale":"2024-04-25T01:43:34.770510+0000","last_undegraded":"2024-04-25T01:43:34.770510+0000","last_fullsized":"2024-04-25T01:43:34.770510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:18.788470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"30'155","reported_seq":189,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.897294+0000","last_change":"2024-04-25T01:39:24.390844+0000","last_active":"2024-04-25T01:43:46.897294+0000","last_peered":"2024-04-25T01:43:46.897294+0000","last_clean":"2024-04-25T01:43:46.897294+0000","last_became_active":"2024-04-25T01:39:24.390543+0000","last_became_peered":"2024-04-25T01:39:24.390543+0000","last_unstale":"2024-04-25T01:43:46.897294+0000","last_undegraded":"2024-04-25T01:43:46.897294+0000","last_fullsized":"2024-04-25T01:43:46.897294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:01:03.804058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403980+0000","last_change":"2024-04-25T01:39:23.368562+0000","last_active":"2024-04-25T01:43:29.403980+0000","last_peered":"2024-04-25T01:43:29.403980+0000","last_clean":"2024-04-25T01:43:29.403980+0000","last_became_active":"2024-04-25T01:39:23.368272+0000","last_became_peered":"2024-04-25T01:39:23.368272+0000","last_unstale":"2024-04-25T01:43:29.403980+0000","last_undegraded":"2024-04-25T01:43:29.403980+0000","last_fullsized":"2024-04-25T01:43:29.403980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:15.464993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.402026+0000","last_change":"2024-04-25T01:39:32.430196+0000","last_active":"2024-04-25T01:43:29.402026+0000","last_peered":"2024-04-25T01:43:29.402026+0000","last_clean":"2024-04-25T01:43:29.402026+0000","last_became_active":"2024-04-25T01:39:32.429759+0000","last_became_peered":"2024-04-25T01:39:32.429759+0000","last_unstale":"2024-04-25T01:43:29.402026+0000","last_undegraded":"2024-04-25T01:43:29.402026+0000","last_fullsized":"2024-04-25T01:43:29.402026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:58:09.299194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"30'171","reported_seq":197,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.746690+0000","last_change":"2024-04-25T01:39:33.440935+0000","last_active":"2024-04-25T01:43:34.746690+0000","last_peered":"2024-04-25T01:43:34.746690+0000","last_clean":"2024-04-25T01:43:34.746690+0000","last_became_active":"2024-04-25T01:39:33.439344+0000","last_became_peered":"2024-04-25T01:39:33.439344+0000","last_unstale":"2024-04-25T01:43:34.746690+0000","last_undegraded":"2024-04-25T01:43:34.746690+0000","last_fullsized":"2024-04-25T01:43:34.746690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:23.928991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"30'179","reported_seq":213,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.876122+0000","last_change":"2024-04-25T01:39:24.389203+0000","last_active":"2024-04-25T01:43:46.876122+0000","last_peered":"2024-04-25T01:43:46.876122+0000","last_clean":"2024-04-25T01:43:46.876122+0000","last_became_active":"2024-04-25T01:39:24.388306+0000","last_became_peered":"2024-04-25T01:39:24.388306+0000","last_unstale":"2024-04-25T01:43:46.876122+0000","last_undegraded":"2024-04-25T01:43:46.876122+0000","last_fullsized":"2024-04-25T01:43:46.876122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:59:33.951161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.406645+0000","last_change":"2024-04-25T01:39:23.375729+0000","last_active":"2024-04-25T01:43:29.406645+0000","last_peered":"2024-04-25T01:43:29.406645+0000","last_clean":"2024-04-25T01:43:29.406645+0000","last_became_active":"2024-04-25T01:39:23.375488+0000","last_became_peered":"2024-04-25T01:39:23.375488+0000","last_unstale":"2024-04-25T01:43:29.406645+0000","last_undegraded":"2024-04-25T01:43:29.406645+0000","last_fullsized":"2024-04-25T01:43:29.406645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:00.039083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403502+0000","last_change":"2024-04-25T01:39:32.427586+0000","last_active":"2024-04-25T01:43:29.403502+0000","last_peered":"2024-04-25T01:43:29.403502+0000","last_clean":"2024-04-25T01:43:29.403502+0000","last_became_active":"2024-04-25T01:39:32.427282+0000","last_became_peered":"2024-04-25T01:39:32.427282+0000","last_unstale":"2024-04-25T01:43:29.403502+0000","last_undegraded":"2024-04-25T01:43:29.403502+0000","last_fullsized":"2024-04-25T01:43:29.403502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:35.956279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'200","reported_seq":225,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.753861+0000","last_change":"2024-04-25T01:39:33.438949+0000","last_active":"2024-04-25T01:43:34.753861+0000","last_peered":"2024-04-25T01:43:34.753861+0000","last_clean":"2024-04-25T01:43:34.753861+0000","last_became_active":"2024-04-25T01:39:33.438669+0000","last_became_peered":"2024-04-25T01:39:33.438669+0000","last_unstale":"2024-04-25T01:43:34.753861+0000","last_undegraded":"2024-04-25T01:43:34.753861+0000","last_fullsized":"2024-04-25T01:43:34.753861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:07.849060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"30'162","reported_seq":196,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.873816+0000","last_change":"2024-04-25T01:39:24.377438+0000","last_active":"2024-04-25T01:43:46.873816+0000","last_peered":"2024-04-25T01:43:46.873816+0000","last_clean":"2024-04-25T01:43:46.873816+0000","last_became_active":"2024-04-25T01:39:24.377146+0000","last_became_peered":"2024-04-25T01:39:24.377146+0000","last_unstale":"2024-04-25T01:43:46.873816+0000","last_undegraded":"2024-04-25T01:43:46.873816+0000","last_fullsized":"2024-04-25T01:43:46.873816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:54:17.698561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":327680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"30'5","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:31.449181+0000","last_change":"2024-04-25T01:39:23.371019+0000","last_active":"2024-04-25T01:43:31.449181+0000","last_peered":"2024-04-25T01:43:31.449181+0000","last_clean":"2024-04-25T01:43:31.449181+0000","last_became_active":"2024-04-25T01:39:23.370727+0000","last_became_peered":"2024-04-25T01:39:23.370727+0000","last_unstale":"2024-04-25T01:43:31.449181+0000","last_undegraded":"2024-04-25T01:43:31.449181+0000","last_fullsized":"2024-04-25T01:43:31.449181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:10.714475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'3","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.435640+0000","last_change":"2024-04-25T01:39:32.431610+0000","last_active":"2024-04-25T01:43:32.435640+0000","last_peered":"2024-04-25T01:43:32.435640+0000","last_clean":"2024-04-25T01:43:32.435640+0000","last_became_active":"2024-04-25T01:39:32.431335+0000","last_became_peered":"2024-04-25T01:39:32.431335+0000","last_unstale":"2024-04-25T01:43:32.435640+0000","last_undegraded":"2024-04-25T01:43:32.435640+0000","last_fullsized":"2024-04-25T01:43:32.435640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:54.882078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"30'173","reported_seq":198,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.747273+0000","last_change":"2024-04-25T01:39:33.438896+0000","last_active":"2024-04-25T01:43:34.747273+0000","last_peered":"2024-04-25T01:43:34.747273+0000","last_clean":"2024-04-25T01:43:34.747273+0000","last_became_active":"2024-04-25T01:39:33.438622+0000","last_became_peered":"2024-04-25T01:39:33.438622+0000","last_unstale":"2024-04-25T01:43:34.747273+0000","last_undegraded":"2024-04-25T01:43:34.747273+0000","last_fullsized":"2024-04-25T01:43:34.747273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:40:47.408809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"30'157","reported_seq":191,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.873335+0000","last_change":"2024-04-25T01:39:24.391366+0000","last_active":"2024-04-25T01:43:46.873335+0000","last_peered":"2024-04-25T01:43:46.873335+0000","last_clean":"2024-04-25T01:43:46.873335+0000","last_became_active":"2024-04-25T01:39:24.391093+0000","last_became_peered":"2024-04-25T01:39:24.391093+0000","last_unstale":"2024-04-25T01:43:46.873335+0000","last_undegraded":"2024-04-25T01:43:46.873335+0000","last_fullsized":"2024-04-25T01:43:46.873335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:10.906935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":311296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.397493+0000","last_change":"2024-04-25T01:39:23.379767+0000","last_active":"2024-04-25T01:43:29.397493+0000","last_peered":"2024-04-25T01:43:29.397493+0000","last_clean":"2024-04-25T01:43:29.397493+0000","last_became_active":"2024-04-25T01:39:23.379294+0000","last_became_peered":"2024-04-25T01:39:23.379294+0000","last_unstale":"2024-04-25T01:43:29.397493+0000","last_undegraded":"2024-04-25T01:43:29.397493+0000","last_fullsized":"2024-04-25T01:43:29.397493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:36:37.823796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"30'25","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:35.399094+0000","last_change":"2024-04-25T01:39:32.429452+0000","last_active":"2024-04-25T01:43:35.399094+0000","last_peered":"2024-04-25T01:43:35.399094+0000","last_clean":"2024-04-25T01:43:35.399094+0000","last_became_active":"2024-04-25T01:39:32.429189+0000","last_became_peered":"2024-04-25T01:39:32.429189+0000","last_unstale":"2024-04-25T01:43:35.399094+0000","last_undegraded":"2024-04-25T01:43:35.399094+0000","last_fullsized":"2024-04-25T01:43:35.399094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:58:02.723851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"30'171","reported_seq":197,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.770009+0000","last_change":"2024-04-25T01:39:33.438945+0000","last_active":"2024-04-25T01:43:34.770009+0000","last_peered":"2024-04-25T01:43:34.770009+0000","last_clean":"2024-04-25T01:43:34.770009+0000","last_became_active":"2024-04-25T01:39:33.438233+0000","last_became_peered":"2024-04-25T01:39:33.438233+0000","last_unstale":"2024-04-25T01:43:34.770009+0000","last_undegraded":"2024-04-25T01:43:34.770009+0000","last_fullsized":"2024-04-25T01:43:34.770009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:50.545311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"30'209","reported_seq":243,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.896362+0000","last_change":"2024-04-25T01:39:24.401208+0000","last_active":"2024-04-25T01:43:46.896362+0000","last_peered":"2024-04-25T01:43:46.896362+0000","last_clean":"2024-04-25T01:43:46.896362+0000","last_became_active":"2024-04-25T01:39:24.400502+0000","last_became_peered":"2024-04-25T01:39:24.400502+0000","last_unstale":"2024-04-25T01:43:46.896362+0000","last_undegraded":"2024-04-25T01:43:46.896362+0000","last_fullsized":"2024-04-25T01:43:46.896362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:55:09.076617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403950+0000","last_change":"2024-04-25T01:39:23.367826+0000","last_active":"2024-04-25T01:43:29.403950+0000","last_peered":"2024-04-25T01:43:29.403950+0000","last_clean":"2024-04-25T01:43:29.403950+0000","last_became_active":"2024-04-25T01:39:23.367520+0000","last_became_peered":"2024-04-25T01:39:23.367520+0000","last_unstale":"2024-04-25T01:43:29.403950+0000","last_undegraded":"2024-04-25T01:43:29.403950+0000","last_fullsized":"2024-04-25T01:43:29.403950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:05.997166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":192,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.397641+0000","last_change":"2024-04-25T01:39:12.918495+0000","last_active":"2024-04-25T01:43:29.397641+0000","last_peered":"2024-04-25T01:43:29.397641+0000","last_clean":"2024-04-25T01:43:29.397641+0000","last_became_active":"2024-04-25T01:39:12.917330+0000","last_became_peered":"2024-04-25T01:39:12.917330+0000","last_unstale":"2024-04-25T01:43:29.397641+0000","last_undegraded":"2024-04-25T01:43:29.397641+0000","last_fullsized":"2024-04-25T01:43:29.397641+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:11.731178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:11.731178+0000","last_clean_scrub_stamp":"2024-04-25T01:39:11.731178+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:26:14.153244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.412547+0000","last_change":"2024-04-25T01:39:32.431797+0000","last_active":"2024-04-25T01:43:29.412547+0000","last_peered":"2024-04-25T01:43:29.412547+0000","last_clean":"2024-04-25T01:43:29.412547+0000","last_became_active":"2024-04-25T01:39:32.431523+0000","last_became_peered":"2024-04-25T01:39:32.431523+0000","last_unstale":"2024-04-25T01:43:29.412547+0000","last_undegraded":"2024-04-25T01:43:29.412547+0000","last_fullsized":"2024-04-25T01:43:29.412547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:45.752128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"30'174","reported_seq":199,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.741855+0000","last_change":"2024-04-25T01:39:33.440488+0000","last_active":"2024-04-25T01:43:34.741855+0000","last_peered":"2024-04-25T01:43:34.741855+0000","last_clean":"2024-04-25T01:43:34.741855+0000","last_became_active":"2024-04-25T01:39:33.440161+0000","last_became_peered":"2024-04-25T01:39:33.440161+0000","last_unstale":"2024-04-25T01:43:34.741855+0000","last_undegraded":"2024-04-25T01:43:34.741855+0000","last_fullsized":"2024-04-25T01:43:34.741855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:45.542876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"30'168","reported_seq":201,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.899419+0000","last_change":"2024-04-25T01:39:24.394350+0000","last_active":"2024-04-25T01:43:46.899419+0000","last_peered":"2024-04-25T01:43:46.899419+0000","last_clean":"2024-04-25T01:43:46.899419+0000","last_became_active":"2024-04-25T01:39:24.393235+0000","last_became_peered":"2024-04-25T01:39:24.393235+0000","last_unstale":"2024-04-25T01:43:46.899419+0000","last_undegraded":"2024-04-25T01:43:46.899419+0000","last_fullsized":"2024-04-25T01:43:46.899419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:00:48.588700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.397643+0000","last_change":"2024-04-25T01:39:23.368352+0000","last_active":"2024-04-25T01:43:29.397643+0000","last_peered":"2024-04-25T01:43:29.397643+0000","last_clean":"2024-04-25T01:43:29.397643+0000","last_became_active":"2024-04-25T01:39:23.368075+0000","last_became_peered":"2024-04-25T01:39:23.368075+0000","last_unstale":"2024-04-25T01:43:29.397643+0000","last_undegraded":"2024-04-25T01:43:29.397643+0000","last_fullsized":"2024-04-25T01:43:29.397643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:11.300091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.412211+0000","last_change":"2024-04-25T01:39:32.430007+0000","last_active":"2024-04-25T01:43:29.412211+0000","last_peered":"2024-04-25T01:43:29.412211+0000","last_clean":"2024-04-25T01:43:29.412211+0000","last_became_active":"2024-04-25T01:39:32.429721+0000","last_became_peered":"2024-04-25T01:39:32.429721+0000","last_unstale":"2024-04-25T01:43:29.412211+0000","last_undegraded":"2024-04-25T01:43:29.412211+0000","last_fullsized":"2024-04-25T01:43:29.412211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:47.409375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"30'171","reported_seq":196,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.755135+0000","last_change":"2024-04-25T01:39:33.447230+0000","last_active":"2024-04-25T01:43:34.755135+0000","last_peered":"2024-04-25T01:43:34.755135+0000","last_clean":"2024-04-25T01:43:34.755135+0000","last_became_active":"2024-04-25T01:39:33.446930+0000","last_became_peered":"2024-04-25T01:39:33.446930+0000","last_unstale":"2024-04-25T01:43:34.755135+0000","last_undegraded":"2024-04-25T01:43:34.755135+0000","last_fullsized":"2024-04-25T01:43:34.755135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:51:40.920560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'173","reported_seq":206,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.895588+0000","last_change":"2024-04-25T01:39:24.394286+0000","last_active":"2024-04-25T01:43:46.895588+0000","last_peered":"2024-04-25T01:43:46.895588+0000","last_clean":"2024-04-25T01:43:46.895588+0000","last_became_active":"2024-04-25T01:39:24.393558+0000","last_became_peered":"2024-04-25T01:39:24.393558+0000","last_unstale":"2024-04-25T01:43:46.895588+0000","last_undegraded":"2024-04-25T01:43:46.895588+0000","last_fullsized":"2024-04-25T01:43:46.895588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:59.100947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.404678+0000","last_change":"2024-04-25T01:39:23.370690+0000","last_active":"2024-04-25T01:43:29.404678+0000","last_peered":"2024-04-25T01:43:29.404678+0000","last_clean":"2024-04-25T01:43:29.404678+0000","last_became_active":"2024-04-25T01:39:23.370391+0000","last_became_peered":"2024-04-25T01:39:23.370391+0000","last_unstale":"2024-04-25T01:43:29.404678+0000","last_undegraded":"2024-04-25T01:43:29.404678+0000","last_fullsized":"2024-04-25T01:43:29.404678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:29.647636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"30'6","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.404958+0000","last_change":"2024-04-25T01:39:32.429412+0000","last_active":"2024-04-25T01:43:29.404958+0000","last_peered":"2024-04-25T01:43:29.404958+0000","last_clean":"2024-04-25T01:43:29.404958+0000","last_became_active":"2024-04-25T01:39:32.429143+0000","last_became_peered":"2024-04-25T01:39:32.429143+0000","last_unstale":"2024-04-25T01:43:29.404958+0000","last_undegraded":"2024-04-25T01:43:29.404958+0000","last_fullsized":"2024-04-25T01:43:29.404958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:53.637245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"30'173","reported_seq":198,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.766305+0000","last_change":"2024-04-25T01:39:33.437128+0000","last_active":"2024-04-25T01:43:34.766305+0000","last_peered":"2024-04-25T01:43:34.766305+0000","last_clean":"2024-04-25T01:43:34.766305+0000","last_became_active":"2024-04-25T01:39:33.436861+0000","last_became_peered":"2024-04-25T01:39:33.436861+0000","last_unstale":"2024-04-25T01:43:34.766305+0000","last_undegraded":"2024-04-25T01:43:34.766305+0000","last_fullsized":"2024-04-25T01:43:34.766305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:41.746373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"30'168","reported_seq":201,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.889452+0000","last_change":"2024-04-25T01:39:24.392170+0000","last_active":"2024-04-25T01:43:46.889452+0000","last_peered":"2024-04-25T01:43:46.889452+0000","last_clean":"2024-04-25T01:43:46.889452+0000","last_became_active":"2024-04-25T01:39:24.391811+0000","last_became_peered":"2024-04-25T01:39:24.391811+0000","last_unstale":"2024-04-25T01:43:46.889452+0000","last_undegraded":"2024-04-25T01:43:46.889452+0000","last_fullsized":"2024-04-25T01:43:46.889452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:32.859676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.398084+0000","last_change":"2024-04-25T01:39:23.369872+0000","last_active":"2024-04-25T01:43:29.398084+0000","last_peered":"2024-04-25T01:43:29.398084+0000","last_clean":"2024-04-25T01:43:29.398084+0000","last_became_active":"2024-04-25T01:39:23.369314+0000","last_became_peered":"2024-04-25T01:39:23.369314+0000","last_unstale":"2024-04-25T01:43:29.398084+0000","last_undegraded":"2024-04-25T01:43:29.398084+0000","last_fullsized":"2024-04-25T01:43:29.398084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:14.571148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.402389+0000","last_change":"2024-04-25T01:39:32.429664+0000","last_active":"2024-04-25T01:43:29.402389+0000","last_peered":"2024-04-25T01:43:29.402389+0000","last_clean":"2024-04-25T01:43:29.402389+0000","last_became_active":"2024-04-25T01:39:32.429358+0000","last_became_peered":"2024-04-25T01:39:32.429358+0000","last_unstale":"2024-04-25T01:43:29.402389+0000","last_undegraded":"2024-04-25T01:43:29.402389+0000","last_fullsized":"2024-04-25T01:43:29.402389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:57:10.913056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"30'178","reported_seq":203,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.682457+0000","last_change":"2024-04-25T01:39:33.440419+0000","last_active":"2024-04-25T01:43:34.682457+0000","last_peered":"2024-04-25T01:43:34.682457+0000","last_clean":"2024-04-25T01:43:34.682457+0000","last_became_active":"2024-04-25T01:39:33.440054+0000","last_became_peered":"2024-04-25T01:39:33.440054+0000","last_unstale":"2024-04-25T01:43:34.682457+0000","last_undegraded":"2024-04-25T01:43:34.682457+0000","last_fullsized":"2024-04-25T01:43:34.682457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:42.321235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"30'179","reported_seq":198,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.877749+0000","last_change":"2024-04-25T01:40:05.826359+0000","last_active":"2024-04-25T01:43:46.877749+0000","last_peered":"2024-04-25T01:43:46.877749+0000","last_clean":"2024-04-25T01:43:46.877749+0000","last_became_active":"2024-04-25T01:40:05.826076+0000","last_became_peered":"2024-04-25T01:40:05.826076+0000","last_unstale":"2024-04-25T01:43:46.877749+0000","last_undegraded":"2024-04-25T01:43:46.877749+0000","last_fullsized":"2024-04-25T01:43:46.877749+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:42:53.707094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.404466+0000","last_change":"2024-04-25T01:39:23.367322+0000","last_active":"2024-04-25T01:43:29.404466+0000","last_peered":"2024-04-25T01:43:29.404466+0000","last_clean":"2024-04-25T01:43:29.404466+0000","last_became_active":"2024-04-25T01:39:23.367054+0000","last_became_peered":"2024-04-25T01:39:23.367054+0000","last_unstale":"2024-04-25T01:43:29.404466+0000","last_undegraded":"2024-04-25T01:43:29.404466+0000","last_fullsized":"2024-04-25T01:43:29.404466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:10.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.402979+0000","last_change":"2024-04-25T01:39:32.426874+0000","last_active":"2024-04-25T01:43:29.402979+0000","last_peered":"2024-04-25T01:43:29.402979+0000","last_clean":"2024-04-25T01:43:29.402979+0000","last_became_active":"2024-04-25T01:39:32.426599+0000","last_became_peered":"2024-04-25T01:39:32.426599+0000","last_unstale":"2024-04-25T01:43:29.402979+0000","last_undegraded":"2024-04-25T01:43:29.402979+0000","last_fullsized":"2024-04-25T01:43:29.402979+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:27.672277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"30'164","reported_seq":189,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.722453+0000","last_change":"2024-04-25T01:39:33.428909+0000","last_active":"2024-04-25T01:43:34.722453+0000","last_peered":"2024-04-25T01:43:34.722453+0000","last_clean":"2024-04-25T01:43:34.722453+0000","last_became_active":"2024-04-25T01:39:33.428626+0000","last_became_peered":"2024-04-25T01:39:33.428626+0000","last_unstale":"2024-04-25T01:43:34.722453+0000","last_undegraded":"2024-04-25T01:43:34.722453+0000","last_fullsized":"2024-04-25T01:43:34.722453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:21.188264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'204","reported_seq":237,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.879392+0000","last_change":"2024-04-25T01:39:24.389946+0000","last_active":"2024-04-25T01:43:46.879392+0000","last_peered":"2024-04-25T01:43:46.879392+0000","last_clean":"2024-04-25T01:43:46.879392+0000","last_became_active":"2024-04-25T01:39:24.389656+0000","last_became_peered":"2024-04-25T01:39:24.389656+0000","last_unstale":"2024-04-25T01:43:46.879392+0000","last_undegraded":"2024-04-25T01:43:46.879392+0000","last_fullsized":"2024-04-25T01:43:46.879392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:55.943639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"30'9","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.397557+0000","last_change":"2024-04-25T01:39:23.373599+0000","last_active":"2024-04-25T01:43:29.397557+0000","last_peered":"2024-04-25T01:43:29.397557+0000","last_clean":"2024-04-25T01:43:29.397557+0000","last_became_active":"2024-04-25T01:39:23.373281+0000","last_became_peered":"2024-04-25T01:39:23.373281+0000","last_unstale":"2024-04-25T01:43:29.397557+0000","last_undegraded":"2024-04-25T01:43:29.397557+0000","last_fullsized":"2024-04-25T01:43:29.397557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:40.850925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403096+0000","last_change":"2024-04-25T01:39:32.427502+0000","last_active":"2024-04-25T01:43:29.403096+0000","last_peered":"2024-04-25T01:43:29.403096+0000","last_clean":"2024-04-25T01:43:29.403096+0000","last_became_active":"2024-04-25T01:39:32.426499+0000","last_became_peered":"2024-04-25T01:39:32.426499+0000","last_unstale":"2024-04-25T01:43:29.403096+0000","last_undegraded":"2024-04-25T01:43:29.403096+0000","last_fullsized":"2024-04-25T01:43:29.403096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:26.977416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"30'274","reported_seq":299,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.747979+0000","last_change":"2024-04-25T01:39:33.436901+0000","last_active":"2024-04-25T01:43:34.747979+0000","last_peered":"2024-04-25T01:43:34.747979+0000","last_clean":"2024-04-25T01:43:34.747979+0000","last_became_active":"2024-04-25T01:39:33.436001+0000","last_became_peered":"2024-04-25T01:39:33.436001+0000","last_unstale":"2024-04-25T01:43:34.747979+0000","last_undegraded":"2024-04-25T01:43:34.747979+0000","last_fullsized":"2024-04-25T01:43:34.747979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:34:41.678663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"30'176","reported_seq":209,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.874522+0000","last_change":"2024-04-25T01:39:24.394248+0000","last_active":"2024-04-25T01:43:46.874522+0000","last_peered":"2024-04-25T01:43:46.874522+0000","last_clean":"2024-04-25T01:43:46.874522+0000","last_became_active":"2024-04-25T01:39:24.393958+0000","last_became_peered":"2024-04-25T01:39:24.393958+0000","last_unstale":"2024-04-25T01:43:46.874522+0000","last_undegraded":"2024-04-25T01:43:46.874522+0000","last_fullsized":"2024-04-25T01:43:46.874522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:35.087577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.412806+0000","last_change":"2024-04-25T01:39:23.372939+0000","last_active":"2024-04-25T01:43:29.412806+0000","last_peered":"2024-04-25T01:43:29.412806+0000","last_clean":"2024-04-25T01:43:29.412806+0000","last_became_active":"2024-04-25T01:39:23.372648+0000","last_became_peered":"2024-04-25T01:39:23.372648+0000","last_unstale":"2024-04-25T01:43:29.412806+0000","last_undegraded":"2024-04-25T01:43:29.412806+0000","last_fullsized":"2024-04-25T01:43:29.412806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:02:13.283096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'1","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.408083+0000","last_change":"2024-04-25T01:39:32.432218+0000","last_active":"2024-04-25T01:43:29.408083+0000","last_peered":"2024-04-25T01:43:29.408083+0000","last_clean":"2024-04-25T01:43:29.408083+0000","last_became_active":"2024-04-25T01:39:32.431938+0000","last_became_peered":"2024-04-25T01:39:32.431938+0000","last_unstale":"2024-04-25T01:43:29.408083+0000","last_undegraded":"2024-04-25T01:43:29.408083+0000","last_fullsized":"2024-04-25T01:43:29.408083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:56:15.053817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"30'185","reported_seq":210,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.742694+0000","last_change":"2024-04-25T01:39:33.441342+0000","last_active":"2024-04-25T01:43:34.742694+0000","last_peered":"2024-04-25T01:43:34.742694+0000","last_clean":"2024-04-25T01:43:34.742694+0000","last_became_active":"2024-04-25T01:39:33.441074+0000","last_became_peered":"2024-04-25T01:39:33.441074+0000","last_unstale":"2024-04-25T01:43:34.742694+0000","last_undegraded":"2024-04-25T01:43:34.742694+0000","last_fullsized":"2024-04-25T01:43:34.742694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:22:43.000112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'214","reported_seq":247,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.879311+0000","last_change":"2024-04-25T01:39:24.390114+0000","last_active":"2024-04-25T01:43:46.879311+0000","last_peered":"2024-04-25T01:43:46.879311+0000","last_clean":"2024-04-25T01:43:46.879311+0000","last_became_active":"2024-04-25T01:39:24.389841+0000","last_became_peered":"2024-04-25T01:39:24.389841+0000","last_unstale":"2024-04-25T01:43:46.879311+0000","last_undegraded":"2024-04-25T01:43:46.879311+0000","last_fullsized":"2024-04-25T01:43:46.879311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:34.950624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.406513+0000","last_change":"2024-04-25T01:39:23.369440+0000","last_active":"2024-04-25T01:43:29.406513+0000","last_peered":"2024-04-25T01:43:29.406513+0000","last_clean":"2024-04-25T01:43:29.406513+0000","last_became_active":"2024-04-25T01:39:23.369151+0000","last_became_peered":"2024-04-25T01:39:23.369151+0000","last_unstale":"2024-04-25T01:43:29.406513+0000","last_undegraded":"2024-04-25T01:43:29.406513+0000","last_fullsized":"2024-04-25T01:43:29.406513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:31:46.921287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'2024","reported_seq":2068,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.423122+0000","last_change":"2024-04-25T01:39:32.430701+0000","last_active":"2024-04-25T01:43:32.423122+0000","last_peered":"2024-04-25T01:43:32.423122+0000","last_clean":"2024-04-25T01:43:32.423122+0000","last_became_active":"2024-04-25T01:39:32.430187+0000","last_became_peered":"2024-04-25T01:39:32.430187+0000","last_unstale":"2024-04-25T01:43:32.423122+0000","last_undegraded":"2024-04-25T01:43:32.423122+0000","last_fullsized":"2024-04-25T01:43:32.423122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2024,"log_dups_size":0,"ondisk_log_size":2024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:57.148375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":4133,"num_write":2021,"num_write_kb":6037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"30'182","reported_seq":207,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.699488+0000","last_change":"2024-04-25T01:39:33.427429+0000","last_active":"2024-04-25T01:43:34.699488+0000","last_peered":"2024-04-25T01:43:34.699488+0000","last_clean":"2024-04-25T01:43:34.699488+0000","last_became_active":"2024-04-25T01:39:33.427164+0000","last_became_peered":"2024-04-25T01:39:33.427164+0000","last_unstale":"2024-04-25T01:43:34.699488+0000","last_undegraded":"2024-04-25T01:43:34.699488+0000","last_fullsized":"2024-04-25T01:43:34.699488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:33:59.664252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"30'179","reported_seq":212,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.881499+0000","last_change":"2024-04-25T01:39:24.388852+0000","last_active":"2024-04-25T01:43:46.881499+0000","last_peered":"2024-04-25T01:43:46.881499+0000","last_clean":"2024-04-25T01:43:46.881499+0000","last_became_active":"2024-04-25T01:39:24.388594+0000","last_became_peered":"2024-04-25T01:39:24.388594+0000","last_unstale":"2024-04-25T01:43:46.881499+0000","last_undegraded":"2024-04-25T01:43:46.881499+0000","last_fullsized":"2024-04-25T01:43:46.881499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:46:49.718182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.404791+0000","last_change":"2024-04-25T01:39:23.372903+0000","last_active":"2024-04-25T01:43:29.404791+0000","last_peered":"2024-04-25T01:43:29.404791+0000","last_clean":"2024-04-25T01:43:29.404791+0000","last_became_active":"2024-04-25T01:39:23.372617+0000","last_became_peered":"2024-04-25T01:39:23.372617+0000","last_unstale":"2024-04-25T01:43:29.404791+0000","last_undegraded":"2024-04-25T01:43:29.404791+0000","last_fullsized":"2024-04-25T01:43:29.404791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:54:58.506432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"30'8","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:35.564703+0000","last_change":"2024-04-25T01:39:32.430218+0000","last_active":"2024-04-25T01:43:35.564703+0000","last_peered":"2024-04-25T01:43:35.564703+0000","last_clean":"2024-04-25T01:43:35.564703+0000","last_became_active":"2024-04-25T01:39:32.429900+0000","last_became_peered":"2024-04-25T01:39:32.429900+0000","last_unstale":"2024-04-25T01:43:35.564703+0000","last_undegraded":"2024-04-25T01:43:35.564703+0000","last_fullsized":"2024-04-25T01:43:35.564703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:52.253045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"30'217","reported_seq":242,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.745610+0000","last_change":"2024-04-25T01:39:33.440325+0000","last_active":"2024-04-25T01:43:34.745610+0000","last_peered":"2024-04-25T01:43:34.745610+0000","last_clean":"2024-04-25T01:43:34.745610+0000","last_became_active":"2024-04-25T01:39:33.439961+0000","last_became_peered":"2024-04-25T01:39:33.439961+0000","last_unstale":"2024-04-25T01:43:34.745610+0000","last_undegraded":"2024-04-25T01:43:34.745610+0000","last_fullsized":"2024-04-25T01:43:34.745610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:01.846576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'159","reported_seq":192,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.885824+0000","last_change":"2024-04-25T01:39:24.380617+0000","last_active":"2024-04-25T01:43:46.885824+0000","last_peered":"2024-04-25T01:43:46.885824+0000","last_clean":"2024-04-25T01:43:46.885824+0000","last_became_active":"2024-04-25T01:39:24.380330+0000","last_became_peered":"2024-04-25T01:39:24.380330+0000","last_unstale":"2024-04-25T01:43:46.885824+0000","last_undegraded":"2024-04-25T01:43:46.885824+0000","last_fullsized":"2024-04-25T01:43:46.885824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:24.010569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"30'2022","reported_seq":2070,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.412675+0000","last_change":"2024-04-25T01:39:23.373295+0000","last_active":"2024-04-25T01:43:29.412675+0000","last_peered":"2024-04-25T01:43:29.412675+0000","last_clean":"2024-04-25T01:43:29.412675+0000","last_became_active":"2024-04-25T01:39:23.372984+0000","last_became_peered":"2024-04-25T01:39:23.372984+0000","last_unstale":"2024-04-25T01:43:29.412675+0000","last_undegraded":"2024-04-25T01:43:29.412675+0000","last_fullsized":"2024-04-25T01:43:29.412675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2022,"log_dups_size":0,"ondisk_log_size":2022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:10.854190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":65,"num_write":2019,"num_write_kb":6035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.401920+0000","last_change":"2024-04-25T01:39:32.433589+0000","last_active":"2024-04-25T01:43:29.401920+0000","last_peered":"2024-04-25T01:43:29.401920+0000","last_clean":"2024-04-25T01:43:29.401920+0000","last_became_active":"2024-04-25T01:39:32.433408+0000","last_became_peered":"2024-04-25T01:39:32.433408+0000","last_unstale":"2024-04-25T01:43:29.401920+0000","last_undegraded":"2024-04-25T01:43:29.401920+0000","last_fullsized":"2024-04-25T01:43:29.401920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:25.789951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"30'189","reported_seq":214,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.688751+0000","last_change":"2024-04-25T01:39:33.433449+0000","last_active":"2024-04-25T01:43:34.688751+0000","last_peered":"2024-04-25T01:43:34.688751+0000","last_clean":"2024-04-25T01:43:34.688751+0000","last_became_active":"2024-04-25T01:39:33.432690+0000","last_became_peered":"2024-04-25T01:39:33.432690+0000","last_unstale":"2024-04-25T01:43:34.688751+0000","last_undegraded":"2024-04-25T01:43:34.688751+0000","last_fullsized":"2024-04-25T01:43:34.688751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:30.046453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"30'179","reported_seq":212,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.886230+0000","last_change":"2024-04-25T01:39:24.391245+0000","last_active":"2024-04-25T01:43:46.886230+0000","last_peered":"2024-04-25T01:43:46.886230+0000","last_clean":"2024-04-25T01:43:46.886230+0000","last_became_active":"2024-04-25T01:39:24.390941+0000","last_became_peered":"2024-04-25T01:39:24.390941+0000","last_unstale":"2024-04-25T01:43:46.886230+0000","last_undegraded":"2024-04-25T01:43:46.886230+0000","last_fullsized":"2024-04-25T01:43:46.886230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:55.182405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"30'8","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:35.181358+0000","last_change":"2024-04-25T01:39:23.369043+0000","last_active":"2024-04-25T01:43:35.181358+0000","last_peered":"2024-04-25T01:43:35.181358+0000","last_clean":"2024-04-25T01:43:35.181358+0000","last_became_active":"2024-04-25T01:39:23.368778+0000","last_became_peered":"2024-04-25T01:39:23.368778+0000","last_unstale":"2024-04-25T01:43:35.181358+0000","last_undegraded":"2024-04-25T01:43:35.181358+0000","last_fullsized":"2024-04-25T01:43:35.181358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:59.501724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.404425+0000","last_change":"2024-04-25T01:39:32.431530+0000","last_active":"2024-04-25T01:43:29.404425+0000","last_peered":"2024-04-25T01:43:29.404425+0000","last_clean":"2024-04-25T01:43:29.404425+0000","last_became_active":"2024-04-25T01:39:32.431247+0000","last_became_peered":"2024-04-25T01:39:32.431247+0000","last_unstale":"2024-04-25T01:43:29.404425+0000","last_undegraded":"2024-04-25T01:43:29.404425+0000","last_fullsized":"2024-04-25T01:43:29.404425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:46:02.014508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":24,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"30'233","reported_seq":258,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.697325+0000","last_change":"2024-04-25T01:39:33.446545+0000","last_active":"2024-04-25T01:43:34.697325+0000","last_peered":"2024-04-25T01:43:34.697325+0000","last_clean":"2024-04-25T01:43:34.697325+0000","last_became_active":"2024-04-25T01:39:33.446263+0000","last_became_peered":"2024-04-25T01:39:33.446263+0000","last_unstale":"2024-04-25T01:43:34.697325+0000","last_undegraded":"2024-04-25T01:43:34.697325+0000","last_fullsized":"2024-04-25T01:43:34.697325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:27.026460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"30'153","reported_seq":186,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.894871+0000","last_change":"2024-04-25T01:39:24.403875+0000","last_active":"2024-04-25T01:43:46.894871+0000","last_peered":"2024-04-25T01:43:46.894871+0000","last_clean":"2024-04-25T01:43:46.894871+0000","last_became_active":"2024-04-25T01:39:24.403591+0000","last_became_peered":"2024-04-25T01:39:24.403591+0000","last_unstale":"2024-04-25T01:43:46.894871+0000","last_undegraded":"2024-04-25T01:43:46.894871+0000","last_fullsized":"2024-04-25T01:43:46.894871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:45.276173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.406434+0000","last_change":"2024-04-25T01:39:23.378968+0000","last_active":"2024-04-25T01:43:29.406434+0000","last_peered":"2024-04-25T01:43:29.406434+0000","last_clean":"2024-04-25T01:43:29.406434+0000","last_became_active":"2024-04-25T01:39:23.378635+0000","last_became_peered":"2024-04-25T01:39:23.378635+0000","last_unstale":"2024-04-25T01:43:29.406434+0000","last_undegraded":"2024-04-25T01:43:29.406434+0000","last_fullsized":"2024-04-25T01:43:29.406434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:39.780544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.431179+0000","last_change":"2024-04-25T01:39:32.427357+0000","last_active":"2024-04-25T01:43:32.431179+0000","last_peered":"2024-04-25T01:43:32.431179+0000","last_clean":"2024-04-25T01:43:32.431179+0000","last_became_active":"2024-04-25T01:39:32.427105+0000","last_became_peered":"2024-04-25T01:39:32.427105+0000","last_unstale":"2024-04-25T01:43:32.431179+0000","last_undegraded":"2024-04-25T01:43:32.431179+0000","last_fullsized":"2024-04-25T01:43:32.431179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:04.848726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":66,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'217","reported_seq":242,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.751559+0000","last_change":"2024-04-25T01:39:33.444814+0000","last_active":"2024-04-25T01:43:34.751559+0000","last_peered":"2024-04-25T01:43:34.751559+0000","last_clean":"2024-04-25T01:43:34.751559+0000","last_became_active":"2024-04-25T01:39:33.444489+0000","last_became_peered":"2024-04-25T01:39:33.444489+0000","last_unstale":"2024-04-25T01:43:34.751559+0000","last_undegraded":"2024-04-25T01:43:34.751559+0000","last_fullsized":"2024-04-25T01:43:34.751559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:06.718940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"30'235","reported_seq":268,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.898877+0000","last_change":"2024-04-25T01:39:24.392642+0000","last_active":"2024-04-25T01:43:46.898877+0000","last_peered":"2024-04-25T01:43:46.898877+0000","last_clean":"2024-04-25T01:43:46.898877+0000","last_became_active":"2024-04-25T01:39:24.391605+0000","last_became_peered":"2024-04-25T01:39:24.391605+0000","last_unstale":"2024-04-25T01:43:46.898877+0000","last_undegraded":"2024-04-25T01:43:46.898877+0000","last_fullsized":"2024-04-25T01:43:46.898877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:01:23.217074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":565248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.413394+0000","last_change":"2024-04-25T01:39:23.377236+0000","last_active":"2024-04-25T01:43:29.413394+0000","last_peered":"2024-04-25T01:43:29.413394+0000","last_clean":"2024-04-25T01:43:29.413394+0000","last_became_active":"2024-04-25T01:39:23.376727+0000","last_became_peered":"2024-04-25T01:39:23.376727+0000","last_unstale":"2024-04-25T01:43:29.413394+0000","last_undegraded":"2024-04-25T01:43:29.413394+0000","last_fullsized":"2024-04-25T01:43:29.413394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:08.103707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.407470+0000","last_change":"2024-04-25T01:39:32.424457+0000","last_active":"2024-04-25T01:43:29.407470+0000","last_peered":"2024-04-25T01:43:29.407470+0000","last_clean":"2024-04-25T01:43:29.407470+0000","last_became_active":"2024-04-25T01:39:32.424203+0000","last_became_peered":"2024-04-25T01:39:32.424203+0000","last_unstale":"2024-04-25T01:43:29.407470+0000","last_undegraded":"2024-04-25T01:43:29.407470+0000","last_fullsized":"2024-04-25T01:43:29.407470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:12:20.824070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"30'172","reported_seq":198,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.723551+0000","last_change":"2024-04-25T01:39:33.445948+0000","last_active":"2024-04-25T01:43:34.723551+0000","last_peered":"2024-04-25T01:43:34.723551+0000","last_clean":"2024-04-25T01:43:34.723551+0000","last_became_active":"2024-04-25T01:39:33.445654+0000","last_became_peered":"2024-04-25T01:39:33.445654+0000","last_unstale":"2024-04-25T01:43:34.723551+0000","last_undegraded":"2024-04-25T01:43:34.723551+0000","last_fullsized":"2024-04-25T01:43:34.723551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:51.323909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'4","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.612487+0000","last_change":"2024-04-25T01:39:32.430484+0000","last_active":"2024-04-25T01:43:29.612487+0000","last_peered":"2024-04-25T01:43:29.612487+0000","last_clean":"2024-04-25T01:43:29.612487+0000","last_became_active":"2024-04-25T01:39:32.430220+0000","last_became_peered":"2024-04-25T01:39:32.430220+0000","last_unstale":"2024-04-25T01:43:29.612487+0000","last_undegraded":"2024-04-25T01:43:29.612487+0000","last_fullsized":"2024-04-25T01:43:29.612487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:36:53.152442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"30'187","reported_seq":220,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.879565+0000","last_change":"2024-04-25T01:39:24.375457+0000","last_active":"2024-04-25T01:43:46.879565+0000","last_peered":"2024-04-25T01:43:46.879565+0000","last_clean":"2024-04-25T01:43:46.879565+0000","last_became_active":"2024-04-25T01:39:24.375178+0000","last_became_peered":"2024-04-25T01:39:24.375178+0000","last_unstale":"2024-04-25T01:43:46.879565+0000","last_undegraded":"2024-04-25T01:43:46.879565+0000","last_fullsized":"2024-04-25T01:43:46.879565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:58:15.640882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.402961+0000","last_change":"2024-04-25T01:39:23.369998+0000","last_active":"2024-04-25T01:43:29.402961+0000","last_peered":"2024-04-25T01:43:29.402961+0000","last_clean":"2024-04-25T01:43:29.402961+0000","last_became_active":"2024-04-25T01:39:23.369710+0000","last_became_peered":"2024-04-25T01:39:23.369710+0000","last_unstale":"2024-04-25T01:43:29.402961+0000","last_undegraded":"2024-04-25T01:43:29.402961+0000","last_fullsized":"2024-04-25T01:43:29.402961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:32:34.329452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"30'192","reported_seq":218,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.763527+0000","last_change":"2024-04-25T01:39:33.447666+0000","last_active":"2024-04-25T01:43:34.763527+0000","last_peered":"2024-04-25T01:43:34.763527+0000","last_clean":"2024-04-25T01:43:34.763527+0000","last_became_active":"2024-04-25T01:39:33.447436+0000","last_became_peered":"2024-04-25T01:39:33.447436+0000","last_unstale":"2024-04-25T01:43:34.763527+0000","last_undegraded":"2024-04-25T01:43:34.763527+0000","last_fullsized":"2024-04-25T01:43:34.763527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:25:20.440422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'7","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.420309+0000","last_change":"2024-04-25T01:39:32.436300+0000","last_active":"2024-04-25T01:43:32.420309+0000","last_peered":"2024-04-25T01:43:32.420309+0000","last_clean":"2024-04-25T01:43:32.420309+0000","last_became_active":"2024-04-25T01:39:32.436000+0000","last_became_peered":"2024-04-25T01:39:32.436000+0000","last_unstale":"2024-04-25T01:43:32.420309+0000","last_undegraded":"2024-04-25T01:43:32.420309+0000","last_fullsized":"2024-04-25T01:43:32.420309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:38.044992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"30'190","reported_seq":223,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.876992+0000","last_change":"2024-04-25T01:39:24.387708+0000","last_active":"2024-04-25T01:43:46.876992+0000","last_peered":"2024-04-25T01:43:46.876992+0000","last_clean":"2024-04-25T01:43:46.876992+0000","last_became_active":"2024-04-25T01:39:24.387433+0000","last_became_peered":"2024-04-25T01:39:24.387433+0000","last_unstale":"2024-04-25T01:43:46.876992+0000","last_undegraded":"2024-04-25T01:43:46.876992+0000","last_fullsized":"2024-04-25T01:43:46.876992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:34.312066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.407793+0000","last_change":"2024-04-25T01:39:23.377487+0000","last_active":"2024-04-25T01:43:29.407793+0000","last_peered":"2024-04-25T01:43:29.407793+0000","last_clean":"2024-04-25T01:43:29.407793+0000","last_became_active":"2024-04-25T01:39:23.377181+0000","last_became_peered":"2024-04-25T01:39:23.377181+0000","last_unstale":"2024-04-25T01:43:29.407793+0000","last_undegraded":"2024-04-25T01:43:29.407793+0000","last_fullsized":"2024-04-25T01:43:29.407793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:17.434141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"30'209","reported_seq":234,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.752030+0000","last_change":"2024-04-25T01:39:33.444973+0000","last_active":"2024-04-25T01:43:34.752030+0000","last_peered":"2024-04-25T01:43:34.752030+0000","last_clean":"2024-04-25T01:43:34.752030+0000","last_became_active":"2024-04-25T01:39:33.444673+0000","last_became_peered":"2024-04-25T01:39:33.444673+0000","last_unstale":"2024-04-25T01:43:34.752030+0000","last_undegraded":"2024-04-25T01:43:34.752030+0000","last_fullsized":"2024-04-25T01:43:34.752030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:08.372714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"29'3","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.412813+0000","last_change":"2024-04-25T01:39:23.372975+0000","last_active":"2024-04-25T01:43:29.412813+0000","last_peered":"2024-04-25T01:43:29.412813+0000","last_clean":"2024-04-25T01:43:29.412813+0000","last_became_active":"2024-04-25T01:39:23.372688+0000","last_became_peered":"2024-04-25T01:39:23.372688+0000","last_unstale":"2024-04-25T01:43:29.412813+0000","last_undegraded":"2024-04-25T01:43:29.412813+0000","last_fullsized":"2024-04-25T01:43:29.412813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:42:57.195844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"30'157","reported_seq":190,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.882990+0000","last_change":"2024-04-25T01:39:24.388095+0000","last_active":"2024-04-25T01:43:46.882990+0000","last_peered":"2024-04-25T01:43:46.882990+0000","last_clean":"2024-04-25T01:43:46.882990+0000","last_became_active":"2024-04-25T01:39:24.387797+0000","last_became_peered":"2024-04-25T01:39:24.387797+0000","last_unstale":"2024-04-25T01:43:46.882990+0000","last_undegraded":"2024-04-25T01:43:46.882990+0000","last_fullsized":"2024-04-25T01:43:46.882990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:43:16.385957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.424303+0000","last_change":"2024-04-25T01:39:32.427081+0000","last_active":"2024-04-25T01:43:32.424303+0000","last_peered":"2024-04-25T01:43:32.424303+0000","last_clean":"2024-04-25T01:43:32.424303+0000","last_became_active":"2024-04-25T01:39:32.426626+0000","last_became_peered":"2024-04-25T01:39:32.426626+0000","last_unstale":"2024-04-25T01:43:32.424303+0000","last_undegraded":"2024-04-25T01:43:32.424303+0000","last_fullsized":"2024-04-25T01:43:32.424303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:45.358400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"30'170","reported_seq":195,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.728867+0000","last_change":"2024-04-25T01:39:33.446301+0000","last_active":"2024-04-25T01:43:34.728867+0000","last_peered":"2024-04-25T01:43:34.728867+0000","last_clean":"2024-04-25T01:43:34.728867+0000","last_became_active":"2024-04-25T01:39:33.445158+0000","last_became_peered":"2024-04-25T01:39:33.445158+0000","last_unstale":"2024-04-25T01:43:34.728867+0000","last_undegraded":"2024-04-25T01:43:34.728867+0000","last_fullsized":"2024-04-25T01:43:34.728867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:53:26.017968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"30'1824","reported_seq":1859,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:35.275648+0000","last_change":"2024-04-25T01:39:23.371716+0000","last_active":"2024-04-25T01:43:35.275648+0000","last_peered":"2024-04-25T01:43:35.275648+0000","last_clean":"2024-04-25T01:43:35.275648+0000","last_became_active":"2024-04-25T01:39:23.371475+0000","last_became_peered":"2024-04-25T01:39:23.371475+0000","last_unstale":"2024-04-25T01:43:35.275648+0000","last_undegraded":"2024-04-25T01:43:35.275648+0000","last_fullsized":"2024-04-25T01:43:35.275648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1824,"log_dups_size":0,"ondisk_log_size":1824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:10.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3805208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1821,"num_write_kb":5470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"30'150","reported_seq":183,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.870889+0000","last_change":"2024-04-25T01:39:24.388083+0000","last_active":"2024-04-25T01:43:46.870889+0000","last_peered":"2024-04-25T01:43:46.870889+0000","last_clean":"2024-04-25T01:43:46.870889+0000","last_became_active":"2024-04-25T01:39:24.387789+0000","last_became_peered":"2024-04-25T01:39:24.387789+0000","last_unstale":"2024-04-25T01:43:46.870889+0000","last_undegraded":"2024-04-25T01:43:46.870889+0000","last_fullsized":"2024-04-25T01:43:46.870889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:31.760631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'5","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.422640+0000","last_change":"2024-04-25T01:39:32.429613+0000","last_active":"2024-04-25T01:43:32.422640+0000","last_peered":"2024-04-25T01:43:32.422640+0000","last_clean":"2024-04-25T01:43:32.422640+0000","last_became_active":"2024-04-25T01:39:32.429361+0000","last_became_peered":"2024-04-25T01:39:32.429361+0000","last_unstale":"2024-04-25T01:43:32.422640+0000","last_undegraded":"2024-04-25T01:43:32.422640+0000","last_fullsized":"2024-04-25T01:43:32.422640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:04:59.928602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"30'221","reported_seq":246,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.683570+0000","last_change":"2024-04-25T01:39:33.426384+0000","last_active":"2024-04-25T01:43:34.683570+0000","last_peered":"2024-04-25T01:43:34.683570+0000","last_clean":"2024-04-25T01:43:34.683570+0000","last_became_active":"2024-04-25T01:39:33.426101+0000","last_became_peered":"2024-04-25T01:39:33.426101+0000","last_unstale":"2024-04-25T01:43:34.683570+0000","last_undegraded":"2024-04-25T01:43:34.683570+0000","last_fullsized":"2024-04-25T01:43:34.683570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:36.820458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"30'172","reported_seq":206,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.884138+0000","last_change":"2024-04-25T01:39:24.395618+0000","last_active":"2024-04-25T01:43:46.884138+0000","last_peered":"2024-04-25T01:43:46.884138+0000","last_clean":"2024-04-25T01:43:46.884138+0000","last_became_active":"2024-04-25T01:39:24.394816+0000","last_became_peered":"2024-04-25T01:39:24.394816+0000","last_unstale":"2024-04-25T01:43:46.884138+0000","last_undegraded":"2024-04-25T01:43:46.884138+0000","last_fullsized":"2024-04-25T01:43:46.884138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:01.025135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"30'174","reported_seq":199,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.719246+0000","last_change":"2024-04-25T01:39:33.432537+0000","last_active":"2024-04-25T01:43:34.719246+0000","last_peered":"2024-04-25T01:43:34.719246+0000","last_clean":"2024-04-25T01:43:34.719246+0000","last_became_active":"2024-04-25T01:39:33.432266+0000","last_became_peered":"2024-04-25T01:39:33.432266+0000","last_unstale":"2024-04-25T01:43:34.719246+0000","last_undegraded":"2024-04-25T01:43:34.719246+0000","last_fullsized":"2024-04-25T01:43:34.719246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:31.703689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"30'158","reported_seq":197,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.876820+0000","last_change":"2024-04-25T01:40:06.450805+0000","last_active":"2024-04-25T01:43:46.876820+0000","last_peered":"2024-04-25T01:43:46.876820+0000","last_clean":"2024-04-25T01:43:46.876820+0000","last_became_active":"2024-04-25T01:40:06.450447+0000","last_became_peered":"2024-04-25T01:40:06.450447+0000","last_unstale":"2024-04-25T01:43:46.876820+0000","last_undegraded":"2024-04-25T01:43:46.876820+0000","last_fullsized":"2024-04-25T01:43:46.876820+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:37:30.384756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"30'168","reported_seq":193,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.705486+0000","last_change":"2024-04-25T01:39:33.439086+0000","last_active":"2024-04-25T01:43:34.705486+0000","last_peered":"2024-04-25T01:43:34.705486+0000","last_clean":"2024-04-25T01:43:34.705486+0000","last_became_active":"2024-04-25T01:39:33.438811+0000","last_became_peered":"2024-04-25T01:39:33.438811+0000","last_unstale":"2024-04-25T01:43:34.705486+0000","last_undegraded":"2024-04-25T01:43:34.705486+0000","last_fullsized":"2024-04-25T01:43:34.705486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:49:23.604749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"30'143","reported_seq":177,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.895840+0000","last_change":"2024-04-25T01:39:24.399738+0000","last_active":"2024-04-25T01:43:46.895840+0000","last_peered":"2024-04-25T01:43:46.895840+0000","last_clean":"2024-04-25T01:43:46.895840+0000","last_became_active":"2024-04-25T01:39:24.399499+0000","last_became_peered":"2024-04-25T01:39:24.399499+0000","last_unstale":"2024-04-25T01:43:46.895840+0000","last_undegraded":"2024-04-25T01:43:46.895840+0000","last_fullsized":"2024-04-25T01:43:46.895840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:58.646669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":311296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"30'184","reported_seq":209,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.728870+0000","last_change":"2024-04-25T01:39:33.444074+0000","last_active":"2024-04-25T01:43:34.728870+0000","last_peered":"2024-04-25T01:43:34.728870+0000","last_clean":"2024-04-25T01:43:34.728870+0000","last_became_active":"2024-04-25T01:39:33.443796+0000","last_became_peered":"2024-04-25T01:39:33.443796+0000","last_unstale":"2024-04-25T01:43:34.728870+0000","last_undegraded":"2024-04-25T01:43:34.728870+0000","last_fullsized":"2024-04-25T01:43:34.728870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:56.379211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"30'124","reported_seq":158,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.880255+0000","last_change":"2024-04-25T01:39:24.390631+0000","last_active":"2024-04-25T01:43:46.880255+0000","last_peered":"2024-04-25T01:43:46.880255+0000","last_clean":"2024-04-25T01:43:46.880255+0000","last_became_active":"2024-04-25T01:39:24.390363+0000","last_became_peered":"2024-04-25T01:39:24.390363+0000","last_unstale":"2024-04-25T01:43:46.880255+0000","last_undegraded":"2024-04-25T01:43:46.880255+0000","last_fullsized":"2024-04-25T01:43:46.880255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:48.830416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"30'162","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.716155+0000","last_change":"2024-04-25T01:39:33.437787+0000","last_active":"2024-04-25T01:43:34.716155+0000","last_peered":"2024-04-25T01:43:34.716155+0000","last_clean":"2024-04-25T01:43:34.716155+0000","last_became_active":"2024-04-25T01:39:33.436131+0000","last_became_peered":"2024-04-25T01:39:33.436131+0000","last_unstale":"2024-04-25T01:43:34.716155+0000","last_undegraded":"2024-04-25T01:43:34.716155+0000","last_fullsized":"2024-04-25T01:43:34.716155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:29:13.213643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"30'148","reported_seq":182,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.875617+0000","last_change":"2024-04-25T01:39:24.389645+0000","last_active":"2024-04-25T01:43:46.875617+0000","last_peered":"2024-04-25T01:43:46.875617+0000","last_clean":"2024-04-25T01:43:46.875617+0000","last_became_active":"2024-04-25T01:39:24.389375+0000","last_became_peered":"2024-04-25T01:39:24.389375+0000","last_unstale":"2024-04-25T01:43:46.875617+0000","last_undegraded":"2024-04-25T01:43:46.875617+0000","last_fullsized":"2024-04-25T01:43:46.875617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:13:12.753893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"30'141","reported_seq":167,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.743053+0000","last_change":"2024-04-25T01:39:33.448177+0000","last_active":"2024-04-25T01:43:34.743053+0000","last_peered":"2024-04-25T01:43:34.743053+0000","last_clean":"2024-04-25T01:43:34.743053+0000","last_became_active":"2024-04-25T01:39:33.447588+0000","last_became_peered":"2024-04-25T01:39:33.447588+0000","last_unstale":"2024-04-25T01:43:34.743053+0000","last_undegraded":"2024-04-25T01:43:34.743053+0000","last_fullsized":"2024-04-25T01:43:34.743053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:11:20.466189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"30'156","reported_seq":190,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.878803+0000","last_change":"2024-04-25T01:39:24.374082+0000","last_active":"2024-04-25T01:43:46.878803+0000","last_peered":"2024-04-25T01:43:46.878803+0000","last_clean":"2024-04-25T01:43:46.878803+0000","last_became_active":"2024-04-25T01:39:24.373731+0000","last_became_peered":"2024-04-25T01:39:24.373731+0000","last_unstale":"2024-04-25T01:43:46.878803+0000","last_undegraded":"2024-04-25T01:43:46.878803+0000","last_fullsized":"2024-04-25T01:43:46.878803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:45.817483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"30'188","reported_seq":214,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.753852+0000","last_change":"2024-04-25T01:39:33.446992+0000","last_active":"2024-04-25T01:43:34.753852+0000","last_peered":"2024-04-25T01:43:34.753852+0000","last_clean":"2024-04-25T01:43:34.753852+0000","last_became_active":"2024-04-25T01:39:33.446652+0000","last_became_peered":"2024-04-25T01:39:33.446652+0000","last_unstale":"2024-04-25T01:43:34.753852+0000","last_undegraded":"2024-04-25T01:43:34.753852+0000","last_fullsized":"2024-04-25T01:43:34.753852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:43:52.959274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"30'224","reported_seq":258,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.886451+0000","last_change":"2024-04-25T01:39:24.398614+0000","last_active":"2024-04-25T01:43:46.886451+0000","last_peered":"2024-04-25T01:43:46.886451+0000","last_clean":"2024-04-25T01:43:46.886451+0000","last_became_active":"2024-04-25T01:39:24.398299+0000","last_became_peered":"2024-04-25T01:39:24.398299+0000","last_unstale":"2024-04-25T01:43:46.886451+0000","last_undegraded":"2024-04-25T01:43:46.886451+0000","last_fullsized":"2024-04-25T01:43:46.886451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:54:51.191225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":516096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"30'167","reported_seq":193,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.764139+0000","last_change":"2024-04-25T01:39:33.441401+0000","last_active":"2024-04-25T01:43:34.764139+0000","last_peered":"2024-04-25T01:43:34.764139+0000","last_clean":"2024-04-25T01:43:34.764139+0000","last_became_active":"2024-04-25T01:39:33.441104+0000","last_became_peered":"2024-04-25T01:39:33.441104+0000","last_unstale":"2024-04-25T01:43:34.764139+0000","last_undegraded":"2024-04-25T01:43:34.764139+0000","last_fullsized":"2024-04-25T01:43:34.764139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:51.503340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"30'161","reported_seq":195,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.874331+0000","last_change":"2024-04-25T01:39:24.390352+0000","last_active":"2024-04-25T01:43:46.874331+0000","last_peered":"2024-04-25T01:43:46.874331+0000","last_clean":"2024-04-25T01:43:46.874331+0000","last_became_active":"2024-04-25T01:39:24.389809+0000","last_became_peered":"2024-04-25T01:39:24.389809+0000","last_unstale":"2024-04-25T01:43:46.874331+0000","last_undegraded":"2024-04-25T01:43:46.874331+0000","last_fullsized":"2024-04-25T01:43:46.874331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:22:44.221898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"30'188","reported_seq":213,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.738058+0000","last_change":"2024-04-25T01:39:33.426710+0000","last_active":"2024-04-25T01:43:34.738058+0000","last_peered":"2024-04-25T01:43:34.738058+0000","last_clean":"2024-04-25T01:43:34.738058+0000","last_became_active":"2024-04-25T01:39:33.426056+0000","last_became_peered":"2024-04-25T01:39:33.426056+0000","last_unstale":"2024-04-25T01:43:34.738058+0000","last_undegraded":"2024-04-25T01:43:34.738058+0000","last_fullsized":"2024-04-25T01:43:34.738058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:53:41.174851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"30'220","reported_seq":254,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.895157+0000","last_change":"2024-04-25T01:39:24.387093+0000","last_active":"2024-04-25T01:43:46.895157+0000","last_peered":"2024-04-25T01:43:46.895157+0000","last_clean":"2024-04-25T01:43:46.895157+0000","last_became_active":"2024-04-25T01:39:24.386809+0000","last_became_peered":"2024-04-25T01:39:24.386809+0000","last_unstale":"2024-04-25T01:43:46.895157+0000","last_undegraded":"2024-04-25T01:43:46.895157+0000","last_fullsized":"2024-04-25T01:43:46.895157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:46:05.313828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"30'189","reported_seq":214,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.730046+0000","last_change":"2024-04-25T01:39:33.436499+0000","last_active":"2024-04-25T01:43:34.730046+0000","last_peered":"2024-04-25T01:43:34.730046+0000","last_clean":"2024-04-25T01:43:34.730046+0000","last_became_active":"2024-04-25T01:39:33.436017+0000","last_became_peered":"2024-04-25T01:39:33.436017+0000","last_unstale":"2024-04-25T01:43:34.730046+0000","last_undegraded":"2024-04-25T01:43:34.730046+0000","last_fullsized":"2024-04-25T01:43:34.730046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:46:09.302012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"30'149","reported_seq":182,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.874684+0000","last_change":"2024-04-25T01:39:24.389039+0000","last_active":"2024-04-25T01:43:46.874684+0000","last_peered":"2024-04-25T01:43:46.874684+0000","last_clean":"2024-04-25T01:43:46.874684+0000","last_became_active":"2024-04-25T01:39:24.388793+0000","last_became_peered":"2024-04-25T01:39:24.388793+0000","last_unstale":"2024-04-25T01:43:46.874684+0000","last_undegraded":"2024-04-25T01:43:46.874684+0000","last_fullsized":"2024-04-25T01:43:46.874684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:13.093550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"30'196","reported_seq":221,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.759968+0000","last_change":"2024-04-25T01:39:33.441122+0000","last_active":"2024-04-25T01:43:34.759968+0000","last_peered":"2024-04-25T01:43:34.759968+0000","last_clean":"2024-04-25T01:43:34.759968+0000","last_became_active":"2024-04-25T01:39:33.440760+0000","last_became_peered":"2024-04-25T01:39:33.440760+0000","last_unstale":"2024-04-25T01:43:34.759968+0000","last_undegraded":"2024-04-25T01:43:34.759968+0000","last_fullsized":"2024-04-25T01:43:34.759968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:30:12.603789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"30'194","reported_seq":227,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.899298+0000","last_change":"2024-04-25T01:39:24.390884+0000","last_active":"2024-04-25T01:43:46.899298+0000","last_peered":"2024-04-25T01:43:46.899298+0000","last_clean":"2024-04-25T01:43:46.899298+0000","last_became_active":"2024-04-25T01:39:24.390591+0000","last_became_peered":"2024-04-25T01:39:24.390591+0000","last_unstale":"2024-04-25T01:43:46.899298+0000","last_undegraded":"2024-04-25T01:43:46.899298+0000","last_fullsized":"2024-04-25T01:43:46.899298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:51.274363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"30'233","reported_seq":258,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.751644+0000","last_change":"2024-04-25T01:39:33.429482+0000","last_active":"2024-04-25T01:43:34.751644+0000","last_peered":"2024-04-25T01:43:34.751644+0000","last_clean":"2024-04-25T01:43:34.751644+0000","last_became_active":"2024-04-25T01:39:33.429158+0000","last_became_peered":"2024-04-25T01:39:33.429158+0000","last_unstale":"2024-04-25T01:43:34.751644+0000","last_undegraded":"2024-04-25T01:43:34.751644+0000","last_fullsized":"2024-04-25T01:43:34.751644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:58:07.372868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"30'168","reported_seq":201,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.886803+0000","last_change":"2024-04-25T01:39:24.388891+0000","last_active":"2024-04-25T01:43:46.886803+0000","last_peered":"2024-04-25T01:43:46.886803+0000","last_clean":"2024-04-25T01:43:46.886803+0000","last_became_active":"2024-04-25T01:39:24.388619+0000","last_became_peered":"2024-04-25T01:39:24.388619+0000","last_unstale":"2024-04-25T01:43:46.886803+0000","last_undegraded":"2024-04-25T01:43:46.886803+0000","last_fullsized":"2024-04-25T01:43:46.886803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:05.176386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"30'215","reported_seq":240,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.728559+0000","last_change":"2024-04-25T01:39:33.443534+0000","last_active":"2024-04-25T01:43:34.728559+0000","last_peered":"2024-04-25T01:43:34.728559+0000","last_clean":"2024-04-25T01:43:34.728559+0000","last_became_active":"2024-04-25T01:39:33.443257+0000","last_became_peered":"2024-04-25T01:39:33.443257+0000","last_unstale":"2024-04-25T01:43:34.728559+0000","last_undegraded":"2024-04-25T01:43:34.728559+0000","last_fullsized":"2024-04-25T01:43:34.728559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:44:30.154519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"30'188","reported_seq":221,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.888562+0000","last_change":"2024-04-25T01:39:24.395109+0000","last_active":"2024-04-25T01:43:46.888562+0000","last_peered":"2024-04-25T01:43:46.888562+0000","last_clean":"2024-04-25T01:43:46.888562+0000","last_became_active":"2024-04-25T01:39:24.394784+0000","last_became_peered":"2024-04-25T01:39:24.394784+0000","last_unstale":"2024-04-25T01:43:46.888562+0000","last_undegraded":"2024-04-25T01:43:46.888562+0000","last_fullsized":"2024-04-25T01:43:46.888562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:44:09.102603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"30'159","reported_seq":184,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.714401+0000","last_change":"2024-04-25T01:39:33.446683+0000","last_active":"2024-04-25T01:43:34.714401+0000","last_peered":"2024-04-25T01:43:34.714401+0000","last_clean":"2024-04-25T01:43:34.714401+0000","last_became_active":"2024-04-25T01:39:33.445949+0000","last_became_peered":"2024-04-25T01:39:33.445949+0000","last_unstale":"2024-04-25T01:43:34.714401+0000","last_undegraded":"2024-04-25T01:43:34.714401+0000","last_fullsized":"2024-04-25T01:43:34.714401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:28.864821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"30'196","reported_seq":229,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.868887+0000","last_change":"2024-04-25T01:39:24.380199+0000","last_active":"2024-04-25T01:43:46.868887+0000","last_peered":"2024-04-25T01:43:46.868887+0000","last_clean":"2024-04-25T01:43:46.868887+0000","last_became_active":"2024-04-25T01:39:24.379591+0000","last_became_peered":"2024-04-25T01:39:24.379591+0000","last_unstale":"2024-04-25T01:43:46.868887+0000","last_undegraded":"2024-04-25T01:43:46.868887+0000","last_fullsized":"2024-04-25T01:43:46.868887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:54.534683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"30'233","reported_seq":258,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.760480+0000","last_change":"2024-04-25T01:39:33.439702+0000","last_active":"2024-04-25T01:43:34.760480+0000","last_peered":"2024-04-25T01:43:34.760480+0000","last_clean":"2024-04-25T01:43:34.760480+0000","last_became_active":"2024-04-25T01:39:33.439424+0000","last_became_peered":"2024-04-25T01:39:33.439424+0000","last_unstale":"2024-04-25T01:43:34.760480+0000","last_undegraded":"2024-04-25T01:43:34.760480+0000","last_fullsized":"2024-04-25T01:43:34.760480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:31.528140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"30'179","reported_seq":212,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.883530+0000","last_change":"2024-04-25T01:39:24.395125+0000","last_active":"2024-04-25T01:43:46.883530+0000","last_peered":"2024-04-25T01:43:46.883530+0000","last_clean":"2024-04-25T01:43:46.883530+0000","last_became_active":"2024-04-25T01:39:24.392605+0000","last_became_peered":"2024-04-25T01:39:24.392605+0000","last_unstale":"2024-04-25T01:43:46.883530+0000","last_undegraded":"2024-04-25T01:43:46.883530+0000","last_fullsized":"2024-04-25T01:43:46.883530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:53.333616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"30'166","reported_seq":191,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.710900+0000","last_change":"2024-04-25T01:39:33.438104+0000","last_active":"2024-04-25T01:43:34.710900+0000","last_peered":"2024-04-25T01:43:34.710900+0000","last_clean":"2024-04-25T01:43:34.710900+0000","last_became_active":"2024-04-25T01:39:33.437795+0000","last_became_peered":"2024-04-25T01:39:33.437795+0000","last_unstale":"2024-04-25T01:43:34.710900+0000","last_undegraded":"2024-04-25T01:43:34.710900+0000","last_fullsized":"2024-04-25T01:43:34.710900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:32.294104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"30'199","reported_seq":232,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.899022+0000","last_change":"2024-04-25T01:39:24.391312+0000","last_active":"2024-04-25T01:43:46.899022+0000","last_peered":"2024-04-25T01:43:46.899022+0000","last_clean":"2024-04-25T01:43:46.899022+0000","last_became_active":"2024-04-25T01:39:24.390978+0000","last_became_peered":"2024-04-25T01:39:24.390978+0000","last_unstale":"2024-04-25T01:43:46.899022+0000","last_undegraded":"2024-04-25T01:43:46.899022+0000","last_fullsized":"2024-04-25T01:43:46.899022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:38:25.637031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"30'197","reported_seq":222,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.738370+0000","last_change":"2024-04-25T01:39:33.431262+0000","last_active":"2024-04-25T01:43:34.738370+0000","last_peered":"2024-04-25T01:43:34.738370+0000","last_clean":"2024-04-25T01:43:34.738370+0000","last_became_active":"2024-04-25T01:39:33.430982+0000","last_became_peered":"2024-04-25T01:39:33.430982+0000","last_unstale":"2024-04-25T01:43:34.738370+0000","last_undegraded":"2024-04-25T01:43:34.738370+0000","last_fullsized":"2024-04-25T01:43:34.738370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:11.821542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"30'161","reported_seq":194,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.892591+0000","last_change":"2024-04-25T01:39:24.399270+0000","last_active":"2024-04-25T01:43:46.892591+0000","last_peered":"2024-04-25T01:43:46.892591+0000","last_clean":"2024-04-25T01:43:46.892591+0000","last_became_active":"2024-04-25T01:39:24.399011+0000","last_became_peered":"2024-04-25T01:39:24.399011+0000","last_unstale":"2024-04-25T01:43:46.892591+0000","last_undegraded":"2024-04-25T01:43:46.892591+0000","last_fullsized":"2024-04-25T01:43:46.892591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:00.987674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"30'187","reported_seq":212,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.706034+0000","last_change":"2024-04-25T01:39:33.443939+0000","last_active":"2024-04-25T01:43:34.706034+0000","last_peered":"2024-04-25T01:43:34.706034+0000","last_clean":"2024-04-25T01:43:34.706034+0000","last_became_active":"2024-04-25T01:39:33.443608+0000","last_became_peered":"2024-04-25T01:39:33.443608+0000","last_unstale":"2024-04-25T01:43:34.706034+0000","last_undegraded":"2024-04-25T01:43:34.706034+0000","last_fullsized":"2024-04-25T01:43:34.706034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:35.561173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"30'178","reported_seq":211,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.872334+0000","last_change":"2024-04-25T01:39:24.388943+0000","last_active":"2024-04-25T01:43:46.872334+0000","last_peered":"2024-04-25T01:43:46.872334+0000","last_clean":"2024-04-25T01:43:46.872334+0000","last_became_active":"2024-04-25T01:39:24.388690+0000","last_became_peered":"2024-04-25T01:39:24.388690+0000","last_unstale":"2024-04-25T01:43:46.872334+0000","last_undegraded":"2024-04-25T01:43:46.872334+0000","last_fullsized":"2024-04-25T01:43:46.872334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:42:18.260701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"30'175","reported_seq":200,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.762256+0000","last_change":"2024-04-25T01:39:33.438460+0000","last_active":"2024-04-25T01:43:34.762256+0000","last_peered":"2024-04-25T01:43:34.762256+0000","last_clean":"2024-04-25T01:43:34.762256+0000","last_became_active":"2024-04-25T01:39:33.436581+0000","last_became_peered":"2024-04-25T01:39:33.436581+0000","last_unstale":"2024-04-25T01:43:34.762256+0000","last_undegraded":"2024-04-25T01:43:34.762256+0000","last_fullsized":"2024-04-25T01:43:34.762256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:03:27.382925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"30'181","reported_seq":214,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.879616+0000","last_change":"2024-04-25T01:39:24.389556+0000","last_active":"2024-04-25T01:43:46.879616+0000","last_peered":"2024-04-25T01:43:46.879616+0000","last_clean":"2024-04-25T01:43:46.879616+0000","last_became_active":"2024-04-25T01:39:24.389254+0000","last_became_peered":"2024-04-25T01:39:24.389254+0000","last_unstale":"2024-04-25T01:43:46.879616+0000","last_undegraded":"2024-04-25T01:43:46.879616+0000","last_fullsized":"2024-04-25T01:43:46.879616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:56.208172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"30'237","reported_seq":262,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.748129+0000","last_change":"2024-04-25T01:39:33.433893+0000","last_active":"2024-04-25T01:43:34.748129+0000","last_peered":"2024-04-25T01:43:34.748129+0000","last_clean":"2024-04-25T01:43:34.748129+0000","last_became_active":"2024-04-25T01:39:33.433577+0000","last_became_peered":"2024-04-25T01:39:33.433577+0000","last_unstale":"2024-04-25T01:43:34.748129+0000","last_undegraded":"2024-04-25T01:43:34.748129+0000","last_fullsized":"2024-04-25T01:43:34.748129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:16.371837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"30'187","reported_seq":220,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.884139+0000","last_change":"2024-04-25T01:39:24.392021+0000","last_active":"2024-04-25T01:43:46.884139+0000","last_peered":"2024-04-25T01:43:46.884139+0000","last_clean":"2024-04-25T01:43:46.884139+0000","last_became_active":"2024-04-25T01:39:24.391352+0000","last_became_peered":"2024-04-25T01:39:24.391352+0000","last_unstale":"2024-04-25T01:43:46.884139+0000","last_undegraded":"2024-04-25T01:43:46.884139+0000","last_fullsized":"2024-04-25T01:43:46.884139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:44.434749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"30'186","reported_seq":211,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.683783+0000","last_change":"2024-04-25T01:39:33.436641+0000","last_active":"2024-04-25T01:43:34.683783+0000","last_peered":"2024-04-25T01:43:34.683783+0000","last_clean":"2024-04-25T01:43:34.683783+0000","last_became_active":"2024-04-25T01:39:33.436389+0000","last_became_peered":"2024-04-25T01:39:33.436389+0000","last_unstale":"2024-04-25T01:43:34.683783+0000","last_undegraded":"2024-04-25T01:43:34.683783+0000","last_fullsized":"2024-04-25T01:43:34.683783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:19:51.940088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"30'169","reported_seq":202,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.883979+0000","last_change":"2024-04-25T01:39:24.396300+0000","last_active":"2024-04-25T01:43:46.883979+0000","last_peered":"2024-04-25T01:43:46.883979+0000","last_clean":"2024-04-25T01:43:46.883979+0000","last_became_active":"2024-04-25T01:39:24.396023+0000","last_became_peered":"2024-04-25T01:39:24.396023+0000","last_unstale":"2024-04-25T01:43:46.883979+0000","last_undegraded":"2024-04-25T01:43:46.883979+0000","last_fullsized":"2024-04-25T01:43:46.883979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:21.500721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"30'186","reported_seq":211,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.733553+0000","last_change":"2024-04-25T01:39:33.443419+0000","last_active":"2024-04-25T01:43:34.733553+0000","last_peered":"2024-04-25T01:43:34.733553+0000","last_clean":"2024-04-25T01:43:34.733553+0000","last_became_active":"2024-04-25T01:39:33.443163+0000","last_became_peered":"2024-04-25T01:39:33.443163+0000","last_unstale":"2024-04-25T01:43:34.733553+0000","last_undegraded":"2024-04-25T01:43:34.733553+0000","last_fullsized":"2024-04-25T01:43:34.733553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:22.156410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"30'212","reported_seq":245,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.897937+0000","last_change":"2024-04-25T01:39:24.404047+0000","last_active":"2024-04-25T01:43:46.897937+0000","last_peered":"2024-04-25T01:43:46.897937+0000","last_clean":"2024-04-25T01:43:46.897937+0000","last_became_active":"2024-04-25T01:39:24.403700+0000","last_became_peered":"2024-04-25T01:39:24.403700+0000","last_unstale":"2024-04-25T01:43:46.897937+0000","last_undegraded":"2024-04-25T01:43:46.897937+0000","last_fullsized":"2024-04-25T01:43:46.897937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:53.123061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":491520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"30'177","reported_seq":202,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.712967+0000","last_change":"2024-04-25T01:39:33.435520+0000","last_active":"2024-04-25T01:43:34.712967+0000","last_peered":"2024-04-25T01:43:34.712967+0000","last_clean":"2024-04-25T01:43:34.712967+0000","last_became_active":"2024-04-25T01:39:33.434446+0000","last_became_peered":"2024-04-25T01:39:33.434446+0000","last_unstale":"2024-04-25T01:43:34.712967+0000","last_undegraded":"2024-04-25T01:43:34.712967+0000","last_fullsized":"2024-04-25T01:43:34.712967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:59.696009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"30'183","reported_seq":221,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.883554+0000","last_change":"2024-04-25T01:40:05.559200+0000","last_active":"2024-04-25T01:43:46.883554+0000","last_peered":"2024-04-25T01:43:46.883554+0000","last_clean":"2024-04-25T01:43:46.883554+0000","last_became_active":"2024-04-25T01:40:05.558954+0000","last_became_peered":"2024-04-25T01:40:05.558954+0000","last_unstale":"2024-04-25T01:43:46.883554+0000","last_undegraded":"2024-04-25T01:43:46.883554+0000","last_fullsized":"2024-04-25T01:43:46.883554+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:30.998037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"30'191","reported_seq":216,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.740677+0000","last_change":"2024-04-25T01:39:33.436479+0000","last_active":"2024-04-25T01:43:34.740677+0000","last_peered":"2024-04-25T01:43:34.740677+0000","last_clean":"2024-04-25T01:43:34.740677+0000","last_became_active":"2024-04-25T01:39:33.436193+0000","last_became_peered":"2024-04-25T01:39:33.436193+0000","last_unstale":"2024-04-25T01:43:34.740677+0000","last_undegraded":"2024-04-25T01:43:34.740677+0000","last_fullsized":"2024-04-25T01:43:34.740677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:20:03.455536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"30'179","reported_seq":212,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.896948+0000","last_change":"2024-04-25T01:39:24.393362+0000","last_active":"2024-04-25T01:43:46.896948+0000","last_peered":"2024-04-25T01:43:46.896948+0000","last_clean":"2024-04-25T01:43:46.896948+0000","last_became_active":"2024-04-25T01:39:24.392836+0000","last_became_peered":"2024-04-25T01:39:24.392836+0000","last_unstale":"2024-04-25T01:43:46.896948+0000","last_undegraded":"2024-04-25T01:43:46.896948+0000","last_fullsized":"2024-04-25T01:43:46.896948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:58.871777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"30'168","reported_seq":194,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.765220+0000","last_change":"2024-04-25T01:39:33.440164+0000","last_active":"2024-04-25T01:43:34.765220+0000","last_peered":"2024-04-25T01:43:34.765220+0000","last_clean":"2024-04-25T01:43:34.765220+0000","last_became_active":"2024-04-25T01:39:33.439878+0000","last_became_peered":"2024-04-25T01:39:33.439878+0000","last_unstale":"2024-04-25T01:43:34.765220+0000","last_undegraded":"2024-04-25T01:43:34.765220+0000","last_fullsized":"2024-04-25T01:43:34.765220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:44:52.817169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"30'207","reported_seq":240,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.896113+0000","last_change":"2024-04-25T01:39:24.401765+0000","last_active":"2024-04-25T01:43:46.896113+0000","last_peered":"2024-04-25T01:43:46.896113+0000","last_clean":"2024-04-25T01:43:46.896113+0000","last_became_active":"2024-04-25T01:39:24.400509+0000","last_became_peered":"2024-04-25T01:39:24.400509+0000","last_unstale":"2024-04-25T01:43:46.896113+0000","last_undegraded":"2024-04-25T01:43:46.896113+0000","last_fullsized":"2024-04-25T01:43:46.896113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:25.031622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":491520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"30'180","reported_seq":206,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.734853+0000","last_change":"2024-04-25T01:39:33.439353+0000","last_active":"2024-04-25T01:43:34.734853+0000","last_peered":"2024-04-25T01:43:34.734853+0000","last_clean":"2024-04-25T01:43:34.734853+0000","last_became_active":"2024-04-25T01:39:33.438915+0000","last_became_peered":"2024-04-25T01:39:33.438915+0000","last_unstale":"2024-04-25T01:43:34.734853+0000","last_undegraded":"2024-04-25T01:43:34.734853+0000","last_fullsized":"2024-04-25T01:43:34.734853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:19.180919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"30'197","reported_seq":230,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.885409+0000","last_change":"2024-04-25T01:39:24.387941+0000","last_active":"2024-04-25T01:43:46.885409+0000","last_peered":"2024-04-25T01:43:46.885409+0000","last_clean":"2024-04-25T01:43:46.885409+0000","last_became_active":"2024-04-25T01:39:24.387674+0000","last_became_peered":"2024-04-25T01:39:24.387674+0000","last_unstale":"2024-04-25T01:43:46.885409+0000","last_undegraded":"2024-04-25T01:43:46.885409+0000","last_fullsized":"2024-04-25T01:43:46.885409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:05.676143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"30'205","reported_seq":231,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.768022+0000","last_change":"2024-04-25T01:39:33.444917+0000","last_active":"2024-04-25T01:43:34.768022+0000","last_peered":"2024-04-25T01:43:34.768022+0000","last_clean":"2024-04-25T01:43:34.768022+0000","last_became_active":"2024-04-25T01:39:33.444636+0000","last_became_peered":"2024-04-25T01:39:33.444636+0000","last_unstale":"2024-04-25T01:43:34.768022+0000","last_undegraded":"2024-04-25T01:43:34.768022+0000","last_fullsized":"2024-04-25T01:43:34.768022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:31.531502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"30'159","reported_seq":192,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.895208+0000","last_change":"2024-04-25T01:39:24.399950+0000","last_active":"2024-04-25T01:43:46.895208+0000","last_peered":"2024-04-25T01:43:46.895208+0000","last_clean":"2024-04-25T01:43:46.895208+0000","last_became_active":"2024-04-25T01:39:24.399701+0000","last_became_peered":"2024-04-25T01:39:24.399701+0000","last_unstale":"2024-04-25T01:43:46.895208+0000","last_undegraded":"2024-04-25T01:43:46.895208+0000","last_fullsized":"2024-04-25T01:43:46.895208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:49.618370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"30'193","reported_seq":219,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.907697+0000","last_change":"2024-04-25T01:39:33.440936+0000","last_active":"2024-04-25T01:43:34.907697+0000","last_peered":"2024-04-25T01:43:34.907697+0000","last_clean":"2024-04-25T01:43:34.907697+0000","last_became_active":"2024-04-25T01:39:33.440679+0000","last_became_peered":"2024-04-25T01:39:33.440679+0000","last_unstale":"2024-04-25T01:43:34.907697+0000","last_undegraded":"2024-04-25T01:43:34.907697+0000","last_fullsized":"2024-04-25T01:43:34.907697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:08:53.629572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"30'177","reported_seq":210,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.876988+0000","last_change":"2024-04-25T01:39:24.380318+0000","last_active":"2024-04-25T01:43:46.876988+0000","last_peered":"2024-04-25T01:43:46.876988+0000","last_clean":"2024-04-25T01:43:46.876988+0000","last_became_active":"2024-04-25T01:39:24.379573+0000","last_became_peered":"2024-04-25T01:39:24.379573+0000","last_unstale":"2024-04-25T01:43:46.876988+0000","last_undegraded":"2024-04-25T01:43:46.876988+0000","last_fullsized":"2024-04-25T01:43:46.876988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:12.089917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"30'176","reported_seq":201,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.756355+0000","last_change":"2024-04-25T01:39:33.426380+0000","last_active":"2024-04-25T01:43:34.756355+0000","last_peered":"2024-04-25T01:43:34.756355+0000","last_clean":"2024-04-25T01:43:34.756355+0000","last_became_active":"2024-04-25T01:39:33.426090+0000","last_became_peered":"2024-04-25T01:39:33.426090+0000","last_unstale":"2024-04-25T01:43:34.756355+0000","last_undegraded":"2024-04-25T01:43:34.756355+0000","last_fullsized":"2024-04-25T01:43:34.756355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:34.329217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"30'192","reported_seq":226,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.896768+0000","last_change":"2024-04-25T01:39:24.398726+0000","last_active":"2024-04-25T01:43:46.896768+0000","last_peered":"2024-04-25T01:43:46.896768+0000","last_clean":"2024-04-25T01:43:46.896768+0000","last_became_active":"2024-04-25T01:39:24.398449+0000","last_became_peered":"2024-04-25T01:39:24.398449+0000","last_unstale":"2024-04-25T01:43:46.896768+0000","last_undegraded":"2024-04-25T01:43:46.896768+0000","last_fullsized":"2024-04-25T01:43:46.896768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:41:38.230939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"30'187","reported_seq":212,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.731406+0000","last_change":"2024-04-25T01:39:33.436488+0000","last_active":"2024-04-25T01:43:34.731406+0000","last_peered":"2024-04-25T01:43:34.731406+0000","last_clean":"2024-04-25T01:43:34.731406+0000","last_became_active":"2024-04-25T01:39:33.436224+0000","last_became_peered":"2024-04-25T01:39:33.436224+0000","last_unstale":"2024-04-25T01:43:34.731406+0000","last_undegraded":"2024-04-25T01:43:34.731406+0000","last_fullsized":"2024-04-25T01:43:34.731406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:38.227206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"30'175","reported_seq":209,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.871923+0000","last_change":"2024-04-25T01:39:24.386909+0000","last_active":"2024-04-25T01:43:46.871923+0000","last_peered":"2024-04-25T01:43:46.871923+0000","last_clean":"2024-04-25T01:43:46.871923+0000","last_became_active":"2024-04-25T01:39:24.386568+0000","last_became_peered":"2024-04-25T01:39:24.386568+0000","last_unstale":"2024-04-25T01:43:46.871923+0000","last_undegraded":"2024-04-25T01:43:46.871923+0000","last_fullsized":"2024-04-25T01:43:46.871923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:29.904064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"30'223","reported_seq":248,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.755445+0000","last_change":"2024-04-25T01:39:33.440753+0000","last_active":"2024-04-25T01:43:34.755445+0000","last_peered":"2024-04-25T01:43:34.755445+0000","last_clean":"2024-04-25T01:43:34.755445+0000","last_became_active":"2024-04-25T01:39:33.440480+0000","last_became_peered":"2024-04-25T01:39:33.440480+0000","last_unstale":"2024-04-25T01:43:34.755445+0000","last_undegraded":"2024-04-25T01:43:34.755445+0000","last_fullsized":"2024-04-25T01:43:34.755445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:18.113293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"30'159","reported_seq":193,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.877584+0000","last_change":"2024-04-25T01:39:24.386803+0000","last_active":"2024-04-25T01:43:46.877584+0000","last_peered":"2024-04-25T01:43:46.877584+0000","last_clean":"2024-04-25T01:43:46.877584+0000","last_became_active":"2024-04-25T01:39:24.386531+0000","last_became_peered":"2024-04-25T01:39:24.386531+0000","last_unstale":"2024-04-25T01:43:46.877584+0000","last_undegraded":"2024-04-25T01:43:46.877584+0000","last_fullsized":"2024-04-25T01:43:46.877584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:19.160345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"30'214","reported_seq":239,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.689935+0000","last_change":"2024-04-25T01:39:33.436433+0000","last_active":"2024-04-25T01:43:34.689935+0000","last_peered":"2024-04-25T01:43:34.689935+0000","last_clean":"2024-04-25T01:43:34.689935+0000","last_became_active":"2024-04-25T01:39:33.436134+0000","last_became_peered":"2024-04-25T01:39:33.436134+0000","last_unstale":"2024-04-25T01:43:34.689935+0000","last_undegraded":"2024-04-25T01:43:34.689935+0000","last_fullsized":"2024-04-25T01:43:34.689935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:08:30.641790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"30'170","reported_seq":204,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.888991+0000","last_change":"2024-04-25T01:39:24.396231+0000","last_active":"2024-04-25T01:43:46.888991+0000","last_peered":"2024-04-25T01:43:46.888991+0000","last_clean":"2024-04-25T01:43:46.888991+0000","last_became_active":"2024-04-25T01:39:24.395958+0000","last_became_peered":"2024-04-25T01:39:24.395958+0000","last_unstale":"2024-04-25T01:43:46.888991+0000","last_undegraded":"2024-04-25T01:43:46.888991+0000","last_fullsized":"2024-04-25T01:43:46.888991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:54.898765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12101,"ondisk_log_size":12101,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":7961050,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":239,"num_read_kb":8015,"num_write":3914,"num_write_kb":11480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15990784,"data_stored":15922100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3914,"ondisk_log_size":3914,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11253,"ondisk_log_size":11253,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8001487,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":165,"num_read_kb":215,"num_write":3941,"num_write_kb":11543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16072704,"data_stored":16002974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3930,"ondisk_log_size":3930,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67676,"kb_used_data":4628,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94304164,"statfs":{"total":96636764160,"available":96567463936,"internally_reserved":0,"allocated":4739072,"data_stored":4538211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":64551370},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61976,"kb_used_data":4432,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94309864,"statfs":{"total":96636764160,"available":96573300736,"internally_reserved":0,"allocated":4538368,"data_stored":4337555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574907,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62040,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94309800,"statfs":{"total":96636764160,"available":96573235200,"internally_reserved":0,"allocated":344064,"data_stored":143129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574907,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67072,"kb_used_data":4024,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94304768,"statfs":{"total":96636764160,"available":96568082432,"internally_reserved":0,"allocated":4120576,"data_stored":3907469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123396,"kb_used_data":15932,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94248444,"statfs":{"total":96636764160,"available":96510406656,"internally_reserved":0,"allocated":16314368,"data_stored":16102349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":110033351},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574907,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57872,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313968,"statfs":{"total":96636764160,"available":96577503232,"internally_reserved":0,"allocated":335872,"data_stored":142538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49500,"kb_used_data":4436,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94322340,"statfs":{"total":96636764160,"available":96586076160,"internally_reserved":0,"allocated":4542464,"data_stored":4337121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574907,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62616,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94309224,"statfs":{"total":96636764160,"available":96572645376,"internally_reserved":0,"allocated":933888,"data_stored":732969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8015872,"data_stored":8000689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3813376,"data_stored":3805790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4194998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7974912,"data_stored":7959870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3780608,"data_stored":3765380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T01:43:50.640 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T01:43:50.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.778+0000 7ffa61e09640 1 Processor -- start 2024-04-25T01:43:50.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.778+0000 7ffa61e09640 1 -- start start 2024-04-25T01:43:50.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.779+0000 7ffa61e09640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa5c156c80 0x7ffa5c0c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:50.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.779+0000 7ffa61e09640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa5c157130 con 0x7ffa5c150090 2024-04-25T01:43:50.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.779+0000 7ffa61e09640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa5c0c9de0 con 0x7ffa5c06c280 2024-04-25T01:43:50.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.779+0000 7ffa61e09640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ffa5c06b830 con 0x7ffa5c156c80 2024-04-25T01:43:50.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.779+0000 7ffa5b7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ffa5c150090 0x7ffa5c0c8200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52262/0 (socket says 172.21.15.77:52262) 2024-04-25T01:43:50.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.779+0000 7ffa5b7fe640 1 -- 172.21.15.77:0/3773235253 learned_addr learned my addr 172.21.15.77:0/3773235253 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:43:50.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.780+0000 7ffa5a7fc640 1 -- 172.21.15.77:0/3773235253 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2256714732 0 0) 0x7ffa4c001110 con 0x7ffa5c150090 2024-04-25T01:43:50.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.780+0000 7ffa5a7fc640 1 -- 172.21.15.77:0/3773235253 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa44003520 con 0x7ffa5c150090 2024-04-25T01:43:50.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.780+0000 7ffa5affd640 1 --2- 172.21.15.77:0/3773235253 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa5c156c80 0x7ffa5c0c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:50.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.780+0000 7ffa5a7fc640 1 -- 172.21.15.77:0/3773235253 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1220743623 0 0) 0x7ffa44003520 con 0x7ffa5c150090 2024-04-25T01:43:50.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.780+0000 7ffa5a7fc640 1 -- 172.21.15.77:0/3773235253 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa5c156c80 msgr2=0x7ffa5c0c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:50.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.780+0000 7ffa5a7fc640 1 --2- 172.21.15.77:0/3773235253 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa5c156c80 0x7ffa5c0c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.780+0000 7ffa5a7fc640 1 -- 172.21.15.77:0/3773235253 >> v1:172.21.15.121:6789/0 conn(0x7ffa5c06c280 legacy=0x7ffa5c0c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:50.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.780+0000 7ffa5a7fc640 1 -- 172.21.15.77:0/3773235253 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa5c0c89c0 con 0x7ffa5c150090 2024-04-25T01:43:50.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.780+0000 7ffa5a7fc640 1 -- 172.21.15.77:0/3773235253 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7ffa4c001840 con 0x7ffa5c150090 2024-04-25T01:43:50.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.780+0000 7ffa5a7fc640 1 -- 172.21.15.77:0/3773235253 >> v1:172.21.15.77:6789/0 conn(0x7ffa5c150090 legacy=0x7ffa5c0c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:50.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.780+0000 7ffa5a7fc640 1 --2- 172.21.15.77:0/3773235253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa440039e0 0x7ffa44003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:50.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.780+0000 7ffa5a7fc640 1 --2- 172.21.15.77:0/3773235253 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa5c156c80 0x7ffa44004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:50.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.780+0000 7ffa5a7fc640 1 --2- 172.21.15.77:0/3773235253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa44004d40 0x7ffa440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:50.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.780+0000 7ffa5a7fc640 1 -- 172.21.15.77:0/3773235253 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5c06b830 con 0x7ffa440039e0 2024-04-25T01:43:50.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.780+0000 7ffa5a7fc640 1 -- 172.21.15.77:0/3773235253 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4400bb50 con 0x7ffa44004d40 2024-04-25T01:43:50.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.780+0000 7ffa5a7fc640 1 -- 172.21.15.77:0/3773235253 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ffa4400bd50 con 0x7ffa5c156c80 2024-04-25T01:43:50.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.780+0000 7ffa5b7fe640 1 --2- 172.21.15.77:0/3773235253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa440039e0 0x7ffa44003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:50.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.780+0000 7ffa5affd640 1 --2- 172.21.15.77:0/3773235253 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa5c156c80 0x7ffa44004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:50.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.780+0000 7ffa5bfff640 1 --2- 172.21.15.77:0/3773235253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa44004d40 0x7ffa440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:50.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.780+0000 7ffa5b7fe640 1 -- 172.21.15.77:0/3773235253 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa5c156c80 msgr2=0x7ffa44004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:50.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.780+0000 7ffa5b7fe640 1 --2- 172.21.15.77:0/3773235253 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa5c156c80 0x7ffa44004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.780+0000 7ffa5b7fe640 1 -- 172.21.15.77:0/3773235253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa44004d40 msgr2=0x7ffa440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:50.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.780+0000 7ffa5b7fe640 1 --2- 172.21.15.77:0/3773235253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa44004d40 0x7ffa440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.780+0000 7ffa5b7fe640 1 -- 172.21.15.77:0/3773235253 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa44003520 con 0x7ffa440039e0 2024-04-25T01:43:50.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.780+0000 7ffa5bfff640 1 --2- 172.21.15.77:0/3773235253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa44004d40 0x7ffa440051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:43:50.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.781+0000 7ffa5b7fe640 1 --2- 172.21.15.77:0/3773235253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa440039e0 0x7ffa44003e20 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00c4c0 tx=0x7ffa44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745e084bc16f0994 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:50.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.781+0000 7ffa5a7fc640 1 -- 172.21.15.77:0/3773235253 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c00c0e0 con 0x7ffa440039e0 2024-04-25T01:43:50.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.781+0000 7ffa5a7fc640 1 -- 172.21.15.77:0/3773235253 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa4c034070 con 0x7ffa440039e0 2024-04-25T01:43:50.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.781+0000 7ffa5a7fc640 1 -- 172.21.15.77:0/3773235253 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c005d30 con 0x7ffa440039e0 2024-04-25T01:43:50.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.782+0000 7ffa61e09640 1 -- 172.21.15.77:0/3773235253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa440039e0 msgr2=0x7ffa44003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:50.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.782+0000 7ffa61e09640 1 --2- 172.21.15.77:0/3773235253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa440039e0 0x7ffa44003e20 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00c4c0 tx=0x7ffa44005830 comp rx=0 tx=0).stop 2024-04-25T01:43:50.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.782+0000 7ffa5bfff640 1 -- 172.21.15.77:0/3773235253 reap_dead start 2024-04-25T01:43:50.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.782+0000 7ffa61e09640 1 -- 172.21.15.77:0/3773235253 shutdown_connections 2024-04-25T01:43:50.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.782+0000 7ffa61e09640 1 -- 172.21.15.77:0/3773235253 >> 172.21.15.77:0/3773235253 conn(0x7ffa5c0ad4d0 msgr2=0x7ffa5c0ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:50.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.782+0000 7ffa61e09640 1 -- 172.21.15.77:0/3773235253 shutdown_connections 2024-04-25T01:43:50.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.782+0000 7ffa61e09640 1 -- 172.21.15.77:0/3773235253 wait complete. 2024-04-25T01:43:50.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.783+0000 7ffa61e09640 1 Processor -- start 2024-04-25T01:43:50.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.783+0000 7ffa61e09640 1 -- start start 2024-04-25T01:43:50.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.783+0000 7ffa61e09640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa440039e0 0x7ffa5c1594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:50.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.783+0000 7ffa61e09640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa5c15a190 0x7ffa5c1528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.783+0000 7ffa61e09640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa5c0ae5c0 0x7ffa5c14c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.783+0000 7ffa61e09640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5c06bd60 con 0x7ffa5c0ae5c0 2024-04-25T01:43:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.783+0000 7ffa61e09640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5c06ba80 con 0x7ffa5c15a190 2024-04-25T01:43:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.783+0000 7ffa61e09640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ffa5c0c6a30 con 0x7ffa440039e0 2024-04-25T01:43:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.784+0000 7ffa5bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa5c0ae5c0 0x7ffa5c14c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.784+0000 7ffa5bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa5c0ae5c0 0x7ffa5c14c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59058/0 (socket says 172.21.15.77:59058) 2024-04-25T01:43:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.784+0000 7ffa5bfff640 1 -- 172.21.15.77:0/1560453715 learned_addr learned my addr 172.21.15.77:0/1560453715 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.784+0000 7ffa5b7fe640 1 --2- 172.21.15.77:0/1560453715 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa440039e0 0x7ffa5c1594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.784+0000 7ffa5bfff640 1 -- 172.21.15.77:0/1560453715 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa440039e0 msgr2=0x7ffa5c1594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.784+0000 7ffa5bfff640 1 --2- 172.21.15.77:0/1560453715 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa440039e0 0x7ffa5c1594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.784+0000 7ffa5bfff640 1 -- 172.21.15.77:0/1560453715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa5c15a190 msgr2=0x7ffa5c1528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.784+0000 7ffa5bfff640 1 --2- 172.21.15.77:0/1560453715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa5c15a190 0x7ffa5c1528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.784+0000 7ffa5bfff640 1 -- 172.21.15.77:0/1560453715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa5c1ef8f0 con 0x7ffa5c0ae5c0 2024-04-25T01:43:50.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.784+0000 7ffa5bfff640 1 --2- 172.21.15.77:0/1560453715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa5c0ae5c0 0x7ffa5c14c070 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c157060 tx=0x7ffa5400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:50.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.784+0000 7ffa43fff640 1 -- 172.21.15.77:0/1560453715 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa54019070 con 0x7ffa5c0ae5c0 2024-04-25T01:43:50.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.784+0000 7ffa43fff640 1 -- 172.21.15.77:0/1560453715 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa54006b50 con 0x7ffa5c0ae5c0 2024-04-25T01:43:50.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.784+0000 7ffa61e09640 1 -- 172.21.15.77:0/1560453715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa5c1531b0 con 0x7ffa5c0ae5c0 2024-04-25T01:43:50.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.784+0000 7ffa43fff640 1 -- 172.21.15.77:0/1560453715 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa54003970 con 0x7ffa5c0ae5c0 2024-04-25T01:43:50.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.784+0000 7ffa61e09640 1 -- 172.21.15.77:0/1560453715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa5c0b12e0 con 0x7ffa5c0ae5c0 2024-04-25T01:43:50.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.785+0000 7ffa61e09640 1 -- 172.21.15.77:0/1560453715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa5c04f500 con 0x7ffa5c0ae5c0 2024-04-25T01:43:50.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.785+0000 7ffa43fff640 1 -- 172.21.15.77:0/1560453715 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffa5401c070 con 0x7ffa5c0ae5c0 2024-04-25T01:43:50.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.786+0000 7ffa43fff640 1 --2- 172.21.15.77:0/1560453715 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ffa4806be60 0x7ffa4806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:50.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.786+0000 7ffa43fff640 1 -- 172.21.15.77:0/1560453715 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7ffa5408a9a0 con 0x7ffa5c0ae5c0 2024-04-25T01:43:50.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.786+0000 7ffa5b7fe640 1 --2- 172.21.15.77:0/1560453715 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ffa4806be60 0x7ffa4806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:50.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.786+0000 7ffa5b7fe640 1 --2- 172.21.15.77:0/1560453715 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ffa4806be60 0x7ffa4806e320 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00c4c0 tx=0x7ffa4c009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:50.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.790+0000 7ffa43fff640 1 -- 172.21.15.77:0/1560453715 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ffa54058e90 con 0x7ffa5c0ae5c0 2024-04-25T01:43:50.847 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:43:50.850 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:43:50.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.969+0000 7ffa61e09640 1 -- 172.21.15.77:0/1560453715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffa5c06cec0 con 0x7ffa5c0ae5c0 2024-04-25T01:43:50.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.971+0000 7ffa43fff640 1 -- 172.21.15.77:0/1560453715 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+21172 (secure 0 0 0) 0x7ffa54058790 con 0x7ffa5c0ae5c0 2024-04-25T01:43:50.962 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:43:50.962 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":30,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:43:29.392580+0000","last_up_change":"2024-04-25T01:39:10.729600+0000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T01:39:11.681151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T01:39:21.606752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T01:39:22.677664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T01:39:30.501700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T01:39:31.740717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6811","nonce":3366980158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6817","nonce":3366980158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6828","nonce":3366980158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6825","nonce":3366980158}]},"public_addr":"172.21.15.77:6811/3366980158","cluster_addr":"172.21.15.77:6817/3366980158","heartbeat_back_addr":"172.21.15.77:6828/3366980158","heartbeat_front_addr":"172.21.15.77:6825/3366980158","state":["exists","up"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6801","nonce":3971619298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6803","nonce":3971619298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6807","nonce":3971619298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6805","nonce":3971619298}]},"public_addr":"172.21.15.77:6801/3971619298","cluster_addr":"172.21.15.77:6803/3971619298","heartbeat_back_addr":"172.21.15.77:6807/3971619298","heartbeat_front_addr":"172.21.15.77:6805/3971619298","state":["exists","up"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6810","nonce":4103452689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6813","nonce":4103452689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6823","nonce":4103452689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6818","nonce":4103452689}]},"public_addr":"172.21.15.77:6810/4103452689","cluster_addr":"172.21.15.77:6813/4103452689","heartbeat_back_addr":"172.21.15.77:6823/4103452689","heartbeat_front_addr":"172.21.15.77:6818/4103452689","state":["exists","up"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6819","nonce":217398906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6824","nonce":217398906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6831","nonce":217398906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6829","nonce":217398906}]},"public_addr":"172.21.15.77:6819/217398906","cluster_addr":"172.21.15.77:6824/217398906","heartbeat_back_addr":"172.21.15.77:6831/217398906","heartbeat_front_addr":"172.21.15.77:6829/217398906","state":["exists","up"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6801","nonce":2565483070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6803","nonce":2565483070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6810","nonce":2565483070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6806","nonce":2565483070}]},"public_addr":"172.21.15.121:6801/2565483070","cluster_addr":"172.21.15.121:6803/2565483070","heartbeat_back_addr":"172.21.15.121:6810/2565483070","heartbeat_front_addr":"172.21.15.121:6806/2565483070","state":["exists","up"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6807","nonce":2785294752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6809","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6811","nonce":2785294752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6815","nonce":2785294752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6813","nonce":2785294752}]},"public_addr":"172.21.15.121:6807/2785294752","cluster_addr":"172.21.15.121:6811/2785294752","heartbeat_back_addr":"172.21.15.121:6815/2785294752","heartbeat_front_addr":"172.21.15.121:6813/2785294752","state":["exists","up"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6820","nonce":523906818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6824","nonce":523906818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6831","nonce":523906818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6828","nonce":523906818}]},"public_addr":"172.21.15.121:6820/523906818","cluster_addr":"172.21.15.121:6824/523906818","heartbeat_back_addr":"172.21.15.121:6831/523906818","heartbeat_front_addr":"172.21.15.121:6828/523906818","state":["exists","up"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6817","nonce":1683602459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6819","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6821","nonce":1683602459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6829","nonce":1683602459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6823","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6825","nonce":1683602459}]},"public_addr":"172.21.15.121:6817/1683602459","cluster_addr":"172.21.15.121:6821/1683602459","heartbeat_back_addr":"172.21.15.121:6829/1683602459","heartbeat_front_addr":"172.21.15.121:6825/1683602459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.839443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.818842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.776243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.793085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.822396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.907311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.918374+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.848430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:6837/2398109146":"2024-04-26T01:43:29.392514+0000","172.21.15.77:6836/2398109146":"2024-04-26T01:43:29.392514+0000","172.21.15.121:6834/1039950655":"2024-04-26T01:42:04.378069+0000","172.21.15.77:6835/1958322306":"2024-04-26T01:41:34.373188+0000","172.21.15.77:6834/1958322306":"2024-04-26T01:41:34.373188+0000","172.21.15.121:6835/2449150984":"2024-04-26T01:41:34.373282+0000","172.21.15.121:6832/1039950655":"2024-04-26T01:42:04.378069+0000","172.21.15.121:6833/2449150984":"2024-04-26T01:41:34.373282+0000","172.21.15.77:6837/3454203695":"2024-04-26T01:40:59.368156+0000","172.21.15.77:6836/3454203695":"2024-04-26T01:40:59.368156+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:43:50.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.972+0000 7ffa61e09640 1 -- 172.21.15.77:0/1560453715 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ffa4806be60 msgr2=0x7ffa4806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:50.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.972+0000 7ffa61e09640 1 --2- 172.21.15.77:0/1560453715 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ffa4806be60 0x7ffa4806e320 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00c4c0 tx=0x7ffa4c009030 comp rx=0 tx=0).stop 2024-04-25T01:43:50.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.972+0000 7ffa61e09640 1 -- 172.21.15.77:0/1560453715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa5c0ae5c0 msgr2=0x7ffa5c14c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:50.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.972+0000 7ffa61e09640 1 --2- 172.21.15.77:0/1560453715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa5c0ae5c0 0x7ffa5c14c070 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c157060 tx=0x7ffa5400eb90 comp rx=0 tx=0).stop 2024-04-25T01:43:50.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.973+0000 7ffa61e09640 1 -- 172.21.15.77:0/1560453715 shutdown_connections 2024-04-25T01:43:50.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.973+0000 7ffa61e09640 1 --2- 172.21.15.77:0/1560453715 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ffa4806be60 0x7ffa4806e320 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.973+0000 7ffa61e09640 1 --2- 172.21.15.77:0/1560453715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa5c0ae5c0 0x7ffa5c14c070 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.973+0000 7ffa61e09640 1 --2- 172.21.15.77:0/1560453715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa5c15a190 0x7ffa5c1528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.973+0000 7ffa61e09640 1 --2- 172.21.15.77:0/1560453715 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa440039e0 0x7ffa5c1594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:50.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.973+0000 7ffa61e09640 1 -- 172.21.15.77:0/1560453715 >> 172.21.15.77:0/1560453715 conn(0x7ffa5c0ad4d0 msgr2=0x7ffa5c0ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:50.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.973+0000 7ffa61e09640 1 -- 172.21.15.77:0/1560453715 shutdown_connections 2024-04-25T01:43:50.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:50.973+0000 7ffa61e09640 1 -- 172.21.15.77:0/1560453715 wait complete. 2024-04-25T01:43:51.975 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T01:43:51.976 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T01:43:52.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.099+0000 7f10bd038640 1 Processor -- start 2024-04-25T01:43:52.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.099+0000 7f10bd038640 1 -- start start 2024-04-25T01:43:52.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.100+0000 7f10bd038640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f10b806d0a0 0x7f10b8152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:52.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.100+0000 7f10bd038640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f10b80c1e80 0x7f10b806d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:52.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.100+0000 7f10bd038640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10b80c2f90 con 0x7f10b8154360 2024-04-25T01:43:52.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.100+0000 7f10bd038640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f10b80c2380 con 0x7f10b806d0a0 2024-04-25T01:43:52.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.100+0000 7f10bd038640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f10b80c2660 con 0x7f10b80c1e80 2024-04-25T01:43:52.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.100+0000 7f10b759e640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f10b8154360 0x7f10b8154810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52266/0 (socket says 172.21.15.77:52266) 2024-04-25T01:43:52.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.100+0000 7f10b759e640 1 -- 172.21.15.77:0/1332266872 learned_addr learned my addr 172.21.15.77:0/1332266872 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:43:52.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.100+0000 7f10b6d9d640 1 --2- 172.21.15.77:0/1332266872 >> v2:172.21.15.121:3300/0 conn(0x7f10b806d0a0 0x7f10b8152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:52.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.100+0000 7f10b5d9b640 1 -- 172.21.15.77:0/1332266872 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2401629968 0 0) 0x7f10b80c2f90 con 0x7f10b8154360 2024-04-25T01:43:52.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.100+0000 7f10b5d9b640 1 -- 172.21.15.77:0/1332266872 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10a4003520 con 0x7f10b8154360 2024-04-25T01:43:52.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.100+0000 7f10b659c640 1 --2- 172.21.15.77:0/1332266872 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f10b80c1e80 0x7f10b806d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:52.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.101+0000 7f10b6d9d640 1 -- 172.21.15.77:0/1332266872 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f10b80c1e80 msgr2=0x7f10b806d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:52.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.101+0000 7f10b6d9d640 1 --2- 172.21.15.77:0/1332266872 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f10b80c1e80 0x7f10b806d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.101+0000 7f10b6d9d640 1 -- 172.21.15.77:0/1332266872 >> v1:172.21.15.77:6789/0 conn(0x7f10b8154360 legacy=0x7f10b8154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:52.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.101+0000 7f10b5d9b640 1 -- 172.21.15.77:0/1332266872 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1642716935 0 0) 0x7f10a4003520 con 0x7f10b8154360 2024-04-25T01:43:52.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.101+0000 7f10b6d9d640 1 -- 172.21.15.77:0/1332266872 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b80c2940 con 0x7f10b806d0a0 2024-04-25T01:43:52.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.101+0000 7f10b659c640 1 --2- 172.21.15.77:0/1332266872 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f10b80c1e80 0x7f10b806d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:43:52.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.101+0000 7f10b6d9d640 1 --2- 172.21.15.77:0/1332266872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10b806d0a0 0x7f10b8152b90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f10a00097a0 tx=0x7f10a002a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d0cb67a270f376d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:52.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.102+0000 7f10b5d9b640 1 -- 172.21.15.77:0/1332266872 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a0037070 con 0x7f10b806d0a0 2024-04-25T01:43:52.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.102+0000 7f10b5d9b640 1 -- 172.21.15.77:0/1332266872 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10a002ab10 con 0x7f10b806d0a0 2024-04-25T01:43:52.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.102+0000 7f10b5d9b640 1 -- 172.21.15.77:0/1332266872 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b00019f0 con 0x7f10b806d0a0 2024-04-25T01:43:52.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.102+0000 7f10bd038640 1 -- 172.21.15.77:0/1332266872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10b806d0a0 msgr2=0x7f10b8152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:52.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.102+0000 7f10bd038640 1 --2- 172.21.15.77:0/1332266872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10b806d0a0 0x7f10b8152b90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f10a00097a0 tx=0x7f10a002a080 comp rx=0 tx=0).stop 2024-04-25T01:43:52.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.102+0000 7f10bd038640 1 -- 172.21.15.77:0/1332266872 shutdown_connections 2024-04-25T01:43:52.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.102+0000 7f10bd038640 1 --2- 172.21.15.77:0/1332266872 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f10b80c1e80 0x7f10b806d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.102+0000 7f10bd038640 1 --2- 172.21.15.77:0/1332266872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10b806d0a0 0x7f10b8152b90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.102+0000 7f10bd038640 1 -- 172.21.15.77:0/1332266872 >> 172.21.15.77:0/1332266872 conn(0x7f10b80a9230 msgr2=0x7f10b80a9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:52.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.102+0000 7f10bd038640 1 -- 172.21.15.77:0/1332266872 shutdown_connections 2024-04-25T01:43:52.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.102+0000 7f10bd038640 1 -- 172.21.15.77:0/1332266872 wait complete. 2024-04-25T01:43:52.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.104+0000 7f10bd038640 1 Processor -- start 2024-04-25T01:43:52.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.104+0000 7f10bd038640 1 -- start start 2024-04-25T01:43:52.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.104+0000 7f10bd038640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10b806d0a0 0x7f10b80ab370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:52.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.104+0000 7f10bd038640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f10b80c1e80 0x7f10b80aa610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:52.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.104+0000 7f10bd038640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10b8154360 0x7f10b80aab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:52.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.104+0000 7f10bd038640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f10b8155e90 con 0x7f10b8154360 2024-04-25T01:43:52.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.104+0000 7f10bd038640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f10b806c4a0 con 0x7f10b806d0a0 2024-04-25T01:43:52.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.104+0000 7f10bd038640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f10b8154f20 con 0x7f10b80c1e80 2024-04-25T01:43:52.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.104+0000 7f10b759e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10b8154360 0x7f10b80aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:52.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.104+0000 7f10b759e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10b8154360 0x7f10b80aab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59072/0 (socket says 172.21.15.77:59072) 2024-04-25T01:43:52.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.104+0000 7f10b759e640 1 -- 172.21.15.77:0/1622790150 learned_addr learned my addr 172.21.15.77:0/1622790150 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:52.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.105+0000 7f10b659c640 1 --2- 172.21.15.77:0/1622790150 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f10b80c1e80 0x7f10b80aa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:52.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.105+0000 7f10b6d9d640 1 --2- 172.21.15.77:0/1622790150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10b806d0a0 0x7f10b80ab370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:52.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.105+0000 7f10b759e640 1 -- 172.21.15.77:0/1622790150 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f10b80c1e80 msgr2=0x7f10b80aa610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:52.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.105+0000 7f10b759e640 1 --2- 172.21.15.77:0/1622790150 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f10b80c1e80 0x7f10b80aa610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.105+0000 7f10b759e640 1 -- 172.21.15.77:0/1622790150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10b806d0a0 msgr2=0x7f10b80ab370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:52.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.105+0000 7f10b759e640 1 --2- 172.21.15.77:0/1622790150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10b806d0a0 0x7f10b80ab370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.105+0000 7f10b759e640 1 -- 172.21.15.77:0/1622790150 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b80c1100 con 0x7f10b8154360 2024-04-25T01:43:52.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.105+0000 7f10b759e640 1 --2- 172.21.15.77:0/1622790150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10b8154360 0x7f10b80aab50 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f10b000cc30 tx=0x7f10b000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:52.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.105+0000 7f10af7fe640 1 -- 172.21.15.77:0/1622790150 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b0017070 con 0x7f10b8154360 2024-04-25T01:43:52.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.105+0000 7f10af7fe640 1 -- 172.21.15.77:0/1622790150 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10b000ce40 con 0x7f10b8154360 2024-04-25T01:43:52.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.105+0000 7f10af7fe640 1 -- 172.21.15.77:0/1622790150 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b0012600 con 0x7f10b8154360 2024-04-25T01:43:52.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.105+0000 7f10bd038640 1 -- 172.21.15.77:0/1622790150 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b80c13e0 con 0x7f10b8154360 2024-04-25T01:43:52.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.105+0000 7f10bd038640 1 -- 172.21.15.77:0/1622790150 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b80ab8b0 con 0x7f10b8154360 2024-04-25T01:43:52.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.106+0000 7f10bd038640 1 -- 172.21.15.77:0/1622790150 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f10b814db00 con 0x7f10b8154360 2024-04-25T01:43:52.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.107+0000 7f10af7fe640 1 -- 172.21.15.77:0/1622790150 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f10b001a070 con 0x7f10b8154360 2024-04-25T01:43:52.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.107+0000 7f10af7fe640 1 --2- 172.21.15.77:0/1622790150 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f109806be30 0x7f109806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:52.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.107+0000 7f10af7fe640 1 -- 172.21.15.77:0/1622790150 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7f10b008b130 con 0x7f10b8154360 2024-04-25T01:43:52.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.107+0000 7f10b6d9d640 1 --2- 172.21.15.77:0/1622790150 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f109806be30 0x7f109806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:52.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.107+0000 7f10af7fe640 1 --2- 172.21.15.77:0/1622790150 >> [v2:172.21.15.77:6809/3366980158,v1:172.21.15.77:6811/3366980158] conn(0x7f1098076b60 0x7f1098078fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:52.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.107+0000 7f10af7fe640 1 -- 172.21.15.77:0/1622790150 --> [v2:172.21.15.77:6809/3366980158,v1:172.21.15.77:6811/3366980158] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f10b000de50 con 0x7f1098076b60 2024-04-25T01:43:52.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.107+0000 7f10af7fe640 1 -- 172.21.15.77:0/1622790150 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f10b0092050 con 0x7f10b8154360 2024-04-25T01:43:52.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.107+0000 7f10b659c640 1 --2- 172.21.15.77:0/1622790150 >> [v2:172.21.15.77:6809/3366980158,v1:172.21.15.77:6811/3366980158] conn(0x7f1098076b60 0x7f1098078fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:52.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.108+0000 7f10b6d9d640 1 --2- 172.21.15.77:0/1622790150 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f109806be30 0x7f109806e2f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f10a0034000 tx=0x7f10a002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:52.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.108+0000 7f10b659c640 1 --2- 172.21.15.77:0/1622790150 >> [v2:172.21.15.77:6809/3366980158,v1:172.21.15.77:6811/3366980158] conn(0x7f1098076b60 0x7f1098078fe0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:52.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.108+0000 7f10af7fe640 1 -- 172.21.15.77:0/1622790150 <== osd.0 v2:172.21.15.77:6809/3366980158 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f10b000de50 con 0x7f1098076b60 2024-04-25T01:43:52.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.122+0000 7f10bd038640 1 -- 172.21.15.77:0/1622790150 --> [v2:172.21.15.77:6809/3366980158,v1:172.21.15.77:6811/3366980158] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f10b8075d10 con 0x7f1098076b60 2024-04-25T01:43:52.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.122+0000 7f10af7fe640 1 -- 172.21.15.77:0/1622790150 <== osd.0 v2:172.21.15.77:6809/3366980158 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f10b8075d10 con 0x7f1098076b60 2024-04-25T01:43:52.113 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T01:43:52.113 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T01:43:52.113 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T01:43:52.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.122+0000 7f10bd038640 1 -- 172.21.15.77:0/1622790150 >> [v2:172.21.15.77:6809/3366980158,v1:172.21.15.77:6811/3366980158] conn(0x7f1098076b60 msgr2=0x7f1098078fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:52.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.122+0000 7f10bd038640 1 --2- 172.21.15.77:0/1622790150 >> [v2:172.21.15.77:6809/3366980158,v1:172.21.15.77:6811/3366980158] conn(0x7f1098076b60 0x7f1098078fe0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.122+0000 7f10bd038640 1 -- 172.21.15.77:0/1622790150 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f109806be30 msgr2=0x7f109806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:52.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.122+0000 7f10bd038640 1 --2- 172.21.15.77:0/1622790150 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f109806be30 0x7f109806e2f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f10a0034000 tx=0x7f10a002e000 comp rx=0 tx=0).stop 2024-04-25T01:43:52.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.122+0000 7f10bd038640 1 -- 172.21.15.77:0/1622790150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10b8154360 msgr2=0x7f10b80aab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:52.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.122+0000 7f10bd038640 1 --2- 172.21.15.77:0/1622790150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10b8154360 0x7f10b80aab50 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f10b000cc30 tx=0x7f10b000a430 comp rx=0 tx=0).stop 2024-04-25T01:43:52.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.122+0000 7f10b759e640 1 -- 172.21.15.77:0/1622790150 reap_dead start 2024-04-25T01:43:52.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.122+0000 7f10bd038640 1 -- 172.21.15.77:0/1622790150 shutdown_connections 2024-04-25T01:43:52.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.122+0000 7f10bd038640 1 -- 172.21.15.77:0/1622790150 >> 172.21.15.77:0/1622790150 conn(0x7f10b80a9230 msgr2=0x7f10b80c5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:52.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.122+0000 7f10bd038640 1 -- 172.21.15.77:0/1622790150 shutdown_connections 2024-04-25T01:43:52.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.123+0000 7f10bd038640 1 -- 172.21.15.77:0/1622790150 wait complete. 2024-04-25T01:43:52.126 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T01:43:52.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.235+0000 7fc00044d640 1 Processor -- start 2024-04-25T01:43:52.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.235+0000 7fc00044d640 1 -- start start 2024-04-25T01:43:52.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.236+0000 7fc00044d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbff8153530 0x7fbff80c6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:52.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.236+0000 7fc00044d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbff80bef50 0x7fbff81595f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:52.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.236+0000 7fc00044d640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbff806d110 con 0x7fbff80c97c0 2024-04-25T01:43:52.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.236+0000 7fc00044d640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fbff8153910 con 0x7fbff8153530 2024-04-25T01:43:52.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.236+0000 7fc00044d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fbff8156980 con 0x7fbff80bef50 2024-04-25T01:43:52.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.236+0000 7fbffd9e8640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbff80bef50 0x7fbff81595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:52.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.236+0000 7fbffe1e9640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbff8153530 0x7fbff80c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:52.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.236+0000 7fbffe9ea640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fbff80c97c0 0x7fbff8159b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.77:38996/0 (socket says 172.21.15.77:38996) 2024-04-25T01:43:52.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.236+0000 7fbffd9e8640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbff80bef50 0x7fbff81595f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.77:53182/0 (socket says 172.21.15.77:53182) 2024-04-25T01:43:52.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.236+0000 7fbffe9ea640 1 -- 172.21.15.77:0/325475446 learned_addr learned my addr 172.21.15.77:0/325475446 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:43:52.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.237+0000 7fbffd9e8640 1 -- 172.21.15.77:0/325475446 >> v2:172.21.15.121:3300/0 conn(0x7fbff8153530 msgr2=0x7fbff80c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:52.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.237+0000 7fbffd9e8640 1 --2- 172.21.15.77:0/325475446 >> v2:172.21.15.121:3300/0 conn(0x7fbff8153530 0x7fbff80c6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.237+0000 7fbffd9e8640 1 -- 172.21.15.77:0/325475446 >> v1:172.21.15.121:6789/0 conn(0x7fbff80c97c0 legacy=0x7fbff8159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:52.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.237+0000 7fbffd9e8640 1 -- 172.21.15.77:0/325475446 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff8156c60 con 0x7fbff80bef50 2024-04-25T01:43:52.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.237+0000 7fbffd1e7640 1 -- 172.21.15.77:0/325475446 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2273713521 0 0) 0x7fbff806d110 con 0x7fbff80c97c0 2024-04-25T01:43:52.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.237+0000 7fbffe1e9640 1 --2- 172.21.15.77:0/325475446 >> v2:172.21.15.121:3300/0 conn(0x7fbff8153530 0x7fbff80c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:43:52.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.237+0000 7fbffd9e8640 1 --2- 172.21.15.77:0/325475446 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbff80bef50 0x7fbff81595f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8009790 tx=0x7fbfe802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce03a256e922d5f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:52.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.237+0000 7fbffd1e7640 1 -- 172.21.15.77:0/325475446 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe8037070 con 0x7fbff80bef50 2024-04-25T01:43:52.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.237+0000 7fbffd1e7640 1 -- 172.21.15.77:0/325475446 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfe802ae50 con 0x7fbff80bef50 2024-04-25T01:43:52.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.237+0000 7fbffd1e7640 1 -- 172.21.15.77:0/325475446 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe8032660 con 0x7fbff80bef50 2024-04-25T01:43:52.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.238+0000 7fc00044d640 1 -- 172.21.15.77:0/325475446 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbff80bef50 msgr2=0x7fbff81595f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:52.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.238+0000 7fc00044d640 1 --2- 172.21.15.77:0/325475446 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbff80bef50 0x7fbff81595f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8009790 tx=0x7fbfe802a100 comp rx=0 tx=0).stop 2024-04-25T01:43:52.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.238+0000 7fc00044d640 1 -- 172.21.15.77:0/325475446 shutdown_connections 2024-04-25T01:43:52.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.238+0000 7fc00044d640 1 --2- 172.21.15.77:0/325475446 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbff80bef50 0x7fbff81595f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.238+0000 7fc00044d640 1 --2- 172.21.15.77:0/325475446 >> v2:172.21.15.121:3300/0 conn(0x7fbff8153530 0x7fbff80c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.238+0000 7fc00044d640 1 -- 172.21.15.77:0/325475446 >> 172.21.15.77:0/325475446 conn(0x7fbff80672c0 msgr2=0x7fbff80676d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:52.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.238+0000 7fc00044d640 1 -- 172.21.15.77:0/325475446 shutdown_connections 2024-04-25T01:43:52.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.238+0000 7fc00044d640 1 -- 172.21.15.77:0/325475446 wait complete. 2024-04-25T01:43:52.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.239+0000 7fc00044d640 1 Processor -- start 2024-04-25T01:43:52.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.239+0000 7fc00044d640 1 -- start start 2024-04-25T01:43:52.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.240+0000 7fc00044d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbff80bef50 0x7fbff81e1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:52.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.240+0000 7fc00044d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbff80c97c0 0x7fbff81e1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:52.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.240+0000 7fc00044d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbff8153530 0x7fbff81582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:52.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.240+0000 7fc00044d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbff815a240 con 0x7fbff80bef50 2024-04-25T01:43:52.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.240+0000 7fc00044d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbff80cc250 con 0x7fbff8153530 2024-04-25T01:43:52.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.240+0000 7fc00044d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fbff80c6780 con 0x7fbff80c97c0 2024-04-25T01:43:52.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.240+0000 7fbffe1e9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbff80bef50 0x7fbff81e1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:52.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.240+0000 7fbffe1e9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbff80bef50 0x7fbff81e1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59084/0 (socket says 172.21.15.77:59084) 2024-04-25T01:43:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.240+0000 7fbffe1e9640 1 -- 172.21.15.77:0/2459683082 learned_addr learned my addr 172.21.15.77:0/2459683082 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.240+0000 7fbffd9e8640 1 --2- 172.21.15.77:0/2459683082 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbff80c97c0 0x7fbff81e1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.240+0000 7fbffe9ea640 1 --2- 172.21.15.77:0/2459683082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbff8153530 0x7fbff81582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.240+0000 7fbffe1e9640 1 -- 172.21.15.77:0/2459683082 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbff80c97c0 msgr2=0x7fbff81e1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.240+0000 7fbffe1e9640 1 --2- 172.21.15.77:0/2459683082 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbff80c97c0 0x7fbff81e1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.240+0000 7fbffe1e9640 1 -- 172.21.15.77:0/2459683082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbff8153530 msgr2=0x7fbff81582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.240+0000 7fbffe1e9640 1 --2- 172.21.15.77:0/2459683082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbff8153530 0x7fbff81582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.240+0000 7fbffe1e9640 1 -- 172.21.15.77:0/2459683082 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff814c8a0 con 0x7fbff80bef50 2024-04-25T01:43:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.241+0000 7fbffe1e9640 1 --2- 172.21.15.77:0/2459683082 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbff80bef50 0x7fbff81e1350 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbff400e960 tx=0x7fbff400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.241+0000 7fbfeeffd640 1 -- 172.21.15.77:0/2459683082 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff4017070 con 0x7fbff80bef50 2024-04-25T01:43:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.241+0000 7fbfeeffd640 1 -- 172.21.15.77:0/2459683082 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff400ca00 con 0x7fbff80bef50 2024-04-25T01:43:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.241+0000 7fc00044d640 1 -- 172.21.15.77:0/2459683082 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbff81df7b0 con 0x7fbff80bef50 2024-04-25T01:43:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.241+0000 7fbfeeffd640 1 -- 172.21.15.77:0/2459683082 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff400cdd0 con 0x7fbff80bef50 2024-04-25T01:43:52.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.241+0000 7fc00044d640 1 -- 172.21.15.77:0/2459683082 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbff81dfa90 con 0x7fbff80bef50 2024-04-25T01:43:52.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.242+0000 7fc00044d640 1 -- 172.21.15.77:0/2459683082 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbff8156e80 con 0x7fbff80bef50 2024-04-25T01:43:52.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.242+0000 7fbfeeffd640 1 -- 172.21.15.77:0/2459683082 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbff401a070 con 0x7fbff80bef50 2024-04-25T01:43:52.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.243+0000 7fbfeeffd640 1 --2- 172.21.15.77:0/2459683082 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbfdc06be60 0x7fbfdc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:52.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.243+0000 7fbfeeffd640 1 -- 172.21.15.77:0/2459683082 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7fbff408b140 con 0x7fbff80bef50 2024-04-25T01:43:52.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.243+0000 7fbffd9e8640 1 --2- 172.21.15.77:0/2459683082 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbfdc06be60 0x7fbfdc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:52.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.243+0000 7fbffd9e8640 1 --2- 172.21.15.77:0/2459683082 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbfdc06be60 0x7fbfdc06e320 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8034000 tx=0x7fbfe802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:52.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.247+0000 7fbfeeffd640 1 -- 172.21.15.77:0/2459683082 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbff8156e80 con 0x7fbff80bef50 2024-04-25T01:43:52.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.444+0000 7fc00044d640 1 -- 172.21.15.77:0/2459683082 --> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fbff804f500 con 0x7fbfdc06be60 2024-04-25T01:43:52.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.445+0000 7fbfeeffd640 1 -- 172.21.15.77:0/2459683082 <== mgr.4098 v2:172.21.15.77:6832/4208232183 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbff804f500 con 0x7fbfdc06be60 2024-04-25T01:43:52.436 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T01:43:52.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.447+0000 7fc00044d640 1 -- 172.21.15.77:0/2459683082 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbfdc06be60 msgr2=0x7fbfdc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:52.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.447+0000 7fc00044d640 1 --2- 172.21.15.77:0/2459683082 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbfdc06be60 0x7fbfdc06e320 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8034000 tx=0x7fbfe802e000 comp rx=0 tx=0).stop 2024-04-25T01:43:52.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.447+0000 7fc00044d640 1 -- 172.21.15.77:0/2459683082 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbff80bef50 msgr2=0x7fbff81e1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:52.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.447+0000 7fc00044d640 1 --2- 172.21.15.77:0/2459683082 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbff80bef50 0x7fbff81e1350 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbff400e960 tx=0x7fbff400ee20 comp rx=0 tx=0).stop 2024-04-25T01:43:52.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.447+0000 7fc00044d640 1 -- 172.21.15.77:0/2459683082 shutdown_connections 2024-04-25T01:43:52.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.447+0000 7fc00044d640 1 --2- 172.21.15.77:0/2459683082 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbfdc06be60 0x7fbfdc06e320 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.447+0000 7fc00044d640 1 --2- 172.21.15.77:0/2459683082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbff8153530 0x7fbff81582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.447+0000 7fc00044d640 1 --2- 172.21.15.77:0/2459683082 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbff80c97c0 0x7fbff81e1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.447+0000 7fc00044d640 1 --2- 172.21.15.77:0/2459683082 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbff80bef50 0x7fbff81e1350 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.447+0000 7fc00044d640 1 -- 172.21.15.77:0/2459683082 >> 172.21.15.77:0/2459683082 conn(0x7fbff80672c0 msgr2=0x7fbff81515c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:52.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.447+0000 7fc00044d640 1 -- 172.21.15.77:0/2459683082 shutdown_connections 2024-04-25T01:43:52.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.447+0000 7fc00044d640 1 -- 172.21.15.77:0/2459683082 wait complete. 2024-04-25T01:43:52.449 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T01:43:52.450 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T01:43:52.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.562+0000 7f5f6d77d640 1 Processor -- start 2024-04-25T01:43:52.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.562+0000 7f5f6d77d640 1 -- start start 2024-04-25T01:43:52.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.563+0000 7f5f6d77d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5f68152b90 0x7f5f6806d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:52.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.563+0000 7f5f6d77d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f680c2f90 con 0x7f5f680c1e80 2024-04-25T01:43:52.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.563+0000 7f5f6d77d640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f680c2380 con 0x7f5f6806d0a0 2024-04-25T01:43:52.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.563+0000 7f5f6d77d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f5f680c2660 con 0x7f5f68152b90 2024-04-25T01:43:52.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.563+0000 7f5f677fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5f68152b90 0x7f5f6806d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:52.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.563+0000 7f5f5ffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f5f680c1e80 0x7f5f68154a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52268/0 (socket says 172.21.15.77:52268) 2024-04-25T01:43:52.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.563+0000 7f5f5ffff640 1 -- 172.21.15.77:0/3094539995 learned_addr learned my addr 172.21.15.77:0/3094539995 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:43:52.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.563+0000 7f5f677fe640 1 -- 172.21.15.77:0/3094539995 >> v1:172.21.15.121:6789/0 conn(0x7f5f6806d0a0 legacy=0x7f5f68154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:52.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.563+0000 7f5f677fe640 1 -- 172.21.15.77:0/3094539995 >> v1:172.21.15.77:6789/0 conn(0x7f5f680c1e80 legacy=0x7f5f68154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:52.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.563+0000 7f5f677fe640 1 -- 172.21.15.77:0/3094539995 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f680c2940 con 0x7f5f68152b90 2024-04-25T01:43:52.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.564+0000 7f5f677fe640 1 --2- 172.21.15.77:0/3094539995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f68152b90 0x7f5f6806d480 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f5f60009d90 tx=0x7f5f6002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a58886ccb694e50 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:52.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.564+0000 7f5f667fc640 1 -- 172.21.15.77:0/3094539995 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f60031600 con 0x7f5f68152b90 2024-04-25T01:43:52.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.564+0000 7f5f667fc640 1 -- 172.21.15.77:0/3094539995 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f600317a0 con 0x7f5f68152b90 2024-04-25T01:43:52.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.564+0000 7f5f667fc640 1 -- 172.21.15.77:0/3094539995 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f60031b70 con 0x7f5f68152b90 2024-04-25T01:43:52.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.565+0000 7f5f6d77d640 1 -- 172.21.15.77:0/3094539995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f68152b90 msgr2=0x7f5f6806d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:52.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.565+0000 7f5f6d77d640 1 --2- 172.21.15.77:0/3094539995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f68152b90 0x7f5f6806d480 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f5f60009d90 tx=0x7f5f6002a5d0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.565+0000 7f5f6d77d640 1 -- 172.21.15.77:0/3094539995 shutdown_connections 2024-04-25T01:43:52.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.565+0000 7f5f6d77d640 1 --2- 172.21.15.77:0/3094539995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f68152b90 0x7f5f6806d480 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.565+0000 7f5f6d77d640 1 -- 172.21.15.77:0/3094539995 >> 172.21.15.77:0/3094539995 conn(0x7f5f680a9230 msgr2=0x7f5f680a9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:52.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.565+0000 7f5f6d77d640 1 -- 172.21.15.77:0/3094539995 shutdown_connections 2024-04-25T01:43:52.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.565+0000 7f5f6d77d640 1 -- 172.21.15.77:0/3094539995 wait complete. 2024-04-25T01:43:52.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.566+0000 7f5f6d77d640 1 Processor -- start 2024-04-25T01:43:52.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.566+0000 7f5f6d77d640 1 -- start start 2024-04-25T01:43:52.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.567+0000 7f5f6d77d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f6806d0a0 0x7f5f6813eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:52.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.567+0000 7f5f6d77d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f680c1e80 0x7f5f680704d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:52.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.567+0000 7f5f6d77d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5f68152b90 0x7f5f6813c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:52.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.567+0000 7f5f6d77d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5f68155e90 con 0x7f5f6806d0a0 2024-04-25T01:43:52.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.567+0000 7f5f6d77d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6806c4a0 con 0x7f5f680c1e80 2024-04-25T01:43:52.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.567+0000 7f5f6d77d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f5f6806b110 con 0x7f5f68152b90 2024-04-25T01:43:52.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.567+0000 7f5f66ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f6806d0a0 0x7f5f6813eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:52.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.567+0000 7f5f66ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f6806d0a0 0x7f5f6813eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59104/0 (socket says 172.21.15.77:59104) 2024-04-25T01:43:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.567+0000 7f5f66ffd640 1 -- 172.21.15.77:0/3507510132 learned_addr learned my addr 172.21.15.77:0/3507510132 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.567+0000 7f5f5ffff640 1 --2- 172.21.15.77:0/3507510132 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f680c1e80 0x7f5f680704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.567+0000 7f5f677fe640 1 --2- 172.21.15.77:0/3507510132 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5f68152b90 0x7f5f6813c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.567+0000 7f5f66ffd640 1 -- 172.21.15.77:0/3507510132 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5f68152b90 msgr2=0x7f5f6813c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.567+0000 7f5f66ffd640 1 --2- 172.21.15.77:0/3507510132 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5f68152b90 0x7f5f6813c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.567+0000 7f5f66ffd640 1 -- 172.21.15.77:0/3507510132 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f680c1e80 msgr2=0x7f5f680704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.567+0000 7f5f66ffd640 1 --2- 172.21.15.77:0/3507510132 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f680c1e80 0x7f5f680704d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.567+0000 7f5f66ffd640 1 -- 172.21.15.77:0/3507510132 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f6813e0e0 con 0x7f5f6806d0a0 2024-04-25T01:43:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.567+0000 7f5f677fe640 1 --2- 172.21.15.77:0/3507510132 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5f68152b90 0x7f5f6813c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:43:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.567+0000 7f5f66ffd640 1 --2- 172.21.15.77:0/3507510132 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f6806d0a0 0x7f5f6813eea0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800c430 tx=0x7f5f5800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.567+0000 7f5f5f7fe640 1 -- 172.21.15.77:0/3507510132 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f580052d0 con 0x7f5f6806d0a0 2024-04-25T01:43:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.567+0000 7f5f5f7fe640 1 -- 172.21.15.77:0/3507510132 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f58005490 con 0x7f5f6806d0a0 2024-04-25T01:43:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.567+0000 7f5f5f7fe640 1 -- 172.21.15.77:0/3507510132 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f58007260 con 0x7f5f6806d0a0 2024-04-25T01:43:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.567+0000 7f5f6d77d640 1 -- 172.21.15.77:0/3507510132 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f6813e3c0 con 0x7f5f6806d0a0 2024-04-25T01:43:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.567+0000 7f5f6d77d640 1 -- 172.21.15.77:0/3507510132 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f6813e980 con 0x7f5f6806d0a0 2024-04-25T01:43:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.568+0000 7f5f6d77d640 1 -- 172.21.15.77:0/3507510132 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5f68075d10 con 0x7f5f6806d0a0 2024-04-25T01:43:52.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.569+0000 7f5f5f7fe640 1 -- 172.21.15.77:0/3507510132 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5f58007400 con 0x7f5f6806d0a0 2024-04-25T01:43:52.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.569+0000 7f5f5f7fe640 1 --2- 172.21.15.77:0/3507510132 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5f4806be30 0x7f5f4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:52.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.569+0000 7f5f5f7fe640 1 -- 172.21.15.77:0/3507510132 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7f5f5808a7f0 con 0x7f5f6806d0a0 2024-04-25T01:43:52.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.569+0000 7f5f5ffff640 1 --2- 172.21.15.77:0/3507510132 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5f4806be30 0x7f5f4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:52.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.570+0000 7f5f5f7fe640 1 --2- 172.21.15.77:0/3507510132 >> [v2:172.21.15.77:6800/3971619298,v1:172.21.15.77:6801/3971619298] conn(0x7f5f48076b50 0x7f5f48078fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:52.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.570+0000 7f5f5f7fe640 1 -- 172.21.15.77:0/3507510132 --> [v2:172.21.15.77:6800/3971619298,v1:172.21.15.77:6801/3971619298] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5f58009e50 con 0x7f5f48076b50 2024-04-25T01:43:52.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.570+0000 7f5f5f7fe640 1 -- 172.21.15.77:0/3507510132 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5f5808f2c0 con 0x7f5f6806d0a0 2024-04-25T01:43:52.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.570+0000 7f5f677fe640 1 --2- 172.21.15.77:0/3507510132 >> [v2:172.21.15.77:6800/3971619298,v1:172.21.15.77:6801/3971619298] conn(0x7f5f48076b50 0x7f5f48078fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:52.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.570+0000 7f5f5ffff640 1 --2- 172.21.15.77:0/3507510132 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5f4806be30 0x7f5f4806e2f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5f6813f790 tx=0x7f5f50009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:52.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.570+0000 7f5f677fe640 1 --2- 172.21.15.77:0/3507510132 >> [v2:172.21.15.77:6800/3971619298,v1:172.21.15.77:6801/3971619298] conn(0x7f5f48076b50 0x7f5f48078fd0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:52.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.571+0000 7f5f5f7fe640 1 -- 172.21.15.77:0/3507510132 <== osd.1 v2:172.21.15.77:6800/3971619298 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5f58009e50 con 0x7f5f48076b50 2024-04-25T01:43:52.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.583+0000 7f5f6d77d640 1 -- 172.21.15.77:0/3507510132 --> [v2:172.21.15.77:6800/3971619298,v1:172.21.15.77:6801/3971619298] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5f680c3cc0 con 0x7f5f48076b50 2024-04-25T01:43:52.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.584+0000 7f5f5f7fe640 1 -- 172.21.15.77:0/3507510132 <== osd.1 v2:172.21.15.77:6800/3971619298 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5f680c3cc0 con 0x7f5f48076b50 2024-04-25T01:43:52.575 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T01:43:52.575 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T01:43:52.575 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T01:43:52.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.584+0000 7f5f6d77d640 1 -- 172.21.15.77:0/3507510132 >> [v2:172.21.15.77:6800/3971619298,v1:172.21.15.77:6801/3971619298] conn(0x7f5f48076b50 msgr2=0x7f5f48078fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:52.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.584+0000 7f5f6d77d640 1 --2- 172.21.15.77:0/3507510132 >> [v2:172.21.15.77:6800/3971619298,v1:172.21.15.77:6801/3971619298] conn(0x7f5f48076b50 0x7f5f48078fd0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.584+0000 7f5f6d77d640 1 -- 172.21.15.77:0/3507510132 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5f4806be30 msgr2=0x7f5f4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:52.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.584+0000 7f5f6d77d640 1 --2- 172.21.15.77:0/3507510132 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f5f4806be30 0x7f5f4806e2f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5f6813f790 tx=0x7f5f50009040 comp rx=0 tx=0).stop 2024-04-25T01:43:52.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.584+0000 7f5f6d77d640 1 -- 172.21.15.77:0/3507510132 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f6806d0a0 msgr2=0x7f5f6813eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:52.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.584+0000 7f5f6d77d640 1 --2- 172.21.15.77:0/3507510132 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f6806d0a0 0x7f5f6813eea0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800c430 tx=0x7f5f5800c8f0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.584+0000 7f5f677fe640 1 -- 172.21.15.77:0/3507510132 reap_dead start 2024-04-25T01:43:52.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.584+0000 7f5f6d77d640 1 -- 172.21.15.77:0/3507510132 shutdown_connections 2024-04-25T01:43:52.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.584+0000 7f5f6d77d640 1 -- 172.21.15.77:0/3507510132 >> 172.21.15.77:0/3507510132 conn(0x7f5f680a9230 msgr2=0x7f5f680c3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:52.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.584+0000 7f5f6d77d640 1 -- 172.21.15.77:0/3507510132 shutdown_connections 2024-04-25T01:43:52.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.584+0000 7f5f6d77d640 1 -- 172.21.15.77:0/3507510132 wait complete. 2024-04-25T01:43:52.586 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T01:43:52.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.695+0000 7f0f7334f640 1 Processor -- start 2024-04-25T01:43:52.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.695+0000 7f0f7334f640 1 -- start start 2024-04-25T01:43:52.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.696+0000 7f0f7334f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0f6c0c97c0 0x7f0f6c159d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:52.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.696+0000 7f0f7334f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f6c06d110 con 0x7f0f6c0bef50 2024-04-25T01:43:52.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.696+0000 7f0f7334f640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f6c153910 con 0x7f0f6c153530 2024-04-25T01:43:52.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.696+0000 7f0f7334f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f0f6c156980 con 0x7f0f6c0c97c0 2024-04-25T01:43:52.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.696+0000 7f0f718ec640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0f6c0c97c0 0x7f0f6c159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:52.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.696+0000 7f0f708ea640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0f6c0bef50 0x7f0f6c1595f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52280/0 (socket says 172.21.15.77:52280) 2024-04-25T01:43:52.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.696+0000 7f0f718ec640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0f6c0c97c0 0x7f0f6c159d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59120/0 (socket says 172.21.15.77:59120) 2024-04-25T01:43:52.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.696+0000 7f0f708ea640 1 -- 172.21.15.77:0/1340098939 learned_addr learned my addr 172.21.15.77:0/1340098939 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:43:52.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.697+0000 7f0f718ec640 1 -- 172.21.15.77:0/1340098939 >> v1:172.21.15.121:6789/0 conn(0x7f0f6c153530 legacy=0x7f0f6c0c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:52.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.697+0000 7f0f718ec640 1 -- 172.21.15.77:0/1340098939 >> v1:172.21.15.77:6789/0 conn(0x7f0f6c0bef50 legacy=0x7f0f6c1595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:52.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.697+0000 7f0f718ec640 1 -- 172.21.15.77:0/1340098939 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6c156c60 con 0x7f0f6c0c97c0 2024-04-25T01:43:52.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.697+0000 7f0f6bfff640 1 -- 172.21.15.77:0/1340098939 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 921671060 0 0) 0x7f0f6c06d110 con 0x7f0f6c0bef50 2024-04-25T01:43:52.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.698+0000 7f0f718ec640 1 --2- 172.21.15.77:0/1340098939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f6c0c97c0 0x7f0f6c159d00 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0097a0 tx=0x7f0f5c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18bea16ab3e956f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:52.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.698+0000 7f0f6bfff640 1 -- 172.21.15.77:0/1340098939 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c037070 con 0x7f0f6c0c97c0 2024-04-25T01:43:52.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.698+0000 7f0f6bfff640 1 -- 172.21.15.77:0/1340098939 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f5c032440 con 0x7f0f6c0c97c0 2024-04-25T01:43:52.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.698+0000 7f0f6bfff640 1 -- 172.21.15.77:0/1340098939 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c032810 con 0x7f0f6c0c97c0 2024-04-25T01:43:52.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.699+0000 7f0f7334f640 1 -- 172.21.15.77:0/1340098939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f6c0c97c0 msgr2=0x7f0f6c159d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:52.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.699+0000 7f0f7334f640 1 --2- 172.21.15.77:0/1340098939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f6c0c97c0 0x7f0f6c159d00 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0097a0 tx=0x7f0f5c02a1a0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.699+0000 7f0f7334f640 1 -- 172.21.15.77:0/1340098939 shutdown_connections 2024-04-25T01:43:52.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.699+0000 7f0f7334f640 1 --2- 172.21.15.77:0/1340098939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f6c0c97c0 0x7f0f6c159d00 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.699+0000 7f0f7334f640 1 -- 172.21.15.77:0/1340098939 >> 172.21.15.77:0/1340098939 conn(0x7f0f6c0672c0 msgr2=0x7f0f6c0676d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:52.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.699+0000 7f0f7334f640 1 -- 172.21.15.77:0/1340098939 shutdown_connections 2024-04-25T01:43:52.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.699+0000 7f0f7334f640 1 -- 172.21.15.77:0/1340098939 wait complete. 2024-04-25T01:43:52.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.700+0000 7f0f7334f640 1 Processor -- start 2024-04-25T01:43:52.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.700+0000 7f0f7334f640 1 -- start start 2024-04-25T01:43:52.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.701+0000 7f0f7334f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f6c0bef50 0x7f0f6c14e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:52.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.701+0000 7f0f7334f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f6c0c97c0 0x7f0f6c148df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:52.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.701+0000 7f0f7334f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f6c153530 0x7f0f6c149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:52.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.701+0000 7f0f7334f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c15a240 con 0x7f0f6c0bef50 2024-04-25T01:43:52.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.701+0000 7f0f7334f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c0cc250 con 0x7f0f6c0c97c0 2024-04-25T01:43:52.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.701+0000 7f0f7334f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f0f6c0c6950 con 0x7f0f6c153530 2024-04-25T01:43:52.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.701+0000 7f0f710eb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f6c0bef50 0x7f0f6c14e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:52.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.701+0000 7f0f710eb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f6c0bef50 0x7f0f6c14e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59126/0 (socket says 172.21.15.77:59126) 2024-04-25T01:43:52.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.701+0000 7f0f710eb640 1 -- 172.21.15.77:0/91665872 learned_addr learned my addr 172.21.15.77:0/91665872 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:52.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.701+0000 7f0f708ea640 1 --2- 172.21.15.77:0/91665872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f6c0c97c0 0x7f0f6c148df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:52.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.701+0000 7f0f718ec640 1 --2- 172.21.15.77:0/91665872 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f6c153530 0x7f0f6c149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:52.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.701+0000 7f0f710eb640 1 -- 172.21.15.77:0/91665872 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f6c153530 msgr2=0x7f0f6c149330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:52.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.701+0000 7f0f710eb640 1 --2- 172.21.15.77:0/91665872 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f6c153530 0x7f0f6c149330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.701+0000 7f0f710eb640 1 -- 172.21.15.77:0/91665872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f6c0c97c0 msgr2=0x7f0f6c148df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:52.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.701+0000 7f0f710eb640 1 --2- 172.21.15.77:0/91665872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f6c0c97c0 0x7f0f6c148df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.701+0000 7f0f710eb640 1 -- 172.21.15.77:0/91665872 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6c0b1330 con 0x7f0f6c0bef50 2024-04-25T01:43:52.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.701+0000 7f0f718ec640 1 --2- 172.21.15.77:0/91665872 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f6c153530 0x7f0f6c149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:43:52.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.701+0000 7f0f710eb640 1 --2- 172.21.15.77:0/91665872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f6c0bef50 0x7f0f6c14e930 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400c430 tx=0x7f0f6400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:52.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.701+0000 7f0f69ffb640 1 -- 172.21.15.77:0/91665872 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f64017070 con 0x7f0f6c0bef50 2024-04-25T01:43:52.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.701+0000 7f0f69ffb640 1 -- 172.21.15.77:0/91665872 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f640052d0 con 0x7f0f6c0bef50 2024-04-25T01:43:52.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.701+0000 7f0f69ffb640 1 -- 172.21.15.77:0/91665872 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f64003830 con 0x7f0f6c0bef50 2024-04-25T01:43:52.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.701+0000 7f0f7334f640 1 -- 172.21.15.77:0/91665872 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f6c159050 con 0x7f0f6c0bef50 2024-04-25T01:43:52.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.702+0000 7f0f7334f640 1 -- 172.21.15.77:0/91665872 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f6c0b0b30 con 0x7f0f6c0bef50 2024-04-25T01:43:52.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.703+0000 7f0f7334f640 1 -- 172.21.15.77:0/91665872 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f6c04f500 con 0x7f0f6c0bef50 2024-04-25T01:43:52.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.703+0000 7f0f69ffb640 1 -- 172.21.15.77:0/91665872 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f6401a070 con 0x7f0f6c0bef50 2024-04-25T01:43:52.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.703+0000 7f0f69ffb640 1 --2- 172.21.15.77:0/91665872 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0f5806be30 0x7f0f5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:52.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.703+0000 7f0f69ffb640 1 -- 172.21.15.77:0/91665872 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7f0f6408a5e0 con 0x7f0f6c0bef50 2024-04-25T01:43:52.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.704+0000 7f0f708ea640 1 --2- 172.21.15.77:0/91665872 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0f5806be30 0x7f0f5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:52.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.704+0000 7f0f708ea640 1 --2- 172.21.15.77:0/91665872 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0f5806be30 0x7f0f5806e2f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c1ea240 tx=0x7f0f60009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:52.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.708+0000 7f0f69ffb640 1 -- 172.21.15.77:0/91665872 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0f6c0b1330 con 0x7f0f6c0bef50 2024-04-25T01:43:52.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.887+0000 7f0f7334f640 1 -- 172.21.15.77:0/91665872 --> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f0f6c0c9150 con 0x7f0f5806be30 2024-04-25T01:43:52.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.888+0000 7f0f69ffb640 1 -- 172.21.15.77:0/91665872 <== mgr.4098 v2:172.21.15.77:6832/4208232183 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0f6c0c9150 con 0x7f0f5806be30 2024-04-25T01:43:52.879 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T01:43:52.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.890+0000 7f0f7334f640 1 -- 172.21.15.77:0/91665872 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0f5806be30 msgr2=0x7f0f5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:52.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.890+0000 7f0f7334f640 1 --2- 172.21.15.77:0/91665872 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0f5806be30 0x7f0f5806e2f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c1ea240 tx=0x7f0f60009040 comp rx=0 tx=0).stop 2024-04-25T01:43:52.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.890+0000 7f0f7334f640 1 -- 172.21.15.77:0/91665872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f6c0bef50 msgr2=0x7f0f6c14e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:52.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.890+0000 7f0f7334f640 1 --2- 172.21.15.77:0/91665872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f6c0bef50 0x7f0f6c14e930 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400c430 tx=0x7f0f6400c8f0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.890+0000 7f0f7334f640 1 -- 172.21.15.77:0/91665872 shutdown_connections 2024-04-25T01:43:52.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.890+0000 7f0f7334f640 1 --2- 172.21.15.77:0/91665872 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0f5806be30 0x7f0f5806e2f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.890+0000 7f0f7334f640 1 --2- 172.21.15.77:0/91665872 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f6c153530 0x7f0f6c149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.890+0000 7f0f7334f640 1 --2- 172.21.15.77:0/91665872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f6c0c97c0 0x7f0f6c148df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.890+0000 7f0f7334f640 1 --2- 172.21.15.77:0/91665872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f6c0bef50 0x7f0f6c14e930 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.890+0000 7f0f7334f640 1 -- 172.21.15.77:0/91665872 >> 172.21.15.77:0/91665872 conn(0x7f0f6c0672c0 msgr2=0x7f0f6c0ca440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:52.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.890+0000 7f0f7334f640 1 -- 172.21.15.77:0/91665872 shutdown_connections 2024-04-25T01:43:52.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:52.890+0000 7f0f7334f640 1 -- 172.21.15.77:0/91665872 wait complete. 2024-04-25T01:43:52.892 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T01:43:52.893 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T01:43:52.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.004+0000 7fbe3e9a0640 1 Processor -- start 2024-04-25T01:43:52.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.004+0000 7fbe3e9a0640 1 -- start start 2024-04-25T01:43:52.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.005+0000 7fbe3e9a0640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe381500d0 0x7fbe38152e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:52.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.005+0000 7fbe3e9a0640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbe3806d060 0x7fbe38153350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:52.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.005+0000 7fbe3e9a0640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe380c2fc0 con 0x7fbe380accb0 2024-04-25T01:43:52.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.005+0000 7fbe3e9a0640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fbe380ab840 con 0x7fbe3806d060 2024-04-25T01:43:52.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.005+0000 7fbe3e9a0640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fbe38153eb0 con 0x7fbe381500d0 2024-04-25T01:43:52.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.005+0000 7fbe3d99e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe381500d0 0x7fbe38152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:52.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.005+0000 7fbe3d19d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbe3806d060 0x7fbe38153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:52.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.005+0000 7fbe3d19d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbe3806d060 0x7fbe38153350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:58922/0 (socket says 172.21.15.77:58922) 2024-04-25T01:43:52.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.005+0000 7fbe3e19f640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fbe380accb0 0x7fbe380ad140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.77:39030/0 (socket says 172.21.15.77:39030) 2024-04-25T01:43:52.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.005+0000 7fbe3d99e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe381500d0 0x7fbe38152e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.77:53226/0 (socket says 172.21.15.77:53226) 2024-04-25T01:43:52.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.005+0000 7fbe3d19d640 1 -- 172.21.15.77:0/1461809827 learned_addr learned my addr 172.21.15.77:0/1461809827 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:52.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.005+0000 7fbe3d99e640 1 -- 172.21.15.77:0/1461809827 >> v2:172.21.15.121:3300/0 conn(0x7fbe3806d060 msgr2=0x7fbe38153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:52.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.005+0000 7fbe3d99e640 1 --2- 172.21.15.77:0/1461809827 >> v2:172.21.15.121:3300/0 conn(0x7fbe3806d060 0x7fbe38153350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:52.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.006+0000 7fbe3d99e640 1 -- 172.21.15.77:0/1461809827 >> v1:172.21.15.121:6789/0 conn(0x7fbe380accb0 legacy=0x7fbe380ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:52.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.006+0000 7fbe3d99e640 1 -- 172.21.15.77:0/1461809827 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe380c48c0 con 0x7fbe381500d0 2024-04-25T01:43:52.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.006+0000 7fbe3c99c640 1 -- 172.21.15.77:0/1461809827 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2681591073 0 0) 0x7fbe380c2fc0 con 0x7fbe380accb0 2024-04-25T01:43:52.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.006+0000 7fbe3d19d640 1 --2- 172.21.15.77:0/1461809827 >> v2:172.21.15.121:3300/0 conn(0x7fbe3806d060 0x7fbe38153350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:43:53.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.006+0000 7fbe3d99e640 1 --2- 172.21.15.77:0/1461809827 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe381500d0 0x7fbe38152e10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbe280097a0 tx=0x7fbe2802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77a98788575dc9f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:53.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.006+0000 7fbe3c99c640 1 -- 172.21.15.77:0/1461809827 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe28037070 con 0x7fbe381500d0 2024-04-25T01:43:53.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.006+0000 7fbe3c99c640 1 -- 172.21.15.77:0/1461809827 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe28032440 con 0x7fbe381500d0 2024-04-25T01:43:53.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.006+0000 7fbe3c99c640 1 -- 172.21.15.77:0/1461809827 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe28032810 con 0x7fbe381500d0 2024-04-25T01:43:53.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.007+0000 7fbe3e9a0640 1 -- 172.21.15.77:0/1461809827 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe381500d0 msgr2=0x7fbe38152e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.007+0000 7fbe3e9a0640 1 --2- 172.21.15.77:0/1461809827 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe381500d0 0x7fbe38152e10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbe280097a0 tx=0x7fbe2802a180 comp rx=0 tx=0).stop 2024-04-25T01:43:53.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.007+0000 7fbe3e9a0640 1 -- 172.21.15.77:0/1461809827 shutdown_connections 2024-04-25T01:43:53.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.007+0000 7fbe3e9a0640 1 --2- 172.21.15.77:0/1461809827 >> v2:172.21.15.121:3300/0 conn(0x7fbe3806d060 0x7fbe38153350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.007+0000 7fbe3e9a0640 1 --2- 172.21.15.77:0/1461809827 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe381500d0 0x7fbe38152e10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.007+0000 7fbe3e9a0640 1 -- 172.21.15.77:0/1461809827 >> 172.21.15.77:0/1461809827 conn(0x7fbe380c4eb0 msgr2=0x7fbe380c5290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:53.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.007+0000 7fbe3e9a0640 1 -- 172.21.15.77:0/1461809827 shutdown_connections 2024-04-25T01:43:53.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.007+0000 7fbe3e9a0640 1 -- 172.21.15.77:0/1461809827 wait complete. 2024-04-25T01:43:53.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.008+0000 7fbe3e9a0640 1 Processor -- start 2024-04-25T01:43:53.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.008+0000 7fbe3e9a0640 1 -- start start 2024-04-25T01:43:53.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.009+0000 7fbe3e9a0640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe3806d060 0x7fbe38072960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.009+0000 7fbe3e9a0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe380accb0 0x7fbe380c1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.009+0000 7fbe3e9a0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe381500d0 0x7fbe38150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.009+0000 7fbe3e9a0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbe380c4090 con 0x7fbe381500d0 2024-04-25T01:43:53.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.009+0000 7fbe3e9a0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbe380c4670 con 0x7fbe380accb0 2024-04-25T01:43:53.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.009+0000 7fbe3e9a0640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fbe380ad850 con 0x7fbe3806d060 2024-04-25T01:43:53.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.009+0000 7fbe3e19f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe381500d0 0x7fbe38150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.009+0000 7fbe3d19d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe380accb0 0x7fbe380c1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.009+0000 7fbe3d99e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe3806d060 0x7fbe38072960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.009+0000 7fbe3d19d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe380accb0 0x7fbe380c1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:58932/0 (socket says 172.21.15.77:58932) 2024-04-25T01:43:53.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.009+0000 7fbe3d19d640 1 -- 172.21.15.77:0/3906988303 learned_addr learned my addr 172.21.15.77:0/3906988303 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:53.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.009+0000 7fbe3e19f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe381500d0 0x7fbe38150da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59128/0 (socket says 172.21.15.77:59128) 2024-04-25T01:43:53.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.009+0000 7fbe3d19d640 1 -- 172.21.15.77:0/3906988303 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe3806d060 msgr2=0x7fbe38072960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.009+0000 7fbe3d19d640 1 --2- 172.21.15.77:0/3906988303 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe3806d060 0x7fbe38072960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.009+0000 7fbe3d19d640 1 -- 172.21.15.77:0/3906988303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe381500d0 msgr2=0x7fbe38150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.009+0000 7fbe3d19d640 1 --2- 172.21.15.77:0/3906988303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe381500d0 0x7fbe38150da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.009+0000 7fbe3d19d640 1 -- 172.21.15.77:0/3906988303 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe380c6f00 con 0x7fbe380accb0 2024-04-25T01:43:53.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.010+0000 7fbe3d19d640 1 --2- 172.21.15.77:0/3906988303 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe380accb0 0x7fbe380c1a50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbe3400b240 tx=0x7fbe3400d720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:53.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.010+0000 7fbe2e7fc640 1 -- 172.21.15.77:0/3906988303 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe34019680 con 0x7fbe380accb0 2024-04-25T01:43:53.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.010+0000 7fbe2e7fc640 1 -- 172.21.15.77:0/3906988303 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe34019820 con 0x7fbe380accb0 2024-04-25T01:43:53.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.010+0000 7fbe2e7fc640 1 -- 172.21.15.77:0/3906988303 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe34019bd0 con 0x7fbe380accb0 2024-04-25T01:43:53.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.010+0000 7fbe3e9a0640 1 -- 172.21.15.77:0/3906988303 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe38072ff0 con 0x7fbe380accb0 2024-04-25T01:43:53.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.010+0000 7fbe3e9a0640 1 -- 172.21.15.77:0/3906988303 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe38071560 con 0x7fbe380accb0 2024-04-25T01:43:53.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.011+0000 7fbe3e9a0640 1 -- 172.21.15.77:0/3906988303 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbe3804fd50 con 0x7fbe380accb0 2024-04-25T01:43:53.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.011+0000 7fbe2e7fc640 1 -- 172.21.15.77:0/3906988303 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbe34010440 con 0x7fbe380accb0 2024-04-25T01:43:53.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.012+0000 7fbe2e7fc640 1 --2- 172.21.15.77:0/3906988303 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbe1c06be30 0x7fbe1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.012+0000 7fbe2e7fc640 1 -- 172.21.15.77:0/3906988303 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7fbe3408c070 con 0x7fbe380accb0 2024-04-25T01:43:53.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.012+0000 7fbe3d99e640 1 --2- 172.21.15.77:0/3906988303 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbe1c06be30 0x7fbe1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.012+0000 7fbe2e7fc640 1 --2- 172.21.15.77:0/3906988303 >> [v2:172.21.15.77:6808/4103452689,v1:172.21.15.77:6810/4103452689] conn(0x7fbe1c076b50 0x7fbe1c078fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.012+0000 7fbe2e7fc640 1 -- 172.21.15.77:0/3906988303 --> [v2:172.21.15.77:6808/4103452689,v1:172.21.15.77:6810/4103452689] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbe34008e50 con 0x7fbe1c076b50 2024-04-25T01:43:53.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.012+0000 7fbe2e7fc640 1 -- 172.21.15.77:0/3906988303 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbe34093050 con 0x7fbe380accb0 2024-04-25T01:43:53.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.012+0000 7fbe3e19f640 1 --2- 172.21.15.77:0/3906988303 >> [v2:172.21.15.77:6808/4103452689,v1:172.21.15.77:6810/4103452689] conn(0x7fbe1c076b50 0x7fbe1c078fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.012+0000 7fbe3d99e640 1 --2- 172.21.15.77:0/3906988303 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbe1c06be30 0x7fbe1c06e2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbe28034000 tx=0x7fbe2802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:53.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.012+0000 7fbe3e19f640 1 --2- 172.21.15.77:0/3906988303 >> [v2:172.21.15.77:6808/4103452689,v1:172.21.15.77:6810/4103452689] conn(0x7fbe1c076b50 0x7fbe1c078fd0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:53.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.013+0000 7fbe2e7fc640 1 -- 172.21.15.77:0/3906988303 <== osd.2 v2:172.21.15.77:6808/4103452689 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbe34008e50 con 0x7fbe1c076b50 2024-04-25T01:43:53.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.026+0000 7fbe3e9a0640 1 -- 172.21.15.77:0/3906988303 --> [v2:172.21.15.77:6808/4103452689,v1:172.21.15.77:6810/4103452689] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbe380c7d00 con 0x7fbe1c076b50 2024-04-25T01:43:53.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.026+0000 7fbe2e7fc640 1 -- 172.21.15.77:0/3906988303 <== osd.2 v2:172.21.15.77:6808/4103452689 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbe380c7d00 con 0x7fbe1c076b50 2024-04-25T01:43:53.017 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T01:43:53.017 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T01:43:53.017 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T01:43:53.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.026+0000 7fbe3e9a0640 1 -- 172.21.15.77:0/3906988303 >> [v2:172.21.15.77:6808/4103452689,v1:172.21.15.77:6810/4103452689] conn(0x7fbe1c076b50 msgr2=0x7fbe1c078fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.026+0000 7fbe3e9a0640 1 --2- 172.21.15.77:0/3906988303 >> [v2:172.21.15.77:6808/4103452689,v1:172.21.15.77:6810/4103452689] conn(0x7fbe1c076b50 0x7fbe1c078fd0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.026+0000 7fbe3e9a0640 1 -- 172.21.15.77:0/3906988303 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbe1c06be30 msgr2=0x7fbe1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.026+0000 7fbe3e9a0640 1 --2- 172.21.15.77:0/3906988303 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fbe1c06be30 0x7fbe1c06e2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbe28034000 tx=0x7fbe2802e000 comp rx=0 tx=0).stop 2024-04-25T01:43:53.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.026+0000 7fbe3e9a0640 1 -- 172.21.15.77:0/3906988303 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe380accb0 msgr2=0x7fbe380c1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.026+0000 7fbe3e9a0640 1 --2- 172.21.15.77:0/3906988303 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe380accb0 0x7fbe380c1a50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbe3400b240 tx=0x7fbe3400d720 comp rx=0 tx=0).stop 2024-04-25T01:43:53.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.026+0000 7fbe3e19f640 1 -- 172.21.15.77:0/3906988303 reap_dead start 2024-04-25T01:43:53.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.026+0000 7fbe3e9a0640 1 -- 172.21.15.77:0/3906988303 shutdown_connections 2024-04-25T01:43:53.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.026+0000 7fbe3e9a0640 1 -- 172.21.15.77:0/3906988303 >> 172.21.15.77:0/3906988303 conn(0x7fbe380c4eb0 msgr2=0x7fbe381540b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:53.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.026+0000 7fbe3e9a0640 1 -- 172.21.15.77:0/3906988303 shutdown_connections 2024-04-25T01:43:53.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.026+0000 7fbe3e9a0640 1 -- 172.21.15.77:0/3906988303 wait complete. 2024-04-25T01:43:53.028 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T01:43:53.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.135+0000 7f4bb68ee640 1 Processor -- start 2024-04-25T01:43:53.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.135+0000 7f4bb68ee640 1 -- start start 2024-04-25T01:43:53.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.136+0000 7f4bb68ee640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4bb00bef50 0x7f4bb01595f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.136+0000 7f4bb68ee640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4bb00c97c0 0x7f4bb0159b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.136+0000 7f4bb68ee640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bb006d110 con 0x7f4bb0153530 2024-04-25T01:43:53.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.136+0000 7f4bb68ee640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f4bb0153910 con 0x7f4bb00c97c0 2024-04-25T01:43:53.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.136+0000 7f4bb68ee640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f4bb0156980 con 0x7f4bb00bef50 2024-04-25T01:43:53.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.136+0000 7f4bb4e8b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4bb00c97c0 0x7f4bb0159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.136+0000 7f4baffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4bb0153530 0x7f4bb00c6240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52282/0 (socket says 172.21.15.77:52282) 2024-04-25T01:43:53.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.136+0000 7f4bb4e8b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4bb00c97c0 0x7f4bb0159b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59142/0 (socket says 172.21.15.77:59142) 2024-04-25T01:43:53.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.136+0000 7f4baffff640 1 -- 172.21.15.77:0/4171275819 learned_addr learned my addr 172.21.15.77:0/4171275819 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:43:53.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.137+0000 7f4baf7fe640 1 --2- 172.21.15.77:0/4171275819 >> v2:172.21.15.121:3300/0 conn(0x7f4bb00bef50 0x7f4bb01595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.137+0000 7f4bb4e8b640 1 -- 172.21.15.77:0/4171275819 >> v2:172.21.15.121:3300/0 conn(0x7f4bb00bef50 msgr2=0x7f4bb01595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:53.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.137+0000 7f4bb4e8b640 1 --2- 172.21.15.77:0/4171275819 >> v2:172.21.15.121:3300/0 conn(0x7f4bb00bef50 0x7f4bb01595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.137+0000 7f4bb4e8b640 1 -- 172.21.15.77:0/4171275819 >> v1:172.21.15.77:6789/0 conn(0x7f4bb0153530 legacy=0x7f4bb00c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.137+0000 7f4baeffd640 1 -- 172.21.15.77:0/4171275819 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2514302481 0 0) 0x7f4bb006d110 con 0x7f4bb0153530 2024-04-25T01:43:53.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.137+0000 7f4bb4e8b640 1 -- 172.21.15.77:0/4171275819 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb0156c60 con 0x7f4bb00c97c0 2024-04-25T01:43:53.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.137+0000 7f4baf7fe640 1 --2- 172.21.15.77:0/4171275819 >> v2:172.21.15.121:3300/0 conn(0x7f4bb00bef50 0x7f4bb01595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:43:53.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.137+0000 7f4bb4e8b640 1 --2- 172.21.15.77:0/4171275819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bb00c97c0 0x7f4bb0159b30 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4bb00c9370 tx=0x7f4ba802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c152cf11c1e92659 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:53.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.137+0000 7f4baeffd640 1 -- 172.21.15.77:0/4171275819 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8007740 con 0x7f4bb00c97c0 2024-04-25T01:43:53.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.138+0000 7f4baeffd640 1 -- 172.21.15.77:0/4171275819 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba80078e0 con 0x7f4bb00c97c0 2024-04-25T01:43:53.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.138+0000 7f4baeffd640 1 -- 172.21.15.77:0/4171275819 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8007cb0 con 0x7f4bb00c97c0 2024-04-25T01:43:53.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.138+0000 7f4bb68ee640 1 -- 172.21.15.77:0/4171275819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bb00c97c0 msgr2=0x7f4bb0159b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.138+0000 7f4bb68ee640 1 --2- 172.21.15.77:0/4171275819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bb00c97c0 0x7f4bb0159b30 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4bb00c9370 tx=0x7f4ba802a5f0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.138+0000 7f4bb68ee640 1 -- 172.21.15.77:0/4171275819 shutdown_connections 2024-04-25T01:43:53.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.138+0000 7f4bb68ee640 1 --2- 172.21.15.77:0/4171275819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bb00c97c0 0x7f4bb0159b30 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.138+0000 7f4bb68ee640 1 --2- 172.21.15.77:0/4171275819 >> v2:172.21.15.121:3300/0 conn(0x7f4bb00bef50 0x7f4bb01595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.138+0000 7f4bb68ee640 1 -- 172.21.15.77:0/4171275819 >> 172.21.15.77:0/4171275819 conn(0x7f4bb00672c0 msgr2=0x7f4bb00676d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.138+0000 7f4bb68ee640 1 -- 172.21.15.77:0/4171275819 shutdown_connections 2024-04-25T01:43:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.138+0000 7f4bb68ee640 1 -- 172.21.15.77:0/4171275819 wait complete. 2024-04-25T01:43:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.139+0000 7f4bb68ee640 1 Processor -- start 2024-04-25T01:43:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.139+0000 7f4bb68ee640 1 -- start start 2024-04-25T01:43:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.140+0000 7f4bb68ee640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4bb00bef50 0x7f4bb01eba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.140+0000 7f4bb68ee640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bb00c97c0 0x7f4bb00ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.140+0000 7f4bb68ee640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bb0153530 0x7f4bb00c1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.140+0000 7f4bb68ee640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb00c6950 con 0x7f4bb00c97c0 2024-04-25T01:43:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.140+0000 7f4bb68ee640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb00cc250 con 0x7f4bb0153530 2024-04-25T01:43:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.140+0000 7f4bb68ee640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f4bb00c6ad0 con 0x7f4bb00bef50 2024-04-25T01:43:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.140+0000 7f4baf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bb00c97c0 0x7f4bb00ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.140+0000 7f4baf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bb00c97c0 0x7f4bb00ac2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59156/0 (socket says 172.21.15.77:59156) 2024-04-25T01:43:53.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.140+0000 7f4baf7fe640 1 -- 172.21.15.77:0/1864418594 learned_addr learned my addr 172.21.15.77:0/1864418594 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.140+0000 7f4baffff640 1 --2- 172.21.15.77:0/1864418594 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4bb00bef50 0x7f4bb01eba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.140+0000 7f4bb4e8b640 1 --2- 172.21.15.77:0/1864418594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bb0153530 0x7f4bb00c1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.140+0000 7f4baf7fe640 1 -- 172.21.15.77:0/1864418594 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4bb00bef50 msgr2=0x7f4bb01eba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.140+0000 7f4baf7fe640 1 --2- 172.21.15.77:0/1864418594 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4bb00bef50 0x7f4bb01eba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.140+0000 7f4baf7fe640 1 -- 172.21.15.77:0/1864418594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bb0153530 msgr2=0x7f4bb00c1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.140+0000 7f4baf7fe640 1 --2- 172.21.15.77:0/1864418594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bb0153530 0x7f4bb00c1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.140+0000 7f4baf7fe640 1 -- 172.21.15.77:0/1864418594 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb0158250 con 0x7f4bb00c97c0 2024-04-25T01:43:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.141+0000 7f4baf7fe640 1 --2- 172.21.15.77:0/1864418594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bb00c97c0 0x7f4bb00ac2d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000c7f0 tx=0x7f4ba000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.141+0000 7f4bacff9640 1 -- 172.21.15.77:0/1864418594 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0005b90 con 0x7f4bb00c97c0 2024-04-25T01:43:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.141+0000 7f4bacff9640 1 -- 172.21.15.77:0/1864418594 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba0005d30 con 0x7f4bb00c97c0 2024-04-25T01:43:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.141+0000 7f4bb68ee640 1 -- 172.21.15.77:0/1864418594 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bb0157640 con 0x7f4bb00c97c0 2024-04-25T01:43:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.141+0000 7f4bacff9640 1 -- 172.21.15.77:0/1864418594 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0007a30 con 0x7f4bb00c97c0 2024-04-25T01:43:53.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.141+0000 7f4bb68ee640 1 -- 172.21.15.77:0/1864418594 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bb0157c00 con 0x7f4bb00c97c0 2024-04-25T01:43:53.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.142+0000 7f4bb68ee640 1 -- 172.21.15.77:0/1864418594 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bb004f500 con 0x7f4bb00c97c0 2024-04-25T01:43:53.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.142+0000 7f4bacff9640 1 -- 172.21.15.77:0/1864418594 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ba0007bd0 con 0x7f4bb00c97c0 2024-04-25T01:43:53.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.143+0000 7f4bacff9640 1 --2- 172.21.15.77:0/1864418594 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4b9c06be30 0x7f4b9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.143+0000 7f4baffff640 1 --2- 172.21.15.77:0/1864418594 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4b9c06be30 0x7f4b9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.143+0000 7f4bacff9640 1 -- 172.21.15.77:0/1864418594 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7f4ba008b330 con 0x7f4bb00c97c0 2024-04-25T01:43:53.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.143+0000 7f4baffff640 1 --2- 172.21.15.77:0/1864418594 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4b9c06be30 0x7f4b9c06e2f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4007fd0 tx=0x7f4ba4007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:53.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.147+0000 7f4bacff9640 1 -- 172.21.15.77:0/1864418594 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4ba0015020 con 0x7f4bb00c97c0 2024-04-25T01:43:53.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.324+0000 7f4bb68ee640 1 -- 172.21.15.77:0/1864418594 --> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f4bb0158460 con 0x7f4b9c06be30 2024-04-25T01:43:53.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.324+0000 7f4bacff9640 1 -- 172.21.15.77:0/1864418594 <== mgr.4098 v2:172.21.15.77:6832/4208232183 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4bb0158460 con 0x7f4b9c06be30 2024-04-25T01:43:53.315 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T01:43:53.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.326+0000 7f4bb68ee640 1 -- 172.21.15.77:0/1864418594 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4b9c06be30 msgr2=0x7f4b9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.326+0000 7f4bb68ee640 1 --2- 172.21.15.77:0/1864418594 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4b9c06be30 0x7f4b9c06e2f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4007fd0 tx=0x7f4ba4007de0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.326+0000 7f4bb68ee640 1 -- 172.21.15.77:0/1864418594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bb00c97c0 msgr2=0x7f4bb00ac2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.326+0000 7f4bb68ee640 1 --2- 172.21.15.77:0/1864418594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bb00c97c0 0x7f4bb00ac2d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000c7f0 tx=0x7f4ba000cbf0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.326+0000 7f4bb68ee640 1 -- 172.21.15.77:0/1864418594 shutdown_connections 2024-04-25T01:43:53.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.326+0000 7f4bb68ee640 1 --2- 172.21.15.77:0/1864418594 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4b9c06be30 0x7f4b9c06e2f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.326+0000 7f4bb68ee640 1 --2- 172.21.15.77:0/1864418594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bb00c97c0 0x7f4bb00ac2d0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.326+0000 7f4bb68ee640 1 --2- 172.21.15.77:0/1864418594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bb0153530 0x7f4bb00c1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.326+0000 7f4bb68ee640 1 --2- 172.21.15.77:0/1864418594 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4bb00bef50 0x7f4bb01eba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.326+0000 7f4bb68ee640 1 -- 172.21.15.77:0/1864418594 >> 172.21.15.77:0/1864418594 conn(0x7f4bb00672c0 msgr2=0x7f4bb00c9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:53.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.326+0000 7f4bb68ee640 1 -- 172.21.15.77:0/1864418594 shutdown_connections 2024-04-25T01:43:53.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.326+0000 7f4bb68ee640 1 -- 172.21.15.77:0/1864418594 wait complete. 2024-04-25T01:43:53.328 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T01:43:53.329 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T01:43:53.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.438+0000 7ff0de0ae640 1 Processor -- start 2024-04-25T01:43:53.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.439+0000 7ff0de0ae640 1 -- start start 2024-04-25T01:43:53.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.439+0000 7ff0de0ae640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff0d80c1e80 0x7ff0d8152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.439+0000 7ff0de0ae640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff0d806d480 0x7ff0d8154a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.439+0000 7ff0de0ae640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0d806d8d0 con 0x7ff0d806d0a0 2024-04-25T01:43:53.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.439+0000 7ff0de0ae640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff0d80c2f90 con 0x7ff0d806d480 2024-04-25T01:43:53.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.439+0000 7ff0de0ae640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7ff0d80c2380 con 0x7ff0d80c1e80 2024-04-25T01:43:53.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.439+0000 7ff0d7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff0d806d480 0x7ff0d8154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.439+0000 7ff0d7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff0d806d480 0x7ff0d8154a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59164/0 (socket says 172.21.15.77:59164) 2024-04-25T01:43:53.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.439+0000 7ff0d7fff640 1 -- 172.21.15.77:0/3976463025 learned_addr learned my addr 172.21.15.77:0/3976463025 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:53.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.440+0000 7ff0d6ffd640 1 --2- 172.21.15.77:0/3976463025 >> v2:172.21.15.121:3300/0 conn(0x7ff0d80c1e80 0x7ff0d8152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.440+0000 7ff0d7fff640 1 -- 172.21.15.77:0/3976463025 >> v2:172.21.15.121:3300/0 conn(0x7ff0d80c1e80 msgr2=0x7ff0d8152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:53.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.440+0000 7ff0d7fff640 1 --2- 172.21.15.77:0/3976463025 >> v2:172.21.15.121:3300/0 conn(0x7ff0d80c1e80 0x7ff0d8152b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.440+0000 7ff0d7fff640 1 -- 172.21.15.77:0/3976463025 >> v1:172.21.15.121:6789/0 conn(0x7ff0d806d0a0 legacy=0x7ff0d8154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:53.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.440+0000 7ff0d7fff640 1 -- 172.21.15.77:0/3976463025 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d80c2660 con 0x7ff0d806d480 2024-04-25T01:43:53.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.440+0000 7ff0d6ffd640 1 --2- 172.21.15.77:0/3976463025 >> v2:172.21.15.121:3300/0 conn(0x7ff0d80c1e80 0x7ff0d8152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:43:53.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.440+0000 7ff0d7fff640 1 --2- 172.21.15.77:0/3976463025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0d806d480 0x7ff0d8154a70 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7ff0d80aa230 tx=0x7ff0d002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2bbbf49dd2b3ffb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:53.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.441+0000 7ff0d67fc640 1 -- 172.21.15.77:0/3976463025 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0036070 con 0x7ff0d806d480 2024-04-25T01:43:53.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.441+0000 7ff0d67fc640 1 -- 172.21.15.77:0/3976463025 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d0031600 con 0x7ff0d806d480 2024-04-25T01:43:53.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.441+0000 7ff0d67fc640 1 -- 172.21.15.77:0/3976463025 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00319d0 con 0x7ff0d806d480 2024-04-25T01:43:53.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.441+0000 7ff0de0ae640 1 -- 172.21.15.77:0/3976463025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0d806d480 msgr2=0x7ff0d8154a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.441+0000 7ff0de0ae640 1 --2- 172.21.15.77:0/3976463025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0d806d480 0x7ff0d8154a70 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7ff0d80aa230 tx=0x7ff0d002a660 comp rx=0 tx=0).stop 2024-04-25T01:43:53.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.441+0000 7ff0de0ae640 1 -- 172.21.15.77:0/3976463025 shutdown_connections 2024-04-25T01:43:53.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.441+0000 7ff0de0ae640 1 --2- 172.21.15.77:0/3976463025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0d806d480 0x7ff0d8154a70 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.441+0000 7ff0de0ae640 1 --2- 172.21.15.77:0/3976463025 >> v2:172.21.15.121:3300/0 conn(0x7ff0d80c1e80 0x7ff0d8152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.441+0000 7ff0de0ae640 1 -- 172.21.15.77:0/3976463025 >> 172.21.15.77:0/3976463025 conn(0x7ff0d80a9230 msgr2=0x7ff0d80a9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:53.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.441+0000 7ff0de0ae640 1 -- 172.21.15.77:0/3976463025 shutdown_connections 2024-04-25T01:43:53.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.441+0000 7ff0de0ae640 1 -- 172.21.15.77:0/3976463025 wait complete. 2024-04-25T01:43:53.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.442+0000 7ff0de0ae640 1 Processor -- start 2024-04-25T01:43:53.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.442+0000 7ff0de0ae640 1 -- start start 2024-04-25T01:43:53.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.443+0000 7ff0de0ae640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff0d806d0a0 0x7ff0d81441b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.443+0000 7ff0de0ae640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0d806d480 0x7ff0d8144da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.443+0000 7ff0de0ae640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0d80c1e80 0x7ff0d81452e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.443+0000 7ff0de0ae640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d806c4a0 con 0x7ff0d80c1e80 2024-04-25T01:43:53.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.443+0000 7ff0de0ae640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d80c2c20 con 0x7ff0d806d480 2024-04-25T01:43:53.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.443+0000 7ff0de0ae640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff0d8154fb0 con 0x7ff0d806d0a0 2024-04-25T01:43:53.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.443+0000 7ff0d7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0d80c1e80 0x7ff0d81452e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.443+0000 7ff0d7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0d80c1e80 0x7ff0d81452e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59174/0 (socket says 172.21.15.77:59174) 2024-04-25T01:43:53.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.443+0000 7ff0d7fff640 1 -- 172.21.15.77:0/2436315055 learned_addr learned my addr 172.21.15.77:0/2436315055 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:53.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.443+0000 7ff0d6ffd640 1 --2- 172.21.15.77:0/2436315055 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0d806d480 0x7ff0d8144da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.443+0000 7ff0d77fe640 1 --2- 172.21.15.77:0/2436315055 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff0d806d0a0 0x7ff0d81441b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.443+0000 7ff0d7fff640 1 -- 172.21.15.77:0/2436315055 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff0d806d0a0 msgr2=0x7ff0d81441b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.443+0000 7ff0d7fff640 1 --2- 172.21.15.77:0/2436315055 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff0d806d0a0 0x7ff0d81441b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.443+0000 7ff0d7fff640 1 -- 172.21.15.77:0/2436315055 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0d806d480 msgr2=0x7ff0d8144da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.443+0000 7ff0d7fff640 1 --2- 172.21.15.77:0/2436315055 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0d806d480 0x7ff0d8144da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.443+0000 7ff0d7fff640 1 -- 172.21.15.77:0/2436315055 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d8070f80 con 0x7ff0d80c1e80 2024-04-25T01:43:53.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.444+0000 7ff0d7fff640 1 --2- 172.21.15.77:0/2436315055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0d80c1e80 0x7ff0d81452e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0009f40 tx=0x7ff0d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:53.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.444+0000 7ff0bffff640 1 -- 172.21.15.77:0/2436315055 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0036050 con 0x7ff0d80c1e80 2024-04-25T01:43:53.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.444+0000 7ff0bffff640 1 -- 172.21.15.77:0/2436315055 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d0042070 con 0x7ff0d80c1e80 2024-04-25T01:43:53.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.444+0000 7ff0bffff640 1 -- 172.21.15.77:0/2436315055 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0009510 con 0x7ff0d80c1e80 2024-04-25T01:43:53.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.444+0000 7ff0de0ae640 1 -- 172.21.15.77:0/2436315055 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0d8071260 con 0x7ff0d80c1e80 2024-04-25T01:43:53.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.444+0000 7ff0de0ae640 1 -- 172.21.15.77:0/2436315055 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0d81480d0 con 0x7ff0d80c1e80 2024-04-25T01:43:53.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.445+0000 7ff0de0ae640 1 -- 172.21.15.77:0/2436315055 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff0d8150530 con 0x7ff0d80c1e80 2024-04-25T01:43:53.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.445+0000 7ff0bffff640 1 -- 172.21.15.77:0/2436315055 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff0d0007bf0 con 0x7ff0d80c1e80 2024-04-25T01:43:53.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.446+0000 7ff0bffff640 1 --2- 172.21.15.77:0/2436315055 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff0c406be30 0x7ff0c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.446+0000 7ff0bffff640 1 -- 172.21.15.77:0/2436315055 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7ff0d00ac3b0 con 0x7ff0d80c1e80 2024-04-25T01:43:53.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.446+0000 7ff0d77fe640 1 --2- 172.21.15.77:0/2436315055 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff0c406be30 0x7ff0c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.446+0000 7ff0bffff640 1 --2- 172.21.15.77:0/2436315055 >> [v2:172.21.15.77:6816/217398906,v1:172.21.15.77:6819/217398906] conn(0x7ff0c4076b50 0x7ff0c4078fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.446+0000 7ff0bffff640 1 -- 172.21.15.77:0/2436315055 --> [v2:172.21.15.77:6816/217398906,v1:172.21.15.77:6819/217398906] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff0d004ae80 con 0x7ff0c4076b50 2024-04-25T01:43:53.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.446+0000 7ff0bffff640 1 -- 172.21.15.77:0/2436315055 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff0d00b3050 con 0x7ff0d80c1e80 2024-04-25T01:43:53.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.446+0000 7ff0d6ffd640 1 --2- 172.21.15.77:0/2436315055 >> [v2:172.21.15.77:6816/217398906,v1:172.21.15.77:6819/217398906] conn(0x7ff0c4076b50 0x7ff0c4078fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.446+0000 7ff0d77fe640 1 --2- 172.21.15.77:0/2436315055 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff0c406be30 0x7ff0c406e2f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff0d80c53c0 tx=0x7ff0c8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:53.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.446+0000 7ff0d6ffd640 1 --2- 172.21.15.77:0/2436315055 >> [v2:172.21.15.77:6816/217398906,v1:172.21.15.77:6819/217398906] conn(0x7ff0c4076b50 0x7ff0c4078fd0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:53.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.447+0000 7ff0bffff640 1 -- 172.21.15.77:0/2436315055 <== osd.3 v2:172.21.15.77:6816/217398906 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff0d004ae80 con 0x7ff0c4076b50 2024-04-25T01:43:53.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.460+0000 7ff0de0ae640 1 -- 172.21.15.77:0/2436315055 --> [v2:172.21.15.77:6816/217398906,v1:172.21.15.77:6819/217398906] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff0d8071430 con 0x7ff0c4076b50 2024-04-25T01:43:53.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.460+0000 7ff0bffff640 1 -- 172.21.15.77:0/2436315055 <== osd.3 v2:172.21.15.77:6816/217398906 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff0d8071430 con 0x7ff0c4076b50 2024-04-25T01:43:53.451 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T01:43:53.452 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T01:43:53.452 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T01:43:53.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.461+0000 7ff0de0ae640 1 -- 172.21.15.77:0/2436315055 >> [v2:172.21.15.77:6816/217398906,v1:172.21.15.77:6819/217398906] conn(0x7ff0c4076b50 msgr2=0x7ff0c4078fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.461+0000 7ff0de0ae640 1 --2- 172.21.15.77:0/2436315055 >> [v2:172.21.15.77:6816/217398906,v1:172.21.15.77:6819/217398906] conn(0x7ff0c4076b50 0x7ff0c4078fd0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.461+0000 7ff0de0ae640 1 -- 172.21.15.77:0/2436315055 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff0c406be30 msgr2=0x7ff0c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.461+0000 7ff0de0ae640 1 --2- 172.21.15.77:0/2436315055 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7ff0c406be30 0x7ff0c406e2f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff0d80c53c0 tx=0x7ff0c8009040 comp rx=0 tx=0).stop 2024-04-25T01:43:53.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.461+0000 7ff0de0ae640 1 -- 172.21.15.77:0/2436315055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0d80c1e80 msgr2=0x7ff0d81452e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.461+0000 7ff0de0ae640 1 --2- 172.21.15.77:0/2436315055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0d80c1e80 0x7ff0d81452e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0009f40 tx=0x7ff0d0004a40 comp rx=0 tx=0).stop 2024-04-25T01:43:53.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.461+0000 7ff0d7fff640 1 -- 172.21.15.77:0/2436315055 reap_dead start 2024-04-25T01:43:53.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.461+0000 7ff0de0ae640 1 -- 172.21.15.77:0/2436315055 shutdown_connections 2024-04-25T01:43:53.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.461+0000 7ff0de0ae640 1 -- 172.21.15.77:0/2436315055 >> 172.21.15.77:0/2436315055 conn(0x7ff0d80a9230 msgr2=0x7ff0d80c3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:53.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.461+0000 7ff0de0ae640 1 -- 172.21.15.77:0/2436315055 shutdown_connections 2024-04-25T01:43:53.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.461+0000 7ff0de0ae640 1 -- 172.21.15.77:0/2436315055 wait complete. 2024-04-25T01:43:53.462 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T01:43:53.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.568+0000 7f325921b640 1 Processor -- start 2024-04-25T01:43:53.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.568+0000 7f325921b640 1 -- start start 2024-04-25T01:43:53.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.569+0000 7f325921b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f32540c4280 0x7f32541538f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.569+0000 7f325921b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3254073450 0x7f3254153e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.569+0000 7f325921b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f32540c4cb0 0x7f32540c5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.569+0000 7f325921b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f32540c1cd0 con 0x7f3254073450 2024-04-25T01:43:53.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.569+0000 7f325921b640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f32540c7040 con 0x7f32540c4280 2024-04-25T01:43:53.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.569+0000 7f325921b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f32540ac010 con 0x7f32540c4cb0 2024-04-25T01:43:53.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.569+0000 7f325259c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3254073450 0x7f3254153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.569+0000 7f325259c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3254073450 0x7f3254153e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59178/0 (socket says 172.21.15.77:59178) 2024-04-25T01:43:53.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.569+0000 7f325259c640 1 -- 172.21.15.77:0/1622843380 learned_addr learned my addr 172.21.15.77:0/1622843380 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:53.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.570+0000 7f3252d9d640 1 --2- 172.21.15.77:0/1622843380 >> v2:172.21.15.121:3300/0 conn(0x7f32540c4280 0x7f32541538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.570+0000 7f325259c640 1 -- 172.21.15.77:0/1622843380 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f32540c4cb0 msgr2=0x7f32540c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:53.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.570+0000 7f325259c640 1 --2- 172.21.15.77:0/1622843380 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f32540c4cb0 0x7f32540c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.570+0000 7f325259c640 1 -- 172.21.15.77:0/1622843380 >> v2:172.21.15.121:3300/0 conn(0x7f32540c4280 msgr2=0x7f32541538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:53.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.570+0000 7f325259c640 1 --2- 172.21.15.77:0/1622843380 >> v2:172.21.15.121:3300/0 conn(0x7f32540c4280 0x7f32541538f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.570+0000 7f325259c640 1 -- 172.21.15.77:0/1622843380 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32540ac2f0 con 0x7f3254073450 2024-04-25T01:43:53.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.570+0000 7f325259c640 1 --2- 172.21.15.77:0/1622843380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3254073450 0x7f3254153e30 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f32540c3fe0 tx=0x7f324802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd0c07824d8d2d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:53.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.570+0000 7f3251d9b640 1 -- 172.21.15.77:0/1622843380 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3248037070 con 0x7f3254073450 2024-04-25T01:43:53.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.570+0000 7f3251d9b640 1 -- 172.21.15.77:0/1622843380 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3248032440 con 0x7f3254073450 2024-04-25T01:43:53.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.570+0000 7f3251d9b640 1 -- 172.21.15.77:0/1622843380 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3248032810 con 0x7f3254073450 2024-04-25T01:43:53.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.571+0000 7f325921b640 1 -- 172.21.15.77:0/1622843380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3254073450 msgr2=0x7f3254153e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.571+0000 7f325921b640 1 --2- 172.21.15.77:0/1622843380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3254073450 0x7f3254153e30 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f32540c3fe0 tx=0x7f324802a1e0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.571+0000 7f325921b640 1 -- 172.21.15.77:0/1622843380 shutdown_connections 2024-04-25T01:43:53.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.571+0000 7f325921b640 1 --2- 172.21.15.77:0/1622843380 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f32540c4cb0 0x7f32540c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.571+0000 7f325921b640 1 --2- 172.21.15.77:0/1622843380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3254073450 0x7f3254153e30 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.571+0000 7f325921b640 1 --2- 172.21.15.77:0/1622843380 >> v2:172.21.15.121:3300/0 conn(0x7f32540c4280 0x7f32541538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.571+0000 7f325921b640 1 -- 172.21.15.77:0/1622843380 >> 172.21.15.77:0/1622843380 conn(0x7f32540c7580 msgr2=0x7f32540c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:53.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.571+0000 7f325921b640 1 -- 172.21.15.77:0/1622843380 shutdown_connections 2024-04-25T01:43:53.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.571+0000 7f325921b640 1 -- 172.21.15.77:0/1622843380 wait complete. 2024-04-25T01:43:53.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.572+0000 7f325921b640 1 Processor -- start 2024-04-25T01:43:53.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.572+0000 7f325921b640 1 -- start start 2024-04-25T01:43:53.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.573+0000 7f325921b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3254073450 0x7f32541ea8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.573+0000 7f325921b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32540c4280 0x7f32540a9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.573+0000 7f325921b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32540c4cb0 0x7f325414bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.573+0000 7f325921b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f32540c1a90 con 0x7f32540c4cb0 2024-04-25T01:43:53.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.573+0000 7f325921b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f32540c1910 con 0x7f32540c4280 2024-04-25T01:43:53.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.573+0000 7f325921b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f32540c4660 con 0x7f3254073450 2024-04-25T01:43:53.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.573+0000 7f325359e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32540c4cb0 0x7f325414bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.573+0000 7f325359e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32540c4cb0 0x7f325414bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59194/0 (socket says 172.21.15.77:59194) 2024-04-25T01:43:53.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.573+0000 7f325359e640 1 -- 172.21.15.77:0/1037975081 learned_addr learned my addr 172.21.15.77:0/1037975081 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:53.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.573+0000 7f325259c640 1 --2- 172.21.15.77:0/1037975081 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32540c4280 0x7f32540a9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.573+0000 7f3252d9d640 1 --2- 172.21.15.77:0/1037975081 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3254073450 0x7f32541ea8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.573+0000 7f325359e640 1 -- 172.21.15.77:0/1037975081 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3254073450 msgr2=0x7f32541ea8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.573+0000 7f325359e640 1 --2- 172.21.15.77:0/1037975081 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3254073450 0x7f32541ea8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.573+0000 7f325359e640 1 -- 172.21.15.77:0/1037975081 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32540c4280 msgr2=0x7f32540a9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.573+0000 7f325359e640 1 --2- 172.21.15.77:0/1037975081 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32540c4280 0x7f32540a9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.573+0000 7f325359e640 1 -- 172.21.15.77:0/1037975081 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32541ed3d0 con 0x7f32540c4cb0 2024-04-25T01:43:53.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.574+0000 7f325359e640 1 --2- 172.21.15.77:0/1037975081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32540c4cb0 0x7f325414bac0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f324400b970 tx=0x7f324400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:53.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.574+0000 7f323b7fe640 1 -- 172.21.15.77:0/1037975081 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3244019070 con 0x7f32540c4cb0 2024-04-25T01:43:53.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.574+0000 7f323b7fe640 1 -- 172.21.15.77:0/1037975081 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f324400cb60 con 0x7f32540c4cb0 2024-04-25T01:43:53.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.574+0000 7f325921b640 1 -- 172.21.15.77:0/1037975081 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32541ed670 con 0x7f32540c4cb0 2024-04-25T01:43:53.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.574+0000 7f323b7fe640 1 -- 172.21.15.77:0/1037975081 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3244014440 con 0x7f32540c4cb0 2024-04-25T01:43:53.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.574+0000 7f325921b640 1 -- 172.21.15.77:0/1037975081 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32540a9c80 con 0x7f32540c4cb0 2024-04-25T01:43:53.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.575+0000 7f325921b640 1 -- 172.21.15.77:0/1037975081 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f325406c1d0 con 0x7f32540c4cb0 2024-04-25T01:43:53.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.575+0000 7f323b7fe640 1 -- 172.21.15.77:0/1037975081 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f324401c070 con 0x7f32540c4cb0 2024-04-25T01:43:53.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.576+0000 7f323b7fe640 1 --2- 172.21.15.77:0/1037975081 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f324006be60 0x7f324006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.576+0000 7f323b7fe640 1 -- 172.21.15.77:0/1037975081 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7f324408b000 con 0x7f32540c4cb0 2024-04-25T01:43:53.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.576+0000 7f3252d9d640 1 --2- 172.21.15.77:0/1037975081 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f324006be60 0x7f324006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.576+0000 7f3252d9d640 1 --2- 172.21.15.77:0/1037975081 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f324006be60 0x7f324006e320 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f324c00aac0 tx=0x7f324c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:53.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.580+0000 7f323b7fe640 1 -- 172.21.15.77:0/1037975081 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f325406c1d0 con 0x7f32540c4cb0 2024-04-25T01:43:53.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.755+0000 7f325921b640 1 -- 172.21.15.77:0/1037975081 --> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f32541edca0 con 0x7f324006be60 2024-04-25T01:43:53.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.755+0000 7f323b7fe640 1 -- 172.21.15.77:0/1037975081 <== mgr.4098 v2:172.21.15.77:6832/4208232183 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f32541edca0 con 0x7f324006be60 2024-04-25T01:43:53.746 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T01:43:53.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.757+0000 7f325921b640 1 -- 172.21.15.77:0/1037975081 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f324006be60 msgr2=0x7f324006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.757+0000 7f325921b640 1 --2- 172.21.15.77:0/1037975081 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f324006be60 0x7f324006e320 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f324c00aac0 tx=0x7f324c008040 comp rx=0 tx=0).stop 2024-04-25T01:43:53.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.757+0000 7f325921b640 1 -- 172.21.15.77:0/1037975081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32540c4cb0 msgr2=0x7f325414bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.757+0000 7f325921b640 1 --2- 172.21.15.77:0/1037975081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32540c4cb0 0x7f325414bac0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f324400b970 tx=0x7f324400be30 comp rx=0 tx=0).stop 2024-04-25T01:43:53.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.757+0000 7f325921b640 1 -- 172.21.15.77:0/1037975081 shutdown_connections 2024-04-25T01:43:53.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.757+0000 7f325921b640 1 --2- 172.21.15.77:0/1037975081 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f324006be60 0x7f324006e320 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.757+0000 7f325921b640 1 --2- 172.21.15.77:0/1037975081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32540c4cb0 0x7f325414bac0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.757+0000 7f325921b640 1 --2- 172.21.15.77:0/1037975081 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32540c4280 0x7f32540a9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.757+0000 7f325921b640 1 --2- 172.21.15.77:0/1037975081 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3254073450 0x7f32541ea8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.757+0000 7f325921b640 1 -- 172.21.15.77:0/1037975081 >> 172.21.15.77:0/1037975081 conn(0x7f32540c7580 msgr2=0x7f32540ab460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:53.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.757+0000 7f325921b640 1 -- 172.21.15.77:0/1037975081 shutdown_connections 2024-04-25T01:43:53.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.757+0000 7f325921b640 1 -- 172.21.15.77:0/1037975081 wait complete. 2024-04-25T01:43:53.759 INFO:tasks.ceph:Scrubbing osd.4 2024-04-25T01:43:53.759 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-25T01:43:53.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.869+0000 7f0d5a658640 1 Processor -- start 2024-04-25T01:43:53.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.870+0000 7f0d5a658640 1 -- start start 2024-04-25T01:43:53.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.870+0000 7f0d5a658640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0d540c85a0 0x7f0d540c9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.870+0000 7f0d5a658640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0d54156110 0x7f0d54153290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.870+0000 7f0d5a658640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0d541537d0 0x7f0d5406bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.870+0000 7f0d5a658640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f0d541565f0 con 0x7f0d541537d0 2024-04-25T01:43:53.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.870+0000 7f0d5a658640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f0d541568d0 con 0x7f0d540c85a0 2024-04-25T01:43:53.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.870+0000 7f0d5a658640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f0d54156bb0 con 0x7f0d54156110 2024-04-25T01:43:53.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.870+0000 7f0d58bf5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0d541537d0 0x7f0d5406bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.870+0000 7f0d58bf5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0d541537d0 0x7f0d5406bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59208/0 (socket says 172.21.15.77:59208) 2024-04-25T01:43:53.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.870+0000 7f0d58bf5640 1 -- 172.21.15.77:0/3134247986 learned_addr learned my addr 172.21.15.77:0/3134247986 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:53.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.871+0000 7f0d53fff640 1 --2- 172.21.15.77:0/3134247986 >> v2:172.21.15.121:3300/0 conn(0x7f0d540c85a0 0x7f0d540c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.871+0000 7f0d537fe640 1 --2- 172.21.15.77:0/3134247986 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0d54156110 0x7f0d54153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.871+0000 7f0d58bf5640 1 -- 172.21.15.77:0/3134247986 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0d54156110 msgr2=0x7f0d54153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:53.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.871+0000 7f0d58bf5640 1 --2- 172.21.15.77:0/3134247986 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0d54156110 0x7f0d54153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.871+0000 7f0d58bf5640 1 -- 172.21.15.77:0/3134247986 >> v2:172.21.15.121:3300/0 conn(0x7f0d540c85a0 msgr2=0x7f0d540c9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:53.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.871+0000 7f0d58bf5640 1 --2- 172.21.15.77:0/3134247986 >> v2:172.21.15.121:3300/0 conn(0x7f0d540c85a0 0x7f0d540c9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.871+0000 7f0d58bf5640 1 -- 172.21.15.77:0/3134247986 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d54156e90 con 0x7f0d541537d0 2024-04-25T01:43:53.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.871+0000 7f0d58bf5640 1 --2- 172.21.15.77:0/3134247986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d541537d0 0x7f0d5406bbf0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0d540c8e40 tx=0x7f0d4c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45eb206787b7f2c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:53.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.872+0000 7f0d52ffd640 1 -- 172.21.15.77:0/3134247986 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c036070 con 0x7f0d541537d0 2024-04-25T01:43:53.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.872+0000 7f0d52ffd640 1 -- 172.21.15.77:0/3134247986 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d4c031600 con 0x7f0d541537d0 2024-04-25T01:43:53.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.872+0000 7f0d52ffd640 1 -- 172.21.15.77:0/3134247986 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c0319d0 con 0x7f0d541537d0 2024-04-25T01:43:53.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.872+0000 7f0d5a658640 1 -- 172.21.15.77:0/3134247986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d541537d0 msgr2=0x7f0d5406bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.872+0000 7f0d5a658640 1 --2- 172.21.15.77:0/3134247986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d541537d0 0x7f0d5406bbf0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0d540c8e40 tx=0x7f0d4c02a610 comp rx=0 tx=0).stop 2024-04-25T01:43:53.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.872+0000 7f0d5a658640 1 -- 172.21.15.77:0/3134247986 shutdown_connections 2024-04-25T01:43:53.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.872+0000 7f0d5a658640 1 --2- 172.21.15.77:0/3134247986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d541537d0 0x7f0d5406bbf0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.872+0000 7f0d5a658640 1 --2- 172.21.15.77:0/3134247986 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0d54156110 0x7f0d54153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.872+0000 7f0d5a658640 1 --2- 172.21.15.77:0/3134247986 >> v2:172.21.15.121:3300/0 conn(0x7f0d540c85a0 0x7f0d540c9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.872+0000 7f0d5a658640 1 -- 172.21.15.77:0/3134247986 >> 172.21.15.77:0/3134247986 conn(0x7f0d540675b0 msgr2=0x7f0d540ad450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:53.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.872+0000 7f0d5a658640 1 -- 172.21.15.77:0/3134247986 shutdown_connections 2024-04-25T01:43:53.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.872+0000 7f0d5a658640 1 -- 172.21.15.77:0/3134247986 wait complete. 2024-04-25T01:43:53.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.873+0000 7f0d5a658640 1 Processor -- start 2024-04-25T01:43:53.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.873+0000 7f0d5a658640 1 -- start start 2024-04-25T01:43:53.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.874+0000 7f0d5a658640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d540c85a0 0x7f0d540c3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.874+0000 7f0d5a658640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0d541537d0 0x7f0d540c0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.874+0000 7f0d5a658640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d54156110 0x7f0d540ac310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.874+0000 7f0d5a658640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0d540c8b00 con 0x7f0d54156110 2024-04-25T01:43:53.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.874+0000 7f0d5a658640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0d540c8980 con 0x7f0d540c85a0 2024-04-25T01:43:53.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.874+0000 7f0d5a658640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f0d5406c130 con 0x7f0d541537d0 2024-04-25T01:43:53.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.874+0000 7f0d58bf5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d54156110 0x7f0d540ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.874+0000 7f0d58bf5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d54156110 0x7f0d540ac310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59218/0 (socket says 172.21.15.77:59218) 2024-04-25T01:43:53.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.874+0000 7f0d58bf5640 1 -- 172.21.15.77:0/293141332 learned_addr learned my addr 172.21.15.77:0/293141332 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:53.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.874+0000 7f0d53fff640 1 --2- 172.21.15.77:0/293141332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d540c85a0 0x7f0d540c3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.874+0000 7f0d537fe640 1 --2- 172.21.15.77:0/293141332 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0d541537d0 0x7f0d540c0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.874+0000 7f0d58bf5640 1 -- 172.21.15.77:0/293141332 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0d541537d0 msgr2=0x7f0d540c0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.874+0000 7f0d58bf5640 1 --2- 172.21.15.77:0/293141332 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0d541537d0 0x7f0d540c0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.874+0000 7f0d58bf5640 1 -- 172.21.15.77:0/293141332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d540c85a0 msgr2=0x7f0d540c3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.874+0000 7f0d58bf5640 1 --2- 172.21.15.77:0/293141332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d540c85a0 0x7f0d540c3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.874+0000 7f0d58bf5640 1 -- 172.21.15.77:0/293141332 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d540c1670 con 0x7f0d54156110 2024-04-25T01:43:53.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.874+0000 7f0d537fe640 1 --2- 172.21.15.77:0/293141332 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0d541537d0 0x7f0d540c0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:43:53.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.875+0000 7f0d58bf5640 1 --2- 172.21.15.77:0/293141332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d54156110 0x7f0d540ac310 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009f40 tx=0x7f0d4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:53.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.875+0000 7f0d50ff9640 1 -- 172.21.15.77:0/293141332 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c036050 con 0x7f0d54156110 2024-04-25T01:43:53.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.875+0000 7f0d50ff9640 1 -- 172.21.15.77:0/293141332 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d4c042070 con 0x7f0d54156110 2024-04-25T01:43:53.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.875+0000 7f0d50ff9640 1 -- 172.21.15.77:0/293141332 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c009510 con 0x7f0d54156110 2024-04-25T01:43:53.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.875+0000 7f0d5a658640 1 -- 172.21.15.77:0/293141332 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d540c1910 con 0x7f0d54156110 2024-04-25T01:43:53.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.875+0000 7f0d5a658640 1 -- 172.21.15.77:0/293141332 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d540c5560 con 0x7f0d54156110 2024-04-25T01:43:53.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.876+0000 7f0d5a658640 1 -- 172.21.15.77:0/293141332 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0d540c5350 con 0x7f0d54156110 2024-04-25T01:43:53.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.876+0000 7f0d50ff9640 1 -- 172.21.15.77:0/293141332 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0d4c007bf0 con 0x7f0d54156110 2024-04-25T01:43:53.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.876+0000 7f0d50ff9640 1 --2- 172.21.15.77:0/293141332 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0d4006be30 0x7f0d4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.877+0000 7f0d50ff9640 1 -- 172.21.15.77:0/293141332 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7f0d4c0ac060 con 0x7f0d54156110 2024-04-25T01:43:53.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.877+0000 7f0d53fff640 1 --2- 172.21.15.77:0/293141332 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0d4006be30 0x7f0d4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.877+0000 7f0d50ff9640 1 --2- 172.21.15.77:0/293141332 >> [v2:172.21.15.121:6800/2565483070,v1:172.21.15.121:6801/2565483070] conn(0x7f0d40076b60 0x7f0d40078fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.877+0000 7f0d50ff9640 1 -- 172.21.15.77:0/293141332 --> [v2:172.21.15.121:6800/2565483070,v1:172.21.15.121:6801/2565483070] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0d400796b0 con 0x7f0d40076b60 2024-04-25T01:43:53.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.877+0000 7f0d50ff9640 1 -- 172.21.15.77:0/293141332 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0d4c0b3050 con 0x7f0d54156110 2024-04-25T01:43:53.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.877+0000 7f0d53fff640 1 --2- 172.21.15.77:0/293141332 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0d4006be30 0x7f0d4006e2f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0d540cc4f0 tx=0x7f0d44009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:53.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.877+0000 7f0d537fe640 1 --2- 172.21.15.77:0/293141332 >> [v2:172.21.15.121:6800/2565483070,v1:172.21.15.121:6801/2565483070] conn(0x7f0d40076b60 0x7f0d40078fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.878+0000 7f0d537fe640 1 --2- 172.21.15.77:0/293141332 >> [v2:172.21.15.121:6800/2565483070,v1:172.21.15.121:6801/2565483070] conn(0x7f0d40076b60 0x7f0d40078fe0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:53.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.878+0000 7f0d50ff9640 1 -- 172.21.15.77:0/293141332 <== osd.4 v2:172.21.15.121:6800/2565483070 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0d400796b0 con 0x7f0d40076b60 2024-04-25T01:43:53.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.891+0000 7f0d5a658640 1 -- 172.21.15.77:0/293141332 --> [v2:172.21.15.121:6800/2565483070,v1:172.21.15.121:6801/2565483070] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0d54075d10 con 0x7f0d40076b60 2024-04-25T01:43:53.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.892+0000 7f0d50ff9640 1 -- 172.21.15.77:0/293141332 <== osd.4 v2:172.21.15.121:6800/2565483070 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0d54075d10 con 0x7f0d40076b60 2024-04-25T01:43:53.883 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T01:43:53.883 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T01:43:53.883 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T01:43:53.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.892+0000 7f0d5a658640 1 -- 172.21.15.77:0/293141332 >> [v2:172.21.15.121:6800/2565483070,v1:172.21.15.121:6801/2565483070] conn(0x7f0d40076b60 msgr2=0x7f0d40078fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.892+0000 7f0d5a658640 1 --2- 172.21.15.77:0/293141332 >> [v2:172.21.15.121:6800/2565483070,v1:172.21.15.121:6801/2565483070] conn(0x7f0d40076b60 0x7f0d40078fe0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.892+0000 7f0d5a658640 1 -- 172.21.15.77:0/293141332 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0d4006be30 msgr2=0x7f0d4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.892+0000 7f0d5a658640 1 --2- 172.21.15.77:0/293141332 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f0d4006be30 0x7f0d4006e2f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0d540cc4f0 tx=0x7f0d44009190 comp rx=0 tx=0).stop 2024-04-25T01:43:53.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.892+0000 7f0d5a658640 1 -- 172.21.15.77:0/293141332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d54156110 msgr2=0x7f0d540ac310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.892+0000 7f0d5a658640 1 --2- 172.21.15.77:0/293141332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d54156110 0x7f0d540ac310 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009f40 tx=0x7f0d4c004a40 comp rx=0 tx=0).stop 2024-04-25T01:43:53.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.892+0000 7f0d58bf5640 1 -- 172.21.15.77:0/293141332 reap_dead start 2024-04-25T01:43:53.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.892+0000 7f0d5a658640 1 -- 172.21.15.77:0/293141332 shutdown_connections 2024-04-25T01:43:53.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.892+0000 7f0d5a658640 1 -- 172.21.15.77:0/293141332 >> 172.21.15.77:0/293141332 conn(0x7f0d540675b0 msgr2=0x7f0d54152690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:53.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.892+0000 7f0d5a658640 1 -- 172.21.15.77:0/293141332 shutdown_connections 2024-04-25T01:43:53.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:53.892+0000 7f0d5a658640 1 -- 172.21.15.77:0/293141332 wait complete. 2024-04-25T01:43:53.894 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-25T01:43:53.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.000+0000 7fd8a1b9e640 1 Processor -- start 2024-04-25T01:43:53.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.000+0000 7fd8a1b9e640 1 -- start start 2024-04-25T01:43:53.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.001+0000 7fd8a1b9e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd89c06d470 0x7fd89c06d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.001+0000 7fd8a1b9e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd89c0c4d10 0x7fd89c0c2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.001+0000 7fd8a1b9e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd89c0acf70 con 0x7fd89c0c6c50 2024-04-25T01:43:53.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.001+0000 7fd8a1b9e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd89c0acd20 con 0x7fd89c0c4d10 2024-04-25T01:43:53.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.001+0000 7fd8a1b9e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd89c153120 con 0x7fd89c06d470 2024-04-25T01:43:53.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.001+0000 7fd89bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd89c0c4d10 0x7fd89c0c2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.001+0000 7fd89affd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd89c0c6c50 0x7fd89c0abf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52284/0 (socket says 172.21.15.77:52284) 2024-04-25T01:43:53.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.001+0000 7fd89affd640 1 -- 172.21.15.77:0/3989439340 learned_addr learned my addr 172.21.15.77:0/3989439340 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:43:53.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.001+0000 7fd89bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd89c0c4d10 0x7fd89c0c2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59226/0 (socket says 172.21.15.77:59226) 2024-04-25T01:43:53.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.001+0000 7fd89bfff640 1 -- 172.21.15.77:0/3989439340 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd89c06d470 msgr2=0x7fd89c06d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:53.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.001+0000 7fd89b7fe640 1 --2- 172.21.15.77:0/3989439340 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd89c06d470 0x7fd89c06d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.001+0000 7fd89bfff640 1 --2- 172.21.15.77:0/3989439340 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd89c06d470 0x7fd89c06d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.001+0000 7fd89a7fc640 1 -- 172.21.15.77:0/3989439340 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2500281350 0 0) 0x7fd89c0acf70 con 0x7fd89c0c6c50 2024-04-25T01:43:53.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.001+0000 7fd89bfff640 1 -- 172.21.15.77:0/3989439340 >> v1:172.21.15.77:6789/0 conn(0x7fd89c0c6c50 legacy=0x7fd89c0abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.001+0000 7fd89bfff640 1 -- 172.21.15.77:0/3989439340 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89c153400 con 0x7fd89c0c4d10 2024-04-25T01:43:53.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.002+0000 7fd89bfff640 1 --2- 172.21.15.77:0/3989439340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89c0c4d10 0x7fd89c0c2340 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd89400bfa0 tx=0x7fd89402c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a740a40deca54ecc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:53.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.002+0000 7fd89a7fc640 1 -- 172.21.15.77:0/3989439340 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89403a070 con 0x7fd89c0c4d10 2024-04-25T01:43:53.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.002+0000 7fd89a7fc640 1 -- 172.21.15.77:0/3989439340 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd894032480 con 0x7fd89c0c4d10 2024-04-25T01:43:53.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.002+0000 7fd89a7fc640 1 -- 172.21.15.77:0/3989439340 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd894032850 con 0x7fd89c0c4d10 2024-04-25T01:43:53.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.003+0000 7fd8a1b9e640 1 -- 172.21.15.77:0/3989439340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89c0c4d10 msgr2=0x7fd89c0c2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:53.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.003+0000 7fd8a1b9e640 1 --2- 172.21.15.77:0/3989439340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89c0c4d10 0x7fd89c0c2340 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd89400bfa0 tx=0x7fd89402c750 comp rx=0 tx=0).stop 2024-04-25T01:43:53.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.003+0000 7fd8a1b9e640 1 -- 172.21.15.77:0/3989439340 shutdown_connections 2024-04-25T01:43:53.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.003+0000 7fd8a1b9e640 1 --2- 172.21.15.77:0/3989439340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89c0c4d10 0x7fd89c0c2340 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.003+0000 7fd8a1b9e640 1 --2- 172.21.15.77:0/3989439340 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd89c06d470 0x7fd89c06d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:53.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.003+0000 7fd8a1b9e640 1 -- 172.21.15.77:0/3989439340 >> 172.21.15.77:0/3989439340 conn(0x7fd89c0c7580 msgr2=0x7fd89c0c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:53.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.003+0000 7fd8a1b9e640 1 -- 172.21.15.77:0/3989439340 shutdown_connections 2024-04-25T01:43:53.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.003+0000 7fd8a1b9e640 1 -- 172.21.15.77:0/3989439340 wait complete. 2024-04-25T01:43:53.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.004+0000 7fd8a1b9e640 1 Processor -- start 2024-04-25T01:43:53.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.004+0000 7fd8a1b9e640 1 -- start start 2024-04-25T01:43:53.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.005+0000 7fd8a1b9e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd89c06d470 0x7fd89c148580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.005+0000 7fd8a1b9e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89c0c4d10 0x7fd89c071c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.005+0000 7fd8a1b9e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd89c0c6c50 0x7fd89c1462d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:53.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.005+0000 7fd8a1b9e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd89c0ac820 con 0x7fd89c0c4d10 2024-04-25T01:43:53.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.005+0000 7fd8a1b9e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd89c0ac6a0 con 0x7fd89c0c6c50 2024-04-25T01:43:53.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.005+0000 7fd8a1b9e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd89c0c4080 con 0x7fd89c06d470 2024-04-25T01:43:53.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.005+0000 7fd89affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89c0c4d10 0x7fd89c071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:53.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.005+0000 7fd89affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89c0c4d10 0x7fd89c071c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59232/0 (socket says 172.21.15.77:59232) 2024-04-25T01:43:53.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.005+0000 7fd89affd640 1 -- 172.21.15.77:0/788191077 learned_addr learned my addr 172.21.15.77:0/788191077 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:54.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.005+0000 7fd89b7fe640 1 --2- 172.21.15.77:0/788191077 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd89c06d470 0x7fd89c148580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:54.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.005+0000 7fd89bfff640 1 --2- 172.21.15.77:0/788191077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd89c0c6c50 0x7fd89c1462d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:54.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.005+0000 7fd89affd640 1 -- 172.21.15.77:0/788191077 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd89c06d470 msgr2=0x7fd89c148580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.005+0000 7fd89affd640 1 --2- 172.21.15.77:0/788191077 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd89c06d470 0x7fd89c148580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.005+0000 7fd89affd640 1 -- 172.21.15.77:0/788191077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd89c0c6c50 msgr2=0x7fd89c1462d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.005+0000 7fd89affd640 1 --2- 172.21.15.77:0/788191077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd89c0c6c50 0x7fd89c1462d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.005+0000 7fd89affd640 1 -- 172.21.15.77:0/788191077 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89c1e7cb0 con 0x7fd89c0c4d10 2024-04-25T01:43:54.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.005+0000 7fd89affd640 1 --2- 172.21.15.77:0/788191077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89c0c4d10 0x7fd89c071c30 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd89000c440 tx=0x7fd89000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:54.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.006+0000 7fd883fff640 1 -- 172.21.15.77:0/788191077 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd890018070 con 0x7fd89c0c4d10 2024-04-25T01:43:54.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.006+0000 7fd883fff640 1 -- 172.21.15.77:0/788191077 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8900074e0 con 0x7fd89c0c4d10 2024-04-25T01:43:54.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.006+0000 7fd883fff640 1 -- 172.21.15.77:0/788191077 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd890004a20 con 0x7fd89c0c4d10 2024-04-25T01:43:54.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.006+0000 7fd8a1b9e640 1 -- 172.21.15.77:0/788191077 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd89c071430 con 0x7fd89c0c4d10 2024-04-25T01:43:54.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.006+0000 7fd8a1b9e640 1 -- 172.21.15.77:0/788191077 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd89c14aaa0 con 0x7fd89c0c4d10 2024-04-25T01:43:54.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.007+0000 7fd8a1b9e640 1 -- 172.21.15.77:0/788191077 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd89c04f500 con 0x7fd89c0c4d10 2024-04-25T01:43:54.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.007+0000 7fd883fff640 1 -- 172.21.15.77:0/788191077 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd89001b070 con 0x7fd89c0c4d10 2024-04-25T01:43:54.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.007+0000 7fd883fff640 1 --2- 172.21.15.77:0/788191077 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd88806be60 0x7fd88806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:54.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.007+0000 7fd89b7fe640 1 --2- 172.21.15.77:0/788191077 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd88806be60 0x7fd88806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:54.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.008+0000 7fd883fff640 1 -- 172.21.15.77:0/788191077 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7fd89008a500 con 0x7fd89c0c4d10 2024-04-25T01:43:54.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.008+0000 7fd89b7fe640 1 --2- 172.21.15.77:0/788191077 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd88806be60 0x7fd88806e320 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd89c0c65f0 tx=0x7fd88c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:54.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.012+0000 7fd883fff640 1 -- 172.21.15.77:0/788191077 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd8900583a0 con 0x7fd89c0c4d10 2024-04-25T01:43:54.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.185+0000 7fd8a1b9e640 1 -- 172.21.15.77:0/788191077 --> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fd89c1e7a60 con 0x7fd88806be60 2024-04-25T01:43:54.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.186+0000 7fd883fff640 1 -- 172.21.15.77:0/788191077 <== mgr.4098 v2:172.21.15.77:6832/4208232183 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd89c1e7a60 con 0x7fd88806be60 2024-04-25T01:43:54.177 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 4 to deep-scrub 2024-04-25T01:43:54.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.188+0000 7fd8a1b9e640 1 -- 172.21.15.77:0/788191077 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd88806be60 msgr2=0x7fd88806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.188+0000 7fd8a1b9e640 1 --2- 172.21.15.77:0/788191077 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd88806be60 0x7fd88806e320 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd89c0c65f0 tx=0x7fd88c008040 comp rx=0 tx=0).stop 2024-04-25T01:43:54.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.188+0000 7fd8a1b9e640 1 -- 172.21.15.77:0/788191077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89c0c4d10 msgr2=0x7fd89c071c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.188+0000 7fd8a1b9e640 1 --2- 172.21.15.77:0/788191077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89c0c4d10 0x7fd89c071c30 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd89000c440 tx=0x7fd89000c900 comp rx=0 tx=0).stop 2024-04-25T01:43:54.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.188+0000 7fd8a1b9e640 1 -- 172.21.15.77:0/788191077 shutdown_connections 2024-04-25T01:43:54.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.188+0000 7fd8a1b9e640 1 --2- 172.21.15.77:0/788191077 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd88806be60 0x7fd88806e320 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.188+0000 7fd8a1b9e640 1 --2- 172.21.15.77:0/788191077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89c0c4d10 0x7fd89c071c30 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.188+0000 7fd8a1b9e640 1 --2- 172.21.15.77:0/788191077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd89c0c6c50 0x7fd89c1462d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.188+0000 7fd8a1b9e640 1 --2- 172.21.15.77:0/788191077 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd89c06d470 0x7fd89c148580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.188+0000 7fd8a1b9e640 1 -- 172.21.15.77:0/788191077 >> 172.21.15.77:0/788191077 conn(0x7fd89c0c7580 msgr2=0x7fd89c0c5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:54.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.188+0000 7fd8a1b9e640 1 -- 172.21.15.77:0/788191077 shutdown_connections 2024-04-25T01:43:54.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.188+0000 7fd8a1b9e640 1 -- 172.21.15.77:0/788191077 wait complete. 2024-04-25T01:43:54.190 INFO:tasks.ceph:Scrubbing osd.5 2024-04-25T01:43:54.190 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-25T01:43:54.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.299+0000 7fe9c59a2640 1 Processor -- start 2024-04-25T01:43:54.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.299+0000 7fe9c59a2640 1 -- start start 2024-04-25T01:43:54.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.300+0000 7fe9c59a2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe9c00cabf0 0x7fe9c006b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:54.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.300+0000 7fe9c59a2640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe9c00c6230 0x7fe9c0160a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:54.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.300+0000 7fe9c59a2640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9c00cafd0 con 0x7fe9c00c7f40 2024-04-25T01:43:54.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.300+0000 7fe9c59a2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe9c00c6ea0 con 0x7fe9c00cabf0 2024-04-25T01:43:54.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.300+0000 7fe9c59a2640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fe9c00c7180 con 0x7fe9c00c6230 2024-04-25T01:43:54.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.300+0000 7fe9beffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe9c00cabf0 0x7fe9c006b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:54.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.300+0000 7fe9beffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe9c00cabf0 0x7fe9c006b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59242/0 (socket says 172.21.15.77:59242) 2024-04-25T01:43:54.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.300+0000 7fe9beffd640 1 -- 172.21.15.77:0/1209509676 learned_addr learned my addr 172.21.15.77:0/1209509676 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:54.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.300+0000 7fe9bf7fe640 1 --2- 172.21.15.77:0/1209509676 >> v2:172.21.15.121:3300/0 conn(0x7fe9c00c6230 0x7fe9c0160a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:54.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.300+0000 7fe9beffd640 1 -- 172.21.15.77:0/1209509676 >> v2:172.21.15.121:3300/0 conn(0x7fe9c00c6230 msgr2=0x7fe9c0160a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:54.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.300+0000 7fe9beffd640 1 --2- 172.21.15.77:0/1209509676 >> v2:172.21.15.121:3300/0 conn(0x7fe9c00c6230 0x7fe9c0160a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.300+0000 7fe9beffd640 1 -- 172.21.15.77:0/1209509676 >> v1:172.21.15.121:6789/0 conn(0x7fe9c00c7f40 legacy=0x7fe9c00c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.300+0000 7fe9beffd640 1 -- 172.21.15.77:0/1209509676 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c00c7460 con 0x7fe9c00cabf0 2024-04-25T01:43:54.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.301+0000 7fe9beffd640 1 --2- 172.21.15.77:0/1209509676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9c00cabf0 0x7fe9c006b110 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe9c008da90 tx=0x7fe9b002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=685f6a96ff21c7f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:54.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.301+0000 7fe9bdffb640 1 -- 172.21.15.77:0/1209509676 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0037070 con 0x7fe9c00cabf0 2024-04-25T01:43:54.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.301+0000 7fe9bdffb640 1 -- 172.21.15.77:0/1209509676 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9b0032440 con 0x7fe9c00cabf0 2024-04-25T01:43:54.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.301+0000 7fe9bdffb640 1 -- 172.21.15.77:0/1209509676 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0032810 con 0x7fe9c00cabf0 2024-04-25T01:43:54.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.301+0000 7fe9c59a2640 1 -- 172.21.15.77:0/1209509676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9c00cabf0 msgr2=0x7fe9c006b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.301+0000 7fe9c59a2640 1 --2- 172.21.15.77:0/1209509676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9c00cabf0 0x7fe9c006b110 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe9c008da90 tx=0x7fe9b002a1e0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.301+0000 7fe9c59a2640 1 -- 172.21.15.77:0/1209509676 shutdown_connections 2024-04-25T01:43:54.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.301+0000 7fe9c59a2640 1 --2- 172.21.15.77:0/1209509676 >> v2:172.21.15.121:3300/0 conn(0x7fe9c00c6230 0x7fe9c0160a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.301+0000 7fe9c59a2640 1 --2- 172.21.15.77:0/1209509676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9c00cabf0 0x7fe9c006b110 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.301+0000 7fe9c59a2640 1 -- 172.21.15.77:0/1209509676 >> 172.21.15.77:0/1209509676 conn(0x7fe9c00cb8b0 msgr2=0x7fe9c00cbcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:54.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.301+0000 7fe9c59a2640 1 -- 172.21.15.77:0/1209509676 shutdown_connections 2024-04-25T01:43:54.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.301+0000 7fe9c59a2640 1 -- 172.21.15.77:0/1209509676 wait complete. 2024-04-25T01:43:54.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.302+0000 7fe9c59a2640 1 Processor -- start 2024-04-25T01:43:54.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.303+0000 7fe9c59a2640 1 -- start start 2024-04-25T01:43:54.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.303+0000 7fe9c59a2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe9c00c6230 0x7fe9c00c4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:54.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.303+0000 7fe9c59a2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9c00cabf0 0x7fe9c00c3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:54.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.303+0000 7fe9c59a2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9c00c5410 0x7fe9c01ece50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:54.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.303+0000 7fe9c59a2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c006bd80 con 0x7fe9c00c5410 2024-04-25T01:43:54.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.303+0000 7fe9c59a2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c006bc00 con 0x7fe9c00cabf0 2024-04-25T01:43:54.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.303+0000 7fe9c59a2640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe9c00c9ec0 con 0x7fe9c00c6230 2024-04-25T01:43:54.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.303+0000 7fe9bf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9c00c5410 0x7fe9c01ece50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:54.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.303+0000 7fe9bf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9c00c5410 0x7fe9c01ece50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59246/0 (socket says 172.21.15.77:59246) 2024-04-25T01:43:54.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.303+0000 7fe9bf7fe640 1 -- 172.21.15.77:0/3822163961 learned_addr learned my addr 172.21.15.77:0/3822163961 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:54.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.304+0000 7fe9beffd640 1 --2- 172.21.15.77:0/3822163961 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe9c00c6230 0x7fe9c00c4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:54.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.304+0000 7fe9be7fc640 1 --2- 172.21.15.77:0/3822163961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9c00cabf0 0x7fe9c00c3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:54.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.304+0000 7fe9bf7fe640 1 -- 172.21.15.77:0/3822163961 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe9c00c6230 msgr2=0x7fe9c00c4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.304+0000 7fe9bf7fe640 1 --2- 172.21.15.77:0/3822163961 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe9c00c6230 0x7fe9c00c4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.304+0000 7fe9bf7fe640 1 -- 172.21.15.77:0/3822163961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9c00cabf0 msgr2=0x7fe9c00c3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.304+0000 7fe9bf7fe640 1 --2- 172.21.15.77:0/3822163961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9c00cabf0 0x7fe9c00c3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.304+0000 7fe9bf7fe640 1 -- 172.21.15.77:0/3822163961 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c01efa00 con 0x7fe9c00c5410 2024-04-25T01:43:54.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.304+0000 7fe9bf7fe640 1 --2- 172.21.15.77:0/3822163961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9c00c5410 0x7fe9c01ece50 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009dd0 tx=0x7fe9b800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:54.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.304+0000 7fe9a7fff640 1 -- 172.21.15.77:0/3822163961 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8018020 con 0x7fe9c00c5410 2024-04-25T01:43:54.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.304+0000 7fe9a7fff640 1 -- 172.21.15.77:0/3822163961 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9b8014480 con 0x7fe9c00c5410 2024-04-25T01:43:54.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.304+0000 7fe9c59a2640 1 -- 172.21.15.77:0/3822163961 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9c00c3340 con 0x7fe9c00c5410 2024-04-25T01:43:54.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.304+0000 7fe9a7fff640 1 -- 172.21.15.77:0/3822163961 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8014870 con 0x7fe9c00c5410 2024-04-25T01:43:54.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.304+0000 7fe9c59a2640 1 -- 172.21.15.77:0/3822163961 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9c01efca0 con 0x7fe9c00c5410 2024-04-25T01:43:54.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.305+0000 7fe9c59a2640 1 -- 172.21.15.77:0/3822163961 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe9c0075d10 con 0x7fe9c00c5410 2024-04-25T01:43:54.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.306+0000 7fe9a7fff640 1 -- 172.21.15.77:0/3822163961 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe9b8005d10 con 0x7fe9c00c5410 2024-04-25T01:43:54.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.306+0000 7fe9a7fff640 1 --2- 172.21.15.77:0/3822163961 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe9ac06be30 0x7fe9ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:54.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.306+0000 7fe9beffd640 1 --2- 172.21.15.77:0/3822163961 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe9ac06be30 0x7fe9ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:54.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.306+0000 7fe9a7fff640 1 -- 172.21.15.77:0/3822163961 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7fe9b808bcc0 con 0x7fe9c00c5410 2024-04-25T01:43:54.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.306+0000 7fe9a7fff640 1 --2- 172.21.15.77:0/3822163961 >> [v2:172.21.15.121:6805/2785294752,v1:172.21.15.121:6807/2785294752] conn(0x7fe9ac076b50 0x7fe9ac078fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:54.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.306+0000 7fe9a7fff640 1 -- 172.21.15.77:0/3822163961 --> [v2:172.21.15.121:6805/2785294752,v1:172.21.15.121:6807/2785294752] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe9ac0796a0 con 0x7fe9ac076b50 2024-04-25T01:43:54.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.306+0000 7fe9a7fff640 1 -- 172.21.15.77:0/3822163961 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe9b8090030 con 0x7fe9c00c5410 2024-04-25T01:43:54.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.306+0000 7fe9beffd640 1 --2- 172.21.15.77:0/3822163961 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe9ac06be30 0x7fe9ac06e2f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0034000 tx=0x7fe9b002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:54.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.306+0000 7fe9be7fc640 1 --2- 172.21.15.77:0/3822163961 >> [v2:172.21.15.121:6805/2785294752,v1:172.21.15.121:6807/2785294752] conn(0x7fe9ac076b50 0x7fe9ac078fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:54.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.307+0000 7fe9be7fc640 1 --2- 172.21.15.77:0/3822163961 >> [v2:172.21.15.121:6805/2785294752,v1:172.21.15.121:6807/2785294752] conn(0x7fe9ac076b50 0x7fe9ac078fd0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:54.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.308+0000 7fe9a7fff640 1 -- 172.21.15.77:0/3822163961 <== osd.5 v2:172.21.15.121:6805/2785294752 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe9ac0796a0 con 0x7fe9ac076b50 2024-04-25T01:43:54.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.320+0000 7fe9c59a2640 1 -- 172.21.15.77:0/3822163961 --> [v2:172.21.15.121:6805/2785294752,v1:172.21.15.121:6807/2785294752] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe9c0152960 con 0x7fe9ac076b50 2024-04-25T01:43:54.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.321+0000 7fe9a7fff640 1 -- 172.21.15.77:0/3822163961 <== osd.5 v2:172.21.15.121:6805/2785294752 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe9c0152960 con 0x7fe9ac076b50 2024-04-25T01:43:54.312 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T01:43:54.312 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T01:43:54.312 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T01:43:54.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.321+0000 7fe9c59a2640 1 -- 172.21.15.77:0/3822163961 >> [v2:172.21.15.121:6805/2785294752,v1:172.21.15.121:6807/2785294752] conn(0x7fe9ac076b50 msgr2=0x7fe9ac078fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.321+0000 7fe9c59a2640 1 --2- 172.21.15.77:0/3822163961 >> [v2:172.21.15.121:6805/2785294752,v1:172.21.15.121:6807/2785294752] conn(0x7fe9ac076b50 0x7fe9ac078fd0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.322+0000 7fe9c59a2640 1 -- 172.21.15.77:0/3822163961 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe9ac06be30 msgr2=0x7fe9ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.322+0000 7fe9c59a2640 1 --2- 172.21.15.77:0/3822163961 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe9ac06be30 0x7fe9ac06e2f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0034000 tx=0x7fe9b002e000 comp rx=0 tx=0).stop 2024-04-25T01:43:54.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.322+0000 7fe9c59a2640 1 -- 172.21.15.77:0/3822163961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9c00c5410 msgr2=0x7fe9c01ece50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.322+0000 7fe9c59a2640 1 --2- 172.21.15.77:0/3822163961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9c00c5410 0x7fe9c01ece50 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009dd0 tx=0x7fe9b800c490 comp rx=0 tx=0).stop 2024-04-25T01:43:54.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.322+0000 7fe9bf7fe640 1 -- 172.21.15.77:0/3822163961 reap_dead start 2024-04-25T01:43:54.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.322+0000 7fe9c59a2640 1 -- 172.21.15.77:0/3822163961 shutdown_connections 2024-04-25T01:43:54.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.322+0000 7fe9c59a2640 1 -- 172.21.15.77:0/3822163961 >> 172.21.15.77:0/3822163961 conn(0x7fe9c00cb8b0 msgr2=0x7fe9c00cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:54.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.322+0000 7fe9c59a2640 1 -- 172.21.15.77:0/3822163961 shutdown_connections 2024-04-25T01:43:54.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.322+0000 7fe9c59a2640 1 -- 172.21.15.77:0/3822163961 wait complete. 2024-04-25T01:43:54.323 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-25T01:43:54.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.431+0000 7f3b4904d640 1 Processor -- start 2024-04-25T01:43:54.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.431+0000 7f3b4904d640 1 -- start start 2024-04-25T01:43:54.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.431+0000 7f3b4904d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3b440c2550 0x7f3b440c1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:54.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.431+0000 7f3b4904d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b44156040 con 0x7f3b440c2930 2024-04-25T01:43:54.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.431+0000 7f3b4904d640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b441562c0 con 0x7f3b44153ac0 2024-04-25T01:43:54.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.431+0000 7f3b4904d640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f3b44156bf0 con 0x7f3b440c2550 2024-04-25T01:43:54.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.431+0000 7f3b4259c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3b440c2930 0x7f3b441533b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52300/0 (socket says 172.21.15.77:52300) 2024-04-25T01:43:54.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.431+0000 7f3b4259c640 1 -- 172.21.15.77:0/3779654837 learned_addr learned my addr 172.21.15.77:0/3779654837 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:43:54.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.432+0000 7f3b42d9d640 1 --2- 172.21.15.77:0/3779654837 >> v2:172.21.15.121:3300/0 conn(0x7f3b440c2550 0x7f3b440c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:54.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.432+0000 7f3b41d9b640 1 -- 172.21.15.77:0/3779654837 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4109827612 0 0) 0x7f3b34001110 con 0x7f3b440c2930 2024-04-25T01:43:54.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.432+0000 7f3b41d9b640 1 -- 172.21.15.77:0/3779654837 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b30003520 con 0x7f3b440c2930 2024-04-25T01:43:54.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.432+0000 7f3b41d9b640 1 -- 172.21.15.77:0/3779654837 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1468641437 0 0) 0x7f3b441562c0 con 0x7f3b44153ac0 2024-04-25T01:43:54.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.432+0000 7f3b41d9b640 1 -- 172.21.15.77:0/3779654837 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b34001110 con 0x7f3b44153ac0 2024-04-25T01:43:54.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.432+0000 7f3b41d9b640 1 -- 172.21.15.77:0/3779654837 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1739098198 0 0) 0x7f3b30003520 con 0x7f3b440c2930 2024-04-25T01:43:54.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.432+0000 7f3b42d9d640 1 -- 172.21.15.77:0/3779654837 >> v1:172.21.15.121:6789/0 conn(0x7f3b44153ac0 legacy=0x7f3b441595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.432+0000 7f3b42d9d640 1 -- 172.21.15.77:0/3779654837 >> v1:172.21.15.77:6789/0 conn(0x7f3b440c2930 legacy=0x7f3b441533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.432+0000 7f3b42d9d640 1 -- 172.21.15.77:0/3779654837 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b441565a0 con 0x7f3b440c2550 2024-04-25T01:43:54.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.433+0000 7f3b42d9d640 1 --2- 172.21.15.77:0/3779654837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b440c2550 0x7f3b440c1720 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c0097a0 tx=0x7f3b2c02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ab0c6ff4cefb864 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:54.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.433+0000 7f3b41d9b640 1 -- 172.21.15.77:0/3779654837 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c037070 con 0x7f3b440c2550 2024-04-25T01:43:54.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.433+0000 7f3b41d9b640 1 -- 172.21.15.77:0/3779654837 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b2c02abc0 con 0x7f3b440c2550 2024-04-25T01:43:54.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.433+0000 7f3b41d9b640 1 -- 172.21.15.77:0/3779654837 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b34001840 con 0x7f3b440c2550 2024-04-25T01:43:54.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.433+0000 7f3b4904d640 1 -- 172.21.15.77:0/3779654837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b440c2550 msgr2=0x7f3b440c1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.433+0000 7f3b4904d640 1 --2- 172.21.15.77:0/3779654837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b440c2550 0x7f3b440c1720 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c0097a0 tx=0x7f3b2c02a130 comp rx=0 tx=0).stop 2024-04-25T01:43:54.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.433+0000 7f3b4904d640 1 -- 172.21.15.77:0/3779654837 shutdown_connections 2024-04-25T01:43:54.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.433+0000 7f3b4904d640 1 --2- 172.21.15.77:0/3779654837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b440c2550 0x7f3b440c1720 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.433+0000 7f3b4904d640 1 -- 172.21.15.77:0/3779654837 >> 172.21.15.77:0/3779654837 conn(0x7f3b440a9690 msgr2=0x7f3b440a9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:54.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.434+0000 7f3b4904d640 1 -- 172.21.15.77:0/3779654837 shutdown_connections 2024-04-25T01:43:54.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.434+0000 7f3b4904d640 1 -- 172.21.15.77:0/3779654837 wait complete. 2024-04-25T01:43:54.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.435+0000 7f3b4904d640 1 Processor -- start 2024-04-25T01:43:54.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.435+0000 7f3b4904d640 1 -- start start 2024-04-25T01:43:54.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.436+0000 7f3b4904d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b440c2550 0x7f3b440ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:54.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.436+0000 7f3b4904d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3b440c2930 0x7f3b44154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:54.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.436+0000 7f3b4904d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b44155430 0x7f3b440aa990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:54.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.436+0000 7f3b4904d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3b440c2dc0 con 0x7f3b44155430 2024-04-25T01:43:54.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.436+0000 7f3b4904d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3b440a6fe0 con 0x7f3b440c2550 2024-04-25T01:43:54.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.436+0000 7f3b4904d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f3b440c2f40 con 0x7f3b440c2930 2024-04-25T01:43:54.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.436+0000 7f3b4359e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b44155430 0x7f3b440aa990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:54.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.436+0000 7f3b4359e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b44155430 0x7f3b440aa990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59262/0 (socket says 172.21.15.77:59262) 2024-04-25T01:43:54.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.436+0000 7f3b4359e640 1 -- 172.21.15.77:0/1830854839 learned_addr learned my addr 172.21.15.77:0/1830854839 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:54.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.436+0000 7f3b4359e640 1 -- 172.21.15.77:0/1830854839 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3b440c2930 msgr2=0x7f3b44154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.436+0000 7f3b4359e640 1 --2- 172.21.15.77:0/1830854839 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3b440c2930 0x7f3b44154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.436+0000 7f3b4359e640 1 -- 172.21.15.77:0/1830854839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b440c2550 msgr2=0x7f3b440ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.436+0000 7f3b42d9d640 1 --2- 172.21.15.77:0/1830854839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b440c2550 0x7f3b440ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:54.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.436+0000 7f3b4359e640 1 --2- 172.21.15.77:0/1830854839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b440c2550 0x7f3b440ac7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.436+0000 7f3b4359e640 1 -- 172.21.15.77:0/1830854839 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b441ec7f0 con 0x7f3b44155430 2024-04-25T01:43:54.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.436+0000 7f3b42d9d640 1 --2- 172.21.15.77:0/1830854839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b440c2550 0x7f3b440ac7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:43:54.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.436+0000 7f3b4359e640 1 --2- 172.21.15.77:0/1830854839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b44155430 0x7f3b440aa990 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00c710 tx=0x7f3b3c00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:54.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.436+0000 7f3b3b7fe640 1 -- 172.21.15.77:0/1830854839 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c003b70 con 0x7f3b44155430 2024-04-25T01:43:54.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.436+0000 7f3b3b7fe640 1 -- 172.21.15.77:0/1830854839 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b3c003d10 con 0x7f3b44155430 2024-04-25T01:43:54.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.436+0000 7f3b4904d640 1 -- 172.21.15.77:0/1830854839 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b441eba30 con 0x7f3b44155430 2024-04-25T01:43:54.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.436+0000 7f3b3b7fe640 1 -- 172.21.15.77:0/1830854839 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c00aa50 con 0x7f3b44155430 2024-04-25T01:43:54.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.436+0000 7f3b4904d640 1 -- 172.21.15.77:0/1830854839 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b441ebff0 con 0x7f3b44155430 2024-04-25T01:43:54.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.437+0000 7f3b4904d640 1 -- 172.21.15.77:0/1830854839 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b4404f500 con 0x7f3b44155430 2024-04-25T01:43:54.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.438+0000 7f3b3b7fe640 1 -- 172.21.15.77:0/1830854839 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b3c00abf0 con 0x7f3b44155430 2024-04-25T01:43:54.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.438+0000 7f3b3b7fe640 1 --2- 172.21.15.77:0/1830854839 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3b2406be30 0x7f3b2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:54.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.438+0000 7f3b3b7fe640 1 -- 172.21.15.77:0/1830854839 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7f3b3c08b2d0 con 0x7f3b44155430 2024-04-25T01:43:54.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.438+0000 7f3b42d9d640 1 --2- 172.21.15.77:0/1830854839 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3b2406be30 0x7f3b2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:54.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.439+0000 7f3b42d9d640 1 --2- 172.21.15.77:0/1830854839 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3b2406be30 0x7f3b2406e2f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c034000 tx=0x7f3b2c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:54.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.443+0000 7f3b3b7fe640 1 -- 172.21.15.77:0/1830854839 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3b3c00ce20 con 0x7f3b44155430 2024-04-25T01:43:54.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.620+0000 7f3b4904d640 1 -- 172.21.15.77:0/1830854839 --> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f3b440c6e60 con 0x7f3b2406be30 2024-04-25T01:43:54.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.621+0000 7f3b3b7fe640 1 -- 172.21.15.77:0/1830854839 <== mgr.4098 v2:172.21.15.77:6832/4208232183 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3b440c6e60 con 0x7f3b2406be30 2024-04-25T01:43:54.612 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 5 to deep-scrub 2024-04-25T01:43:54.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.623+0000 7f3b4904d640 1 -- 172.21.15.77:0/1830854839 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3b2406be30 msgr2=0x7f3b2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.623+0000 7f3b4904d640 1 --2- 172.21.15.77:0/1830854839 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3b2406be30 0x7f3b2406e2f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c034000 tx=0x7f3b2c02e000 comp rx=0 tx=0).stop 2024-04-25T01:43:54.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.623+0000 7f3b4904d640 1 -- 172.21.15.77:0/1830854839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b44155430 msgr2=0x7f3b440aa990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.623+0000 7f3b4904d640 1 --2- 172.21.15.77:0/1830854839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b44155430 0x7f3b440aa990 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00c710 tx=0x7f3b3c00cbd0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.623+0000 7f3b4904d640 1 -- 172.21.15.77:0/1830854839 shutdown_connections 2024-04-25T01:43:54.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.623+0000 7f3b4904d640 1 --2- 172.21.15.77:0/1830854839 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f3b2406be30 0x7f3b2406e2f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.623+0000 7f3b4904d640 1 --2- 172.21.15.77:0/1830854839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b44155430 0x7f3b440aa990 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.623+0000 7f3b4904d640 1 --2- 172.21.15.77:0/1830854839 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3b440c2930 0x7f3b44154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.623+0000 7f3b4904d640 1 --2- 172.21.15.77:0/1830854839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b440c2550 0x7f3b440ac7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.623+0000 7f3b4904d640 1 -- 172.21.15.77:0/1830854839 >> 172.21.15.77:0/1830854839 conn(0x7f3b440a9690 msgr2=0x7f3b4414eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:54.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.623+0000 7f3b4904d640 1 -- 172.21.15.77:0/1830854839 shutdown_connections 2024-04-25T01:43:54.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.623+0000 7f3b4904d640 1 -- 172.21.15.77:0/1830854839 wait complete. 2024-04-25T01:43:54.625 INFO:tasks.ceph:Scrubbing osd.6 2024-04-25T01:43:54.625 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-25T01:43:54.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.736+0000 7f3790d6a640 1 Processor -- start 2024-04-25T01:43:54.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.736+0000 7f3790d6a640 1 -- start start 2024-04-25T01:43:54.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.737+0000 7f3790d6a640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f378c0c3330 0x7f378c0c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:54.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.737+0000 7f3790d6a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f378c14ac90 con 0x7f378c1573e0 2024-04-25T01:43:54.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.737+0000 7f3790d6a640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f378c153ee0 con 0x7f378c06bb50 2024-04-25T01:43:54.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.737+0000 7f3790d6a640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f378c1541c0 con 0x7f378c0c3330 2024-04-25T01:43:54.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.737+0000 7f378ad9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f378c1573e0 0x7f378c157810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52312/0 (socket says 172.21.15.77:52312) 2024-04-25T01:43:54.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.737+0000 7f378ad9d640 1 -- 172.21.15.77:0/3429885029 learned_addr learned my addr 172.21.15.77:0/3429885029 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:43:54.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.737+0000 7f378a59c640 1 --2- 172.21.15.77:0/3429885029 >> v2:172.21.15.121:3300/0 conn(0x7f378c0c3330 0x7f378c0c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:54.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.737+0000 7f378959a640 1 -- 172.21.15.77:0/3429885029 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 550459390 0 0) 0x7f378c14ac90 con 0x7f378c1573e0 2024-04-25T01:43:54.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.737+0000 7f378959a640 1 -- 172.21.15.77:0/3429885029 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3774003520 con 0x7f378c1573e0 2024-04-25T01:43:54.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.738+0000 7f378959a640 1 -- 172.21.15.77:0/3429885029 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1226237524 0 0) 0x7f3774003520 con 0x7f378c1573e0 2024-04-25T01:43:54.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.738+0000 7f378959a640 1 -- 172.21.15.77:0/3429885029 >> v2:172.21.15.121:3300/0 conn(0x7f378c0c3330 msgr2=0x7f378c0c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:54.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.738+0000 7f378959a640 1 --2- 172.21.15.77:0/3429885029 >> v2:172.21.15.121:3300/0 conn(0x7f378c0c3330 0x7f378c0c3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.738+0000 7f378959a640 1 -- 172.21.15.77:0/3429885029 >> v1:172.21.15.121:6789/0 conn(0x7f378c06bb50 legacy=0x7f378c06bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.738+0000 7f378959a640 1 -- 172.21.15.77:0/3429885029 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f378c1544a0 con 0x7f378c1573e0 2024-04-25T01:43:54.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.738+0000 7f378959a640 1 -- 172.21.15.77:0/3429885029 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7f37840019f0 con 0x7f378c1573e0 2024-04-25T01:43:54.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.738+0000 7f378959a640 1 -- 172.21.15.77:0/3429885029 >> v1:172.21.15.77:6789/0 conn(0x7f378c1573e0 legacy=0x7f378c157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.738+0000 7f378959a640 1 --2- 172.21.15.77:0/3429885029 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3774003a20 0x7f3774003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:54.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.738+0000 7f378959a640 1 --2- 172.21.15.77:0/3429885029 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3774004800 0x7f3774004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:54.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.738+0000 7f378959a640 1 --2- 172.21.15.77:0/3429885029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37740052c0 0x7f377400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:54.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.738+0000 7f378959a640 1 -- 172.21.15.77:0/3429885029 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f378c1541c0 con 0x7f3774003a20 2024-04-25T01:43:54.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.738+0000 7f378959a640 1 -- 172.21.15.77:0/3429885029 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f377400c200 con 0x7f37740052c0 2024-04-25T01:43:54.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.738+0000 7f378959a640 1 -- 172.21.15.77:0/3429885029 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f377400c400 con 0x7f3774004800 2024-04-25T01:43:54.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.738+0000 7f378a59c640 1 --2- 172.21.15.77:0/3429885029 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3774003a20 0x7f3774003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:54.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.738+0000 7f378ad9d640 1 --2- 172.21.15.77:0/3429885029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37740052c0 0x7f377400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:54.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.738+0000 7f3789d9b640 1 --2- 172.21.15.77:0/3429885029 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3774004800 0x7f3774004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:54.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.738+0000 7f378a59c640 1 -- 172.21.15.77:0/3429885029 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3774004800 msgr2=0x7f3774004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:54.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.738+0000 7f378a59c640 1 --2- 172.21.15.77:0/3429885029 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3774004800 0x7f3774004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.738+0000 7f378a59c640 1 -- 172.21.15.77:0/3429885029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37740052c0 msgr2=0x7f377400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:54.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.738+0000 7f378a59c640 1 --2- 172.21.15.77:0/3429885029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37740052c0 0x7f377400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.738+0000 7f378ad9d640 1 -- 172.21.15.77:0/3429885029 reap_dead start 2024-04-25T01:43:54.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.738+0000 7f378a59c640 1 -- 172.21.15.77:0/3429885029 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3774003520 con 0x7f3774003a20 2024-04-25T01:43:54.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.738+0000 7f3789d9b640 1 --2- 172.21.15.77:0/3429885029 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3774004800 0x7f3774004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:43:54.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.739+0000 7f378a59c640 1 --2- 172.21.15.77:0/3429885029 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3774003a20 0x7f3774003e40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f377c009ac0 tx=0x7f3774005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88be4578e48f57c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:54.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.739+0000 7f378959a640 1 -- 172.21.15.77:0/3429885029 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c036070 con 0x7f3774003a20 2024-04-25T01:43:54.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.739+0000 7f378959a640 1 -- 172.21.15.77:0/3429885029 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f377c031400 con 0x7f3774003a20 2024-04-25T01:43:54.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.739+0000 7f378959a640 1 -- 172.21.15.77:0/3429885029 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c009690 con 0x7f3774003a20 2024-04-25T01:43:54.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.739+0000 7f3790d6a640 1 -- 172.21.15.77:0/3429885029 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3774003a20 msgr2=0x7f3774003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.739+0000 7f3790d6a640 1 --2- 172.21.15.77:0/3429885029 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3774003a20 0x7f3774003e40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f377c009ac0 tx=0x7f3774005830 comp rx=0 tx=0).stop 2024-04-25T01:43:54.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.740+0000 7f3790d6a640 1 -- 172.21.15.77:0/3429885029 shutdown_connections 2024-04-25T01:43:54.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.740+0000 7f3790d6a640 1 --2- 172.21.15.77:0/3429885029 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3774003a20 0x7f3774003e40 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.740+0000 7f3790d6a640 1 -- 172.21.15.77:0/3429885029 >> 172.21.15.77:0/3429885029 conn(0x7f378c0a9230 msgr2=0x7f378c0a9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:54.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.740+0000 7f3790d6a640 1 -- 172.21.15.77:0/3429885029 shutdown_connections 2024-04-25T01:43:54.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.740+0000 7f3790d6a640 1 -- 172.21.15.77:0/3429885029 wait complete. 2024-04-25T01:43:54.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.741+0000 7f3790d6a640 1 Processor -- start 2024-04-25T01:43:54.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.741+0000 7f3790d6a640 1 -- start start 2024-04-25T01:43:54.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.742+0000 7f3790d6a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3774003a20 0x7f378c1ed680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:54.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.742+0000 7f3790d6a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f378c0c6cb0 0x7f378c0c4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:54.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.742+0000 7f3790d6a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f378c1471c0 0x7f378c147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:54.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.742+0000 7f3790d6a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f378c0c3890 con 0x7f378c1471c0 2024-04-25T01:43:54.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.742+0000 7f3790d6a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f378c0c3710 con 0x7f378c0c6cb0 2024-04-25T01:43:54.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.742+0000 7f3790d6a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f378c0c3a10 con 0x7f3774003a20 2024-04-25T01:43:54.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.742+0000 7f378ad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f378c1471c0 0x7f378c147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:54.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.742+0000 7f378ad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f378c1471c0 0x7f378c147670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59284/0 (socket says 172.21.15.77:59284) 2024-04-25T01:43:54.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.742+0000 7f378ad9d640 1 -- 172.21.15.77:0/349288044 learned_addr learned my addr 172.21.15.77:0/349288044 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:54.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.742+0000 7f3789d9b640 1 --2- 172.21.15.77:0/349288044 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f378c0c6cb0 0x7f378c0c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:54.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.742+0000 7f378a59c640 1 --2- 172.21.15.77:0/349288044 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3774003a20 0x7f378c1ed680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:54.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.742+0000 7f378ad9d640 1 -- 172.21.15.77:0/349288044 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3774003a20 msgr2=0x7f378c1ed680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.742+0000 7f378ad9d640 1 --2- 172.21.15.77:0/349288044 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3774003a20 0x7f378c1ed680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.742+0000 7f378ad9d640 1 -- 172.21.15.77:0/349288044 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f378c0c6cb0 msgr2=0x7f378c0c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.742+0000 7f378ad9d640 1 --2- 172.21.15.77:0/349288044 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f378c0c6cb0 0x7f378c0c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.742+0000 7f378ad9d640 1 -- 172.21.15.77:0/349288044 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f378c0c5a20 con 0x7f378c1471c0 2024-04-25T01:43:54.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.742+0000 7f378ad9d640 1 --2- 172.21.15.77:0/349288044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f378c1471c0 0x7f378c147670 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f378c0a9090 tx=0x7f3784007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:54.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.742+0000 7f377affd640 1 -- 172.21.15.77:0/349288044 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378400aae0 con 0x7f378c1471c0 2024-04-25T01:43:54.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.742+0000 7f377affd640 1 -- 172.21.15.77:0/349288044 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3784018070 con 0x7f378c1471c0 2024-04-25T01:43:54.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.742+0000 7f3790d6a640 1 -- 172.21.15.77:0/349288044 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f378c0c5d00 con 0x7f378c1471c0 2024-04-25T01:43:54.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.742+0000 7f377affd640 1 -- 172.21.15.77:0/349288044 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37840133f0 con 0x7f378c1471c0 2024-04-25T01:43:54.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.742+0000 7f3790d6a640 1 -- 172.21.15.77:0/349288044 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f378c155ad0 con 0x7f378c1471c0 2024-04-25T01:43:54.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.743+0000 7f3790d6a640 1 -- 172.21.15.77:0/349288044 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f378c075d10 con 0x7f378c1471c0 2024-04-25T01:43:54.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.744+0000 7f377affd640 1 -- 172.21.15.77:0/349288044 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3784013590 con 0x7f378c1471c0 2024-04-25T01:43:54.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.744+0000 7f377affd640 1 --2- 172.21.15.77:0/349288044 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f376c06be60 0x7f376c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:54.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.744+0000 7f377affd640 1 -- 172.21.15.77:0/349288044 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7f378408c230 con 0x7f378c1471c0 2024-04-25T01:43:54.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.744+0000 7f378a59c640 1 --2- 172.21.15.77:0/349288044 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f376c06be60 0x7f376c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:54.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.744+0000 7f377affd640 1 --2- 172.21.15.77:0/349288044 >> [v2:172.21.15.121:6818/523906818,v1:172.21.15.121:6820/523906818] conn(0x7f376c076b80 0x7f376c079000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:54.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.744+0000 7f377affd640 1 -- 172.21.15.77:0/349288044 --> [v2:172.21.15.121:6818/523906818,v1:172.21.15.121:6820/523906818] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f378401ee50 con 0x7f376c076b80 2024-04-25T01:43:54.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.744+0000 7f377affd640 1 -- 172.21.15.77:0/349288044 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f378408c6c0 con 0x7f378c1471c0 2024-04-25T01:43:54.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.745+0000 7f378a59c640 1 --2- 172.21.15.77:0/349288044 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f376c06be60 0x7f376c06e320 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f377c033000 tx=0x7f377c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:54.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.745+0000 7f3789d9b640 1 --2- 172.21.15.77:0/349288044 >> [v2:172.21.15.121:6818/523906818,v1:172.21.15.121:6820/523906818] conn(0x7f376c076b80 0x7f376c079000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:54.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.745+0000 7f3789d9b640 1 --2- 172.21.15.77:0/349288044 >> [v2:172.21.15.121:6818/523906818,v1:172.21.15.121:6820/523906818] conn(0x7f376c076b80 0x7f376c079000 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:54.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.746+0000 7f377affd640 1 -- 172.21.15.77:0/349288044 <== osd.6 v2:172.21.15.121:6818/523906818 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f378401ee50 con 0x7f376c076b80 2024-04-25T01:43:54.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.759+0000 7f3790d6a640 1 -- 172.21.15.77:0/349288044 --> [v2:172.21.15.121:6818/523906818,v1:172.21.15.121:6820/523906818] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f378c06b6d0 con 0x7f376c076b80 2024-04-25T01:43:54.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.759+0000 7f377affd640 1 -- 172.21.15.77:0/349288044 <== osd.6 v2:172.21.15.121:6818/523906818 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f378c06b6d0 con 0x7f376c076b80 2024-04-25T01:43:54.750 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T01:43:54.750 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T01:43:54.751 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T01:43:54.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.759+0000 7f3790d6a640 1 -- 172.21.15.77:0/349288044 >> [v2:172.21.15.121:6818/523906818,v1:172.21.15.121:6820/523906818] conn(0x7f376c076b80 msgr2=0x7f376c079000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.759+0000 7f3790d6a640 1 --2- 172.21.15.77:0/349288044 >> [v2:172.21.15.121:6818/523906818,v1:172.21.15.121:6820/523906818] conn(0x7f376c076b80 0x7f376c079000 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.760+0000 7f3790d6a640 1 -- 172.21.15.77:0/349288044 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f376c06be60 msgr2=0x7f376c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.760+0000 7f3790d6a640 1 --2- 172.21.15.77:0/349288044 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f376c06be60 0x7f376c06e320 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f377c033000 tx=0x7f377c008030 comp rx=0 tx=0).stop 2024-04-25T01:43:54.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.760+0000 7f3790d6a640 1 -- 172.21.15.77:0/349288044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f378c1471c0 msgr2=0x7f378c147670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.760+0000 7f3790d6a640 1 --2- 172.21.15.77:0/349288044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f378c1471c0 0x7f378c147670 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f378c0a9090 tx=0x7f3784007b00 comp rx=0 tx=0).stop 2024-04-25T01:43:54.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.760+0000 7f378ad9d640 1 -- 172.21.15.77:0/349288044 reap_dead start 2024-04-25T01:43:54.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.760+0000 7f3790d6a640 1 -- 172.21.15.77:0/349288044 shutdown_connections 2024-04-25T01:43:54.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.760+0000 7f3790d6a640 1 -- 172.21.15.77:0/349288044 >> 172.21.15.77:0/349288044 conn(0x7f378c0a9230 msgr2=0x7f378c0c2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:54.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.760+0000 7f3790d6a640 1 -- 172.21.15.77:0/349288044 shutdown_connections 2024-04-25T01:43:54.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.760+0000 7f3790d6a640 1 -- 172.21.15.77:0/349288044 wait complete. 2024-04-25T01:43:54.761 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-25T01:43:54.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.867+0000 7f4fcde3f640 1 Processor -- start 2024-04-25T01:43:54.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.867+0000 7f4fcde3f640 1 -- start start 2024-04-25T01:43:54.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.868+0000 7f4fcde3f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4fc80cbef0 0x7f4fc8156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:54.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.868+0000 7f4fcde3f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fc80c6ca0 con 0x7f4fc815a0e0 2024-04-25T01:43:54.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.868+0000 7f4fcde3f640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fc80c66e0 con 0x7f4fc814fd20 2024-04-25T01:43:54.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.868+0000 7f4fcde3f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f4fc80c69c0 con 0x7f4fc80cbef0 2024-04-25T01:43:54.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.868+0000 7f4fc77fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4fc80cbef0 0x7f4fc8156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:54.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.868+0000 7f4fc77fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4fc80cbef0 0x7f4fc8156ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59298/0 (socket says 172.21.15.77:59298) 2024-04-25T01:43:54.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.868+0000 7f4fc6ffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4fc815a0e0 0x7f4fc80c9810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52314/0 (socket says 172.21.15.77:52314) 2024-04-25T01:43:54.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.868+0000 7f4fc77fe640 1 -- 172.21.15.77:0/1119456660 learned_addr learned my addr 172.21.15.77:0/1119456660 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:54.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.868+0000 7f4fc77fe640 1 -- 172.21.15.77:0/1119456660 >> v1:172.21.15.121:6789/0 conn(0x7f4fc814fd20 legacy=0x7f4fc8160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:54.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.868+0000 7f4fc77fe640 1 -- 172.21.15.77:0/1119456660 >> v1:172.21.15.77:6789/0 conn(0x7f4fc815a0e0 legacy=0x7f4fc80c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.868+0000 7f4fc77fe640 1 -- 172.21.15.77:0/1119456660 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc81598e0 con 0x7f4fc80cbef0 2024-04-25T01:43:54.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.868+0000 7f4fc67fc640 1 -- 172.21.15.77:0/1119456660 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1135406663 0 0) 0x7f4fbc001110 con 0x7f4fc815a0e0 2024-04-25T01:43:54.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.869+0000 7f4fc77fe640 1 --2- 172.21.15.77:0/1119456660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fc80cbef0 0x7f4fc8156ba0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8009870 tx=0x7f4fb802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504595a84fb3d525 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:54.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.869+0000 7f4fc67fc640 1 -- 172.21.15.77:0/1119456660 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8037070 con 0x7f4fc80cbef0 2024-04-25T01:43:54.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.869+0000 7f4fc67fc640 1 -- 172.21.15.77:0/1119456660 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fb8032440 con 0x7f4fc80cbef0 2024-04-25T01:43:54.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.869+0000 7f4fc67fc640 1 -- 172.21.15.77:0/1119456660 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8032810 con 0x7f4fc80cbef0 2024-04-25T01:43:54.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.870+0000 7f4fcde3f640 1 -- 172.21.15.77:0/1119456660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fc80cbef0 msgr2=0x7f4fc8156ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.870+0000 7f4fcde3f640 1 --2- 172.21.15.77:0/1119456660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fc80cbef0 0x7f4fc8156ba0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8009870 tx=0x7f4fb802a2a0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.870+0000 7f4fcde3f640 1 -- 172.21.15.77:0/1119456660 shutdown_connections 2024-04-25T01:43:54.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.870+0000 7f4fcde3f640 1 --2- 172.21.15.77:0/1119456660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fc80cbef0 0x7f4fc8156ba0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.870+0000 7f4fcde3f640 1 -- 172.21.15.77:0/1119456660 >> 172.21.15.77:0/1119456660 conn(0x7f4fc8067080 msgr2=0x7f4fc8067460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:54.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.870+0000 7f4fcde3f640 1 -- 172.21.15.77:0/1119456660 shutdown_connections 2024-04-25T01:43:54.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.870+0000 7f4fcde3f640 1 -- 172.21.15.77:0/1119456660 wait complete. 2024-04-25T01:43:54.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.871+0000 7f4fcde3f640 1 Processor -- start 2024-04-25T01:43:54.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.871+0000 7f4fcde3f640 1 -- start start 2024-04-25T01:43:54.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.872+0000 7f4fcde3f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4fc80cbef0 0x7f4fc8150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:54.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.872+0000 7f4fcde3f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fc814fd20 0x7f4fc80c21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:54.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.872+0000 7f4fcde3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fc815a0e0 0x7f4fc80c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:54.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.872+0000 7f4fcde3f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc815a530 con 0x7f4fc814fd20 2024-04-25T01:43:54.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.872+0000 7f4fcde3f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc806d0d0 con 0x7f4fc815a0e0 2024-04-25T01:43:54.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.872+0000 7f4fcde3f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f4fc80c6290 con 0x7f4fc80cbef0 2024-04-25T01:43:54.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.872+0000 7f4fc6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fc814fd20 0x7f4fc80c21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:54.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.872+0000 7f4fc6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fc814fd20 0x7f4fc80c21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59314/0 (socket says 172.21.15.77:59314) 2024-04-25T01:43:54.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.872+0000 7f4fc6ffd640 1 -- 172.21.15.77:0/3633784310 learned_addr learned my addr 172.21.15.77:0/3633784310 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:54.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.872+0000 7f4fc77fe640 1 --2- 172.21.15.77:0/3633784310 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4fc80cbef0 0x7f4fc8150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:54.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.872+0000 7f4fc7fff640 1 --2- 172.21.15.77:0/3633784310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fc815a0e0 0x7f4fc80c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:54.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.872+0000 7f4fc6ffd640 1 -- 172.21.15.77:0/3633784310 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4fc80cbef0 msgr2=0x7f4fc8150b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.872+0000 7f4fc6ffd640 1 --2- 172.21.15.77:0/3633784310 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4fc80cbef0 0x7f4fc8150b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.872+0000 7f4fc6ffd640 1 -- 172.21.15.77:0/3633784310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fc815a0e0 msgr2=0x7f4fc80c4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:54.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.872+0000 7f4fc6ffd640 1 --2- 172.21.15.77:0/3633784310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fc815a0e0 0x7f4fc80c4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:54.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.872+0000 7f4fc6ffd640 1 -- 172.21.15.77:0/3633784310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc8151120 con 0x7f4fc814fd20 2024-04-25T01:43:54.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.872+0000 7f4fc6ffd640 1 --2- 172.21.15.77:0/3633784310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fc814fd20 0x7f4fc80c21a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc00c3f0 tx=0x7f4fbc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:54.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.872+0000 7f4faffff640 1 -- 172.21.15.77:0/3633784310 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc0074e0 con 0x7f4fc814fd20 2024-04-25T01:43:54.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.873+0000 7f4faffff640 1 -- 172.21.15.77:0/3633784310 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fbc0047e0 con 0x7f4fc814fd20 2024-04-25T01:43:54.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.873+0000 7f4fcde3f640 1 -- 172.21.15.77:0/3633784310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc80c16c0 con 0x7f4fc814fd20 2024-04-25T01:43:54.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.873+0000 7f4faffff640 1 -- 172.21.15.77:0/3633784310 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc004c10 con 0x7f4fc814fd20 2024-04-25T01:43:54.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.873+0000 7f4fcde3f640 1 -- 172.21.15.77:0/3633784310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc80c5360 con 0x7f4fc814fd20 2024-04-25T01:43:54.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.873+0000 7f4fcde3f640 1 -- 172.21.15.77:0/3633784310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fc80c7a00 con 0x7f4fc814fd20 2024-04-25T01:43:54.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.874+0000 7f4faffff640 1 -- 172.21.15.77:0/3633784310 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4fbc011070 con 0x7f4fc814fd20 2024-04-25T01:43:54.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.874+0000 7f4faffff640 1 --2- 172.21.15.77:0/3633784310 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4fb406be60 0x7f4fb406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:54.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.875+0000 7f4fc77fe640 1 --2- 172.21.15.77:0/3633784310 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4fb406be60 0x7f4fb406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:54.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.875+0000 7f4faffff640 1 -- 172.21.15.77:0/3633784310 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7f4fbc08af00 con 0x7f4fc814fd20 2024-04-25T01:43:54.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.875+0000 7f4fc77fe640 1 --2- 172.21.15.77:0/3633784310 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4fb406be60 0x7f4fb406e320 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8034000 tx=0x7f4fb802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:54.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:54.879+0000 7f4faffff640 1 -- 172.21.15.77:0/3633784310 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4fc80c7a00 con 0x7f4fc814fd20 2024-04-25T01:43:55.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.053+0000 7f4fcde3f640 1 -- 172.21.15.77:0/3633784310 --> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f4fc804f500 con 0x7f4fb406be60 2024-04-25T01:43:55.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.053+0000 7f4faffff640 1 -- 172.21.15.77:0/3633784310 <== mgr.4098 v2:172.21.15.77:6832/4208232183 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4fc804f500 con 0x7f4fb406be60 2024-04-25T01:43:55.044 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 6 to deep-scrub 2024-04-25T01:43:55.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.055+0000 7f4fcde3f640 1 -- 172.21.15.77:0/3633784310 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4fb406be60 msgr2=0x7f4fb406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:55.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.055+0000 7f4fcde3f640 1 --2- 172.21.15.77:0/3633784310 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4fb406be60 0x7f4fb406e320 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8034000 tx=0x7f4fb802e000 comp rx=0 tx=0).stop 2024-04-25T01:43:55.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.055+0000 7f4fcde3f640 1 -- 172.21.15.77:0/3633784310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fc814fd20 msgr2=0x7f4fc80c21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:55.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.055+0000 7f4fcde3f640 1 --2- 172.21.15.77:0/3633784310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fc814fd20 0x7f4fc80c21a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc00c3f0 tx=0x7f4fbc00c8b0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.055+0000 7f4fcde3f640 1 -- 172.21.15.77:0/3633784310 shutdown_connections 2024-04-25T01:43:55.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.055+0000 7f4fcde3f640 1 --2- 172.21.15.77:0/3633784310 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f4fb406be60 0x7f4fb406e320 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.055+0000 7f4fcde3f640 1 --2- 172.21.15.77:0/3633784310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fc814fd20 0x7f4fc80c21a0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.055+0000 7f4fcde3f640 1 --2- 172.21.15.77:0/3633784310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fc815a0e0 0x7f4fc80c4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.055+0000 7f4fcde3f640 1 --2- 172.21.15.77:0/3633784310 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4fc80cbef0 0x7f4fc8150b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.055+0000 7f4fcde3f640 1 -- 172.21.15.77:0/3633784310 >> 172.21.15.77:0/3633784310 conn(0x7f4fc8067080 msgr2=0x7f4fc80c8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:55.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.055+0000 7f4fcde3f640 1 -- 172.21.15.77:0/3633784310 shutdown_connections 2024-04-25T01:43:55.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.055+0000 7f4fcde3f640 1 -- 172.21.15.77:0/3633784310 wait complete. 2024-04-25T01:43:55.057 INFO:tasks.ceph:Scrubbing osd.7 2024-04-25T01:43:55.057 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-25T01:43:55.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.167+0000 7f1052134640 1 Processor -- start 2024-04-25T01:43:55.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.167+0000 7f1052134640 1 -- start start 2024-04-25T01:43:55.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.168+0000 7f1052134640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f104c06c260 0x7f104c0c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:55.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.168+0000 7f1052134640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f104c1573e0 0x7f104c157810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:55.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.168+0000 7f1052134640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f104c14ac90 con 0x7f104c0c3330 2024-04-25T01:43:55.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.168+0000 7f1052134640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f104c153ee0 con 0x7f104c06c260 2024-04-25T01:43:55.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.168+0000 7f1052134640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f104c1541c0 con 0x7f104c1573e0 2024-04-25T01:43:55.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.168+0000 7f104affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f104c06c260 0x7f104c0c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:55.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.168+0000 7f104b7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f104c0c3330 0x7f104c06bb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52320/0 (socket says 172.21.15.77:52320) 2024-04-25T01:43:55.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.168+0000 7f104b7fe640 1 -- 172.21.15.77:0/2749751326 learned_addr learned my addr 172.21.15.77:0/2749751326 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:43:55.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.168+0000 7f104bfff640 1 --2- 172.21.15.77:0/2749751326 >> v2:172.21.15.121:3300/0 conn(0x7f104c1573e0 0x7f104c157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:55.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.168+0000 7f104a7fc640 1 -- 172.21.15.77:0/2749751326 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3803411308 0 0) 0x7f104c14ac90 con 0x7f104c0c3330 2024-04-25T01:43:55.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.168+0000 7f104a7fc640 1 -- 172.21.15.77:0/2749751326 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1034003520 con 0x7f104c0c3330 2024-04-25T01:43:55.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.168+0000 7f104affd640 1 -- 172.21.15.77:0/2749751326 >> v2:172.21.15.121:3300/0 conn(0x7f104c1573e0 msgr2=0x7f104c157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:55.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.168+0000 7f104affd640 1 --2- 172.21.15.77:0/2749751326 >> v2:172.21.15.121:3300/0 conn(0x7f104c1573e0 0x7f104c157810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.168+0000 7f104affd640 1 -- 172.21.15.77:0/2749751326 >> v1:172.21.15.77:6789/0 conn(0x7f104c0c3330 legacy=0x7f104c06bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:55.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.168+0000 7f104affd640 1 -- 172.21.15.77:0/2749751326 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104c1544a0 con 0x7f104c06c260 2024-04-25T01:43:55.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.169+0000 7f104affd640 1 --2- 172.21.15.77:0/2749751326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f104c06c260 0x7f104c0c3710 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f104c06e140 tx=0x7f104002a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb61b099a79fae82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:55.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.169+0000 7f104a7fc640 1 -- 172.21.15.77:0/2749751326 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1040037070 con 0x7f104c06c260 2024-04-25T01:43:55.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.169+0000 7f104a7fc640 1 -- 172.21.15.77:0/2749751326 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f104002add0 con 0x7f104c06c260 2024-04-25T01:43:55.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.169+0000 7f104a7fc640 1 -- 172.21.15.77:0/2749751326 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1040032660 con 0x7f104c06c260 2024-04-25T01:43:55.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.169+0000 7f1052134640 1 -- 172.21.15.77:0/2749751326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f104c06c260 msgr2=0x7f104c0c3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:55.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.169+0000 7f1052134640 1 --2- 172.21.15.77:0/2749751326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f104c06c260 0x7f104c0c3710 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f104c06e140 tx=0x7f104002a080 comp rx=0 tx=0).stop 2024-04-25T01:43:55.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.169+0000 7f1052134640 1 -- 172.21.15.77:0/2749751326 shutdown_connections 2024-04-25T01:43:55.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.169+0000 7f1052134640 1 --2- 172.21.15.77:0/2749751326 >> v2:172.21.15.121:3300/0 conn(0x7f104c1573e0 0x7f104c157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.169+0000 7f1052134640 1 --2- 172.21.15.77:0/2749751326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f104c06c260 0x7f104c0c3710 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.169+0000 7f1052134640 1 -- 172.21.15.77:0/2749751326 >> 172.21.15.77:0/2749751326 conn(0x7f104c0a9230 msgr2=0x7f104c0a9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:55.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.169+0000 7f1052134640 1 -- 172.21.15.77:0/2749751326 shutdown_connections 2024-04-25T01:43:55.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.169+0000 7f1052134640 1 -- 172.21.15.77:0/2749751326 wait complete. 2024-04-25T01:43:55.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.170+0000 7f1052134640 1 Processor -- start 2024-04-25T01:43:55.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.171+0000 7f1052134640 1 -- start start 2024-04-25T01:43:55.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.171+0000 7f1052134640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f104c06c260 0x7f104c139750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:55.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.171+0000 7f1052134640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f104c0c3330 0x7f104c14e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:55.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.171+0000 7f1052134640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f104c1573e0 0x7f104c14e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:55.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.171+0000 7f1052134640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f104c157ed0 con 0x7f104c1573e0 2024-04-25T01:43:55.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.171+0000 7f1052134640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f104c157d50 con 0x7f104c0c3330 2024-04-25T01:43:55.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.171+0000 7f1052134640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f104c158050 con 0x7f104c06c260 2024-04-25T01:43:55.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.171+0000 7f104bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f104c1573e0 0x7f104c14e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:55.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.171+0000 7f104bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f104c1573e0 0x7f104c14e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59330/0 (socket says 172.21.15.77:59330) 2024-04-25T01:43:55.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.171+0000 7f104bfff640 1 -- 172.21.15.77:0/3295692974 learned_addr learned my addr 172.21.15.77:0/3295692974 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:55.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.172+0000 7f104bfff640 1 -- 172.21.15.77:0/3295692974 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f104c06c260 msgr2=0x7f104c139750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:55.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.172+0000 7f104bfff640 1 --2- 172.21.15.77:0/3295692974 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f104c06c260 0x7f104c139750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.172+0000 7f104bfff640 1 -- 172.21.15.77:0/3295692974 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f104c0c3330 msgr2=0x7f104c14e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:55.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.172+0000 7f104bfff640 1 --2- 172.21.15.77:0/3295692974 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f104c0c3330 0x7f104c14e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.172+0000 7f104bfff640 1 -- 172.21.15.77:0/3295692974 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104c071620 con 0x7f104c1573e0 2024-04-25T01:43:55.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.172+0000 7f104bfff640 1 --2- 172.21.15.77:0/3295692974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f104c1573e0 0x7f104c14e960 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f1044007e70 tx=0x7f104400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:55.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.172+0000 7f1033fff640 1 -- 172.21.15.77:0/3295692974 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1044014620 con 0x7f104c1573e0 2024-04-25T01:43:55.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.172+0000 7f1033fff640 1 -- 172.21.15.77:0/3295692974 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1044019070 con 0x7f104c1573e0 2024-04-25T01:43:55.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.172+0000 7f1052134640 1 -- 172.21.15.77:0/3295692974 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f104c14eea0 con 0x7f104c1573e0 2024-04-25T01:43:55.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.172+0000 7f1033fff640 1 -- 172.21.15.77:0/3295692974 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1044014a20 con 0x7f104c1573e0 2024-04-25T01:43:55.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.172+0000 7f1052134640 1 -- 172.21.15.77:0/3295692974 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f104c0718c0 con 0x7f104c1573e0 2024-04-25T01:43:55.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.173+0000 7f1052134640 1 -- 172.21.15.77:0/3295692974 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f104c149380 con 0x7f104c1573e0 2024-04-25T01:43:55.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.173+0000 7f1033fff640 1 -- 172.21.15.77:0/3295692974 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1044014bc0 con 0x7f104c1573e0 2024-04-25T01:43:55.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.174+0000 7f1033fff640 1 --2- 172.21.15.77:0/3295692974 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f103806be30 0x7f103806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:55.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.174+0000 7f1033fff640 1 -- 172.21.15.77:0/3295692974 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7f104408caf0 con 0x7f104c1573e0 2024-04-25T01:43:55.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.174+0000 7f104b7fe640 1 --2- 172.21.15.77:0/3295692974 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f103806be30 0x7f103806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:55.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.174+0000 7f1033fff640 1 --2- 172.21.15.77:0/3295692974 >> [v2:172.21.15.121:6816/1683602459,v1:172.21.15.121:6817/1683602459] conn(0x7f1038076b50 0x7f1038078fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:55.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.174+0000 7f1033fff640 1 -- 172.21.15.77:0/3295692974 --> [v2:172.21.15.121:6816/1683602459,v1:172.21.15.121:6817/1683602459] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f104400df30 con 0x7f1038076b50 2024-04-25T01:43:55.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.174+0000 7f1033fff640 1 -- 172.21.15.77:0/3295692974 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f104408cea0 con 0x7f104c1573e0 2024-04-25T01:43:55.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.174+0000 7f104b7fe640 1 --2- 172.21.15.77:0/3295692974 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f103806be30 0x7f103806e2f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f103c000f60 tx=0x7f103c0078f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:55.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.174+0000 7f104affd640 1 --2- 172.21.15.77:0/3295692974 >> [v2:172.21.15.121:6816/1683602459,v1:172.21.15.121:6817/1683602459] conn(0x7f1038076b50 0x7f1038078fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:55.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.175+0000 7f104affd640 1 --2- 172.21.15.77:0/3295692974 >> [v2:172.21.15.121:6816/1683602459,v1:172.21.15.121:6817/1683602459] conn(0x7f1038076b50 0x7f1038078fd0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:55.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.176+0000 7f1033fff640 1 -- 172.21.15.77:0/3295692974 <== osd.7 v2:172.21.15.121:6816/1683602459 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f104400df30 con 0x7f1038076b50 2024-04-25T01:43:55.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.188+0000 7f1052134640 1 -- 172.21.15.77:0/3295692974 --> [v2:172.21.15.121:6816/1683602459,v1:172.21.15.121:6817/1683602459] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f104c075d10 con 0x7f1038076b50 2024-04-25T01:43:55.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.189+0000 7f1033fff640 1 -- 172.21.15.77:0/3295692974 <== osd.7 v2:172.21.15.121:6816/1683602459 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f104c075d10 con 0x7f1038076b50 2024-04-25T01:43:55.180 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-25T01:43:55.180 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T01:43:55.180 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-25T01:43:55.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.189+0000 7f1052134640 1 -- 172.21.15.77:0/3295692974 >> [v2:172.21.15.121:6816/1683602459,v1:172.21.15.121:6817/1683602459] conn(0x7f1038076b50 msgr2=0x7f1038078fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:55.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.189+0000 7f1052134640 1 --2- 172.21.15.77:0/3295692974 >> [v2:172.21.15.121:6816/1683602459,v1:172.21.15.121:6817/1683602459] conn(0x7f1038076b50 0x7f1038078fd0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.189+0000 7f1052134640 1 -- 172.21.15.77:0/3295692974 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f103806be30 msgr2=0x7f103806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:55.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.189+0000 7f1052134640 1 --2- 172.21.15.77:0/3295692974 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f103806be30 0x7f103806e2f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f103c000f60 tx=0x7f103c0078f0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.189+0000 7f1052134640 1 -- 172.21.15.77:0/3295692974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f104c1573e0 msgr2=0x7f104c14e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:55.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.189+0000 7f1052134640 1 --2- 172.21.15.77:0/3295692974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f104c1573e0 0x7f104c14e960 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f1044007e70 tx=0x7f104400e4b0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.189+0000 7f104bfff640 1 -- 172.21.15.77:0/3295692974 reap_dead start 2024-04-25T01:43:55.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.189+0000 7f1052134640 1 -- 172.21.15.77:0/3295692974 shutdown_connections 2024-04-25T01:43:55.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.189+0000 7f1052134640 1 -- 172.21.15.77:0/3295692974 >> 172.21.15.77:0/3295692974 conn(0x7f104c0a9230 msgr2=0x7f104c070410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:55.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.189+0000 7f1052134640 1 -- 172.21.15.77:0/3295692974 shutdown_connections 2024-04-25T01:43:55.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.190+0000 7f1052134640 1 -- 172.21.15.77:0/3295692974 wait complete. 2024-04-25T01:43:55.191 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T01:43:55.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.297+0000 7fb6795dc640 1 Processor -- start 2024-04-25T01:43:55.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.297+0000 7fb6795dc640 1 -- start start 2024-04-25T01:43:55.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.298+0000 7fb6795dc640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb6740bef50 0x7fb6741595f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:55.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.298+0000 7fb6795dc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb6740c97c0 0x7fb674159b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:55.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.298+0000 7fb6795dc640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb67406d110 con 0x7fb674153530 2024-04-25T01:43:55.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.298+0000 7fb6795dc640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb674153910 con 0x7fb6740c97c0 2024-04-25T01:43:55.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.298+0000 7fb6795dc640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb674156980 con 0x7fb6740bef50 2024-04-25T01:43:55.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.298+0000 7fb6737fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb6740c97c0 0x7fb674159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:55.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.298+0000 7fb6737fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb6740c97c0 0x7fb674159b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59338/0 (socket says 172.21.15.77:59338) 2024-04-25T01:43:55.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.298+0000 7fb6737fe640 1 -- 172.21.15.77:0/1647090369 learned_addr learned my addr 172.21.15.77:0/1647090369 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:55.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.298+0000 7fb6727fc640 1 --2- 172.21.15.77:0/1647090369 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb6740bef50 0x7fb6741595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:55.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.298+0000 7fb6737fe640 1 -- 172.21.15.77:0/1647090369 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb6740bef50 msgr2=0x7fb6741595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:55.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.298+0000 7fb6737fe640 1 --2- 172.21.15.77:0/1647090369 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb6740bef50 0x7fb6741595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.298+0000 7fb6737fe640 1 -- 172.21.15.77:0/1647090369 >> v1:172.21.15.121:6789/0 conn(0x7fb674153530 legacy=0x7fb6740c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:55.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.298+0000 7fb6737fe640 1 -- 172.21.15.77:0/1647090369 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb674156c60 con 0x7fb6740c97c0 2024-04-25T01:43:55.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.299+0000 7fb6737fe640 1 --2- 172.21.15.77:0/1647090369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6740c97c0 0x7fb674159b30 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fb66c009870 tx=0x7fb66c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82034dd645cb52c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:55.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.299+0000 7fb671ffb640 1 -- 172.21.15.77:0/1647090369 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c037070 con 0x7fb6740c97c0 2024-04-25T01:43:55.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.299+0000 7fb671ffb640 1 -- 172.21.15.77:0/1647090369 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb66c032440 con 0x7fb6740c97c0 2024-04-25T01:43:55.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.299+0000 7fb671ffb640 1 -- 172.21.15.77:0/1647090369 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c032810 con 0x7fb6740c97c0 2024-04-25T01:43:55.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.300+0000 7fb6795dc640 1 -- 172.21.15.77:0/1647090369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6740c97c0 msgr2=0x7fb674159b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:55.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.300+0000 7fb6795dc640 1 --2- 172.21.15.77:0/1647090369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6740c97c0 0x7fb674159b30 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fb66c009870 tx=0x7fb66c02a1c0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.300+0000 7fb6795dc640 1 -- 172.21.15.77:0/1647090369 shutdown_connections 2024-04-25T01:43:55.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.300+0000 7fb6795dc640 1 --2- 172.21.15.77:0/1647090369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6740c97c0 0x7fb674159b30 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.300+0000 7fb6795dc640 1 --2- 172.21.15.77:0/1647090369 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb6740bef50 0x7fb6741595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.300+0000 7fb6795dc640 1 -- 172.21.15.77:0/1647090369 >> 172.21.15.77:0/1647090369 conn(0x7fb6740672c0 msgr2=0x7fb6740676d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:55.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.300+0000 7fb6795dc640 1 -- 172.21.15.77:0/1647090369 shutdown_connections 2024-04-25T01:43:55.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.300+0000 7fb6795dc640 1 -- 172.21.15.77:0/1647090369 wait complete. 2024-04-25T01:43:55.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.301+0000 7fb6795dc640 1 Processor -- start 2024-04-25T01:43:55.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.301+0000 7fb6795dc640 1 -- start start 2024-04-25T01:43:55.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.302+0000 7fb6795dc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6740bef50 0x7fb6741ef820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:55.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.302+0000 7fb6795dc640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb6740c97c0 0x7fb67414e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:55.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.302+0000 7fb6795dc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb674153530 0x7fb6740ac7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:55.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.302+0000 7fb6795dc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb6740c6950 con 0x7fb6740bef50 2024-04-25T01:43:55.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.302+0000 7fb6795dc640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb6740cc250 con 0x7fb674153530 2024-04-25T01:43:55.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.302+0000 7fb6795dc640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb6740c6ad0 con 0x7fb6740c97c0 2024-04-25T01:43:55.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.302+0000 7fb672ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6740bef50 0x7fb6741ef820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:55.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.302+0000 7fb672ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6740bef50 0x7fb6741ef820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59354/0 (socket says 172.21.15.77:59354) 2024-04-25T01:43:55.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.302+0000 7fb672ffd640 1 -- 172.21.15.77:0/2143003227 learned_addr learned my addr 172.21.15.77:0/2143003227 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:55.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.302+0000 7fb6727fc640 1 --2- 172.21.15.77:0/2143003227 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb6740c97c0 0x7fb67414e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:55.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.302+0000 7fb6737fe640 1 --2- 172.21.15.77:0/2143003227 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb674153530 0x7fb6740ac7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:55.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.302+0000 7fb672ffd640 1 -- 172.21.15.77:0/2143003227 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb6740c97c0 msgr2=0x7fb67414e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:55.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.302+0000 7fb672ffd640 1 --2- 172.21.15.77:0/2143003227 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb6740c97c0 0x7fb67414e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.302+0000 7fb672ffd640 1 -- 172.21.15.77:0/2143003227 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb674153530 msgr2=0x7fb6740ac7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:55.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.302+0000 7fb672ffd640 1 --2- 172.21.15.77:0/2143003227 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb674153530 0x7fb6740ac7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.302+0000 7fb672ffd640 1 -- 172.21.15.77:0/2143003227 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6741eeda0 con 0x7fb6740bef50 2024-04-25T01:43:55.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.302+0000 7fb672ffd640 1 --2- 172.21.15.77:0/2143003227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6740bef50 0x7fb6741ef820 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fb66400c730 tx=0x7fb66400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:55.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.302+0000 7fb65b7fe640 1 -- 172.21.15.77:0/2143003227 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb664016020 con 0x7fb6740bef50 2024-04-25T01:43:55.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.302+0000 7fb65b7fe640 1 -- 172.21.15.77:0/2143003227 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb664006d50 con 0x7fb6740bef50 2024-04-25T01:43:55.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.302+0000 7fb6795dc640 1 -- 172.21.15.77:0/2143003227 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb67414c6f0 con 0x7fb6740bef50 2024-04-25T01:43:55.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.302+0000 7fb65b7fe640 1 -- 172.21.15.77:0/2143003227 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb664003bb0 con 0x7fb6740bef50 2024-04-25T01:43:55.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.303+0000 7fb6795dc640 1 -- 172.21.15.77:0/2143003227 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6741ef040 con 0x7fb6740bef50 2024-04-25T01:43:55.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.304+0000 7fb6795dc640 1 -- 172.21.15.77:0/2143003227 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb67404f500 con 0x7fb6740bef50 2024-04-25T01:43:55.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.304+0000 7fb65b7fe640 1 -- 172.21.15.77:0/2143003227 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb66400a850 con 0x7fb6740bef50 2024-04-25T01:43:55.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.304+0000 7fb65b7fe640 1 --2- 172.21.15.77:0/2143003227 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb66006be30 0x7fb66006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:55.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.304+0000 7fb6727fc640 1 --2- 172.21.15.77:0/2143003227 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb66006be30 0x7fb66006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:55.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.304+0000 7fb65b7fe640 1 -- 172.21.15.77:0/2143003227 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7fb66408aff0 con 0x7fb6740bef50 2024-04-25T01:43:55.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.305+0000 7fb6727fc640 1 --2- 172.21.15.77:0/2143003227 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb66006be30 0x7fb66006e2f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb6740c9410 tx=0x7fb668008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:55.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.309+0000 7fb65b7fe640 1 -- 172.21.15.77:0/2143003227 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb664020020 con 0x7fb6740bef50 2024-04-25T01:43:55.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.487+0000 7fb6795dc640 1 -- 172.21.15.77:0/2143003227 --> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fb67406cd20 con 0x7fb66006be30 2024-04-25T01:43:55.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.488+0000 7fb65b7fe640 1 -- 172.21.15.77:0/2143003227 <== mgr.4098 v2:172.21.15.77:6832/4208232183 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb67406cd20 con 0x7fb66006be30 2024-04-25T01:43:55.479 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T01:43:55.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.490+0000 7fb6795dc640 1 -- 172.21.15.77:0/2143003227 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb66006be30 msgr2=0x7fb66006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:55.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.490+0000 7fb6795dc640 1 --2- 172.21.15.77:0/2143003227 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb66006be30 0x7fb66006e2f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb6740c9410 tx=0x7fb668008040 comp rx=0 tx=0).stop 2024-04-25T01:43:55.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.490+0000 7fb6795dc640 1 -- 172.21.15.77:0/2143003227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6740bef50 msgr2=0x7fb6741ef820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:55.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.490+0000 7fb6795dc640 1 --2- 172.21.15.77:0/2143003227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6740bef50 0x7fb6741ef820 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fb66400c730 tx=0x7fb66400cbf0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.490+0000 7fb6795dc640 1 -- 172.21.15.77:0/2143003227 shutdown_connections 2024-04-25T01:43:55.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.490+0000 7fb6795dc640 1 --2- 172.21.15.77:0/2143003227 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb66006be30 0x7fb66006e2f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.490+0000 7fb6795dc640 1 --2- 172.21.15.77:0/2143003227 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb674153530 0x7fb6740ac7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.490+0000 7fb6795dc640 1 --2- 172.21.15.77:0/2143003227 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb6740c97c0 0x7fb67414e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.490+0000 7fb6795dc640 1 --2- 172.21.15.77:0/2143003227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6740bef50 0x7fb6741ef820 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.490+0000 7fb6795dc640 1 -- 172.21.15.77:0/2143003227 >> 172.21.15.77:0/2143003227 conn(0x7fb6740672c0 msgr2=0x7fb6740676a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:55.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.490+0000 7fb6795dc640 1 -- 172.21.15.77:0/2143003227 shutdown_connections 2024-04-25T01:43:55.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.490+0000 7fb6795dc640 1 -- 172.21.15.77:0/2143003227 wait complete. 2024-04-25T01:43:55.492 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T01:43:55.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.597+0000 7feb610a5640 1 Processor -- start 2024-04-25T01:43:55.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.597+0000 7feb610a5640 1 -- start start 2024-04-25T01:43:55.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.598+0000 7feb610a5640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7feb5c150090 0x7feb5c156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:55.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.598+0000 7feb610a5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7feb5c0c8200 0x7feb5c0c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:55.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.598+0000 7feb610a5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb5c0c9de0 con 0x7feb5c06c280 2024-04-25T01:43:55.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.598+0000 7feb610a5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7feb5c06b830 con 0x7feb5c0c8200 2024-04-25T01:43:55.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.598+0000 7feb610a5640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7feb5c0c89c0 con 0x7feb5c150090 2024-04-25T01:43:55.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.598+0000 7feb5a59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7feb5c0c8200 0x7feb5c0c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:55.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.598+0000 7feb5a59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7feb5c0c8200 0x7feb5c0c98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59356/0 (socket says 172.21.15.77:59356) 2024-04-25T01:43:55.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.598+0000 7feb5a59c640 1 -- 172.21.15.77:0/2922924353 learned_addr learned my addr 172.21.15.77:0/2922924353 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:55.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.598+0000 7feb5b59e640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7feb5c06c280 0x7feb5c0c6320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52336/0 (socket says 172.21.15.77:52336) 2024-04-25T01:43:55.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.598+0000 7feb5ad9d640 1 --2- 172.21.15.77:0/2922924353 >> v2:172.21.15.121:3300/0 conn(0x7feb5c150090 0x7feb5c156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:55.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.598+0000 7feb5a59c640 1 -- 172.21.15.77:0/2922924353 >> v2:172.21.15.121:3300/0 conn(0x7feb5c150090 msgr2=0x7feb5c156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:43:55.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.598+0000 7feb5a59c640 1 --2- 172.21.15.77:0/2922924353 >> v2:172.21.15.121:3300/0 conn(0x7feb5c150090 0x7feb5c156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.598+0000 7feb5a59c640 1 -- 172.21.15.77:0/2922924353 >> v1:172.21.15.77:6789/0 conn(0x7feb5c06c280 legacy=0x7feb5c0c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:55.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.598+0000 7feb5a59c640 1 -- 172.21.15.77:0/2922924353 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb5c0c8ca0 con 0x7feb5c0c8200 2024-04-25T01:43:55.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.598+0000 7feb59d9b640 1 -- 172.21.15.77:0/2922924353 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3958285917 0 0) 0x7feb5c0c9de0 con 0x7feb5c06c280 2024-04-25T01:43:55.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.598+0000 7feb5ad9d640 1 --2- 172.21.15.77:0/2922924353 >> v2:172.21.15.121:3300/0 conn(0x7feb5c150090 0x7feb5c156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:43:55.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.599+0000 7feb5a59c640 1 --2- 172.21.15.77:0/2922924353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb5c0c8200 0x7feb5c0c98a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7feb5c06b9b0 tx=0x7feb5002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=262067759a4fb2df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:55.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.599+0000 7feb59d9b640 1 -- 172.21.15.77:0/2922924353 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb50037070 con 0x7feb5c0c8200 2024-04-25T01:43:55.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.599+0000 7feb59d9b640 1 -- 172.21.15.77:0/2922924353 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb50032440 con 0x7feb5c0c8200 2024-04-25T01:43:55.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.599+0000 7feb59d9b640 1 -- 172.21.15.77:0/2922924353 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb50032810 con 0x7feb5c0c8200 2024-04-25T01:43:55.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.600+0000 7feb610a5640 1 -- 172.21.15.77:0/2922924353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb5c0c8200 msgr2=0x7feb5c0c98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:55.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.600+0000 7feb610a5640 1 --2- 172.21.15.77:0/2922924353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb5c0c8200 0x7feb5c0c98a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7feb5c06b9b0 tx=0x7feb5002a270 comp rx=0 tx=0).stop 2024-04-25T01:43:55.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.600+0000 7feb610a5640 1 -- 172.21.15.77:0/2922924353 shutdown_connections 2024-04-25T01:43:55.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.600+0000 7feb610a5640 1 --2- 172.21.15.77:0/2922924353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb5c0c8200 0x7feb5c0c98a0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.600+0000 7feb610a5640 1 --2- 172.21.15.77:0/2922924353 >> v2:172.21.15.121:3300/0 conn(0x7feb5c150090 0x7feb5c156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.600+0000 7feb610a5640 1 -- 172.21.15.77:0/2922924353 >> 172.21.15.77:0/2922924353 conn(0x7feb5c0ad4d0 msgr2=0x7feb5c0ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:55.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.600+0000 7feb610a5640 1 -- 172.21.15.77:0/2922924353 shutdown_connections 2024-04-25T01:43:55.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.600+0000 7feb610a5640 1 -- 172.21.15.77:0/2922924353 wait complete. 2024-04-25T01:43:55.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.601+0000 7feb610a5640 1 Processor -- start 2024-04-25T01:43:55.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.601+0000 7feb610a5640 1 -- start start 2024-04-25T01:43:55.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.602+0000 7feb610a5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feb5c06c280 0x7feb5c1ec180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:55.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.602+0000 7feb610a5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb5c0c8200 0x7feb5c0c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:55.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.602+0000 7feb610a5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb5c150090 0x7feb5c152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:55.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.602+0000 7feb610a5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7feb5c0c86b0 con 0x7feb5c150090 2024-04-25T01:43:55.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.602+0000 7feb610a5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7feb5c06bd60 con 0x7feb5c0c8200 2024-04-25T01:43:55.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.602+0000 7feb610a5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7feb5c0c6a30 con 0x7feb5c06c280 2024-04-25T01:43:55.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.602+0000 7feb5b59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb5c150090 0x7feb5c152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:55.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.602+0000 7feb5b59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb5c150090 0x7feb5c152de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59366/0 (socket says 172.21.15.77:59366) 2024-04-25T01:43:55.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.602+0000 7feb5b59e640 1 -- 172.21.15.77:0/4271481112 learned_addr learned my addr 172.21.15.77:0/4271481112 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:43:55.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.602+0000 7feb5a59c640 1 --2- 172.21.15.77:0/4271481112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb5c0c8200 0x7feb5c0c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:55.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.602+0000 7feb5ad9d640 1 --2- 172.21.15.77:0/4271481112 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feb5c06c280 0x7feb5c1ec180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:55.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.602+0000 7feb5b59e640 1 -- 172.21.15.77:0/4271481112 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feb5c06c280 msgr2=0x7feb5c1ec180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:55.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.602+0000 7feb5b59e640 1 --2- 172.21.15.77:0/4271481112 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feb5c06c280 0x7feb5c1ec180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.602+0000 7feb5b59e640 1 -- 172.21.15.77:0/4271481112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb5c0c8200 msgr2=0x7feb5c0c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:55.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.602+0000 7feb5b59e640 1 --2- 172.21.15.77:0/4271481112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb5c0c8200 0x7feb5c0c4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.602+0000 7feb5b59e640 1 -- 172.21.15.77:0/4271481112 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb5c152250 con 0x7feb5c150090 2024-04-25T01:43:55.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.602+0000 7feb5a59c640 1 --2- 172.21.15.77:0/4271481112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb5c0c8200 0x7feb5c0c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:43:55.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.602+0000 7feb5b59e640 1 --2- 172.21.15.77:0/4271481112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb5c150090 0x7feb5c152de0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7feb5400c480 tx=0x7feb5400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:55.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.603+0000 7feb437fe640 1 -- 172.21.15.77:0/4271481112 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb54018070 con 0x7feb5c150090 2024-04-25T01:43:55.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.603+0000 7feb437fe640 1 -- 172.21.15.77:0/4271481112 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb54007500 con 0x7feb5c150090 2024-04-25T01:43:55.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.603+0000 7feb437fe640 1 -- 172.21.15.77:0/4271481112 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb54004a20 con 0x7feb5c150090 2024-04-25T01:43:55.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.603+0000 7feb610a5640 1 -- 172.21.15.77:0/4271481112 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb5c152530 con 0x7feb5c150090 2024-04-25T01:43:55.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.603+0000 7feb610a5640 1 -- 172.21.15.77:0/4271481112 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb5c153320 con 0x7feb5c150090 2024-04-25T01:43:55.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.604+0000 7feb610a5640 1 -- 172.21.15.77:0/4271481112 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb5c04f500 con 0x7feb5c150090 2024-04-25T01:43:55.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.604+0000 7feb437fe640 1 -- 172.21.15.77:0/4271481112 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feb5401b070 con 0x7feb5c150090 2024-04-25T01:43:55.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.604+0000 7feb437fe640 1 --2- 172.21.15.77:0/4271481112 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7feb4806be30 0x7feb4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:43:55.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.604+0000 7feb437fe640 1 -- 172.21.15.77:0/4271481112 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7feb5408a590 con 0x7feb5c150090 2024-04-25T01:43:55.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.604+0000 7feb5ad9d640 1 --2- 172.21.15.77:0/4271481112 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7feb4806be30 0x7feb4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:43:55.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.605+0000 7feb5ad9d640 1 --2- 172.21.15.77:0/4271481112 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7feb4806be30 0x7feb4806e2f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7feb4c00f500 tx=0x7feb4c007770 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:43:55.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.609+0000 7feb437fe640 1 -- 172.21.15.77:0/4271481112 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7feb540584f0 con 0x7feb5c150090 2024-04-25T01:43:55.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.781+0000 7feb610a5640 1 -- 172.21.15.77:0/4271481112 --> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feb5c0c6f10 con 0x7feb4806be30 2024-04-25T01:43:55.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.791+0000 7feb437fe640 1 -- 172.21.15.77:0/4271481112 <== mgr.4098 v2:172.21.15.77:6832/4208232183 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+492525 (secure 0 0 0) 0x7feb5c0c6f10 con 0x7feb4806be30 2024-04-25T01:43:55.788 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:43:55.791 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-25T01:43:55.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.795+0000 7feb610a5640 1 -- 172.21.15.77:0/4271481112 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7feb4806be30 msgr2=0x7feb4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:55.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.795+0000 7feb610a5640 1 --2- 172.21.15.77:0/4271481112 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7feb4806be30 0x7feb4806e2f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7feb4c00f500 tx=0x7feb4c007770 comp rx=0 tx=0).stop 2024-04-25T01:43:55.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.795+0000 7feb610a5640 1 -- 172.21.15.77:0/4271481112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb5c150090 msgr2=0x7feb5c152de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:43:55.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.795+0000 7feb610a5640 1 --2- 172.21.15.77:0/4271481112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb5c150090 0x7feb5c152de0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7feb5400c480 tx=0x7feb5400c940 comp rx=0 tx=0).stop 2024-04-25T01:43:55.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.795+0000 7feb610a5640 1 -- 172.21.15.77:0/4271481112 shutdown_connections 2024-04-25T01:43:55.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.795+0000 7feb610a5640 1 --2- 172.21.15.77:0/4271481112 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7feb4806be30 0x7feb4806e2f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.795+0000 7feb610a5640 1 --2- 172.21.15.77:0/4271481112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb5c150090 0x7feb5c152de0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.795+0000 7feb610a5640 1 --2- 172.21.15.77:0/4271481112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb5c0c8200 0x7feb5c0c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.795+0000 7feb610a5640 1 --2- 172.21.15.77:0/4271481112 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feb5c06c280 0x7feb5c1ec180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:43:55.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.796+0000 7feb610a5640 1 -- 172.21.15.77:0/4271481112 >> 172.21.15.77:0/4271481112 conn(0x7feb5c0ad4d0 msgr2=0x7feb5c14f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:43:55.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.796+0000 7feb610a5640 1 -- 172.21.15.77:0/4271481112 shutdown_connections 2024-04-25T01:43:55.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:43:55.796+0000 7feb610a5640 1 -- 172.21.15.77:0/4271481112 wait complete. 2024-04-25T01:43:55.798 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":165,"stamp":"2024-04-25T01:43:55.725586+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16553154,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":520,"num_read_kb":8330,"num_write":26453,"num_write_kb":50357090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31322,"ondisk_log_size":31322,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":552152,"kb_used_data":35032,"kb_used_omap":12,"kb_used_meta":517043,"kb_avail":754422568,"statfs":{"total":773094113280,"available":772528709632,"internally_reserved":0,"allocated":35872768,"data_stored":34242012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":529452592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":422,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003358"},"pg_stats":[{"pgid":"5.18","version":"30'210","reported_seq":235,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.740479+0000","last_change":"2024-04-25T01:39:33.445614+0000","last_active":"2024-04-25T01:43:34.740479+0000","last_peered":"2024-04-25T01:43:34.740479+0000","last_clean":"2024-04-25T01:43:34.740479+0000","last_became_active":"2024-04-25T01:39:33.445090+0000","last_became_peered":"2024-04-25T01:39:33.445090+0000","last_unstale":"2024-04-25T01:43:34.740479+0000","last_undegraded":"2024-04-25T01:43:34.740479+0000","last_fullsized":"2024-04-25T01:43:34.740479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:50.951488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"29'6","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403369+0000","last_change":"2024-04-25T01:39:23.377096+0000","last_active":"2024-04-25T01:43:29.403369+0000","last_peered":"2024-04-25T01:43:29.403369+0000","last_clean":"2024-04-25T01:43:29.403369+0000","last_became_active":"2024-04-25T01:39:23.376811+0000","last_became_peered":"2024-04-25T01:39:23.376811+0000","last_unstale":"2024-04-25T01:43:29.403369+0000","last_undegraded":"2024-04-25T01:43:29.403369+0000","last_fullsized":"2024-04-25T01:43:29.403369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:26.888605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"30'181","reported_seq":215,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.883447+0000","last_change":"2024-04-25T01:39:24.394317+0000","last_active":"2024-04-25T01:43:46.883447+0000","last_peered":"2024-04-25T01:43:46.883447+0000","last_clean":"2024-04-25T01:43:46.883447+0000","last_became_active":"2024-04-25T01:39:24.394032+0000","last_became_peered":"2024-04-25T01:39:24.394032+0000","last_unstale":"2024-04-25T01:43:46.883447+0000","last_undegraded":"2024-04-25T01:43:46.883447+0000","last_fullsized":"2024-04-25T01:43:46.883447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:11.795443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.407597+0000","last_change":"2024-04-25T01:39:32.421607+0000","last_active":"2024-04-25T01:43:29.407597+0000","last_peered":"2024-04-25T01:43:29.407597+0000","last_clean":"2024-04-25T01:43:29.407597+0000","last_became_active":"2024-04-25T01:39:32.421355+0000","last_became_peered":"2024-04-25T01:39:32.421355+0000","last_unstale":"2024-04-25T01:43:29.407597+0000","last_undegraded":"2024-04-25T01:43:29.407597+0000","last_fullsized":"2024-04-25T01:43:29.407597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:12:14.019262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"30'203","reported_seq":228,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.744955+0000","last_change":"2024-04-25T01:39:33.436651+0000","last_active":"2024-04-25T01:43:34.744955+0000","last_peered":"2024-04-25T01:43:34.744955+0000","last_clean":"2024-04-25T01:43:34.744955+0000","last_became_active":"2024-04-25T01:39:33.436370+0000","last_became_peered":"2024-04-25T01:39:33.436370+0000","last_unstale":"2024-04-25T01:43:34.744955+0000","last_undegraded":"2024-04-25T01:43:34.744955+0000","last_fullsized":"2024-04-25T01:43:34.744955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:57:10.341738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"29'3","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.408859+0000","last_change":"2024-04-25T01:39:23.369400+0000","last_active":"2024-04-25T01:43:29.408859+0000","last_peered":"2024-04-25T01:43:29.408859+0000","last_clean":"2024-04-25T01:43:29.408859+0000","last_became_active":"2024-04-25T01:39:23.368726+0000","last_became_peered":"2024-04-25T01:39:23.368726+0000","last_unstale":"2024-04-25T01:43:29.408859+0000","last_undegraded":"2024-04-25T01:43:29.408859+0000","last_fullsized":"2024-04-25T01:43:29.408859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:35:42.971179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"30'177","reported_seq":211,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.894898+0000","last_change":"2024-04-25T01:39:24.403873+0000","last_active":"2024-04-25T01:43:46.894898+0000","last_peered":"2024-04-25T01:43:46.894898+0000","last_clean":"2024-04-25T01:43:46.894898+0000","last_became_active":"2024-04-25T01:39:24.403623+0000","last_became_peered":"2024-04-25T01:39:24.403623+0000","last_unstale":"2024-04-25T01:43:46.894898+0000","last_undegraded":"2024-04-25T01:43:46.894898+0000","last_fullsized":"2024-04-25T01:43:46.894898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:49.360933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.402853+0000","last_change":"2024-04-25T01:39:32.430985+0000","last_active":"2024-04-25T01:43:29.402853+0000","last_peered":"2024-04-25T01:43:29.402853+0000","last_clean":"2024-04-25T01:43:29.402853+0000","last_became_active":"2024-04-25T01:39:32.430617+0000","last_became_peered":"2024-04-25T01:39:32.430617+0000","last_unstale":"2024-04-25T01:43:29.402853+0000","last_undegraded":"2024-04-25T01:43:29.402853+0000","last_fullsized":"2024-04-25T01:43:29.402853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:13.938619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"30'163","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.712918+0000","last_change":"2024-04-25T01:39:33.444043+0000","last_active":"2024-04-25T01:43:34.712918+0000","last_peered":"2024-04-25T01:43:34.712918+0000","last_clean":"2024-04-25T01:43:34.712918+0000","last_became_active":"2024-04-25T01:39:33.443737+0000","last_became_peered":"2024-04-25T01:39:33.443737+0000","last_unstale":"2024-04-25T01:43:34.712918+0000","last_undegraded":"2024-04-25T01:43:34.712918+0000","last_fullsized":"2024-04-25T01:43:34.712918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:02:50.401910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"29'4","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.398875+0000","last_change":"2024-04-25T01:39:23.377963+0000","last_active":"2024-04-25T01:43:29.398875+0000","last_peered":"2024-04-25T01:43:29.398875+0000","last_clean":"2024-04-25T01:43:29.398875+0000","last_became_active":"2024-04-25T01:39:23.377402+0000","last_became_peered":"2024-04-25T01:39:23.377402+0000","last_unstale":"2024-04-25T01:43:29.398875+0000","last_undegraded":"2024-04-25T01:43:29.398875+0000","last_fullsized":"2024-04-25T01:43:29.398875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:15.873450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"30'160","reported_seq":193,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.895882+0000","last_change":"2024-04-25T01:39:24.394512+0000","last_active":"2024-04-25T01:43:46.895882+0000","last_peered":"2024-04-25T01:43:46.895882+0000","last_clean":"2024-04-25T01:43:46.895882+0000","last_became_active":"2024-04-25T01:39:24.393954+0000","last_became_peered":"2024-04-25T01:39:24.393954+0000","last_unstale":"2024-04-25T01:43:46.895882+0000","last_undegraded":"2024-04-25T01:43:46.895882+0000","last_fullsized":"2024-04-25T01:43:46.895882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:30.534400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1807","reported_seq":1836,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:40.159686+0000","last_change":"2024-04-25T01:39:32.428198+0000","last_active":"2024-04-25T01:43:40.159686+0000","last_peered":"2024-04-25T01:43:40.159686+0000","last_clean":"2024-04-25T01:43:40.159686+0000","last_became_active":"2024-04-25T01:39:32.427955+0000","last_became_peered":"2024-04-25T01:39:32.427955+0000","last_unstale":"2024-04-25T01:43:40.159686+0000","last_undegraded":"2024-04-25T01:43:40.159686+0000","last_fullsized":"2024-04-25T01:43:40.159686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1807,"log_dups_size":0,"ondisk_log_size":1807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:07.684150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3765045,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":3663,"num_write":1803,"num_write_kb":5411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"30'173","reported_seq":198,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.693724+0000","last_change":"2024-04-25T01:39:33.439854+0000","last_active":"2024-04-25T01:43:34.693724+0000","last_peered":"2024-04-25T01:43:34.693724+0000","last_clean":"2024-04-25T01:43:34.693724+0000","last_became_active":"2024-04-25T01:39:33.439555+0000","last_became_peered":"2024-04-25T01:39:33.439555+0000","last_unstale":"2024-04-25T01:43:34.693724+0000","last_undegraded":"2024-04-25T01:43:34.693724+0000","last_fullsized":"2024-04-25T01:43:34.693724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:50.250748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.397933+0000","last_change":"2024-04-25T01:39:23.377093+0000","last_active":"2024-04-25T01:43:29.397933+0000","last_peered":"2024-04-25T01:43:29.397933+0000","last_clean":"2024-04-25T01:43:29.397933+0000","last_became_active":"2024-04-25T01:39:23.376744+0000","last_became_peered":"2024-04-25T01:39:23.376744+0000","last_unstale":"2024-04-25T01:43:29.397933+0000","last_undegraded":"2024-04-25T01:43:29.397933+0000","last_fullsized":"2024-04-25T01:43:29.397933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:43.529618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"30'198","reported_seq":231,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.898863+0000","last_change":"2024-04-25T01:39:24.393293+0000","last_active":"2024-04-25T01:43:46.898863+0000","last_peered":"2024-04-25T01:43:46.898863+0000","last_clean":"2024-04-25T01:43:46.898863+0000","last_became_active":"2024-04-25T01:39:24.393005+0000","last_became_peered":"2024-04-25T01:39:24.393005+0000","last_unstale":"2024-04-25T01:43:46.898863+0000","last_undegraded":"2024-04-25T01:43:46.898863+0000","last_fullsized":"2024-04-25T01:43:46.898863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:32.070747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'4","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403096+0000","last_change":"2024-04-25T01:39:32.428956+0000","last_active":"2024-04-25T01:43:29.403096+0000","last_peered":"2024-04-25T01:43:29.403096+0000","last_clean":"2024-04-25T01:43:29.403096+0000","last_became_active":"2024-04-25T01:39:32.428705+0000","last_became_peered":"2024-04-25T01:39:32.428705+0000","last_unstale":"2024-04-25T01:43:29.403096+0000","last_undegraded":"2024-04-25T01:43:29.403096+0000","last_fullsized":"2024-04-25T01:43:29.403096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:06:22.998986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"30'179","reported_seq":204,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.750752+0000","last_change":"2024-04-25T01:39:33.446571+0000","last_active":"2024-04-25T01:43:34.750752+0000","last_peered":"2024-04-25T01:43:34.750752+0000","last_clean":"2024-04-25T01:43:34.750752+0000","last_became_active":"2024-04-25T01:39:33.446234+0000","last_became_peered":"2024-04-25T01:39:33.446234+0000","last_unstale":"2024-04-25T01:43:34.750752+0000","last_undegraded":"2024-04-25T01:43:34.750752+0000","last_fullsized":"2024-04-25T01:43:34.750752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:12.742092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"30'156","reported_seq":190,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.887578+0000","last_change":"2024-04-25T01:39:24.398859+0000","last_active":"2024-04-25T01:43:46.887578+0000","last_peered":"2024-04-25T01:43:46.887578+0000","last_clean":"2024-04-25T01:43:46.887578+0000","last_became_active":"2024-04-25T01:39:24.398618+0000","last_became_peered":"2024-04-25T01:39:24.398618+0000","last_unstale":"2024-04-25T01:43:46.887578+0000","last_undegraded":"2024-04-25T01:43:46.887578+0000","last_fullsized":"2024-04-25T01:43:46.887578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:15.278376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'5","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.397898+0000","last_change":"2024-04-25T01:39:23.377717+0000","last_active":"2024-04-25T01:43:29.397898+0000","last_peered":"2024-04-25T01:43:29.397898+0000","last_clean":"2024-04-25T01:43:29.397898+0000","last_became_active":"2024-04-25T01:39:23.377291+0000","last_became_peered":"2024-04-25T01:39:23.377291+0000","last_unstale":"2024-04-25T01:43:29.397898+0000","last_undegraded":"2024-04-25T01:43:29.397898+0000","last_fullsized":"2024-04-25T01:43:29.397898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:06.402745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403630+0000","last_change":"2024-04-25T01:39:32.426840+0000","last_active":"2024-04-25T01:43:29.403630+0000","last_peered":"2024-04-25T01:43:29.403630+0000","last_clean":"2024-04-25T01:43:29.403630+0000","last_became_active":"2024-04-25T01:39:32.426529+0000","last_became_peered":"2024-04-25T01:39:32.426529+0000","last_unstale":"2024-04-25T01:43:29.403630+0000","last_undegraded":"2024-04-25T01:43:29.403630+0000","last_fullsized":"2024-04-25T01:43:29.403630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:30:57.097685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"30'193","reported_seq":218,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.726718+0000","last_change":"2024-04-25T01:39:33.437767+0000","last_active":"2024-04-25T01:43:34.726718+0000","last_peered":"2024-04-25T01:43:34.726718+0000","last_clean":"2024-04-25T01:43:34.726718+0000","last_became_active":"2024-04-25T01:39:33.437483+0000","last_became_peered":"2024-04-25T01:39:33.437483+0000","last_unstale":"2024-04-25T01:43:34.726718+0000","last_undegraded":"2024-04-25T01:43:34.726718+0000","last_fullsized":"2024-04-25T01:43:34.726718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:44.321779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"30'164","reported_seq":197,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.877665+0000","last_change":"2024-04-25T01:39:24.387100+0000","last_active":"2024-04-25T01:43:46.877665+0000","last_peered":"2024-04-25T01:43:46.877665+0000","last_clean":"2024-04-25T01:43:46.877665+0000","last_became_active":"2024-04-25T01:39:24.386782+0000","last_became_peered":"2024-04-25T01:39:24.386782+0000","last_unstale":"2024-04-25T01:43:46.877665+0000","last_undegraded":"2024-04-25T01:43:46.877665+0000","last_fullsized":"2024-04-25T01:43:46.877665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:48.789139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.402653+0000","last_change":"2024-04-25T01:39:23.368446+0000","last_active":"2024-04-25T01:43:29.402653+0000","last_peered":"2024-04-25T01:43:29.402653+0000","last_clean":"2024-04-25T01:43:29.402653+0000","last_became_active":"2024-04-25T01:39:23.368183+0000","last_became_peered":"2024-04-25T01:39:23.368183+0000","last_unstale":"2024-04-25T01:43:29.402653+0000","last_undegraded":"2024-04-25T01:43:29.402653+0000","last_fullsized":"2024-04-25T01:43:29.402653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:13.738756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403500+0000","last_change":"2024-04-25T01:39:32.427589+0000","last_active":"2024-04-25T01:43:29.403500+0000","last_peered":"2024-04-25T01:43:29.403500+0000","last_clean":"2024-04-25T01:43:29.403500+0000","last_became_active":"2024-04-25T01:39:32.427328+0000","last_became_peered":"2024-04-25T01:39:32.427328+0000","last_unstale":"2024-04-25T01:43:29.403500+0000","last_undegraded":"2024-04-25T01:43:29.403500+0000","last_fullsized":"2024-04-25T01:43:29.403500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:48:12.328303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"30'191","reported_seq":216,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.768647+0000","last_change":"2024-04-25T01:39:33.447634+0000","last_active":"2024-04-25T01:43:34.768647+0000","last_peered":"2024-04-25T01:43:34.768647+0000","last_clean":"2024-04-25T01:43:34.768647+0000","last_became_active":"2024-04-25T01:39:33.445908+0000","last_became_peered":"2024-04-25T01:39:33.445908+0000","last_unstale":"2024-04-25T01:43:34.768647+0000","last_undegraded":"2024-04-25T01:43:34.768647+0000","last_fullsized":"2024-04-25T01:43:34.768647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:13.586396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"30'170","reported_seq":204,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.880762+0000","last_change":"2024-04-25T01:39:24.373600+0000","last_active":"2024-04-25T01:43:46.880762+0000","last_peered":"2024-04-25T01:43:46.880762+0000","last_clean":"2024-04-25T01:43:46.880762+0000","last_became_active":"2024-04-25T01:39:24.373311+0000","last_became_peered":"2024-04-25T01:39:24.373311+0000","last_unstale":"2024-04-25T01:43:46.880762+0000","last_undegraded":"2024-04-25T01:43:46.880762+0000","last_fullsized":"2024-04-25T01:43:46.880762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:46.338959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.402749+0000","last_change":"2024-04-25T01:39:23.377103+0000","last_active":"2024-04-25T01:43:29.402749+0000","last_peered":"2024-04-25T01:43:29.402749+0000","last_clean":"2024-04-25T01:43:29.402749+0000","last_became_active":"2024-04-25T01:39:23.376826+0000","last_became_peered":"2024-04-25T01:39:23.376826+0000","last_unstale":"2024-04-25T01:43:29.402749+0000","last_undegraded":"2024-04-25T01:43:29.402749+0000","last_fullsized":"2024-04-25T01:43:29.402749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:46.663754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.404054+0000","last_change":"2024-04-25T01:39:32.426839+0000","last_active":"2024-04-25T01:43:29.404054+0000","last_peered":"2024-04-25T01:43:29.404054+0000","last_clean":"2024-04-25T01:43:29.404054+0000","last_became_active":"2024-04-25T01:39:32.426545+0000","last_became_peered":"2024-04-25T01:39:32.426545+0000","last_unstale":"2024-04-25T01:43:29.404054+0000","last_undegraded":"2024-04-25T01:43:29.404054+0000","last_fullsized":"2024-04-25T01:43:29.404054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:22.161839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"30'171","reported_seq":196,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.686031+0000","last_change":"2024-04-25T01:39:33.444616+0000","last_active":"2024-04-25T01:43:34.686031+0000","last_peered":"2024-04-25T01:43:34.686031+0000","last_clean":"2024-04-25T01:43:34.686031+0000","last_became_active":"2024-04-25T01:39:33.444350+0000","last_became_peered":"2024-04-25T01:39:33.444350+0000","last_unstale":"2024-04-25T01:43:34.686031+0000","last_undegraded":"2024-04-25T01:43:34.686031+0000","last_fullsized":"2024-04-25T01:43:34.686031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:47:15.686320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"30'147","reported_seq":181,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.868654+0000","last_change":"2024-04-25T01:39:24.386969+0000","last_active":"2024-04-25T01:43:46.868654+0000","last_peered":"2024-04-25T01:43:46.868654+0000","last_clean":"2024-04-25T01:43:46.868654+0000","last_became_active":"2024-04-25T01:39:24.386376+0000","last_became_peered":"2024-04-25T01:39:24.386376+0000","last_unstale":"2024-04-25T01:43:46.868654+0000","last_undegraded":"2024-04-25T01:43:46.868654+0000","last_fullsized":"2024-04-25T01:43:46.868654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:13:31.585462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.397503+0000","last_change":"2024-04-25T01:39:23.378993+0000","last_active":"2024-04-25T01:43:29.397503+0000","last_peered":"2024-04-25T01:43:29.397503+0000","last_clean":"2024-04-25T01:43:29.397503+0000","last_became_active":"2024-04-25T01:39:23.376908+0000","last_became_peered":"2024-04-25T01:39:23.376908+0000","last_unstale":"2024-04-25T01:43:29.397503+0000","last_undegraded":"2024-04-25T01:43:29.397503+0000","last_fullsized":"2024-04-25T01:43:29.397503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:13:18.370559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.424880+0000","last_change":"2024-04-25T01:39:32.433597+0000","last_active":"2024-04-25T01:43:32.424880+0000","last_peered":"2024-04-25T01:43:32.424880+0000","last_clean":"2024-04-25T01:43:32.424880+0000","last_became_active":"2024-04-25T01:39:32.433307+0000","last_became_peered":"2024-04-25T01:39:32.433307+0000","last_unstale":"2024-04-25T01:43:32.424880+0000","last_undegraded":"2024-04-25T01:43:32.424880+0000","last_fullsized":"2024-04-25T01:43:32.424880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:20.784385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"30'175","reported_seq":201,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.754290+0000","last_change":"2024-04-25T01:39:33.427297+0000","last_active":"2024-04-25T01:43:34.754290+0000","last_peered":"2024-04-25T01:43:34.754290+0000","last_clean":"2024-04-25T01:43:34.754290+0000","last_became_active":"2024-04-25T01:39:33.426132+0000","last_became_peered":"2024-04-25T01:39:33.426132+0000","last_unstale":"2024-04-25T01:43:34.754290+0000","last_undegraded":"2024-04-25T01:43:34.754290+0000","last_fullsized":"2024-04-25T01:43:34.754290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:04.147341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"30'175","reported_seq":209,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.879746+0000","last_change":"2024-04-25T01:39:24.393003+0000","last_active":"2024-04-25T01:43:46.879746+0000","last_peered":"2024-04-25T01:43:46.879746+0000","last_clean":"2024-04-25T01:43:46.879746+0000","last_became_active":"2024-04-25T01:39:24.392209+0000","last_became_peered":"2024-04-25T01:39:24.392209+0000","last_unstale":"2024-04-25T01:43:46.879746+0000","last_undegraded":"2024-04-25T01:43:46.879746+0000","last_fullsized":"2024-04-25T01:43:46.879746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:44:58.432859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"30'3","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:35.181348+0000","last_change":"2024-04-25T01:39:23.379804+0000","last_active":"2024-04-25T01:43:35.181348+0000","last_peered":"2024-04-25T01:43:35.181348+0000","last_clean":"2024-04-25T01:43:35.181348+0000","last_became_active":"2024-04-25T01:39:23.379430+0000","last_became_peered":"2024-04-25T01:39:23.379430+0000","last_unstale":"2024-04-25T01:43:35.181348+0000","last_undegraded":"2024-04-25T01:43:35.181348+0000","last_fullsized":"2024-04-25T01:43:35.181348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:42:23.254767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.426420+0000","last_change":"2024-04-25T01:39:32.432763+0000","last_active":"2024-04-25T01:43:32.426420+0000","last_peered":"2024-04-25T01:43:32.426420+0000","last_clean":"2024-04-25T01:43:32.426420+0000","last_became_active":"2024-04-25T01:39:32.432482+0000","last_became_peered":"2024-04-25T01:39:32.432482+0000","last_unstale":"2024-04-25T01:43:32.426420+0000","last_undegraded":"2024-04-25T01:43:32.426420+0000","last_fullsized":"2024-04-25T01:43:32.426420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:04.848726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"30'176","reported_seq":202,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.767725+0000","last_change":"2024-04-25T01:39:33.445800+0000","last_active":"2024-04-25T01:43:34.767725+0000","last_peered":"2024-04-25T01:43:34.767725+0000","last_clean":"2024-04-25T01:43:34.767725+0000","last_became_active":"2024-04-25T01:39:33.445500+0000","last_became_peered":"2024-04-25T01:39:33.445500+0000","last_unstale":"2024-04-25T01:43:34.767725+0000","last_undegraded":"2024-04-25T01:43:34.767725+0000","last_fullsized":"2024-04-25T01:43:34.767725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:06:36.800043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"30'154","reported_seq":173,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.886331+0000","last_change":"2024-04-25T01:40:06.055331+0000","last_active":"2024-04-25T01:43:46.886331+0000","last_peered":"2024-04-25T01:43:46.886331+0000","last_clean":"2024-04-25T01:43:46.886331+0000","last_became_active":"2024-04-25T01:40:06.055084+0000","last_became_peered":"2024-04-25T01:40:06.055084+0000","last_unstale":"2024-04-25T01:43:46.886331+0000","last_undegraded":"2024-04-25T01:43:46.886331+0000","last_fullsized":"2024-04-25T01:43:46.886331+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:15:15.409515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"30'30","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:47.397597+0000","last_change":"2024-04-25T01:39:23.377687+0000","last_active":"2024-04-25T01:43:47.397597+0000","last_peered":"2024-04-25T01:43:47.397597+0000","last_clean":"2024-04-25T01:43:47.397597+0000","last_became_active":"2024-04-25T01:39:23.377372+0000","last_became_peered":"2024-04-25T01:39:23.377372+0000","last_unstale":"2024-04-25T01:43:47.397597+0000","last_undegraded":"2024-04-25T01:43:47.397597+0000","last_fullsized":"2024-04-25T01:43:47.397597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:51.983659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":56,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.407473+0000","last_change":"2024-04-25T01:39:32.430816+0000","last_active":"2024-04-25T01:43:29.407473+0000","last_peered":"2024-04-25T01:43:29.407473+0000","last_clean":"2024-04-25T01:43:29.407473+0000","last_became_active":"2024-04-25T01:39:32.430537+0000","last_became_peered":"2024-04-25T01:39:32.430537+0000","last_unstale":"2024-04-25T01:43:29.407473+0000","last_undegraded":"2024-04-25T01:43:29.407473+0000","last_fullsized":"2024-04-25T01:43:29.407473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:58.939453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"30'198","reported_seq":224,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.725529+0000","last_change":"2024-04-25T01:39:33.440287+0000","last_active":"2024-04-25T01:43:34.725529+0000","last_peered":"2024-04-25T01:43:34.725529+0000","last_clean":"2024-04-25T01:43:34.725529+0000","last_became_active":"2024-04-25T01:39:33.439796+0000","last_became_peered":"2024-04-25T01:39:33.439796+0000","last_unstale":"2024-04-25T01:43:34.725529+0000","last_undegraded":"2024-04-25T01:43:34.725529+0000","last_fullsized":"2024-04-25T01:43:34.725529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:08.515401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"30'173","reported_seq":207,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.867380+0000","last_change":"2024-04-25T01:39:24.376933+0000","last_active":"2024-04-25T01:43:46.867380+0000","last_peered":"2024-04-25T01:43:46.867380+0000","last_clean":"2024-04-25T01:43:46.867380+0000","last_became_active":"2024-04-25T01:39:24.376612+0000","last_became_peered":"2024-04-25T01:39:24.376612+0000","last_unstale":"2024-04-25T01:43:46.867380+0000","last_undegraded":"2024-04-25T01:43:46.867380+0000","last_fullsized":"2024-04-25T01:43:46.867380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:56:55.534200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.399082+0000","last_change":"2024-04-25T01:39:23.378190+0000","last_active":"2024-04-25T01:43:29.399082+0000","last_peered":"2024-04-25T01:43:29.399082+0000","last_clean":"2024-04-25T01:43:29.399082+0000","last_became_active":"2024-04-25T01:39:23.377677+0000","last_became_peered":"2024-04-25T01:39:23.377677+0000","last_unstale":"2024-04-25T01:43:29.399082+0000","last_undegraded":"2024-04-25T01:43:29.399082+0000","last_fullsized":"2024-04-25T01:43:29.399082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:09.516058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403847+0000","last_change":"2024-04-25T01:39:32.431542+0000","last_active":"2024-04-25T01:43:29.403847+0000","last_peered":"2024-04-25T01:43:29.403847+0000","last_clean":"2024-04-25T01:43:29.403847+0000","last_became_active":"2024-04-25T01:39:32.431253+0000","last_became_peered":"2024-04-25T01:39:32.431253+0000","last_unstale":"2024-04-25T01:43:29.403847+0000","last_undegraded":"2024-04-25T01:43:29.403847+0000","last_fullsized":"2024-04-25T01:43:29.403847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:36.723239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"30'188","reported_seq":214,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.770510+0000","last_change":"2024-04-25T01:39:33.448529+0000","last_active":"2024-04-25T01:43:34.770510+0000","last_peered":"2024-04-25T01:43:34.770510+0000","last_clean":"2024-04-25T01:43:34.770510+0000","last_became_active":"2024-04-25T01:39:33.448266+0000","last_became_peered":"2024-04-25T01:39:33.448266+0000","last_unstale":"2024-04-25T01:43:34.770510+0000","last_undegraded":"2024-04-25T01:43:34.770510+0000","last_fullsized":"2024-04-25T01:43:34.770510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:18.788470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"30'155","reported_seq":189,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.897294+0000","last_change":"2024-04-25T01:39:24.390844+0000","last_active":"2024-04-25T01:43:46.897294+0000","last_peered":"2024-04-25T01:43:46.897294+0000","last_clean":"2024-04-25T01:43:46.897294+0000","last_became_active":"2024-04-25T01:39:24.390543+0000","last_became_peered":"2024-04-25T01:39:24.390543+0000","last_unstale":"2024-04-25T01:43:46.897294+0000","last_undegraded":"2024-04-25T01:43:46.897294+0000","last_fullsized":"2024-04-25T01:43:46.897294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:01:03.804058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403980+0000","last_change":"2024-04-25T01:39:23.368562+0000","last_active":"2024-04-25T01:43:29.403980+0000","last_peered":"2024-04-25T01:43:29.403980+0000","last_clean":"2024-04-25T01:43:29.403980+0000","last_became_active":"2024-04-25T01:39:23.368272+0000","last_became_peered":"2024-04-25T01:39:23.368272+0000","last_unstale":"2024-04-25T01:43:29.403980+0000","last_undegraded":"2024-04-25T01:43:29.403980+0000","last_fullsized":"2024-04-25T01:43:29.403980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:15.464993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.402026+0000","last_change":"2024-04-25T01:39:32.430196+0000","last_active":"2024-04-25T01:43:29.402026+0000","last_peered":"2024-04-25T01:43:29.402026+0000","last_clean":"2024-04-25T01:43:29.402026+0000","last_became_active":"2024-04-25T01:39:32.429759+0000","last_became_peered":"2024-04-25T01:39:32.429759+0000","last_unstale":"2024-04-25T01:43:29.402026+0000","last_undegraded":"2024-04-25T01:43:29.402026+0000","last_fullsized":"2024-04-25T01:43:29.402026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:58:09.299194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"30'171","reported_seq":197,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.746690+0000","last_change":"2024-04-25T01:39:33.440935+0000","last_active":"2024-04-25T01:43:34.746690+0000","last_peered":"2024-04-25T01:43:34.746690+0000","last_clean":"2024-04-25T01:43:34.746690+0000","last_became_active":"2024-04-25T01:39:33.439344+0000","last_became_peered":"2024-04-25T01:39:33.439344+0000","last_unstale":"2024-04-25T01:43:34.746690+0000","last_undegraded":"2024-04-25T01:43:34.746690+0000","last_fullsized":"2024-04-25T01:43:34.746690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:23.928991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"30'179","reported_seq":213,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.876122+0000","last_change":"2024-04-25T01:39:24.389203+0000","last_active":"2024-04-25T01:43:46.876122+0000","last_peered":"2024-04-25T01:43:46.876122+0000","last_clean":"2024-04-25T01:43:46.876122+0000","last_became_active":"2024-04-25T01:39:24.388306+0000","last_became_peered":"2024-04-25T01:39:24.388306+0000","last_unstale":"2024-04-25T01:43:46.876122+0000","last_undegraded":"2024-04-25T01:43:46.876122+0000","last_fullsized":"2024-04-25T01:43:46.876122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:59:33.951161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.406645+0000","last_change":"2024-04-25T01:39:23.375729+0000","last_active":"2024-04-25T01:43:29.406645+0000","last_peered":"2024-04-25T01:43:29.406645+0000","last_clean":"2024-04-25T01:43:29.406645+0000","last_became_active":"2024-04-25T01:39:23.375488+0000","last_became_peered":"2024-04-25T01:39:23.375488+0000","last_unstale":"2024-04-25T01:43:29.406645+0000","last_undegraded":"2024-04-25T01:43:29.406645+0000","last_fullsized":"2024-04-25T01:43:29.406645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:00.039083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403502+0000","last_change":"2024-04-25T01:39:32.427586+0000","last_active":"2024-04-25T01:43:29.403502+0000","last_peered":"2024-04-25T01:43:29.403502+0000","last_clean":"2024-04-25T01:43:29.403502+0000","last_became_active":"2024-04-25T01:39:32.427282+0000","last_became_peered":"2024-04-25T01:39:32.427282+0000","last_unstale":"2024-04-25T01:43:29.403502+0000","last_undegraded":"2024-04-25T01:43:29.403502+0000","last_fullsized":"2024-04-25T01:43:29.403502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:35.956279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'200","reported_seq":225,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.753861+0000","last_change":"2024-04-25T01:39:33.438949+0000","last_active":"2024-04-25T01:43:34.753861+0000","last_peered":"2024-04-25T01:43:34.753861+0000","last_clean":"2024-04-25T01:43:34.753861+0000","last_became_active":"2024-04-25T01:39:33.438669+0000","last_became_peered":"2024-04-25T01:39:33.438669+0000","last_unstale":"2024-04-25T01:43:34.753861+0000","last_undegraded":"2024-04-25T01:43:34.753861+0000","last_fullsized":"2024-04-25T01:43:34.753861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:07.849060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"30'162","reported_seq":196,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.873816+0000","last_change":"2024-04-25T01:39:24.377438+0000","last_active":"2024-04-25T01:43:46.873816+0000","last_peered":"2024-04-25T01:43:46.873816+0000","last_clean":"2024-04-25T01:43:46.873816+0000","last_became_active":"2024-04-25T01:39:24.377146+0000","last_became_peered":"2024-04-25T01:39:24.377146+0000","last_unstale":"2024-04-25T01:43:46.873816+0000","last_undegraded":"2024-04-25T01:43:46.873816+0000","last_fullsized":"2024-04-25T01:43:46.873816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:54:17.698561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":327680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"30'5","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:31.449181+0000","last_change":"2024-04-25T01:39:23.371019+0000","last_active":"2024-04-25T01:43:31.449181+0000","last_peered":"2024-04-25T01:43:31.449181+0000","last_clean":"2024-04-25T01:43:31.449181+0000","last_became_active":"2024-04-25T01:39:23.370727+0000","last_became_peered":"2024-04-25T01:39:23.370727+0000","last_unstale":"2024-04-25T01:43:31.449181+0000","last_undegraded":"2024-04-25T01:43:31.449181+0000","last_fullsized":"2024-04-25T01:43:31.449181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:10.714475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'3","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:35.564864+0000","last_change":"2024-04-25T01:39:32.431610+0000","last_active":"2024-04-25T01:43:35.564864+0000","last_peered":"2024-04-25T01:43:35.564864+0000","last_clean":"2024-04-25T01:43:35.564864+0000","last_became_active":"2024-04-25T01:39:32.431335+0000","last_became_peered":"2024-04-25T01:39:32.431335+0000","last_unstale":"2024-04-25T01:43:35.564864+0000","last_undegraded":"2024-04-25T01:43:35.564864+0000","last_fullsized":"2024-04-25T01:43:35.564864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:54.882078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"30'173","reported_seq":198,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.747273+0000","last_change":"2024-04-25T01:39:33.438896+0000","last_active":"2024-04-25T01:43:34.747273+0000","last_peered":"2024-04-25T01:43:34.747273+0000","last_clean":"2024-04-25T01:43:34.747273+0000","last_became_active":"2024-04-25T01:39:33.438622+0000","last_became_peered":"2024-04-25T01:39:33.438622+0000","last_unstale":"2024-04-25T01:43:34.747273+0000","last_undegraded":"2024-04-25T01:43:34.747273+0000","last_fullsized":"2024-04-25T01:43:34.747273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:40:47.408809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"30'157","reported_seq":191,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.873335+0000","last_change":"2024-04-25T01:39:24.391366+0000","last_active":"2024-04-25T01:43:46.873335+0000","last_peered":"2024-04-25T01:43:46.873335+0000","last_clean":"2024-04-25T01:43:46.873335+0000","last_became_active":"2024-04-25T01:39:24.391093+0000","last_became_peered":"2024-04-25T01:39:24.391093+0000","last_unstale":"2024-04-25T01:43:46.873335+0000","last_undegraded":"2024-04-25T01:43:46.873335+0000","last_fullsized":"2024-04-25T01:43:46.873335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:10.906935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":311296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.397493+0000","last_change":"2024-04-25T01:39:23.379767+0000","last_active":"2024-04-25T01:43:29.397493+0000","last_peered":"2024-04-25T01:43:29.397493+0000","last_clean":"2024-04-25T01:43:29.397493+0000","last_became_active":"2024-04-25T01:39:23.379294+0000","last_became_peered":"2024-04-25T01:39:23.379294+0000","last_unstale":"2024-04-25T01:43:29.397493+0000","last_undegraded":"2024-04-25T01:43:29.397493+0000","last_fullsized":"2024-04-25T01:43:29.397493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:36:37.823796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"30'26","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:39.399368+0000","last_change":"2024-04-25T01:39:32.429452+0000","last_active":"2024-04-25T01:43:39.399368+0000","last_peered":"2024-04-25T01:43:39.399368+0000","last_clean":"2024-04-25T01:43:39.399368+0000","last_became_active":"2024-04-25T01:39:32.429189+0000","last_became_peered":"2024-04-25T01:39:32.429189+0000","last_unstale":"2024-04-25T01:43:39.399368+0000","last_undegraded":"2024-04-25T01:43:39.399368+0000","last_fullsized":"2024-04-25T01:43:39.399368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:58:02.723851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":46,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"30'171","reported_seq":197,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.770009+0000","last_change":"2024-04-25T01:39:33.438945+0000","last_active":"2024-04-25T01:43:34.770009+0000","last_peered":"2024-04-25T01:43:34.770009+0000","last_clean":"2024-04-25T01:43:34.770009+0000","last_became_active":"2024-04-25T01:39:33.438233+0000","last_became_peered":"2024-04-25T01:39:33.438233+0000","last_unstale":"2024-04-25T01:43:34.770009+0000","last_undegraded":"2024-04-25T01:43:34.770009+0000","last_fullsized":"2024-04-25T01:43:34.770009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:50.545311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"30'209","reported_seq":243,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.896362+0000","last_change":"2024-04-25T01:39:24.401208+0000","last_active":"2024-04-25T01:43:46.896362+0000","last_peered":"2024-04-25T01:43:46.896362+0000","last_clean":"2024-04-25T01:43:46.896362+0000","last_became_active":"2024-04-25T01:39:24.400502+0000","last_became_peered":"2024-04-25T01:39:24.400502+0000","last_unstale":"2024-04-25T01:43:46.896362+0000","last_undegraded":"2024-04-25T01:43:46.896362+0000","last_fullsized":"2024-04-25T01:43:46.896362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:55:09.076617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403950+0000","last_change":"2024-04-25T01:39:23.367826+0000","last_active":"2024-04-25T01:43:29.403950+0000","last_peered":"2024-04-25T01:43:29.403950+0000","last_clean":"2024-04-25T01:43:29.403950+0000","last_became_active":"2024-04-25T01:39:23.367520+0000","last_became_peered":"2024-04-25T01:39:23.367520+0000","last_unstale":"2024-04-25T01:43:29.403950+0000","last_undegraded":"2024-04-25T01:43:29.403950+0000","last_fullsized":"2024-04-25T01:43:29.403950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:05.997166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":192,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.397641+0000","last_change":"2024-04-25T01:39:12.918495+0000","last_active":"2024-04-25T01:43:29.397641+0000","last_peered":"2024-04-25T01:43:29.397641+0000","last_clean":"2024-04-25T01:43:29.397641+0000","last_became_active":"2024-04-25T01:39:12.917330+0000","last_became_peered":"2024-04-25T01:39:12.917330+0000","last_unstale":"2024-04-25T01:43:29.397641+0000","last_undegraded":"2024-04-25T01:43:29.397641+0000","last_fullsized":"2024-04-25T01:43:29.397641+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:11.731178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:11.731178+0000","last_clean_scrub_stamp":"2024-04-25T01:39:11.731178+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:26:14.153244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.412547+0000","last_change":"2024-04-25T01:39:32.431797+0000","last_active":"2024-04-25T01:43:29.412547+0000","last_peered":"2024-04-25T01:43:29.412547+0000","last_clean":"2024-04-25T01:43:29.412547+0000","last_became_active":"2024-04-25T01:39:32.431523+0000","last_became_peered":"2024-04-25T01:39:32.431523+0000","last_unstale":"2024-04-25T01:43:29.412547+0000","last_undegraded":"2024-04-25T01:43:29.412547+0000","last_fullsized":"2024-04-25T01:43:29.412547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:45.752128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"30'174","reported_seq":199,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.741855+0000","last_change":"2024-04-25T01:39:33.440488+0000","last_active":"2024-04-25T01:43:34.741855+0000","last_peered":"2024-04-25T01:43:34.741855+0000","last_clean":"2024-04-25T01:43:34.741855+0000","last_became_active":"2024-04-25T01:39:33.440161+0000","last_became_peered":"2024-04-25T01:39:33.440161+0000","last_unstale":"2024-04-25T01:43:34.741855+0000","last_undegraded":"2024-04-25T01:43:34.741855+0000","last_fullsized":"2024-04-25T01:43:34.741855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:45.542876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"30'168","reported_seq":201,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.899419+0000","last_change":"2024-04-25T01:39:24.394350+0000","last_active":"2024-04-25T01:43:46.899419+0000","last_peered":"2024-04-25T01:43:46.899419+0000","last_clean":"2024-04-25T01:43:46.899419+0000","last_became_active":"2024-04-25T01:39:24.393235+0000","last_became_peered":"2024-04-25T01:39:24.393235+0000","last_unstale":"2024-04-25T01:43:46.899419+0000","last_undegraded":"2024-04-25T01:43:46.899419+0000","last_fullsized":"2024-04-25T01:43:46.899419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:00:48.588700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.397643+0000","last_change":"2024-04-25T01:39:23.368352+0000","last_active":"2024-04-25T01:43:29.397643+0000","last_peered":"2024-04-25T01:43:29.397643+0000","last_clean":"2024-04-25T01:43:29.397643+0000","last_became_active":"2024-04-25T01:39:23.368075+0000","last_became_peered":"2024-04-25T01:39:23.368075+0000","last_unstale":"2024-04-25T01:43:29.397643+0000","last_undegraded":"2024-04-25T01:43:29.397643+0000","last_fullsized":"2024-04-25T01:43:29.397643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:11.300091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.412259+0000","last_change":"2024-04-25T01:39:32.430007+0000","last_active":"2024-04-25T01:43:29.412259+0000","last_peered":"2024-04-25T01:43:29.412259+0000","last_clean":"2024-04-25T01:43:29.412259+0000","last_became_active":"2024-04-25T01:39:32.429721+0000","last_became_peered":"2024-04-25T01:39:32.429721+0000","last_unstale":"2024-04-25T01:43:29.412259+0000","last_undegraded":"2024-04-25T01:43:29.412259+0000","last_fullsized":"2024-04-25T01:43:29.412259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:48:47.409375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"30'171","reported_seq":196,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.755135+0000","last_change":"2024-04-25T01:39:33.447230+0000","last_active":"2024-04-25T01:43:34.755135+0000","last_peered":"2024-04-25T01:43:34.755135+0000","last_clean":"2024-04-25T01:43:34.755135+0000","last_became_active":"2024-04-25T01:39:33.446930+0000","last_became_peered":"2024-04-25T01:39:33.446930+0000","last_unstale":"2024-04-25T01:43:34.755135+0000","last_undegraded":"2024-04-25T01:43:34.755135+0000","last_fullsized":"2024-04-25T01:43:34.755135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:51:40.920560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'173","reported_seq":206,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.895588+0000","last_change":"2024-04-25T01:39:24.394286+0000","last_active":"2024-04-25T01:43:46.895588+0000","last_peered":"2024-04-25T01:43:46.895588+0000","last_clean":"2024-04-25T01:43:46.895588+0000","last_became_active":"2024-04-25T01:39:24.393558+0000","last_became_peered":"2024-04-25T01:39:24.393558+0000","last_unstale":"2024-04-25T01:43:46.895588+0000","last_undegraded":"2024-04-25T01:43:46.895588+0000","last_fullsized":"2024-04-25T01:43:46.895588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:59.100947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.404678+0000","last_change":"2024-04-25T01:39:23.370690+0000","last_active":"2024-04-25T01:43:29.404678+0000","last_peered":"2024-04-25T01:43:29.404678+0000","last_clean":"2024-04-25T01:43:29.404678+0000","last_became_active":"2024-04-25T01:39:23.370391+0000","last_became_peered":"2024-04-25T01:39:23.370391+0000","last_unstale":"2024-04-25T01:43:29.404678+0000","last_undegraded":"2024-04-25T01:43:29.404678+0000","last_fullsized":"2024-04-25T01:43:29.404678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:29.647636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"30'6","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.404958+0000","last_change":"2024-04-25T01:39:32.429412+0000","last_active":"2024-04-25T01:43:29.404958+0000","last_peered":"2024-04-25T01:43:29.404958+0000","last_clean":"2024-04-25T01:43:29.404958+0000","last_became_active":"2024-04-25T01:39:32.429143+0000","last_became_peered":"2024-04-25T01:39:32.429143+0000","last_unstale":"2024-04-25T01:43:29.404958+0000","last_undegraded":"2024-04-25T01:43:29.404958+0000","last_fullsized":"2024-04-25T01:43:29.404958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:53.637245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"30'173","reported_seq":198,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.766305+0000","last_change":"2024-04-25T01:39:33.437128+0000","last_active":"2024-04-25T01:43:34.766305+0000","last_peered":"2024-04-25T01:43:34.766305+0000","last_clean":"2024-04-25T01:43:34.766305+0000","last_became_active":"2024-04-25T01:39:33.436861+0000","last_became_peered":"2024-04-25T01:39:33.436861+0000","last_unstale":"2024-04-25T01:43:34.766305+0000","last_undegraded":"2024-04-25T01:43:34.766305+0000","last_fullsized":"2024-04-25T01:43:34.766305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:41.746373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"30'168","reported_seq":201,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.889452+0000","last_change":"2024-04-25T01:39:24.392170+0000","last_active":"2024-04-25T01:43:46.889452+0000","last_peered":"2024-04-25T01:43:46.889452+0000","last_clean":"2024-04-25T01:43:46.889452+0000","last_became_active":"2024-04-25T01:39:24.391811+0000","last_became_peered":"2024-04-25T01:39:24.391811+0000","last_unstale":"2024-04-25T01:43:46.889452+0000","last_undegraded":"2024-04-25T01:43:46.889452+0000","last_fullsized":"2024-04-25T01:43:46.889452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:32.859676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.398084+0000","last_change":"2024-04-25T01:39:23.369872+0000","last_active":"2024-04-25T01:43:29.398084+0000","last_peered":"2024-04-25T01:43:29.398084+0000","last_clean":"2024-04-25T01:43:29.398084+0000","last_became_active":"2024-04-25T01:39:23.369314+0000","last_became_peered":"2024-04-25T01:39:23.369314+0000","last_unstale":"2024-04-25T01:43:29.398084+0000","last_undegraded":"2024-04-25T01:43:29.398084+0000","last_fullsized":"2024-04-25T01:43:29.398084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:14.571148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.402443+0000","last_change":"2024-04-25T01:39:32.429664+0000","last_active":"2024-04-25T01:43:29.402443+0000","last_peered":"2024-04-25T01:43:29.402443+0000","last_clean":"2024-04-25T01:43:29.402443+0000","last_became_active":"2024-04-25T01:39:32.429358+0000","last_became_peered":"2024-04-25T01:39:32.429358+0000","last_unstale":"2024-04-25T01:43:29.402443+0000","last_undegraded":"2024-04-25T01:43:29.402443+0000","last_fullsized":"2024-04-25T01:43:29.402443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:57:10.913056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"30'178","reported_seq":203,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.682457+0000","last_change":"2024-04-25T01:39:33.440419+0000","last_active":"2024-04-25T01:43:34.682457+0000","last_peered":"2024-04-25T01:43:34.682457+0000","last_clean":"2024-04-25T01:43:34.682457+0000","last_became_active":"2024-04-25T01:39:33.440054+0000","last_became_peered":"2024-04-25T01:39:33.440054+0000","last_unstale":"2024-04-25T01:43:34.682457+0000","last_undegraded":"2024-04-25T01:43:34.682457+0000","last_fullsized":"2024-04-25T01:43:34.682457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:42.321235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"30'179","reported_seq":198,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.877749+0000","last_change":"2024-04-25T01:40:05.826359+0000","last_active":"2024-04-25T01:43:46.877749+0000","last_peered":"2024-04-25T01:43:46.877749+0000","last_clean":"2024-04-25T01:43:46.877749+0000","last_became_active":"2024-04-25T01:40:05.826076+0000","last_became_peered":"2024-04-25T01:40:05.826076+0000","last_unstale":"2024-04-25T01:43:46.877749+0000","last_undegraded":"2024-04-25T01:43:46.877749+0000","last_fullsized":"2024-04-25T01:43:46.877749+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:42:53.707094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.404466+0000","last_change":"2024-04-25T01:39:23.367322+0000","last_active":"2024-04-25T01:43:29.404466+0000","last_peered":"2024-04-25T01:43:29.404466+0000","last_clean":"2024-04-25T01:43:29.404466+0000","last_became_active":"2024-04-25T01:39:23.367054+0000","last_became_peered":"2024-04-25T01:39:23.367054+0000","last_unstale":"2024-04-25T01:43:29.404466+0000","last_undegraded":"2024-04-25T01:43:29.404466+0000","last_fullsized":"2024-04-25T01:43:29.404466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:10.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403318+0000","last_change":"2024-04-25T01:39:32.426874+0000","last_active":"2024-04-25T01:43:29.403318+0000","last_peered":"2024-04-25T01:43:29.403318+0000","last_clean":"2024-04-25T01:43:29.403318+0000","last_became_active":"2024-04-25T01:39:32.426599+0000","last_became_peered":"2024-04-25T01:39:32.426599+0000","last_unstale":"2024-04-25T01:43:29.403318+0000","last_undegraded":"2024-04-25T01:43:29.403318+0000","last_fullsized":"2024-04-25T01:43:29.403318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:27.672277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"30'164","reported_seq":189,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.722453+0000","last_change":"2024-04-25T01:39:33.428909+0000","last_active":"2024-04-25T01:43:34.722453+0000","last_peered":"2024-04-25T01:43:34.722453+0000","last_clean":"2024-04-25T01:43:34.722453+0000","last_became_active":"2024-04-25T01:39:33.428626+0000","last_became_peered":"2024-04-25T01:39:33.428626+0000","last_unstale":"2024-04-25T01:43:34.722453+0000","last_undegraded":"2024-04-25T01:43:34.722453+0000","last_fullsized":"2024-04-25T01:43:34.722453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:21.188264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'204","reported_seq":237,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.879392+0000","last_change":"2024-04-25T01:39:24.389946+0000","last_active":"2024-04-25T01:43:46.879392+0000","last_peered":"2024-04-25T01:43:46.879392+0000","last_clean":"2024-04-25T01:43:46.879392+0000","last_became_active":"2024-04-25T01:39:24.389656+0000","last_became_peered":"2024-04-25T01:39:24.389656+0000","last_unstale":"2024-04-25T01:43:46.879392+0000","last_undegraded":"2024-04-25T01:43:46.879392+0000","last_fullsized":"2024-04-25T01:43:46.879392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:55.943639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"30'9","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.397557+0000","last_change":"2024-04-25T01:39:23.373599+0000","last_active":"2024-04-25T01:43:29.397557+0000","last_peered":"2024-04-25T01:43:29.397557+0000","last_clean":"2024-04-25T01:43:29.397557+0000","last_became_active":"2024-04-25T01:39:23.373281+0000","last_became_peered":"2024-04-25T01:39:23.373281+0000","last_unstale":"2024-04-25T01:43:29.397557+0000","last_undegraded":"2024-04-25T01:43:29.397557+0000","last_fullsized":"2024-04-25T01:43:29.397557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:40.850925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.403096+0000","last_change":"2024-04-25T01:39:32.427502+0000","last_active":"2024-04-25T01:43:29.403096+0000","last_peered":"2024-04-25T01:43:29.403096+0000","last_clean":"2024-04-25T01:43:29.403096+0000","last_became_active":"2024-04-25T01:39:32.426499+0000","last_became_peered":"2024-04-25T01:39:32.426499+0000","last_unstale":"2024-04-25T01:43:29.403096+0000","last_undegraded":"2024-04-25T01:43:29.403096+0000","last_fullsized":"2024-04-25T01:43:29.403096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:26.977416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"30'274","reported_seq":299,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.747979+0000","last_change":"2024-04-25T01:39:33.436901+0000","last_active":"2024-04-25T01:43:34.747979+0000","last_peered":"2024-04-25T01:43:34.747979+0000","last_clean":"2024-04-25T01:43:34.747979+0000","last_became_active":"2024-04-25T01:39:33.436001+0000","last_became_peered":"2024-04-25T01:39:33.436001+0000","last_unstale":"2024-04-25T01:43:34.747979+0000","last_undegraded":"2024-04-25T01:43:34.747979+0000","last_fullsized":"2024-04-25T01:43:34.747979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:34:41.678663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"30'176","reported_seq":209,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.874522+0000","last_change":"2024-04-25T01:39:24.394248+0000","last_active":"2024-04-25T01:43:46.874522+0000","last_peered":"2024-04-25T01:43:46.874522+0000","last_clean":"2024-04-25T01:43:46.874522+0000","last_became_active":"2024-04-25T01:39:24.393958+0000","last_became_peered":"2024-04-25T01:39:24.393958+0000","last_unstale":"2024-04-25T01:43:46.874522+0000","last_undegraded":"2024-04-25T01:43:46.874522+0000","last_fullsized":"2024-04-25T01:43:46.874522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:35.087577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.412806+0000","last_change":"2024-04-25T01:39:23.372939+0000","last_active":"2024-04-25T01:43:29.412806+0000","last_peered":"2024-04-25T01:43:29.412806+0000","last_clean":"2024-04-25T01:43:29.412806+0000","last_became_active":"2024-04-25T01:39:23.372648+0000","last_became_peered":"2024-04-25T01:39:23.372648+0000","last_unstale":"2024-04-25T01:43:29.412806+0000","last_undegraded":"2024-04-25T01:43:29.412806+0000","last_fullsized":"2024-04-25T01:43:29.412806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:02:13.283096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'1","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.408083+0000","last_change":"2024-04-25T01:39:32.432218+0000","last_active":"2024-04-25T01:43:29.408083+0000","last_peered":"2024-04-25T01:43:29.408083+0000","last_clean":"2024-04-25T01:43:29.408083+0000","last_became_active":"2024-04-25T01:39:32.431938+0000","last_became_peered":"2024-04-25T01:39:32.431938+0000","last_unstale":"2024-04-25T01:43:29.408083+0000","last_undegraded":"2024-04-25T01:43:29.408083+0000","last_fullsized":"2024-04-25T01:43:29.408083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:56:15.053817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"30'185","reported_seq":210,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.742694+0000","last_change":"2024-04-25T01:39:33.441342+0000","last_active":"2024-04-25T01:43:34.742694+0000","last_peered":"2024-04-25T01:43:34.742694+0000","last_clean":"2024-04-25T01:43:34.742694+0000","last_became_active":"2024-04-25T01:39:33.441074+0000","last_became_peered":"2024-04-25T01:39:33.441074+0000","last_unstale":"2024-04-25T01:43:34.742694+0000","last_undegraded":"2024-04-25T01:43:34.742694+0000","last_fullsized":"2024-04-25T01:43:34.742694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:22:43.000112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'214","reported_seq":247,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.879311+0000","last_change":"2024-04-25T01:39:24.390114+0000","last_active":"2024-04-25T01:43:46.879311+0000","last_peered":"2024-04-25T01:43:46.879311+0000","last_clean":"2024-04-25T01:43:46.879311+0000","last_became_active":"2024-04-25T01:39:24.389841+0000","last_became_peered":"2024-04-25T01:39:24.389841+0000","last_unstale":"2024-04-25T01:43:46.879311+0000","last_undegraded":"2024-04-25T01:43:46.879311+0000","last_fullsized":"2024-04-25T01:43:46.879311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:34.950624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.406513+0000","last_change":"2024-04-25T01:39:23.369440+0000","last_active":"2024-04-25T01:43:29.406513+0000","last_peered":"2024-04-25T01:43:29.406513+0000","last_clean":"2024-04-25T01:43:29.406513+0000","last_became_active":"2024-04-25T01:39:23.369151+0000","last_became_peered":"2024-04-25T01:39:23.369151+0000","last_unstale":"2024-04-25T01:43:29.406513+0000","last_undegraded":"2024-04-25T01:43:29.406513+0000","last_fullsized":"2024-04-25T01:43:29.406513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:31:46.921287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'2025","reported_seq":2069,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.433802+0000","last_change":"2024-04-25T01:39:32.430701+0000","last_active":"2024-04-25T01:43:32.433802+0000","last_peered":"2024-04-25T01:43:32.433802+0000","last_clean":"2024-04-25T01:43:32.433802+0000","last_became_active":"2024-04-25T01:39:32.430187+0000","last_became_peered":"2024-04-25T01:39:32.430187+0000","last_unstale":"2024-04-25T01:43:32.433802+0000","last_undegraded":"2024-04-25T01:43:32.433802+0000","last_fullsized":"2024-04-25T01:43:32.433802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2025,"log_dups_size":0,"ondisk_log_size":2025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:57.148375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":4133,"num_write":2022,"num_write_kb":6038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"30'182","reported_seq":207,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.699488+0000","last_change":"2024-04-25T01:39:33.427429+0000","last_active":"2024-04-25T01:43:34.699488+0000","last_peered":"2024-04-25T01:43:34.699488+0000","last_clean":"2024-04-25T01:43:34.699488+0000","last_became_active":"2024-04-25T01:39:33.427164+0000","last_became_peered":"2024-04-25T01:39:33.427164+0000","last_unstale":"2024-04-25T01:43:34.699488+0000","last_undegraded":"2024-04-25T01:43:34.699488+0000","last_fullsized":"2024-04-25T01:43:34.699488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:33:59.664252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"30'179","reported_seq":212,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.881499+0000","last_change":"2024-04-25T01:39:24.388852+0000","last_active":"2024-04-25T01:43:46.881499+0000","last_peered":"2024-04-25T01:43:46.881499+0000","last_clean":"2024-04-25T01:43:46.881499+0000","last_became_active":"2024-04-25T01:39:24.388594+0000","last_became_peered":"2024-04-25T01:39:24.388594+0000","last_unstale":"2024-04-25T01:43:46.881499+0000","last_undegraded":"2024-04-25T01:43:46.881499+0000","last_fullsized":"2024-04-25T01:43:46.881499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:46:49.718182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.404791+0000","last_change":"2024-04-25T01:39:23.372903+0000","last_active":"2024-04-25T01:43:29.404791+0000","last_peered":"2024-04-25T01:43:29.404791+0000","last_clean":"2024-04-25T01:43:29.404791+0000","last_became_active":"2024-04-25T01:39:23.372617+0000","last_became_peered":"2024-04-25T01:39:23.372617+0000","last_unstale":"2024-04-25T01:43:29.404791+0000","last_undegraded":"2024-04-25T01:43:29.404791+0000","last_fullsized":"2024-04-25T01:43:29.404791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:54:58.506432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"30'8","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:35.564703+0000","last_change":"2024-04-25T01:39:32.430218+0000","last_active":"2024-04-25T01:43:35.564703+0000","last_peered":"2024-04-25T01:43:35.564703+0000","last_clean":"2024-04-25T01:43:35.564703+0000","last_became_active":"2024-04-25T01:39:32.429900+0000","last_became_peered":"2024-04-25T01:39:32.429900+0000","last_unstale":"2024-04-25T01:43:35.564703+0000","last_undegraded":"2024-04-25T01:43:35.564703+0000","last_fullsized":"2024-04-25T01:43:35.564703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:52.253045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"30'217","reported_seq":242,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.745610+0000","last_change":"2024-04-25T01:39:33.440325+0000","last_active":"2024-04-25T01:43:34.745610+0000","last_peered":"2024-04-25T01:43:34.745610+0000","last_clean":"2024-04-25T01:43:34.745610+0000","last_became_active":"2024-04-25T01:39:33.439961+0000","last_became_peered":"2024-04-25T01:39:33.439961+0000","last_unstale":"2024-04-25T01:43:34.745610+0000","last_undegraded":"2024-04-25T01:43:34.745610+0000","last_fullsized":"2024-04-25T01:43:34.745610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:01.846576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'159","reported_seq":192,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.885824+0000","last_change":"2024-04-25T01:39:24.380617+0000","last_active":"2024-04-25T01:43:46.885824+0000","last_peered":"2024-04-25T01:43:46.885824+0000","last_clean":"2024-04-25T01:43:46.885824+0000","last_became_active":"2024-04-25T01:39:24.380330+0000","last_became_peered":"2024-04-25T01:39:24.380330+0000","last_unstale":"2024-04-25T01:43:46.885824+0000","last_undegraded":"2024-04-25T01:43:46.885824+0000","last_fullsized":"2024-04-25T01:43:46.885824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:24.010569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"30'2022","reported_seq":2070,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.412675+0000","last_change":"2024-04-25T01:39:23.373295+0000","last_active":"2024-04-25T01:43:29.412675+0000","last_peered":"2024-04-25T01:43:29.412675+0000","last_clean":"2024-04-25T01:43:29.412675+0000","last_became_active":"2024-04-25T01:39:23.372984+0000","last_became_peered":"2024-04-25T01:39:23.372984+0000","last_unstale":"2024-04-25T01:43:29.412675+0000","last_undegraded":"2024-04-25T01:43:29.412675+0000","last_fullsized":"2024-04-25T01:43:29.412675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":2022,"log_dups_size":0,"ondisk_log_size":2022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:10.854190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":65,"num_write":2019,"num_write_kb":6035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.401920+0000","last_change":"2024-04-25T01:39:32.433589+0000","last_active":"2024-04-25T01:43:29.401920+0000","last_peered":"2024-04-25T01:43:29.401920+0000","last_clean":"2024-04-25T01:43:29.401920+0000","last_became_active":"2024-04-25T01:39:32.433408+0000","last_became_peered":"2024-04-25T01:39:32.433408+0000","last_unstale":"2024-04-25T01:43:29.401920+0000","last_undegraded":"2024-04-25T01:43:29.401920+0000","last_fullsized":"2024-04-25T01:43:29.401920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:25.789951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"30'189","reported_seq":214,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.688751+0000","last_change":"2024-04-25T01:39:33.433449+0000","last_active":"2024-04-25T01:43:34.688751+0000","last_peered":"2024-04-25T01:43:34.688751+0000","last_clean":"2024-04-25T01:43:34.688751+0000","last_became_active":"2024-04-25T01:39:33.432690+0000","last_became_peered":"2024-04-25T01:39:33.432690+0000","last_unstale":"2024-04-25T01:43:34.688751+0000","last_undegraded":"2024-04-25T01:43:34.688751+0000","last_fullsized":"2024-04-25T01:43:34.688751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:47:30.046453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"30'179","reported_seq":212,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.886230+0000","last_change":"2024-04-25T01:39:24.391245+0000","last_active":"2024-04-25T01:43:46.886230+0000","last_peered":"2024-04-25T01:43:46.886230+0000","last_clean":"2024-04-25T01:43:46.886230+0000","last_became_active":"2024-04-25T01:39:24.390941+0000","last_became_peered":"2024-04-25T01:39:24.390941+0000","last_unstale":"2024-04-25T01:43:46.886230+0000","last_undegraded":"2024-04-25T01:43:46.886230+0000","last_fullsized":"2024-04-25T01:43:46.886230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:55.182405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"30'8","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:35.181358+0000","last_change":"2024-04-25T01:39:23.369043+0000","last_active":"2024-04-25T01:43:35.181358+0000","last_peered":"2024-04-25T01:43:35.181358+0000","last_clean":"2024-04-25T01:43:35.181358+0000","last_became_active":"2024-04-25T01:39:23.368778+0000","last_became_peered":"2024-04-25T01:39:23.368778+0000","last_unstale":"2024-04-25T01:43:35.181358+0000","last_undegraded":"2024-04-25T01:43:35.181358+0000","last_fullsized":"2024-04-25T01:43:35.181358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:59.501724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.404425+0000","last_change":"2024-04-25T01:39:32.431530+0000","last_active":"2024-04-25T01:43:29.404425+0000","last_peered":"2024-04-25T01:43:29.404425+0000","last_clean":"2024-04-25T01:43:29.404425+0000","last_became_active":"2024-04-25T01:39:32.431247+0000","last_became_peered":"2024-04-25T01:39:32.431247+0000","last_unstale":"2024-04-25T01:43:29.404425+0000","last_undegraded":"2024-04-25T01:43:29.404425+0000","last_fullsized":"2024-04-25T01:43:29.404425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:46:02.014508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":24,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"30'233","reported_seq":258,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.697325+0000","last_change":"2024-04-25T01:39:33.446545+0000","last_active":"2024-04-25T01:43:34.697325+0000","last_peered":"2024-04-25T01:43:34.697325+0000","last_clean":"2024-04-25T01:43:34.697325+0000","last_became_active":"2024-04-25T01:39:33.446263+0000","last_became_peered":"2024-04-25T01:39:33.446263+0000","last_unstale":"2024-04-25T01:43:34.697325+0000","last_undegraded":"2024-04-25T01:43:34.697325+0000","last_fullsized":"2024-04-25T01:43:34.697325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:27.026460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"30'153","reported_seq":186,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.894871+0000","last_change":"2024-04-25T01:39:24.403875+0000","last_active":"2024-04-25T01:43:46.894871+0000","last_peered":"2024-04-25T01:43:46.894871+0000","last_clean":"2024-04-25T01:43:46.894871+0000","last_became_active":"2024-04-25T01:39:24.403591+0000","last_became_peered":"2024-04-25T01:39:24.403591+0000","last_unstale":"2024-04-25T01:43:46.894871+0000","last_undegraded":"2024-04-25T01:43:46.894871+0000","last_fullsized":"2024-04-25T01:43:46.894871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:45.276173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.406434+0000","last_change":"2024-04-25T01:39:23.378968+0000","last_active":"2024-04-25T01:43:29.406434+0000","last_peered":"2024-04-25T01:43:29.406434+0000","last_clean":"2024-04-25T01:43:29.406434+0000","last_became_active":"2024-04-25T01:39:23.378635+0000","last_became_peered":"2024-04-25T01:39:23.378635+0000","last_unstale":"2024-04-25T01:43:29.406434+0000","last_undegraded":"2024-04-25T01:43:29.406434+0000","last_fullsized":"2024-04-25T01:43:29.406434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:39.780544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.431179+0000","last_change":"2024-04-25T01:39:32.427357+0000","last_active":"2024-04-25T01:43:32.431179+0000","last_peered":"2024-04-25T01:43:32.431179+0000","last_clean":"2024-04-25T01:43:32.431179+0000","last_became_active":"2024-04-25T01:39:32.427105+0000","last_became_peered":"2024-04-25T01:39:32.427105+0000","last_unstale":"2024-04-25T01:43:32.431179+0000","last_undegraded":"2024-04-25T01:43:32.431179+0000","last_fullsized":"2024-04-25T01:43:32.431179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:02:04.848726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":66,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'217","reported_seq":242,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.751559+0000","last_change":"2024-04-25T01:39:33.444814+0000","last_active":"2024-04-25T01:43:34.751559+0000","last_peered":"2024-04-25T01:43:34.751559+0000","last_clean":"2024-04-25T01:43:34.751559+0000","last_became_active":"2024-04-25T01:39:33.444489+0000","last_became_peered":"2024-04-25T01:39:33.444489+0000","last_unstale":"2024-04-25T01:43:34.751559+0000","last_undegraded":"2024-04-25T01:43:34.751559+0000","last_fullsized":"2024-04-25T01:43:34.751559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:51:06.718940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"30'235","reported_seq":268,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.898877+0000","last_change":"2024-04-25T01:39:24.392642+0000","last_active":"2024-04-25T01:43:46.898877+0000","last_peered":"2024-04-25T01:43:46.898877+0000","last_clean":"2024-04-25T01:43:46.898877+0000","last_became_active":"2024-04-25T01:39:24.391605+0000","last_became_peered":"2024-04-25T01:39:24.391605+0000","last_unstale":"2024-04-25T01:43:46.898877+0000","last_undegraded":"2024-04-25T01:43:46.898877+0000","last_fullsized":"2024-04-25T01:43:46.898877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:01:23.217074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":565248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.413394+0000","last_change":"2024-04-25T01:39:23.377236+0000","last_active":"2024-04-25T01:43:29.413394+0000","last_peered":"2024-04-25T01:43:29.413394+0000","last_clean":"2024-04-25T01:43:29.413394+0000","last_became_active":"2024-04-25T01:39:23.376727+0000","last_became_peered":"2024-04-25T01:39:23.376727+0000","last_unstale":"2024-04-25T01:43:29.413394+0000","last_undegraded":"2024-04-25T01:43:29.413394+0000","last_fullsized":"2024-04-25T01:43:29.413394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:08.103707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.407470+0000","last_change":"2024-04-25T01:39:32.424457+0000","last_active":"2024-04-25T01:43:29.407470+0000","last_peered":"2024-04-25T01:43:29.407470+0000","last_clean":"2024-04-25T01:43:29.407470+0000","last_became_active":"2024-04-25T01:39:32.424203+0000","last_became_peered":"2024-04-25T01:39:32.424203+0000","last_unstale":"2024-04-25T01:43:29.407470+0000","last_undegraded":"2024-04-25T01:43:29.407470+0000","last_fullsized":"2024-04-25T01:43:29.407470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:12:20.824070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"30'172","reported_seq":198,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.723551+0000","last_change":"2024-04-25T01:39:33.445948+0000","last_active":"2024-04-25T01:43:34.723551+0000","last_peered":"2024-04-25T01:43:34.723551+0000","last_clean":"2024-04-25T01:43:34.723551+0000","last_became_active":"2024-04-25T01:39:33.445654+0000","last_became_peered":"2024-04-25T01:39:33.445654+0000","last_unstale":"2024-04-25T01:43:34.723551+0000","last_undegraded":"2024-04-25T01:43:34.723551+0000","last_fullsized":"2024-04-25T01:43:34.723551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:51.323909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'4","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.612487+0000","last_change":"2024-04-25T01:39:32.430484+0000","last_active":"2024-04-25T01:43:29.612487+0000","last_peered":"2024-04-25T01:43:29.612487+0000","last_clean":"2024-04-25T01:43:29.612487+0000","last_became_active":"2024-04-25T01:39:32.430220+0000","last_became_peered":"2024-04-25T01:39:32.430220+0000","last_unstale":"2024-04-25T01:43:29.612487+0000","last_undegraded":"2024-04-25T01:43:29.612487+0000","last_fullsized":"2024-04-25T01:43:29.612487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:36:53.152442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"30'187","reported_seq":220,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.879565+0000","last_change":"2024-04-25T01:39:24.375457+0000","last_active":"2024-04-25T01:43:46.879565+0000","last_peered":"2024-04-25T01:43:46.879565+0000","last_clean":"2024-04-25T01:43:46.879565+0000","last_became_active":"2024-04-25T01:39:24.375178+0000","last_became_peered":"2024-04-25T01:39:24.375178+0000","last_unstale":"2024-04-25T01:43:46.879565+0000","last_undegraded":"2024-04-25T01:43:46.879565+0000","last_fullsized":"2024-04-25T01:43:46.879565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:58:15.640882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.402961+0000","last_change":"2024-04-25T01:39:23.369998+0000","last_active":"2024-04-25T01:43:29.402961+0000","last_peered":"2024-04-25T01:43:29.402961+0000","last_clean":"2024-04-25T01:43:29.402961+0000","last_became_active":"2024-04-25T01:39:23.369710+0000","last_became_peered":"2024-04-25T01:39:23.369710+0000","last_unstale":"2024-04-25T01:43:29.402961+0000","last_undegraded":"2024-04-25T01:43:29.402961+0000","last_fullsized":"2024-04-25T01:43:29.402961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:32:34.329452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"30'192","reported_seq":218,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.763527+0000","last_change":"2024-04-25T01:39:33.447666+0000","last_active":"2024-04-25T01:43:34.763527+0000","last_peered":"2024-04-25T01:43:34.763527+0000","last_clean":"2024-04-25T01:43:34.763527+0000","last_became_active":"2024-04-25T01:39:33.447436+0000","last_became_peered":"2024-04-25T01:39:33.447436+0000","last_unstale":"2024-04-25T01:43:34.763527+0000","last_undegraded":"2024-04-25T01:43:34.763527+0000","last_fullsized":"2024-04-25T01:43:34.763527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:25:20.440422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'7","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.420309+0000","last_change":"2024-04-25T01:39:32.436300+0000","last_active":"2024-04-25T01:43:32.420309+0000","last_peered":"2024-04-25T01:43:32.420309+0000","last_clean":"2024-04-25T01:43:32.420309+0000","last_became_active":"2024-04-25T01:39:32.436000+0000","last_became_peered":"2024-04-25T01:39:32.436000+0000","last_unstale":"2024-04-25T01:43:32.420309+0000","last_undegraded":"2024-04-25T01:43:32.420309+0000","last_fullsized":"2024-04-25T01:43:32.420309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:38.044992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"30'190","reported_seq":223,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.876992+0000","last_change":"2024-04-25T01:39:24.387708+0000","last_active":"2024-04-25T01:43:46.876992+0000","last_peered":"2024-04-25T01:43:46.876992+0000","last_clean":"2024-04-25T01:43:46.876992+0000","last_became_active":"2024-04-25T01:39:24.387433+0000","last_became_peered":"2024-04-25T01:39:24.387433+0000","last_unstale":"2024-04-25T01:43:46.876992+0000","last_undegraded":"2024-04-25T01:43:46.876992+0000","last_fullsized":"2024-04-25T01:43:46.876992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:34:34.312066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.407793+0000","last_change":"2024-04-25T01:39:23.377487+0000","last_active":"2024-04-25T01:43:29.407793+0000","last_peered":"2024-04-25T01:43:29.407793+0000","last_clean":"2024-04-25T01:43:29.407793+0000","last_became_active":"2024-04-25T01:39:23.377181+0000","last_became_peered":"2024-04-25T01:39:23.377181+0000","last_unstale":"2024-04-25T01:43:29.407793+0000","last_undegraded":"2024-04-25T01:43:29.407793+0000","last_fullsized":"2024-04-25T01:43:29.407793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:17.434141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"30'209","reported_seq":234,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.752030+0000","last_change":"2024-04-25T01:39:33.444973+0000","last_active":"2024-04-25T01:43:34.752030+0000","last_peered":"2024-04-25T01:43:34.752030+0000","last_clean":"2024-04-25T01:43:34.752030+0000","last_became_active":"2024-04-25T01:39:33.444673+0000","last_became_peered":"2024-04-25T01:39:33.444673+0000","last_unstale":"2024-04-25T01:43:34.752030+0000","last_undegraded":"2024-04-25T01:43:34.752030+0000","last_fullsized":"2024-04-25T01:43:34.752030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:08.372714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"29'3","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.412813+0000","last_change":"2024-04-25T01:39:23.372975+0000","last_active":"2024-04-25T01:43:29.412813+0000","last_peered":"2024-04-25T01:43:29.412813+0000","last_clean":"2024-04-25T01:43:29.412813+0000","last_became_active":"2024-04-25T01:39:23.372688+0000","last_became_peered":"2024-04-25T01:39:23.372688+0000","last_unstale":"2024-04-25T01:43:29.412813+0000","last_undegraded":"2024-04-25T01:43:29.412813+0000","last_fullsized":"2024-04-25T01:43:29.412813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:42:57.195844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"30'158","reported_seq":191,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.883850+0000","last_change":"2024-04-25T01:39:24.388095+0000","last_active":"2024-04-25T01:43:46.883850+0000","last_peered":"2024-04-25T01:43:46.883850+0000","last_clean":"2024-04-25T01:43:46.883850+0000","last_became_active":"2024-04-25T01:39:24.387797+0000","last_became_peered":"2024-04-25T01:39:24.387797+0000","last_unstale":"2024-04-25T01:43:46.883850+0000","last_undegraded":"2024-04-25T01:43:46.883850+0000","last_fullsized":"2024-04-25T01:43:46.883850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:43:16.385957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.424303+0000","last_change":"2024-04-25T01:39:32.427081+0000","last_active":"2024-04-25T01:43:32.424303+0000","last_peered":"2024-04-25T01:43:32.424303+0000","last_clean":"2024-04-25T01:43:32.424303+0000","last_became_active":"2024-04-25T01:39:32.426626+0000","last_became_peered":"2024-04-25T01:39:32.426626+0000","last_unstale":"2024-04-25T01:43:32.424303+0000","last_undegraded":"2024-04-25T01:43:32.424303+0000","last_fullsized":"2024-04-25T01:43:32.424303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:45.358400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"30'170","reported_seq":195,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.728867+0000","last_change":"2024-04-25T01:39:33.446301+0000","last_active":"2024-04-25T01:43:34.728867+0000","last_peered":"2024-04-25T01:43:34.728867+0000","last_clean":"2024-04-25T01:43:34.728867+0000","last_became_active":"2024-04-25T01:39:33.445158+0000","last_became_peered":"2024-04-25T01:39:33.445158+0000","last_unstale":"2024-04-25T01:43:34.728867+0000","last_undegraded":"2024-04-25T01:43:34.728867+0000","last_fullsized":"2024-04-25T01:43:34.728867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:53:26.017968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"30'1825","reported_seq":1860,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.846785+0000","last_change":"2024-04-25T01:39:23.371716+0000","last_active":"2024-04-25T01:43:46.846785+0000","last_peered":"2024-04-25T01:43:46.846785+0000","last_clean":"2024-04-25T01:43:46.846785+0000","last_became_active":"2024-04-25T01:39:23.371475+0000","last_became_peered":"2024-04-25T01:39:23.371475+0000","last_unstale":"2024-04-25T01:43:46.846785+0000","last_undegraded":"2024-04-25T01:43:46.846785+0000","last_fullsized":"2024-04-25T01:43:46.846785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":1825,"log_dups_size":0,"ondisk_log_size":1825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:10.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3805284,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1822,"num_write_kb":5471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"30'150","reported_seq":183,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.870889+0000","last_change":"2024-04-25T01:39:24.388083+0000","last_active":"2024-04-25T01:43:46.870889+0000","last_peered":"2024-04-25T01:43:46.870889+0000","last_clean":"2024-04-25T01:43:46.870889+0000","last_became_active":"2024-04-25T01:39:24.387789+0000","last_became_peered":"2024-04-25T01:39:24.387789+0000","last_unstale":"2024-04-25T01:43:46.870889+0000","last_undegraded":"2024-04-25T01:43:46.870889+0000","last_fullsized":"2024-04-25T01:43:46.870889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:31.760631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'5","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:32.422640+0000","last_change":"2024-04-25T01:39:32.429613+0000","last_active":"2024-04-25T01:43:32.422640+0000","last_peered":"2024-04-25T01:43:32.422640+0000","last_clean":"2024-04-25T01:43:32.422640+0000","last_became_active":"2024-04-25T01:39:32.429361+0000","last_became_peered":"2024-04-25T01:39:32.429361+0000","last_unstale":"2024-04-25T01:43:32.422640+0000","last_undegraded":"2024-04-25T01:43:32.422640+0000","last_fullsized":"2024-04-25T01:43:32.422640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:31.399787+0000","last_clean_scrub_stamp":"2024-04-25T01:39:31.399787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:04:59.928602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"30'221","reported_seq":246,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.683570+0000","last_change":"2024-04-25T01:39:33.426384+0000","last_active":"2024-04-25T01:43:34.683570+0000","last_peered":"2024-04-25T01:43:34.683570+0000","last_clean":"2024-04-25T01:43:34.683570+0000","last_became_active":"2024-04-25T01:39:33.426101+0000","last_became_peered":"2024-04-25T01:39:33.426101+0000","last_unstale":"2024-04-25T01:43:34.683570+0000","last_undegraded":"2024-04-25T01:43:34.683570+0000","last_fullsized":"2024-04-25T01:43:34.683570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:36.820458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"30'172","reported_seq":206,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.884138+0000","last_change":"2024-04-25T01:39:24.395618+0000","last_active":"2024-04-25T01:43:46.884138+0000","last_peered":"2024-04-25T01:43:46.884138+0000","last_clean":"2024-04-25T01:43:46.884138+0000","last_became_active":"2024-04-25T01:39:24.394816+0000","last_became_peered":"2024-04-25T01:39:24.394816+0000","last_unstale":"2024-04-25T01:43:46.884138+0000","last_undegraded":"2024-04-25T01:43:46.884138+0000","last_fullsized":"2024-04-25T01:43:46.884138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:01.025135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"30'174","reported_seq":199,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.719246+0000","last_change":"2024-04-25T01:39:33.432537+0000","last_active":"2024-04-25T01:43:34.719246+0000","last_peered":"2024-04-25T01:43:34.719246+0000","last_clean":"2024-04-25T01:43:34.719246+0000","last_became_active":"2024-04-25T01:39:33.432266+0000","last_became_peered":"2024-04-25T01:39:33.432266+0000","last_unstale":"2024-04-25T01:43:34.719246+0000","last_undegraded":"2024-04-25T01:43:34.719246+0000","last_fullsized":"2024-04-25T01:43:34.719246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:31.703689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"30'158","reported_seq":197,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.876820+0000","last_change":"2024-04-25T01:40:06.450805+0000","last_active":"2024-04-25T01:43:46.876820+0000","last_peered":"2024-04-25T01:43:46.876820+0000","last_clean":"2024-04-25T01:43:46.876820+0000","last_became_active":"2024-04-25T01:40:06.450447+0000","last_became_peered":"2024-04-25T01:40:06.450447+0000","last_unstale":"2024-04-25T01:43:46.876820+0000","last_undegraded":"2024-04-25T01:43:46.876820+0000","last_fullsized":"2024-04-25T01:43:46.876820+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:37:30.384756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"30'168","reported_seq":193,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.705486+0000","last_change":"2024-04-25T01:39:33.439086+0000","last_active":"2024-04-25T01:43:34.705486+0000","last_peered":"2024-04-25T01:43:34.705486+0000","last_clean":"2024-04-25T01:43:34.705486+0000","last_became_active":"2024-04-25T01:39:33.438811+0000","last_became_peered":"2024-04-25T01:39:33.438811+0000","last_unstale":"2024-04-25T01:43:34.705486+0000","last_undegraded":"2024-04-25T01:43:34.705486+0000","last_fullsized":"2024-04-25T01:43:34.705486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:49:23.604749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"30'143","reported_seq":177,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.895840+0000","last_change":"2024-04-25T01:39:24.399738+0000","last_active":"2024-04-25T01:43:46.895840+0000","last_peered":"2024-04-25T01:43:46.895840+0000","last_clean":"2024-04-25T01:43:46.895840+0000","last_became_active":"2024-04-25T01:39:24.399499+0000","last_became_peered":"2024-04-25T01:39:24.399499+0000","last_unstale":"2024-04-25T01:43:46.895840+0000","last_undegraded":"2024-04-25T01:43:46.895840+0000","last_fullsized":"2024-04-25T01:43:46.895840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:58.646669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":311296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"30'184","reported_seq":209,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.728870+0000","last_change":"2024-04-25T01:39:33.444074+0000","last_active":"2024-04-25T01:43:34.728870+0000","last_peered":"2024-04-25T01:43:34.728870+0000","last_clean":"2024-04-25T01:43:34.728870+0000","last_became_active":"2024-04-25T01:39:33.443796+0000","last_became_peered":"2024-04-25T01:39:33.443796+0000","last_unstale":"2024-04-25T01:43:34.728870+0000","last_undegraded":"2024-04-25T01:43:34.728870+0000","last_fullsized":"2024-04-25T01:43:34.728870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:56.379211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"30'124","reported_seq":158,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.880255+0000","last_change":"2024-04-25T01:39:24.390631+0000","last_active":"2024-04-25T01:43:46.880255+0000","last_peered":"2024-04-25T01:43:46.880255+0000","last_clean":"2024-04-25T01:43:46.880255+0000","last_became_active":"2024-04-25T01:39:24.390363+0000","last_became_peered":"2024-04-25T01:39:24.390363+0000","last_unstale":"2024-04-25T01:43:46.880255+0000","last_undegraded":"2024-04-25T01:43:46.880255+0000","last_fullsized":"2024-04-25T01:43:46.880255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:48.830416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"30'162","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.716155+0000","last_change":"2024-04-25T01:39:33.437787+0000","last_active":"2024-04-25T01:43:34.716155+0000","last_peered":"2024-04-25T01:43:34.716155+0000","last_clean":"2024-04-25T01:43:34.716155+0000","last_became_active":"2024-04-25T01:39:33.436131+0000","last_became_peered":"2024-04-25T01:39:33.436131+0000","last_unstale":"2024-04-25T01:43:34.716155+0000","last_undegraded":"2024-04-25T01:43:34.716155+0000","last_fullsized":"2024-04-25T01:43:34.716155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:29:13.213643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"30'148","reported_seq":182,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.875617+0000","last_change":"2024-04-25T01:39:24.389645+0000","last_active":"2024-04-25T01:43:46.875617+0000","last_peered":"2024-04-25T01:43:46.875617+0000","last_clean":"2024-04-25T01:43:46.875617+0000","last_became_active":"2024-04-25T01:39:24.389375+0000","last_became_peered":"2024-04-25T01:39:24.389375+0000","last_unstale":"2024-04-25T01:43:46.875617+0000","last_undegraded":"2024-04-25T01:43:46.875617+0000","last_fullsized":"2024-04-25T01:43:46.875617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:13:12.753893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"30'141","reported_seq":167,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.743053+0000","last_change":"2024-04-25T01:39:33.448177+0000","last_active":"2024-04-25T01:43:34.743053+0000","last_peered":"2024-04-25T01:43:34.743053+0000","last_clean":"2024-04-25T01:43:34.743053+0000","last_became_active":"2024-04-25T01:39:33.447588+0000","last_became_peered":"2024-04-25T01:39:33.447588+0000","last_unstale":"2024-04-25T01:43:34.743053+0000","last_undegraded":"2024-04-25T01:43:34.743053+0000","last_fullsized":"2024-04-25T01:43:34.743053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:11:20.466189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"30'156","reported_seq":190,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.878803+0000","last_change":"2024-04-25T01:39:24.374082+0000","last_active":"2024-04-25T01:43:46.878803+0000","last_peered":"2024-04-25T01:43:46.878803+0000","last_clean":"2024-04-25T01:43:46.878803+0000","last_became_active":"2024-04-25T01:39:24.373731+0000","last_became_peered":"2024-04-25T01:39:24.373731+0000","last_unstale":"2024-04-25T01:43:46.878803+0000","last_undegraded":"2024-04-25T01:43:46.878803+0000","last_fullsized":"2024-04-25T01:43:46.878803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:45.817483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"30'188","reported_seq":214,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.753852+0000","last_change":"2024-04-25T01:39:33.446992+0000","last_active":"2024-04-25T01:43:34.753852+0000","last_peered":"2024-04-25T01:43:34.753852+0000","last_clean":"2024-04-25T01:43:34.753852+0000","last_became_active":"2024-04-25T01:39:33.446652+0000","last_became_peered":"2024-04-25T01:39:33.446652+0000","last_unstale":"2024-04-25T01:43:34.753852+0000","last_undegraded":"2024-04-25T01:43:34.753852+0000","last_fullsized":"2024-04-25T01:43:34.753852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:43:52.959274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"30'224","reported_seq":258,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.886451+0000","last_change":"2024-04-25T01:39:24.398614+0000","last_active":"2024-04-25T01:43:46.886451+0000","last_peered":"2024-04-25T01:43:46.886451+0000","last_clean":"2024-04-25T01:43:46.886451+0000","last_became_active":"2024-04-25T01:39:24.398299+0000","last_became_peered":"2024-04-25T01:39:24.398299+0000","last_unstale":"2024-04-25T01:43:46.886451+0000","last_undegraded":"2024-04-25T01:43:46.886451+0000","last_fullsized":"2024-04-25T01:43:46.886451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:54:51.191225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":516096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"30'167","reported_seq":193,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.764139+0000","last_change":"2024-04-25T01:39:33.441401+0000","last_active":"2024-04-25T01:43:34.764139+0000","last_peered":"2024-04-25T01:43:34.764139+0000","last_clean":"2024-04-25T01:43:34.764139+0000","last_became_active":"2024-04-25T01:39:33.441104+0000","last_became_peered":"2024-04-25T01:39:33.441104+0000","last_unstale":"2024-04-25T01:43:34.764139+0000","last_undegraded":"2024-04-25T01:43:34.764139+0000","last_fullsized":"2024-04-25T01:43:34.764139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:32:51.503340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"30'161","reported_seq":195,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.874331+0000","last_change":"2024-04-25T01:39:24.390352+0000","last_active":"2024-04-25T01:43:46.874331+0000","last_peered":"2024-04-25T01:43:46.874331+0000","last_clean":"2024-04-25T01:43:46.874331+0000","last_became_active":"2024-04-25T01:39:24.389809+0000","last_became_peered":"2024-04-25T01:39:24.389809+0000","last_unstale":"2024-04-25T01:43:46.874331+0000","last_undegraded":"2024-04-25T01:43:46.874331+0000","last_fullsized":"2024-04-25T01:43:46.874331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:22:44.221898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"30'188","reported_seq":213,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.738058+0000","last_change":"2024-04-25T01:39:33.426710+0000","last_active":"2024-04-25T01:43:34.738058+0000","last_peered":"2024-04-25T01:43:34.738058+0000","last_clean":"2024-04-25T01:43:34.738058+0000","last_became_active":"2024-04-25T01:39:33.426056+0000","last_became_peered":"2024-04-25T01:39:33.426056+0000","last_unstale":"2024-04-25T01:43:34.738058+0000","last_undegraded":"2024-04-25T01:43:34.738058+0000","last_fullsized":"2024-04-25T01:43:34.738058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:53:41.174851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"30'220","reported_seq":254,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.895157+0000","last_change":"2024-04-25T01:39:24.387093+0000","last_active":"2024-04-25T01:43:46.895157+0000","last_peered":"2024-04-25T01:43:46.895157+0000","last_clean":"2024-04-25T01:43:46.895157+0000","last_became_active":"2024-04-25T01:39:24.386809+0000","last_became_peered":"2024-04-25T01:39:24.386809+0000","last_unstale":"2024-04-25T01:43:46.895157+0000","last_undegraded":"2024-04-25T01:43:46.895157+0000","last_fullsized":"2024-04-25T01:43:46.895157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:46:05.313828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"30'189","reported_seq":214,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.730046+0000","last_change":"2024-04-25T01:39:33.436499+0000","last_active":"2024-04-25T01:43:34.730046+0000","last_peered":"2024-04-25T01:43:34.730046+0000","last_clean":"2024-04-25T01:43:34.730046+0000","last_became_active":"2024-04-25T01:39:33.436017+0000","last_became_peered":"2024-04-25T01:39:33.436017+0000","last_unstale":"2024-04-25T01:43:34.730046+0000","last_undegraded":"2024-04-25T01:43:34.730046+0000","last_fullsized":"2024-04-25T01:43:34.730046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:46:09.302012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"30'149","reported_seq":182,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.874684+0000","last_change":"2024-04-25T01:39:24.389039+0000","last_active":"2024-04-25T01:43:46.874684+0000","last_peered":"2024-04-25T01:43:46.874684+0000","last_clean":"2024-04-25T01:43:46.874684+0000","last_became_active":"2024-04-25T01:39:24.388793+0000","last_became_peered":"2024-04-25T01:39:24.388793+0000","last_unstale":"2024-04-25T01:43:46.874684+0000","last_undegraded":"2024-04-25T01:43:46.874684+0000","last_fullsized":"2024-04-25T01:43:46.874684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:13.093550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"30'196","reported_seq":221,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.759968+0000","last_change":"2024-04-25T01:39:33.441122+0000","last_active":"2024-04-25T01:43:34.759968+0000","last_peered":"2024-04-25T01:43:34.759968+0000","last_clean":"2024-04-25T01:43:34.759968+0000","last_became_active":"2024-04-25T01:39:33.440760+0000","last_became_peered":"2024-04-25T01:39:33.440760+0000","last_unstale":"2024-04-25T01:43:34.759968+0000","last_undegraded":"2024-04-25T01:43:34.759968+0000","last_fullsized":"2024-04-25T01:43:34.759968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:30:12.603789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"30'194","reported_seq":227,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.899298+0000","last_change":"2024-04-25T01:39:24.390884+0000","last_active":"2024-04-25T01:43:46.899298+0000","last_peered":"2024-04-25T01:43:46.899298+0000","last_clean":"2024-04-25T01:43:46.899298+0000","last_became_active":"2024-04-25T01:39:24.390591+0000","last_became_peered":"2024-04-25T01:39:24.390591+0000","last_unstale":"2024-04-25T01:43:46.899298+0000","last_undegraded":"2024-04-25T01:43:46.899298+0000","last_fullsized":"2024-04-25T01:43:46.899298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:51.274363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"30'233","reported_seq":258,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.751644+0000","last_change":"2024-04-25T01:39:33.429482+0000","last_active":"2024-04-25T01:43:34.751644+0000","last_peered":"2024-04-25T01:43:34.751644+0000","last_clean":"2024-04-25T01:43:34.751644+0000","last_became_active":"2024-04-25T01:39:33.429158+0000","last_became_peered":"2024-04-25T01:39:33.429158+0000","last_unstale":"2024-04-25T01:43:34.751644+0000","last_undegraded":"2024-04-25T01:43:34.751644+0000","last_fullsized":"2024-04-25T01:43:34.751644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:58:07.372868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"30'168","reported_seq":201,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.886803+0000","last_change":"2024-04-25T01:39:24.388891+0000","last_active":"2024-04-25T01:43:46.886803+0000","last_peered":"2024-04-25T01:43:46.886803+0000","last_clean":"2024-04-25T01:43:46.886803+0000","last_became_active":"2024-04-25T01:39:24.388619+0000","last_became_peered":"2024-04-25T01:39:24.388619+0000","last_unstale":"2024-04-25T01:43:46.886803+0000","last_undegraded":"2024-04-25T01:43:46.886803+0000","last_fullsized":"2024-04-25T01:43:46.886803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:05.176386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"30'215","reported_seq":240,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.728559+0000","last_change":"2024-04-25T01:39:33.443534+0000","last_active":"2024-04-25T01:43:34.728559+0000","last_peered":"2024-04-25T01:43:34.728559+0000","last_clean":"2024-04-25T01:43:34.728559+0000","last_became_active":"2024-04-25T01:39:33.443257+0000","last_became_peered":"2024-04-25T01:39:33.443257+0000","last_unstale":"2024-04-25T01:43:34.728559+0000","last_undegraded":"2024-04-25T01:43:34.728559+0000","last_fullsized":"2024-04-25T01:43:34.728559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:44:30.154519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"30'188","reported_seq":221,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.888562+0000","last_change":"2024-04-25T01:39:24.395109+0000","last_active":"2024-04-25T01:43:46.888562+0000","last_peered":"2024-04-25T01:43:46.888562+0000","last_clean":"2024-04-25T01:43:46.888562+0000","last_became_active":"2024-04-25T01:39:24.394784+0000","last_became_peered":"2024-04-25T01:39:24.394784+0000","last_unstale":"2024-04-25T01:43:46.888562+0000","last_undegraded":"2024-04-25T01:43:46.888562+0000","last_fullsized":"2024-04-25T01:43:46.888562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:44:09.102603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"30'159","reported_seq":184,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.714401+0000","last_change":"2024-04-25T01:39:33.446683+0000","last_active":"2024-04-25T01:43:34.714401+0000","last_peered":"2024-04-25T01:43:34.714401+0000","last_clean":"2024-04-25T01:43:34.714401+0000","last_became_active":"2024-04-25T01:39:33.445949+0000","last_became_peered":"2024-04-25T01:39:33.445949+0000","last_unstale":"2024-04-25T01:43:34.714401+0000","last_undegraded":"2024-04-25T01:43:34.714401+0000","last_fullsized":"2024-04-25T01:43:34.714401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:28.864821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"30'196","reported_seq":229,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.868887+0000","last_change":"2024-04-25T01:39:24.380199+0000","last_active":"2024-04-25T01:43:46.868887+0000","last_peered":"2024-04-25T01:43:46.868887+0000","last_clean":"2024-04-25T01:43:46.868887+0000","last_became_active":"2024-04-25T01:39:24.379591+0000","last_became_peered":"2024-04-25T01:39:24.379591+0000","last_unstale":"2024-04-25T01:43:46.868887+0000","last_undegraded":"2024-04-25T01:43:46.868887+0000","last_fullsized":"2024-04-25T01:43:46.868887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:54.534683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"30'233","reported_seq":258,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.760480+0000","last_change":"2024-04-25T01:39:33.439702+0000","last_active":"2024-04-25T01:43:34.760480+0000","last_peered":"2024-04-25T01:43:34.760480+0000","last_clean":"2024-04-25T01:43:34.760480+0000","last_became_active":"2024-04-25T01:39:33.439424+0000","last_became_peered":"2024-04-25T01:39:33.439424+0000","last_unstale":"2024-04-25T01:43:34.760480+0000","last_undegraded":"2024-04-25T01:43:34.760480+0000","last_fullsized":"2024-04-25T01:43:34.760480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:31.528140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"30'179","reported_seq":212,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.883530+0000","last_change":"2024-04-25T01:39:24.395125+0000","last_active":"2024-04-25T01:43:46.883530+0000","last_peered":"2024-04-25T01:43:46.883530+0000","last_clean":"2024-04-25T01:43:46.883530+0000","last_became_active":"2024-04-25T01:39:24.392605+0000","last_became_peered":"2024-04-25T01:39:24.392605+0000","last_unstale":"2024-04-25T01:43:46.883530+0000","last_undegraded":"2024-04-25T01:43:46.883530+0000","last_fullsized":"2024-04-25T01:43:46.883530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:53.333616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"30'166","reported_seq":191,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.710900+0000","last_change":"2024-04-25T01:39:33.438104+0000","last_active":"2024-04-25T01:43:34.710900+0000","last_peered":"2024-04-25T01:43:34.710900+0000","last_clean":"2024-04-25T01:43:34.710900+0000","last_became_active":"2024-04-25T01:39:33.437795+0000","last_became_peered":"2024-04-25T01:39:33.437795+0000","last_unstale":"2024-04-25T01:43:34.710900+0000","last_undegraded":"2024-04-25T01:43:34.710900+0000","last_fullsized":"2024-04-25T01:43:34.710900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:32.294104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"30'199","reported_seq":232,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.899022+0000","last_change":"2024-04-25T01:39:24.391312+0000","last_active":"2024-04-25T01:43:46.899022+0000","last_peered":"2024-04-25T01:43:46.899022+0000","last_clean":"2024-04-25T01:43:46.899022+0000","last_became_active":"2024-04-25T01:39:24.390978+0000","last_became_peered":"2024-04-25T01:39:24.390978+0000","last_unstale":"2024-04-25T01:43:46.899022+0000","last_undegraded":"2024-04-25T01:43:46.899022+0000","last_fullsized":"2024-04-25T01:43:46.899022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:38:25.637031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"30'197","reported_seq":222,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.738370+0000","last_change":"2024-04-25T01:39:33.431262+0000","last_active":"2024-04-25T01:43:34.738370+0000","last_peered":"2024-04-25T01:43:34.738370+0000","last_clean":"2024-04-25T01:43:34.738370+0000","last_became_active":"2024-04-25T01:39:33.430982+0000","last_became_peered":"2024-04-25T01:39:33.430982+0000","last_unstale":"2024-04-25T01:43:34.738370+0000","last_undegraded":"2024-04-25T01:43:34.738370+0000","last_fullsized":"2024-04-25T01:43:34.738370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:11.821542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"30'161","reported_seq":194,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.892591+0000","last_change":"2024-04-25T01:39:24.399270+0000","last_active":"2024-04-25T01:43:46.892591+0000","last_peered":"2024-04-25T01:43:46.892591+0000","last_clean":"2024-04-25T01:43:46.892591+0000","last_became_active":"2024-04-25T01:39:24.399011+0000","last_became_peered":"2024-04-25T01:39:24.399011+0000","last_unstale":"2024-04-25T01:43:46.892591+0000","last_undegraded":"2024-04-25T01:43:46.892591+0000","last_fullsized":"2024-04-25T01:43:46.892591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:00.987674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"30'187","reported_seq":212,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.706034+0000","last_change":"2024-04-25T01:39:33.443939+0000","last_active":"2024-04-25T01:43:34.706034+0000","last_peered":"2024-04-25T01:43:34.706034+0000","last_clean":"2024-04-25T01:43:34.706034+0000","last_became_active":"2024-04-25T01:39:33.443608+0000","last_became_peered":"2024-04-25T01:39:33.443608+0000","last_unstale":"2024-04-25T01:43:34.706034+0000","last_undegraded":"2024-04-25T01:43:34.706034+0000","last_fullsized":"2024-04-25T01:43:34.706034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:35.561173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"30'178","reported_seq":211,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.872334+0000","last_change":"2024-04-25T01:39:24.388943+0000","last_active":"2024-04-25T01:43:46.872334+0000","last_peered":"2024-04-25T01:43:46.872334+0000","last_clean":"2024-04-25T01:43:46.872334+0000","last_became_active":"2024-04-25T01:39:24.388690+0000","last_became_peered":"2024-04-25T01:39:24.388690+0000","last_unstale":"2024-04-25T01:43:46.872334+0000","last_undegraded":"2024-04-25T01:43:46.872334+0000","last_fullsized":"2024-04-25T01:43:46.872334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:42:18.260701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"30'175","reported_seq":200,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.762256+0000","last_change":"2024-04-25T01:39:33.438460+0000","last_active":"2024-04-25T01:43:34.762256+0000","last_peered":"2024-04-25T01:43:34.762256+0000","last_clean":"2024-04-25T01:43:34.762256+0000","last_became_active":"2024-04-25T01:39:33.436581+0000","last_became_peered":"2024-04-25T01:39:33.436581+0000","last_unstale":"2024-04-25T01:43:34.762256+0000","last_undegraded":"2024-04-25T01:43:34.762256+0000","last_fullsized":"2024-04-25T01:43:34.762256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:03:27.382925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"30'181","reported_seq":214,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.879616+0000","last_change":"2024-04-25T01:39:24.389556+0000","last_active":"2024-04-25T01:43:46.879616+0000","last_peered":"2024-04-25T01:43:46.879616+0000","last_clean":"2024-04-25T01:43:46.879616+0000","last_became_active":"2024-04-25T01:39:24.389254+0000","last_became_peered":"2024-04-25T01:39:24.389254+0000","last_unstale":"2024-04-25T01:43:46.879616+0000","last_undegraded":"2024-04-25T01:43:46.879616+0000","last_fullsized":"2024-04-25T01:43:46.879616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:56.208172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"30'237","reported_seq":262,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.748129+0000","last_change":"2024-04-25T01:39:33.433893+0000","last_active":"2024-04-25T01:43:34.748129+0000","last_peered":"2024-04-25T01:43:34.748129+0000","last_clean":"2024-04-25T01:43:34.748129+0000","last_became_active":"2024-04-25T01:39:33.433577+0000","last_became_peered":"2024-04-25T01:39:33.433577+0000","last_unstale":"2024-04-25T01:43:34.748129+0000","last_undegraded":"2024-04-25T01:43:34.748129+0000","last_fullsized":"2024-04-25T01:43:34.748129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:16.371837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"30'187","reported_seq":220,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.884139+0000","last_change":"2024-04-25T01:39:24.392021+0000","last_active":"2024-04-25T01:43:46.884139+0000","last_peered":"2024-04-25T01:43:46.884139+0000","last_clean":"2024-04-25T01:43:46.884139+0000","last_became_active":"2024-04-25T01:39:24.391352+0000","last_became_peered":"2024-04-25T01:39:24.391352+0000","last_unstale":"2024-04-25T01:43:46.884139+0000","last_undegraded":"2024-04-25T01:43:46.884139+0000","last_fullsized":"2024-04-25T01:43:46.884139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:33:44.434749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"30'186","reported_seq":211,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.683783+0000","last_change":"2024-04-25T01:39:33.436641+0000","last_active":"2024-04-25T01:43:34.683783+0000","last_peered":"2024-04-25T01:43:34.683783+0000","last_clean":"2024-04-25T01:43:34.683783+0000","last_became_active":"2024-04-25T01:39:33.436389+0000","last_became_peered":"2024-04-25T01:39:33.436389+0000","last_unstale":"2024-04-25T01:43:34.683783+0000","last_undegraded":"2024-04-25T01:43:34.683783+0000","last_fullsized":"2024-04-25T01:43:34.683783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:19:51.940088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"30'169","reported_seq":202,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.883979+0000","last_change":"2024-04-25T01:39:24.396300+0000","last_active":"2024-04-25T01:43:46.883979+0000","last_peered":"2024-04-25T01:43:46.883979+0000","last_clean":"2024-04-25T01:43:46.883979+0000","last_became_active":"2024-04-25T01:39:24.396023+0000","last_became_peered":"2024-04-25T01:39:24.396023+0000","last_unstale":"2024-04-25T01:43:46.883979+0000","last_undegraded":"2024-04-25T01:43:46.883979+0000","last_fullsized":"2024-04-25T01:43:46.883979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:21.500721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"30'186","reported_seq":211,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.733553+0000","last_change":"2024-04-25T01:39:33.443419+0000","last_active":"2024-04-25T01:43:34.733553+0000","last_peered":"2024-04-25T01:43:34.733553+0000","last_clean":"2024-04-25T01:43:34.733553+0000","last_became_active":"2024-04-25T01:39:33.443163+0000","last_became_peered":"2024-04-25T01:39:33.443163+0000","last_unstale":"2024-04-25T01:43:34.733553+0000","last_undegraded":"2024-04-25T01:43:34.733553+0000","last_fullsized":"2024-04-25T01:43:34.733553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:22.156410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"30'212","reported_seq":245,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.897937+0000","last_change":"2024-04-25T01:39:24.404047+0000","last_active":"2024-04-25T01:43:46.897937+0000","last_peered":"2024-04-25T01:43:46.897937+0000","last_clean":"2024-04-25T01:43:46.897937+0000","last_became_active":"2024-04-25T01:39:24.403700+0000","last_became_peered":"2024-04-25T01:39:24.403700+0000","last_unstale":"2024-04-25T01:43:46.897937+0000","last_undegraded":"2024-04-25T01:43:46.897937+0000","last_fullsized":"2024-04-25T01:43:46.897937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:53.123061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":491520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"30'177","reported_seq":202,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.712967+0000","last_change":"2024-04-25T01:39:33.435520+0000","last_active":"2024-04-25T01:43:34.712967+0000","last_peered":"2024-04-25T01:43:34.712967+0000","last_clean":"2024-04-25T01:43:34.712967+0000","last_became_active":"2024-04-25T01:39:33.434446+0000","last_became_peered":"2024-04-25T01:39:33.434446+0000","last_unstale":"2024-04-25T01:43:34.712967+0000","last_undegraded":"2024-04-25T01:43:34.712967+0000","last_fullsized":"2024-04-25T01:43:34.712967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:59.696009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"30'183","reported_seq":221,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.883554+0000","last_change":"2024-04-25T01:40:05.559200+0000","last_active":"2024-04-25T01:43:46.883554+0000","last_peered":"2024-04-25T01:43:46.883554+0000","last_clean":"2024-04-25T01:43:46.883554+0000","last_became_active":"2024-04-25T01:40:05.558954+0000","last_became_peered":"2024-04-25T01:40:05.558954+0000","last_unstale":"2024-04-25T01:43:46.883554+0000","last_undegraded":"2024-04-25T01:43:46.883554+0000","last_fullsized":"2024-04-25T01:43:46.883554+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:30.998037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"30'191","reported_seq":216,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.740677+0000","last_change":"2024-04-25T01:39:33.436479+0000","last_active":"2024-04-25T01:43:34.740677+0000","last_peered":"2024-04-25T01:43:34.740677+0000","last_clean":"2024-04-25T01:43:34.740677+0000","last_became_active":"2024-04-25T01:39:33.436193+0000","last_became_peered":"2024-04-25T01:39:33.436193+0000","last_unstale":"2024-04-25T01:43:34.740677+0000","last_undegraded":"2024-04-25T01:43:34.740677+0000","last_fullsized":"2024-04-25T01:43:34.740677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:20:03.455536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"30'179","reported_seq":212,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.896948+0000","last_change":"2024-04-25T01:39:24.393362+0000","last_active":"2024-04-25T01:43:46.896948+0000","last_peered":"2024-04-25T01:43:46.896948+0000","last_clean":"2024-04-25T01:43:46.896948+0000","last_became_active":"2024-04-25T01:39:24.392836+0000","last_became_peered":"2024-04-25T01:39:24.392836+0000","last_unstale":"2024-04-25T01:43:46.896948+0000","last_undegraded":"2024-04-25T01:43:46.896948+0000","last_fullsized":"2024-04-25T01:43:46.896948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:58.871777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"30'168","reported_seq":194,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.765220+0000","last_change":"2024-04-25T01:39:33.440164+0000","last_active":"2024-04-25T01:43:34.765220+0000","last_peered":"2024-04-25T01:43:34.765220+0000","last_clean":"2024-04-25T01:43:34.765220+0000","last_became_active":"2024-04-25T01:39:33.439878+0000","last_became_peered":"2024-04-25T01:39:33.439878+0000","last_unstale":"2024-04-25T01:43:34.765220+0000","last_undegraded":"2024-04-25T01:43:34.765220+0000","last_fullsized":"2024-04-25T01:43:34.765220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:44:52.817169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"30'207","reported_seq":240,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.896113+0000","last_change":"2024-04-25T01:39:24.401765+0000","last_active":"2024-04-25T01:43:46.896113+0000","last_peered":"2024-04-25T01:43:46.896113+0000","last_clean":"2024-04-25T01:43:46.896113+0000","last_became_active":"2024-04-25T01:39:24.400509+0000","last_became_peered":"2024-04-25T01:39:24.400509+0000","last_unstale":"2024-04-25T01:43:46.896113+0000","last_undegraded":"2024-04-25T01:43:46.896113+0000","last_fullsized":"2024-04-25T01:43:46.896113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:51:25.031622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":491520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"30'180","reported_seq":206,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.734853+0000","last_change":"2024-04-25T01:39:33.439353+0000","last_active":"2024-04-25T01:43:34.734853+0000","last_peered":"2024-04-25T01:43:34.734853+0000","last_clean":"2024-04-25T01:43:34.734853+0000","last_became_active":"2024-04-25T01:39:33.438915+0000","last_became_peered":"2024-04-25T01:39:33.438915+0000","last_unstale":"2024-04-25T01:43:34.734853+0000","last_undegraded":"2024-04-25T01:43:34.734853+0000","last_fullsized":"2024-04-25T01:43:34.734853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:19.180919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"30'197","reported_seq":230,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.885409+0000","last_change":"2024-04-25T01:39:24.387941+0000","last_active":"2024-04-25T01:43:46.885409+0000","last_peered":"2024-04-25T01:43:46.885409+0000","last_clean":"2024-04-25T01:43:46.885409+0000","last_became_active":"2024-04-25T01:39:24.387674+0000","last_became_peered":"2024-04-25T01:39:24.387674+0000","last_unstale":"2024-04-25T01:43:46.885409+0000","last_undegraded":"2024-04-25T01:43:46.885409+0000","last_fullsized":"2024-04-25T01:43:46.885409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:05.676143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"30'205","reported_seq":231,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.768022+0000","last_change":"2024-04-25T01:39:33.444917+0000","last_active":"2024-04-25T01:43:34.768022+0000","last_peered":"2024-04-25T01:43:34.768022+0000","last_clean":"2024-04-25T01:43:34.768022+0000","last_became_active":"2024-04-25T01:39:33.444636+0000","last_became_peered":"2024-04-25T01:39:33.444636+0000","last_unstale":"2024-04-25T01:43:34.768022+0000","last_undegraded":"2024-04-25T01:43:34.768022+0000","last_fullsized":"2024-04-25T01:43:34.768022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:31.531502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"30'159","reported_seq":192,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.895208+0000","last_change":"2024-04-25T01:39:24.399950+0000","last_active":"2024-04-25T01:43:46.895208+0000","last_peered":"2024-04-25T01:43:46.895208+0000","last_clean":"2024-04-25T01:43:46.895208+0000","last_became_active":"2024-04-25T01:39:24.399701+0000","last_became_peered":"2024-04-25T01:39:24.399701+0000","last_unstale":"2024-04-25T01:43:46.895208+0000","last_undegraded":"2024-04-25T01:43:46.895208+0000","last_fullsized":"2024-04-25T01:43:46.895208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:49.618370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"30'193","reported_seq":219,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.907697+0000","last_change":"2024-04-25T01:39:33.440936+0000","last_active":"2024-04-25T01:43:34.907697+0000","last_peered":"2024-04-25T01:43:34.907697+0000","last_clean":"2024-04-25T01:43:34.907697+0000","last_became_active":"2024-04-25T01:39:33.440679+0000","last_became_peered":"2024-04-25T01:39:33.440679+0000","last_unstale":"2024-04-25T01:43:34.907697+0000","last_undegraded":"2024-04-25T01:43:34.907697+0000","last_fullsized":"2024-04-25T01:43:34.907697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:08:53.629572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"30'177","reported_seq":210,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.876988+0000","last_change":"2024-04-25T01:39:24.380318+0000","last_active":"2024-04-25T01:43:46.876988+0000","last_peered":"2024-04-25T01:43:46.876988+0000","last_clean":"2024-04-25T01:43:46.876988+0000","last_became_active":"2024-04-25T01:39:24.379573+0000","last_became_peered":"2024-04-25T01:39:24.379573+0000","last_unstale":"2024-04-25T01:43:46.876988+0000","last_undegraded":"2024-04-25T01:43:46.876988+0000","last_fullsized":"2024-04-25T01:43:46.876988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:12.089917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"30'176","reported_seq":201,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.756355+0000","last_change":"2024-04-25T01:39:33.426380+0000","last_active":"2024-04-25T01:43:34.756355+0000","last_peered":"2024-04-25T01:43:34.756355+0000","last_clean":"2024-04-25T01:43:34.756355+0000","last_became_active":"2024-04-25T01:39:33.426090+0000","last_became_peered":"2024-04-25T01:39:33.426090+0000","last_unstale":"2024-04-25T01:43:34.756355+0000","last_undegraded":"2024-04-25T01:43:34.756355+0000","last_fullsized":"2024-04-25T01:43:34.756355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:02:34.329217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"30'192","reported_seq":226,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.896768+0000","last_change":"2024-04-25T01:39:24.398726+0000","last_active":"2024-04-25T01:43:46.896768+0000","last_peered":"2024-04-25T01:43:46.896768+0000","last_clean":"2024-04-25T01:43:46.896768+0000","last_became_active":"2024-04-25T01:39:24.398449+0000","last_became_peered":"2024-04-25T01:39:24.398449+0000","last_unstale":"2024-04-25T01:43:46.896768+0000","last_undegraded":"2024-04-25T01:43:46.896768+0000","last_fullsized":"2024-04-25T01:43:46.896768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:41:38.230939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"30'187","reported_seq":212,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.731406+0000","last_change":"2024-04-25T01:39:33.436488+0000","last_active":"2024-04-25T01:43:34.731406+0000","last_peered":"2024-04-25T01:43:34.731406+0000","last_clean":"2024-04-25T01:43:34.731406+0000","last_became_active":"2024-04-25T01:39:33.436224+0000","last_became_peered":"2024-04-25T01:39:33.436224+0000","last_unstale":"2024-04-25T01:43:34.731406+0000","last_undegraded":"2024-04-25T01:43:34.731406+0000","last_fullsized":"2024-04-25T01:43:34.731406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:45:38.227206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"30'175","reported_seq":209,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.871923+0000","last_change":"2024-04-25T01:39:24.386909+0000","last_active":"2024-04-25T01:43:46.871923+0000","last_peered":"2024-04-25T01:43:46.871923+0000","last_clean":"2024-04-25T01:43:46.871923+0000","last_became_active":"2024-04-25T01:39:24.386568+0000","last_became_peered":"2024-04-25T01:39:24.386568+0000","last_unstale":"2024-04-25T01:43:46.871923+0000","last_undegraded":"2024-04-25T01:43:46.871923+0000","last_fullsized":"2024-04-25T01:43:46.871923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:29.904064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"30'223","reported_seq":248,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.755445+0000","last_change":"2024-04-25T01:39:33.440753+0000","last_active":"2024-04-25T01:43:34.755445+0000","last_peered":"2024-04-25T01:43:34.755445+0000","last_clean":"2024-04-25T01:43:34.755445+0000","last_became_active":"2024-04-25T01:39:33.440480+0000","last_became_peered":"2024-04-25T01:39:33.440480+0000","last_unstale":"2024-04-25T01:43:34.755445+0000","last_undegraded":"2024-04-25T01:43:34.755445+0000","last_fullsized":"2024-04-25T01:43:34.755445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:49:18.113293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"30'160","reported_seq":194,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.877750+0000","last_change":"2024-04-25T01:39:24.386803+0000","last_active":"2024-04-25T01:43:46.877750+0000","last_peered":"2024-04-25T01:43:46.877750+0000","last_clean":"2024-04-25T01:43:46.877750+0000","last_became_active":"2024-04-25T01:39:24.386531+0000","last_became_peered":"2024-04-25T01:39:24.386531+0000","last_unstale":"2024-04-25T01:43:46.877750+0000","last_undegraded":"2024-04-25T01:43:46.877750+0000","last_fullsized":"2024-04-25T01:43:46.877750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:30:19.160345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"30'214","reported_seq":239,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.689935+0000","last_change":"2024-04-25T01:39:33.436433+0000","last_active":"2024-04-25T01:43:34.689935+0000","last_peered":"2024-04-25T01:43:34.689935+0000","last_clean":"2024-04-25T01:43:34.689935+0000","last_became_active":"2024-04-25T01:39:33.436134+0000","last_became_peered":"2024-04-25T01:39:33.436134+0000","last_unstale":"2024-04-25T01:43:34.689935+0000","last_undegraded":"2024-04-25T01:43:34.689935+0000","last_fullsized":"2024-04-25T01:43:34.689935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:08:30.641790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"30'170","reported_seq":204,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.888991+0000","last_change":"2024-04-25T01:39:24.396231+0000","last_active":"2024-04-25T01:43:46.888991+0000","last_peered":"2024-04-25T01:43:46.888991+0000","last_clean":"2024-04-25T01:43:46.888991+0000","last_became_active":"2024-04-25T01:39:24.395958+0000","last_became_peered":"2024-04-25T01:39:24.395958+0000","last_unstale":"2024-04-25T01:43:46.888991+0000","last_undegraded":"2024-04-25T01:43:46.888991+0000","last_fullsized":"2024-04-25T01:43:46.888991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:19:54.898765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12101,"ondisk_log_size":12101,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":7961223,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":239,"num_read_kb":8015,"num_write":3918,"num_write_kb":11482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15990784,"data_stored":15922446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3917,"ondisk_log_size":3917,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11255,"ondisk_log_size":11255,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8001563,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":165,"num_read_kb":215,"num_write":3944,"num_write_kb":11544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16072704,"data_stored":16003126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3932,"ondisk_log_size":3932,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574908,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67676,"kb_used_data":4628,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94304164,"statfs":{"total":96636764160,"available":96567463936,"internally_reserved":0,"allocated":4739072,"data_stored":4538287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":64551370},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61976,"kb_used_data":4432,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94309864,"statfs":{"total":96636764160,"available":96573300736,"internally_reserved":0,"allocated":4538368,"data_stored":4337555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574908,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62040,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94309800,"statfs":{"total":96636764160,"available":96573235200,"internally_reserved":0,"allocated":344064,"data_stored":143129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574908,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67072,"kb_used_data":4024,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94304768,"statfs":{"total":96636764160,"available":96568082432,"internally_reserved":0,"allocated":4120576,"data_stored":3907642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574908,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123400,"kb_used_data":15936,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94248440,"statfs":{"total":96636764160,"available":96510402560,"internally_reserved":0,"allocated":16318464,"data_stored":16102771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":110033351},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574908,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57872,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313968,"statfs":{"total":96636764160,"available":96577503232,"internally_reserved":0,"allocated":335872,"data_stored":142538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49500,"kb_used_data":4436,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94322340,"statfs":{"total":96636764160,"available":96586076160,"internally_reserved":0,"allocated":4542464,"data_stored":4337121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574908,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62616,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94309224,"statfs":{"total":96636764160,"available":96572645376,"internally_reserved":0,"allocated":933888,"data_stored":732969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8015872,"data_stored":8000765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3813376,"data_stored":3805866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4194998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7974912,"data_stored":7960043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3780608,"data_stored":3765553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T01:43:55.808 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.808 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.808 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.808 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.808 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.808 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.808 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.808 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.809 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.809 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.809 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.809 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.809 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.809 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.809 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.809 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.809 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.810 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.810 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.810 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.810 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.810 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.810 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.811 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.811 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.811 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.811 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.811 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.811 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.811 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.811 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.811 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.811 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.812 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.812 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.812 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.812 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.812 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.812 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.812 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.812 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.812 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.813 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.813 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.813 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.813 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.813 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.813 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.813 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.813 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.813 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.814 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.814 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.814 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.814 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.814 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.814 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.814 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.814 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.814 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.815 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.815 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.815 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.815 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T01:39:11.731178+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.815 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.815 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.815 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.815 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.815 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.816 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.816 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.816 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.816 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.816 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.816 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.816 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.817 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.817 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.817 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.817 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.817 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.817 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.817 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.817 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.818 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.818 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.818 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.818 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.818 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.818 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.818 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.818 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.818 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.819 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.819 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.819 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.819 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.819 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.819 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.819 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.819 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.819 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.820 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.820 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.820 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.820 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.820 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.820 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.820 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.820 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.820 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.820 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.821 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.821 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.821 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.821 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.821 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.821 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.821 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.821 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.821 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.821 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.822 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.822 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.822 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.822 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.822 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.822 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.822 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-25T01:39:31.399787+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.822 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.822 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.823 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.823 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.823 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.823 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.823 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.823 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.823 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.823 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.823 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.824 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.824 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.824 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.824 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.824 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.824 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.824 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.824 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.824 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.825 INFO:tasks.ceph:pgid 5.2c last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.825 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.825 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.825 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.825 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.825 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.825 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.825 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.825 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.826 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.826 INFO:tasks.ceph:pgid 5.29 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.826 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.826 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.826 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.826 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.826 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.826 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.826 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.827 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.827 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.827 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.827 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.827 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.827 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.827 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.827 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.827 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.827 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.828 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.828 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.828 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.828 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.828 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.828 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.828 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.828 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.828 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.829 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.829 INFO:tasks.ceph:pgid 5.3b last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.829 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.829 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.829 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.829 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.829 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:43:55.829 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T01:44:06.741 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:44:06.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.859+0000 7efc1eed4640 1 Processor -- start 2024-04-25T01:44:06.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.859+0000 7efc1eed4640 1 -- start start 2024-04-25T01:44:06.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.860+0000 7efc1eed4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efc180ad3a0 0x7efc18155a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:06.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.860+0000 7efc1eed4640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efc180c38d0 0x7efc18155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:06.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.860+0000 7efc1eed4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc180c2cb0 con 0x7efc1814fdd0 2024-04-25T01:44:06.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.860+0000 7efc1eed4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7efc180c30e0 con 0x7efc180ad3a0 2024-04-25T01:44:06.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.860+0000 7efc1eed4640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7efc18152f80 con 0x7efc180c38d0 2024-04-25T01:44:06.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.860+0000 7efc17fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efc180ad3a0 0x7efc18155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:06.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.860+0000 7efc17fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efc180ad3a0 0x7efc18155a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54662/0 (socket says 172.21.15.77:54662) 2024-04-25T01:44:06.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.860+0000 7efc17fff640 1 -- 172.21.15.77:0/3218748265 learned_addr learned my addr 172.21.15.77:0/3218748265 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:06.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.860+0000 7efc1cc70640 1 --1- 172.21.15.77:0/3218748265 >> v1:172.21.15.77:6789/0 conn(0x7efc1814fdd0 0x7efc1806da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44438/0 (socket says 172.21.15.77:44438) 2024-04-25T01:44:06.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.860+0000 7efc17fff640 1 -- 172.21.15.77:0/3218748265 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efc180c38d0 msgr2=0x7efc18155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:06.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.860+0000 7efc17fff640 1 --2- 172.21.15.77:0/3218748265 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efc180c38d0 0x7efc18155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:06.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.860+0000 7efc17fff640 1 -- 172.21.15.77:0/3218748265 >> v1:172.21.15.77:6789/0 conn(0x7efc1814fdd0 legacy=0x7efc1806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:06.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.860+0000 7efc17fff640 1 -- 172.21.15.77:0/3218748265 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc18153260 con 0x7efc180ad3a0 2024-04-25T01:44:06.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.860+0000 7efc177fe640 1 -- 172.21.15.77:0/3218748265 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 411958069 0 0) 0x7efc180c2cb0 con 0x7efc1814fdd0 2024-04-25T01:44:06.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.861+0000 7efc17fff640 1 --2- 172.21.15.77:0/3218748265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc180ad3a0 0x7efc18155a60 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7efc0800d150 tx=0x7efc0802c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bffbaf73498ba401 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:06.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.861+0000 7efc177fe640 1 -- 172.21.15.77:0/3218748265 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc08039070 con 0x7efc180ad3a0 2024-04-25T01:44:06.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.861+0000 7efc177fe640 1 -- 172.21.15.77:0/3218748265 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc08009600 con 0x7efc180ad3a0 2024-04-25T01:44:06.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.861+0000 7efc177fe640 1 -- 172.21.15.77:0/3218748265 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc080099d0 con 0x7efc180ad3a0 2024-04-25T01:44:06.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.862+0000 7efc1eed4640 1 -- 172.21.15.77:0/3218748265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc180ad3a0 msgr2=0x7efc18155a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:06.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.862+0000 7efc1eed4640 1 --2- 172.21.15.77:0/3218748265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc180ad3a0 0x7efc18155a60 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7efc0800d150 tx=0x7efc0802c890 comp rx=0 tx=0).stop 2024-04-25T01:44:06.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.862+0000 7efc1eed4640 1 -- 172.21.15.77:0/3218748265 shutdown_connections 2024-04-25T01:44:06.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.862+0000 7efc1eed4640 1 --2- 172.21.15.77:0/3218748265 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efc180c38d0 0x7efc18155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:06.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.862+0000 7efc1eed4640 1 --2- 172.21.15.77:0/3218748265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc180ad3a0 0x7efc18155a60 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:06.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.862+0000 7efc1eed4640 1 -- 172.21.15.77:0/3218748265 >> 172.21.15.77:0/3218748265 conn(0x7efc180c3f80 msgr2=0x7efc180c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:06.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.862+0000 7efc1eed4640 1 -- 172.21.15.77:0/3218748265 shutdown_connections 2024-04-25T01:44:06.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.862+0000 7efc1eed4640 1 -- 172.21.15.77:0/3218748265 wait complete. 2024-04-25T01:44:06.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.863+0000 7efc1eed4640 1 Processor -- start 2024-04-25T01:44:06.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.863+0000 7efc1eed4640 1 -- start start 2024-04-25T01:44:06.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.864+0000 7efc1eed4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc180ad3a0 0x7efc180c0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:06.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.864+0000 7efc1eed4640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efc180c38d0 0x7efc181418f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:06.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.864+0000 7efc1eed4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc1814fdd0 0x7efc18141e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:06.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.864+0000 7efc1eed4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efc1806e2c0 con 0x7efc180ad3a0 2024-04-25T01:44:06.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.864+0000 7efc1eed4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efc1806e140 con 0x7efc1814fdd0 2024-04-25T01:44:06.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.864+0000 7efc1eed4640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7efc180c28f0 con 0x7efc180c38d0 2024-04-25T01:44:06.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.864+0000 7efc1cc70640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc180ad3a0 0x7efc180c0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:06.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.864+0000 7efc1cc70640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc180ad3a0 0x7efc180c0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54670/0 (socket says 172.21.15.77:54670) 2024-04-25T01:44:06.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.864+0000 7efc1cc70640 1 -- 172.21.15.77:0/1611351563 learned_addr learned my addr 172.21.15.77:0/1611351563 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:06.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.864+0000 7efc17fff640 1 --2- 172.21.15.77:0/1611351563 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efc180c38d0 0x7efc181418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:06.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.864+0000 7efc1d471640 1 --2- 172.21.15.77:0/1611351563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc1814fdd0 0x7efc18141e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:06.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.864+0000 7efc1cc70640 1 -- 172.21.15.77:0/1611351563 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efc180c38d0 msgr2=0x7efc181418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:06.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.864+0000 7efc1cc70640 1 --2- 172.21.15.77:0/1611351563 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efc180c38d0 0x7efc181418f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:06.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.864+0000 7efc1cc70640 1 -- 172.21.15.77:0/1611351563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc1814fdd0 msgr2=0x7efc18141e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:06.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.864+0000 7efc1cc70640 1 --2- 172.21.15.77:0/1611351563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc1814fdd0 0x7efc18141e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:06.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.864+0000 7efc1cc70640 1 -- 172.21.15.77:0/1611351563 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc18153a60 con 0x7efc180ad3a0 2024-04-25T01:44:06.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.864+0000 7efc1cc70640 1 --2- 172.21.15.77:0/1611351563 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc180ad3a0 0x7efc180c0b20 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7efc1000c430 tx=0x7efc1000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:06.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.864+0000 7efc157fa640 1 -- 172.21.15.77:0/1611351563 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc100074e0 con 0x7efc180ad3a0 2024-04-25T01:44:06.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.865+0000 7efc157fa640 1 -- 172.21.15.77:0/1611351563 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc100047e0 con 0x7efc180ad3a0 2024-04-25T01:44:06.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.865+0000 7efc1eed4640 1 -- 172.21.15.77:0/1611351563 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc181ef410 con 0x7efc180ad3a0 2024-04-25T01:44:06.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.865+0000 7efc157fa640 1 -- 172.21.15.77:0/1611351563 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc10004bd0 con 0x7efc180ad3a0 2024-04-25T01:44:06.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.865+0000 7efc1eed4640 1 -- 172.21.15.77:0/1611351563 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc181ef9d0 con 0x7efc180ad3a0 2024-04-25T01:44:06.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.866+0000 7efc1eed4640 1 -- 172.21.15.77:0/1611351563 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc1804f500 con 0x7efc180ad3a0 2024-04-25T01:44:06.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.866+0000 7efc157fa640 1 -- 172.21.15.77:0/1611351563 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efc10011070 con 0x7efc180ad3a0 2024-04-25T01:44:06.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.866+0000 7efc157fa640 1 --2- 172.21.15.77:0/1611351563 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7efbf806be60 0x7efbf806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:06.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.867+0000 7efc17fff640 1 --2- 172.21.15.77:0/1611351563 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7efbf806be60 0x7efbf806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:06.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.867+0000 7efc157fa640 1 -- 172.21.15.77:0/1611351563 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7efc1008af40 con 0x7efc180ad3a0 2024-04-25T01:44:06.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.867+0000 7efc17fff640 1 --2- 172.21.15.77:0/1611351563 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7efbf806be60 0x7efbf806e320 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efc08036000 tx=0x7efc0800b000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:06.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:06.871+0000 7efc157fa640 1 -- 172.21.15.77:0/1611351563 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7efc1000e280 con 0x7efc180ad3a0 2024-04-25T01:44:07.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.081+0000 7efc1eed4640 1 -- 172.21.15.77:0/1611351563 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc180c18c0 con 0x7efc180ad3a0 2024-04-25T01:44:07.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.082+0000 7efc157fa640 1 -- 172.21.15.77:0/1611351563 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+6485 (secure 0 0 0) 0x7efc10059430 con 0x7efc180ad3a0 2024-04-25T01:44:07.073 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:44:07.073 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1570919706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1570919706},{"type":"v1","addr":"172.21.15.77:6837","nonce":1570919706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:42:07.395274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5439":{"gid":5439,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5439,"qdb_cluster":[5439]},"id":1},{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:43:32.407370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":22,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5179,"qdb_cluster":[5179]},"id":2}]} 2024-04-25T01:44:07.073 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 33 2024-04-25T01:44:07.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.084+0000 7efc1eed4640 1 -- 172.21.15.77:0/1611351563 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7efbf806be60 msgr2=0x7efbf806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:07.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.084+0000 7efc1eed4640 1 --2- 172.21.15.77:0/1611351563 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7efbf806be60 0x7efbf806e320 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efc08036000 tx=0x7efc0800b000 comp rx=0 tx=0).stop 2024-04-25T01:44:07.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.084+0000 7efc1eed4640 1 -- 172.21.15.77:0/1611351563 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc180ad3a0 msgr2=0x7efc180c0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:07.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.084+0000 7efc1eed4640 1 --2- 172.21.15.77:0/1611351563 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc180ad3a0 0x7efc180c0b20 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7efc1000c430 tx=0x7efc1000c8f0 comp rx=0 tx=0).stop 2024-04-25T01:44:07.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.084+0000 7efc1eed4640 1 -- 172.21.15.77:0/1611351563 shutdown_connections 2024-04-25T01:44:07.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.084+0000 7efc1eed4640 1 --2- 172.21.15.77:0/1611351563 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7efbf806be60 0x7efbf806e320 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:07.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.084+0000 7efc1eed4640 1 --2- 172.21.15.77:0/1611351563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc1814fdd0 0x7efc18141e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:07.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.084+0000 7efc1eed4640 1 --2- 172.21.15.77:0/1611351563 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efc180c38d0 0x7efc181418f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:07.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.084+0000 7efc1eed4640 1 --2- 172.21.15.77:0/1611351563 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc180ad3a0 0x7efc180c0b20 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:07.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.084+0000 7efc1eed4640 1 -- 172.21.15.77:0/1611351563 >> 172.21.15.77:0/1611351563 conn(0x7efc180c3f80 msgr2=0x7efc180c1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:07.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.084+0000 7efc1eed4640 1 -- 172.21.15.77:0/1611351563 shutdown_connections 2024-04-25T01:44:07.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.084+0000 7efc1eed4640 1 -- 172.21.15.77:0/1611351563 wait complete. 2024-04-25T01:44:07.087 INFO:tasks.mds_thrash.fs.[a]:kill mds.a (rank=0) 2024-04-25T01:44:07.087 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T01:44:07.087 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T01:44:07.098 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T01:44:07.098 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:44:07.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.244+0000 7fe6c17a9640 1 Processor -- start 2024-04-25T01:44:07.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.244+0000 7fe6c17a9640 1 -- start start 2024-04-25T01:44:07.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.245+0000 7fe6c17a9640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe6bc06d0a0 0x7fe6bc06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:07.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.245+0000 7fe6c17a9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe6bc154380 0x7fe6bc154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:07.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.245+0000 7fe6c17a9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6bc153be0 con 0x7fe6bc150320 2024-04-25T01:44:07.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.245+0000 7fe6c17a9640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fe6bc152fd0 con 0x7fe6bc06d0a0 2024-04-25T01:44:07.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.245+0000 7fe6c17a9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe6bc1532b0 con 0x7fe6bc154380 2024-04-25T01:44:07.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.245+0000 7fe6baffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe6bc150320 0x7fe6bc156bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44454/0 (socket says 172.21.15.77:44454) 2024-04-25T01:44:07.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.245+0000 7fe6baffd640 1 -- 172.21.15.77:0/3992259622 learned_addr learned my addr 172.21.15.77:0/3992259622 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:44:07.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.245+0000 7fe6b9ffb640 1 -- 172.21.15.77:0/3992259622 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1285977897 0 0) 0x7fe6bc153be0 con 0x7fe6bc150320 2024-04-25T01:44:07.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.245+0000 7fe6b9ffb640 1 -- 172.21.15.77:0/3992259622 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6a4003520 con 0x7fe6bc150320 2024-04-25T01:44:07.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.245+0000 7fe6ba7fc640 1 --2- 172.21.15.77:0/3992259622 >> v2:172.21.15.121:3300/0 conn(0x7fe6bc06d0a0 0x7fe6bc06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:07.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.245+0000 7fe6bb7fe640 1 --2- 172.21.15.77:0/3992259622 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe6bc154380 0x7fe6bc154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:07.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.245+0000 7fe6b9ffb640 1 -- 172.21.15.77:0/3992259622 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2697416474 0 0) 0x7fe6a4003520 con 0x7fe6bc150320 2024-04-25T01:44:07.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.245+0000 7fe6b9ffb640 1 -- 172.21.15.77:0/3992259622 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe6bc154380 msgr2=0x7fe6bc154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:07.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.245+0000 7fe6b9ffb640 1 --2- 172.21.15.77:0/3992259622 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe6bc154380 0x7fe6bc154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:07.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.245+0000 7fe6b9ffb640 1 -- 172.21.15.77:0/3992259622 >> v2:172.21.15.121:3300/0 conn(0x7fe6bc06d0a0 msgr2=0x7fe6bc06d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:07.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.245+0000 7fe6b9ffb640 1 --2- 172.21.15.77:0/3992259622 >> v2:172.21.15.121:3300/0 conn(0x7fe6bc06d0a0 0x7fe6bc06d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:07.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.245+0000 7fe6b9ffb640 1 -- 172.21.15.77:0/3992259622 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6bc153590 con 0x7fe6bc150320 2024-04-25T01:44:07.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.245+0000 7fe6b9ffb640 1 -- 172.21.15.77:0/3992259622 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7fe6ac001670 con 0x7fe6bc150320 2024-04-25T01:44:07.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.245+0000 7fe6b9ffb640 1 -- 172.21.15.77:0/3992259622 >> v1:172.21.15.77:6789/0 conn(0x7fe6bc150320 legacy=0x7fe6bc156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:07.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.245+0000 7fe6b9ffb640 1 --2- 172.21.15.77:0/3992259622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6a40039b0 0x7fe6a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:07.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.245+0000 7fe6b9ffb640 1 --2- 172.21.15.77:0/3992259622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6a4004800 0x7fe6a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:07.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.245+0000 7fe6b9ffb640 1 --2- 172.21.15.77:0/3992259622 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe6bc154380 0x7fe6a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:07.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.245+0000 7fe6b9ffb640 1 -- 172.21.15.77:0/3992259622 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc152fd0 con 0x7fe6a40039b0 2024-04-25T01:44:07.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.245+0000 7fe6b9ffb640 1 -- 172.21.15.77:0/3992259622 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc1532b0 con 0x7fe6a4004800 2024-04-25T01:44:07.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.245+0000 7fe6b9ffb640 1 -- 172.21.15.77:0/3992259622 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe6a400bb50 con 0x7fe6bc154380 2024-04-25T01:44:07.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.245+0000 7fe6ba7fc640 1 --2- 172.21.15.77:0/3992259622 >> v2:172.21.15.121:3300/0 conn(0x7fe6bc06d0a0 0x7fe6bc06d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:44:07.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.245+0000 7fe6baffd640 1 --2- 172.21.15.77:0/3992259622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6a40039b0 0x7fe6a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:07.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.246+0000 7fe6bb7fe640 1 --2- 172.21.15.77:0/3992259622 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe6bc154380 0x7fe6a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:07.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.246+0000 7fe6ba7fc640 1 --2- 172.21.15.77:0/3992259622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6a4004800 0x7fe6a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:07.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.246+0000 7fe6baffd640 1 -- 172.21.15.77:0/3992259622 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe6bc154380 msgr2=0x7fe6a40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:07.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.246+0000 7fe6baffd640 1 --2- 172.21.15.77:0/3992259622 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe6bc154380 0x7fe6a40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:07.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.246+0000 7fe6baffd640 1 -- 172.21.15.77:0/3992259622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6a4004800 msgr2=0x7fe6a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:07.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.246+0000 7fe6baffd640 1 --2- 172.21.15.77:0/3992259622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6a4004800 0x7fe6a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:07.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.246+0000 7fe6baffd640 1 -- 172.21.15.77:0/3992259622 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a4003520 con 0x7fe6a40039b0 2024-04-25T01:44:07.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.246+0000 7fe6ba7fc640 1 --2- 172.21.15.77:0/3992259622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6a4004800 0x7fe6a4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:44:07.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.246+0000 7fe6baffd640 1 --2- 172.21.15.77:0/3992259622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6a40039b0 0x7fe6a4003dd0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac007fd0 tx=0x7fe6a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb9624634e45246 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:07.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.246+0000 7fe6b9ffb640 1 -- 172.21.15.77:0/3992259622 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac007d50 con 0x7fe6a40039b0 2024-04-25T01:44:07.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.246+0000 7fe6b9ffb640 1 -- 172.21.15.77:0/3992259622 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6ac005ad0 con 0x7fe6a40039b0 2024-04-25T01:44:07.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.246+0000 7fe6b9ffb640 1 -- 172.21.15.77:0/3992259622 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac007070 con 0x7fe6a40039b0 2024-04-25T01:44:07.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.247+0000 7fe6c17a9640 1 -- 172.21.15.77:0/3992259622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6a40039b0 msgr2=0x7fe6a4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:07.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.247+0000 7fe6c17a9640 1 --2- 172.21.15.77:0/3992259622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6a40039b0 0x7fe6a4003dd0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac007fd0 tx=0x7fe6a4005830 comp rx=0 tx=0).stop 2024-04-25T01:44:07.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.247+0000 7fe6bb7fe640 1 -- 172.21.15.77:0/3992259622 reap_dead start 2024-04-25T01:44:07.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.247+0000 7fe6c17a9640 1 -- 172.21.15.77:0/3992259622 shutdown_connections 2024-04-25T01:44:07.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.247+0000 7fe6c17a9640 1 -- 172.21.15.77:0/3992259622 >> 172.21.15.77:0/3992259622 conn(0x7fe6bc0c3f80 msgr2=0x7fe6bc0c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:07.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.247+0000 7fe6c17a9640 1 -- 172.21.15.77:0/3992259622 shutdown_connections 2024-04-25T01:44:07.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.247+0000 7fe6c17a9640 1 -- 172.21.15.77:0/3992259622 wait complete. 2024-04-25T01:44:07.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.248+0000 7fe6c17a9640 1 Processor -- start 2024-04-25T01:44:07.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.248+0000 7fe6c17a9640 1 -- start start 2024-04-25T01:44:07.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.249+0000 7fe6c17a9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6a40039b0 0x7fe6bc1de630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:07.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.249+0000 7fe6c17a9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6bc155660 0x7fe6bc1deb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:07.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.249+0000 7fe6c17a9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe6bc14c380 0x7fe6bc14c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:07.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.249+0000 7fe6c17a9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc152d70 con 0x7fe6a40039b0 2024-04-25T01:44:07.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.249+0000 7fe6c17a9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc152bf0 con 0x7fe6bc155660 2024-04-25T01:44:07.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.249+0000 7fe6c17a9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe6bc0c3100 con 0x7fe6bc14c380 2024-04-25T01:44:07.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.249+0000 7fe6baffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6a40039b0 0x7fe6bc1de630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:07.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.249+0000 7fe6baffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6a40039b0 0x7fe6bc1de630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54698/0 (socket says 172.21.15.77:54698) 2024-04-25T01:44:07.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.249+0000 7fe6baffd640 1 -- 172.21.15.77:0/1885160805 learned_addr learned my addr 172.21.15.77:0/1885160805 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:07.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.249+0000 7fe6ba7fc640 1 --2- 172.21.15.77:0/1885160805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6bc155660 0x7fe6bc1deb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:07.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.249+0000 7fe6bb7fe640 1 --2- 172.21.15.77:0/1885160805 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe6bc14c380 0x7fe6bc14c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:07.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.249+0000 7fe6baffd640 1 -- 172.21.15.77:0/1885160805 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe6bc14c380 msgr2=0x7fe6bc14c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:07.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.249+0000 7fe6baffd640 1 --2- 172.21.15.77:0/1885160805 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe6bc14c380 0x7fe6bc14c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:07.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.249+0000 7fe6baffd640 1 -- 172.21.15.77:0/1885160805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6bc155660 msgr2=0x7fe6bc1deb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:07.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.249+0000 7fe6baffd640 1 --2- 172.21.15.77:0/1885160805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6bc155660 0x7fe6bc1deb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:07.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.249+0000 7fe6baffd640 1 -- 172.21.15.77:0/1885160805 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6bc156aa0 con 0x7fe6a40039b0 2024-04-25T01:44:07.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.250+0000 7fe6baffd640 1 --2- 172.21.15.77:0/1885160805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6a40039b0 0x7fe6bc1de630 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac00c300 tx=0x7fe6bc0702e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:07.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.250+0000 7fe6a37fe640 1 -- 172.21.15.77:0/1885160805 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac041070 con 0x7fe6a40039b0 2024-04-25T01:44:07.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.250+0000 7fe6a37fe640 1 -- 172.21.15.77:0/1885160805 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6ac007280 con 0x7fe6a40039b0 2024-04-25T01:44:07.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.250+0000 7fe6c17a9640 1 -- 172.21.15.77:0/1885160805 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6bc154ab0 con 0x7fe6a40039b0 2024-04-25T01:44:07.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.250+0000 7fe6a37fe640 1 -- 172.21.15.77:0/1885160805 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac007d50 con 0x7fe6a40039b0 2024-04-25T01:44:07.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.250+0000 7fe6c17a9640 1 -- 172.21.15.77:0/1885160805 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6bc1ea480 con 0x7fe6a40039b0 2024-04-25T01:44:07.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.251+0000 7fe6c17a9640 1 -- 172.21.15.77:0/1885160805 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6bc04f500 con 0x7fe6a40039b0 2024-04-25T01:44:07.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.251+0000 7fe6a37fe640 1 -- 172.21.15.77:0/1885160805 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe6ac044070 con 0x7fe6a40039b0 2024-04-25T01:44:07.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.251+0000 7fe6a37fe640 1 --2- 172.21.15.77:0/1885160805 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe6a806be30 0x7fe6a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:07.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.252+0000 7fe6ba7fc640 1 --2- 172.21.15.77:0/1885160805 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe6a806be30 0x7fe6a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:07.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.252+0000 7fe6a37fe640 1 -- 172.21.15.77:0/1885160805 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7fe6ac0ab6a0 con 0x7fe6a40039b0 2024-04-25T01:44:07.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.252+0000 7fe6ba7fc640 1 --2- 172.21.15.77:0/1885160805 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe6a806be30 0x7fe6a806e2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0006fd0 tx=0x7fe6b0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:07.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.256+0000 7fe6a37fe640 1 -- 172.21.15.77:0/1885160805 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe6ac079b90 con 0x7fe6a40039b0 2024-04-25T01:44:07.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.468+0000 7fe6c17a9640 1 -- 172.21.15.77:0/1885160805 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe6bc0a8c60 con 0x7fe6a40039b0 2024-04-25T01:44:07.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.468+0000 7fe6a37fe640 1 -- 172.21.15.77:0/1885160805 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+6485 (secure 0 0 0) 0x7fe6ac079490 con 0x7fe6a40039b0 2024-04-25T01:44:07.460 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:44:07.460 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1570919706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1570919706},{"type":"v1","addr":"172.21.15.77:6837","nonce":1570919706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:42:07.395274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5439":{"gid":5439,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5439,"qdb_cluster":[5439]},"id":1},{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:43:32.407370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":22,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5179,"qdb_cluster":[5179]},"id":2}]} 2024-04-25T01:44:07.460 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 33 2024-04-25T01:44:07.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.470+0000 7fe6c17a9640 1 -- 172.21.15.77:0/1885160805 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe6a806be30 msgr2=0x7fe6a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:07.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.470+0000 7fe6c17a9640 1 --2- 172.21.15.77:0/1885160805 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe6a806be30 0x7fe6a806e2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0006fd0 tx=0x7fe6b0008040 comp rx=0 tx=0).stop 2024-04-25T01:44:07.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.470+0000 7fe6c17a9640 1 -- 172.21.15.77:0/1885160805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6a40039b0 msgr2=0x7fe6bc1de630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:07.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.470+0000 7fe6c17a9640 1 --2- 172.21.15.77:0/1885160805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6a40039b0 0x7fe6bc1de630 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac00c300 tx=0x7fe6bc0702e0 comp rx=0 tx=0).stop 2024-04-25T01:44:07.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.470+0000 7fe6c17a9640 1 -- 172.21.15.77:0/1885160805 shutdown_connections 2024-04-25T01:44:07.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.470+0000 7fe6c17a9640 1 --2- 172.21.15.77:0/1885160805 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe6a806be30 0x7fe6a806e2f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:07.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.470+0000 7fe6c17a9640 1 --2- 172.21.15.77:0/1885160805 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe6bc14c380 0x7fe6bc14c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:07.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.470+0000 7fe6c17a9640 1 --2- 172.21.15.77:0/1885160805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6bc155660 0x7fe6bc1deb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:07.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.470+0000 7fe6c17a9640 1 --2- 172.21.15.77:0/1885160805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6a40039b0 0x7fe6bc1de630 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:07.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.470+0000 7fe6c17a9640 1 -- 172.21.15.77:0/1885160805 >> 172.21.15.77:0/1885160805 conn(0x7fe6bc0c3f80 msgr2=0x7fe6bc1479c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:07.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.470+0000 7fe6c17a9640 1 -- 172.21.15.77:0/1885160805 shutdown_connections 2024-04-25T01:44:07.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:07.470+0000 7fe6c17a9640 1 -- 172.21.15.77:0/1885160805 wait complete. 2024-04-25T01:44:07.473 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T01:44:09.474 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:44:09.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.591+0000 7fe0ff122640 1 Processor -- start 2024-04-25T01:44:09.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.591+0000 7fe0ff122640 1 -- start start 2024-04-25T01:44:09.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.592+0000 7fe0ff122640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe0f814fdd0 0x7fe0f806da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:09.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.592+0000 7fe0ff122640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe0f806df70 0x7fe0f8156170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:09.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.592+0000 7fe0ff122640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0f80c2cb0 con 0x7fe0f80ad3a0 2024-04-25T01:44:09.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.592+0000 7fe0ff122640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fe0f80c30e0 con 0x7fe0f814fdd0 2024-04-25T01:44:09.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.592+0000 7fe0ff122640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe0f8152f80 con 0x7fe0f806df70 2024-04-25T01:44:09.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.592+0000 7fe0f7fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe0f80ad3a0 0x7fe0f8155a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:37968/0 (socket says 172.21.15.77:37968) 2024-04-25T01:44:09.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.592+0000 7fe0f7fff640 1 -- 172.21.15.77:0/1055499200 learned_addr learned my addr 172.21.15.77:0/1055499200 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:44:09.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.592+0000 7fe0fcebe640 1 --2- 172.21.15.77:0/1055499200 >> v2:172.21.15.121:3300/0 conn(0x7fe0f814fdd0 0x7fe0f806da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:09.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.592+0000 7fe0f77fe640 1 -- 172.21.15.77:0/1055499200 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1433865055 0 0) 0x7fe0f80c2cb0 con 0x7fe0f80ad3a0 2024-04-25T01:44:09.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.592+0000 7fe0fd6bf640 1 --2- 172.21.15.77:0/1055499200 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe0f806df70 0x7fe0f8156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:09.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.592+0000 7fe0f77fe640 1 -- 172.21.15.77:0/1055499200 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0e0003520 con 0x7fe0f80ad3a0 2024-04-25T01:44:09.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.593+0000 7fe0f77fe640 1 -- 172.21.15.77:0/1055499200 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 608338513 0 0) 0x7fe0e0003520 con 0x7fe0f80ad3a0 2024-04-25T01:44:09.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.593+0000 7fe0f77fe640 1 -- 172.21.15.77:0/1055499200 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe0f806df70 msgr2=0x7fe0f8156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:09.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.593+0000 7fe0f77fe640 1 --2- 172.21.15.77:0/1055499200 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe0f806df70 0x7fe0f8156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:09.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.593+0000 7fe0f77fe640 1 -- 172.21.15.77:0/1055499200 >> v2:172.21.15.121:3300/0 conn(0x7fe0f814fdd0 msgr2=0x7fe0f806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:09.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.593+0000 7fe0f77fe640 1 --2- 172.21.15.77:0/1055499200 >> v2:172.21.15.121:3300/0 conn(0x7fe0f814fdd0 0x7fe0f806da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:09.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.593+0000 7fe0f77fe640 1 -- 172.21.15.77:0/1055499200 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f8153260 con 0x7fe0f80ad3a0 2024-04-25T01:44:09.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.593+0000 7fe0f77fe640 1 -- 172.21.15.77:0/1055499200 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7fe0ec001670 con 0x7fe0f80ad3a0 2024-04-25T01:44:09.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.593+0000 7fe0f77fe640 1 -- 172.21.15.77:0/1055499200 >> v1:172.21.15.77:6789/0 conn(0x7fe0f80ad3a0 legacy=0x7fe0f8155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:09.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.593+0000 7fe0f77fe640 1 --2- 172.21.15.77:0/1055499200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0e00039b0 0x7fe0e0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:09.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.593+0000 7fe0f77fe640 1 --2- 172.21.15.77:0/1055499200 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe0f806df70 0x7fe0e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:09.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.593+0000 7fe0f77fe640 1 --2- 172.21.15.77:0/1055499200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0e0004d40 0x7fe0e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:09.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.593+0000 7fe0f77fe640 1 -- 172.21.15.77:0/1055499200 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f80c30e0 con 0x7fe0e00039b0 2024-04-25T01:44:09.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.593+0000 7fe0f77fe640 1 -- 172.21.15.77:0/1055499200 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f8152f80 con 0x7fe0e0004d40 2024-04-25T01:44:09.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.593+0000 7fe0f77fe640 1 -- 172.21.15.77:0/1055499200 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe0e000b9f0 con 0x7fe0f806df70 2024-04-25T01:44:09.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.593+0000 7fe0fcebe640 1 --2- 172.21.15.77:0/1055499200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0e00039b0 0x7fe0e0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:09.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.593+0000 7fe0f7fff640 1 --2- 172.21.15.77:0/1055499200 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe0f806df70 0x7fe0e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:09.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.593+0000 7fe0fd6bf640 1 --2- 172.21.15.77:0/1055499200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0e0004d40 0x7fe0e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:09.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.593+0000 7fe0fcebe640 1 -- 172.21.15.77:0/1055499200 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe0f806df70 msgr2=0x7fe0e0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:09.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.593+0000 7fe0fcebe640 1 --2- 172.21.15.77:0/1055499200 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe0f806df70 0x7fe0e0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:09.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.593+0000 7fe0fcebe640 1 -- 172.21.15.77:0/1055499200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0e0004d40 msgr2=0x7fe0e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:09.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.593+0000 7fe0fcebe640 1 --2- 172.21.15.77:0/1055499200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0e0004d40 0x7fe0e00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:09.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.593+0000 7fe0fcebe640 1 -- 172.21.15.77:0/1055499200 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e0003520 con 0x7fe0e00039b0 2024-04-25T01:44:09.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.594+0000 7fe0fcebe640 1 --2- 172.21.15.77:0/1055499200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0e00039b0 0x7fe0e0003dd0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8009ac0 tx=0x7fe0e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0107c72547658fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:09.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.594+0000 7fe0f77fe640 1 -- 172.21.15.77:0/1055499200 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e8036070 con 0x7fe0e00039b0 2024-04-25T01:44:09.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.594+0000 7fe0f77fe640 1 -- 172.21.15.77:0/1055499200 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0e8031400 con 0x7fe0e00039b0 2024-04-25T01:44:09.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.594+0000 7fe0f77fe640 1 -- 172.21.15.77:0/1055499200 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e8009690 con 0x7fe0e00039b0 2024-04-25T01:44:09.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.595+0000 7fe0ff122640 1 -- 172.21.15.77:0/1055499200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0e00039b0 msgr2=0x7fe0e0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:09.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.595+0000 7fe0ff122640 1 --2- 172.21.15.77:0/1055499200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0e00039b0 0x7fe0e0003dd0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8009ac0 tx=0x7fe0e0005830 comp rx=0 tx=0).stop 2024-04-25T01:44:09.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.595+0000 7fe0fd6bf640 1 -- 172.21.15.77:0/1055499200 reap_dead start 2024-04-25T01:44:09.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.595+0000 7fe0ff122640 1 -- 172.21.15.77:0/1055499200 shutdown_connections 2024-04-25T01:44:09.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.595+0000 7fe0ff122640 1 -- 172.21.15.77:0/1055499200 >> 172.21.15.77:0/1055499200 conn(0x7fe0f80c3f80 msgr2=0x7fe0f80c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:09.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.595+0000 7fe0ff122640 1 -- 172.21.15.77:0/1055499200 shutdown_connections 2024-04-25T01:44:09.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.595+0000 7fe0ff122640 1 -- 172.21.15.77:0/1055499200 wait complete. 2024-04-25T01:44:09.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.596+0000 7fe0ff122640 1 Processor -- start 2024-04-25T01:44:09.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.596+0000 7fe0ff122640 1 -- start start 2024-04-25T01:44:09.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.597+0000 7fe0ff122640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe0e00039b0 0x7fe0f81ea1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:09.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.597+0000 7fe0ff122640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0f814a560 0x7fe0f814c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:09.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.597+0000 7fe0ff122640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0f8154eb0 0x7fe0f8148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:09.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.597+0000 7fe0ff122640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f80c2a70 con 0x7fe0f8154eb0 2024-04-25T01:44:09.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.597+0000 7fe0ff122640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f80c28f0 con 0x7fe0f814a560 2024-04-25T01:44:09.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.597+0000 7fe0ff122640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe0f80c38d0 con 0x7fe0e00039b0 2024-04-25T01:44:09.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.597+0000 7fe0fd6bf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0f8154eb0 0x7fe0f8148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:09.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.597+0000 7fe0fd6bf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0f8154eb0 0x7fe0f8148830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43874/0 (socket says 172.21.15.77:43874) 2024-04-25T01:44:09.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.597+0000 7fe0fd6bf640 1 -- 172.21.15.77:0/3347858036 learned_addr learned my addr 172.21.15.77:0/3347858036 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:09.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.597+0000 7fe0f7fff640 1 --2- 172.21.15.77:0/3347858036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0f814a560 0x7fe0f814c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:09.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.597+0000 7fe0fcebe640 1 --2- 172.21.15.77:0/3347858036 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe0e00039b0 0x7fe0f81ea1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:09.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.597+0000 7fe0fd6bf640 1 -- 172.21.15.77:0/3347858036 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe0e00039b0 msgr2=0x7fe0f81ea1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:09.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.597+0000 7fe0fd6bf640 1 --2- 172.21.15.77:0/3347858036 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe0e00039b0 0x7fe0f81ea1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:09.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.597+0000 7fe0fd6bf640 1 -- 172.21.15.77:0/3347858036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0f814a560 msgr2=0x7fe0f814c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:09.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.597+0000 7fe0fd6bf640 1 --2- 172.21.15.77:0/3347858036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0f814a560 0x7fe0f814c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:09.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.597+0000 7fe0fd6bf640 1 -- 172.21.15.77:0/3347858036 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f8156040 con 0x7fe0f8154eb0 2024-04-25T01:44:09.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.597+0000 7fe0f7fff640 1 --2- 172.21.15.77:0/3347858036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0f814a560 0x7fe0f814c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:44:09.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.597+0000 7fe0fd6bf640 1 --2- 172.21.15.77:0/3347858036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0f8154eb0 0x7fe0f8148830 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80ad020 tx=0x7fe0f000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:09.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.598+0000 7fe0f57fa640 1 -- 172.21.15.77:0/3347858036 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f000fde0 con 0x7fe0f8154eb0 2024-04-25T01:44:09.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.598+0000 7fe0f57fa640 1 -- 172.21.15.77:0/3347858036 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f0015430 con 0x7fe0f8154eb0 2024-04-25T01:44:09.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.598+0000 7fe0ff122640 1 -- 172.21.15.77:0/3347858036 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0f8156320 con 0x7fe0f8154eb0 2024-04-25T01:44:09.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.598+0000 7fe0f57fa640 1 -- 172.21.15.77:0/3347858036 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f0015820 con 0x7fe0f8154eb0 2024-04-25T01:44:09.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.598+0000 7fe0ff122640 1 -- 172.21.15.77:0/3347858036 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0f814c8c0 con 0x7fe0f8154eb0 2024-04-25T01:44:09.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.599+0000 7fe0ff122640 1 -- 172.21.15.77:0/3347858036 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0f8150d50 con 0x7fe0f8154eb0 2024-04-25T01:44:09.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.599+0000 7fe0f57fa640 1 -- 172.21.15.77:0/3347858036 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe0f00159c0 con 0x7fe0f8154eb0 2024-04-25T01:44:09.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.599+0000 7fe0f57fa640 1 --2- 172.21.15.77:0/3347858036 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe0e406be30 0x7fe0e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:09.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.600+0000 7fe0f57fa640 1 -- 172.21.15.77:0/3347858036 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7fe0f008c1f0 con 0x7fe0f8154eb0 2024-04-25T01:44:09.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.600+0000 7fe0fcebe640 1 --2- 172.21.15.77:0/3347858036 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe0e406be30 0x7fe0e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:09.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.600+0000 7fe0fcebe640 1 --2- 172.21.15.77:0/3347858036 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe0e406be30 0x7fe0e406e2f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8033000 tx=0x7fe0e8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:09.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.604+0000 7fe0f57fa640 1 -- 172.21.15.77:0/3347858036 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe0f8150d50 con 0x7fe0f8154eb0 2024-04-25T01:44:09.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.816+0000 7fe0ff122640 1 -- 172.21.15.77:0/3347858036 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0f80c1d80 con 0x7fe0f8154eb0 2024-04-25T01:44:09.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.816+0000 7fe0f57fa640 1 -- 172.21.15.77:0/3347858036 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+6485 (secure 0 0 0) 0x7fe0f80c1d80 con 0x7fe0f8154eb0 2024-04-25T01:44:09.808 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:44:09.808 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1570919706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1570919706},{"type":"v1","addr":"172.21.15.77:6837","nonce":1570919706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:42:07.395274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5439":{"gid":5439,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5439,"qdb_cluster":[5439]},"id":1},{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:43:32.407370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":22,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5179,"qdb_cluster":[5179]},"id":2}]} 2024-04-25T01:44:09.808 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 33 2024-04-25T01:44:09.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.818+0000 7fe0ff122640 1 -- 172.21.15.77:0/3347858036 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe0e406be30 msgr2=0x7fe0e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:09.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.818+0000 7fe0ff122640 1 --2- 172.21.15.77:0/3347858036 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe0e406be30 0x7fe0e406e2f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8033000 tx=0x7fe0e8008030 comp rx=0 tx=0).stop 2024-04-25T01:44:09.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.818+0000 7fe0ff122640 1 -- 172.21.15.77:0/3347858036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0f8154eb0 msgr2=0x7fe0f8148830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:09.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.818+0000 7fe0ff122640 1 --2- 172.21.15.77:0/3347858036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0f8154eb0 0x7fe0f8148830 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80ad020 tx=0x7fe0f000f580 comp rx=0 tx=0).stop 2024-04-25T01:44:09.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.818+0000 7fe0ff122640 1 -- 172.21.15.77:0/3347858036 shutdown_connections 2024-04-25T01:44:09.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.818+0000 7fe0ff122640 1 --2- 172.21.15.77:0/3347858036 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fe0e406be30 0x7fe0e406e2f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:09.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.818+0000 7fe0ff122640 1 --2- 172.21.15.77:0/3347858036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0f8154eb0 0x7fe0f8148830 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:09.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.818+0000 7fe0ff122640 1 --2- 172.21.15.77:0/3347858036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0f814a560 0x7fe0f814c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:09.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.818+0000 7fe0ff122640 1 --2- 172.21.15.77:0/3347858036 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe0e00039b0 0x7fe0f81ea1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:09.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.818+0000 7fe0ff122640 1 -- 172.21.15.77:0/3347858036 >> 172.21.15.77:0/3347858036 conn(0x7fe0f80c3f80 msgr2=0x7fe0f80aa320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:09.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.818+0000 7fe0ff122640 1 -- 172.21.15.77:0/3347858036 shutdown_connections 2024-04-25T01:44:09.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:09.818+0000 7fe0ff122640 1 -- 172.21.15.77:0/3347858036 wait complete. 2024-04-25T01:44:09.821 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T01:44:11.822 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:44:11.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.938+0000 7fab2b563640 1 Processor -- start 2024-04-25T01:44:11.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.939+0000 7fab2b563640 1 -- start start 2024-04-25T01:44:11.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.939+0000 7fab2b563640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fab24156c80 0x7fab240c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:11.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.939+0000 7fab2b563640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab24157130 con 0x7fab2406c280 2024-04-25T01:44:11.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.939+0000 7fab2b563640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab240c9de0 con 0x7fab24150090 2024-04-25T01:44:11.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.939+0000 7fab2b563640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fab2406b830 con 0x7fab24156c80 2024-04-25T01:44:11.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.940+0000 7fab29b00640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fab2406c280 0x7fab240c6320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:37984/0 (socket says 172.21.15.77:37984) 2024-04-25T01:44:11.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.940+0000 7fab29b00640 1 -- 172.21.15.77:0/397161120 learned_addr learned my addr 172.21.15.77:0/397161120 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:44:11.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.940+0000 7fab1bfff640 1 -- 172.21.15.77:0/397161120 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2651457657 0 0) 0x7fab1c001490 con 0x7fab2406c280 2024-04-25T01:44:11.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.940+0000 7fab1bfff640 1 -- 172.21.15.77:0/397161120 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab10003520 con 0x7fab2406c280 2024-04-25T01:44:11.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.940+0000 7fab28afe640 1 --2- 172.21.15.77:0/397161120 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fab24156c80 0x7fab240c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:11.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.940+0000 7fab1bfff640 1 -- 172.21.15.77:0/397161120 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1637657814 0 0) 0x7fab10003520 con 0x7fab2406c280 2024-04-25T01:44:11.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.940+0000 7fab1bfff640 1 -- 172.21.15.77:0/397161120 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fab24156c80 msgr2=0x7fab240c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:11.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.940+0000 7fab1bfff640 1 --2- 172.21.15.77:0/397161120 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fab24156c80 0x7fab240c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:11.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.940+0000 7fab1bfff640 1 -- 172.21.15.77:0/397161120 >> v1:172.21.15.121:6789/0 conn(0x7fab24150090 legacy=0x7fab240c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:11.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.940+0000 7fab1bfff640 1 -- 172.21.15.77:0/397161120 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab240c89c0 con 0x7fab2406c280 2024-04-25T01:44:11.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.940+0000 7fab1bfff640 1 -- 172.21.15.77:0/397161120 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7fab1c001bc0 con 0x7fab2406c280 2024-04-25T01:44:11.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.940+0000 7fab1bfff640 1 -- 172.21.15.77:0/397161120 >> v1:172.21.15.77:6789/0 conn(0x7fab2406c280 legacy=0x7fab240c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:11.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.940+0000 7fab1bfff640 1 --2- 172.21.15.77:0/397161120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab100039e0 0x7fab10003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:11.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.940+0000 7fab1bfff640 1 --2- 172.21.15.77:0/397161120 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fab24156c80 0x7fab10004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:11.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.940+0000 7fab1bfff640 1 --2- 172.21.15.77:0/397161120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab10004d40 0x7fab100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:11.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.940+0000 7fab1bfff640 1 -- 172.21.15.77:0/397161120 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fab2406b830 con 0x7fab100039e0 2024-04-25T01:44:11.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.940+0000 7fab1bfff640 1 -- 172.21.15.77:0/397161120 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fab1000baa0 con 0x7fab10004d40 2024-04-25T01:44:11.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.940+0000 7fab1bfff640 1 -- 172.21.15.77:0/397161120 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fab1000bca0 con 0x7fab24156c80 2024-04-25T01:44:11.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.940+0000 7fab292ff640 1 --2- 172.21.15.77:0/397161120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab100039e0 0x7fab10003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:11.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.940+0000 7fab28afe640 1 --2- 172.21.15.77:0/397161120 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fab24156c80 0x7fab10004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:11.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.940+0000 7fab29b00640 1 --2- 172.21.15.77:0/397161120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab10004d40 0x7fab100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:11.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.941+0000 7fab292ff640 1 -- 172.21.15.77:0/397161120 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fab24156c80 msgr2=0x7fab10004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:11.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.941+0000 7fab292ff640 1 --2- 172.21.15.77:0/397161120 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fab24156c80 0x7fab10004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:11.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.941+0000 7fab292ff640 1 -- 172.21.15.77:0/397161120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab10004d40 msgr2=0x7fab100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:11.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.941+0000 7fab292ff640 1 --2- 172.21.15.77:0/397161120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab10004d40 0x7fab100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:11.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.941+0000 7fab292ff640 1 -- 172.21.15.77:0/397161120 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab10003520 con 0x7fab100039e0 2024-04-25T01:44:11.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.941+0000 7fab29b00640 1 --2- 172.21.15.77:0/397161120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab10004d40 0x7fab100051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:44:11.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.941+0000 7fab292ff640 1 --2- 172.21.15.77:0/397161120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab100039e0 0x7fab10003e20 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fab14001720 tx=0x7fab10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bf277122708550 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:11.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.941+0000 7fab1bfff640 1 -- 172.21.15.77:0/397161120 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab14001370 con 0x7fab100039e0 2024-04-25T01:44:11.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.941+0000 7fab1bfff640 1 -- 172.21.15.77:0/397161120 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab140052d0 con 0x7fab100039e0 2024-04-25T01:44:11.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.941+0000 7fab1bfff640 1 -- 172.21.15.77:0/397161120 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab1402abc0 con 0x7fab100039e0 2024-04-25T01:44:11.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.942+0000 7fab2b563640 1 -- 172.21.15.77:0/397161120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab100039e0 msgr2=0x7fab10003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:11.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.942+0000 7fab2b563640 1 --2- 172.21.15.77:0/397161120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab100039e0 0x7fab10003e20 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fab14001720 tx=0x7fab10005830 comp rx=0 tx=0).stop 2024-04-25T01:44:11.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.942+0000 7fab29b00640 1 -- 172.21.15.77:0/397161120 reap_dead start 2024-04-25T01:44:11.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.942+0000 7fab2b563640 1 -- 172.21.15.77:0/397161120 shutdown_connections 2024-04-25T01:44:11.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.942+0000 7fab2b563640 1 -- 172.21.15.77:0/397161120 >> 172.21.15.77:0/397161120 conn(0x7fab240ad4d0 msgr2=0x7fab240ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:11.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.942+0000 7fab2b563640 1 -- 172.21.15.77:0/397161120 shutdown_connections 2024-04-25T01:44:11.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.942+0000 7fab2b563640 1 -- 172.21.15.77:0/397161120 wait complete. 2024-04-25T01:44:11.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.943+0000 7fab2b563640 1 Processor -- start 2024-04-25T01:44:11.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.943+0000 7fab2b563640 1 -- start start 2024-04-25T01:44:11.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.944+0000 7fab2b563640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fab100039e0 0x7fab241528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:11.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.944+0000 7fab2b563640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab241582a0 0x7fab240af930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:11.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.944+0000 7fab2b563640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab240afe70 0x7fab2414bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:11.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.944+0000 7fab2b563640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fab2406bd60 con 0x7fab240afe70 2024-04-25T01:44:11.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.944+0000 7fab2b563640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fab2406ba80 con 0x7fab241582a0 2024-04-25T01:44:11.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.944+0000 7fab2b563640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fab240c6a30 con 0x7fab100039e0 2024-04-25T01:44:11.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.944+0000 7fab29b00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab240afe70 0x7fab2414bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:11.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.944+0000 7fab29b00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab240afe70 0x7fab2414bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43890/0 (socket says 172.21.15.77:43890) 2024-04-25T01:44:11.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.944+0000 7fab29b00640 1 -- 172.21.15.77:0/2712086414 learned_addr learned my addr 172.21.15.77:0/2712086414 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:11.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.944+0000 7fab28afe640 1 --2- 172.21.15.77:0/2712086414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab241582a0 0x7fab240af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:11.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.944+0000 7fab292ff640 1 --2- 172.21.15.77:0/2712086414 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fab100039e0 0x7fab241528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:11.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.944+0000 7fab29b00640 1 -- 172.21.15.77:0/2712086414 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fab100039e0 msgr2=0x7fab241528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:11.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.944+0000 7fab29b00640 1 --2- 172.21.15.77:0/2712086414 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fab100039e0 0x7fab241528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:11.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.944+0000 7fab29b00640 1 -- 172.21.15.77:0/2712086414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab241582a0 msgr2=0x7fab240af930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:11.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.944+0000 7fab29b00640 1 --2- 172.21.15.77:0/2712086414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab241582a0 0x7fab240af930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:11.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.944+0000 7fab29b00640 1 -- 172.21.15.77:0/2712086414 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab240b08d0 con 0x7fab240afe70 2024-04-25T01:44:11.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.944+0000 7fab292ff640 1 --2- 172.21.15.77:0/2712086414 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fab100039e0 0x7fab241528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:44:11.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.944+0000 7fab29b00640 1 --2- 172.21.15.77:0/2712086414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab240afe70 0x7fab2414bd50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fab24157060 tx=0x7fab1c007ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:11.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.945+0000 7fab19ffb640 1 -- 172.21.15.77:0/2712086414 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab1c017030 con 0x7fab240afe70 2024-04-25T01:44:11.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.945+0000 7fab19ffb640 1 -- 172.21.15.77:0/2712086414 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab1c00e960 con 0x7fab240afe70 2024-04-25T01:44:11.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.945+0000 7fab19ffb640 1 -- 172.21.15.77:0/2712086414 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab1c00eb10 con 0x7fab240afe70 2024-04-25T01:44:11.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.945+0000 7fab2b563640 1 -- 172.21.15.77:0/2712086414 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab240b0bb0 con 0x7fab240afe70 2024-04-25T01:44:11.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.945+0000 7fab2b563640 1 -- 172.21.15.77:0/2712086414 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab240b1200 con 0x7fab240afe70 2024-04-25T01:44:11.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.946+0000 7fab2b563640 1 -- 172.21.15.77:0/2712086414 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab2404f500 con 0x7fab240afe70 2024-04-25T01:44:11.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.946+0000 7fab19ffb640 1 -- 172.21.15.77:0/2712086414 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fab1c01a070 con 0x7fab240afe70 2024-04-25T01:44:11.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.946+0000 7fab19ffb640 1 --2- 172.21.15.77:0/2712086414 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fab0806be60 0x7fab0806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:11.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.947+0000 7fab19ffb640 1 -- 172.21.15.77:0/2712086414 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7fab1c08b2c0 con 0x7fab240afe70 2024-04-25T01:44:11.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.947+0000 7fab292ff640 1 --2- 172.21.15.77:0/2712086414 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fab0806be60 0x7fab0806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:11.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.947+0000 7fab292ff640 1 --2- 172.21.15.77:0/2712086414 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fab0806be60 0x7fab0806e320 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fab14032000 tx=0x7fab1402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:11.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:11.951+0000 7fab19ffb640 1 -- 172.21.15.77:0/2712086414 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fab24157130 con 0x7fab240afe70 2024-04-25T01:44:12.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:12.162+0000 7fab2b563640 1 -- 172.21.15.77:0/2712086414 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab240b0d80 con 0x7fab240afe70 2024-04-25T01:44:12.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:12.162+0000 7fab19ffb640 1 -- 172.21.15.77:0/2712086414 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+6485 (secure 0 0 0) 0x7fab1c00ecb0 con 0x7fab240afe70 2024-04-25T01:44:12.154 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:44:12.154 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1570919706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1570919706},{"type":"v1","addr":"172.21.15.77:6837","nonce":1570919706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:42:07.395274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5439":{"gid":5439,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5439,"qdb_cluster":[5439]},"id":1},{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:43:32.407370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":22,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5179,"qdb_cluster":[5179]},"id":2}]} 2024-04-25T01:44:12.154 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 33 2024-04-25T01:44:12.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:12.164+0000 7fab2b563640 1 -- 172.21.15.77:0/2712086414 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fab0806be60 msgr2=0x7fab0806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:12.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:12.164+0000 7fab2b563640 1 --2- 172.21.15.77:0/2712086414 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fab0806be60 0x7fab0806e320 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fab14032000 tx=0x7fab1402e000 comp rx=0 tx=0).stop 2024-04-25T01:44:12.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:12.164+0000 7fab2b563640 1 -- 172.21.15.77:0/2712086414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab240afe70 msgr2=0x7fab2414bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:12.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:12.164+0000 7fab2b563640 1 --2- 172.21.15.77:0/2712086414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab240afe70 0x7fab2414bd50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fab24157060 tx=0x7fab1c007ae0 comp rx=0 tx=0).stop 2024-04-25T01:44:12.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:12.164+0000 7fab2b563640 1 -- 172.21.15.77:0/2712086414 shutdown_connections 2024-04-25T01:44:12.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:12.164+0000 7fab2b563640 1 --2- 172.21.15.77:0/2712086414 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fab0806be60 0x7fab0806e320 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:12.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:12.164+0000 7fab2b563640 1 --2- 172.21.15.77:0/2712086414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab240afe70 0x7fab2414bd50 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:12.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:12.164+0000 7fab2b563640 1 --2- 172.21.15.77:0/2712086414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab241582a0 0x7fab240af930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:12.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:12.164+0000 7fab2b563640 1 --2- 172.21.15.77:0/2712086414 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fab100039e0 0x7fab241528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:12.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:12.164+0000 7fab2b563640 1 -- 172.21.15.77:0/2712086414 >> 172.21.15.77:0/2712086414 conn(0x7fab240ad4d0 msgr2=0x7fab240cadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:12.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:12.164+0000 7fab2b563640 1 -- 172.21.15.77:0/2712086414 shutdown_connections 2024-04-25T01:44:12.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:12.164+0000 7fab2b563640 1 -- 172.21.15.77:0/2712086414 wait complete. 2024-04-25T01:44:12.167 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T01:44:14.168 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:44:14.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.286+0000 7fa072276640 1 Processor -- start 2024-04-25T01:44:14.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.286+0000 7fa072276640 1 -- start start 2024-04-25T01:44:14.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.287+0000 7fa072276640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa06c06d0a0 0x7fa06c06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:14.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.287+0000 7fa072276640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa06c154380 0x7fa06c154800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:14.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.287+0000 7fa072276640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa06c153be0 con 0x7fa06c150320 2024-04-25T01:44:14.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.287+0000 7fa072276640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fa06c152fd0 con 0x7fa06c154380 2024-04-25T01:44:14.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.287+0000 7fa072276640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fa06c1532b0 con 0x7fa06c06d0a0 2024-04-25T01:44:14.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.287+0000 7fa06bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa06c150320 0x7fa06c156bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:37986/0 (socket says 172.21.15.77:37986) 2024-04-25T01:44:14.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.287+0000 7fa06bfff640 1 -- 172.21.15.77:0/2966394672 learned_addr learned my addr 172.21.15.77:0/2966394672 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:44:14.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.287+0000 7fa070813640 1 --2- 172.21.15.77:0/2966394672 >> v2:172.21.15.121:3300/0 conn(0x7fa06c154380 0x7fa06c154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:14.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.287+0000 7fa06b7fe640 1 --2- 172.21.15.77:0/2966394672 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa06c06d0a0 0x7fa06c06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:14.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.287+0000 7fa06affd640 1 -- 172.21.15.77:0/2966394672 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2375994253 0 0) 0x7fa06c153be0 con 0x7fa06c150320 2024-04-25T01:44:14.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.287+0000 7fa06affd640 1 -- 172.21.15.77:0/2966394672 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa054003520 con 0x7fa06c150320 2024-04-25T01:44:14.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.287+0000 7fa06affd640 1 -- 172.21.15.77:0/2966394672 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 944133147 0 0) 0x7fa054003520 con 0x7fa06c150320 2024-04-25T01:44:14.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.287+0000 7fa06affd640 1 -- 172.21.15.77:0/2966394672 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa06c06d0a0 msgr2=0x7fa06c06d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:14.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.287+0000 7fa06affd640 1 --2- 172.21.15.77:0/2966394672 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa06c06d0a0 0x7fa06c06d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:14.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.287+0000 7fa06affd640 1 -- 172.21.15.77:0/2966394672 >> v2:172.21.15.121:3300/0 conn(0x7fa06c154380 msgr2=0x7fa06c154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:14.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.287+0000 7fa06affd640 1 --2- 172.21.15.77:0/2966394672 >> v2:172.21.15.121:3300/0 conn(0x7fa06c154380 0x7fa06c154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:14.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.287+0000 7fa06affd640 1 -- 172.21.15.77:0/2966394672 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa06c153590 con 0x7fa06c150320 2024-04-25T01:44:14.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.287+0000 7fa06affd640 1 -- 172.21.15.77:0/2966394672 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7fa05c001670 con 0x7fa06c150320 2024-04-25T01:44:14.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.287+0000 7fa06affd640 1 -- 172.21.15.77:0/2966394672 >> v1:172.21.15.77:6789/0 conn(0x7fa06c150320 legacy=0x7fa06c156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:14.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.287+0000 7fa06affd640 1 --2- 172.21.15.77:0/2966394672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0540039b0 0x7fa054003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:14.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.287+0000 7fa06affd640 1 --2- 172.21.15.77:0/2966394672 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa06c06d0a0 0x7fa054004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:14.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.287+0000 7fa06affd640 1 --2- 172.21.15.77:0/2966394672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa054004d40 0x7fa0540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:14.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.287+0000 7fa06affd640 1 -- 172.21.15.77:0/2966394672 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c152fd0 con 0x7fa054004d40 2024-04-25T01:44:14.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.287+0000 7fa06affd640 1 -- 172.21.15.77:0/2966394672 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c1532b0 con 0x7fa0540039b0 2024-04-25T01:44:14.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.287+0000 7fa06affd640 1 -- 172.21.15.77:0/2966394672 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fa05400b9c0 con 0x7fa06c06d0a0 2024-04-25T01:44:14.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.288+0000 7fa070813640 1 --2- 172.21.15.77:0/2966394672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa054004d40 0x7fa0540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:14.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.288+0000 7fa06bfff640 1 --2- 172.21.15.77:0/2966394672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0540039b0 0x7fa054003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:14.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.288+0000 7fa06b7fe640 1 --2- 172.21.15.77:0/2966394672 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa06c06d0a0 0x7fa054004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:14.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.288+0000 7fa070813640 1 -- 172.21.15.77:0/2966394672 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa06c06d0a0 msgr2=0x7fa054004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:14.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.288+0000 7fa070813640 1 --2- 172.21.15.77:0/2966394672 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa06c06d0a0 0x7fa054004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:14.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.288+0000 7fa070813640 1 -- 172.21.15.77:0/2966394672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0540039b0 msgr2=0x7fa054003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:14.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.288+0000 7fa070813640 1 --2- 172.21.15.77:0/2966394672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0540039b0 0x7fa054003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:14.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.288+0000 7fa070813640 1 -- 172.21.15.77:0/2966394672 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa054003520 con 0x7fa054004d40 2024-04-25T01:44:14.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.289+0000 7fa070813640 1 --2- 172.21.15.77:0/2966394672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa054004d40 0x7fa0540051c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa064009fc0 tx=0x7fa054005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e8918723b37247 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:14.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.289+0000 7fa06affd640 1 -- 172.21.15.77:0/2966394672 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa064009c10 con 0x7fa054004d40 2024-04-25T01:44:14.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.289+0000 7fa06affd640 1 -- 172.21.15.77:0/2966394672 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa064036070 con 0x7fa054004d40 2024-04-25T01:44:14.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.289+0000 7fa06affd640 1 -- 172.21.15.77:0/2966394672 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06402d070 con 0x7fa054004d40 2024-04-25T01:44:14.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.289+0000 7fa072276640 1 -- 172.21.15.77:0/2966394672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa054004d40 msgr2=0x7fa0540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:14.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.289+0000 7fa072276640 1 --2- 172.21.15.77:0/2966394672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa054004d40 0x7fa0540051c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa064009fc0 tx=0x7fa054005830 comp rx=0 tx=0).stop 2024-04-25T01:44:14.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.289+0000 7fa070813640 1 -- 172.21.15.77:0/2966394672 reap_dead start 2024-04-25T01:44:14.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.289+0000 7fa072276640 1 -- 172.21.15.77:0/2966394672 shutdown_connections 2024-04-25T01:44:14.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.289+0000 7fa072276640 1 -- 172.21.15.77:0/2966394672 >> 172.21.15.77:0/2966394672 conn(0x7fa06c0c3f80 msgr2=0x7fa06c0c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:14.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.289+0000 7fa072276640 1 -- 172.21.15.77:0/2966394672 shutdown_connections 2024-04-25T01:44:14.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.289+0000 7fa072276640 1 -- 172.21.15.77:0/2966394672 wait complete. 2024-04-25T01:44:14.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.290+0000 7fa072276640 1 Processor -- start 2024-04-25T01:44:14.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.291+0000 7fa072276640 1 -- start start 2024-04-25T01:44:14.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.291+0000 7fa072276640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa054004d40 0x7fa06c0ac1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:14.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.291+0000 7fa072276640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa06c0c5070 0x7fa06c1e06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:14.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.291+0000 7fa072276640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa06c149640 0x7fa06c149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:14.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.291+0000 7fa072276640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c152d70 con 0x7fa054004d40 2024-04-25T01:44:14.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.291+0000 7fa072276640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c152bf0 con 0x7fa06c0c5070 2024-04-25T01:44:14.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.291+0000 7fa072276640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fa06c0c3100 con 0x7fa06c149640 2024-04-25T01:44:14.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.291+0000 7fa06bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa054004d40 0x7fa06c0ac1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:14.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.291+0000 7fa06bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa054004d40 0x7fa06c0ac1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43902/0 (socket says 172.21.15.77:43902) 2024-04-25T01:44:14.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.291+0000 7fa06bfff640 1 -- 172.21.15.77:0/3494758935 learned_addr learned my addr 172.21.15.77:0/3494758935 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:14.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.292+0000 7fa06b7fe640 1 --2- 172.21.15.77:0/3494758935 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa06c0c5070 0x7fa06c1e06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:14.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.292+0000 7fa070813640 1 --2- 172.21.15.77:0/3494758935 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa06c149640 0x7fa06c149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:14.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.292+0000 7fa06bfff640 1 -- 172.21.15.77:0/3494758935 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa06c149640 msgr2=0x7fa06c149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:14.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.292+0000 7fa06bfff640 1 --2- 172.21.15.77:0/3494758935 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa06c149640 0x7fa06c149ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:14.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.292+0000 7fa06bfff640 1 -- 172.21.15.77:0/3494758935 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa06c0c5070 msgr2=0x7fa06c1e06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:14.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.292+0000 7fa06bfff640 1 --2- 172.21.15.77:0/3494758935 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa06c0c5070 0x7fa06c1e06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:14.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.292+0000 7fa06bfff640 1 -- 172.21.15.77:0/3494758935 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa06c1ebb60 con 0x7fa054004d40 2024-04-25T01:44:14.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.292+0000 7fa06bfff640 1 --2- 172.21.15.77:0/3494758935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa054004d40 0x7fa06c0ac1c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa05c0072f0 tx=0x7fa05c0077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:14.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.292+0000 7fa068ff9640 1 -- 172.21.15.77:0/3494758935 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c01a070 con 0x7fa054004d40 2024-04-25T01:44:14.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.292+0000 7fa068ff9640 1 -- 172.21.15.77:0/3494758935 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa05c00f960 con 0x7fa054004d40 2024-04-25T01:44:14.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.292+0000 7fa072276640 1 -- 172.21.15.77:0/3494758935 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa06c1ebe40 con 0x7fa054004d40 2024-04-25T01:44:14.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.292+0000 7fa068ff9640 1 -- 172.21.15.77:0/3494758935 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c00fd50 con 0x7fa054004d40 2024-04-25T01:44:14.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.292+0000 7fa072276640 1 -- 172.21.15.77:0/3494758935 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa06c1ec400 con 0x7fa054004d40 2024-04-25T01:44:14.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.293+0000 7fa072276640 1 -- 172.21.15.77:0/3494758935 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa06c04f500 con 0x7fa054004d40 2024-04-25T01:44:14.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.293+0000 7fa068ff9640 1 -- 172.21.15.77:0/3494758935 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa05c01d070 con 0x7fa054004d40 2024-04-25T01:44:14.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.294+0000 7fa068ff9640 1 --2- 172.21.15.77:0/3494758935 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa05806be30 0x7fa05806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:14.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.294+0000 7fa068ff9640 1 -- 172.21.15.77:0/3494758935 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7fa05c08ad60 con 0x7fa054004d40 2024-04-25T01:44:14.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.294+0000 7fa06b7fe640 1 --2- 172.21.15.77:0/3494758935 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa05806be30 0x7fa05806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:14.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.294+0000 7fa06b7fe640 1 --2- 172.21.15.77:0/3494758935 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa05806be30 0x7fa05806e2f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa06c1520b0 tx=0x7fa060008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:14.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.299+0000 7fa068ff9640 1 -- 172.21.15.77:0/3494758935 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa05c059250 con 0x7fa054004d40 2024-04-25T01:44:14.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.514+0000 7fa072276640 1 -- 172.21.15.77:0/3494758935 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa06c0c1c60 con 0x7fa054004d40 2024-04-25T01:44:14.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.514+0000 7fa068ff9640 1 -- 172.21.15.77:0/3494758935 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+6485 (secure 0 0 0) 0x7fa05c058b50 con 0x7fa054004d40 2024-04-25T01:44:14.506 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:44:14.506 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1570919706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1570919706},{"type":"v1","addr":"172.21.15.77:6837","nonce":1570919706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:42:07.395274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5439":{"gid":5439,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5439,"qdb_cluster":[5439]},"id":1},{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:43:32.407370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":22,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5179,"qdb_cluster":[5179]},"id":2}]} 2024-04-25T01:44:14.506 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 33 2024-04-25T01:44:14.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.516+0000 7fa072276640 1 -- 172.21.15.77:0/3494758935 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa05806be30 msgr2=0x7fa05806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:14.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.516+0000 7fa072276640 1 --2- 172.21.15.77:0/3494758935 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa05806be30 0x7fa05806e2f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa06c1520b0 tx=0x7fa060008040 comp rx=0 tx=0).stop 2024-04-25T01:44:14.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.516+0000 7fa072276640 1 -- 172.21.15.77:0/3494758935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa054004d40 msgr2=0x7fa06c0ac1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:14.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.516+0000 7fa072276640 1 --2- 172.21.15.77:0/3494758935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa054004d40 0x7fa06c0ac1c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa05c0072f0 tx=0x7fa05c0077b0 comp rx=0 tx=0).stop 2024-04-25T01:44:14.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.516+0000 7fa072276640 1 -- 172.21.15.77:0/3494758935 shutdown_connections 2024-04-25T01:44:14.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.516+0000 7fa072276640 1 --2- 172.21.15.77:0/3494758935 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa05806be30 0x7fa05806e2f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:14.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.516+0000 7fa072276640 1 --2- 172.21.15.77:0/3494758935 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa06c149640 0x7fa06c149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:14.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.516+0000 7fa072276640 1 --2- 172.21.15.77:0/3494758935 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa06c0c5070 0x7fa06c1e06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:14.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.516+0000 7fa072276640 1 --2- 172.21.15.77:0/3494758935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa054004d40 0x7fa06c0ac1c0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:14.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.516+0000 7fa072276640 1 -- 172.21.15.77:0/3494758935 >> 172.21.15.77:0/3494758935 conn(0x7fa06c0c3f80 msgr2=0x7fa06c152280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:14.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.516+0000 7fa072276640 1 -- 172.21.15.77:0/3494758935 shutdown_connections 2024-04-25T01:44:14.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:14.516+0000 7fa072276640 1 -- 172.21.15.77:0/3494758935 wait complete. 2024-04-25T01:44:14.519 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T01:44:15.830 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T01:44:15.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.952+0000 7f7b9c2ca640 1 Processor -- start 2024-04-25T01:44:15.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.952+0000 7f7b9c2ca640 1 -- start start 2024-04-25T01:44:15.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.953+0000 7f7b9c2ca640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7b9414fdd0 0x7f7b9406da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:15.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.953+0000 7f7b9c2ca640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b940ad3a0 0x7f7b94155a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:15.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.953+0000 7f7b9c2ca640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b940c2cb0 con 0x7f7b9406df70 2024-04-25T01:44:15.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.953+0000 7f7b9c2ca640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f7b940c30e0 con 0x7f7b9414fdd0 2024-04-25T01:44:15.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.953+0000 7f7b9c2ca640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f7b94152f80 con 0x7f7b940ad3a0 2024-04-25T01:44:15.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.953+0000 7f7b9a066640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7b9414fdd0 0x7f7b9406da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:15.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.953+0000 7f7b9a066640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7b9414fdd0 0x7f7b9406da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43906/0 (socket says 172.21.15.77:43906) 2024-04-25T01:44:15.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.953+0000 7f7b9a066640 1 -- 172.21.15.77:0/1997478323 learned_addr learned my addr 172.21.15.77:0/1997478323 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:15.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.954+0000 7f7b9a066640 1 -- 172.21.15.77:0/1997478323 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b940ad3a0 msgr2=0x7f7b94155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:15.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.954+0000 7f7b9a066640 1 --2- 172.21.15.77:0/1997478323 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b940ad3a0 0x7f7b94155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:15.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.954+0000 7f7b9a066640 1 -- 172.21.15.77:0/1997478323 >> v1:172.21.15.121:6789/0 conn(0x7f7b9406df70 legacy=0x7f7b94155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:15.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.954+0000 7f7b9a066640 1 -- 172.21.15.77:0/1997478323 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b94153260 con 0x7f7b9414fdd0 2024-04-25T01:44:15.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.954+0000 7f7b9a066640 1 --2- 172.21.15.77:0/1997478323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b9414fdd0 0x7f7b9406da30 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7b940c3260 tx=0x7f7b9002a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b1cf1aee637451 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:15.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.954+0000 7f7b99064640 1 -- 172.21.15.77:0/1997478323 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b90037070 con 0x7f7b9414fdd0 2024-04-25T01:44:15.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.954+0000 7f7b99064640 1 -- 172.21.15.77:0/1997478323 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b90032440 con 0x7f7b9414fdd0 2024-04-25T01:44:15.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.954+0000 7f7b99064640 1 -- 172.21.15.77:0/1997478323 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b90032810 con 0x7f7b9414fdd0 2024-04-25T01:44:15.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.955+0000 7f7b9c2ca640 1 -- 172.21.15.77:0/1997478323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b9414fdd0 msgr2=0x7f7b9406da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:15.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.955+0000 7f7b9c2ca640 1 --2- 172.21.15.77:0/1997478323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b9414fdd0 0x7f7b9406da30 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7b940c3260 tx=0x7f7b9002a160 comp rx=0 tx=0).stop 2024-04-25T01:44:15.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.955+0000 7f7b9c2ca640 1 -- 172.21.15.77:0/1997478323 shutdown_connections 2024-04-25T01:44:15.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.955+0000 7f7b9c2ca640 1 --2- 172.21.15.77:0/1997478323 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b940ad3a0 0x7f7b94155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:15.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.955+0000 7f7b9c2ca640 1 --2- 172.21.15.77:0/1997478323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b9414fdd0 0x7f7b9406da30 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:15.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.955+0000 7f7b9c2ca640 1 -- 172.21.15.77:0/1997478323 >> 172.21.15.77:0/1997478323 conn(0x7f7b940c3f80 msgr2=0x7f7b940c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:15.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.955+0000 7f7b9c2ca640 1 -- 172.21.15.77:0/1997478323 shutdown_connections 2024-04-25T01:44:15.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.955+0000 7f7b9c2ca640 1 -- 172.21.15.77:0/1997478323 wait complete. 2024-04-25T01:44:15.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.956+0000 7f7b9c2ca640 1 Processor -- start 2024-04-25T01:44:15.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.956+0000 7f7b9c2ca640 1 -- start start 2024-04-25T01:44:15.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.957+0000 7f7b9c2ca640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b9406df70 0x7f7b94143870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:15.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.957+0000 7f7b9c2ca640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b940ad3a0 0x7f7b94147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:15.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.957+0000 7f7b9c2ca640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b9414fdd0 0x7f7b941475a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:15.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.957+0000 7f7b9c2ca640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7b940c28f0 con 0x7f7b940ad3a0 2024-04-25T01:44:15.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.957+0000 7f7b9c2ca640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7b941566b0 con 0x7f7b9414fdd0 2024-04-25T01:44:15.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.957+0000 7f7b9c2ca640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f7b940c2a70 con 0x7f7b9406df70 2024-04-25T01:44:15.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.957+0000 7f7b99865640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b940ad3a0 0x7f7b94147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:15.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.957+0000 7f7b99865640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b940ad3a0 0x7f7b94147060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43920/0 (socket says 172.21.15.77:43920) 2024-04-25T01:44:15.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.957+0000 7f7b99865640 1 -- 172.21.15.77:0/1157004916 learned_addr learned my addr 172.21.15.77:0/1157004916 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:15.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.957+0000 7f7b9a066640 1 --2- 172.21.15.77:0/1157004916 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b9406df70 0x7f7b94143870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:15.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.957+0000 7f7b9a867640 1 --2- 172.21.15.77:0/1157004916 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b9414fdd0 0x7f7b941475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:15.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.957+0000 7f7b99865640 1 -- 172.21.15.77:0/1157004916 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b9406df70 msgr2=0x7f7b94143870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:15.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.957+0000 7f7b99865640 1 --2- 172.21.15.77:0/1157004916 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b9406df70 0x7f7b94143870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:15.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.957+0000 7f7b99865640 1 -- 172.21.15.77:0/1157004916 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b9414fdd0 msgr2=0x7f7b941475a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:15.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.957+0000 7f7b99865640 1 --2- 172.21.15.77:0/1157004916 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b9414fdd0 0x7f7b941475a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:15.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.957+0000 7f7b99865640 1 -- 172.21.15.77:0/1157004916 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b941edce0 con 0x7f7b940ad3a0 2024-04-25T01:44:15.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.957+0000 7f7b99865640 1 --2- 172.21.15.77:0/1157004916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b940ad3a0 0x7f7b94147060 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f7b8400b4a0 tx=0x7f7b8400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:15.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.958+0000 7f7b8affd640 1 -- 172.21.15.77:0/1157004916 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b84014070 con 0x7f7b940ad3a0 2024-04-25T01:44:15.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.958+0000 7f7b8affd640 1 -- 172.21.15.77:0/1157004916 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b84010610 con 0x7f7b940ad3a0 2024-04-25T01:44:15.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.958+0000 7f7b8affd640 1 -- 172.21.15.77:0/1157004916 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b84010a00 con 0x7f7b940ad3a0 2024-04-25T01:44:15.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.958+0000 7f7b9c2ca640 1 -- 172.21.15.77:0/1157004916 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b940703f0 con 0x7f7b940ad3a0 2024-04-25T01:44:15.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.958+0000 7f7b9c2ca640 1 -- 172.21.15.77:0/1157004916 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b940a8e70 con 0x7f7b940ad3a0 2024-04-25T01:44:15.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.959+0000 7f7b9c2ca640 1 -- 172.21.15.77:0/1157004916 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b9404f500 con 0x7f7b940ad3a0 2024-04-25T01:44:15.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.959+0000 7f7b8affd640 1 -- 172.21.15.77:0/1157004916 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7b84017070 con 0x7f7b940ad3a0 2024-04-25T01:44:15.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.959+0000 7f7b8affd640 1 --2- 172.21.15.77:0/1157004916 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7b7806be30 0x7f7b7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:15.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.960+0000 7f7b8affd640 1 -- 172.21.15.77:0/1157004916 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7f7b8408ad20 con 0x7f7b940ad3a0 2024-04-25T01:44:15.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.960+0000 7f7b9a066640 1 --2- 172.21.15.77:0/1157004916 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7b7806be30 0x7f7b7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:15.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.960+0000 7f7b9a066640 1 --2- 172.21.15.77:0/1157004916 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7b7806be30 0x7f7b7806e2f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7b90034000 tx=0x7f7b9002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:15.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:15.964+0000 7f7b8affd640 1 -- 172.21.15.77:0/1157004916 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7b84058bc0 con 0x7f7b940ad3a0 2024-04-25T01:44:16.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.133+0000 7f7b9c2ca640 1 -- 172.21.15.77:0/1157004916 --> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7b941eda90 con 0x7f7b7806be30 2024-04-25T01:44:16.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.144+0000 7f7b8affd640 1 -- 172.21.15.77:0/1157004916 <== mgr.4098 v2:172.21.15.77:6832/4208232183 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+491548 (secure 0 0 0) 0x7f7b941eda90 con 0x7f7b7806be30 2024-04-25T01:44:16.141 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:44:16.144 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-25T01:44:16.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.148+0000 7f7b9c2ca640 1 -- 172.21.15.77:0/1157004916 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7b7806be30 msgr2=0x7f7b7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:16.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.148+0000 7f7b9c2ca640 1 --2- 172.21.15.77:0/1157004916 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7b7806be30 0x7f7b7806e2f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7b90034000 tx=0x7f7b9002e000 comp rx=0 tx=0).stop 2024-04-25T01:44:16.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.148+0000 7f7b9c2ca640 1 -- 172.21.15.77:0/1157004916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b940ad3a0 msgr2=0x7f7b94147060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:16.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.148+0000 7f7b9c2ca640 1 --2- 172.21.15.77:0/1157004916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b940ad3a0 0x7f7b94147060 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f7b8400b4a0 tx=0x7f7b8400b960 comp rx=0 tx=0).stop 2024-04-25T01:44:16.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.148+0000 7f7b9c2ca640 1 -- 172.21.15.77:0/1157004916 shutdown_connections 2024-04-25T01:44:16.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.148+0000 7f7b9c2ca640 1 --2- 172.21.15.77:0/1157004916 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f7b7806be30 0x7f7b7806e2f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:16.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.148+0000 7f7b9c2ca640 1 --2- 172.21.15.77:0/1157004916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b940ad3a0 0x7f7b94147060 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:16.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.148+0000 7f7b9c2ca640 1 --2- 172.21.15.77:0/1157004916 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b9414fdd0 0x7f7b941475a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:16.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.148+0000 7f7b9c2ca640 1 --2- 172.21.15.77:0/1157004916 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b9406df70 0x7f7b94143870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:16.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.148+0000 7f7b9c2ca640 1 -- 172.21.15.77:0/1157004916 >> 172.21.15.77:0/1157004916 conn(0x7f7b940c3f80 msgr2=0x7f7b9414e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:16.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.148+0000 7f7b9c2ca640 1 -- 172.21.15.77:0/1157004916 shutdown_connections 2024-04-25T01:44:16.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.148+0000 7f7b9c2ca640 1 -- 172.21.15.77:0/1157004916 wait complete. 2024-04-25T01:44:16.151 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":175,"stamp":"2024-04-25T01:44:15.731637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16553154,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":520,"num_read_kb":8330,"num_write":26453,"num_write_kb":50357090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31363,"ondisk_log_size":31363,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":535512,"kb_used_data":35032,"kb_used_omap":12,"kb_used_meta":500403,"kb_avail":754439208,"statfs":{"total":773094113280,"available":772545748992,"internally_reserved":0,"allocated":35872768,"data_stored":34242012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":512413232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003542"},"pg_stats":[{"pgid":"5.18","version":"30'210","reported_seq":244,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:11.353369+0000","last_change":"2024-04-25T01:44:11.353407+0000","last_active":"2024-04-25T01:44:11.353369+0000","last_peered":"2024-04-25T01:44:11.353369+0000","last_clean":"2024-04-25T01:44:11.353369+0000","last_became_active":"2024-04-25T01:39:33.445090+0000","last_became_peered":"2024-04-25T01:39:33.445090+0000","last_unstale":"2024-04-25T01:44:11.353369+0000","last_undegraded":"2024-04-25T01:44:11.353369+0000","last_fullsized":"2024-04-25T01:44:11.353369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'210","last_scrub_stamp":"2024-04-25T01:44:11.353224+0000","last_deep_scrub":"30'210","last_deep_scrub_stamp":"2024-04-25T01:44:11.353224+0000","last_clean_scrub_stamp":"2024-04-25T01:44:11.353224+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:39:17.808271+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"30'8","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:58.687445+0000","last_change":"2024-04-25T01:43:58.687483+0000","last_active":"2024-04-25T01:43:58.687445+0000","last_peered":"2024-04-25T01:43:58.687445+0000","last_clean":"2024-04-25T01:43:58.687445+0000","last_became_active":"2024-04-25T01:39:23.376811+0000","last_became_peered":"2024-04-25T01:39:23.376811+0000","last_unstale":"2024-04-25T01:43:58.687445+0000","last_undegraded":"2024-04-25T01:43:58.687445+0000","last_fullsized":"2024-04-25T01:43:58.687445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'8","last_scrub_stamp":"2024-04-25T01:43:58.687362+0000","last_deep_scrub":"30'8","last_deep_scrub_stamp":"2024-04-25T01:43:58.687362+0000","last_clean_scrub_stamp":"2024-04-25T01:43:58.687362+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:35:31.058038+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"30'181","reported_seq":224,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:03.399097+0000","last_change":"2024-04-25T01:44:03.399154+0000","last_active":"2024-04-25T01:44:03.399097+0000","last_peered":"2024-04-25T01:44:03.399097+0000","last_clean":"2024-04-25T01:44:03.399097+0000","last_became_active":"2024-04-25T01:39:24.394032+0000","last_became_peered":"2024-04-25T01:39:24.394032+0000","last_unstale":"2024-04-25T01:44:03.399097+0000","last_undegraded":"2024-04-25T01:44:03.399097+0000","last_fullsized":"2024-04-25T01:44:03.399097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'181","last_scrub_stamp":"2024-04-25T01:44:03.399000+0000","last_deep_scrub":"30'181","last_deep_scrub_stamp":"2024-04-25T01:44:03.399000+0000","last_clean_scrub_stamp":"2024-04-25T01:44:03.399000+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:05:22.587995+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:57.371524+0000","last_change":"2024-04-25T01:43:57.371546+0000","last_active":"2024-04-25T01:43:57.371524+0000","last_peered":"2024-04-25T01:43:57.371524+0000","last_clean":"2024-04-25T01:43:57.371524+0000","last_became_active":"2024-04-25T01:39:32.421355+0000","last_became_peered":"2024-04-25T01:39:32.421355+0000","last_unstale":"2024-04-25T01:43:57.371524+0000","last_undegraded":"2024-04-25T01:43:57.371524+0000","last_fullsized":"2024-04-25T01:43:57.371524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:43:57.371446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:43:57.371446+0000","last_clean_scrub_stamp":"2024-04-25T01:43:57.371446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:28:23.826204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"30'203","reported_seq":229,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.768833+0000","last_change":"2024-04-25T01:39:33.436651+0000","last_active":"2024-04-25T01:43:34.768833+0000","last_peered":"2024-04-25T01:43:34.768833+0000","last_clean":"2024-04-25T01:43:34.768833+0000","last_became_active":"2024-04-25T01:39:33.436370+0000","last_became_peered":"2024-04-25T01:39:33.436370+0000","last_unstale":"2024-04-25T01:43:34.768833+0000","last_undegraded":"2024-04-25T01:43:34.768833+0000","last_fullsized":"2024-04-25T01:43:34.768833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"29'3","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:08.482394+0000","last_change":"2024-04-25T01:44:08.482454+0000","last_active":"2024-04-25T01:44:08.482394+0000","last_peered":"2024-04-25T01:44:08.482394+0000","last_clean":"2024-04-25T01:44:08.482394+0000","last_became_active":"2024-04-25T01:39:23.368726+0000","last_became_peered":"2024-04-25T01:39:23.368726+0000","last_unstale":"2024-04-25T01:44:08.482394+0000","last_undegraded":"2024-04-25T01:44:08.482394+0000","last_fullsized":"2024-04-25T01:44:08.482394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-04-25T01:44:08.482300+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-04-25T01:44:08.482300+0000","last_clean_scrub_stamp":"2024-04-25T01:44:08.482300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:55.967256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"30'177","reported_seq":220,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:53.661767+0000","last_change":"2024-04-25T01:43:53.661788+0000","last_active":"2024-04-25T01:43:53.661767+0000","last_peered":"2024-04-25T01:43:53.661767+0000","last_clean":"2024-04-25T01:43:53.661767+0000","last_became_active":"2024-04-25T01:39:24.403623+0000","last_became_peered":"2024-04-25T01:39:24.403623+0000","last_unstale":"2024-04-25T01:43:53.661767+0000","last_undegraded":"2024-04-25T01:43:53.661767+0000","last_fullsized":"2024-04-25T01:43:53.661767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'177","last_scrub_stamp":"2024-04-25T01:43:53.661689+0000","last_deep_scrub":"30'177","last_deep_scrub_stamp":"2024-04-25T01:43:53.661689+0000","last_clean_scrub_stamp":"2024-04-25T01:43:53.661689+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:45.558385+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:54.301241+0000","last_change":"2024-04-25T01:43:54.301276+0000","last_active":"2024-04-25T01:43:54.301241+0000","last_peered":"2024-04-25T01:43:54.301241+0000","last_clean":"2024-04-25T01:43:54.301241+0000","last_became_active":"2024-04-25T01:39:32.430617+0000","last_became_peered":"2024-04-25T01:39:32.430617+0000","last_unstale":"2024-04-25T01:43:54.301241+0000","last_undegraded":"2024-04-25T01:43:54.301241+0000","last_fullsized":"2024-04-25T01:43:54.301241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:43:54.301128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:43:54.301128+0000","last_clean_scrub_stamp":"2024-04-25T01:43:54.301128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:29.315864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"30'163","reported_seq":189,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.732582+0000","last_change":"2024-04-25T01:39:33.444043+0000","last_active":"2024-04-25T01:43:34.732582+0000","last_peered":"2024-04-25T01:43:34.732582+0000","last_clean":"2024-04-25T01:43:34.732582+0000","last_became_active":"2024-04-25T01:39:33.443737+0000","last_became_peered":"2024-04-25T01:39:33.443737+0000","last_unstale":"2024-04-25T01:43:34.732582+0000","last_undegraded":"2024-04-25T01:43:34.732582+0000","last_fullsized":"2024-04-25T01:43:34.732582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"30'5","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:10.535708+0000","last_change":"2024-04-25T01:44:10.535737+0000","last_active":"2024-04-25T01:44:10.535708+0000","last_peered":"2024-04-25T01:44:10.535708+0000","last_clean":"2024-04-25T01:44:10.535708+0000","last_became_active":"2024-04-25T01:39:23.377402+0000","last_became_peered":"2024-04-25T01:39:23.377402+0000","last_unstale":"2024-04-25T01:44:10.535708+0000","last_undegraded":"2024-04-25T01:44:10.535708+0000","last_fullsized":"2024-04-25T01:44:10.535708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2024-04-25T01:44:10.535621+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2024-04-25T01:44:10.535621+0000","last_clean_scrub_stamp":"2024-04-25T01:44:10.535621+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:39.984702+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"30'160","reported_seq":202,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:58.821221+0000","last_change":"2024-04-25T01:43:58.821243+0000","last_active":"2024-04-25T01:43:58.821221+0000","last_peered":"2024-04-25T01:43:58.821221+0000","last_clean":"2024-04-25T01:43:58.821221+0000","last_became_active":"2024-04-25T01:39:24.393954+0000","last_became_peered":"2024-04-25T01:39:24.393954+0000","last_unstale":"2024-04-25T01:43:58.821221+0000","last_undegraded":"2024-04-25T01:43:58.821221+0000","last_fullsized":"2024-04-25T01:43:58.821221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'160","last_scrub_stamp":"2024-04-25T01:43:58.821132+0000","last_deep_scrub":"30'160","last_deep_scrub_stamp":"2024-04-25T01:43:58.821132+0000","last_clean_scrub_stamp":"2024-04-25T01:43:58.821132+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:26.916069+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1807","reported_seq":1845,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:58.225217+0000","last_change":"2024-04-25T01:43:58.225246+0000","last_active":"2024-04-25T01:43:58.225217+0000","last_peered":"2024-04-25T01:43:58.225217+0000","last_clean":"2024-04-25T01:43:58.225217+0000","last_became_active":"2024-04-25T01:39:32.427955+0000","last_became_peered":"2024-04-25T01:39:32.427955+0000","last_unstale":"2024-04-25T01:43:58.225217+0000","last_undegraded":"2024-04-25T01:43:58.225217+0000","last_fullsized":"2024-04-25T01:43:58.225217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1807","last_scrub_stamp":"2024-04-25T01:43:58.225124+0000","last_deep_scrub":"30'1807","last_deep_scrub_stamp":"2024-04-25T01:43:58.225124+0000","last_clean_scrub_stamp":"2024-04-25T01:43:58.225124+0000","objects_scrubbed":1,"log_size":1807,"log_dups_size":0,"ondisk_log_size":1807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:10.777088+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3765045,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":3663,"num_write":1803,"num_write_kb":5411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"30'173","reported_seq":199,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.752778+0000","last_change":"2024-04-25T01:39:33.439854+0000","last_active":"2024-04-25T01:43:34.752778+0000","last_peered":"2024-04-25T01:43:34.752778+0000","last_clean":"2024-04-25T01:43:34.752778+0000","last_became_active":"2024-04-25T01:39:33.439555+0000","last_became_peered":"2024-04-25T01:39:33.439555+0000","last_unstale":"2024-04-25T01:43:34.752778+0000","last_undegraded":"2024-04-25T01:43:34.752778+0000","last_fullsized":"2024-04-25T01:43:34.752778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"30'3","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:08.568089+0000","last_change":"2024-04-25T01:44:08.568119+0000","last_active":"2024-04-25T01:44:08.568089+0000","last_peered":"2024-04-25T01:44:08.568089+0000","last_clean":"2024-04-25T01:44:08.568089+0000","last_became_active":"2024-04-25T01:39:23.376744+0000","last_became_peered":"2024-04-25T01:39:23.376744+0000","last_unstale":"2024-04-25T01:44:08.568089+0000","last_undegraded":"2024-04-25T01:44:08.568089+0000","last_fullsized":"2024-04-25T01:44:08.568089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-04-25T01:44:08.568004+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-04-25T01:44:08.568004+0000","last_clean_scrub_stamp":"2024-04-25T01:44:08.568004+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:03:46.791296+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"30'198","reported_seq":240,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:02.904514+0000","last_change":"2024-04-25T01:44:02.904563+0000","last_active":"2024-04-25T01:44:02.904514+0000","last_peered":"2024-04-25T01:44:02.904514+0000","last_clean":"2024-04-25T01:44:02.904514+0000","last_became_active":"2024-04-25T01:39:24.393005+0000","last_became_peered":"2024-04-25T01:39:24.393005+0000","last_unstale":"2024-04-25T01:44:02.904514+0000","last_undegraded":"2024-04-25T01:44:02.904514+0000","last_fullsized":"2024-04-25T01:44:02.904514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'198","last_scrub_stamp":"2024-04-25T01:44:02.904410+0000","last_deep_scrub":"30'198","last_deep_scrub_stamp":"2024-04-25T01:44:02.904410+0000","last_clean_scrub_stamp":"2024-04-25T01:44:02.904410+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:06.356118+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'4","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:56.214686+0000","last_change":"2024-04-25T01:43:56.214713+0000","last_active":"2024-04-25T01:43:56.214686+0000","last_peered":"2024-04-25T01:43:56.214686+0000","last_clean":"2024-04-25T01:43:56.214686+0000","last_became_active":"2024-04-25T01:39:32.428705+0000","last_became_peered":"2024-04-25T01:39:32.428705+0000","last_unstale":"2024-04-25T01:43:56.214686+0000","last_undegraded":"2024-04-25T01:43:56.214686+0000","last_fullsized":"2024-04-25T01:43:56.214686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-04-25T01:43:56.214583+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-04-25T01:43:56.214583+0000","last_clean_scrub_stamp":"2024-04-25T01:43:56.214583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:30.220750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"30'179","reported_seq":206,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:52.889745+0000","last_change":"2024-04-25T01:39:33.446571+0000","last_active":"2024-04-25T01:43:52.889745+0000","last_peered":"2024-04-25T01:43:52.889745+0000","last_clean":"2024-04-25T01:43:52.889745+0000","last_became_active":"2024-04-25T01:39:33.446234+0000","last_became_peered":"2024-04-25T01:39:33.446234+0000","last_unstale":"2024-04-25T01:43:52.889745+0000","last_undegraded":"2024-04-25T01:43:52.889745+0000","last_fullsized":"2024-04-25T01:43:52.889745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"30'156","reported_seq":199,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:56.065854+0000","last_change":"2024-04-25T01:43:56.065883+0000","last_active":"2024-04-25T01:43:56.065854+0000","last_peered":"2024-04-25T01:43:56.065854+0000","last_clean":"2024-04-25T01:43:56.065854+0000","last_became_active":"2024-04-25T01:39:24.398618+0000","last_became_peered":"2024-04-25T01:39:24.398618+0000","last_unstale":"2024-04-25T01:43:56.065854+0000","last_undegraded":"2024-04-25T01:43:56.065854+0000","last_fullsized":"2024-04-25T01:43:56.065854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'156","last_scrub_stamp":"2024-04-25T01:43:56.065744+0000","last_deep_scrub":"30'156","last_deep_scrub_stamp":"2024-04-25T01:43:56.065744+0000","last_clean_scrub_stamp":"2024-04-25T01:43:56.065744+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:31:50.550389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"30'6","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:09.559328+0000","last_change":"2024-04-25T01:44:09.559372+0000","last_active":"2024-04-25T01:44:09.559328+0000","last_peered":"2024-04-25T01:44:09.559328+0000","last_clean":"2024-04-25T01:44:09.559328+0000","last_became_active":"2024-04-25T01:39:23.377291+0000","last_became_peered":"2024-04-25T01:39:23.377291+0000","last_unstale":"2024-04-25T01:44:09.559328+0000","last_undegraded":"2024-04-25T01:44:09.559328+0000","last_fullsized":"2024-04-25T01:44:09.559328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'6","last_scrub_stamp":"2024-04-25T01:44:09.559244+0000","last_deep_scrub":"30'6","last_deep_scrub_stamp":"2024-04-25T01:44:09.559244+0000","last_clean_scrub_stamp":"2024-04-25T01:44:09.559244+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:15:44.580771+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"30'2","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:07.338749+0000","last_change":"2024-04-25T01:44:07.338776+0000","last_active":"2024-04-25T01:44:07.338749+0000","last_peered":"2024-04-25T01:44:07.338749+0000","last_clean":"2024-04-25T01:44:07.338749+0000","last_became_active":"2024-04-25T01:39:32.426529+0000","last_became_peered":"2024-04-25T01:39:32.426529+0000","last_unstale":"2024-04-25T01:44:07.338749+0000","last_undegraded":"2024-04-25T01:44:07.338749+0000","last_fullsized":"2024-04-25T01:44:07.338749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-25T01:44:07.338650+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-25T01:44:07.338650+0000","last_clean_scrub_stamp":"2024-04-25T01:44:07.338650+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:00:47.715989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"30'193","reported_seq":228,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:01.330827+0000","last_change":"2024-04-25T01:44:01.330827+0000","last_active":"2024-04-25T01:44:01.330827+0000","last_peered":"2024-04-25T01:44:01.330827+0000","last_clean":"2024-04-25T01:44:01.330827+0000","last_became_active":"2024-04-25T01:39:33.437483+0000","last_became_peered":"2024-04-25T01:39:33.437483+0000","last_unstale":"2024-04-25T01:44:01.330827+0000","last_undegraded":"2024-04-25T01:44:01.330827+0000","last_fullsized":"2024-04-25T01:44:01.330827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'193","last_scrub_stamp":"2024-04-25T01:44:01.330683+0000","last_deep_scrub":"30'193","last_deep_scrub_stamp":"2024-04-25T01:44:01.330683+0000","last_clean_scrub_stamp":"2024-04-25T01:44:01.330683+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:30:19.509062+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"30'164","reported_seq":207,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:12.395818+0000","last_change":"2024-04-25T01:44:12.395862+0000","last_active":"2024-04-25T01:44:12.395818+0000","last_peered":"2024-04-25T01:44:12.395818+0000","last_clean":"2024-04-25T01:44:12.395818+0000","last_became_active":"2024-04-25T01:39:24.386782+0000","last_became_peered":"2024-04-25T01:39:24.386782+0000","last_unstale":"2024-04-25T01:44:12.395818+0000","last_undegraded":"2024-04-25T01:44:12.395818+0000","last_fullsized":"2024-04-25T01:44:12.395818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'164","last_scrub_stamp":"2024-04-25T01:44:12.395734+0000","last_deep_scrub":"30'164","last_deep_scrub_stamp":"2024-04-25T01:44:12.395734+0000","last_clean_scrub_stamp":"2024-04-25T01:44:12.395734+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:19:45.931220+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:02.172393+0000","last_change":"2024-04-25T01:44:02.172418+0000","last_active":"2024-04-25T01:44:02.172393+0000","last_peered":"2024-04-25T01:44:02.172393+0000","last_clean":"2024-04-25T01:44:02.172393+0000","last_became_active":"2024-04-25T01:39:23.368183+0000","last_became_peered":"2024-04-25T01:39:23.368183+0000","last_unstale":"2024-04-25T01:44:02.172393+0000","last_undegraded":"2024-04-25T01:44:02.172393+0000","last_fullsized":"2024-04-25T01:44:02.172393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:02.172292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:02.172292+0000","last_clean_scrub_stamp":"2024-04-25T01:44:02.172292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:07.144202+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:00.188960+0000","last_change":"2024-04-25T01:44:00.188960+0000","last_active":"2024-04-25T01:44:00.188960+0000","last_peered":"2024-04-25T01:44:00.188960+0000","last_clean":"2024-04-25T01:44:00.188960+0000","last_became_active":"2024-04-25T01:39:32.427328+0000","last_became_peered":"2024-04-25T01:39:32.427328+0000","last_unstale":"2024-04-25T01:44:00.188960+0000","last_undegraded":"2024-04-25T01:44:00.188960+0000","last_fullsized":"2024-04-25T01:44:00.188960+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:00.188846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:00.188846+0000","last_clean_scrub_stamp":"2024-04-25T01:44:00.188846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:10.545008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"30'191","reported_seq":218,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:54.187740+0000","last_change":"2024-04-25T01:39:33.447634+0000","last_active":"2024-04-25T01:43:54.187740+0000","last_peered":"2024-04-25T01:43:54.187740+0000","last_clean":"2024-04-25T01:43:54.187740+0000","last_became_active":"2024-04-25T01:39:33.445908+0000","last_became_peered":"2024-04-25T01:39:33.445908+0000","last_unstale":"2024-04-25T01:43:54.187740+0000","last_undegraded":"2024-04-25T01:43:54.187740+0000","last_fullsized":"2024-04-25T01:43:54.187740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"30'170","reported_seq":213,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:11.433270+0000","last_change":"2024-04-25T01:44:11.433295+0000","last_active":"2024-04-25T01:44:11.433270+0000","last_peered":"2024-04-25T01:44:11.433270+0000","last_clean":"2024-04-25T01:44:11.433270+0000","last_became_active":"2024-04-25T01:39:24.373311+0000","last_became_peered":"2024-04-25T01:39:24.373311+0000","last_unstale":"2024-04-25T01:44:11.433270+0000","last_undegraded":"2024-04-25T01:44:11.433270+0000","last_fullsized":"2024-04-25T01:44:11.433270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'170","last_scrub_stamp":"2024-04-25T01:44:11.433175+0000","last_deep_scrub":"30'170","last_deep_scrub_stamp":"2024-04-25T01:44:11.433175+0000","last_clean_scrub_stamp":"2024-04-25T01:44:11.433175+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:30:56.163864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:06.119022+0000","last_change":"2024-04-25T01:44:06.119051+0000","last_active":"2024-04-25T01:44:06.119022+0000","last_peered":"2024-04-25T01:44:06.119022+0000","last_clean":"2024-04-25T01:44:06.119022+0000","last_became_active":"2024-04-25T01:39:23.376826+0000","last_became_peered":"2024-04-25T01:39:23.376826+0000","last_unstale":"2024-04-25T01:44:06.119022+0000","last_undegraded":"2024-04-25T01:44:06.119022+0000","last_fullsized":"2024-04-25T01:44:06.119022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:06.118901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:06.118901+0000","last_clean_scrub_stamp":"2024-04-25T01:44:06.118901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:47:21.293873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"30'2","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:53.128417+0000","last_change":"2024-04-25T01:43:53.128417+0000","last_active":"2024-04-25T01:43:53.128417+0000","last_peered":"2024-04-25T01:43:53.128417+0000","last_clean":"2024-04-25T01:43:53.128417+0000","last_became_active":"2024-04-25T01:39:32.426545+0000","last_became_peered":"2024-04-25T01:39:32.426545+0000","last_unstale":"2024-04-25T01:43:53.128417+0000","last_undegraded":"2024-04-25T01:43:53.128417+0000","last_fullsized":"2024-04-25T01:43:53.128417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-25T01:43:53.128323+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-25T01:43:53.128323+0000","last_clean_scrub_stamp":"2024-04-25T01:43:53.128323+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:50.651934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"30'171","reported_seq":198,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:54.622870+0000","last_change":"2024-04-25T01:39:33.444616+0000","last_active":"2024-04-25T01:43:54.622870+0000","last_peered":"2024-04-25T01:43:54.622870+0000","last_clean":"2024-04-25T01:43:54.622870+0000","last_became_active":"2024-04-25T01:39:33.444350+0000","last_became_peered":"2024-04-25T01:39:33.444350+0000","last_unstale":"2024-04-25T01:43:54.622870+0000","last_undegraded":"2024-04-25T01:43:54.622870+0000","last_fullsized":"2024-04-25T01:43:54.622870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"30'147","reported_seq":190,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:02.223414+0000","last_change":"2024-04-25T01:44:02.223440+0000","last_active":"2024-04-25T01:44:02.223414+0000","last_peered":"2024-04-25T01:44:02.223414+0000","last_clean":"2024-04-25T01:44:02.223414+0000","last_became_active":"2024-04-25T01:39:24.386376+0000","last_became_peered":"2024-04-25T01:39:24.386376+0000","last_unstale":"2024-04-25T01:44:02.223414+0000","last_undegraded":"2024-04-25T01:44:02.223414+0000","last_fullsized":"2024-04-25T01:44:02.223414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'147","last_scrub_stamp":"2024-04-25T01:44:02.223318+0000","last_deep_scrub":"30'147","last_deep_scrub_stamp":"2024-04-25T01:44:02.223318+0000","last_clean_scrub_stamp":"2024-04-25T01:44:02.223318+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:45.420819+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:12.522975+0000","last_change":"2024-04-25T01:44:12.523014+0000","last_active":"2024-04-25T01:44:12.522975+0000","last_peered":"2024-04-25T01:44:12.522975+0000","last_clean":"2024-04-25T01:44:12.522975+0000","last_became_active":"2024-04-25T01:39:23.376908+0000","last_became_peered":"2024-04-25T01:39:23.376908+0000","last_unstale":"2024-04-25T01:44:12.522975+0000","last_undegraded":"2024-04-25T01:44:12.522975+0000","last_fullsized":"2024-04-25T01:44:12.522975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:12.522856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:12.522856+0000","last_clean_scrub_stamp":"2024-04-25T01:44:12.522856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:01:12.415523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"30'3","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:59.219645+0000","last_change":"2024-04-25T01:43:59.219645+0000","last_active":"2024-04-25T01:43:59.219645+0000","last_peered":"2024-04-25T01:43:59.219645+0000","last_clean":"2024-04-25T01:43:59.219645+0000","last_became_active":"2024-04-25T01:39:32.433307+0000","last_became_peered":"2024-04-25T01:39:32.433307+0000","last_unstale":"2024-04-25T01:43:59.219645+0000","last_undegraded":"2024-04-25T01:43:59.219645+0000","last_fullsized":"2024-04-25T01:43:59.219645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-04-25T01:43:59.219529+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-04-25T01:43:59.219529+0000","last_clean_scrub_stamp":"2024-04-25T01:43:59.219529+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:19.904283+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"30'175","reported_seq":202,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:37.497497+0000","last_change":"2024-04-25T01:39:33.427297+0000","last_active":"2024-04-25T01:43:37.497497+0000","last_peered":"2024-04-25T01:43:37.497497+0000","last_clean":"2024-04-25T01:43:37.497497+0000","last_became_active":"2024-04-25T01:39:33.426132+0000","last_became_peered":"2024-04-25T01:39:33.426132+0000","last_unstale":"2024-04-25T01:43:37.497497+0000","last_undegraded":"2024-04-25T01:43:37.497497+0000","last_fullsized":"2024-04-25T01:43:37.497497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"30'175","reported_seq":218,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:54.702517+0000","last_change":"2024-04-25T01:43:54.702539+0000","last_active":"2024-04-25T01:43:54.702517+0000","last_peered":"2024-04-25T01:43:54.702517+0000","last_clean":"2024-04-25T01:43:54.702517+0000","last_became_active":"2024-04-25T01:39:24.392209+0000","last_became_peered":"2024-04-25T01:39:24.392209+0000","last_unstale":"2024-04-25T01:43:54.702517+0000","last_undegraded":"2024-04-25T01:43:54.702517+0000","last_fullsized":"2024-04-25T01:43:54.702517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'175","last_scrub_stamp":"2024-04-25T01:43:54.702424+0000","last_deep_scrub":"30'175","last_deep_scrub_stamp":"2024-04-25T01:43:54.702424+0000","last_clean_scrub_stamp":"2024-04-25T01:43:54.702424+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:38.297342+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"30'4","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:03.061857+0000","last_change":"2024-04-25T01:44:03.061894+0000","last_active":"2024-04-25T01:44:03.061857+0000","last_peered":"2024-04-25T01:44:03.061857+0000","last_clean":"2024-04-25T01:44:03.061857+0000","last_became_active":"2024-04-25T01:39:23.379430+0000","last_became_peered":"2024-04-25T01:39:23.379430+0000","last_unstale":"2024-04-25T01:44:03.061857+0000","last_undegraded":"2024-04-25T01:44:03.061857+0000","last_fullsized":"2024-04-25T01:44:03.061857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-04-25T01:44:03.061757+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-04-25T01:44:03.061757+0000","last_clean_scrub_stamp":"2024-04-25T01:44:03.061757+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:43:17.753693+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"30'6","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:57.251343+0000","last_change":"2024-04-25T01:43:57.251398+0000","last_active":"2024-04-25T01:43:57.251343+0000","last_peered":"2024-04-25T01:43:57.251343+0000","last_clean":"2024-04-25T01:43:57.251343+0000","last_became_active":"2024-04-25T01:39:32.432482+0000","last_became_peered":"2024-04-25T01:39:32.432482+0000","last_unstale":"2024-04-25T01:43:57.251343+0000","last_undegraded":"2024-04-25T01:43:57.251343+0000","last_fullsized":"2024-04-25T01:43:57.251343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'6","last_scrub_stamp":"2024-04-25T01:43:57.251234+0000","last_deep_scrub":"30'6","last_deep_scrub_stamp":"2024-04-25T01:43:57.251234+0000","last_clean_scrub_stamp":"2024-04-25T01:43:57.251234+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:37.814148+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"30'176","reported_seq":211,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:12.305632+0000","last_change":"2024-04-25T01:44:12.305660+0000","last_active":"2024-04-25T01:44:12.305632+0000","last_peered":"2024-04-25T01:44:12.305632+0000","last_clean":"2024-04-25T01:44:12.305632+0000","last_became_active":"2024-04-25T01:39:33.445500+0000","last_became_peered":"2024-04-25T01:39:33.445500+0000","last_unstale":"2024-04-25T01:44:12.305632+0000","last_undegraded":"2024-04-25T01:44:12.305632+0000","last_fullsized":"2024-04-25T01:44:12.305632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'176","last_scrub_stamp":"2024-04-25T01:44:12.305536+0000","last_deep_scrub":"30'176","last_deep_scrub_stamp":"2024-04-25T01:44:12.305536+0000","last_clean_scrub_stamp":"2024-04-25T01:44:12.305536+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:45:32.666791+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"30'154","reported_seq":182,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:08.347529+0000","last_change":"2024-04-25T01:44:08.347554+0000","last_active":"2024-04-25T01:44:08.347529+0000","last_peered":"2024-04-25T01:44:08.347529+0000","last_clean":"2024-04-25T01:44:08.347529+0000","last_became_active":"2024-04-25T01:40:06.055084+0000","last_became_peered":"2024-04-25T01:40:06.055084+0000","last_unstale":"2024-04-25T01:44:08.347529+0000","last_undegraded":"2024-04-25T01:44:08.347529+0000","last_fullsized":"2024-04-25T01:44:08.347529+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'154","last_scrub_stamp":"2024-04-25T01:44:08.347432+0000","last_deep_scrub":"30'154","last_deep_scrub_stamp":"2024-04-25T01:44:08.347432+0000","last_clean_scrub_stamp":"2024-04-25T01:44:08.347432+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:33:57.921914+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"30'30","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:07.087927+0000","last_change":"2024-04-25T01:44:07.087951+0000","last_active":"2024-04-25T01:44:07.087927+0000","last_peered":"2024-04-25T01:44:07.087927+0000","last_clean":"2024-04-25T01:44:07.087927+0000","last_became_active":"2024-04-25T01:39:23.377372+0000","last_became_peered":"2024-04-25T01:39:23.377372+0000","last_unstale":"2024-04-25T01:44:07.087927+0000","last_undegraded":"2024-04-25T01:44:07.087927+0000","last_fullsized":"2024-04-25T01:44:07.087927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2024-04-25T01:44:07.087835+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2024-04-25T01:44:07.087835+0000","last_clean_scrub_stamp":"2024-04-25T01:44:07.087835+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:48.046197+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":56,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:00.347617+0000","last_change":"2024-04-25T01:44:00.347642+0000","last_active":"2024-04-25T01:44:00.347617+0000","last_peered":"2024-04-25T01:44:00.347617+0000","last_clean":"2024-04-25T01:44:00.347617+0000","last_became_active":"2024-04-25T01:39:32.430537+0000","last_became_peered":"2024-04-25T01:39:32.430537+0000","last_unstale":"2024-04-25T01:44:00.347617+0000","last_undegraded":"2024-04-25T01:44:00.347617+0000","last_fullsized":"2024-04-25T01:44:00.347617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:00.347528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:00.347528+0000","last_clean_scrub_stamp":"2024-04-25T01:44:00.347528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:51.248028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"30'198","reported_seq":233,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:10.157700+0000","last_change":"2024-04-25T01:44:10.157724+0000","last_active":"2024-04-25T01:44:10.157700+0000","last_peered":"2024-04-25T01:44:10.157700+0000","last_clean":"2024-04-25T01:44:10.157700+0000","last_became_active":"2024-04-25T01:39:33.439796+0000","last_became_peered":"2024-04-25T01:39:33.439796+0000","last_unstale":"2024-04-25T01:44:10.157700+0000","last_undegraded":"2024-04-25T01:44:10.157700+0000","last_fullsized":"2024-04-25T01:44:10.157700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'198","last_scrub_stamp":"2024-04-25T01:44:10.157611+0000","last_deep_scrub":"30'198","last_deep_scrub_stamp":"2024-04-25T01:44:10.157611+0000","last_clean_scrub_stamp":"2024-04-25T01:44:10.157611+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:56.960529+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"30'173","reported_seq":216,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:59.162886+0000","last_change":"2024-04-25T01:43:59.162916+0000","last_active":"2024-04-25T01:43:59.162886+0000","last_peered":"2024-04-25T01:43:59.162886+0000","last_clean":"2024-04-25T01:43:59.162886+0000","last_became_active":"2024-04-25T01:39:24.376612+0000","last_became_peered":"2024-04-25T01:39:24.376612+0000","last_unstale":"2024-04-25T01:43:59.162886+0000","last_undegraded":"2024-04-25T01:43:59.162886+0000","last_fullsized":"2024-04-25T01:43:59.162886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'173","last_scrub_stamp":"2024-04-25T01:43:59.162791+0000","last_deep_scrub":"30'173","last_deep_scrub_stamp":"2024-04-25T01:43:59.162791+0000","last_clean_scrub_stamp":"2024-04-25T01:43:59.162791+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:43:45.418758+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:11.525730+0000","last_change":"2024-04-25T01:44:11.525754+0000","last_active":"2024-04-25T01:44:11.525730+0000","last_peered":"2024-04-25T01:44:11.525730+0000","last_clean":"2024-04-25T01:44:11.525730+0000","last_became_active":"2024-04-25T01:39:23.377677+0000","last_became_peered":"2024-04-25T01:39:23.377677+0000","last_unstale":"2024-04-25T01:44:11.525730+0000","last_undegraded":"2024-04-25T01:44:11.525730+0000","last_fullsized":"2024-04-25T01:44:11.525730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:11.525634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:11.525634+0000","last_clean_scrub_stamp":"2024-04-25T01:44:11.525634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:26:18.204766+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:08.637808+0000","last_change":"2024-04-25T01:44:08.637834+0000","last_active":"2024-04-25T01:44:08.637808+0000","last_peered":"2024-04-25T01:44:08.637808+0000","last_clean":"2024-04-25T01:44:08.637808+0000","last_became_active":"2024-04-25T01:39:32.431253+0000","last_became_peered":"2024-04-25T01:39:32.431253+0000","last_unstale":"2024-04-25T01:44:08.637808+0000","last_undegraded":"2024-04-25T01:44:08.637808+0000","last_fullsized":"2024-04-25T01:44:08.637808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:08.637697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:08.637697+0000","last_clean_scrub_stamp":"2024-04-25T01:44:08.637697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:19:33.197071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"30'188","reported_seq":215,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:47.048163+0000","last_change":"2024-04-25T01:39:33.448529+0000","last_active":"2024-04-25T01:43:47.048163+0000","last_peered":"2024-04-25T01:43:47.048163+0000","last_clean":"2024-04-25T01:43:47.048163+0000","last_became_active":"2024-04-25T01:39:33.448266+0000","last_became_peered":"2024-04-25T01:39:33.448266+0000","last_unstale":"2024-04-25T01:43:47.048163+0000","last_undegraded":"2024-04-25T01:43:47.048163+0000","last_fullsized":"2024-04-25T01:43:47.048163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"30'155","reported_seq":190,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.899127+0000","last_change":"2024-04-25T01:39:24.390844+0000","last_active":"2024-04-25T01:43:46.899127+0000","last_peered":"2024-04-25T01:43:46.899127+0000","last_clean":"2024-04-25T01:43:46.899127+0000","last_became_active":"2024-04-25T01:39:24.390543+0000","last_became_peered":"2024-04-25T01:39:24.390543+0000","last_unstale":"2024-04-25T01:43:46.899127+0000","last_undegraded":"2024-04-25T01:43:46.899127+0000","last_fullsized":"2024-04-25T01:43:46.899127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:03.133501+0000","last_change":"2024-04-25T01:44:03.133528+0000","last_active":"2024-04-25T01:44:03.133501+0000","last_peered":"2024-04-25T01:44:03.133501+0000","last_clean":"2024-04-25T01:44:03.133501+0000","last_became_active":"2024-04-25T01:39:23.368272+0000","last_became_peered":"2024-04-25T01:39:23.368272+0000","last_unstale":"2024-04-25T01:44:03.133501+0000","last_undegraded":"2024-04-25T01:44:03.133501+0000","last_fullsized":"2024-04-25T01:44:03.133501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:03.133399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:03.133399+0000","last_clean_scrub_stamp":"2024-04-25T01:44:03.133399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:23:35.400104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:56.240998+0000","last_change":"2024-04-25T01:43:56.241017+0000","last_active":"2024-04-25T01:43:56.240998+0000","last_peered":"2024-04-25T01:43:56.240998+0000","last_clean":"2024-04-25T01:43:56.240998+0000","last_became_active":"2024-04-25T01:39:32.429759+0000","last_became_peered":"2024-04-25T01:39:32.429759+0000","last_unstale":"2024-04-25T01:43:56.240998+0000","last_undegraded":"2024-04-25T01:43:56.240998+0000","last_fullsized":"2024-04-25T01:43:56.240998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:43:56.240924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:43:56.240924+0000","last_clean_scrub_stamp":"2024-04-25T01:43:56.240924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:44:18.514419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"30'171","reported_seq":206,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:10.631093+0000","last_change":"2024-04-25T01:44:10.631120+0000","last_active":"2024-04-25T01:44:10.631093+0000","last_peered":"2024-04-25T01:44:10.631093+0000","last_clean":"2024-04-25T01:44:10.631093+0000","last_became_active":"2024-04-25T01:39:33.439344+0000","last_became_peered":"2024-04-25T01:39:33.439344+0000","last_unstale":"2024-04-25T01:44:10.631093+0000","last_undegraded":"2024-04-25T01:44:10.631093+0000","last_fullsized":"2024-04-25T01:44:10.631093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'171","last_scrub_stamp":"2024-04-25T01:44:10.630984+0000","last_deep_scrub":"30'171","last_deep_scrub_stamp":"2024-04-25T01:44:10.630984+0000","last_clean_scrub_stamp":"2024-04-25T01:44:10.630984+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:21:25.115508+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"30'179","reported_seq":222,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:04.260385+0000","last_change":"2024-04-25T01:44:04.260412+0000","last_active":"2024-04-25T01:44:04.260385+0000","last_peered":"2024-04-25T01:44:04.260385+0000","last_clean":"2024-04-25T01:44:04.260385+0000","last_became_active":"2024-04-25T01:39:24.388306+0000","last_became_peered":"2024-04-25T01:39:24.388306+0000","last_unstale":"2024-04-25T01:44:04.260385+0000","last_undegraded":"2024-04-25T01:44:04.260385+0000","last_fullsized":"2024-04-25T01:44:04.260385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'179","last_scrub_stamp":"2024-04-25T01:44:04.260286+0000","last_deep_scrub":"30'179","last_deep_scrub_stamp":"2024-04-25T01:44:04.260286+0000","last_clean_scrub_stamp":"2024-04-25T01:44:04.260286+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:01.991890+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:10.994316+0000","last_change":"2024-04-25T01:44:10.994347+0000","last_active":"2024-04-25T01:44:10.994316+0000","last_peered":"2024-04-25T01:44:10.994316+0000","last_clean":"2024-04-25T01:44:10.994316+0000","last_became_active":"2024-04-25T01:39:23.375488+0000","last_became_peered":"2024-04-25T01:39:23.375488+0000","last_unstale":"2024-04-25T01:44:10.994316+0000","last_undegraded":"2024-04-25T01:44:10.994316+0000","last_fullsized":"2024-04-25T01:44:10.994316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:10.994197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:10.994197+0000","last_clean_scrub_stamp":"2024-04-25T01:44:10.994197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:19.799758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:54.166980+0000","last_change":"2024-04-25T01:43:54.166999+0000","last_active":"2024-04-25T01:43:54.166980+0000","last_peered":"2024-04-25T01:43:54.166980+0000","last_clean":"2024-04-25T01:43:54.166980+0000","last_became_active":"2024-04-25T01:39:32.427282+0000","last_became_peered":"2024-04-25T01:39:32.427282+0000","last_unstale":"2024-04-25T01:43:54.166980+0000","last_undegraded":"2024-04-25T01:43:54.166980+0000","last_fullsized":"2024-04-25T01:43:54.166980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:43:54.166904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:43:54.166904+0000","last_clean_scrub_stamp":"2024-04-25T01:43:54.166904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:10:18.605814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'200","reported_seq":235,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:53.375588+0000","last_change":"2024-04-25T01:43:53.375588+0000","last_active":"2024-04-25T01:43:53.375588+0000","last_peered":"2024-04-25T01:43:53.375588+0000","last_clean":"2024-04-25T01:43:53.375588+0000","last_became_active":"2024-04-25T01:39:33.438669+0000","last_became_peered":"2024-04-25T01:39:33.438669+0000","last_unstale":"2024-04-25T01:43:53.375588+0000","last_undegraded":"2024-04-25T01:43:53.375588+0000","last_fullsized":"2024-04-25T01:43:53.375588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'200","last_scrub_stamp":"2024-04-25T01:43:53.375449+0000","last_deep_scrub":"30'200","last_deep_scrub_stamp":"2024-04-25T01:43:53.375449+0000","last_clean_scrub_stamp":"2024-04-25T01:43:53.375449+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:27.541110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"30'162","reported_seq":205,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:01.155838+0000","last_change":"2024-04-25T01:44:01.155895+0000","last_active":"2024-04-25T01:44:01.155838+0000","last_peered":"2024-04-25T01:44:01.155838+0000","last_clean":"2024-04-25T01:44:01.155838+0000","last_became_active":"2024-04-25T01:39:24.377146+0000","last_became_peered":"2024-04-25T01:39:24.377146+0000","last_unstale":"2024-04-25T01:44:01.155838+0000","last_undegraded":"2024-04-25T01:44:01.155838+0000","last_fullsized":"2024-04-25T01:44:01.155838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'162","last_scrub_stamp":"2024-04-25T01:44:01.155728+0000","last_deep_scrub":"30'162","last_deep_scrub_stamp":"2024-04-25T01:44:01.155728+0000","last_clean_scrub_stamp":"2024-04-25T01:44:01.155728+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:57.937960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":327680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"30'5","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:56.353686+0000","last_change":"2024-04-25T01:43:56.353734+0000","last_active":"2024-04-25T01:43:56.353686+0000","last_peered":"2024-04-25T01:43:56.353686+0000","last_clean":"2024-04-25T01:43:56.353686+0000","last_became_active":"2024-04-25T01:39:23.370727+0000","last_became_peered":"2024-04-25T01:39:23.370727+0000","last_unstale":"2024-04-25T01:43:56.353686+0000","last_undegraded":"2024-04-25T01:43:56.353686+0000","last_fullsized":"2024-04-25T01:43:56.353686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2024-04-25T01:43:56.353596+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2024-04-25T01:43:56.353596+0000","last_clean_scrub_stamp":"2024-04-25T01:43:56.353596+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:05.975660+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'4","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:58.185970+0000","last_change":"2024-04-25T01:43:58.186020+0000","last_active":"2024-04-25T01:43:58.185970+0000","last_peered":"2024-04-25T01:43:58.185970+0000","last_clean":"2024-04-25T01:43:58.185970+0000","last_became_active":"2024-04-25T01:39:32.431335+0000","last_became_peered":"2024-04-25T01:39:32.431335+0000","last_unstale":"2024-04-25T01:43:58.185970+0000","last_undegraded":"2024-04-25T01:43:58.185970+0000","last_fullsized":"2024-04-25T01:43:58.185970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-04-25T01:43:58.185855+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-04-25T01:43:58.185855+0000","last_clean_scrub_stamp":"2024-04-25T01:43:58.185855+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:22:27.829213+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"30'173","reported_seq":200,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:54.622941+0000","last_change":"2024-04-25T01:39:33.438896+0000","last_active":"2024-04-25T01:43:54.622941+0000","last_peered":"2024-04-25T01:43:54.622941+0000","last_clean":"2024-04-25T01:43:54.622941+0000","last_became_active":"2024-04-25T01:39:33.438622+0000","last_became_peered":"2024-04-25T01:39:33.438622+0000","last_unstale":"2024-04-25T01:43:54.622941+0000","last_undegraded":"2024-04-25T01:43:54.622941+0000","last_fullsized":"2024-04-25T01:43:54.622941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"30'157","reported_seq":200,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:56.686949+0000","last_change":"2024-04-25T01:43:56.686976+0000","last_active":"2024-04-25T01:43:56.686949+0000","last_peered":"2024-04-25T01:43:56.686949+0000","last_clean":"2024-04-25T01:43:56.686949+0000","last_became_active":"2024-04-25T01:39:24.391093+0000","last_became_peered":"2024-04-25T01:39:24.391093+0000","last_unstale":"2024-04-25T01:43:56.686949+0000","last_undegraded":"2024-04-25T01:43:56.686949+0000","last_fullsized":"2024-04-25T01:43:56.686949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'157","last_scrub_stamp":"2024-04-25T01:43:56.686857+0000","last_deep_scrub":"30'157","last_deep_scrub_stamp":"2024-04-25T01:43:56.686857+0000","last_clean_scrub_stamp":"2024-04-25T01:43:56.686857+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:14:11.754552+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":311296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:29.397558+0000","last_change":"2024-04-25T01:39:23.379767+0000","last_active":"2024-04-25T01:43:29.397558+0000","last_peered":"2024-04-25T01:43:29.397558+0000","last_clean":"2024-04-25T01:43:29.397558+0000","last_became_active":"2024-04-25T01:39:23.379294+0000","last_became_peered":"2024-04-25T01:39:23.379294+0000","last_unstale":"2024-04-25T01:43:29.397558+0000","last_undegraded":"2024-04-25T01:43:29.397558+0000","last_fullsized":"2024-04-25T01:43:29.397558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:22.345120+0000","last_clean_scrub_stamp":"2024-04-25T01:39:22.345120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"30'26","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:06.708280+0000","last_change":"2024-04-25T01:44:06.708309+0000","last_active":"2024-04-25T01:44:06.708280+0000","last_peered":"2024-04-25T01:44:06.708280+0000","last_clean":"2024-04-25T01:44:06.708280+0000","last_became_active":"2024-04-25T01:39:32.429189+0000","last_became_peered":"2024-04-25T01:39:32.429189+0000","last_unstale":"2024-04-25T01:44:06.708280+0000","last_undegraded":"2024-04-25T01:44:06.708280+0000","last_fullsized":"2024-04-25T01:44:06.708280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2024-04-25T01:44:06.708188+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2024-04-25T01:44:06.708188+0000","last_clean_scrub_stamp":"2024-04-25T01:44:06.708188+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:21:48.375302+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":46,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"30'171","reported_seq":198,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:47.765406+0000","last_change":"2024-04-25T01:39:33.438945+0000","last_active":"2024-04-25T01:43:47.765406+0000","last_peered":"2024-04-25T01:43:47.765406+0000","last_clean":"2024-04-25T01:43:47.765406+0000","last_became_active":"2024-04-25T01:39:33.438233+0000","last_became_peered":"2024-04-25T01:39:33.438233+0000","last_unstale":"2024-04-25T01:43:47.765406+0000","last_undegraded":"2024-04-25T01:43:47.765406+0000","last_fullsized":"2024-04-25T01:43:47.765406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"30'209","reported_seq":252,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:01.375599+0000","last_change":"2024-04-25T01:44:01.375626+0000","last_active":"2024-04-25T01:44:01.375599+0000","last_peered":"2024-04-25T01:44:01.375599+0000","last_clean":"2024-04-25T01:44:01.375599+0000","last_became_active":"2024-04-25T01:39:24.400502+0000","last_became_peered":"2024-04-25T01:39:24.400502+0000","last_unstale":"2024-04-25T01:44:01.375599+0000","last_undegraded":"2024-04-25T01:44:01.375599+0000","last_fullsized":"2024-04-25T01:44:01.375599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'209","last_scrub_stamp":"2024-04-25T01:44:01.375511+0000","last_deep_scrub":"30'209","last_deep_scrub_stamp":"2024-04-25T01:44:01.375511+0000","last_clean_scrub_stamp":"2024-04-25T01:44:01.375511+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:24.077492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:07.924151+0000","last_change":"2024-04-25T01:44:07.924175+0000","last_active":"2024-04-25T01:44:07.924151+0000","last_peered":"2024-04-25T01:44:07.924151+0000","last_clean":"2024-04-25T01:44:07.924151+0000","last_became_active":"2024-04-25T01:39:23.367520+0000","last_became_peered":"2024-04-25T01:39:23.367520+0000","last_unstale":"2024-04-25T01:44:07.924151+0000","last_undegraded":"2024-04-25T01:44:07.924151+0000","last_fullsized":"2024-04-25T01:44:07.924151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:07.924007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:07.924007+0000","last_clean_scrub_stamp":"2024-04-25T01:44:07.924007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:59:46.869223+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"30'119","reported_seq":203,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:07.545530+0000","last_change":"2024-04-25T01:44:07.545564+0000","last_active":"2024-04-25T01:44:07.545530+0000","last_peered":"2024-04-25T01:44:07.545530+0000","last_clean":"2024-04-25T01:44:07.545530+0000","last_became_active":"2024-04-25T01:39:12.917330+0000","last_became_peered":"2024-04-25T01:39:12.917330+0000","last_unstale":"2024-04-25T01:44:07.545530+0000","last_undegraded":"2024-04-25T01:44:07.545530+0000","last_fullsized":"2024-04-25T01:44:07.545530+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'119","last_scrub_stamp":"2024-04-25T01:44:07.545447+0000","last_deep_scrub":"30'119","last_deep_scrub_stamp":"2024-04-25T01:44:07.545447+0000","last_clean_scrub_stamp":"2024-04-25T01:44:07.545447+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:31.695486+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:07.194720+0000","last_change":"2024-04-25T01:44:07.194746+0000","last_active":"2024-04-25T01:44:07.194720+0000","last_peered":"2024-04-25T01:44:07.194720+0000","last_clean":"2024-04-25T01:44:07.194720+0000","last_became_active":"2024-04-25T01:39:32.431523+0000","last_became_peered":"2024-04-25T01:39:32.431523+0000","last_unstale":"2024-04-25T01:44:07.194720+0000","last_undegraded":"2024-04-25T01:44:07.194720+0000","last_fullsized":"2024-04-25T01:44:07.194720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:07.194627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:07.194627+0000","last_clean_scrub_stamp":"2024-04-25T01:44:07.194627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:00.008348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"30'174","reported_seq":209,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:03.304185+0000","last_change":"2024-04-25T01:44:03.304185+0000","last_active":"2024-04-25T01:44:03.304185+0000","last_peered":"2024-04-25T01:44:03.304185+0000","last_clean":"2024-04-25T01:44:03.304185+0000","last_became_active":"2024-04-25T01:39:33.440161+0000","last_became_peered":"2024-04-25T01:39:33.440161+0000","last_unstale":"2024-04-25T01:44:03.304185+0000","last_undegraded":"2024-04-25T01:44:03.304185+0000","last_fullsized":"2024-04-25T01:44:03.304185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'174","last_scrub_stamp":"2024-04-25T01:44:03.304058+0000","last_deep_scrub":"30'174","last_deep_scrub_stamp":"2024-04-25T01:44:03.304058+0000","last_clean_scrub_stamp":"2024-04-25T01:44:03.304058+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:08.092883+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"30'168","reported_seq":211,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:57.550975+0000","last_change":"2024-04-25T01:43:57.550975+0000","last_active":"2024-04-25T01:43:57.550975+0000","last_peered":"2024-04-25T01:43:57.550975+0000","last_clean":"2024-04-25T01:43:57.550975+0000","last_became_active":"2024-04-25T01:39:24.393235+0000","last_became_peered":"2024-04-25T01:39:24.393235+0000","last_unstale":"2024-04-25T01:43:57.550975+0000","last_undegraded":"2024-04-25T01:43:57.550975+0000","last_fullsized":"2024-04-25T01:43:57.550975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'168","last_scrub_stamp":"2024-04-25T01:43:57.550852+0000","last_deep_scrub":"30'168","last_deep_scrub_stamp":"2024-04-25T01:43:57.550852+0000","last_clean_scrub_stamp":"2024-04-25T01:43:57.550852+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:02.191209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:54.383599+0000","last_change":"2024-04-25T01:43:54.383599+0000","last_active":"2024-04-25T01:43:54.383599+0000","last_peered":"2024-04-25T01:43:54.383599+0000","last_clean":"2024-04-25T01:43:54.383599+0000","last_became_active":"2024-04-25T01:39:23.368075+0000","last_became_peered":"2024-04-25T01:39:23.368075+0000","last_unstale":"2024-04-25T01:43:54.383599+0000","last_undegraded":"2024-04-25T01:43:54.383599+0000","last_fullsized":"2024-04-25T01:43:54.383599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:43:54.383506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:43:54.383506+0000","last_clean_scrub_stamp":"2024-04-25T01:43:54.383506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:08.180243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:57.045831+0000","last_change":"2024-04-25T01:43:57.045856+0000","last_active":"2024-04-25T01:43:57.045831+0000","last_peered":"2024-04-25T01:43:57.045831+0000","last_clean":"2024-04-25T01:43:57.045831+0000","last_became_active":"2024-04-25T01:39:32.429721+0000","last_became_peered":"2024-04-25T01:39:32.429721+0000","last_unstale":"2024-04-25T01:43:57.045831+0000","last_undegraded":"2024-04-25T01:43:57.045831+0000","last_fullsized":"2024-04-25T01:43:57.045831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:43:57.045731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:43:57.045731+0000","last_clean_scrub_stamp":"2024-04-25T01:43:57.045731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:01:51.411381+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"30'171","reported_seq":206,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:06.339556+0000","last_change":"2024-04-25T01:44:06.339582+0000","last_active":"2024-04-25T01:44:06.339556+0000","last_peered":"2024-04-25T01:44:06.339556+0000","last_clean":"2024-04-25T01:44:06.339556+0000","last_became_active":"2024-04-25T01:39:33.446930+0000","last_became_peered":"2024-04-25T01:39:33.446930+0000","last_unstale":"2024-04-25T01:44:06.339556+0000","last_undegraded":"2024-04-25T01:44:06.339556+0000","last_fullsized":"2024-04-25T01:44:06.339556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'171","last_scrub_stamp":"2024-04-25T01:44:06.339465+0000","last_deep_scrub":"30'171","last_deep_scrub_stamp":"2024-04-25T01:44:06.339465+0000","last_clean_scrub_stamp":"2024-04-25T01:44:06.339465+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:58.352814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'173","reported_seq":216,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:00.852137+0000","last_change":"2024-04-25T01:44:00.852164+0000","last_active":"2024-04-25T01:44:00.852137+0000","last_peered":"2024-04-25T01:44:00.852137+0000","last_clean":"2024-04-25T01:44:00.852137+0000","last_became_active":"2024-04-25T01:39:24.393558+0000","last_became_peered":"2024-04-25T01:39:24.393558+0000","last_unstale":"2024-04-25T01:44:00.852137+0000","last_undegraded":"2024-04-25T01:44:00.852137+0000","last_fullsized":"2024-04-25T01:44:00.852137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'173","last_scrub_stamp":"2024-04-25T01:44:00.852044+0000","last_deep_scrub":"30'173","last_deep_scrub_stamp":"2024-04-25T01:44:00.852044+0000","last_clean_scrub_stamp":"2024-04-25T01:44:00.852044+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:45.745510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"30'2","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:05.130494+0000","last_change":"2024-04-25T01:44:05.130522+0000","last_active":"2024-04-25T01:44:05.130494+0000","last_peered":"2024-04-25T01:44:05.130494+0000","last_clean":"2024-04-25T01:44:05.130494+0000","last_became_active":"2024-04-25T01:39:23.370391+0000","last_became_peered":"2024-04-25T01:39:23.370391+0000","last_unstale":"2024-04-25T01:44:05.130494+0000","last_undegraded":"2024-04-25T01:44:05.130494+0000","last_fullsized":"2024-04-25T01:44:05.130494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-25T01:44:05.130409+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-25T01:44:05.130409+0000","last_clean_scrub_stamp":"2024-04-25T01:44:05.130409+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:23.578532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"30'7","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:05.684934+0000","last_change":"2024-04-25T01:44:05.684934+0000","last_active":"2024-04-25T01:44:05.684934+0000","last_peered":"2024-04-25T01:44:05.684934+0000","last_clean":"2024-04-25T01:44:05.684934+0000","last_became_active":"2024-04-25T01:39:32.429143+0000","last_became_peered":"2024-04-25T01:39:32.429143+0000","last_unstale":"2024-04-25T01:44:05.684934+0000","last_undegraded":"2024-04-25T01:44:05.684934+0000","last_fullsized":"2024-04-25T01:44:05.684934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'7","last_scrub_stamp":"2024-04-25T01:44:05.684809+0000","last_deep_scrub":"30'7","last_deep_scrub_stamp":"2024-04-25T01:44:05.684809+0000","last_clean_scrub_stamp":"2024-04-25T01:44:05.684809+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:02:36.499386+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"30'173","reported_seq":200,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:55.489778+0000","last_change":"2024-04-25T01:39:33.437128+0000","last_active":"2024-04-25T01:43:55.489778+0000","last_peered":"2024-04-25T01:43:55.489778+0000","last_clean":"2024-04-25T01:43:55.489778+0000","last_became_active":"2024-04-25T01:39:33.436861+0000","last_became_peered":"2024-04-25T01:39:33.436861+0000","last_unstale":"2024-04-25T01:43:55.489778+0000","last_undegraded":"2024-04-25T01:43:55.489778+0000","last_fullsized":"2024-04-25T01:43:55.489778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"30'168","reported_seq":211,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:56.533497+0000","last_change":"2024-04-25T01:43:56.533497+0000","last_active":"2024-04-25T01:43:56.533497+0000","last_peered":"2024-04-25T01:43:56.533497+0000","last_clean":"2024-04-25T01:43:56.533497+0000","last_became_active":"2024-04-25T01:39:24.391811+0000","last_became_peered":"2024-04-25T01:39:24.391811+0000","last_unstale":"2024-04-25T01:43:56.533497+0000","last_undegraded":"2024-04-25T01:43:56.533497+0000","last_fullsized":"2024-04-25T01:43:56.533497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'168","last_scrub_stamp":"2024-04-25T01:43:56.533310+0000","last_deep_scrub":"30'168","last_deep_scrub_stamp":"2024-04-25T01:43:56.533310+0000","last_clean_scrub_stamp":"2024-04-25T01:43:56.533310+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:58:32.136707+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"30'3","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:55.354601+0000","last_change":"2024-04-25T01:43:55.354601+0000","last_active":"2024-04-25T01:43:55.354601+0000","last_peered":"2024-04-25T01:43:55.354601+0000","last_clean":"2024-04-25T01:43:55.354601+0000","last_became_active":"2024-04-25T01:39:23.369314+0000","last_became_peered":"2024-04-25T01:39:23.369314+0000","last_unstale":"2024-04-25T01:43:55.354601+0000","last_undegraded":"2024-04-25T01:43:55.354601+0000","last_fullsized":"2024-04-25T01:43:55.354601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-04-25T01:43:55.354499+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-04-25T01:43:55.354499+0000","last_clean_scrub_stamp":"2024-04-25T01:43:55.354499+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:19:30.954704+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:59.804430+0000","last_change":"2024-04-25T01:43:59.804457+0000","last_active":"2024-04-25T01:43:59.804430+0000","last_peered":"2024-04-25T01:43:59.804430+0000","last_clean":"2024-04-25T01:43:59.804430+0000","last_became_active":"2024-04-25T01:39:32.429358+0000","last_became_peered":"2024-04-25T01:39:32.429358+0000","last_unstale":"2024-04-25T01:43:59.804430+0000","last_undegraded":"2024-04-25T01:43:59.804430+0000","last_fullsized":"2024-04-25T01:43:59.804430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:43:59.804317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:43:59.804317+0000","last_clean_scrub_stamp":"2024-04-25T01:43:59.804317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:38:59.974939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"30'178","reported_seq":213,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:02.346830+0000","last_change":"2024-04-25T01:44:02.346857+0000","last_active":"2024-04-25T01:44:02.346830+0000","last_peered":"2024-04-25T01:44:02.346830+0000","last_clean":"2024-04-25T01:44:02.346830+0000","last_became_active":"2024-04-25T01:39:33.440054+0000","last_became_peered":"2024-04-25T01:39:33.440054+0000","last_unstale":"2024-04-25T01:44:02.346830+0000","last_undegraded":"2024-04-25T01:44:02.346830+0000","last_fullsized":"2024-04-25T01:44:02.346830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'178","last_scrub_stamp":"2024-04-25T01:44:02.346739+0000","last_deep_scrub":"30'178","last_deep_scrub_stamp":"2024-04-25T01:44:02.346739+0000","last_clean_scrub_stamp":"2024-04-25T01:44:02.346739+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:34:24.517647+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"30'179","reported_seq":207,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:07.348236+0000","last_change":"2024-04-25T01:44:07.348277+0000","last_active":"2024-04-25T01:44:07.348236+0000","last_peered":"2024-04-25T01:44:07.348236+0000","last_clean":"2024-04-25T01:44:07.348236+0000","last_became_active":"2024-04-25T01:40:05.826076+0000","last_became_peered":"2024-04-25T01:40:05.826076+0000","last_unstale":"2024-04-25T01:44:07.348236+0000","last_undegraded":"2024-04-25T01:44:07.348236+0000","last_fullsized":"2024-04-25T01:44:07.348236+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'179","last_scrub_stamp":"2024-04-25T01:44:07.348122+0000","last_deep_scrub":"30'179","last_deep_scrub_stamp":"2024-04-25T01:44:07.348122+0000","last_clean_scrub_stamp":"2024-04-25T01:44:07.348122+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:03:44.164106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"30'2","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:01.227539+0000","last_change":"2024-04-25T01:44:01.227568+0000","last_active":"2024-04-25T01:44:01.227539+0000","last_peered":"2024-04-25T01:44:01.227539+0000","last_clean":"2024-04-25T01:44:01.227539+0000","last_became_active":"2024-04-25T01:39:23.367054+0000","last_became_peered":"2024-04-25T01:39:23.367054+0000","last_unstale":"2024-04-25T01:44:01.227539+0000","last_undegraded":"2024-04-25T01:44:01.227539+0000","last_fullsized":"2024-04-25T01:44:01.227539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-25T01:44:01.227397+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-25T01:44:01.227397+0000","last_clean_scrub_stamp":"2024-04-25T01:44:01.227397+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:47:07.714385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:08.327209+0000","last_change":"2024-04-25T01:44:08.327233+0000","last_active":"2024-04-25T01:44:08.327209+0000","last_peered":"2024-04-25T01:44:08.327209+0000","last_clean":"2024-04-25T01:44:08.327209+0000","last_became_active":"2024-04-25T01:39:32.426599+0000","last_became_peered":"2024-04-25T01:39:32.426599+0000","last_unstale":"2024-04-25T01:44:08.327209+0000","last_undegraded":"2024-04-25T01:44:08.327209+0000","last_fullsized":"2024-04-25T01:44:08.327209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:08.327123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:08.327123+0000","last_clean_scrub_stamp":"2024-04-25T01:44:08.327123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:18.813118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"30'164","reported_seq":190,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.756135+0000","last_change":"2024-04-25T01:39:33.428909+0000","last_active":"2024-04-25T01:43:34.756135+0000","last_peered":"2024-04-25T01:43:34.756135+0000","last_clean":"2024-04-25T01:43:34.756135+0000","last_became_active":"2024-04-25T01:39:33.428626+0000","last_became_peered":"2024-04-25T01:39:33.428626+0000","last_unstale":"2024-04-25T01:43:34.756135+0000","last_undegraded":"2024-04-25T01:43:34.756135+0000","last_fullsized":"2024-04-25T01:43:34.756135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'204","reported_seq":247,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:00.546628+0000","last_change":"2024-04-25T01:44:00.546628+0000","last_active":"2024-04-25T01:44:00.546628+0000","last_peered":"2024-04-25T01:44:00.546628+0000","last_clean":"2024-04-25T01:44:00.546628+0000","last_became_active":"2024-04-25T01:39:24.389656+0000","last_became_peered":"2024-04-25T01:39:24.389656+0000","last_unstale":"2024-04-25T01:44:00.546628+0000","last_undegraded":"2024-04-25T01:44:00.546628+0000","last_fullsized":"2024-04-25T01:44:00.546628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'204","last_scrub_stamp":"2024-04-25T01:44:00.546502+0000","last_deep_scrub":"30'204","last_deep_scrub_stamp":"2024-04-25T01:44:00.546502+0000","last_clean_scrub_stamp":"2024-04-25T01:44:00.546502+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:48:45.295003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"30'13","reported_seq":74,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:57.363201+0000","last_change":"2024-04-25T01:43:57.363201+0000","last_active":"2024-04-25T01:43:57.363201+0000","last_peered":"2024-04-25T01:43:57.363201+0000","last_clean":"2024-04-25T01:43:57.363201+0000","last_became_active":"2024-04-25T01:39:23.373281+0000","last_became_peered":"2024-04-25T01:39:23.373281+0000","last_unstale":"2024-04-25T01:43:57.363201+0000","last_undegraded":"2024-04-25T01:43:57.363201+0000","last_fullsized":"2024-04-25T01:43:57.363201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'13","last_scrub_stamp":"2024-04-25T01:43:57.363030+0000","last_deep_scrub":"30'13","last_deep_scrub_stamp":"2024-04-25T01:43:57.363030+0000","last_clean_scrub_stamp":"2024-04-25T01:43:57.363030+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:18:13.563068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:55.665365+0000","last_change":"2024-04-25T01:43:55.665384+0000","last_active":"2024-04-25T01:43:55.665365+0000","last_peered":"2024-04-25T01:43:55.665365+0000","last_clean":"2024-04-25T01:43:55.665365+0000","last_became_active":"2024-04-25T01:39:32.426499+0000","last_became_peered":"2024-04-25T01:39:32.426499+0000","last_unstale":"2024-04-25T01:43:55.665365+0000","last_undegraded":"2024-04-25T01:43:55.665365+0000","last_fullsized":"2024-04-25T01:43:55.665365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:43:55.665292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:43:55.665292+0000","last_clean_scrub_stamp":"2024-04-25T01:43:55.665292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:51.887061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"30'274","reported_seq":308,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:05.919931+0000","last_change":"2024-04-25T01:44:05.919958+0000","last_active":"2024-04-25T01:44:05.919931+0000","last_peered":"2024-04-25T01:44:05.919931+0000","last_clean":"2024-04-25T01:44:05.919931+0000","last_became_active":"2024-04-25T01:39:33.436001+0000","last_became_peered":"2024-04-25T01:39:33.436001+0000","last_unstale":"2024-04-25T01:44:05.919931+0000","last_undegraded":"2024-04-25T01:44:05.919931+0000","last_fullsized":"2024-04-25T01:44:05.919931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'274","last_scrub_stamp":"2024-04-25T01:44:05.919836+0000","last_deep_scrub":"30'274","last_deep_scrub_stamp":"2024-04-25T01:44:05.919836+0000","last_clean_scrub_stamp":"2024-04-25T01:44:05.919836+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:45:27.349965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"30'176","reported_seq":219,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:04.065381+0000","last_change":"2024-04-25T01:44:04.065381+0000","last_active":"2024-04-25T01:44:04.065381+0000","last_peered":"2024-04-25T01:44:04.065381+0000","last_clean":"2024-04-25T01:44:04.065381+0000","last_became_active":"2024-04-25T01:39:24.393958+0000","last_became_peered":"2024-04-25T01:39:24.393958+0000","last_unstale":"2024-04-25T01:44:04.065381+0000","last_undegraded":"2024-04-25T01:44:04.065381+0000","last_fullsized":"2024-04-25T01:44:04.065381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'176","last_scrub_stamp":"2024-04-25T01:44:04.065247+0000","last_deep_scrub":"30'176","last_deep_scrub_stamp":"2024-04-25T01:44:04.065247+0000","last_clean_scrub_stamp":"2024-04-25T01:44:04.065247+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:21:39.552629+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:59.033698+0000","last_change":"2024-04-25T01:43:59.033698+0000","last_active":"2024-04-25T01:43:59.033698+0000","last_peered":"2024-04-25T01:43:59.033698+0000","last_clean":"2024-04-25T01:43:59.033698+0000","last_became_active":"2024-04-25T01:39:23.372648+0000","last_became_peered":"2024-04-25T01:39:23.372648+0000","last_unstale":"2024-04-25T01:43:59.033698+0000","last_undegraded":"2024-04-25T01:43:59.033698+0000","last_fullsized":"2024-04-25T01:43:59.033698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:43:59.033534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:43:59.033534+0000","last_clean_scrub_stamp":"2024-04-25T01:43:59.033534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:35.286645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'1","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:02.380458+0000","last_change":"2024-04-25T01:44:02.380489+0000","last_active":"2024-04-25T01:44:02.380458+0000","last_peered":"2024-04-25T01:44:02.380458+0000","last_clean":"2024-04-25T01:44:02.380458+0000","last_became_active":"2024-04-25T01:39:32.431938+0000","last_became_peered":"2024-04-25T01:39:32.431938+0000","last_unstale":"2024-04-25T01:44:02.380458+0000","last_undegraded":"2024-04-25T01:44:02.380458+0000","last_fullsized":"2024-04-25T01:44:02.380458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2024-04-25T01:44:02.380371+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2024-04-25T01:44:02.380371+0000","last_clean_scrub_stamp":"2024-04-25T01:44:02.380371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:39:05.869163+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"30'185","reported_seq":211,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.762936+0000","last_change":"2024-04-25T01:39:33.441342+0000","last_active":"2024-04-25T01:43:34.762936+0000","last_peered":"2024-04-25T01:43:34.762936+0000","last_clean":"2024-04-25T01:43:34.762936+0000","last_became_active":"2024-04-25T01:39:33.441074+0000","last_became_peered":"2024-04-25T01:39:33.441074+0000","last_unstale":"2024-04-25T01:43:34.762936+0000","last_undegraded":"2024-04-25T01:43:34.762936+0000","last_fullsized":"2024-04-25T01:43:34.762936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'214","reported_seq":257,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:58.581234+0000","last_change":"2024-04-25T01:43:58.581234+0000","last_active":"2024-04-25T01:43:58.581234+0000","last_peered":"2024-04-25T01:43:58.581234+0000","last_clean":"2024-04-25T01:43:58.581234+0000","last_became_active":"2024-04-25T01:39:24.389841+0000","last_became_peered":"2024-04-25T01:39:24.389841+0000","last_unstale":"2024-04-25T01:43:58.581234+0000","last_undegraded":"2024-04-25T01:43:58.581234+0000","last_fullsized":"2024-04-25T01:43:58.581234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'214","last_scrub_stamp":"2024-04-25T01:43:58.581061+0000","last_deep_scrub":"30'214","last_deep_scrub_stamp":"2024-04-25T01:43:58.581061+0000","last_clean_scrub_stamp":"2024-04-25T01:43:58.581061+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:30:20.805162+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:08.965055+0000","last_change":"2024-04-25T01:44:08.965079+0000","last_active":"2024-04-25T01:44:08.965055+0000","last_peered":"2024-04-25T01:44:08.965055+0000","last_clean":"2024-04-25T01:44:08.965055+0000","last_became_active":"2024-04-25T01:39:23.369151+0000","last_became_peered":"2024-04-25T01:39:23.369151+0000","last_unstale":"2024-04-25T01:44:08.965055+0000","last_undegraded":"2024-04-25T01:44:08.965055+0000","last_fullsized":"2024-04-25T01:44:08.965055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:08.964943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:08.964943+0000","last_clean_scrub_stamp":"2024-04-25T01:44:08.964943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:59:30.463100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'2028","reported_seq":2082,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:58.353685+0000","last_change":"2024-04-25T01:43:58.353685+0000","last_active":"2024-04-25T01:43:58.353685+0000","last_peered":"2024-04-25T01:43:58.353685+0000","last_clean":"2024-04-25T01:43:58.353685+0000","last_became_active":"2024-04-25T01:39:32.430187+0000","last_became_peered":"2024-04-25T01:39:32.430187+0000","last_unstale":"2024-04-25T01:43:58.353685+0000","last_undegraded":"2024-04-25T01:43:58.353685+0000","last_fullsized":"2024-04-25T01:43:58.353685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2028","last_scrub_stamp":"2024-04-25T01:43:58.353529+0000","last_deep_scrub":"30'2028","last_deep_scrub_stamp":"2024-04-25T01:43:58.353529+0000","last_clean_scrub_stamp":"2024-04-25T01:43:58.353529+0000","objects_scrubbed":4,"log_size":2028,"log_dups_size":0,"ondisk_log_size":2028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:09:23.141075+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":4133,"num_write":2022,"num_write_kb":6038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"30'182","reported_seq":208,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.733734+0000","last_change":"2024-04-25T01:39:33.427429+0000","last_active":"2024-04-25T01:43:34.733734+0000","last_peered":"2024-04-25T01:43:34.733734+0000","last_clean":"2024-04-25T01:43:34.733734+0000","last_became_active":"2024-04-25T01:39:33.427164+0000","last_became_peered":"2024-04-25T01:39:33.427164+0000","last_unstale":"2024-04-25T01:43:34.733734+0000","last_undegraded":"2024-04-25T01:43:34.733734+0000","last_fullsized":"2024-04-25T01:43:34.733734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"30'179","reported_seq":222,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:01.776446+0000","last_change":"2024-04-25T01:44:01.776446+0000","last_active":"2024-04-25T01:44:01.776446+0000","last_peered":"2024-04-25T01:44:01.776446+0000","last_clean":"2024-04-25T01:44:01.776446+0000","last_became_active":"2024-04-25T01:39:24.388594+0000","last_became_peered":"2024-04-25T01:39:24.388594+0000","last_unstale":"2024-04-25T01:44:01.776446+0000","last_undegraded":"2024-04-25T01:44:01.776446+0000","last_fullsized":"2024-04-25T01:44:01.776446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'179","last_scrub_stamp":"2024-04-25T01:44:01.776312+0000","last_deep_scrub":"30'179","last_deep_scrub_stamp":"2024-04-25T01:44:01.776312+0000","last_clean_scrub_stamp":"2024-04-25T01:44:01.776312+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:10:39.604115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"30'4","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:57.657782+0000","last_change":"2024-04-25T01:43:57.657782+0000","last_active":"2024-04-25T01:43:57.657782+0000","last_peered":"2024-04-25T01:43:57.657782+0000","last_clean":"2024-04-25T01:43:57.657782+0000","last_became_active":"2024-04-25T01:39:23.372617+0000","last_became_peered":"2024-04-25T01:39:23.372617+0000","last_unstale":"2024-04-25T01:43:57.657782+0000","last_undegraded":"2024-04-25T01:43:57.657782+0000","last_fullsized":"2024-04-25T01:43:57.657782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-04-25T01:43:57.657602+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-04-25T01:43:57.657602+0000","last_clean_scrub_stamp":"2024-04-25T01:43:57.657602+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:01:06.264256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"30'9","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:01.892429+0000","last_change":"2024-04-25T01:44:01.892477+0000","last_active":"2024-04-25T01:44:01.892429+0000","last_peered":"2024-04-25T01:44:01.892429+0000","last_clean":"2024-04-25T01:44:01.892429+0000","last_became_active":"2024-04-25T01:39:32.429900+0000","last_became_peered":"2024-04-25T01:39:32.429900+0000","last_unstale":"2024-04-25T01:44:01.892429+0000","last_undegraded":"2024-04-25T01:44:01.892429+0000","last_fullsized":"2024-04-25T01:44:01.892429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'9","last_scrub_stamp":"2024-04-25T01:44:01.892314+0000","last_deep_scrub":"30'9","last_deep_scrub_stamp":"2024-04-25T01:44:01.892314+0000","last_clean_scrub_stamp":"2024-04-25T01:44:01.892314+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:17:37.923615+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"30'217","reported_seq":243,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.765882+0000","last_change":"2024-04-25T01:39:33.440325+0000","last_active":"2024-04-25T01:43:34.765882+0000","last_peered":"2024-04-25T01:43:34.765882+0000","last_clean":"2024-04-25T01:43:34.765882+0000","last_became_active":"2024-04-25T01:39:33.439961+0000","last_became_peered":"2024-04-25T01:39:33.439961+0000","last_unstale":"2024-04-25T01:43:34.765882+0000","last_undegraded":"2024-04-25T01:43:34.765882+0000","last_fullsized":"2024-04-25T01:43:34.765882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'159","reported_seq":194,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:55.489606+0000","last_change":"2024-04-25T01:39:24.380617+0000","last_active":"2024-04-25T01:43:55.489606+0000","last_peered":"2024-04-25T01:43:55.489606+0000","last_clean":"2024-04-25T01:43:55.489606+0000","last_became_active":"2024-04-25T01:39:24.380330+0000","last_became_peered":"2024-04-25T01:39:24.380330+0000","last_unstale":"2024-04-25T01:43:55.489606+0000","last_undegraded":"2024-04-25T01:43:55.489606+0000","last_fullsized":"2024-04-25T01:43:55.489606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"30'2025","reported_seq":2083,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:00.980746+0000","last_change":"2024-04-25T01:44:00.980746+0000","last_active":"2024-04-25T01:44:00.980746+0000","last_peered":"2024-04-25T01:44:00.980746+0000","last_clean":"2024-04-25T01:44:00.980746+0000","last_became_active":"2024-04-25T01:39:23.372984+0000","last_became_peered":"2024-04-25T01:39:23.372984+0000","last_unstale":"2024-04-25T01:44:00.980746+0000","last_undegraded":"2024-04-25T01:44:00.980746+0000","last_fullsized":"2024-04-25T01:44:00.980746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2025","last_scrub_stamp":"2024-04-25T01:44:00.980602+0000","last_deep_scrub":"30'2025","last_deep_scrub_stamp":"2024-04-25T01:44:00.980602+0000","last_clean_scrub_stamp":"2024-04-25T01:44:00.980602+0000","objects_scrubbed":4,"log_size":2025,"log_dups_size":0,"ondisk_log_size":2025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:42.747876+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":65,"num_write":2019,"num_write_kb":6035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:00.196848+0000","last_change":"2024-04-25T01:44:00.196848+0000","last_active":"2024-04-25T01:44:00.196848+0000","last_peered":"2024-04-25T01:44:00.196848+0000","last_clean":"2024-04-25T01:44:00.196848+0000","last_became_active":"2024-04-25T01:39:32.433408+0000","last_became_peered":"2024-04-25T01:39:32.433408+0000","last_unstale":"2024-04-25T01:44:00.196848+0000","last_undegraded":"2024-04-25T01:44:00.196848+0000","last_fullsized":"2024-04-25T01:44:00.196848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:00.196735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:00.196735+0000","last_clean_scrub_stamp":"2024-04-25T01:44:00.196735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:05.696113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"30'189","reported_seq":223,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:12.049232+0000","last_change":"2024-04-25T01:44:12.049252+0000","last_active":"2024-04-25T01:44:12.049232+0000","last_peered":"2024-04-25T01:44:12.049232+0000","last_clean":"2024-04-25T01:44:12.049232+0000","last_became_active":"2024-04-25T01:39:33.432690+0000","last_became_peered":"2024-04-25T01:39:33.432690+0000","last_unstale":"2024-04-25T01:44:12.049232+0000","last_undegraded":"2024-04-25T01:44:12.049232+0000","last_fullsized":"2024-04-25T01:44:12.049232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'189","last_scrub_stamp":"2024-04-25T01:44:12.049150+0000","last_deep_scrub":"30'189","last_deep_scrub_stamp":"2024-04-25T01:44:12.049150+0000","last_clean_scrub_stamp":"2024-04-25T01:44:12.049150+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:18:02.068299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"30'179","reported_seq":222,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:05.285065+0000","last_change":"2024-04-25T01:44:05.285065+0000","last_active":"2024-04-25T01:44:05.285065+0000","last_peered":"2024-04-25T01:44:05.285065+0000","last_clean":"2024-04-25T01:44:05.285065+0000","last_became_active":"2024-04-25T01:39:24.390941+0000","last_became_peered":"2024-04-25T01:39:24.390941+0000","last_unstale":"2024-04-25T01:44:05.285065+0000","last_undegraded":"2024-04-25T01:44:05.285065+0000","last_fullsized":"2024-04-25T01:44:05.285065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'179","last_scrub_stamp":"2024-04-25T01:44:05.284889+0000","last_deep_scrub":"30'179","last_deep_scrub_stamp":"2024-04-25T01:44:05.284889+0000","last_clean_scrub_stamp":"2024-04-25T01:44:05.284889+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:58.184499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"30'9","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:04.091514+0000","last_change":"2024-04-25T01:44:04.091546+0000","last_active":"2024-04-25T01:44:04.091514+0000","last_peered":"2024-04-25T01:44:04.091514+0000","last_clean":"2024-04-25T01:44:04.091514+0000","last_became_active":"2024-04-25T01:39:23.368778+0000","last_became_peered":"2024-04-25T01:39:23.368778+0000","last_unstale":"2024-04-25T01:44:04.091514+0000","last_undegraded":"2024-04-25T01:44:04.091514+0000","last_fullsized":"2024-04-25T01:44:04.091514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'9","last_scrub_stamp":"2024-04-25T01:44:04.091424+0000","last_deep_scrub":"30'9","last_deep_scrub_stamp":"2024-04-25T01:44:04.091424+0000","last_clean_scrub_stamp":"2024-04-25T01:44:04.091424+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:14:04.097758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'4","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:55.264750+0000","last_change":"2024-04-25T01:43:55.264750+0000","last_active":"2024-04-25T01:43:55.264750+0000","last_peered":"2024-04-25T01:43:55.264750+0000","last_clean":"2024-04-25T01:43:55.264750+0000","last_became_active":"2024-04-25T01:39:32.431247+0000","last_became_peered":"2024-04-25T01:39:32.431247+0000","last_unstale":"2024-04-25T01:43:55.264750+0000","last_undegraded":"2024-04-25T01:43:55.264750+0000","last_fullsized":"2024-04-25T01:43:55.264750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-04-25T01:43:55.264588+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-04-25T01:43:55.264588+0000","last_clean_scrub_stamp":"2024-04-25T01:43:55.264588+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:59.794736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":24,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"30'233","reported_seq":259,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.727652+0000","last_change":"2024-04-25T01:39:33.446545+0000","last_active":"2024-04-25T01:43:34.727652+0000","last_peered":"2024-04-25T01:43:34.727652+0000","last_clean":"2024-04-25T01:43:34.727652+0000","last_became_active":"2024-04-25T01:39:33.446263+0000","last_became_peered":"2024-04-25T01:39:33.446263+0000","last_unstale":"2024-04-25T01:43:34.727652+0000","last_undegraded":"2024-04-25T01:43:34.727652+0000","last_fullsized":"2024-04-25T01:43:34.727652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"30'153","reported_seq":195,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:52.659187+0000","last_change":"2024-04-25T01:43:52.659232+0000","last_active":"2024-04-25T01:43:52.659187+0000","last_peered":"2024-04-25T01:43:52.659187+0000","last_clean":"2024-04-25T01:43:52.659187+0000","last_became_active":"2024-04-25T01:39:24.403591+0000","last_became_peered":"2024-04-25T01:39:24.403591+0000","last_unstale":"2024-04-25T01:43:52.659187+0000","last_undegraded":"2024-04-25T01:43:52.659187+0000","last_fullsized":"2024-04-25T01:43:52.659187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'153","last_scrub_stamp":"2024-04-25T01:43:52.659097+0000","last_deep_scrub":"30'153","last_deep_scrub_stamp":"2024-04-25T01:43:52.659097+0000","last_clean_scrub_stamp":"2024-04-25T01:43:52.659097+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:15.244246+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:11.991533+0000","last_change":"2024-04-25T01:44:11.991559+0000","last_active":"2024-04-25T01:44:11.991533+0000","last_peered":"2024-04-25T01:44:11.991533+0000","last_clean":"2024-04-25T01:44:11.991533+0000","last_became_active":"2024-04-25T01:39:23.378635+0000","last_became_peered":"2024-04-25T01:39:23.378635+0000","last_unstale":"2024-04-25T01:44:11.991533+0000","last_undegraded":"2024-04-25T01:44:11.991533+0000","last_fullsized":"2024-04-25T01:44:11.991533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:11.991421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:11.991421+0000","last_clean_scrub_stamp":"2024-04-25T01:44:11.991421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:11:51.159997+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"30'12","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:54.400031+0000","last_change":"2024-04-25T01:43:54.400031+0000","last_active":"2024-04-25T01:43:54.400031+0000","last_peered":"2024-04-25T01:43:54.400031+0000","last_clean":"2024-04-25T01:43:54.400031+0000","last_became_active":"2024-04-25T01:39:32.427105+0000","last_became_peered":"2024-04-25T01:39:32.427105+0000","last_unstale":"2024-04-25T01:43:54.400031+0000","last_undegraded":"2024-04-25T01:43:54.400031+0000","last_fullsized":"2024-04-25T01:43:54.400031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'12","last_scrub_stamp":"2024-04-25T01:43:54.399899+0000","last_deep_scrub":"30'12","last_deep_scrub_stamp":"2024-04-25T01:43:54.399899+0000","last_clean_scrub_stamp":"2024-04-25T01:43:54.399899+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:36.318003+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":66,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'217","reported_seq":244,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:55.489801+0000","last_change":"2024-04-25T01:39:33.444814+0000","last_active":"2024-04-25T01:43:55.489801+0000","last_peered":"2024-04-25T01:43:55.489801+0000","last_clean":"2024-04-25T01:43:55.489801+0000","last_became_active":"2024-04-25T01:39:33.444489+0000","last_became_peered":"2024-04-25T01:39:33.444489+0000","last_unstale":"2024-04-25T01:43:55.489801+0000","last_undegraded":"2024-04-25T01:43:55.489801+0000","last_fullsized":"2024-04-25T01:43:55.489801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"30'235","reported_seq":277,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:04.963852+0000","last_change":"2024-04-25T01:44:04.963876+0000","last_active":"2024-04-25T01:44:04.963852+0000","last_peered":"2024-04-25T01:44:04.963852+0000","last_clean":"2024-04-25T01:44:04.963852+0000","last_became_active":"2024-04-25T01:39:24.391605+0000","last_became_peered":"2024-04-25T01:39:24.391605+0000","last_unstale":"2024-04-25T01:44:04.963852+0000","last_undegraded":"2024-04-25T01:44:04.963852+0000","last_fullsized":"2024-04-25T01:44:04.963852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'235","last_scrub_stamp":"2024-04-25T01:44:04.963755+0000","last_deep_scrub":"30'235","last_deep_scrub_stamp":"2024-04-25T01:44:04.963755+0000","last_clean_scrub_stamp":"2024-04-25T01:44:04.963755+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:12:09.031875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":565248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'1","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:02.016028+0000","last_change":"2024-04-25T01:44:02.016053+0000","last_active":"2024-04-25T01:44:02.016028+0000","last_peered":"2024-04-25T01:44:02.016028+0000","last_clean":"2024-04-25T01:44:02.016028+0000","last_became_active":"2024-04-25T01:39:23.376727+0000","last_became_peered":"2024-04-25T01:39:23.376727+0000","last_unstale":"2024-04-25T01:44:02.016028+0000","last_undegraded":"2024-04-25T01:44:02.016028+0000","last_fullsized":"2024-04-25T01:44:02.016028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2024-04-25T01:44:02.015929+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2024-04-25T01:44:02.015929+0000","last_clean_scrub_stamp":"2024-04-25T01:44:02.015929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:10:23.785928+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:55.391490+0000","last_change":"2024-04-25T01:43:55.391490+0000","last_active":"2024-04-25T01:43:55.391490+0000","last_peered":"2024-04-25T01:43:55.391490+0000","last_clean":"2024-04-25T01:43:55.391490+0000","last_became_active":"2024-04-25T01:39:32.424203+0000","last_became_peered":"2024-04-25T01:39:32.424203+0000","last_unstale":"2024-04-25T01:43:55.391490+0000","last_undegraded":"2024-04-25T01:43:55.391490+0000","last_fullsized":"2024-04-25T01:43:55.391490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:43:55.391399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:43:55.391399+0000","last_clean_scrub_stamp":"2024-04-25T01:43:55.391399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:13.223291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"30'172","reported_seq":207,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:12.155500+0000","last_change":"2024-04-25T01:44:12.155557+0000","last_active":"2024-04-25T01:44:12.155500+0000","last_peered":"2024-04-25T01:44:12.155500+0000","last_clean":"2024-04-25T01:44:12.155500+0000","last_became_active":"2024-04-25T01:39:33.445654+0000","last_became_peered":"2024-04-25T01:39:33.445654+0000","last_unstale":"2024-04-25T01:44:12.155500+0000","last_undegraded":"2024-04-25T01:44:12.155500+0000","last_fullsized":"2024-04-25T01:44:12.155500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'172","last_scrub_stamp":"2024-04-25T01:44:12.155397+0000","last_deep_scrub":"30'172","last_deep_scrub_stamp":"2024-04-25T01:44:12.155397+0000","last_clean_scrub_stamp":"2024-04-25T01:44:12.155397+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:05:07.145905+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'4","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:07.684882+0000","last_change":"2024-04-25T01:44:07.684903+0000","last_active":"2024-04-25T01:44:07.684882+0000","last_peered":"2024-04-25T01:44:07.684882+0000","last_clean":"2024-04-25T01:44:07.684882+0000","last_became_active":"2024-04-25T01:39:32.430220+0000","last_became_peered":"2024-04-25T01:39:32.430220+0000","last_unstale":"2024-04-25T01:44:07.684882+0000","last_undegraded":"2024-04-25T01:44:07.684882+0000","last_fullsized":"2024-04-25T01:44:07.684882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-04-25T01:44:07.684809+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-04-25T01:44:07.684809+0000","last_clean_scrub_stamp":"2024-04-25T01:44:07.684809+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:06.789551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"30'187","reported_seq":229,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:09.063813+0000","last_change":"2024-04-25T01:44:09.063840+0000","last_active":"2024-04-25T01:44:09.063813+0000","last_peered":"2024-04-25T01:44:09.063813+0000","last_clean":"2024-04-25T01:44:09.063813+0000","last_became_active":"2024-04-25T01:39:24.375178+0000","last_became_peered":"2024-04-25T01:39:24.375178+0000","last_unstale":"2024-04-25T01:44:09.063813+0000","last_undegraded":"2024-04-25T01:44:09.063813+0000","last_fullsized":"2024-04-25T01:44:09.063813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'187","last_scrub_stamp":"2024-04-25T01:44:09.063688+0000","last_deep_scrub":"30'187","last_deep_scrub_stamp":"2024-04-25T01:44:09.063688+0000","last_clean_scrub_stamp":"2024-04-25T01:44:09.063688+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:51:03.174886+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:09.955088+0000","last_change":"2024-04-25T01:44:09.955125+0000","last_active":"2024-04-25T01:44:09.955088+0000","last_peered":"2024-04-25T01:44:09.955088+0000","last_clean":"2024-04-25T01:44:09.955088+0000","last_became_active":"2024-04-25T01:39:23.369710+0000","last_became_peered":"2024-04-25T01:39:23.369710+0000","last_unstale":"2024-04-25T01:44:09.955088+0000","last_undegraded":"2024-04-25T01:44:09.955088+0000","last_fullsized":"2024-04-25T01:44:09.955088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:09.954971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:09.954971+0000","last_clean_scrub_stamp":"2024-04-25T01:44:09.954971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:16:24.034755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"30'192","reported_seq":227,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:11.595503+0000","last_change":"2024-04-25T01:44:11.595539+0000","last_active":"2024-04-25T01:44:11.595503+0000","last_peered":"2024-04-25T01:44:11.595503+0000","last_clean":"2024-04-25T01:44:11.595503+0000","last_became_active":"2024-04-25T01:39:33.447436+0000","last_became_peered":"2024-04-25T01:39:33.447436+0000","last_unstale":"2024-04-25T01:44:11.595503+0000","last_undegraded":"2024-04-25T01:44:11.595503+0000","last_fullsized":"2024-04-25T01:44:11.595503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'192","last_scrub_stamp":"2024-04-25T01:44:11.595397+0000","last_deep_scrub":"30'192","last_deep_scrub_stamp":"2024-04-25T01:44:11.595397+0000","last_clean_scrub_stamp":"2024-04-25T01:44:11.595397+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:57.614644+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'9","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:08.231284+0000","last_change":"2024-04-25T01:44:08.231361+0000","last_active":"2024-04-25T01:44:08.231284+0000","last_peered":"2024-04-25T01:44:08.231284+0000","last_clean":"2024-04-25T01:44:08.231284+0000","last_became_active":"2024-04-25T01:39:32.436000+0000","last_became_peered":"2024-04-25T01:39:32.436000+0000","last_unstale":"2024-04-25T01:44:08.231284+0000","last_undegraded":"2024-04-25T01:44:08.231284+0000","last_fullsized":"2024-04-25T01:44:08.231284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'9","last_scrub_stamp":"2024-04-25T01:44:08.231182+0000","last_deep_scrub":"30'9","last_deep_scrub_stamp":"2024-04-25T01:44:08.231182+0000","last_clean_scrub_stamp":"2024-04-25T01:44:08.231182+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:58.977971+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"30'190","reported_seq":224,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.877096+0000","last_change":"2024-04-25T01:39:24.387708+0000","last_active":"2024-04-25T01:43:46.877096+0000","last_peered":"2024-04-25T01:43:46.877096+0000","last_clean":"2024-04-25T01:43:46.877096+0000","last_became_active":"2024-04-25T01:39:24.387433+0000","last_became_peered":"2024-04-25T01:39:24.387433+0000","last_unstale":"2024-04-25T01:43:46.877096+0000","last_undegraded":"2024-04-25T01:43:46.877096+0000","last_fullsized":"2024-04-25T01:43:46.877096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:10.476157+0000","last_change":"2024-04-25T01:44:10.476190+0000","last_active":"2024-04-25T01:44:10.476157+0000","last_peered":"2024-04-25T01:44:10.476157+0000","last_clean":"2024-04-25T01:44:10.476157+0000","last_became_active":"2024-04-25T01:39:23.377181+0000","last_became_peered":"2024-04-25T01:39:23.377181+0000","last_unstale":"2024-04-25T01:44:10.476157+0000","last_undegraded":"2024-04-25T01:44:10.476157+0000","last_fullsized":"2024-04-25T01:44:10.476157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:10.476054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:10.476054+0000","last_clean_scrub_stamp":"2024-04-25T01:44:10.476054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:07.684739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"30'209","reported_seq":235,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.758589+0000","last_change":"2024-04-25T01:39:33.444973+0000","last_active":"2024-04-25T01:43:34.758589+0000","last_peered":"2024-04-25T01:43:34.758589+0000","last_clean":"2024-04-25T01:43:34.758589+0000","last_became_active":"2024-04-25T01:39:33.444673+0000","last_became_peered":"2024-04-25T01:39:33.444673+0000","last_unstale":"2024-04-25T01:43:34.758589+0000","last_undegraded":"2024-04-25T01:43:34.758589+0000","last_fullsized":"2024-04-25T01:43:34.758589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"29'3","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:59.990235+0000","last_change":"2024-04-25T01:43:59.990279+0000","last_active":"2024-04-25T01:43:59.990235+0000","last_peered":"2024-04-25T01:43:59.990235+0000","last_clean":"2024-04-25T01:43:59.990235+0000","last_became_active":"2024-04-25T01:39:23.372688+0000","last_became_peered":"2024-04-25T01:39:23.372688+0000","last_unstale":"2024-04-25T01:43:59.990235+0000","last_undegraded":"2024-04-25T01:43:59.990235+0000","last_fullsized":"2024-04-25T01:43:59.990235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-04-25T01:43:59.990129+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-04-25T01:43:59.990129+0000","last_clean_scrub_stamp":"2024-04-25T01:43:59.990129+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:43.228445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"30'158","reported_seq":200,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:00.771917+0000","last_change":"2024-04-25T01:44:00.771959+0000","last_active":"2024-04-25T01:44:00.771917+0000","last_peered":"2024-04-25T01:44:00.771917+0000","last_clean":"2024-04-25T01:44:00.771917+0000","last_became_active":"2024-04-25T01:39:24.387797+0000","last_became_peered":"2024-04-25T01:39:24.387797+0000","last_unstale":"2024-04-25T01:44:00.771917+0000","last_undegraded":"2024-04-25T01:44:00.771917+0000","last_fullsized":"2024-04-25T01:44:00.771917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'158","last_scrub_stamp":"2024-04-25T01:44:00.771742+0000","last_deep_scrub":"30'158","last_deep_scrub_stamp":"2024-04-25T01:44:00.771742+0000","last_clean_scrub_stamp":"2024-04-25T01:44:00.771742+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:58:58.719028+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"30'3","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:59.336757+0000","last_change":"2024-04-25T01:43:59.336785+0000","last_active":"2024-04-25T01:43:59.336757+0000","last_peered":"2024-04-25T01:43:59.336757+0000","last_clean":"2024-04-25T01:43:59.336757+0000","last_became_active":"2024-04-25T01:39:32.426626+0000","last_became_peered":"2024-04-25T01:39:32.426626+0000","last_unstale":"2024-04-25T01:43:59.336757+0000","last_undegraded":"2024-04-25T01:43:59.336757+0000","last_fullsized":"2024-04-25T01:43:59.336757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-04-25T01:43:59.336674+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-04-25T01:43:59.336674+0000","last_clean_scrub_stamp":"2024-04-25T01:43:59.336674+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:14:54.986133+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"30'170","reported_seq":196,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.749321+0000","last_change":"2024-04-25T01:39:33.446301+0000","last_active":"2024-04-25T01:43:34.749321+0000","last_peered":"2024-04-25T01:43:34.749321+0000","last_clean":"2024-04-25T01:43:34.749321+0000","last_became_active":"2024-04-25T01:39:33.445158+0000","last_became_peered":"2024-04-25T01:39:33.445158+0000","last_unstale":"2024-04-25T01:43:34.749321+0000","last_undegraded":"2024-04-25T01:43:34.749321+0000","last_fullsized":"2024-04-25T01:43:34.749321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"30'1825","reported_seq":1869,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:09.468317+0000","last_change":"2024-04-25T01:44:09.468346+0000","last_active":"2024-04-25T01:44:09.468317+0000","last_peered":"2024-04-25T01:44:09.468317+0000","last_clean":"2024-04-25T01:44:09.468317+0000","last_became_active":"2024-04-25T01:39:23.371475+0000","last_became_peered":"2024-04-25T01:39:23.371475+0000","last_unstale":"2024-04-25T01:44:09.468317+0000","last_undegraded":"2024-04-25T01:44:09.468317+0000","last_fullsized":"2024-04-25T01:44:09.468317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1825","last_scrub_stamp":"2024-04-25T01:44:09.468232+0000","last_deep_scrub":"30'1825","last_deep_scrub_stamp":"2024-04-25T01:44:09.468232+0000","last_clean_scrub_stamp":"2024-04-25T01:44:09.468232+0000","objects_scrubbed":1,"log_size":1825,"log_dups_size":0,"ondisk_log_size":1825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:12:46.274766+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3805284,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1822,"num_write_kb":5471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"30'150","reported_seq":192,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:03.227935+0000","last_change":"2024-04-25T01:44:03.227975+0000","last_active":"2024-04-25T01:44:03.227935+0000","last_peered":"2024-04-25T01:44:03.227935+0000","last_clean":"2024-04-25T01:44:03.227935+0000","last_became_active":"2024-04-25T01:39:24.387789+0000","last_became_peered":"2024-04-25T01:39:24.387789+0000","last_unstale":"2024-04-25T01:44:03.227935+0000","last_undegraded":"2024-04-25T01:44:03.227935+0000","last_fullsized":"2024-04-25T01:44:03.227935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'150","last_scrub_stamp":"2024-04-25T01:44:03.227822+0000","last_deep_scrub":"30'150","last_deep_scrub_stamp":"2024-04-25T01:44:03.227822+0000","last_clean_scrub_stamp":"2024-04-25T01:44:03.227822+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:51:10.185806+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'6","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:56.421442+0000","last_change":"2024-04-25T01:43:56.421467+0000","last_active":"2024-04-25T01:43:56.421442+0000","last_peered":"2024-04-25T01:43:56.421442+0000","last_clean":"2024-04-25T01:43:56.421442+0000","last_became_active":"2024-04-25T01:39:32.429361+0000","last_became_peered":"2024-04-25T01:39:32.429361+0000","last_unstale":"2024-04-25T01:43:56.421442+0000","last_undegraded":"2024-04-25T01:43:56.421442+0000","last_fullsized":"2024-04-25T01:43:56.421442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'6","last_scrub_stamp":"2024-04-25T01:43:56.421352+0000","last_deep_scrub":"30'6","last_deep_scrub_stamp":"2024-04-25T01:43:56.421352+0000","last_clean_scrub_stamp":"2024-04-25T01:43:56.421352+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:40:56.206033+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"30'221","reported_seq":256,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:06.435616+0000","last_change":"2024-04-25T01:44:06.435658+0000","last_active":"2024-04-25T01:44:06.435616+0000","last_peered":"2024-04-25T01:44:06.435616+0000","last_clean":"2024-04-25T01:44:06.435616+0000","last_became_active":"2024-04-25T01:39:33.426101+0000","last_became_peered":"2024-04-25T01:39:33.426101+0000","last_unstale":"2024-04-25T01:44:06.435616+0000","last_undegraded":"2024-04-25T01:44:06.435616+0000","last_fullsized":"2024-04-25T01:44:06.435616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'221","last_scrub_stamp":"2024-04-25T01:44:06.435482+0000","last_deep_scrub":"30'221","last_deep_scrub_stamp":"2024-04-25T01:44:06.435482+0000","last_clean_scrub_stamp":"2024-04-25T01:44:06.435482+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:33.943206+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"30'172","reported_seq":215,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:06.149847+0000","last_change":"2024-04-25T01:44:06.149873+0000","last_active":"2024-04-25T01:44:06.149847+0000","last_peered":"2024-04-25T01:44:06.149847+0000","last_clean":"2024-04-25T01:44:06.149847+0000","last_became_active":"2024-04-25T01:39:24.394816+0000","last_became_peered":"2024-04-25T01:39:24.394816+0000","last_unstale":"2024-04-25T01:44:06.149847+0000","last_undegraded":"2024-04-25T01:44:06.149847+0000","last_fullsized":"2024-04-25T01:44:06.149847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'172","last_scrub_stamp":"2024-04-25T01:44:06.149720+0000","last_deep_scrub":"30'172","last_deep_scrub_stamp":"2024-04-25T01:44:06.149720+0000","last_clean_scrub_stamp":"2024-04-25T01:44:06.149720+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:45:21.524509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"30'174","reported_seq":209,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:11.093009+0000","last_change":"2024-04-25T01:44:11.093090+0000","last_active":"2024-04-25T01:44:11.093009+0000","last_peered":"2024-04-25T01:44:11.093009+0000","last_clean":"2024-04-25T01:44:11.093009+0000","last_became_active":"2024-04-25T01:39:33.432266+0000","last_became_peered":"2024-04-25T01:39:33.432266+0000","last_unstale":"2024-04-25T01:44:11.093009+0000","last_undegraded":"2024-04-25T01:44:11.093009+0000","last_fullsized":"2024-04-25T01:44:11.093009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'174","last_scrub_stamp":"2024-04-25T01:44:11.092905+0000","last_deep_scrub":"30'174","last_deep_scrub_stamp":"2024-04-25T01:44:11.092905+0000","last_clean_scrub_stamp":"2024-04-25T01:44:11.092905+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:45.102307+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"30'158","reported_seq":206,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:09.322557+0000","last_change":"2024-04-25T01:44:09.322585+0000","last_active":"2024-04-25T01:44:09.322557+0000","last_peered":"2024-04-25T01:44:09.322557+0000","last_clean":"2024-04-25T01:44:09.322557+0000","last_became_active":"2024-04-25T01:40:06.450447+0000","last_became_peered":"2024-04-25T01:40:06.450447+0000","last_unstale":"2024-04-25T01:44:09.322557+0000","last_undegraded":"2024-04-25T01:44:09.322557+0000","last_fullsized":"2024-04-25T01:44:09.322557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'158","last_scrub_stamp":"2024-04-25T01:44:09.322470+0000","last_deep_scrub":"30'158","last_deep_scrub_stamp":"2024-04-25T01:44:09.322470+0000","last_clean_scrub_stamp":"2024-04-25T01:44:09.322470+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:36:14.273335+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"30'168","reported_seq":195,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:54.622995+0000","last_change":"2024-04-25T01:39:33.439086+0000","last_active":"2024-04-25T01:43:54.622995+0000","last_peered":"2024-04-25T01:43:54.622995+0000","last_clean":"2024-04-25T01:43:54.622995+0000","last_became_active":"2024-04-25T01:39:33.438811+0000","last_became_peered":"2024-04-25T01:39:33.438811+0000","last_unstale":"2024-04-25T01:43:54.622995+0000","last_undegraded":"2024-04-25T01:43:54.622995+0000","last_fullsized":"2024-04-25T01:43:54.622995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"30'143","reported_seq":186,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:55.741406+0000","last_change":"2024-04-25T01:43:55.741430+0000","last_active":"2024-04-25T01:43:55.741406+0000","last_peered":"2024-04-25T01:43:55.741406+0000","last_clean":"2024-04-25T01:43:55.741406+0000","last_became_active":"2024-04-25T01:39:24.399499+0000","last_became_peered":"2024-04-25T01:39:24.399499+0000","last_unstale":"2024-04-25T01:43:55.741406+0000","last_undegraded":"2024-04-25T01:43:55.741406+0000","last_fullsized":"2024-04-25T01:43:55.741406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'143","last_scrub_stamp":"2024-04-25T01:43:55.741303+0000","last_deep_scrub":"30'143","last_deep_scrub_stamp":"2024-04-25T01:43:55.741303+0000","last_clean_scrub_stamp":"2024-04-25T01:43:55.741303+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:02.676799+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":311296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"30'184","reported_seq":211,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:52.889867+0000","last_change":"2024-04-25T01:39:33.444074+0000","last_active":"2024-04-25T01:43:52.889867+0000","last_peered":"2024-04-25T01:43:52.889867+0000","last_clean":"2024-04-25T01:43:52.889867+0000","last_became_active":"2024-04-25T01:39:33.443796+0000","last_became_peered":"2024-04-25T01:39:33.443796+0000","last_unstale":"2024-04-25T01:43:52.889867+0000","last_undegraded":"2024-04-25T01:43:52.889867+0000","last_fullsized":"2024-04-25T01:43:52.889867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"30'124","reported_seq":167,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:04.733080+0000","last_change":"2024-04-25T01:44:04.733127+0000","last_active":"2024-04-25T01:44:04.733080+0000","last_peered":"2024-04-25T01:44:04.733080+0000","last_clean":"2024-04-25T01:44:04.733080+0000","last_became_active":"2024-04-25T01:39:24.390363+0000","last_became_peered":"2024-04-25T01:39:24.390363+0000","last_unstale":"2024-04-25T01:44:04.733080+0000","last_undegraded":"2024-04-25T01:44:04.733080+0000","last_fullsized":"2024-04-25T01:44:04.733080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'124","last_scrub_stamp":"2024-04-25T01:44:04.732945+0000","last_deep_scrub":"30'124","last_deep_scrub_stamp":"2024-04-25T01:44:04.732945+0000","last_clean_scrub_stamp":"2024-04-25T01:44:04.732945+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:47.799587+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"30'162","reported_seq":189,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:47.765376+0000","last_change":"2024-04-25T01:39:33.437787+0000","last_active":"2024-04-25T01:43:47.765376+0000","last_peered":"2024-04-25T01:43:47.765376+0000","last_clean":"2024-04-25T01:43:47.765376+0000","last_became_active":"2024-04-25T01:39:33.436131+0000","last_became_peered":"2024-04-25T01:39:33.436131+0000","last_unstale":"2024-04-25T01:43:47.765376+0000","last_undegraded":"2024-04-25T01:43:47.765376+0000","last_fullsized":"2024-04-25T01:43:47.765376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"30'148","reported_seq":183,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:47.498696+0000","last_change":"2024-04-25T01:39:24.389645+0000","last_active":"2024-04-25T01:43:47.498696+0000","last_peered":"2024-04-25T01:43:47.498696+0000","last_clean":"2024-04-25T01:43:47.498696+0000","last_became_active":"2024-04-25T01:39:24.389375+0000","last_became_peered":"2024-04-25T01:39:24.389375+0000","last_unstale":"2024-04-25T01:43:47.498696+0000","last_undegraded":"2024-04-25T01:43:47.498696+0000","last_fullsized":"2024-04-25T01:43:47.498696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"30'141","reported_seq":168,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:47.671977+0000","last_change":"2024-04-25T01:39:33.448177+0000","last_active":"2024-04-25T01:43:47.671977+0000","last_peered":"2024-04-25T01:43:47.671977+0000","last_clean":"2024-04-25T01:43:47.671977+0000","last_became_active":"2024-04-25T01:39:33.447588+0000","last_became_peered":"2024-04-25T01:39:33.447588+0000","last_unstale":"2024-04-25T01:43:47.671977+0000","last_undegraded":"2024-04-25T01:43:47.671977+0000","last_fullsized":"2024-04-25T01:43:47.671977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"30'156","reported_seq":199,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:08.112261+0000","last_change":"2024-04-25T01:44:08.112285+0000","last_active":"2024-04-25T01:44:08.112261+0000","last_peered":"2024-04-25T01:44:08.112261+0000","last_clean":"2024-04-25T01:44:08.112261+0000","last_became_active":"2024-04-25T01:39:24.373731+0000","last_became_peered":"2024-04-25T01:39:24.373731+0000","last_unstale":"2024-04-25T01:44:08.112261+0000","last_undegraded":"2024-04-25T01:44:08.112261+0000","last_fullsized":"2024-04-25T01:44:08.112261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'156","last_scrub_stamp":"2024-04-25T01:44:08.112186+0000","last_deep_scrub":"30'156","last_deep_scrub_stamp":"2024-04-25T01:44:08.112186+0000","last_clean_scrub_stamp":"2024-04-25T01:44:08.112186+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:37.020861+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"30'188","reported_seq":215,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:47.765288+0000","last_change":"2024-04-25T01:39:33.446992+0000","last_active":"2024-04-25T01:43:47.765288+0000","last_peered":"2024-04-25T01:43:47.765288+0000","last_clean":"2024-04-25T01:43:47.765288+0000","last_became_active":"2024-04-25T01:39:33.446652+0000","last_became_peered":"2024-04-25T01:39:33.446652+0000","last_unstale":"2024-04-25T01:43:47.765288+0000","last_undegraded":"2024-04-25T01:43:47.765288+0000","last_fullsized":"2024-04-25T01:43:47.765288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"30'224","reported_seq":267,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:58.017384+0000","last_change":"2024-04-25T01:43:58.017412+0000","last_active":"2024-04-25T01:43:58.017384+0000","last_peered":"2024-04-25T01:43:58.017384+0000","last_clean":"2024-04-25T01:43:58.017384+0000","last_became_active":"2024-04-25T01:39:24.398299+0000","last_became_peered":"2024-04-25T01:39:24.398299+0000","last_unstale":"2024-04-25T01:43:58.017384+0000","last_undegraded":"2024-04-25T01:43:58.017384+0000","last_fullsized":"2024-04-25T01:43:58.017384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'224","last_scrub_stamp":"2024-04-25T01:43:58.017263+0000","last_deep_scrub":"30'224","last_deep_scrub_stamp":"2024-04-25T01:43:58.017263+0000","last_clean_scrub_stamp":"2024-04-25T01:43:58.017263+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:44.739129+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":516096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"30'167","reported_seq":202,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:11.171969+0000","last_change":"2024-04-25T01:44:11.172011+0000","last_active":"2024-04-25T01:44:11.171969+0000","last_peered":"2024-04-25T01:44:11.171969+0000","last_clean":"2024-04-25T01:44:11.171969+0000","last_became_active":"2024-04-25T01:39:33.441104+0000","last_became_peered":"2024-04-25T01:39:33.441104+0000","last_unstale":"2024-04-25T01:44:11.171969+0000","last_undegraded":"2024-04-25T01:44:11.171969+0000","last_fullsized":"2024-04-25T01:44:11.171969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'167","last_scrub_stamp":"2024-04-25T01:44:11.171834+0000","last_deep_scrub":"30'167","last_deep_scrub_stamp":"2024-04-25T01:44:11.171834+0000","last_clean_scrub_stamp":"2024-04-25T01:44:11.171834+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:37:48.456453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"30'161","reported_seq":204,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:07.477284+0000","last_change":"2024-04-25T01:44:07.477306+0000","last_active":"2024-04-25T01:44:07.477284+0000","last_peered":"2024-04-25T01:44:07.477284+0000","last_clean":"2024-04-25T01:44:07.477284+0000","last_became_active":"2024-04-25T01:39:24.389809+0000","last_became_peered":"2024-04-25T01:39:24.389809+0000","last_unstale":"2024-04-25T01:44:07.477284+0000","last_undegraded":"2024-04-25T01:44:07.477284+0000","last_fullsized":"2024-04-25T01:44:07.477284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'161","last_scrub_stamp":"2024-04-25T01:44:07.477198+0000","last_deep_scrub":"30'161","last_deep_scrub_stamp":"2024-04-25T01:44:07.477198+0000","last_clean_scrub_stamp":"2024-04-25T01:44:07.477198+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:22:21.595744+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"30'188","reported_seq":214,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.759161+0000","last_change":"2024-04-25T01:39:33.426710+0000","last_active":"2024-04-25T01:43:34.759161+0000","last_peered":"2024-04-25T01:43:34.759161+0000","last_clean":"2024-04-25T01:43:34.759161+0000","last_became_active":"2024-04-25T01:39:33.426056+0000","last_became_peered":"2024-04-25T01:39:33.426056+0000","last_unstale":"2024-04-25T01:43:34.759161+0000","last_undegraded":"2024-04-25T01:43:34.759161+0000","last_fullsized":"2024-04-25T01:43:34.759161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"30'220","reported_seq":255,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:47.125346+0000","last_change":"2024-04-25T01:39:24.387093+0000","last_active":"2024-04-25T01:43:47.125346+0000","last_peered":"2024-04-25T01:43:47.125346+0000","last_clean":"2024-04-25T01:43:47.125346+0000","last_became_active":"2024-04-25T01:39:24.386809+0000","last_became_peered":"2024-04-25T01:39:24.386809+0000","last_unstale":"2024-04-25T01:43:47.125346+0000","last_undegraded":"2024-04-25T01:43:47.125346+0000","last_fullsized":"2024-04-25T01:43:47.125346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"30'189","reported_seq":215,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.764655+0000","last_change":"2024-04-25T01:39:33.436499+0000","last_active":"2024-04-25T01:43:34.764655+0000","last_peered":"2024-04-25T01:43:34.764655+0000","last_clean":"2024-04-25T01:43:34.764655+0000","last_became_active":"2024-04-25T01:39:33.436017+0000","last_became_peered":"2024-04-25T01:39:33.436017+0000","last_unstale":"2024-04-25T01:43:34.764655+0000","last_undegraded":"2024-04-25T01:43:34.764655+0000","last_fullsized":"2024-04-25T01:43:34.764655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"30'149","reported_seq":184,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:53.756913+0000","last_change":"2024-04-25T01:39:24.389039+0000","last_active":"2024-04-25T01:43:53.756913+0000","last_peered":"2024-04-25T01:43:53.756913+0000","last_clean":"2024-04-25T01:43:53.756913+0000","last_became_active":"2024-04-25T01:39:24.388793+0000","last_became_peered":"2024-04-25T01:39:24.388793+0000","last_unstale":"2024-04-25T01:43:53.756913+0000","last_undegraded":"2024-04-25T01:43:53.756913+0000","last_fullsized":"2024-04-25T01:43:53.756913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"30'196","reported_seq":231,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:04.308534+0000","last_change":"2024-04-25T01:44:04.308534+0000","last_active":"2024-04-25T01:44:04.308534+0000","last_peered":"2024-04-25T01:44:04.308534+0000","last_clean":"2024-04-25T01:44:04.308534+0000","last_became_active":"2024-04-25T01:39:33.440760+0000","last_became_peered":"2024-04-25T01:39:33.440760+0000","last_unstale":"2024-04-25T01:44:04.308534+0000","last_undegraded":"2024-04-25T01:44:04.308534+0000","last_fullsized":"2024-04-25T01:44:04.308534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'196","last_scrub_stamp":"2024-04-25T01:44:04.308408+0000","last_deep_scrub":"30'196","last_deep_scrub_stamp":"2024-04-25T01:44:04.308408+0000","last_clean_scrub_stamp":"2024-04-25T01:44:04.308408+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:04:04.433641+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"30'194","reported_seq":229,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:54.622726+0000","last_change":"2024-04-25T01:39:24.390884+0000","last_active":"2024-04-25T01:43:54.622726+0000","last_peered":"2024-04-25T01:43:54.622726+0000","last_clean":"2024-04-25T01:43:54.622726+0000","last_became_active":"2024-04-25T01:39:24.390591+0000","last_became_peered":"2024-04-25T01:39:24.390591+0000","last_unstale":"2024-04-25T01:43:54.622726+0000","last_undegraded":"2024-04-25T01:43:54.622726+0000","last_fullsized":"2024-04-25T01:43:54.622726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"30'233","reported_seq":260,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:53.757212+0000","last_change":"2024-04-25T01:39:33.429482+0000","last_active":"2024-04-25T01:43:53.757212+0000","last_peered":"2024-04-25T01:43:53.757212+0000","last_clean":"2024-04-25T01:43:53.757212+0000","last_became_active":"2024-04-25T01:39:33.429158+0000","last_became_peered":"2024-04-25T01:39:33.429158+0000","last_unstale":"2024-04-25T01:43:53.757212+0000","last_undegraded":"2024-04-25T01:43:53.757212+0000","last_fullsized":"2024-04-25T01:43:53.757212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"30'168","reported_seq":211,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:02.738246+0000","last_change":"2024-04-25T01:44:02.738292+0000","last_active":"2024-04-25T01:44:02.738246+0000","last_peered":"2024-04-25T01:44:02.738246+0000","last_clean":"2024-04-25T01:44:02.738246+0000","last_became_active":"2024-04-25T01:39:24.388619+0000","last_became_peered":"2024-04-25T01:39:24.388619+0000","last_unstale":"2024-04-25T01:44:02.738246+0000","last_undegraded":"2024-04-25T01:44:02.738246+0000","last_fullsized":"2024-04-25T01:44:02.738246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'168","last_scrub_stamp":"2024-04-25T01:44:02.738120+0000","last_deep_scrub":"30'168","last_deep_scrub_stamp":"2024-04-25T01:44:02.738120+0000","last_clean_scrub_stamp":"2024-04-25T01:44:02.738120+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:16:06.111704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"30'215","reported_seq":250,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:09.331383+0000","last_change":"2024-04-25T01:44:09.331411+0000","last_active":"2024-04-25T01:44:09.331383+0000","last_peered":"2024-04-25T01:44:09.331383+0000","last_clean":"2024-04-25T01:44:09.331383+0000","last_became_active":"2024-04-25T01:39:33.443257+0000","last_became_peered":"2024-04-25T01:39:33.443257+0000","last_unstale":"2024-04-25T01:44:09.331383+0000","last_undegraded":"2024-04-25T01:44:09.331383+0000","last_fullsized":"2024-04-25T01:44:09.331383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'215","last_scrub_stamp":"2024-04-25T01:44:09.331282+0000","last_deep_scrub":"30'215","last_deep_scrub_stamp":"2024-04-25T01:44:09.331282+0000","last_clean_scrub_stamp":"2024-04-25T01:44:09.331282+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:59:44.226490+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"30'188","reported_seq":231,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:05.105965+0000","last_change":"2024-04-25T01:44:05.105991+0000","last_active":"2024-04-25T01:44:05.105965+0000","last_peered":"2024-04-25T01:44:05.105965+0000","last_clean":"2024-04-25T01:44:05.105965+0000","last_became_active":"2024-04-25T01:39:24.394784+0000","last_became_peered":"2024-04-25T01:39:24.394784+0000","last_unstale":"2024-04-25T01:44:05.105965+0000","last_undegraded":"2024-04-25T01:44:05.105965+0000","last_fullsized":"2024-04-25T01:44:05.105965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'188","last_scrub_stamp":"2024-04-25T01:44:05.105868+0000","last_deep_scrub":"30'188","last_deep_scrub_stamp":"2024-04-25T01:44:05.105868+0000","last_clean_scrub_stamp":"2024-04-25T01:44:05.105868+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:03.686825+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"30'159","reported_seq":186,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:54.187857+0000","last_change":"2024-04-25T01:39:33.446683+0000","last_active":"2024-04-25T01:43:54.187857+0000","last_peered":"2024-04-25T01:43:54.187857+0000","last_clean":"2024-04-25T01:43:54.187857+0000","last_became_active":"2024-04-25T01:39:33.445949+0000","last_became_peered":"2024-04-25T01:39:33.445949+0000","last_unstale":"2024-04-25T01:43:54.187857+0000","last_undegraded":"2024-04-25T01:43:54.187857+0000","last_fullsized":"2024-04-25T01:43:54.187857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"30'196","reported_seq":239,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:06.573691+0000","last_change":"2024-04-25T01:44:06.573734+0000","last_active":"2024-04-25T01:44:06.573691+0000","last_peered":"2024-04-25T01:44:06.573691+0000","last_clean":"2024-04-25T01:44:06.573691+0000","last_became_active":"2024-04-25T01:39:24.379591+0000","last_became_peered":"2024-04-25T01:39:24.379591+0000","last_unstale":"2024-04-25T01:44:06.573691+0000","last_undegraded":"2024-04-25T01:44:06.573691+0000","last_fullsized":"2024-04-25T01:44:06.573691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'196","last_scrub_stamp":"2024-04-25T01:44:06.573550+0000","last_deep_scrub":"30'196","last_deep_scrub_stamp":"2024-04-25T01:44:06.573550+0000","last_clean_scrub_stamp":"2024-04-25T01:44:06.573550+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:07.137212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"30'233","reported_seq":260,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:54.622929+0000","last_change":"2024-04-25T01:39:33.439702+0000","last_active":"2024-04-25T01:43:54.622929+0000","last_peered":"2024-04-25T01:43:54.622929+0000","last_clean":"2024-04-25T01:43:54.622929+0000","last_became_active":"2024-04-25T01:39:33.439424+0000","last_became_peered":"2024-04-25T01:39:33.439424+0000","last_unstale":"2024-04-25T01:43:54.622929+0000","last_undegraded":"2024-04-25T01:43:54.622929+0000","last_fullsized":"2024-04-25T01:43:54.622929+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"30'179","reported_seq":222,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:58.331752+0000","last_change":"2024-04-25T01:43:58.331752+0000","last_active":"2024-04-25T01:43:58.331752+0000","last_peered":"2024-04-25T01:43:58.331752+0000","last_clean":"2024-04-25T01:43:58.331752+0000","last_became_active":"2024-04-25T01:39:24.392605+0000","last_became_peered":"2024-04-25T01:39:24.392605+0000","last_unstale":"2024-04-25T01:43:58.331752+0000","last_undegraded":"2024-04-25T01:43:58.331752+0000","last_fullsized":"2024-04-25T01:43:58.331752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'179","last_scrub_stamp":"2024-04-25T01:43:58.331586+0000","last_deep_scrub":"30'179","last_deep_scrub_stamp":"2024-04-25T01:43:58.331586+0000","last_clean_scrub_stamp":"2024-04-25T01:43:58.331586+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:02:30.792195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"30'166","reported_seq":201,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:09.605948+0000","last_change":"2024-04-25T01:44:09.605991+0000","last_active":"2024-04-25T01:44:09.605948+0000","last_peered":"2024-04-25T01:44:09.605948+0000","last_clean":"2024-04-25T01:44:09.605948+0000","last_became_active":"2024-04-25T01:39:33.437795+0000","last_became_peered":"2024-04-25T01:39:33.437795+0000","last_unstale":"2024-04-25T01:44:09.605948+0000","last_undegraded":"2024-04-25T01:44:09.605948+0000","last_fullsized":"2024-04-25T01:44:09.605948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'166","last_scrub_stamp":"2024-04-25T01:44:09.605841+0000","last_deep_scrub":"30'166","last_deep_scrub_stamp":"2024-04-25T01:44:09.605841+0000","last_clean_scrub_stamp":"2024-04-25T01:44:09.605841+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:29.588591+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"30'199","reported_seq":242,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:06.882503+0000","last_change":"2024-04-25T01:44:06.882503+0000","last_active":"2024-04-25T01:44:06.882503+0000","last_peered":"2024-04-25T01:44:06.882503+0000","last_clean":"2024-04-25T01:44:06.882503+0000","last_became_active":"2024-04-25T01:39:24.390978+0000","last_became_peered":"2024-04-25T01:39:24.390978+0000","last_unstale":"2024-04-25T01:44:06.882503+0000","last_undegraded":"2024-04-25T01:44:06.882503+0000","last_fullsized":"2024-04-25T01:44:06.882503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'199","last_scrub_stamp":"2024-04-25T01:44:06.882378+0000","last_deep_scrub":"30'199","last_deep_scrub_stamp":"2024-04-25T01:44:06.882378+0000","last_clean_scrub_stamp":"2024-04-25T01:44:06.882378+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:54.683563+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"30'197","reported_seq":231,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:10.096828+0000","last_change":"2024-04-25T01:44:10.096851+0000","last_active":"2024-04-25T01:44:10.096828+0000","last_peered":"2024-04-25T01:44:10.096828+0000","last_clean":"2024-04-25T01:44:10.096828+0000","last_became_active":"2024-04-25T01:39:33.430982+0000","last_became_peered":"2024-04-25T01:39:33.430982+0000","last_unstale":"2024-04-25T01:44:10.096828+0000","last_undegraded":"2024-04-25T01:44:10.096828+0000","last_fullsized":"2024-04-25T01:44:10.096828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'197","last_scrub_stamp":"2024-04-25T01:44:10.096746+0000","last_deep_scrub":"30'197","last_deep_scrub_stamp":"2024-04-25T01:44:10.096746+0000","last_clean_scrub_stamp":"2024-04-25T01:44:10.096746+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:42:33.919070+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"30'161","reported_seq":204,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:54.716946+0000","last_change":"2024-04-25T01:43:54.716946+0000","last_active":"2024-04-25T01:43:54.716946+0000","last_peered":"2024-04-25T01:43:54.716946+0000","last_clean":"2024-04-25T01:43:54.716946+0000","last_became_active":"2024-04-25T01:39:24.399011+0000","last_became_peered":"2024-04-25T01:39:24.399011+0000","last_unstale":"2024-04-25T01:43:54.716946+0000","last_undegraded":"2024-04-25T01:43:54.716946+0000","last_fullsized":"2024-04-25T01:43:54.716946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'161","last_scrub_stamp":"2024-04-25T01:43:54.716825+0000","last_deep_scrub":"30'161","last_deep_scrub_stamp":"2024-04-25T01:43:54.716825+0000","last_clean_scrub_stamp":"2024-04-25T01:43:54.716825+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:36.557149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"30'187","reported_seq":221,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:10.318229+0000","last_change":"2024-04-25T01:44:10.318255+0000","last_active":"2024-04-25T01:44:10.318229+0000","last_peered":"2024-04-25T01:44:10.318229+0000","last_clean":"2024-04-25T01:44:10.318229+0000","last_became_active":"2024-04-25T01:39:33.443608+0000","last_became_peered":"2024-04-25T01:39:33.443608+0000","last_unstale":"2024-04-25T01:44:10.318229+0000","last_undegraded":"2024-04-25T01:44:10.318229+0000","last_fullsized":"2024-04-25T01:44:10.318229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'187","last_scrub_stamp":"2024-04-25T01:44:10.318137+0000","last_deep_scrub":"30'187","last_deep_scrub_stamp":"2024-04-25T01:44:10.318137+0000","last_clean_scrub_stamp":"2024-04-25T01:44:10.318137+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:22:56.984594+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"30'178","reported_seq":221,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:55.212398+0000","last_change":"2024-04-25T01:43:55.212398+0000","last_active":"2024-04-25T01:43:55.212398+0000","last_peered":"2024-04-25T01:43:55.212398+0000","last_clean":"2024-04-25T01:43:55.212398+0000","last_became_active":"2024-04-25T01:39:24.388690+0000","last_became_peered":"2024-04-25T01:39:24.388690+0000","last_unstale":"2024-04-25T01:43:55.212398+0000","last_undegraded":"2024-04-25T01:43:55.212398+0000","last_fullsized":"2024-04-25T01:43:55.212398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'178","last_scrub_stamp":"2024-04-25T01:43:55.212286+0000","last_deep_scrub":"30'178","last_deep_scrub_stamp":"2024-04-25T01:43:55.212286+0000","last_clean_scrub_stamp":"2024-04-25T01:43:55.212286+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:49.318102+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"30'175","reported_seq":201,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.964949+0000","last_change":"2024-04-25T01:39:33.438460+0000","last_active":"2024-04-25T01:43:34.964949+0000","last_peered":"2024-04-25T01:43:34.964949+0000","last_clean":"2024-04-25T01:43:34.964949+0000","last_became_active":"2024-04-25T01:39:33.436581+0000","last_became_peered":"2024-04-25T01:39:33.436581+0000","last_unstale":"2024-04-25T01:43:34.964949+0000","last_undegraded":"2024-04-25T01:43:34.964949+0000","last_fullsized":"2024-04-25T01:43:34.964949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"30'181","reported_seq":224,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:03.739284+0000","last_change":"2024-04-25T01:44:03.739284+0000","last_active":"2024-04-25T01:44:03.739284+0000","last_peered":"2024-04-25T01:44:03.739284+0000","last_clean":"2024-04-25T01:44:03.739284+0000","last_became_active":"2024-04-25T01:39:24.389254+0000","last_became_peered":"2024-04-25T01:39:24.389254+0000","last_unstale":"2024-04-25T01:44:03.739284+0000","last_undegraded":"2024-04-25T01:44:03.739284+0000","last_fullsized":"2024-04-25T01:44:03.739284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'181","last_scrub_stamp":"2024-04-25T01:44:03.739156+0000","last_deep_scrub":"30'181","last_deep_scrub_stamp":"2024-04-25T01:44:03.739156+0000","last_clean_scrub_stamp":"2024-04-25T01:44:03.739156+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:45:47.919671+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"30'237","reported_seq":271,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:01.538619+0000","last_change":"2024-04-25T01:44:01.538666+0000","last_active":"2024-04-25T01:44:01.538619+0000","last_peered":"2024-04-25T01:44:01.538619+0000","last_clean":"2024-04-25T01:44:01.538619+0000","last_became_active":"2024-04-25T01:39:33.433577+0000","last_became_peered":"2024-04-25T01:39:33.433577+0000","last_unstale":"2024-04-25T01:44:01.538619+0000","last_undegraded":"2024-04-25T01:44:01.538619+0000","last_fullsized":"2024-04-25T01:44:01.538619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'237","last_scrub_stamp":"2024-04-25T01:44:01.538514+0000","last_deep_scrub":"30'237","last_deep_scrub_stamp":"2024-04-25T01:44:01.538514+0000","last_clean_scrub_stamp":"2024-04-25T01:44:01.538514+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:42:59.494783+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"30'187","reported_seq":229,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:05.440888+0000","last_change":"2024-04-25T01:44:05.440951+0000","last_active":"2024-04-25T01:44:05.440888+0000","last_peered":"2024-04-25T01:44:05.440888+0000","last_clean":"2024-04-25T01:44:05.440888+0000","last_became_active":"2024-04-25T01:39:24.391352+0000","last_became_peered":"2024-04-25T01:39:24.391352+0000","last_unstale":"2024-04-25T01:44:05.440888+0000","last_undegraded":"2024-04-25T01:44:05.440888+0000","last_fullsized":"2024-04-25T01:44:05.440888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'187","last_scrub_stamp":"2024-04-25T01:44:05.440790+0000","last_deep_scrub":"30'187","last_deep_scrub_stamp":"2024-04-25T01:44:05.440790+0000","last_clean_scrub_stamp":"2024-04-25T01:44:05.440790+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:17:40.666618+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"30'186","reported_seq":212,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.704861+0000","last_change":"2024-04-25T01:39:33.436641+0000","last_active":"2024-04-25T01:43:34.704861+0000","last_peered":"2024-04-25T01:43:34.704861+0000","last_clean":"2024-04-25T01:43:34.704861+0000","last_became_active":"2024-04-25T01:39:33.436389+0000","last_became_peered":"2024-04-25T01:39:33.436389+0000","last_unstale":"2024-04-25T01:43:34.704861+0000","last_undegraded":"2024-04-25T01:43:34.704861+0000","last_fullsized":"2024-04-25T01:43:34.704861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"30'169","reported_seq":211,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:06.289681+0000","last_change":"2024-04-25T01:44:06.289707+0000","last_active":"2024-04-25T01:44:06.289681+0000","last_peered":"2024-04-25T01:44:06.289681+0000","last_clean":"2024-04-25T01:44:06.289681+0000","last_became_active":"2024-04-25T01:39:24.396023+0000","last_became_peered":"2024-04-25T01:39:24.396023+0000","last_unstale":"2024-04-25T01:44:06.289681+0000","last_undegraded":"2024-04-25T01:44:06.289681+0000","last_fullsized":"2024-04-25T01:44:06.289681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'169","last_scrub_stamp":"2024-04-25T01:44:06.289589+0000","last_deep_scrub":"30'169","last_deep_scrub_stamp":"2024-04-25T01:44:06.289589+0000","last_clean_scrub_stamp":"2024-04-25T01:44:06.289589+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:21.571404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"30'186","reported_seq":220,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:05.292327+0000","last_change":"2024-04-25T01:44:05.292355+0000","last_active":"2024-04-25T01:44:05.292327+0000","last_peered":"2024-04-25T01:44:05.292327+0000","last_clean":"2024-04-25T01:44:05.292327+0000","last_became_active":"2024-04-25T01:39:33.443163+0000","last_became_peered":"2024-04-25T01:39:33.443163+0000","last_unstale":"2024-04-25T01:44:05.292327+0000","last_undegraded":"2024-04-25T01:44:05.292327+0000","last_fullsized":"2024-04-25T01:44:05.292327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'186","last_scrub_stamp":"2024-04-25T01:44:05.292231+0000","last_deep_scrub":"30'186","last_deep_scrub_stamp":"2024-04-25T01:44:05.292231+0000","last_clean_scrub_stamp":"2024-04-25T01:44:05.292231+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:18:15.632592+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"30'212","reported_seq":254,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:55.105961+0000","last_change":"2024-04-25T01:43:55.105989+0000","last_active":"2024-04-25T01:43:55.105961+0000","last_peered":"2024-04-25T01:43:55.105961+0000","last_clean":"2024-04-25T01:43:55.105961+0000","last_became_active":"2024-04-25T01:39:24.403700+0000","last_became_peered":"2024-04-25T01:39:24.403700+0000","last_unstale":"2024-04-25T01:43:55.105961+0000","last_undegraded":"2024-04-25T01:43:55.105961+0000","last_fullsized":"2024-04-25T01:43:55.105961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'212","last_scrub_stamp":"2024-04-25T01:43:55.105868+0000","last_deep_scrub":"30'212","last_deep_scrub_stamp":"2024-04-25T01:43:55.105868+0000","last_clean_scrub_stamp":"2024-04-25T01:43:55.105868+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:40.542257+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":491520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"30'177","reported_seq":211,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:03.535713+0000","last_change":"2024-04-25T01:44:03.535742+0000","last_active":"2024-04-25T01:44:03.535713+0000","last_peered":"2024-04-25T01:44:03.535713+0000","last_clean":"2024-04-25T01:44:03.535713+0000","last_became_active":"2024-04-25T01:39:33.434446+0000","last_became_peered":"2024-04-25T01:39:33.434446+0000","last_unstale":"2024-04-25T01:44:03.535713+0000","last_undegraded":"2024-04-25T01:44:03.535713+0000","last_fullsized":"2024-04-25T01:44:03.535713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'177","last_scrub_stamp":"2024-04-25T01:44:03.535611+0000","last_deep_scrub":"30'177","last_deep_scrub_stamp":"2024-04-25T01:44:03.535611+0000","last_clean_scrub_stamp":"2024-04-25T01:44:03.535611+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:12:29.106608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"30'183","reported_seq":222,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:46.884431+0000","last_change":"2024-04-25T01:40:05.559200+0000","last_active":"2024-04-25T01:43:46.884431+0000","last_peered":"2024-04-25T01:43:46.884431+0000","last_clean":"2024-04-25T01:43:46.884431+0000","last_became_active":"2024-04-25T01:40:05.558954+0000","last_became_peered":"2024-04-25T01:40:05.558954+0000","last_unstale":"2024-04-25T01:43:46.884431+0000","last_undegraded":"2024-04-25T01:43:46.884431+0000","last_fullsized":"2024-04-25T01:43:46.884431+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:23.350604+0000","last_clean_scrub_stamp":"2024-04-25T01:39:23.350604+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"30'191","reported_seq":225,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:03.924625+0000","last_change":"2024-04-25T01:44:03.924649+0000","last_active":"2024-04-25T01:44:03.924625+0000","last_peered":"2024-04-25T01:44:03.924625+0000","last_clean":"2024-04-25T01:44:03.924625+0000","last_became_active":"2024-04-25T01:39:33.436193+0000","last_became_peered":"2024-04-25T01:39:33.436193+0000","last_unstale":"2024-04-25T01:44:03.924625+0000","last_undegraded":"2024-04-25T01:44:03.924625+0000","last_fullsized":"2024-04-25T01:44:03.924625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'191","last_scrub_stamp":"2024-04-25T01:44:03.924530+0000","last_deep_scrub":"30'191","last_deep_scrub_stamp":"2024-04-25T01:44:03.924530+0000","last_clean_scrub_stamp":"2024-04-25T01:44:03.924530+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:58:37.445651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"30'179","reported_seq":221,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:55.522232+0000","last_change":"2024-04-25T01:43:55.522282+0000","last_active":"2024-04-25T01:43:55.522232+0000","last_peered":"2024-04-25T01:43:55.522232+0000","last_clean":"2024-04-25T01:43:55.522232+0000","last_became_active":"2024-04-25T01:39:24.392836+0000","last_became_peered":"2024-04-25T01:39:24.392836+0000","last_unstale":"2024-04-25T01:43:55.522232+0000","last_undegraded":"2024-04-25T01:43:55.522232+0000","last_fullsized":"2024-04-25T01:43:55.522232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'179","last_scrub_stamp":"2024-04-25T01:43:55.522128+0000","last_deep_scrub":"30'179","last_deep_scrub_stamp":"2024-04-25T01:43:55.522128+0000","last_clean_scrub_stamp":"2024-04-25T01:43:55.522128+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:31.871799+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"30'168","reported_seq":195,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:47.498709+0000","last_change":"2024-04-25T01:39:33.440164+0000","last_active":"2024-04-25T01:43:47.498709+0000","last_peered":"2024-04-25T01:43:47.498709+0000","last_clean":"2024-04-25T01:43:47.498709+0000","last_became_active":"2024-04-25T01:39:33.439878+0000","last_became_peered":"2024-04-25T01:39:33.439878+0000","last_unstale":"2024-04-25T01:43:47.498709+0000","last_undegraded":"2024-04-25T01:43:47.498709+0000","last_fullsized":"2024-04-25T01:43:47.498709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"30'207","reported_seq":249,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:59.319240+0000","last_change":"2024-04-25T01:43:59.319266+0000","last_active":"2024-04-25T01:43:59.319240+0000","last_peered":"2024-04-25T01:43:59.319240+0000","last_clean":"2024-04-25T01:43:59.319240+0000","last_became_active":"2024-04-25T01:39:24.400509+0000","last_became_peered":"2024-04-25T01:39:24.400509+0000","last_unstale":"2024-04-25T01:43:59.319240+0000","last_undegraded":"2024-04-25T01:43:59.319240+0000","last_fullsized":"2024-04-25T01:43:59.319240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'207","last_scrub_stamp":"2024-04-25T01:43:59.319138+0000","last_deep_scrub":"30'207","last_deep_scrub_stamp":"2024-04-25T01:43:59.319138+0000","last_clean_scrub_stamp":"2024-04-25T01:43:59.319138+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:52.582377+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":491520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"30'180","reported_seq":215,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:09.200943+0000","last_change":"2024-04-25T01:44:09.200966+0000","last_active":"2024-04-25T01:44:09.200943+0000","last_peered":"2024-04-25T01:44:09.200943+0000","last_clean":"2024-04-25T01:44:09.200943+0000","last_became_active":"2024-04-25T01:39:33.438915+0000","last_became_peered":"2024-04-25T01:39:33.438915+0000","last_unstale":"2024-04-25T01:44:09.200943+0000","last_undegraded":"2024-04-25T01:44:09.200943+0000","last_fullsized":"2024-04-25T01:44:09.200943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'180","last_scrub_stamp":"2024-04-25T01:44:09.200857+0000","last_deep_scrub":"30'180","last_deep_scrub_stamp":"2024-04-25T01:44:09.200857+0000","last_clean_scrub_stamp":"2024-04-25T01:44:09.200857+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:52.478932+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"30'197","reported_seq":239,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:02.512463+0000","last_change":"2024-04-25T01:44:02.512491+0000","last_active":"2024-04-25T01:44:02.512463+0000","last_peered":"2024-04-25T01:44:02.512463+0000","last_clean":"2024-04-25T01:44:02.512463+0000","last_became_active":"2024-04-25T01:39:24.387674+0000","last_became_peered":"2024-04-25T01:39:24.387674+0000","last_unstale":"2024-04-25T01:44:02.512463+0000","last_undegraded":"2024-04-25T01:44:02.512463+0000","last_fullsized":"2024-04-25T01:44:02.512463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'197","last_scrub_stamp":"2024-04-25T01:44:02.512351+0000","last_deep_scrub":"30'197","last_deep_scrub_stamp":"2024-04-25T01:44:02.512351+0000","last_clean_scrub_stamp":"2024-04-25T01:44:02.512351+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:09.012294+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"30'205","reported_seq":232,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:37.396441+0000","last_change":"2024-04-25T01:39:33.444917+0000","last_active":"2024-04-25T01:43:37.396441+0000","last_peered":"2024-04-25T01:43:37.396441+0000","last_clean":"2024-04-25T01:43:37.396441+0000","last_became_active":"2024-04-25T01:39:33.444636+0000","last_became_peered":"2024-04-25T01:39:33.444636+0000","last_unstale":"2024-04-25T01:43:37.396441+0000","last_undegraded":"2024-04-25T01:43:37.396441+0000","last_fullsized":"2024-04-25T01:43:37.396441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"30'159","reported_seq":201,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:57.835064+0000","last_change":"2024-04-25T01:43:57.835088+0000","last_active":"2024-04-25T01:43:57.835064+0000","last_peered":"2024-04-25T01:43:57.835064+0000","last_clean":"2024-04-25T01:43:57.835064+0000","last_became_active":"2024-04-25T01:39:24.399701+0000","last_became_peered":"2024-04-25T01:39:24.399701+0000","last_unstale":"2024-04-25T01:43:57.835064+0000","last_undegraded":"2024-04-25T01:43:57.835064+0000","last_fullsized":"2024-04-25T01:43:57.835064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'159","last_scrub_stamp":"2024-04-25T01:43:57.834971+0000","last_deep_scrub":"30'159","last_deep_scrub_stamp":"2024-04-25T01:43:57.834971+0000","last_clean_scrub_stamp":"2024-04-25T01:43:57.834971+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:42.596971+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"30'193","reported_seq":220,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:47.125388+0000","last_change":"2024-04-25T01:39:33.440936+0000","last_active":"2024-04-25T01:43:47.125388+0000","last_peered":"2024-04-25T01:43:47.125388+0000","last_clean":"2024-04-25T01:43:47.125388+0000","last_became_active":"2024-04-25T01:39:33.440679+0000","last_became_peered":"2024-04-25T01:39:33.440679+0000","last_unstale":"2024-04-25T01:43:47.125388+0000","last_undegraded":"2024-04-25T01:43:47.125388+0000","last_fullsized":"2024-04-25T01:43:47.125388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"30'177","reported_seq":219,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:04.544021+0000","last_change":"2024-04-25T01:44:04.544045+0000","last_active":"2024-04-25T01:44:04.544021+0000","last_peered":"2024-04-25T01:44:04.544021+0000","last_clean":"2024-04-25T01:44:04.544021+0000","last_became_active":"2024-04-25T01:39:24.379573+0000","last_became_peered":"2024-04-25T01:39:24.379573+0000","last_unstale":"2024-04-25T01:44:04.544021+0000","last_undegraded":"2024-04-25T01:44:04.544021+0000","last_fullsized":"2024-04-25T01:44:04.544021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'177","last_scrub_stamp":"2024-04-25T01:44:04.543926+0000","last_deep_scrub":"30'177","last_deep_scrub_stamp":"2024-04-25T01:44:04.543926+0000","last_clean_scrub_stamp":"2024-04-25T01:44:04.543926+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:39.797238+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"30'176","reported_seq":210,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:04.425520+0000","last_change":"2024-04-25T01:44:04.425570+0000","last_active":"2024-04-25T01:44:04.425520+0000","last_peered":"2024-04-25T01:44:04.425520+0000","last_clean":"2024-04-25T01:44:04.425520+0000","last_became_active":"2024-04-25T01:39:33.426090+0000","last_became_peered":"2024-04-25T01:39:33.426090+0000","last_unstale":"2024-04-25T01:44:04.425520+0000","last_undegraded":"2024-04-25T01:44:04.425520+0000","last_fullsized":"2024-04-25T01:44:04.425520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'176","last_scrub_stamp":"2024-04-25T01:44:04.425420+0000","last_deep_scrub":"30'176","last_deep_scrub_stamp":"2024-04-25T01:44:04.425420+0000","last_clean_scrub_stamp":"2024-04-25T01:44:04.425420+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:37:40.742324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"30'192","reported_seq":235,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:56.791201+0000","last_change":"2024-04-25T01:43:56.791271+0000","last_active":"2024-04-25T01:43:56.791201+0000","last_peered":"2024-04-25T01:43:56.791201+0000","last_clean":"2024-04-25T01:43:56.791201+0000","last_became_active":"2024-04-25T01:39:24.398449+0000","last_became_peered":"2024-04-25T01:39:24.398449+0000","last_unstale":"2024-04-25T01:43:56.791201+0000","last_undegraded":"2024-04-25T01:43:56.791201+0000","last_fullsized":"2024-04-25T01:43:56.791201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'192","last_scrub_stamp":"2024-04-25T01:43:56.791099+0000","last_deep_scrub":"30'192","last_deep_scrub_stamp":"2024-04-25T01:43:56.791099+0000","last_clean_scrub_stamp":"2024-04-25T01:43:56.791099+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:54.917826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"30'187","reported_seq":221,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:00.289040+0000","last_change":"2024-04-25T01:44:00.289098+0000","last_active":"2024-04-25T01:44:00.289040+0000","last_peered":"2024-04-25T01:44:00.289040+0000","last_clean":"2024-04-25T01:44:00.289040+0000","last_became_active":"2024-04-25T01:39:33.436224+0000","last_became_peered":"2024-04-25T01:39:33.436224+0000","last_unstale":"2024-04-25T01:44:00.289040+0000","last_undegraded":"2024-04-25T01:44:00.289040+0000","last_fullsized":"2024-04-25T01:44:00.289040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'187","last_scrub_stamp":"2024-04-25T01:44:00.288895+0000","last_deep_scrub":"30'187","last_deep_scrub_stamp":"2024-04-25T01:44:00.288895+0000","last_clean_scrub_stamp":"2024-04-25T01:44:00.288895+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:38.338401+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"30'175","reported_seq":218,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:59.728862+0000","last_change":"2024-04-25T01:43:59.728909+0000","last_active":"2024-04-25T01:43:59.728862+0000","last_peered":"2024-04-25T01:43:59.728862+0000","last_clean":"2024-04-25T01:43:59.728862+0000","last_became_active":"2024-04-25T01:39:24.386568+0000","last_became_peered":"2024-04-25T01:39:24.386568+0000","last_unstale":"2024-04-25T01:43:59.728862+0000","last_undegraded":"2024-04-25T01:43:59.728862+0000","last_fullsized":"2024-04-25T01:43:59.728862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'175","last_scrub_stamp":"2024-04-25T01:43:59.728720+0000","last_deep_scrub":"30'175","last_deep_scrub_stamp":"2024-04-25T01:43:59.728720+0000","last_clean_scrub_stamp":"2024-04-25T01:43:59.728720+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:52.823655+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"30'223","reported_seq":249,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:34.760566+0000","last_change":"2024-04-25T01:39:33.440753+0000","last_active":"2024-04-25T01:43:34.760566+0000","last_peered":"2024-04-25T01:43:34.760566+0000","last_clean":"2024-04-25T01:43:34.760566+0000","last_became_active":"2024-04-25T01:39:33.440480+0000","last_became_peered":"2024-04-25T01:39:33.440480+0000","last_unstale":"2024-04-25T01:43:34.760566+0000","last_undegraded":"2024-04-25T01:43:34.760566+0000","last_fullsized":"2024-04-25T01:43:34.760566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:39:32.407403+0000","last_clean_scrub_stamp":"2024-04-25T01:39:32.407403+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"30'160","reported_seq":203,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:57.233813+0000","last_change":"2024-04-25T01:43:57.233837+0000","last_active":"2024-04-25T01:43:57.233813+0000","last_peered":"2024-04-25T01:43:57.233813+0000","last_clean":"2024-04-25T01:43:57.233813+0000","last_became_active":"2024-04-25T01:39:24.386531+0000","last_became_peered":"2024-04-25T01:39:24.386531+0000","last_unstale":"2024-04-25T01:43:57.233813+0000","last_undegraded":"2024-04-25T01:43:57.233813+0000","last_fullsized":"2024-04-25T01:43:57.233813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'160","last_scrub_stamp":"2024-04-25T01:43:57.233727+0000","last_deep_scrub":"30'160","last_deep_scrub_stamp":"2024-04-25T01:43:57.233727+0000","last_clean_scrub_stamp":"2024-04-25T01:43:57.233727+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:41.047375+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"30'214","reported_seq":248,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:44:05.575744+0000","last_change":"2024-04-25T01:44:05.575773+0000","last_active":"2024-04-25T01:44:05.575744+0000","last_peered":"2024-04-25T01:44:05.575744+0000","last_clean":"2024-04-25T01:44:05.575744+0000","last_became_active":"2024-04-25T01:39:33.436134+0000","last_became_peered":"2024-04-25T01:39:33.436134+0000","last_unstale":"2024-04-25T01:44:05.575744+0000","last_undegraded":"2024-04-25T01:44:05.575744+0000","last_fullsized":"2024-04-25T01:44:05.575744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'214","last_scrub_stamp":"2024-04-25T01:44:05.575639+0000","last_deep_scrub":"30'214","last_deep_scrub_stamp":"2024-04-25T01:44:05.575639+0000","last_clean_scrub_stamp":"2024-04-25T01:44:05.575639+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:25.075860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"30'170","reported_seq":213,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T01:43:59.535698+0000","last_change":"2024-04-25T01:43:59.535762+0000","last_active":"2024-04-25T01:43:59.535698+0000","last_peered":"2024-04-25T01:43:59.535698+0000","last_clean":"2024-04-25T01:43:59.535698+0000","last_became_active":"2024-04-25T01:39:24.395958+0000","last_became_peered":"2024-04-25T01:39:24.395958+0000","last_unstale":"2024-04-25T01:43:59.535698+0000","last_undegraded":"2024-04-25T01:43:59.535698+0000","last_fullsized":"2024-04-25T01:43:59.535698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'170","last_scrub_stamp":"2024-04-25T01:43:59.535576+0000","last_deep_scrub":"30'170","last_deep_scrub_stamp":"2024-04-25T01:43:59.535576+0000","last_clean_scrub_stamp":"2024-04-25T01:43:59.535576+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:37:28.417859+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12101,"ondisk_log_size":12101,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":7961223,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":239,"num_read_kb":8015,"num_write":3918,"num_write_kb":11482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15990784,"data_stored":15922446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3937,"ondisk_log_size":3937,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11255,"ondisk_log_size":11255,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8001563,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":165,"num_read_kb":215,"num_write":3944,"num_write_kb":11544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16072704,"data_stored":16003126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3951,"ondisk_log_size":3951,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574912,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67676,"kb_used_data":4628,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94304164,"statfs":{"total":96636764160,"available":96567463936,"internally_reserved":0,"allocated":4739072,"data_stored":4538287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":64551370},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574911,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61976,"kb_used_data":4432,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94309864,"statfs":{"total":96636764160,"available":96573300736,"internally_reserved":0,"allocated":4538368,"data_stored":4337555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45400,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326440,"statfs":{"total":96636764160,"available":96590274560,"internally_reserved":0,"allocated":344064,"data_stored":143129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574912,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67072,"kb_used_data":4024,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94304768,"statfs":{"total":96636764160,"available":96568082432,"internally_reserved":0,"allocated":4120576,"data_stored":3907642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574912,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123400,"kb_used_data":15936,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94248440,"statfs":{"total":96636764160,"available":96510402560,"internally_reserved":0,"allocated":16318464,"data_stored":16102771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":110033351},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574912,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57872,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313968,"statfs":{"total":96636764160,"available":96577503232,"internally_reserved":0,"allocated":335872,"data_stored":142538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49500,"kb_used_data":4436,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94322340,"statfs":{"total":96636764160,"available":96586076160,"internally_reserved":0,"allocated":4542464,"data_stored":4337121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574912,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62616,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94309224,"statfs":{"total":96636764160,"available":96572645376,"internally_reserved":0,"allocated":933888,"data_stored":732969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8015872,"data_stored":8000765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3813376,"data_stored":3805866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4194998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7974912,"data_stored":7960043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3780608,"data_stored":3765553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T01:44:16.200 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.200 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.200 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.201 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.201 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.201 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.201 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.201 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.201 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.202 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.202 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T01:39:22.345120+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.202 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.202 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.203 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.203 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.203 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.203 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.203 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.203 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.203 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.204 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.204 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.204 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.204 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.204 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.205 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.205 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.205 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.205 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.205 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.205 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.205 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.205 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.205 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.206 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.206 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.206 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.206 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.206 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.206 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-25T01:39:23.350604+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.207 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.207 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.207 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.207 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2024-04-25T01:39:32.407403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=39, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=1, tm_min=43, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T01:44:16.207 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T01:44:16.520 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:44:16.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.629+0000 7efc6aa7d640 1 Processor -- start 2024-04-25T01:44:16.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.629+0000 7efc6aa7d640 1 -- start start 2024-04-25T01:44:16.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.630+0000 7efc6aa7d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7efc64150320 0x7efc64156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:16.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.630+0000 7efc6aa7d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efc6406d0a0 0x7efc6406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:16.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.630+0000 7efc6aa7d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc64153be0 con 0x7efc64154380 2024-04-25T01:44:16.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.630+0000 7efc6aa7d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7efc64152fd0 con 0x7efc6406d0a0 2024-04-25T01:44:16.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.630+0000 7efc6aa7d640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7efc641532b0 con 0x7efc64150320 2024-04-25T01:44:16.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.630+0000 7efc63fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efc6406d0a0 0x7efc6406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:16.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.630+0000 7efc6901a640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7efc64154380 0x7efc64154830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:37988/0 (socket says 172.21.15.77:37988) 2024-04-25T01:44:16.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.630+0000 7efc63fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efc6406d0a0 0x7efc6406d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43930/0 (socket says 172.21.15.77:43930) 2024-04-25T01:44:16.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.630+0000 7efc6901a640 1 -- 172.21.15.77:0/249668642 learned_addr learned my addr 172.21.15.77:0/249668642 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:44:16.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.630+0000 7efc68819640 1 --2- 172.21.15.77:0/249668642 >> v2:172.21.15.121:3300/0 conn(0x7efc64150320 0x7efc64156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:16.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.630+0000 7efc63fff640 1 -- 172.21.15.77:0/249668642 >> v2:172.21.15.121:3300/0 conn(0x7efc64150320 msgr2=0x7efc64156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:16.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.630+0000 7efc63fff640 1 --2- 172.21.15.77:0/249668642 >> v2:172.21.15.121:3300/0 conn(0x7efc64150320 0x7efc64156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:16.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.630+0000 7efc63fff640 1 -- 172.21.15.77:0/249668642 >> v1:172.21.15.77:6789/0 conn(0x7efc64154380 legacy=0x7efc64154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:16.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.630+0000 7efc63fff640 1 -- 172.21.15.77:0/249668642 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc64157100 con 0x7efc6406d0a0 2024-04-25T01:44:16.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.630+0000 7efc637fe640 1 -- 172.21.15.77:0/249668642 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3228646947 0 0) 0x7efc64153be0 con 0x7efc64154380 2024-04-25T01:44:16.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.631+0000 7efc63fff640 1 --2- 172.21.15.77:0/249668642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6406d0a0 0x7efc6406d4e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7efc6406db60 tx=0x7efc5802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0318fad8adcb6b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:16.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.631+0000 7efc637fe640 1 -- 172.21.15.77:0/249668642 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc58037070 con 0x7efc6406d0a0 2024-04-25T01:44:16.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.631+0000 7efc637fe640 1 -- 172.21.15.77:0/249668642 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc58032440 con 0x7efc6406d0a0 2024-04-25T01:44:16.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.631+0000 7efc637fe640 1 -- 172.21.15.77:0/249668642 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5802ae60 con 0x7efc6406d0a0 2024-04-25T01:44:16.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.632+0000 7efc6aa7d640 1 -- 172.21.15.77:0/249668642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6406d0a0 msgr2=0x7efc6406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:16.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.632+0000 7efc6aa7d640 1 --2- 172.21.15.77:0/249668642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6406d0a0 0x7efc6406d4e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7efc6406db60 tx=0x7efc5802a110 comp rx=0 tx=0).stop 2024-04-25T01:44:16.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.632+0000 7efc6aa7d640 1 -- 172.21.15.77:0/249668642 shutdown_connections 2024-04-25T01:44:16.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.632+0000 7efc6aa7d640 1 --2- 172.21.15.77:0/249668642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6406d0a0 0x7efc6406d4e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:16.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.632+0000 7efc6aa7d640 1 --2- 172.21.15.77:0/249668642 >> v2:172.21.15.121:3300/0 conn(0x7efc64150320 0x7efc64156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:16.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.632+0000 7efc6aa7d640 1 -- 172.21.15.77:0/249668642 >> 172.21.15.77:0/249668642 conn(0x7efc640c3f80 msgr2=0x7efc640c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:16.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.632+0000 7efc6aa7d640 1 -- 172.21.15.77:0/249668642 shutdown_connections 2024-04-25T01:44:16.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.632+0000 7efc6aa7d640 1 -- 172.21.15.77:0/249668642 wait complete. 2024-04-25T01:44:16.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.633+0000 7efc6aa7d640 1 Processor -- start 2024-04-25T01:44:16.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.633+0000 7efc6aa7d640 1 -- start start 2024-04-25T01:44:16.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.634+0000 7efc6aa7d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efc6406d0a0 0x7efc640ab020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:16.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.634+0000 7efc6aa7d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc64150320 0x7efc64145980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:16.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.634+0000 7efc6aa7d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc64154380 0x7efc6415f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:16.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.634+0000 7efc6aa7d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efc64154f40 con 0x7efc64154380 2024-04-25T01:44:16.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.634+0000 7efc6aa7d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efc64153870 con 0x7efc64150320 2024-04-25T01:44:16.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.634+0000 7efc6aa7d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7efc64152bf0 con 0x7efc6406d0a0 2024-04-25T01:44:16.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.634+0000 7efc6901a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc64154380 0x7efc6415f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:16.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.634+0000 7efc6901a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc64154380 0x7efc6415f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43936/0 (socket says 172.21.15.77:43936) 2024-04-25T01:44:16.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.634+0000 7efc6901a640 1 -- 172.21.15.77:0/1291181864 learned_addr learned my addr 172.21.15.77:0/1291181864 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:16.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.634+0000 7efc6901a640 1 -- 172.21.15.77:0/1291181864 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efc6406d0a0 msgr2=0x7efc640ab020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:16.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.634+0000 7efc6901a640 1 --2- 172.21.15.77:0/1291181864 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efc6406d0a0 0x7efc640ab020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:16.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.634+0000 7efc6901a640 1 -- 172.21.15.77:0/1291181864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc64150320 msgr2=0x7efc64145980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:16.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.634+0000 7efc63fff640 1 --2- 172.21.15.77:0/1291181864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc64150320 0x7efc64145980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:16.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.634+0000 7efc6901a640 1 --2- 172.21.15.77:0/1291181864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc64150320 0x7efc64145980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:16.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.634+0000 7efc6901a640 1 -- 172.21.15.77:0/1291181864 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc6415e6b0 con 0x7efc64154380 2024-04-25T01:44:16.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.634+0000 7efc6901a640 1 --2- 172.21.15.77:0/1291181864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc64154380 0x7efc6415f4f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7efc5c00c7a0 tx=0x7efc5c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:16.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.634+0000 7efc617fa640 1 -- 172.21.15.77:0/1291181864 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5c018070 con 0x7efc64154380 2024-04-25T01:44:16.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.634+0000 7efc617fa640 1 -- 172.21.15.77:0/1291181864 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc5c00a640 con 0x7efc64154380 2024-04-25T01:44:16.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.634+0000 7efc617fa640 1 -- 172.21.15.77:0/1291181864 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5c00aa70 con 0x7efc64154380 2024-04-25T01:44:16.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.634+0000 7efc6aa7d640 1 -- 172.21.15.77:0/1291181864 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc6415e990 con 0x7efc64154380 2024-04-25T01:44:16.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.635+0000 7efc6aa7d640 1 -- 172.21.15.77:0/1291181864 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc64145ec0 con 0x7efc64154380 2024-04-25T01:44:16.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.636+0000 7efc6aa7d640 1 -- 172.21.15.77:0/1291181864 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc6404f500 con 0x7efc64154380 2024-04-25T01:44:16.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.636+0000 7efc617fa640 1 -- 172.21.15.77:0/1291181864 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efc5c01b070 con 0x7efc64154380 2024-04-25T01:44:16.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.636+0000 7efc617fa640 1 --2- 172.21.15.77:0/1291181864 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7efc5006be30 0x7efc5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:16.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.636+0000 7efc617fa640 1 -- 172.21.15.77:0/1291181864 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7efc5c08a980 con 0x7efc64154380 2024-04-25T01:44:16.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.636+0000 7efc68819640 1 --2- 172.21.15.77:0/1291181864 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7efc5006be30 0x7efc5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:16.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.637+0000 7efc68819640 1 --2- 172.21.15.77:0/1291181864 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7efc5006be30 0x7efc5006e2f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efc54006fd0 tx=0x7efc54008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:16.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.641+0000 7efc617fa640 1 -- 172.21.15.77:0/1291181864 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7efc5c058e70 con 0x7efc64154380 2024-04-25T01:44:16.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.848+0000 7efc6aa7d640 1 -- 172.21.15.77:0/1291181864 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc640ac5b0 con 0x7efc64154380 2024-04-25T01:44:16.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.848+0000 7efc617fa640 1 -- 172.21.15.77:0/1291181864 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+6485 (secure 0 0 0) 0x7efc5c058770 con 0x7efc64154380 2024-04-25T01:44:16.840 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:44:16.840 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1570919706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1570919706},{"type":"v1","addr":"172.21.15.77:6837","nonce":1570919706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:42:07.395274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5439":{"gid":5439,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5439,"qdb_cluster":[5439]},"id":1},{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:43:32.407370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":22,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5179,"qdb_cluster":[5179]},"id":2}]} 2024-04-25T01:44:16.840 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 33 2024-04-25T01:44:16.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.850+0000 7efc6aa7d640 1 -- 172.21.15.77:0/1291181864 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7efc5006be30 msgr2=0x7efc5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:16.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.850+0000 7efc6aa7d640 1 --2- 172.21.15.77:0/1291181864 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7efc5006be30 0x7efc5006e2f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efc54006fd0 tx=0x7efc54008040 comp rx=0 tx=0).stop 2024-04-25T01:44:16.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.850+0000 7efc6aa7d640 1 -- 172.21.15.77:0/1291181864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc64154380 msgr2=0x7efc6415f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:16.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.850+0000 7efc6aa7d640 1 --2- 172.21.15.77:0/1291181864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc64154380 0x7efc6415f4f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7efc5c00c7a0 tx=0x7efc5c00cc60 comp rx=0 tx=0).stop 2024-04-25T01:44:16.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.850+0000 7efc6aa7d640 1 -- 172.21.15.77:0/1291181864 shutdown_connections 2024-04-25T01:44:16.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.850+0000 7efc6aa7d640 1 --2- 172.21.15.77:0/1291181864 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7efc5006be30 0x7efc5006e2f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:16.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.850+0000 7efc6aa7d640 1 --2- 172.21.15.77:0/1291181864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc64154380 0x7efc6415f4f0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:16.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.850+0000 7efc6aa7d640 1 --2- 172.21.15.77:0/1291181864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc64150320 0x7efc64145980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:16.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.850+0000 7efc6aa7d640 1 --2- 172.21.15.77:0/1291181864 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efc6406d0a0 0x7efc640ab020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:16.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.850+0000 7efc6aa7d640 1 -- 172.21.15.77:0/1291181864 >> 172.21.15.77:0/1291181864 conn(0x7efc640c3f80 msgr2=0x7efc64150da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:16.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.850+0000 7efc6aa7d640 1 -- 172.21.15.77:0/1291181864 shutdown_connections 2024-04-25T01:44:16.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:16.850+0000 7efc6aa7d640 1 -- 172.21.15.77:0/1291181864 wait complete. 2024-04-25T01:44:16.853 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T01:44:18.854 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:44:18.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.972+0000 7fc882a72640 1 Processor -- start 2024-04-25T01:44:18.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.973+0000 7fc882a72640 1 -- start start 2024-04-25T01:44:18.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.973+0000 7fc882a72640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc87c06c280 0x7fc87c0c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:18.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.973+0000 7fc882a72640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc87c157130 con 0x7fc87c156c80 2024-04-25T01:44:18.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.973+0000 7fc882a72640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc87c0c89c0 con 0x7fc87c150090 2024-04-25T01:44:18.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.973+0000 7fc882a72640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc87c06b830 con 0x7fc87c06c280 2024-04-25T01:44:18.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.973+0000 7fc87bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc87c156c80 0x7fc87c0c98a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60200/0 (socket says 172.21.15.77:60200) 2024-04-25T01:44:18.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.973+0000 7fc87bfff640 1 -- 172.21.15.77:0/95638915 learned_addr learned my addr 172.21.15.77:0/95638915 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:44:18.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.974+0000 7fc88100f640 1 --2- 172.21.15.77:0/95638915 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc87c06c280 0x7fc87c0c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:18.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.974+0000 7fc87b7fe640 1 -- 172.21.15.77:0/95638915 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1399529650 0 0) 0x7fc870001110 con 0x7fc87c156c80 2024-04-25T01:44:18.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.974+0000 7fc87b7fe640 1 -- 172.21.15.77:0/95638915 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc864003520 con 0x7fc87c156c80 2024-04-25T01:44:18.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.974+0000 7fc87b7fe640 1 -- 172.21.15.77:0/95638915 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2897874876 0 0) 0x7fc87c0c89c0 con 0x7fc87c150090 2024-04-25T01:44:18.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.974+0000 7fc87b7fe640 1 -- 172.21.15.77:0/95638915 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc870001110 con 0x7fc87c150090 2024-04-25T01:44:18.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.974+0000 7fc87b7fe640 1 -- 172.21.15.77:0/95638915 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1501704968 0 0) 0x7fc864003520 con 0x7fc87c156c80 2024-04-25T01:44:18.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.974+0000 7fc87b7fe640 1 -- 172.21.15.77:0/95638915 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc87c06c280 msgr2=0x7fc87c0c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:18.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.974+0000 7fc87b7fe640 1 --2- 172.21.15.77:0/95638915 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc87c06c280 0x7fc87c0c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:18.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.974+0000 7fc87b7fe640 1 -- 172.21.15.77:0/95638915 >> v1:172.21.15.121:6789/0 conn(0x7fc87c150090 legacy=0x7fc87c0c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:18.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.974+0000 7fc87b7fe640 1 -- 172.21.15.77:0/95638915 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc87c0c8ca0 con 0x7fc87c156c80 2024-04-25T01:44:18.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.974+0000 7fc87b7fe640 1 -- 172.21.15.77:0/95638915 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7fc870001840 con 0x7fc87c156c80 2024-04-25T01:44:18.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.974+0000 7fc87b7fe640 1 -- 172.21.15.77:0/95638915 >> v1:172.21.15.77:6789/0 conn(0x7fc87c156c80 legacy=0x7fc87c0c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:18.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.974+0000 7fc87b7fe640 1 --2- 172.21.15.77:0/95638915 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc87c06c280 0x7fc864003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:18.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.974+0000 7fc87b7fe640 1 --2- 172.21.15.77:0/95638915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc864004120 0x7fc864004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:18.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.974+0000 7fc87b7fe640 1 --2- 172.21.15.77:0/95638915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc864004d40 0x7fc8640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:18.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.974+0000 7fc87b7fe640 1 -- 172.21.15.77:0/95638915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc87c06b830 con 0x7fc864004120 2024-04-25T01:44:18.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.974+0000 7fc87b7fe640 1 -- 172.21.15.77:0/95638915 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc86400bb00 con 0x7fc864004d40 2024-04-25T01:44:18.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.974+0000 7fc87b7fe640 1 -- 172.21.15.77:0/95638915 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc86400bd00 con 0x7fc87c06c280 2024-04-25T01:44:18.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.974+0000 7fc87bfff640 1 --2- 172.21.15.77:0/95638915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc864004120 0x7fc864004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:18.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.974+0000 7fc88080e640 1 --2- 172.21.15.77:0/95638915 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc87c06c280 0x7fc864003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:18.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.974+0000 7fc88100f640 1 --2- 172.21.15.77:0/95638915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc864004d40 0x7fc8640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:18.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.975+0000 7fc87bfff640 1 -- 172.21.15.77:0/95638915 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc87c06c280 msgr2=0x7fc864003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:18.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.975+0000 7fc87bfff640 1 --2- 172.21.15.77:0/95638915 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc87c06c280 0x7fc864003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:18.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.975+0000 7fc87bfff640 1 -- 172.21.15.77:0/95638915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc864004d40 msgr2=0x7fc8640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:18.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.975+0000 7fc87bfff640 1 --2- 172.21.15.77:0/95638915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc864004d40 0x7fc8640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:18.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.975+0000 7fc87bfff640 1 -- 172.21.15.77:0/95638915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc864003520 con 0x7fc864004120 2024-04-25T01:44:18.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.975+0000 7fc88100f640 1 --2- 172.21.15.77:0/95638915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc864004d40 0x7fc8640051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:44:18.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.975+0000 7fc87bfff640 1 --2- 172.21.15.77:0/95638915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc864004120 0x7fc864004800 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc87000c240 tx=0x7fc864005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d22634664c3b95 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:18.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.975+0000 7fc87b7fe640 1 -- 172.21.15.77:0/95638915 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc870007db0 con 0x7fc864004120 2024-04-25T01:44:18.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.975+0000 7fc87b7fe640 1 -- 172.21.15.77:0/95638915 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc870005af0 con 0x7fc864004120 2024-04-25T01:44:18.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.975+0000 7fc87b7fe640 1 -- 172.21.15.77:0/95638915 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc870007070 con 0x7fc864004120 2024-04-25T01:44:18.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.976+0000 7fc882a72640 1 -- 172.21.15.77:0/95638915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc864004120 msgr2=0x7fc864004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:18.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.976+0000 7fc882a72640 1 --2- 172.21.15.77:0/95638915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc864004120 0x7fc864004800 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc87000c240 tx=0x7fc864005830 comp rx=0 tx=0).stop 2024-04-25T01:44:18.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.976+0000 7fc88100f640 1 -- 172.21.15.77:0/95638915 reap_dead start 2024-04-25T01:44:18.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.976+0000 7fc882a72640 1 -- 172.21.15.77:0/95638915 shutdown_connections 2024-04-25T01:44:18.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.976+0000 7fc882a72640 1 -- 172.21.15.77:0/95638915 >> 172.21.15.77:0/95638915 conn(0x7fc87c0ad4d0 msgr2=0x7fc87c0ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:18.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.976+0000 7fc882a72640 1 -- 172.21.15.77:0/95638915 shutdown_connections 2024-04-25T01:44:18.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.976+0000 7fc882a72640 1 -- 172.21.15.77:0/95638915 wait complete. 2024-04-25T01:44:18.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.977+0000 7fc882a72640 1 Processor -- start 2024-04-25T01:44:18.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.977+0000 7fc882a72640 1 -- start start 2024-04-25T01:44:18.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.978+0000 7fc882a72640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc864004120 0x7fc87c1ecdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:18.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.978+0000 7fc882a72640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc87c159010 0x7fc87c14ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:18.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.978+0000 7fc882a72640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc87c14b150 0x7fc87c1ef120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:18.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.978+0000 7fc882a72640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc87c06c6b0 con 0x7fc87c159010 2024-04-25T01:44:18.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.978+0000 7fc882a72640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc87c06bd60 con 0x7fc87c14b150 2024-04-25T01:44:18.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.978+0000 7fc882a72640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc87c06c830 con 0x7fc864004120 2024-04-25T01:44:18.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.978+0000 7fc87bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc87c159010 0x7fc87c14ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:18.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.978+0000 7fc87bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc87c159010 0x7fc87c14ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39208/0 (socket says 172.21.15.77:39208) 2024-04-25T01:44:18.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.978+0000 7fc87bfff640 1 -- 172.21.15.77:0/821435042 learned_addr learned my addr 172.21.15.77:0/821435042 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:18.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.978+0000 7fc88080e640 1 --2- 172.21.15.77:0/821435042 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc864004120 0x7fc87c1ecdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:18.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.978+0000 7fc88100f640 1 --2- 172.21.15.77:0/821435042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc87c14b150 0x7fc87c1ef120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:18.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.978+0000 7fc87bfff640 1 -- 172.21.15.77:0/821435042 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc864004120 msgr2=0x7fc87c1ecdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:18.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.978+0000 7fc87bfff640 1 --2- 172.21.15.77:0/821435042 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc864004120 0x7fc87c1ecdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:18.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.978+0000 7fc87bfff640 1 -- 172.21.15.77:0/821435042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc87c14b150 msgr2=0x7fc87c1ef120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:18.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.978+0000 7fc87bfff640 1 --2- 172.21.15.77:0/821435042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc87c14b150 0x7fc87c1ef120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:18.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.978+0000 7fc87bfff640 1 -- 172.21.15.77:0/821435042 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc87c159be0 con 0x7fc87c159010 2024-04-25T01:44:18.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.979+0000 7fc87bfff640 1 --2- 172.21.15.77:0/821435042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc87c159010 0x7fc87c14ac10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc87002ada0 tx=0x7fc87c0c8f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:18.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.979+0000 7fc8797fa640 1 -- 172.21.15.77:0/821435042 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc870041020 con 0x7fc87c159010 2024-04-25T01:44:18.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.979+0000 7fc8797fa640 1 -- 172.21.15.77:0/821435042 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc870001640 con 0x7fc87c159010 2024-04-25T01:44:18.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.979+0000 7fc8797fa640 1 -- 172.21.15.77:0/821435042 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc870007290 con 0x7fc87c159010 2024-04-25T01:44:18.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.979+0000 7fc882a72640 1 -- 172.21.15.77:0/821435042 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc87c14b5d0 con 0x7fc87c159010 2024-04-25T01:44:18.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.979+0000 7fc882a72640 1 -- 172.21.15.77:0/821435042 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc87c158530 con 0x7fc87c159010 2024-04-25T01:44:18.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.980+0000 7fc882a72640 1 -- 172.21.15.77:0/821435042 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc87c04f500 con 0x7fc87c159010 2024-04-25T01:44:18.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.980+0000 7fc8797fa640 1 -- 172.21.15.77:0/821435042 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc870044020 con 0x7fc87c159010 2024-04-25T01:44:18.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.981+0000 7fc8797fa640 1 --2- 172.21.15.77:0/821435042 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc86806be60 0x7fc86806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:18.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.981+0000 7fc8797fa640 1 -- 172.21.15.77:0/821435042 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7fc8700ab6a0 con 0x7fc87c159010 2024-04-25T01:44:18.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.981+0000 7fc88080e640 1 --2- 172.21.15.77:0/821435042 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc86806be60 0x7fc86806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:18.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.981+0000 7fc88080e640 1 --2- 172.21.15.77:0/821435042 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc86806be60 0x7fc86806e320 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc86c000c00 tx=0x7fc86c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:18.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:18.985+0000 7fc8797fa640 1 -- 172.21.15.77:0/821435042 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc87c157130 con 0x7fc87c159010 2024-04-25T01:44:19.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:19.193+0000 7fc882a72640 1 -- 172.21.15.77:0/821435042 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc87c06cec0 con 0x7fc87c159010 2024-04-25T01:44:19.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:19.193+0000 7fc8797fa640 1 -- 172.21.15.77:0/821435042 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+6485 (secure 0 0 0) 0x7fc870079460 con 0x7fc87c159010 2024-04-25T01:44:19.185 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:44:19.185 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1570919706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1570919706},{"type":"v1","addr":"172.21.15.77:6837","nonce":1570919706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:42:07.395274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5439":{"gid":5439,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5439,"qdb_cluster":[5439]},"id":1},{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:43:32.407370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":22,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5179,"qdb_cluster":[5179]},"id":2}]} 2024-04-25T01:44:19.185 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 33 2024-04-25T01:44:19.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:19.195+0000 7fc882a72640 1 -- 172.21.15.77:0/821435042 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc86806be60 msgr2=0x7fc86806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:19.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:19.195+0000 7fc882a72640 1 --2- 172.21.15.77:0/821435042 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc86806be60 0x7fc86806e320 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc86c000c00 tx=0x7fc86c009040 comp rx=0 tx=0).stop 2024-04-25T01:44:19.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:19.195+0000 7fc882a72640 1 -- 172.21.15.77:0/821435042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc87c159010 msgr2=0x7fc87c14ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:19.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:19.195+0000 7fc882a72640 1 --2- 172.21.15.77:0/821435042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc87c159010 0x7fc87c14ac10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc87002ada0 tx=0x7fc87c0c8f80 comp rx=0 tx=0).stop 2024-04-25T01:44:19.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:19.195+0000 7fc882a72640 1 -- 172.21.15.77:0/821435042 shutdown_connections 2024-04-25T01:44:19.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:19.195+0000 7fc882a72640 1 --2- 172.21.15.77:0/821435042 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc86806be60 0x7fc86806e320 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:19.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:19.195+0000 7fc882a72640 1 --2- 172.21.15.77:0/821435042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc87c159010 0x7fc87c14ac10 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:19.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:19.195+0000 7fc882a72640 1 --2- 172.21.15.77:0/821435042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc87c14b150 0x7fc87c1ef120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:19.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:19.195+0000 7fc882a72640 1 --2- 172.21.15.77:0/821435042 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc864004120 0x7fc87c1ecdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:19.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:19.195+0000 7fc882a72640 1 -- 172.21.15.77:0/821435042 >> 172.21.15.77:0/821435042 conn(0x7fc87c0ad4d0 msgr2=0x7fc87c0ab490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:19.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:19.196+0000 7fc882a72640 1 -- 172.21.15.77:0/821435042 shutdown_connections 2024-04-25T01:44:19.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:19.196+0000 7fc882a72640 1 -- 172.21.15.77:0/821435042 wait complete. 2024-04-25T01:44:19.197 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T01:44:20.907 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:44:20.910 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:44:21.198 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:44:21.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.320+0000 7fca248bd640 1 Processor -- start 2024-04-25T01:44:21.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.320+0000 7fca248bd640 1 -- start start 2024-04-25T01:44:21.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.321+0000 7fca248bd640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca20150320 0x7fca20156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:21.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.321+0000 7fca248bd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca20153be0 con 0x7fca2006d4e0 2024-04-25T01:44:21.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.321+0000 7fca248bd640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca20157100 con 0x7fca2006d0a0 2024-04-25T01:44:21.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.321+0000 7fca248bd640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fca20152fd0 con 0x7fca20150320 2024-04-25T01:44:21.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.321+0000 7fca1ed9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fca2006d4e0 0x7fca20154a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60206/0 (socket says 172.21.15.77:60206) 2024-04-25T01:44:21.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.321+0000 7fca1ed9d640 1 -- 172.21.15.77:0/741111532 learned_addr learned my addr 172.21.15.77:0/741111532 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:44:21.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.321+0000 7fca1e59c640 1 --2- 172.21.15.77:0/741111532 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca20150320 0x7fca20156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:21.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.321+0000 7fca1d59a640 1 -- 172.21.15.77:0/741111532 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1007774062 0 0) 0x7fca20153be0 con 0x7fca2006d4e0 2024-04-25T01:44:21.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.321+0000 7fca1d59a640 1 -- 172.21.15.77:0/741111532 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca08003520 con 0x7fca2006d4e0 2024-04-25T01:44:21.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.321+0000 7fca1d59a640 1 -- 172.21.15.77:0/741111532 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4268481095 0 0) 0x7fca20157100 con 0x7fca2006d0a0 2024-04-25T01:44:21.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.321+0000 7fca1d59a640 1 -- 172.21.15.77:0/741111532 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca20153be0 con 0x7fca2006d0a0 2024-04-25T01:44:21.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.321+0000 7fca1d59a640 1 -- 172.21.15.77:0/741111532 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3724831125 0 0) 0x7fca08003520 con 0x7fca2006d4e0 2024-04-25T01:44:21.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.321+0000 7fca1d59a640 1 -- 172.21.15.77:0/741111532 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca20150320 msgr2=0x7fca20156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:21.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.321+0000 7fca1d59a640 1 --2- 172.21.15.77:0/741111532 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca20150320 0x7fca20156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:21.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.321+0000 7fca1d59a640 1 -- 172.21.15.77:0/741111532 >> v1:172.21.15.121:6789/0 conn(0x7fca2006d0a0 legacy=0x7fca20154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:21.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.321+0000 7fca1d59a640 1 -- 172.21.15.77:0/741111532 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca201532b0 con 0x7fca2006d4e0 2024-04-25T01:44:21.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.321+0000 7fca1d59a640 1 -- 172.21.15.77:0/741111532 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7fca180019f0 con 0x7fca2006d4e0 2024-04-25T01:44:21.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.321+0000 7fca1d59a640 1 -- 172.21.15.77:0/741111532 >> v1:172.21.15.77:6789/0 conn(0x7fca2006d4e0 legacy=0x7fca20154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:21.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.321+0000 7fca1d59a640 1 --2- 172.21.15.77:0/741111532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca08003b70 0x7fca08003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:21.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.321+0000 7fca1d59a640 1 --2- 172.21.15.77:0/741111532 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca20150320 0x7fca08004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:21.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.321+0000 7fca1d59a640 1 --2- 172.21.15.77:0/741111532 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca08004d40 0x7fca080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:21.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.321+0000 7fca1d59a640 1 -- 172.21.15.77:0/741111532 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fca20152fd0 con 0x7fca08003b70 2024-04-25T01:44:21.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.321+0000 7fca1d59a640 1 -- 172.21.15.77:0/741111532 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fca0800bac0 con 0x7fca08004d40 2024-04-25T01:44:21.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.321+0000 7fca1d59a640 1 -- 172.21.15.77:0/741111532 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fca0800bcc0 con 0x7fca20150320 2024-04-25T01:44:21.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.322+0000 7fca1e59c640 1 --2- 172.21.15.77:0/741111532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca08003b70 0x7fca08003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:21.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.322+0000 7fca1dd9b640 1 --2- 172.21.15.77:0/741111532 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca20150320 0x7fca08004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:21.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.322+0000 7fca1ed9d640 1 --2- 172.21.15.77:0/741111532 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca08004d40 0x7fca080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:21.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.322+0000 7fca1e59c640 1 -- 172.21.15.77:0/741111532 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca20150320 msgr2=0x7fca08004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:21.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.322+0000 7fca1e59c640 1 --2- 172.21.15.77:0/741111532 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca20150320 0x7fca08004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:21.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.322+0000 7fca1e59c640 1 -- 172.21.15.77:0/741111532 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca08004d40 msgr2=0x7fca080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:21.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.322+0000 7fca1e59c640 1 --2- 172.21.15.77:0/741111532 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca08004d40 0x7fca080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:21.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.322+0000 7fca1e59c640 1 -- 172.21.15.77:0/741111532 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca08003520 con 0x7fca08003b70 2024-04-25T01:44:21.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.322+0000 7fca1dd9b640 1 --2- 172.21.15.77:0/741111532 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca20150320 0x7fca08004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:44:21.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.322+0000 7fca1e59c640 1 --2- 172.21.15.77:0/741111532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca08003b70 0x7fca08003f70 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fca10009ac0 tx=0x7fca08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a4cbe35ffbc6ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:21.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.323+0000 7fca1d59a640 1 -- 172.21.15.77:0/741111532 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10036070 con 0x7fca08003b70 2024-04-25T01:44:21.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.323+0000 7fca1d59a640 1 -- 172.21.15.77:0/741111532 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca10031400 con 0x7fca08003b70 2024-04-25T01:44:21.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.323+0000 7fca1d59a640 1 -- 172.21.15.77:0/741111532 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10009690 con 0x7fca08003b70 2024-04-25T01:44:21.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.323+0000 7fca248bd640 1 -- 172.21.15.77:0/741111532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca08003b70 msgr2=0x7fca08003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:21.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.323+0000 7fca248bd640 1 --2- 172.21.15.77:0/741111532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca08003b70 0x7fca08003f70 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fca10009ac0 tx=0x7fca08005830 comp rx=0 tx=0).stop 2024-04-25T01:44:21.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.323+0000 7fca1ed9d640 1 -- 172.21.15.77:0/741111532 reap_dead start 2024-04-25T01:44:21.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.323+0000 7fca248bd640 1 -- 172.21.15.77:0/741111532 shutdown_connections 2024-04-25T01:44:21.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.323+0000 7fca248bd640 1 -- 172.21.15.77:0/741111532 >> 172.21.15.77:0/741111532 conn(0x7fca200c3f80 msgr2=0x7fca200c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:21.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.323+0000 7fca248bd640 1 -- 172.21.15.77:0/741111532 shutdown_connections 2024-04-25T01:44:21.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.323+0000 7fca248bd640 1 -- 172.21.15.77:0/741111532 wait complete. 2024-04-25T01:44:21.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.325+0000 7fca248bd640 1 Processor -- start 2024-04-25T01:44:21.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.325+0000 7fca248bd640 1 -- start start 2024-04-25T01:44:21.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.325+0000 7fca248bd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca08003b70 0x7fca200abda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:21.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.325+0000 7fca248bd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca20070df0 0x7fca200aa650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:21.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.325+0000 7fca248bd640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca200aab90 0x7fca201eb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:21.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.325+0000 7fca248bd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fca20152bf0 con 0x7fca20070df0 2024-04-25T01:44:21.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.325+0000 7fca248bd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fca20153870 con 0x7fca08003b70 2024-04-25T01:44:21.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.325+0000 7fca248bd640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fca20152d70 con 0x7fca200aab90 2024-04-25T01:44:21.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.325+0000 7fca1dd9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca20070df0 0x7fca200aa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:21.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.325+0000 7fca1dd9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca20070df0 0x7fca200aa650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39228/0 (socket says 172.21.15.77:39228) 2024-04-25T01:44:21.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.325+0000 7fca1dd9b640 1 -- 172.21.15.77:0/731948698 learned_addr learned my addr 172.21.15.77:0/731948698 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:21.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.325+0000 7fca1e59c640 1 --2- 172.21.15.77:0/731948698 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca08003b70 0x7fca200abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:21.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.326+0000 7fca1ed9d640 1 --2- 172.21.15.77:0/731948698 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca200aab90 0x7fca201eb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:21.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.326+0000 7fca1dd9b640 1 -- 172.21.15.77:0/731948698 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca200aab90 msgr2=0x7fca201eb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:21.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.326+0000 7fca1dd9b640 1 --2- 172.21.15.77:0/731948698 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca200aab90 0x7fca201eb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:21.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.326+0000 7fca1dd9b640 1 -- 172.21.15.77:0/731948698 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca08003b70 msgr2=0x7fca200abda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:21.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.326+0000 7fca1dd9b640 1 --2- 172.21.15.77:0/731948698 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca08003b70 0x7fca200abda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:21.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.326+0000 7fca1dd9b640 1 -- 172.21.15.77:0/731948698 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca200ab040 con 0x7fca20070df0 2024-04-25T01:44:21.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.326+0000 7fca1dd9b640 1 --2- 172.21.15.77:0/731948698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca20070df0 0x7fca200aa650 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fca14010990 tx=0x7fca14010e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:21.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.326+0000 7fca0effd640 1 -- 172.21.15.77:0/731948698 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1400e910 con 0x7fca20070df0 2024-04-25T01:44:21.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.326+0000 7fca0effd640 1 -- 172.21.15.77:0/731948698 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca1400eab0 con 0x7fca20070df0 2024-04-25T01:44:21.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.326+0000 7fca248bd640 1 -- 172.21.15.77:0/731948698 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca201e8470 con 0x7fca20070df0 2024-04-25T01:44:21.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.326+0000 7fca0effd640 1 -- 172.21.15.77:0/731948698 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1400ee60 con 0x7fca20070df0 2024-04-25T01:44:21.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.326+0000 7fca248bd640 1 -- 172.21.15.77:0/731948698 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca201e8a30 con 0x7fca20070df0 2024-04-25T01:44:21.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.327+0000 7fca248bd640 1 -- 172.21.15.77:0/731948698 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca2004f500 con 0x7fca20070df0 2024-04-25T01:44:21.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.327+0000 7fca0effd640 1 -- 172.21.15.77:0/731948698 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca14007020 con 0x7fca20070df0 2024-04-25T01:44:21.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.328+0000 7fca0effd640 1 --2- 172.21.15.77:0/731948698 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fca0006be60 0x7fca0006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:21.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.328+0000 7fca1e59c640 1 --2- 172.21.15.77:0/731948698 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fca0006be60 0x7fca0006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:21.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.328+0000 7fca0effd640 1 -- 172.21.15.77:0/731948698 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7fca1408d380 con 0x7fca20070df0 2024-04-25T01:44:21.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.328+0000 7fca1e59c640 1 --2- 172.21.15.77:0/731948698 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fca0006be60 0x7fca0006e320 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fca10033000 tx=0x7fca10008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:21.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.333+0000 7fca0effd640 1 -- 172.21.15.77:0/731948698 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fca14016030 con 0x7fca20070df0 2024-04-25T01:44:21.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.545+0000 7fca248bd640 1 -- 172.21.15.77:0/731948698 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca20073750 con 0x7fca20070df0 2024-04-25T01:44:21.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.545+0000 7fca0effd640 1 -- 172.21.15.77:0/731948698 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+6485 (secure 0 0 0) 0x7fca1405b220 con 0x7fca20070df0 2024-04-25T01:44:21.537 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:44:21.537 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1570919706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1570919706},{"type":"v1","addr":"172.21.15.77:6837","nonce":1570919706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:42:07.395274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5439":{"gid":5439,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5439,"qdb_cluster":[5439]},"id":1},{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:43:32.407370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":22,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5179,"qdb_cluster":[5179]},"id":2}]} 2024-04-25T01:44:21.537 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 33 2024-04-25T01:44:21.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.547+0000 7fca248bd640 1 -- 172.21.15.77:0/731948698 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fca0006be60 msgr2=0x7fca0006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:21.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.547+0000 7fca248bd640 1 --2- 172.21.15.77:0/731948698 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fca0006be60 0x7fca0006e320 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fca10033000 tx=0x7fca10008030 comp rx=0 tx=0).stop 2024-04-25T01:44:21.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.547+0000 7fca248bd640 1 -- 172.21.15.77:0/731948698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca20070df0 msgr2=0x7fca200aa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:21.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.547+0000 7fca248bd640 1 --2- 172.21.15.77:0/731948698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca20070df0 0x7fca200aa650 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fca14010990 tx=0x7fca14010e50 comp rx=0 tx=0).stop 2024-04-25T01:44:21.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.547+0000 7fca248bd640 1 -- 172.21.15.77:0/731948698 shutdown_connections 2024-04-25T01:44:21.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.547+0000 7fca248bd640 1 --2- 172.21.15.77:0/731948698 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fca0006be60 0x7fca0006e320 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:21.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.547+0000 7fca248bd640 1 --2- 172.21.15.77:0/731948698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca20070df0 0x7fca200aa650 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:21.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.547+0000 7fca248bd640 1 --2- 172.21.15.77:0/731948698 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca200aab90 0x7fca201eb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:21.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.547+0000 7fca248bd640 1 --2- 172.21.15.77:0/731948698 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca08003b70 0x7fca200abda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:21.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.547+0000 7fca248bd640 1 -- 172.21.15.77:0/731948698 >> 172.21.15.77:0/731948698 conn(0x7fca200c3f80 msgr2=0x7fca2014db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:21.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.547+0000 7fca248bd640 1 -- 172.21.15.77:0/731948698 shutdown_connections 2024-04-25T01:44:21.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:21.547+0000 7fca248bd640 1 -- 172.21.15.77:0/731948698 wait complete. 2024-04-25T01:44:21.550 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T01:44:23.552 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:44:23.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.667+0000 7f1ff8ccd640 1 Processor -- start 2024-04-25T01:44:23.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.667+0000 7f1ff8ccd640 1 -- start start 2024-04-25T01:44:23.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.668+0000 7f1ff8ccd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1ff4156c80 0x7f1ff40c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:23.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.668+0000 7f1ff8ccd640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1ff406c280 0x7f1ff40c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:23.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.668+0000 7f1ff8ccd640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ff4157130 con 0x7f1ff4150090 2024-04-25T01:44:23.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.668+0000 7f1ff8ccd640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f1ff406b830 con 0x7f1ff4156c80 2024-04-25T01:44:23.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.668+0000 7f1ff8ccd640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f1ff40c9de0 con 0x7f1ff406c280 2024-04-25T01:44:23.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.669+0000 7f1ff2d9d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1ff406c280 0x7f1ff40c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:23.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.669+0000 7f1ff1d9b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1ff4156c80 0x7f1ff40c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:23.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.669+0000 7f1ff259c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f1ff4150090 0x7f1ff40c8200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.77:35608/0 (socket says 172.21.15.77:35608) 2024-04-25T01:44:23.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.669+0000 7f1ff2d9d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1ff406c280 0x7f1ff40c6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.77:41596/0 (socket says 172.21.15.77:41596) 2024-04-25T01:44:23.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.669+0000 7f1ff259c640 1 -- 172.21.15.77:0/2429865475 learned_addr learned my addr 172.21.15.77:0/2429865475 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:44:23.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.669+0000 7f1ff159a640 1 -- 172.21.15.77:0/2429865475 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2383175913 0 0) 0x7f1fdc001110 con 0x7f1ff4150090 2024-04-25T01:44:23.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.669+0000 7f1ff159a640 1 -- 172.21.15.77:0/2429865475 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fe0003520 con 0x7f1ff4150090 2024-04-25T01:44:23.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.669+0000 7f1ff1d9b640 1 -- 172.21.15.77:0/2429865475 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1ff406c280 msgr2=0x7f1ff40c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:23.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.669+0000 7f1ff1d9b640 1 --2- 172.21.15.77:0/2429865475 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1ff406c280 0x7f1ff40c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:23.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.669+0000 7f1ff1d9b640 1 -- 172.21.15.77:0/2429865475 >> v1:172.21.15.121:6789/0 conn(0x7f1ff4150090 legacy=0x7f1ff40c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:23.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.669+0000 7f1ff1d9b640 1 -- 172.21.15.77:0/2429865475 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff40c89c0 con 0x7f1ff4156c80 2024-04-25T01:44:23.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.670+0000 7f1ff1d9b640 1 --2- 172.21.15.77:0/2429865475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ff4156c80 0x7f1ff40c98a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1fe40097a0 tx=0x7f1fe402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f12db058188b98 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:23.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.670+0000 7f1ff159a640 1 -- 172.21.15.77:0/2429865475 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4037070 con 0x7f1ff4156c80 2024-04-25T01:44:23.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.670+0000 7f1ff159a640 1 -- 172.21.15.77:0/2429865475 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe4032440 con 0x7f1ff4156c80 2024-04-25T01:44:23.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.670+0000 7f1ff159a640 1 -- 172.21.15.77:0/2429865475 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe40327f0 con 0x7f1ff4156c80 2024-04-25T01:44:23.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.670+0000 7f1ff8ccd640 1 -- 172.21.15.77:0/2429865475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ff4156c80 msgr2=0x7f1ff40c98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:23.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.670+0000 7f1ff8ccd640 1 --2- 172.21.15.77:0/2429865475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ff4156c80 0x7f1ff40c98a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1fe40097a0 tx=0x7f1fe402a180 comp rx=0 tx=0).stop 2024-04-25T01:44:23.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.671+0000 7f1ff8ccd640 1 -- 172.21.15.77:0/2429865475 shutdown_connections 2024-04-25T01:44:23.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.671+0000 7f1ff8ccd640 1 --2- 172.21.15.77:0/2429865475 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1ff406c280 0x7f1ff40c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:23.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.671+0000 7f1ff8ccd640 1 --2- 172.21.15.77:0/2429865475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ff4156c80 0x7f1ff40c98a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:23.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.671+0000 7f1ff8ccd640 1 -- 172.21.15.77:0/2429865475 >> 172.21.15.77:0/2429865475 conn(0x7f1ff40ad4d0 msgr2=0x7f1ff40ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:23.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.671+0000 7f1ff8ccd640 1 -- 172.21.15.77:0/2429865475 shutdown_connections 2024-04-25T01:44:23.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.671+0000 7f1ff8ccd640 1 -- 172.21.15.77:0/2429865475 wait complete. 2024-04-25T01:44:23.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.672+0000 7f1ff8ccd640 1 Processor -- start 2024-04-25T01:44:23.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.672+0000 7f1ff8ccd640 1 -- start start 2024-04-25T01:44:23.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.673+0000 7f1ff8ccd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ff406c280 0x7f1ff41576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:23.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.673+0000 7f1ff8ccd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ff4150090 0x7f1ff41e8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:23.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.673+0000 7f1ff8ccd640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1ff4156c80 0x7f1ff41eba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:23.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.673+0000 7f1ff8ccd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff406bd60 con 0x7f1ff4150090 2024-04-25T01:44:23.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.673+0000 7f1ff8ccd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff406ba80 con 0x7f1ff406c280 2024-04-25T01:44:23.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.673+0000 7f1ff8ccd640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f1ff406c690 con 0x7f1ff4156c80 2024-04-25T01:44:23.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.673+0000 7f1ff1d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ff4150090 0x7f1ff41e8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:23.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.673+0000 7f1ff1d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ff4150090 0x7f1ff41e8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39232/0 (socket says 172.21.15.77:39232) 2024-04-25T01:44:23.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.673+0000 7f1ff1d9b640 1 -- 172.21.15.77:0/1324464439 learned_addr learned my addr 172.21.15.77:0/1324464439 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:23.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.673+0000 7f1ff259c640 1 --2- 172.21.15.77:0/1324464439 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ff406c280 0x7f1ff41576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:23.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.673+0000 7f1ff2d9d640 1 --2- 172.21.15.77:0/1324464439 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1ff4156c80 0x7f1ff41eba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:23.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.673+0000 7f1ff1d9b640 1 -- 172.21.15.77:0/1324464439 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1ff4156c80 msgr2=0x7f1ff41eba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:23.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.673+0000 7f1ff1d9b640 1 --2- 172.21.15.77:0/1324464439 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1ff4156c80 0x7f1ff41eba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:23.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.673+0000 7f1ff1d9b640 1 -- 172.21.15.77:0/1324464439 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ff406c280 msgr2=0x7f1ff41576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:23.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.673+0000 7f1ff1d9b640 1 --2- 172.21.15.77:0/1324464439 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ff406c280 0x7f1ff41576a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:23.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.673+0000 7f1ff1d9b640 1 -- 172.21.15.77:0/1324464439 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff4159440 con 0x7f1ff4150090 2024-04-25T01:44:23.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.673+0000 7f1ff259c640 1 --2- 172.21.15.77:0/1324464439 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ff406c280 0x7f1ff41576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:44:23.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.673+0000 7f1ff1d9b640 1 --2- 172.21.15.77:0/1324464439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ff4150090 0x7f1ff41e8d30 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4035040 tx=0x7f1fe40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:23.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.673+0000 7f1feaffd640 1 -- 172.21.15.77:0/1324464439 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4037040 con 0x7f1ff4150090 2024-04-25T01:44:23.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.674+0000 7f1feaffd640 1 -- 172.21.15.77:0/1324464439 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe4042070 con 0x7f1ff4150090 2024-04-25T01:44:23.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.674+0000 7f1feaffd640 1 -- 172.21.15.77:0/1324464439 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe403b930 con 0x7f1ff4150090 2024-04-25T01:44:23.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.674+0000 7f1ff8ccd640 1 -- 172.21.15.77:0/1324464439 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ff4159720 con 0x7f1ff4150090 2024-04-25T01:44:23.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.674+0000 7f1ff8ccd640 1 -- 172.21.15.77:0/1324464439 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ff4159ce0 con 0x7f1ff4150090 2024-04-25T01:44:23.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.675+0000 7f1ff8ccd640 1 -- 172.21.15.77:0/1324464439 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ff404f500 con 0x7f1ff4150090 2024-04-25T01:44:23.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.675+0000 7f1feaffd640 1 -- 172.21.15.77:0/1324464439 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1fe403bad0 con 0x7f1ff4150090 2024-04-25T01:44:23.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.676+0000 7f1feaffd640 1 --2- 172.21.15.77:0/1324464439 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1fd406be30 0x7f1fd406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:23.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.676+0000 7f1ff259c640 1 --2- 172.21.15.77:0/1324464439 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1fd406be30 0x7f1fd406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:23.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.676+0000 7f1feaffd640 1 -- 172.21.15.77:0/1324464439 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7067+0+0 (secure 0 0 0) 0x7f1fe40abc20 con 0x7f1ff4150090 2024-04-25T01:44:23.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.676+0000 7f1ff259c640 1 --2- 172.21.15.77:0/1324464439 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1fd406be30 0x7f1fd406e2f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc007fd0 tx=0x7f1fdc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:23.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.680+0000 7f1feaffd640 1 -- 172.21.15.77:0/1324464439 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1fe407a080 con 0x7f1ff4150090 2024-04-25T01:44:23.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.891+0000 7f1ff8ccd640 1 -- 172.21.15.77:0/1324464439 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ff406cec0 con 0x7f1ff4150090 2024-04-25T01:44:23.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.891+0000 7f1feaffd640 1 -- 172.21.15.77:0/1324464439 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+6485 (secure 0 0 0) 0x7f1fe4079980 con 0x7f1ff4150090 2024-04-25T01:44:23.883 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:44:23.883 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1570919706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1570919706},{"type":"v1","addr":"172.21.15.77:6837","nonce":1570919706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:42:07.395274+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5439":{"gid":5439,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.77:6835/1935321501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1935321501},{"type":"v1","addr":"172.21.15.77:6835","nonce":1935321501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5439,"qdb_cluster":[5439]},"id":1},{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:43:32.407370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":22,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5179,"qdb_cluster":[5179]},"id":2}]} 2024-04-25T01:44:23.884 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 33 2024-04-25T01:44:23.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.893+0000 7f1ff8ccd640 1 -- 172.21.15.77:0/1324464439 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1fd406be30 msgr2=0x7f1fd406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:23.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.893+0000 7f1ff8ccd640 1 --2- 172.21.15.77:0/1324464439 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1fd406be30 0x7f1fd406e2f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc007fd0 tx=0x7f1fdc009040 comp rx=0 tx=0).stop 2024-04-25T01:44:23.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.893+0000 7f1ff8ccd640 1 -- 172.21.15.77:0/1324464439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ff4150090 msgr2=0x7f1ff41e8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:23.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.893+0000 7f1ff8ccd640 1 --2- 172.21.15.77:0/1324464439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ff4150090 0x7f1ff41e8d30 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4035040 tx=0x7f1fe40046c0 comp rx=0 tx=0).stop 2024-04-25T01:44:23.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.893+0000 7f1ff8ccd640 1 -- 172.21.15.77:0/1324464439 shutdown_connections 2024-04-25T01:44:23.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.893+0000 7f1ff8ccd640 1 --2- 172.21.15.77:0/1324464439 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1fd406be30 0x7f1fd406e2f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:23.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.893+0000 7f1ff8ccd640 1 --2- 172.21.15.77:0/1324464439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ff4150090 0x7f1ff41e8d30 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:23.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.893+0000 7f1ff8ccd640 1 --2- 172.21.15.77:0/1324464439 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1ff4156c80 0x7f1ff41eba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:23.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.893+0000 7f1ff8ccd640 1 --2- 172.21.15.77:0/1324464439 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ff406c280 0x7f1ff41576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:23.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.893+0000 7f1ff8ccd640 1 -- 172.21.15.77:0/1324464439 >> 172.21.15.77:0/1324464439 conn(0x7f1ff40ad4d0 msgr2=0x7f1ff40c6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:23.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.893+0000 7f1ff8ccd640 1 -- 172.21.15.77:0/1324464439 shutdown_connections 2024-04-25T01:44:23.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:23.893+0000 7f1ff8ccd640 1 -- 172.21.15.77:0/1324464439 wait complete. 2024-04-25T01:44:23.896 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T01:44:25.898 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:44:26.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.013+0000 7fd05f2a5640 1 Processor -- start 2024-04-25T01:44:26.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.014+0000 7fd05f2a5640 1 -- start start 2024-04-25T01:44:26.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.014+0000 7fd05f2a5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd05806d0a0 0x7fd05806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:26.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.014+0000 7fd05f2a5640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd058154380 0x7fd058154800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:26.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.014+0000 7fd05f2a5640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd058153be0 con 0x7fd058150320 2024-04-25T01:44:26.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.014+0000 7fd05f2a5640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fd058152fd0 con 0x7fd058154380 2024-04-25T01:44:26.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.014+0000 7fd05f2a5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd0581532b0 con 0x7fd05806d0a0 2024-04-25T01:44:26.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.015+0000 7fd05d842640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd058154380 0x7fd058154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:26.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.015+0000 7fd05c840640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd05806d0a0 0x7fd05806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:26.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.015+0000 7fd05d041640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fd058150320 0x7fd058156bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.77:35612/0 (socket says 172.21.15.77:35612) 2024-04-25T01:44:26.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.015+0000 7fd05d842640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd058154380 0x7fd058154800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.77:51300/0 (socket says 172.21.15.77:51300) 2024-04-25T01:44:26.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.015+0000 7fd05d041640 1 -- 172.21.15.77:0/3525359941 learned_addr learned my addr 172.21.15.77:0/3525359941 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:44:26.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.015+0000 7fd05c840640 1 -- 172.21.15.77:0/3525359941 >> v2:172.21.15.121:3300/0 conn(0x7fd058154380 msgr2=0x7fd058154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:26.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.015+0000 7fd05c840640 1 --2- 172.21.15.77:0/3525359941 >> v2:172.21.15.121:3300/0 conn(0x7fd058154380 0x7fd058154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:26.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.015+0000 7fd05c840640 1 -- 172.21.15.77:0/3525359941 >> v1:172.21.15.121:6789/0 conn(0x7fd058150320 legacy=0x7fd058156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:26.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.015+0000 7fd05c840640 1 -- 172.21.15.77:0/3525359941 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd058153590 con 0x7fd05806d0a0 2024-04-25T01:44:26.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.015+0000 7fd05d842640 1 --2- 172.21.15.77:0/3525359941 >> v2:172.21.15.121:3300/0 conn(0x7fd058154380 0x7fd058154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:44:26.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.016+0000 7fd05c840640 1 --2- 172.21.15.77:0/3525359941 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd05806d0a0 0x7fd05806d4e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd0480097a0 tx=0x7fd04802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc719a609ad91187 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:26.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.016+0000 7fd04ffff640 1 -- 172.21.15.77:0/3525359941 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048037070 con 0x7fd05806d0a0 2024-04-25T01:44:26.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.016+0000 7fd04ffff640 1 -- 172.21.15.77:0/3525359941 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd04802ae50 con 0x7fd05806d0a0 2024-04-25T01:44:26.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.016+0000 7fd04ffff640 1 -- 172.21.15.77:0/3525359941 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048032660 con 0x7fd05806d0a0 2024-04-25T01:44:26.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.017+0000 7fd05f2a5640 1 -- 172.21.15.77:0/3525359941 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd05806d0a0 msgr2=0x7fd05806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:26.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.017+0000 7fd05f2a5640 1 --2- 172.21.15.77:0/3525359941 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd05806d0a0 0x7fd05806d4e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd0480097a0 tx=0x7fd04802a100 comp rx=0 tx=0).stop 2024-04-25T01:44:26.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.017+0000 7fd05f2a5640 1 -- 172.21.15.77:0/3525359941 shutdown_connections 2024-04-25T01:44:26.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.017+0000 7fd05f2a5640 1 --2- 172.21.15.77:0/3525359941 >> v2:172.21.15.121:3300/0 conn(0x7fd058154380 0x7fd058154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:26.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.017+0000 7fd05f2a5640 1 --2- 172.21.15.77:0/3525359941 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd05806d0a0 0x7fd05806d4e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:26.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.017+0000 7fd05f2a5640 1 -- 172.21.15.77:0/3525359941 >> 172.21.15.77:0/3525359941 conn(0x7fd0580c3f80 msgr2=0x7fd0580c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:26.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.017+0000 7fd05f2a5640 1 -- 172.21.15.77:0/3525359941 shutdown_connections 2024-04-25T01:44:26.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.017+0000 7fd05f2a5640 1 -- 172.21.15.77:0/3525359941 wait complete. 2024-04-25T01:44:26.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.018+0000 7fd05f2a5640 1 Processor -- start 2024-04-25T01:44:26.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.018+0000 7fd05f2a5640 1 -- start start 2024-04-25T01:44:26.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.019+0000 7fd05f2a5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd05806d0a0 0x7fd0580c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:26.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.019+0000 7fd05f2a5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd058150320 0x7fd058070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:26.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.019+0000 7fd05f2a5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd058154380 0x7fd058146580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:26.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.019+0000 7fd05f2a5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd058152d70 con 0x7fd058154380 2024-04-25T01:44:26.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.019+0000 7fd05f2a5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd058152bf0 con 0x7fd058150320 2024-04-25T01:44:26.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.019+0000 7fd05f2a5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd0580c3100 con 0x7fd05806d0a0 2024-04-25T01:44:26.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.019+0000 7fd05d842640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd058154380 0x7fd058146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:26.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.019+0000 7fd05d842640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd058154380 0x7fd058146580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39242/0 (socket says 172.21.15.77:39242) 2024-04-25T01:44:26.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.019+0000 7fd05d842640 1 -- 172.21.15.77:0/1109637256 learned_addr learned my addr 172.21.15.77:0/1109637256 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:26.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.019+0000 7fd05d041640 1 --2- 172.21.15.77:0/1109637256 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd05806d0a0 0x7fd0580c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:26.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.019+0000 7fd05c840640 1 --2- 172.21.15.77:0/1109637256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd058150320 0x7fd058070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:26.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.019+0000 7fd05d842640 1 -- 172.21.15.77:0/1109637256 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd05806d0a0 msgr2=0x7fd0580c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:26.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.019+0000 7fd05d842640 1 --2- 172.21.15.77:0/1109637256 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd05806d0a0 0x7fd0580c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:26.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.019+0000 7fd05d842640 1 -- 172.21.15.77:0/1109637256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd058150320 msgr2=0x7fd058070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:26.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.019+0000 7fd05d842640 1 --2- 172.21.15.77:0/1109637256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd058150320 0x7fd058070ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:26.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.019+0000 7fd05d842640 1 -- 172.21.15.77:0/1109637256 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05814d3a0 con 0x7fd058154380 2024-04-25T01:44:26.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.019+0000 7fd05d842640 1 --2- 172.21.15.77:0/1109637256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd058154380 0x7fd058146580 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fd050009e60 tx=0x7fd05000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:26.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.019+0000 7fd04dffb640 1 -- 172.21.15.77:0/1109637256 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd050018030 con 0x7fd058154380 2024-04-25T01:44:26.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.019+0000 7fd04dffb640 1 -- 172.21.15.77:0/1109637256 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd05000cdf0 con 0x7fd058154380 2024-04-25T01:44:26.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.019+0000 7fd05f2a5640 1 -- 172.21.15.77:0/1109637256 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0580c5070 con 0x7fd058154380 2024-04-25T01:44:26.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.020+0000 7fd04dffb640 1 -- 172.21.15.77:0/1109637256 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd050003bb0 con 0x7fd058154380 2024-04-25T01:44:26.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.020+0000 7fd05f2a5640 1 -- 172.21.15.77:0/1109637256 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0580c7720 con 0x7fd058154380 2024-04-25T01:44:26.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.021+0000 7fd05f2a5640 1 -- 172.21.15.77:0/1109637256 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd05804f500 con 0x7fd058154380 2024-04-25T01:44:26.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.021+0000 7fd04dffb640 1 -- 172.21.15.77:0/1109637256 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd05001b070 con 0x7fd058154380 2024-04-25T01:44:26.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.022+0000 7fd04dffb640 1 --2- 172.21.15.77:0/1109637256 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd03c06be30 0x7fd03c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:26.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.022+0000 7fd04dffb640 1 -- 172.21.15.77:0/1109637256 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7153+0+0 (secure 0 0 0) 0x7fd05008bbe0 con 0x7fd058154380 2024-04-25T01:44:26.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.022+0000 7fd05d041640 1 --2- 172.21.15.77:0/1109637256 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd03c06be30 0x7fd03c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:26.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.022+0000 7fd05d041640 1 --2- 172.21.15.77:0/1109637256 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd03c06be30 0x7fd03c06e2f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd054007fd0 tx=0x7fd054007e80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:26.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.026+0000 7fd04dffb640 1 -- 172.21.15.77:0/1109637256 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd050010040 con 0x7fd058154380 2024-04-25T01:44:26.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.233+0000 7fd05f2a5640 1 -- 172.21.15.77:0/1109637256 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd058073750 con 0x7fd058154380 2024-04-25T01:44:26.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.234+0000 7fd04dffb640 1 -- 172.21.15.77:0/1109637256 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5656 (secure 0 0 0) 0x7fd050059a20 con 0x7fd058154380 2024-04-25T01:44:26.226 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:44:26.226 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:44:24.668738+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5622":{"gid":5622,"name":"c","rank":0,"incarnation":34,"state":"up:reconnect","state_seq":12,"addr":"172.21.15.77:6837/1570919706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1570919706},{"type":"v1","addr":"172.21.15.77:6837","nonce":1570919706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:43:32.407370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":22,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5179,"qdb_cluster":[5179]},"id":2}]} 2024-04-25T01:44:26.226 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 35 2024-04-25T01:44:26.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.236+0000 7fd05f2a5640 1 -- 172.21.15.77:0/1109637256 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd03c06be30 msgr2=0x7fd03c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:26.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.236+0000 7fd05f2a5640 1 --2- 172.21.15.77:0/1109637256 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd03c06be30 0x7fd03c06e2f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd054007fd0 tx=0x7fd054007e80 comp rx=0 tx=0).stop 2024-04-25T01:44:26.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.236+0000 7fd05f2a5640 1 -- 172.21.15.77:0/1109637256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd058154380 msgr2=0x7fd058146580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:26.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.236+0000 7fd05f2a5640 1 --2- 172.21.15.77:0/1109637256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd058154380 0x7fd058146580 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fd050009e60 tx=0x7fd05000c490 comp rx=0 tx=0).stop 2024-04-25T01:44:26.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.236+0000 7fd05f2a5640 1 -- 172.21.15.77:0/1109637256 shutdown_connections 2024-04-25T01:44:26.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.236+0000 7fd05f2a5640 1 --2- 172.21.15.77:0/1109637256 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd03c06be30 0x7fd03c06e2f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:26.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.236+0000 7fd05f2a5640 1 --2- 172.21.15.77:0/1109637256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd058154380 0x7fd058146580 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:26.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.236+0000 7fd05f2a5640 1 --2- 172.21.15.77:0/1109637256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd058150320 0x7fd058070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:26.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.236+0000 7fd05f2a5640 1 --2- 172.21.15.77:0/1109637256 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd05806d0a0 0x7fd0580c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:26.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.236+0000 7fd05f2a5640 1 -- 172.21.15.77:0/1109637256 >> 172.21.15.77:0/1109637256 conn(0x7fd0580c3f80 msgr2=0x7fd058150a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:26.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.236+0000 7fd05f2a5640 1 -- 172.21.15.77:0/1109637256 shutdown_connections 2024-04-25T01:44:26.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.236+0000 7fd05f2a5640 1 -- 172.21.15.77:0/1109637256 wait complete. 2024-04-25T01:44:26.239 INFO:tasks.mds_thrash.fs.[a]:mds.a down, removed from mdsmap 2024-04-25T01:44:26.239 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2024-04-25T01:44:26.239 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:44:26.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.343+0000 7fb905ad4640 1 Processor -- start 2024-04-25T01:44:26.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.344+0000 7fb905ad4640 1 -- start start 2024-04-25T01:44:26.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.344+0000 7fb905ad4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb9000ac840 0x7fb9000acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:26.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.344+0000 7fb905ad4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb900155d60 con 0x7fb900153cf0 2024-04-25T01:44:26.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.344+0000 7fb905ad4640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb90006b480 con 0x7fb9001558f0 2024-04-25T01:44:26.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.344+0000 7fb905ad4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb900151780 con 0x7fb9000ac840 2024-04-25T01:44:26.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.344+0000 7fb8ff7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb9000ac840 0x7fb9000acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:26.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.344+0000 7fb8ff7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb9000ac840 0x7fb9000acc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39246/0 (socket says 172.21.15.77:39246) 2024-04-25T01:44:26.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.344+0000 7fb8feffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb900153cf0 0x7fb9001551e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60216/0 (socket says 172.21.15.77:60216) 2024-04-25T01:44:26.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.344+0000 7fb8ff7fe640 1 -- 172.21.15.77:0/2734018873 learned_addr learned my addr 172.21.15.77:0/2734018873 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:26.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.345+0000 7fb8ff7fe640 1 -- 172.21.15.77:0/2734018873 >> v1:172.21.15.121:6789/0 conn(0x7fb9001558f0 legacy=0x7fb90015e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:26.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.345+0000 7fb8ff7fe640 1 -- 172.21.15.77:0/2734018873 >> v1:172.21.15.77:6789/0 conn(0x7fb900153cf0 legacy=0x7fb9001551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:26.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.345+0000 7fb8fe7fc640 1 -- 172.21.15.77:0/2734018873 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 885145461 0 0) 0x7fb8f4001110 con 0x7fb900153cf0 2024-04-25T01:44:26.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.345+0000 7fb8ff7fe640 1 -- 172.21.15.77:0/2734018873 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb90006d2f0 con 0x7fb9000ac840 2024-04-25T01:44:26.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.345+0000 7fb8ff7fe640 1 --2- 172.21.15.77:0/2734018873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9000ac840 0x7fb9000acc20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0009870 tx=0x7fb8f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63306bc77327aa82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:26.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.346+0000 7fb8fe7fc640 1 -- 172.21.15.77:0/2734018873 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0037070 con 0x7fb9000ac840 2024-04-25T01:44:26.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.346+0000 7fb8fe7fc640 1 -- 172.21.15.77:0/2734018873 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8f0032440 con 0x7fb9000ac840 2024-04-25T01:44:26.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.346+0000 7fb8fe7fc640 1 -- 172.21.15.77:0/2734018873 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0032810 con 0x7fb9000ac840 2024-04-25T01:44:26.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.346+0000 7fb905ad4640 1 -- 172.21.15.77:0/2734018873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9000ac840 msgr2=0x7fb9000acc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:26.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.346+0000 7fb905ad4640 1 --2- 172.21.15.77:0/2734018873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9000ac840 0x7fb9000acc20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0009870 tx=0x7fb8f002a270 comp rx=0 tx=0).stop 2024-04-25T01:44:26.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.346+0000 7fb905ad4640 1 -- 172.21.15.77:0/2734018873 shutdown_connections 2024-04-25T01:44:26.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.346+0000 7fb905ad4640 1 --2- 172.21.15.77:0/2734018873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9000ac840 0x7fb9000acc20 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:26.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.346+0000 7fb905ad4640 1 -- 172.21.15.77:0/2734018873 >> 172.21.15.77:0/2734018873 conn(0x7fb9000c3f80 msgr2=0x7fb9000c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:26.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.346+0000 7fb905ad4640 1 -- 172.21.15.77:0/2734018873 shutdown_connections 2024-04-25T01:44:26.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.346+0000 7fb905ad4640 1 -- 172.21.15.77:0/2734018873 wait complete. 2024-04-25T01:44:26.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.347+0000 7fb905ad4640 1 Processor -- start 2024-04-25T01:44:26.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.347+0000 7fb905ad4640 1 -- start start 2024-04-25T01:44:26.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.348+0000 7fb905ad4640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb9000ac840 0x7fb90014c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:26.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.348+0000 7fb905ad4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb900153cf0 0x7fb90014a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:26.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.348+0000 7fb905ad4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9001558f0 0x7fb9001ed370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:26.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.348+0000 7fb905ad4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb90006dc20 con 0x7fb900153cf0 2024-04-25T01:44:26.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.348+0000 7fb905ad4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb90006d0a0 con 0x7fb9001558f0 2024-04-25T01:44:26.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.348+0000 7fb905ad4640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb90006d8b0 con 0x7fb9000ac840 2024-04-25T01:44:26.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.348+0000 7fb8feffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb900153cf0 0x7fb90014a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:26.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.348+0000 7fb8feffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb900153cf0 0x7fb90014a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39248/0 (socket says 172.21.15.77:39248) 2024-04-25T01:44:26.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.348+0000 7fb8feffd640 1 -- 172.21.15.77:0/233663594 learned_addr learned my addr 172.21.15.77:0/233663594 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:26.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.348+0000 7fb8ff7fe640 1 --2- 172.21.15.77:0/233663594 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb9000ac840 0x7fb90014c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:26.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.348+0000 7fb8fffff640 1 --2- 172.21.15.77:0/233663594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9001558f0 0x7fb9001ed370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:26.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.348+0000 7fb8feffd640 1 -- 172.21.15.77:0/233663594 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb9000ac840 msgr2=0x7fb90014c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:26.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.348+0000 7fb8feffd640 1 --2- 172.21.15.77:0/233663594 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb9000ac840 0x7fb90014c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:26.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.348+0000 7fb8feffd640 1 -- 172.21.15.77:0/233663594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9001558f0 msgr2=0x7fb9001ed370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:26.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.348+0000 7fb8feffd640 1 --2- 172.21.15.77:0/233663594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9001558f0 0x7fb9001ed370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:26.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.348+0000 7fb8feffd640 1 -- 172.21.15.77:0/233663594 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb90014d7e0 con 0x7fb900153cf0 2024-04-25T01:44:26.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.348+0000 7fb8fffff640 1 --2- 172.21.15.77:0/233663594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9001558f0 0x7fb9001ed370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:44:26.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.349+0000 7fb8feffd640 1 --2- 172.21.15.77:0/233663594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb900153cf0 0x7fb90014a550 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb8f400c7b0 tx=0x7fb8f400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:26.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.349+0000 7fb8e7fff640 1 -- 172.21.15.77:0/233663594 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4018070 con 0x7fb900153cf0 2024-04-25T01:44:26.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.349+0000 7fb8e7fff640 1 -- 172.21.15.77:0/233663594 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8f40072d0 con 0x7fb900153cf0 2024-04-25T01:44:26.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.349+0000 7fb905ad4640 1 -- 172.21.15.77:0/233663594 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb90014bf30 con 0x7fb900153cf0 2024-04-25T01:44:26.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.349+0000 7fb8e7fff640 1 -- 172.21.15.77:0/233663594 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f40047e0 con 0x7fb900153cf0 2024-04-25T01:44:26.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.349+0000 7fb905ad4640 1 -- 172.21.15.77:0/233663594 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb900153670 con 0x7fb900153cf0 2024-04-25T01:44:26.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.350+0000 7fb905ad4640 1 -- 172.21.15.77:0/233663594 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb90004f500 con 0x7fb900153cf0 2024-04-25T01:44:26.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.350+0000 7fb8e7fff640 1 -- 172.21.15.77:0/233663594 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb8f401b070 con 0x7fb900153cf0 2024-04-25T01:44:26.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.350+0000 7fb8e7fff640 1 --2- 172.21.15.77:0/233663594 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb8ec06be60 0x7fb8ec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:26.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.351+0000 7fb8e7fff640 1 -- 172.21.15.77:0/233663594 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7153+0+0 (secure 0 0 0) 0x7fb8f408a5d0 con 0x7fb900153cf0 2024-04-25T01:44:26.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.351+0000 7fb8ff7fe640 1 --2- 172.21.15.77:0/233663594 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb8ec06be60 0x7fb8ec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:26.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.351+0000 7fb8ff7fe640 1 --2- 172.21.15.77:0/233663594 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb8ec06be60 0x7fb8ec06e320 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0034000 tx=0x7fb8f002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:26.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.355+0000 7fb8e7fff640 1 -- 172.21.15.77:0/233663594 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb900155d60 con 0x7fb900153cf0 2024-04-25T01:44:26.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.563+0000 7fb905ad4640 1 -- 172.21.15.77:0/233663594 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb90006b6e0 con 0x7fb900153cf0 2024-04-25T01:44:26.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.564+0000 7fb8e7fff640 1 -- 172.21.15.77:0/233663594 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5656 (secure 0 0 0) 0x7fb8f4007d00 con 0x7fb900153cf0 2024-04-25T01:44:26.556 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:44:26.556 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:44:24.668738+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5622":{"gid":5622,"name":"c","rank":0,"incarnation":34,"state":"up:reconnect","state_seq":12,"addr":"172.21.15.77:6837/1570919706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1570919706},{"type":"v1","addr":"172.21.15.77:6837","nonce":1570919706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:43:32.407370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":22,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5179,"qdb_cluster":[5179]},"id":2}]} 2024-04-25T01:44:26.556 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 35 2024-04-25T01:44:26.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.565+0000 7fb905ad4640 1 -- 172.21.15.77:0/233663594 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb8ec06be60 msgr2=0x7fb8ec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:26.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.565+0000 7fb905ad4640 1 --2- 172.21.15.77:0/233663594 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb8ec06be60 0x7fb8ec06e320 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0034000 tx=0x7fb8f002e000 comp rx=0 tx=0).stop 2024-04-25T01:44:26.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.565+0000 7fb905ad4640 1 -- 172.21.15.77:0/233663594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb900153cf0 msgr2=0x7fb90014a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:26.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.565+0000 7fb905ad4640 1 --2- 172.21.15.77:0/233663594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb900153cf0 0x7fb90014a550 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb8f400c7b0 tx=0x7fb8f400cc70 comp rx=0 tx=0).stop 2024-04-25T01:44:26.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.565+0000 7fb905ad4640 1 -- 172.21.15.77:0/233663594 shutdown_connections 2024-04-25T01:44:26.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.565+0000 7fb905ad4640 1 --2- 172.21.15.77:0/233663594 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fb8ec06be60 0x7fb8ec06e320 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:26.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.565+0000 7fb905ad4640 1 --2- 172.21.15.77:0/233663594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb900153cf0 0x7fb90014a550 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:26.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.565+0000 7fb905ad4640 1 --2- 172.21.15.77:0/233663594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9001558f0 0x7fb9001ed370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:26.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.565+0000 7fb905ad4640 1 --2- 172.21.15.77:0/233663594 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb9000ac840 0x7fb90014c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:26.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.566+0000 7fb905ad4640 1 -- 172.21.15.77:0/233663594 >> 172.21.15.77:0/233663594 conn(0x7fb9000c3f80 msgr2=0x7fb9000c4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:26.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.566+0000 7fb905ad4640 1 -- 172.21.15.77:0/233663594 shutdown_connections 2024-04-25T01:44:26.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:26.566+0000 7fb905ad4640 1 -- 172.21.15.77:0/233663594 wait complete. 2024-04-25T01:44:26.570 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 35, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T01:39:23.701997+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 35, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_5622": { "addr": "172.21.15.77:6837/1570919706", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6836", "nonce": 1570919706, "type": "v2" }, { "addr": "172.21.15.77:6837", "nonce": 1570919706, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5622, "incarnation": 34, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:reconnect", "state_seq": 12 } }, "last_failure": 0, "last_failure_osd_epoch": 31, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-25T01:44:24.668738+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5622 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T01:39:32.761220+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 32, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_5179": { "addr": "172.21.15.121:6834/747036410", "addrs": { "addrvec": [ { "addr": "172.21.15.121:6832", "nonce": 747036410, "type": "v2" }, { "addr": "172.21.15.121:6834", "nonce": 747036410, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5179, "incarnation": 29, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:active", "state_seq": 22 } }, "last_failure": 0, "last_failure_osd_epoch": 30, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-04-25T01:43:32.407370+0000", "qdb_cluster": [ 5179 ], "qdb_leader": 5179, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5179 } } } ], "standbys": [ { "addr": "172.21.15.121:6835/1537604", "addrs": { "addrvec": [ { "addr": "172.21.15.121:6833", "nonce": 1537604, "type": "v2" }, { "addr": "172.21.15.121:6835", "nonce": 1537604, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 22, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5116, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-25T01:44:28.571 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:44:28.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.688+0000 7f3499da2640 1 Processor -- start 2024-04-25T01:44:28.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.688+0000 7f3499da2640 1 -- start start 2024-04-25T01:44:28.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.689+0000 7f3499da2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3494150090 0x7f3494156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:28.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.689+0000 7f3499da2640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f34940c8200 0x7f34940c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:28.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.689+0000 7f3499da2640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34940c9de0 con 0x7f349406c280 2024-04-25T01:44:28.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.689+0000 7f3499da2640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f349406b830 con 0x7f34940c8200 2024-04-25T01:44:28.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.689+0000 7f3499da2640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f34940c89c0 con 0x7f3494150090 2024-04-25T01:44:28.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.690+0000 7f34937fe640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3494150090 0x7f3494156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:28.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.690+0000 7f3492ffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f34940c8200 0x7f34940c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:28.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.690+0000 7f3493fff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f349406c280 0x7f34940c6320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.77:56428/0 (socket says 172.21.15.77:56428) 2024-04-25T01:44:28.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.690+0000 7f3493fff640 1 -- 172.21.15.77:0/3202055293 learned_addr learned my addr 172.21.15.77:0/3202055293 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:44:28.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.690+0000 7f34927fc640 1 -- 172.21.15.77:0/3202055293 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3463631925 0 0) 0x7f34940c9de0 con 0x7f349406c280 2024-04-25T01:44:28.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.690+0000 7f34927fc640 1 -- 172.21.15.77:0/3202055293 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3480003520 con 0x7f349406c280 2024-04-25T01:44:28.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.690+0000 7f34937fe640 1 -- 172.21.15.77:0/3202055293 >> v2:172.21.15.121:3300/0 conn(0x7f34940c8200 msgr2=0x7f34940c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:28.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.690+0000 7f34937fe640 1 --2- 172.21.15.77:0/3202055293 >> v2:172.21.15.121:3300/0 conn(0x7f34940c8200 0x7f34940c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:28.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.690+0000 7f34937fe640 1 -- 172.21.15.77:0/3202055293 >> v1:172.21.15.121:6789/0 conn(0x7f349406c280 legacy=0x7f34940c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:28.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.690+0000 7f34937fe640 1 -- 172.21.15.77:0/3202055293 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34940c8ca0 con 0x7f3494150090 2024-04-25T01:44:28.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.690+0000 7f3492ffd640 1 --2- 172.21.15.77:0/3202055293 >> v2:172.21.15.121:3300/0 conn(0x7f34940c8200 0x7f34940c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:44:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.691+0000 7f34937fe640 1 --2- 172.21.15.77:0/3202055293 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3494150090 0x7f3494156c80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3484009d90 tx=0x7f348402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56df9f7b8b41abe8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.691+0000 7f34927fc640 1 -- 172.21.15.77:0/3202055293 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484007740 con 0x7f3494150090 2024-04-25T01:44:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.691+0000 7f34927fc640 1 -- 172.21.15.77:0/3202055293 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34840078e0 con 0x7f3494150090 2024-04-25T01:44:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.691+0000 7f34927fc640 1 -- 172.21.15.77:0/3202055293 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484007cb0 con 0x7f3494150090 2024-04-25T01:44:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.691+0000 7f3499da2640 1 -- 172.21.15.77:0/3202055293 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3494150090 msgr2=0x7f3494156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.691+0000 7f3499da2640 1 --2- 172.21.15.77:0/3202055293 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3494150090 0x7f3494156c80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3484009d90 tx=0x7f348402a660 comp rx=0 tx=0).stop 2024-04-25T01:44:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.691+0000 7f3499da2640 1 -- 172.21.15.77:0/3202055293 shutdown_connections 2024-04-25T01:44:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.692+0000 7f3499da2640 1 --2- 172.21.15.77:0/3202055293 >> v2:172.21.15.121:3300/0 conn(0x7f34940c8200 0x7f34940c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.692+0000 7f3499da2640 1 --2- 172.21.15.77:0/3202055293 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3494150090 0x7f3494156c80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.692+0000 7f3499da2640 1 -- 172.21.15.77:0/3202055293 >> 172.21.15.77:0/3202055293 conn(0x7f34940ad4d0 msgr2=0x7f34940ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.692+0000 7f3499da2640 1 -- 172.21.15.77:0/3202055293 shutdown_connections 2024-04-25T01:44:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.692+0000 7f3499da2640 1 -- 172.21.15.77:0/3202055293 wait complete. 2024-04-25T01:44:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.693+0000 7f3499da2640 1 Processor -- start 2024-04-25T01:44:28.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.693+0000 7f3499da2640 1 -- start start 2024-04-25T01:44:28.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.693+0000 7f3499da2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f349406c280 0x7f34940c2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:28.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.693+0000 7f3499da2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34940c8200 0x7f34941ef4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:28.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.693+0000 7f3499da2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3494150090 0x7f349414dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:28.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.694+0000 7f3499da2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f34940c8680 con 0x7f3494150090 2024-04-25T01:44:28.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.694+0000 7f3499da2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f349406bd60 con 0x7f34940c8200 2024-04-25T01:44:28.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.694+0000 7f3499da2640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f34940c6a30 con 0x7f349406c280 2024-04-25T01:44:28.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.694+0000 7f3493fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3494150090 0x7f349414dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:28.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.694+0000 7f3493fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3494150090 0x7f349414dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49372/0 (socket says 172.21.15.77:49372) 2024-04-25T01:44:28.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.694+0000 7f3493fff640 1 -- 172.21.15.77:0/2285651176 learned_addr learned my addr 172.21.15.77:0/2285651176 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:28.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.694+0000 7f3492ffd640 1 --2- 172.21.15.77:0/2285651176 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34940c8200 0x7f34941ef4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:28.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.694+0000 7f34937fe640 1 --2- 172.21.15.77:0/2285651176 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f349406c280 0x7f34940c2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:28.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.694+0000 7f3493fff640 1 -- 172.21.15.77:0/2285651176 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f349406c280 msgr2=0x7f34940c2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:28.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.694+0000 7f3493fff640 1 --2- 172.21.15.77:0/2285651176 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f349406c280 0x7f34940c2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:28.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.694+0000 7f3493fff640 1 -- 172.21.15.77:0/2285651176 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34940c8200 msgr2=0x7f34941ef4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:28.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.694+0000 7f3493fff640 1 --2- 172.21.15.77:0/2285651176 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34940c8200 0x7f34941ef4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.694+0000 7f3493fff640 1 -- 172.21.15.77:0/2285651176 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34941efa20 con 0x7f3494150090 2024-04-25T01:44:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.694+0000 7f3493fff640 1 --2- 172.21.15.77:0/2285651176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3494150090 0x7f349414dcc0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f348c00c430 tx=0x7f348c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.694+0000 7f348bfff640 1 -- 172.21.15.77:0/2285651176 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c017070 con 0x7f3494150090 2024-04-25T01:44:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.694+0000 7f348bfff640 1 -- 172.21.15.77:0/2285651176 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f348c005ce0 con 0x7f3494150090 2024-04-25T01:44:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.694+0000 7f3499da2640 1 -- 172.21.15.77:0/2285651176 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34940c5a90 con 0x7f3494150090 2024-04-25T01:44:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.694+0000 7f348bfff640 1 -- 172.21.15.77:0/2285651176 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c007310 con 0x7f3494150090 2024-04-25T01:44:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.694+0000 7f3499da2640 1 -- 172.21.15.77:0/2285651176 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3494153190 con 0x7f3494150090 2024-04-25T01:44:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.695+0000 7f3499da2640 1 -- 172.21.15.77:0/2285651176 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f349404f500 con 0x7f3494150090 2024-04-25T01:44:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.696+0000 7f348bfff640 1 -- 172.21.15.77:0/2285651176 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f348c01a070 con 0x7f3494150090 2024-04-25T01:44:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.696+0000 7f348bfff640 1 --2- 172.21.15.77:0/2285651176 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f347406be30 0x7f347406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.696+0000 7f348bfff640 1 -- 172.21.15.77:0/2285651176 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7153+0+0 (secure 0 0 0) 0x7f348c08a750 con 0x7f3494150090 2024-04-25T01:44:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.696+0000 7f34937fe640 1 --2- 172.21.15.77:0/2285651176 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f347406be30 0x7f347406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.697+0000 7f34937fe640 1 --2- 172.21.15.77:0/2285651176 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f347406be30 0x7f347406e2f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3484034000 tx=0x7f348402f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:28.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.700+0000 7f348bfff640 1 -- 172.21.15.77:0/2285651176 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f348c058590 con 0x7f3494150090 2024-04-25T01:44:28.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.911+0000 7f3499da2640 1 -- 172.21.15.77:0/2285651176 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f34940c6630 con 0x7f3494150090 2024-04-25T01:44:28.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.912+0000 7f348bfff640 1 -- 172.21.15.77:0/2285651176 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5660 (secure 0 0 0) 0x7f348c05c890 con 0x7f3494150090 2024-04-25T01:44:28.904 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:44:28.904 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:44:27.568589+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5622":{"gid":5622,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":14,"addr":"172.21.15.77:6837/1570919706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1570919706},{"type":"v1","addr":"172.21.15.77:6837","nonce":1570919706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5622,"qdb_cluster":[5622]},"id":1},{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:43:32.407370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":22,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5179,"qdb_cluster":[5179]},"id":2}]} 2024-04-25T01:44:28.904 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 37 2024-04-25T01:44:28.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.914+0000 7f3499da2640 1 -- 172.21.15.77:0/2285651176 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f347406be30 msgr2=0x7f347406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:28.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.914+0000 7f3499da2640 1 --2- 172.21.15.77:0/2285651176 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f347406be30 0x7f347406e2f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3484034000 tx=0x7f348402f000 comp rx=0 tx=0).stop 2024-04-25T01:44:28.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.914+0000 7f3499da2640 1 -- 172.21.15.77:0/2285651176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3494150090 msgr2=0x7f349414dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:28.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.914+0000 7f3499da2640 1 --2- 172.21.15.77:0/2285651176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3494150090 0x7f349414dcc0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f348c00c430 tx=0x7f348c00c8f0 comp rx=0 tx=0).stop 2024-04-25T01:44:28.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.914+0000 7f3499da2640 1 -- 172.21.15.77:0/2285651176 shutdown_connections 2024-04-25T01:44:28.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.914+0000 7f3499da2640 1 --2- 172.21.15.77:0/2285651176 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f347406be30 0x7f347406e2f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:28.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.914+0000 7f3499da2640 1 --2- 172.21.15.77:0/2285651176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3494150090 0x7f349414dcc0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:28.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.914+0000 7f3499da2640 1 --2- 172.21.15.77:0/2285651176 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34940c8200 0x7f34941ef4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:28.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.914+0000 7f3499da2640 1 --2- 172.21.15.77:0/2285651176 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f349406c280 0x7f34940c2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:28.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.914+0000 7f3499da2640 1 -- 172.21.15.77:0/2285651176 >> 172.21.15.77:0/2285651176 conn(0x7f34940ad4d0 msgr2=0x7f3494153f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:28.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.914+0000 7f3499da2640 1 -- 172.21.15.77:0/2285651176 shutdown_connections 2024-04-25T01:44:28.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:28.914+0000 7f3499da2640 1 -- 172.21.15.77:0/2285651176 wait complete. 2024-04-25T01:44:28.917 INFO:tasks.mds_thrash.fs.[a]:mds.c has gained rank=0, replacing gid=5439 2024-04-25T01:44:28.917 INFO:tasks.mds_thrash.fs.[a]:waiting for 3 secs before reviving mds.a 2024-04-25T01:44:31.918 INFO:tasks.mds_thrash.fs.[a]:reviving mds.a 2024-04-25T01:44:31.919 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T01:44:31.919 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T01:44:31.922 INFO:tasks.ceph.mds.a:Started 2024-04-25T01:44:31.922 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:44:32.002 INFO:tasks.ceph.mds.a.smithi077.stdout:starting mds.a at 2024-04-25T01:44:32.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.039+0000 7f992d5e7640 1 Processor -- start 2024-04-25T01:44:32.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.039+0000 7f992d5e7640 1 -- start start 2024-04-25T01:44:32.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.040+0000 7f992d5e7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9928156c80 0x7f99280c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:32.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.040+0000 7f992d5e7640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f992806c280 0x7f99280c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:32.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.040+0000 7f992d5e7640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9928157130 con 0x7f9928150090 2024-04-25T01:44:32.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.040+0000 7f992d5e7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f992806b830 con 0x7f9928156c80 2024-04-25T01:44:32.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.040+0000 7f992d5e7640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f99280c9de0 con 0x7f992806c280 2024-04-25T01:44:32.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.040+0000 7f991ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9928156c80 0x7f99280c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:32.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.040+0000 7f991ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9928156c80 0x7f99280c98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49392/0 (socket says 172.21.15.77:49392) 2024-04-25T01:44:32.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.040+0000 7f991ffff640 1 -- 172.21.15.77:0/1939259296 learned_addr learned my addr 172.21.15.77:0/1939259296 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:32.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.040+0000 7f99277fe640 1 --2- 172.21.15.77:0/1939259296 >> v2:172.21.15.121:3300/0 conn(0x7f992806c280 0x7f99280c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:32.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.040+0000 7f991ffff640 1 -- 172.21.15.77:0/1939259296 >> v2:172.21.15.121:3300/0 conn(0x7f992806c280 msgr2=0x7f99280c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:32.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.040+0000 7f991ffff640 1 --2- 172.21.15.77:0/1939259296 >> v2:172.21.15.121:3300/0 conn(0x7f992806c280 0x7f99280c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:32.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.040+0000 7f991ffff640 1 -- 172.21.15.77:0/1939259296 >> v1:172.21.15.121:6789/0 conn(0x7f9928150090 legacy=0x7f99280c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:32.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.040+0000 7f991ffff640 1 -- 172.21.15.77:0/1939259296 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99280c89c0 con 0x7f9928156c80 2024-04-25T01:44:32.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.040+0000 7f99277fe640 1 --2- 172.21.15.77:0/1939259296 >> v2:172.21.15.121:3300/0 conn(0x7f992806c280 0x7f99280c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:44:32.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.041+0000 7f991ffff640 1 --2- 172.21.15.77:0/1939259296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9928156c80 0x7f99280c98a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f99280c78d0 tx=0x7f991002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827d3310c95485a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:32.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.041+0000 7f99267fc640 1 -- 172.21.15.77:0/1939259296 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9910037070 con 0x7f9928156c80 2024-04-25T01:44:32.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.041+0000 7f99267fc640 1 -- 172.21.15.77:0/1939259296 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9910032440 con 0x7f9928156c80 2024-04-25T01:44:32.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.041+0000 7f99267fc640 1 -- 172.21.15.77:0/1939259296 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9910032810 con 0x7f9928156c80 2024-04-25T01:44:32.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.041+0000 7f992d5e7640 1 -- 172.21.15.77:0/1939259296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9928156c80 msgr2=0x7f99280c98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:32.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.041+0000 7f992d5e7640 1 --2- 172.21.15.77:0/1939259296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9928156c80 0x7f99280c98a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f99280c78d0 tx=0x7f991002a270 comp rx=0 tx=0).stop 2024-04-25T01:44:32.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.042+0000 7f992d5e7640 1 -- 172.21.15.77:0/1939259296 shutdown_connections 2024-04-25T01:44:32.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.042+0000 7f992d5e7640 1 --2- 172.21.15.77:0/1939259296 >> v2:172.21.15.121:3300/0 conn(0x7f992806c280 0x7f99280c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:32.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.042+0000 7f992d5e7640 1 --2- 172.21.15.77:0/1939259296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9928156c80 0x7f99280c98a0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:32.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.042+0000 7f992d5e7640 1 -- 172.21.15.77:0/1939259296 >> 172.21.15.77:0/1939259296 conn(0x7f99280ad4d0 msgr2=0x7f99280ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:32.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.042+0000 7f992d5e7640 1 -- 172.21.15.77:0/1939259296 shutdown_connections 2024-04-25T01:44:32.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.042+0000 7f992d5e7640 1 -- 172.21.15.77:0/1939259296 wait complete. 2024-04-25T01:44:32.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.043+0000 7f992d5e7640 1 Processor -- start 2024-04-25T01:44:32.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.043+0000 7f992d5e7640 1 -- start start 2024-04-25T01:44:32.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.043+0000 7f992d5e7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f992806c280 0x7f99281f00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:32.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.043+0000 7f992d5e7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9928150090 0x7f99281528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:32.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.043+0000 7f992d5e7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9928156c80 0x7f99281ec070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:32.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.043+0000 7f992d5e7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f992806bd60 con 0x7f992806c280 2024-04-25T01:44:32.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.043+0000 7f992d5e7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f992806ba80 con 0x7f9928156c80 2024-04-25T01:44:32.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.043+0000 7f992d5e7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f992806c690 con 0x7f9928150090 2024-04-25T01:44:32.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.043+0000 7f9926ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f992806c280 0x7f99281f00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:32.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.043+0000 7f9926ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f992806c280 0x7f99281f00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49402/0 (socket says 172.21.15.77:49402) 2024-04-25T01:44:32.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.043+0000 7f9926ffd640 1 -- 172.21.15.77:0/4095202665 learned_addr learned my addr 172.21.15.77:0/4095202665 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:32.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.044+0000 7f99277fe640 1 --2- 172.21.15.77:0/4095202665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9928156c80 0x7f99281ec070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:32.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.044+0000 7f991ffff640 1 --2- 172.21.15.77:0/4095202665 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9928150090 0x7f99281528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:32.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.044+0000 7f9926ffd640 1 -- 172.21.15.77:0/4095202665 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9928150090 msgr2=0x7f99281528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:32.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.044+0000 7f9926ffd640 1 --2- 172.21.15.77:0/4095202665 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9928150090 0x7f99281528b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:32.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.044+0000 7f9926ffd640 1 -- 172.21.15.77:0/4095202665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9928156c80 msgr2=0x7f99281ec070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:32.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.044+0000 7f9926ffd640 1 --2- 172.21.15.77:0/4095202665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9928156c80 0x7f99281ec070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:32.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.044+0000 7f9926ffd640 1 -- 172.21.15.77:0/4095202665 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f992815a5c0 con 0x7f992806c280 2024-04-25T01:44:32.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.044+0000 7f9926ffd640 1 --2- 172.21.15.77:0/4095202665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f992806c280 0x7f99281f00c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f991800c430 tx=0x7f991800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:32.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.044+0000 7f991f7fe640 1 -- 172.21.15.77:0/4095202665 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99180052d0 con 0x7f992806c280 2024-04-25T01:44:32.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.044+0000 7f991f7fe640 1 -- 172.21.15.77:0/4095202665 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9918005490 con 0x7f992806c280 2024-04-25T01:44:32.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.044+0000 7f992d5e7640 1 -- 172.21.15.77:0/4095202665 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9928158df0 con 0x7f992806c280 2024-04-25T01:44:32.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.044+0000 7f991f7fe640 1 -- 172.21.15.77:0/4095202665 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9918007260 con 0x7f992806c280 2024-04-25T01:44:32.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.044+0000 7f992d5e7640 1 -- 172.21.15.77:0/4095202665 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99281ef5e0 con 0x7f992806c280 2024-04-25T01:44:32.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.045+0000 7f992d5e7640 1 -- 172.21.15.77:0/4095202665 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99280c9290 con 0x7f992806c280 2024-04-25T01:44:32.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.045+0000 7f991f7fe640 1 -- 172.21.15.77:0/4095202665 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9918007400 con 0x7f992806c280 2024-04-25T01:44:32.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.046+0000 7f991f7fe640 1 --2- 172.21.15.77:0/4095202665 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f990806be30 0x7f990806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:32.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.046+0000 7f991f7fe640 1 -- 172.21.15.77:0/4095202665 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7153+0+0 (secure 0 0 0) 0x7f991808a8a0 con 0x7f992806c280 2024-04-25T01:44:32.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.046+0000 7f991ffff640 1 --2- 172.21.15.77:0/4095202665 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f990806be30 0x7f990806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:32.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.046+0000 7f991ffff640 1 --2- 172.21.15.77:0/4095202665 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f990806be30 0x7f990806e2f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9910034000 tx=0x7f991002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:32.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.050+0000 7f991f7fe640 1 -- 172.21.15.77:0/4095202665 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f99280c9290 con 0x7f992806c280 2024-04-25T01:44:32.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.259+0000 7f992d5e7640 1 -- 172.21.15.77:0/4095202665 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f992804f500 con 0x7f992806c280 2024-04-25T01:44:32.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.260+0000 7f991f7fe640 1 -- 172.21.15.77:0/4095202665 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5660 (secure 0 0 0) 0x7f992815a5c0 con 0x7f992806c280 2024-04-25T01:44:32.252 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:44:32.252 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:44:27.568589+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5622":{"gid":5622,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":14,"addr":"172.21.15.77:6837/1570919706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1570919706},{"type":"v1","addr":"172.21.15.77:6837","nonce":1570919706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5622,"qdb_cluster":[5622]},"id":1},{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:43:32.407370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":22,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5179,"qdb_cluster":[5179]},"id":2}]} 2024-04-25T01:44:32.252 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 37 2024-04-25T01:44:32.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.262+0000 7f992d5e7640 1 -- 172.21.15.77:0/4095202665 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f990806be30 msgr2=0x7f990806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:32.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.262+0000 7f992d5e7640 1 --2- 172.21.15.77:0/4095202665 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f990806be30 0x7f990806e2f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9910034000 tx=0x7f991002e000 comp rx=0 tx=0).stop 2024-04-25T01:44:32.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.262+0000 7f992d5e7640 1 -- 172.21.15.77:0/4095202665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f992806c280 msgr2=0x7f99281f00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:32.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.262+0000 7f992d5e7640 1 --2- 172.21.15.77:0/4095202665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f992806c280 0x7f99281f00c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f991800c430 tx=0x7f991800c8f0 comp rx=0 tx=0).stop 2024-04-25T01:44:32.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.262+0000 7f992d5e7640 1 -- 172.21.15.77:0/4095202665 shutdown_connections 2024-04-25T01:44:32.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.262+0000 7f992d5e7640 1 --2- 172.21.15.77:0/4095202665 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f990806be30 0x7f990806e2f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:32.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.262+0000 7f992d5e7640 1 --2- 172.21.15.77:0/4095202665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9928156c80 0x7f99281ec070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:32.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.262+0000 7f992d5e7640 1 --2- 172.21.15.77:0/4095202665 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9928150090 0x7f99281528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:32.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.262+0000 7f992d5e7640 1 --2- 172.21.15.77:0/4095202665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f992806c280 0x7f99281f00c0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:32.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.262+0000 7f992d5e7640 1 -- 172.21.15.77:0/4095202665 >> 172.21.15.77:0/4095202665 conn(0x7f99280ad4d0 msgr2=0x7f99280c9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:32.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.262+0000 7f992d5e7640 1 -- 172.21.15.77:0/4095202665 shutdown_connections 2024-04-25T01:44:32.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:32.262+0000 7f992d5e7640 1 -- 172.21.15.77:0/4095202665 wait complete. 2024-04-25T01:44:32.265 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2024-04-25T01:44:32.428 INFO:tasks.ceph.mds.c.smithi077.stderr:2024-04-25T01:44:32.436+0000 7f07ae3f2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T01:44:34.266 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:44:34.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.384+0000 7fd4ffc9e640 1 Processor -- start 2024-04-25T01:44:34.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.384+0000 7fd4ffc9e640 1 -- start start 2024-04-25T01:44:34.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.385+0000 7fd4ffc9e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd4f806d0a0 0x7fd4f806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:34.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.385+0000 7fd4ffc9e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd4f8154380 0x7fd4f8154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:34.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.385+0000 7fd4ffc9e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4f8153be0 con 0x7fd4f8150320 2024-04-25T01:44:34.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.385+0000 7fd4ffc9e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd4f8152fd0 con 0x7fd4f8154380 2024-04-25T01:44:34.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.385+0000 7fd4ffc9e640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fd4f81532b0 con 0x7fd4f806d0a0 2024-04-25T01:44:34.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.385+0000 7fd4fe23b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd4f8154380 0x7fd4f8154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:34.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.385+0000 7fd4fda3a640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd4f8150320 0x7fd4f8156bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36686/0 (socket says 172.21.15.77:36686) 2024-04-25T01:44:34.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.385+0000 7fd4fe23b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd4f8154380 0x7fd4f8154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49406/0 (socket says 172.21.15.77:49406) 2024-04-25T01:44:34.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.385+0000 7fd4fe23b640 1 -- 172.21.15.77:0/1359905580 learned_addr learned my addr 172.21.15.77:0/1359905580 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:34.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.385+0000 7fd4fd239640 1 --2- 172.21.15.77:0/1359905580 >> v2:172.21.15.121:3300/0 conn(0x7fd4f806d0a0 0x7fd4f806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:34.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.385+0000 7fd4fe23b640 1 -- 172.21.15.77:0/1359905580 >> v2:172.21.15.121:3300/0 conn(0x7fd4f806d0a0 msgr2=0x7fd4f806d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:34.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.385+0000 7fd4fe23b640 1 --2- 172.21.15.77:0/1359905580 >> v2:172.21.15.121:3300/0 conn(0x7fd4f806d0a0 0x7fd4f806d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:34.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.385+0000 7fd4fe23b640 1 -- 172.21.15.77:0/1359905580 >> v1:172.21.15.77:6789/0 conn(0x7fd4f8150320 legacy=0x7fd4f8156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:34.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.385+0000 7fd4fe23b640 1 -- 172.21.15.77:0/1359905580 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f8153590 con 0x7fd4f8154380 2024-04-25T01:44:34.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.386+0000 7fd4fe23b640 1 --2- 172.21.15.77:0/1359905580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f8154380 0x7fd4f8154830 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd4f806e450 tx=0x7fd4f002a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2454da326c2f5104 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:34.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.386+0000 7fd4fca38640 1 -- 172.21.15.77:0/1359905580 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f0036070 con 0x7fd4f8154380 2024-04-25T01:44:34.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.386+0000 7fd4fca38640 1 -- 172.21.15.77:0/1359905580 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f0031600 con 0x7fd4f8154380 2024-04-25T01:44:34.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.386+0000 7fd4fca38640 1 -- 172.21.15.77:0/1359905580 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f00319d0 con 0x7fd4f8154380 2024-04-25T01:44:34.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.386+0000 7fd4ffc9e640 1 -- 172.21.15.77:0/1359905580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f8154380 msgr2=0x7fd4f8154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:34.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.386+0000 7fd4ffc9e640 1 --2- 172.21.15.77:0/1359905580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f8154380 0x7fd4f8154830 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd4f806e450 tx=0x7fd4f002a6d0 comp rx=0 tx=0).stop 2024-04-25T01:44:34.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.386+0000 7fd4ffc9e640 1 -- 172.21.15.77:0/1359905580 shutdown_connections 2024-04-25T01:44:34.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.386+0000 7fd4ffc9e640 1 --2- 172.21.15.77:0/1359905580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f8154380 0x7fd4f8154830 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:34.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.386+0000 7fd4ffc9e640 1 --2- 172.21.15.77:0/1359905580 >> v2:172.21.15.121:3300/0 conn(0x7fd4f806d0a0 0x7fd4f806d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:34.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.386+0000 7fd4ffc9e640 1 -- 172.21.15.77:0/1359905580 >> 172.21.15.77:0/1359905580 conn(0x7fd4f80c3f80 msgr2=0x7fd4f80c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:34.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.387+0000 7fd4ffc9e640 1 -- 172.21.15.77:0/1359905580 shutdown_connections 2024-04-25T01:44:34.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.387+0000 7fd4ffc9e640 1 -- 172.21.15.77:0/1359905580 wait complete. 2024-04-25T01:44:34.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.388+0000 7fd4ffc9e640 1 Processor -- start 2024-04-25T01:44:34.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.388+0000 7fd4ffc9e640 1 -- start start 2024-04-25T01:44:34.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.388+0000 7fd4ffc9e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f806d0a0 0x7fd4f814cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:34.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.388+0000 7fd4ffc9e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd4f8150320 0x7fd4f814d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:34.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.388+0000 7fd4ffc9e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4f8154380 0x7fd4f8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:34.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.388+0000 7fd4ffc9e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f8152d70 con 0x7fd4f806d0a0 2024-04-25T01:44:34.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.388+0000 7fd4ffc9e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f8152bf0 con 0x7fd4f8154380 2024-04-25T01:44:34.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.388+0000 7fd4ffc9e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f80c3100 con 0x7fd4f8150320 2024-04-25T01:44:34.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.388+0000 7fd4fda3a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f806d0a0 0x7fd4f814cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:34.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.388+0000 7fd4fda3a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f806d0a0 0x7fd4f814cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49422/0 (socket says 172.21.15.77:49422) 2024-04-25T01:44:34.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.388+0000 7fd4fda3a640 1 -- 172.21.15.77:0/1329431948 learned_addr learned my addr 172.21.15.77:0/1329431948 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:34.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.389+0000 7fd4fe23b640 1 --2- 172.21.15.77:0/1329431948 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4f8154380 0x7fd4f8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:34.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.389+0000 7fd4fd239640 1 --2- 172.21.15.77:0/1329431948 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd4f8150320 0x7fd4f814d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:34.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.389+0000 7fd4fda3a640 1 -- 172.21.15.77:0/1329431948 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd4f8150320 msgr2=0x7fd4f814d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:34.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.389+0000 7fd4fda3a640 1 --2- 172.21.15.77:0/1329431948 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd4f8150320 0x7fd4f814d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:34.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.389+0000 7fd4fda3a640 1 -- 172.21.15.77:0/1329431948 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4f8154380 msgr2=0x7fd4f8154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:34.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.389+0000 7fd4fda3a640 1 --2- 172.21.15.77:0/1329431948 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4f8154380 0x7fd4f8154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:34.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.389+0000 7fd4fda3a640 1 -- 172.21.15.77:0/1329431948 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f814b0c0 con 0x7fd4f806d0a0 2024-04-25T01:44:34.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.389+0000 7fd4fd239640 1 --2- 172.21.15.77:0/1329431948 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd4f8150320 0x7fd4f814d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:44:34.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.389+0000 7fd4fda3a640 1 --2- 172.21.15.77:0/1329431948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f806d0a0 0x7fd4f814cdd0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400c430 tx=0x7fd4f400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:34.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.389+0000 7fd4ee7fc640 1 -- 172.21.15.77:0/1329431948 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f40074e0 con 0x7fd4f806d0a0 2024-04-25T01:44:34.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.389+0000 7fd4ee7fc640 1 -- 172.21.15.77:0/1329431948 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f4007680 con 0x7fd4f806d0a0 2024-04-25T01:44:34.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.389+0000 7fd4ee7fc640 1 -- 172.21.15.77:0/1329431948 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4004a00 con 0x7fd4f806d0a0 2024-04-25T01:44:34.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.389+0000 7fd4ffc9e640 1 -- 172.21.15.77:0/1329431948 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4f814b3a0 con 0x7fd4f806d0a0 2024-04-25T01:44:34.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.389+0000 7fd4ffc9e640 1 -- 172.21.15.77:0/1329431948 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4f80aaff0 con 0x7fd4f806d0a0 2024-04-25T01:44:34.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.390+0000 7fd4ffc9e640 1 -- 172.21.15.77:0/1329431948 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4f8150700 con 0x7fd4f806d0a0 2024-04-25T01:44:34.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.391+0000 7fd4ee7fc640 1 -- 172.21.15.77:0/1329431948 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd4f401a020 con 0x7fd4f806d0a0 2024-04-25T01:44:34.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.391+0000 7fd4ee7fc640 1 --2- 172.21.15.77:0/1329431948 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd4dc06be60 0x7fd4dc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:34.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.391+0000 7fd4ee7fc640 1 -- 172.21.15.77:0/1329431948 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7153+0+0 (secure 0 0 0) 0x7fd4f408ab00 con 0x7fd4f806d0a0 2024-04-25T01:44:34.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.391+0000 7fd4fd239640 1 --2- 172.21.15.77:0/1329431948 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd4dc06be60 0x7fd4dc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:34.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.392+0000 7fd4fd239640 1 --2- 172.21.15.77:0/1329431948 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd4dc06be60 0x7fd4dc06e320 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd4f814a870 tx=0x7fd4e8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:34.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.395+0000 7fd4ee7fc640 1 -- 172.21.15.77:0/1329431948 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd4f8150700 con 0x7fd4f806d0a0 2024-04-25T01:44:34.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.608+0000 7fd4ffc9e640 1 -- 172.21.15.77:0/1329431948 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4f804f500 con 0x7fd4f806d0a0 2024-04-25T01:44:34.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.608+0000 7fd4ee7fc640 1 -- 172.21.15.77:0/1329431948 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+6485 (secure 0 0 0) 0x7fd4f4058f90 con 0x7fd4f806d0a0 2024-04-25T01:44:34.600 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:44:34.601 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5964,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1289251527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1289251527},{"type":"v1","addr":"172.21.15.77:6835","nonce":1289251527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:44:27.568589+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5622":{"gid":5622,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":14,"addr":"172.21.15.77:6837/1570919706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1570919706},{"type":"v1","addr":"172.21.15.77:6837","nonce":1570919706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5622,"qdb_cluster":[5622]},"id":1},{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:43:32.407370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":22,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5179,"qdb_cluster":[5179]},"id":2}]} 2024-04-25T01:44:34.601 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 38 2024-04-25T01:44:34.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.610+0000 7fd4ffc9e640 1 -- 172.21.15.77:0/1329431948 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd4dc06be60 msgr2=0x7fd4dc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:34.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.610+0000 7fd4ffc9e640 1 --2- 172.21.15.77:0/1329431948 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd4dc06be60 0x7fd4dc06e320 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd4f814a870 tx=0x7fd4e8008040 comp rx=0 tx=0).stop 2024-04-25T01:44:34.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.610+0000 7fd4ffc9e640 1 -- 172.21.15.77:0/1329431948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f806d0a0 msgr2=0x7fd4f814cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:34.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.610+0000 7fd4ffc9e640 1 --2- 172.21.15.77:0/1329431948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f806d0a0 0x7fd4f814cdd0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400c430 tx=0x7fd4f400c8f0 comp rx=0 tx=0).stop 2024-04-25T01:44:34.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.610+0000 7fd4ffc9e640 1 -- 172.21.15.77:0/1329431948 shutdown_connections 2024-04-25T01:44:34.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.610+0000 7fd4ffc9e640 1 --2- 172.21.15.77:0/1329431948 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fd4dc06be60 0x7fd4dc06e320 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:34.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.610+0000 7fd4ffc9e640 1 --2- 172.21.15.77:0/1329431948 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4f8154380 0x7fd4f8154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:34.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.610+0000 7fd4ffc9e640 1 --2- 172.21.15.77:0/1329431948 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd4f8150320 0x7fd4f814d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:34.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.610+0000 7fd4ffc9e640 1 --2- 172.21.15.77:0/1329431948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4f806d0a0 0x7fd4f814cdd0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:34.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.610+0000 7fd4ffc9e640 1 -- 172.21.15.77:0/1329431948 >> 172.21.15.77:0/1329431948 conn(0x7fd4f80c3f80 msgr2=0x7fd4f80c1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:34.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.611+0000 7fd4ffc9e640 1 -- 172.21.15.77:0/1329431948 shutdown_connections 2024-04-25T01:44:34.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:34.611+0000 7fd4ffc9e640 1 -- 172.21.15.77:0/1329431948 wait complete. 2024-04-25T01:44:34.613 INFO:tasks.mds_thrash.fs.[a]:mds.a reported in up:standby state 2024-04-25T01:44:34.614 INFO:tasks.mds_thrash.fs.[a]:waiting for 101 secs before thrashing 2024-04-25T01:44:36.208 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T01:44:36.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.324+0000 7f9816fe7640 1 Processor -- start 2024-04-25T01:44:36.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.324+0000 7f9816fe7640 1 -- start start 2024-04-25T01:44:36.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.325+0000 7f9816fe7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9810150320 0x7f9810156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:36.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.325+0000 7f9816fe7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9810153be0 con 0x7f981006d4e0 2024-04-25T01:44:36.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.325+0000 7f9816fe7640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9810157100 con 0x7f981006d0a0 2024-04-25T01:44:36.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.325+0000 7f9816fe7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9810152fd0 con 0x7f9810150320 2024-04-25T01:44:36.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.325+0000 7f9814d83640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9810150320 0x7f9810156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:36.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.325+0000 7f9815584640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f981006d4e0 0x7f9810154a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36690/0 (socket says 172.21.15.77:36690) 2024-04-25T01:44:36.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.325+0000 7f9815584640 1 -- 172.21.15.77:0/3148941267 learned_addr learned my addr 172.21.15.77:0/3148941267 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:44:36.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.325+0000 7f9814d83640 1 -- 172.21.15.77:0/3148941267 >> v1:172.21.15.121:6789/0 conn(0x7f981006d0a0 legacy=0x7f9810154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:36.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.325+0000 7f9814d83640 1 -- 172.21.15.77:0/3148941267 >> v1:172.21.15.77:6789/0 conn(0x7f981006d4e0 legacy=0x7f9810154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:36.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.325+0000 7f9814d83640 1 -- 172.21.15.77:0/3148941267 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98101532b0 con 0x7f9810150320 2024-04-25T01:44:36.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.325+0000 7f980f7fe640 1 -- 172.21.15.77:0/3148941267 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 411920249 0 0) 0x7f9810153be0 con 0x7f981006d4e0 2024-04-25T01:44:36.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.326+0000 7f9814d83640 1 --2- 172.21.15.77:0/3148941267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9810150320 0x7f9810156bc0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f98040097a0 tx=0x7f980402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae8b16a5a0f32ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:36.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.326+0000 7f980f7fe640 1 -- 172.21.15.77:0/3148941267 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9804037070 con 0x7f9810150320 2024-04-25T01:44:36.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.326+0000 7f980f7fe640 1 -- 172.21.15.77:0/3148941267 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f980402ae50 con 0x7f9810150320 2024-04-25T01:44:36.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.326+0000 7f980f7fe640 1 -- 172.21.15.77:0/3148941267 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9804032660 con 0x7f9810150320 2024-04-25T01:44:36.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.326+0000 7f9816fe7640 1 -- 172.21.15.77:0/3148941267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9810150320 msgr2=0x7f9810156bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:36.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.326+0000 7f9816fe7640 1 --2- 172.21.15.77:0/3148941267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9810150320 0x7f9810156bc0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f98040097a0 tx=0x7f980402a140 comp rx=0 tx=0).stop 2024-04-25T01:44:36.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.327+0000 7f9816fe7640 1 -- 172.21.15.77:0/3148941267 shutdown_connections 2024-04-25T01:44:36.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.327+0000 7f9816fe7640 1 --2- 172.21.15.77:0/3148941267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9810150320 0x7f9810156bc0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:36.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.327+0000 7f9816fe7640 1 -- 172.21.15.77:0/3148941267 >> 172.21.15.77:0/3148941267 conn(0x7f98100c3f80 msgr2=0x7f98100c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:36.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.327+0000 7f9816fe7640 1 -- 172.21.15.77:0/3148941267 shutdown_connections 2024-04-25T01:44:36.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.327+0000 7f9816fe7640 1 -- 172.21.15.77:0/3148941267 wait complete. 2024-04-25T01:44:36.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.328+0000 7f9816fe7640 1 Processor -- start 2024-04-25T01:44:36.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.328+0000 7f9816fe7640 1 -- start start 2024-04-25T01:44:36.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.329+0000 7f9816fe7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f981006d0a0 0x7f9810070850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:36.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.329+0000 7f9816fe7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f981006d4e0 0x7f9810144d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:36.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.329+0000 7f9816fe7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9810150320 0x7f98101452b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:36.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.329+0000 7f9816fe7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9810152bf0 con 0x7f981006d4e0 2024-04-25T01:44:36.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.329+0000 7f9816fe7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9810153870 con 0x7f981006d0a0 2024-04-25T01:44:36.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.329+0000 7f9816fe7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9810152d70 con 0x7f9810150320 2024-04-25T01:44:36.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.329+0000 7f980ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f981006d4e0 0x7f9810144d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:36.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.329+0000 7f980ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f981006d4e0 0x7f9810144d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49448/0 (socket says 172.21.15.77:49448) 2024-04-25T01:44:36.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.329+0000 7f980ffff640 1 -- 172.21.15.77:0/3279704622 learned_addr learned my addr 172.21.15.77:0/3279704622 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:36.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.329+0000 7f9814d83640 1 --2- 172.21.15.77:0/3279704622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f981006d0a0 0x7f9810070850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:36.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.329+0000 7f980ffff640 1 -- 172.21.15.77:0/3279704622 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9810150320 msgr2=0x7f98101452b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:36.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.329+0000 7f9815584640 1 --2- 172.21.15.77:0/3279704622 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9810150320 0x7f98101452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:36.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.329+0000 7f980ffff640 1 --2- 172.21.15.77:0/3279704622 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9810150320 0x7f98101452b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:36.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.329+0000 7f980ffff640 1 -- 172.21.15.77:0/3279704622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f981006d0a0 msgr2=0x7f9810070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:36.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.329+0000 7f980ffff640 1 --2- 172.21.15.77:0/3279704622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f981006d0a0 0x7f9810070850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:36.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.329+0000 7f980ffff640 1 -- 172.21.15.77:0/3279704622 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98101460c0 con 0x7f981006d4e0 2024-04-25T01:44:36.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.329+0000 7f9814d83640 1 --2- 172.21.15.77:0/3279704622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f981006d0a0 0x7f9810070850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:44:36.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.329+0000 7f980ffff640 1 --2- 172.21.15.77:0/3279704622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f981006d4e0 0x7f9810144d70 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f97fc00c430 tx=0x7f97fc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:36.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.329+0000 7f980d7fa640 1 -- 172.21.15.77:0/3279704622 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97fc011790 con 0x7f981006d4e0 2024-04-25T01:44:36.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.329+0000 7f980d7fa640 1 -- 172.21.15.77:0/3279704622 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97fc017070 con 0x7f981006d4e0 2024-04-25T01:44:36.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.329+0000 7f980d7fa640 1 -- 172.21.15.77:0/3279704622 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97fc011b70 con 0x7f981006d4e0 2024-04-25T01:44:36.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.329+0000 7f9816fe7640 1 -- 172.21.15.77:0/3279704622 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9810145e00 con 0x7f981006d4e0 2024-04-25T01:44:36.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.329+0000 7f9816fe7640 1 -- 172.21.15.77:0/3279704622 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98101ecdd0 con 0x7f981006d4e0 2024-04-25T01:44:36.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.330+0000 7f9816fe7640 1 -- 172.21.15.77:0/3279704622 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9810075330 con 0x7f981006d4e0 2024-04-25T01:44:36.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.331+0000 7f980d7fa640 1 -- 172.21.15.77:0/3279704622 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f97fc011d10 con 0x7f981006d4e0 2024-04-25T01:44:36.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.331+0000 7f980d7fa640 1 --2- 172.21.15.77:0/3279704622 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f97f406be30 0x7f97f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:36.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.332+0000 7f9814d83640 1 --2- 172.21.15.77:0/3279704622 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f97f406be30 0x7f97f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:36.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.332+0000 7f980d7fa640 1 -- 172.21.15.77:0/3279704622 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7153+0+0 (secure 0 0 0) 0x7f97fc08b2e0 con 0x7f981006d4e0 2024-04-25T01:44:36.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.332+0000 7f9814d83640 1 --2- 172.21.15.77:0/3279704622 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f97f406be30 0x7f97f406e2f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9804034000 tx=0x7f980402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:36.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.336+0000 7f980d7fa640 1 -- 172.21.15.77:0/3279704622 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9810075330 con 0x7f981006d4e0 2024-04-25T01:44:36.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.514+0000 7f9816fe7640 1 -- 172.21.15.77:0/3279704622 --> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9810073750 con 0x7f97f406be30 2024-04-25T01:44:36.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.525+0000 7f980d7fa640 1 -- 172.21.15.77:0/3279704622 <== mgr.4098 v2:172.21.15.77:6832/4208232183 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+493451 (secure 0 0 0) 0x7f9810073750 con 0x7f97f406be30 2024-04-25T01:44:36.523 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:44:36.527 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-25T01:44:36.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.529+0000 7f9816fe7640 1 -- 172.21.15.77:0/3279704622 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f97f406be30 msgr2=0x7f97f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:36.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.529+0000 7f9816fe7640 1 --2- 172.21.15.77:0/3279704622 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f97f406be30 0x7f97f406e2f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9804034000 tx=0x7f980402e000 comp rx=0 tx=0).stop 2024-04-25T01:44:36.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.529+0000 7f9816fe7640 1 -- 172.21.15.77:0/3279704622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f981006d4e0 msgr2=0x7f9810144d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:36.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.529+0000 7f9816fe7640 1 --2- 172.21.15.77:0/3279704622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f981006d4e0 0x7f9810144d70 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f97fc00c430 tx=0x7f97fc00c8f0 comp rx=0 tx=0).stop 2024-04-25T01:44:36.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.529+0000 7f9816fe7640 1 -- 172.21.15.77:0/3279704622 shutdown_connections 2024-04-25T01:44:36.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.529+0000 7f9816fe7640 1 --2- 172.21.15.77:0/3279704622 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f97f406be30 0x7f97f406e2f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:36.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.529+0000 7f9816fe7640 1 --2- 172.21.15.77:0/3279704622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f981006d4e0 0x7f9810144d70 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:36.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.529+0000 7f9816fe7640 1 --2- 172.21.15.77:0/3279704622 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9810150320 0x7f98101452b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:36.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.529+0000 7f9816fe7640 1 --2- 172.21.15.77:0/3279704622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f981006d0a0 0x7f9810070850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:36.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.529+0000 7f9816fe7640 1 -- 172.21.15.77:0/3279704622 >> 172.21.15.77:0/3279704622 conn(0x7f98100c3f80 msgr2=0x7f98100c2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:36.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.529+0000 7f9816fe7640 1 -- 172.21.15.77:0/3279704622 shutdown_connections 2024-04-25T01:44:36.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.529+0000 7f9816fe7640 1 -- 172.21.15.77:0/3279704622 wait complete. 2024-04-25T01:44:36.532 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2024-04-25T01:44:35.737910+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16563859,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":598,"num_read_kb":16221,"num_write":26462,"num_write_kb":50357105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31378,"ondisk_log_size":31378,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":519008,"kb_used_data":35144,"kb_used_omap":12,"kb_used_meta":483763,"kb_avail":754455712,"statfs":{"total":773094113280,"available":772562649088,"internally_reserved":0,"allocated":35987456,"data_stored":34322934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":495373872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10705,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":7891,"num_write":9,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.334664"},"pg_stats":[{"pgid":"5.18","version":"30'210","reported_seq":247,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.410243+0000","last_change":"2024-04-25T01:44:11.353407+0000","last_active":"2024-04-25T01:44:24.410243+0000","last_peered":"2024-04-25T01:44:24.410243+0000","last_clean":"2024-04-25T01:44:24.410243+0000","last_became_active":"2024-04-25T01:39:33.445090+0000","last_became_peered":"2024-04-25T01:39:33.445090+0000","last_unstale":"2024-04-25T01:44:24.410243+0000","last_undegraded":"2024-04-25T01:44:24.410243+0000","last_fullsized":"2024-04-25T01:44:24.410243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'210","last_scrub_stamp":"2024-04-25T01:44:11.353224+0000","last_deep_scrub":"30'210","last_deep_scrub_stamp":"2024-04-25T01:44:11.353224+0000","last_clean_scrub_stamp":"2024-04-25T01:44:11.353224+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:39:17.808271+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"31'9","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.670135+0000","last_change":"2024-04-25T01:43:58.687483+0000","last_active":"2024-04-25T01:44:24.670135+0000","last_peered":"2024-04-25T01:44:24.670135+0000","last_clean":"2024-04-25T01:44:24.670135+0000","last_became_active":"2024-04-25T01:39:23.376811+0000","last_became_peered":"2024-04-25T01:39:23.376811+0000","last_unstale":"2024-04-25T01:44:24.670135+0000","last_undegraded":"2024-04-25T01:44:24.670135+0000","last_fullsized":"2024-04-25T01:44:24.670135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'8","last_scrub_stamp":"2024-04-25T01:43:58.687362+0000","last_deep_scrub":"30'8","last_deep_scrub_stamp":"2024-04-25T01:43:58.687362+0000","last_clean_scrub_stamp":"2024-04-25T01:43:58.687362+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:35:31.058038+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"30'181","reported_seq":226,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.420521+0000","last_change":"2024-04-25T01:44:03.399154+0000","last_active":"2024-04-25T01:44:24.420521+0000","last_peered":"2024-04-25T01:44:24.420521+0000","last_clean":"2024-04-25T01:44:24.420521+0000","last_became_active":"2024-04-25T01:39:24.394032+0000","last_became_peered":"2024-04-25T01:39:24.394032+0000","last_unstale":"2024-04-25T01:44:24.420521+0000","last_undegraded":"2024-04-25T01:44:24.420521+0000","last_fullsized":"2024-04-25T01:44:24.420521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'181","last_scrub_stamp":"2024-04-25T01:44:03.399000+0000","last_deep_scrub":"30'181","last_deep_scrub_stamp":"2024-04-25T01:44:03.399000+0000","last_clean_scrub_stamp":"2024-04-25T01:44:03.399000+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:05:22.587995+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.418569+0000","last_change":"2024-04-25T01:43:57.371546+0000","last_active":"2024-04-25T01:44:24.418569+0000","last_peered":"2024-04-25T01:44:24.418569+0000","last_clean":"2024-04-25T01:44:24.418569+0000","last_became_active":"2024-04-25T01:39:32.421355+0000","last_became_peered":"2024-04-25T01:39:32.421355+0000","last_unstale":"2024-04-25T01:44:24.418569+0000","last_undegraded":"2024-04-25T01:44:24.418569+0000","last_fullsized":"2024-04-25T01:44:24.418569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:43:57.371446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:43:57.371446+0000","last_clean_scrub_stamp":"2024-04-25T01:43:57.371446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:28:23.826204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"30'203","reported_seq":240,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.404835+0000","last_change":"2024-04-25T01:44:13.037985+0000","last_active":"2024-04-25T01:44:24.404835+0000","last_peered":"2024-04-25T01:44:24.404835+0000","last_clean":"2024-04-25T01:44:24.404835+0000","last_became_active":"2024-04-25T01:39:33.436370+0000","last_became_peered":"2024-04-25T01:39:33.436370+0000","last_unstale":"2024-04-25T01:44:24.404835+0000","last_undegraded":"2024-04-25T01:44:24.404835+0000","last_fullsized":"2024-04-25T01:44:24.404835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'203","last_scrub_stamp":"2024-04-25T01:44:13.037861+0000","last_deep_scrub":"30'203","last_deep_scrub_stamp":"2024-04-25T01:44:13.037861+0000","last_clean_scrub_stamp":"2024-04-25T01:44:13.037861+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:18.123423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"31'4","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.420780+0000","last_change":"2024-04-25T01:44:08.482454+0000","last_active":"2024-04-25T01:44:24.420780+0000","last_peered":"2024-04-25T01:44:24.420780+0000","last_clean":"2024-04-25T01:44:24.420780+0000","last_became_active":"2024-04-25T01:39:23.368726+0000","last_became_peered":"2024-04-25T01:39:23.368726+0000","last_unstale":"2024-04-25T01:44:24.420780+0000","last_undegraded":"2024-04-25T01:44:24.420780+0000","last_fullsized":"2024-04-25T01:44:24.420780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-04-25T01:44:08.482300+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-04-25T01:44:08.482300+0000","last_clean_scrub_stamp":"2024-04-25T01:44:08.482300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:55.967256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"30'177","reported_seq":222,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.411244+0000","last_change":"2024-04-25T01:43:53.661788+0000","last_active":"2024-04-25T01:44:24.411244+0000","last_peered":"2024-04-25T01:44:24.411244+0000","last_clean":"2024-04-25T01:44:24.411244+0000","last_became_active":"2024-04-25T01:39:24.403623+0000","last_became_peered":"2024-04-25T01:39:24.403623+0000","last_unstale":"2024-04-25T01:44:24.411244+0000","last_undegraded":"2024-04-25T01:44:24.411244+0000","last_fullsized":"2024-04-25T01:44:24.411244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'177","last_scrub_stamp":"2024-04-25T01:43:53.661689+0000","last_deep_scrub":"30'177","last_deep_scrub_stamp":"2024-04-25T01:43:53.661689+0000","last_clean_scrub_stamp":"2024-04-25T01:43:53.661689+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:45.558385+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.410232+0000","last_change":"2024-04-25T01:43:54.301276+0000","last_active":"2024-04-25T01:44:24.410232+0000","last_peered":"2024-04-25T01:44:24.410232+0000","last_clean":"2024-04-25T01:44:24.410232+0000","last_became_active":"2024-04-25T01:39:32.430617+0000","last_became_peered":"2024-04-25T01:39:32.430617+0000","last_unstale":"2024-04-25T01:44:24.410232+0000","last_undegraded":"2024-04-25T01:44:24.410232+0000","last_fullsized":"2024-04-25T01:44:24.410232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:43:54.301128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:43:54.301128+0000","last_clean_scrub_stamp":"2024-04-25T01:43:54.301128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:29.315864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"30'163","reported_seq":200,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.412242+0000","last_change":"2024-04-25T01:44:20.601514+0000","last_active":"2024-04-25T01:44:24.412242+0000","last_peered":"2024-04-25T01:44:24.412242+0000","last_clean":"2024-04-25T01:44:24.412242+0000","last_became_active":"2024-04-25T01:39:33.443737+0000","last_became_peered":"2024-04-25T01:39:33.443737+0000","last_unstale":"2024-04-25T01:44:24.412242+0000","last_undegraded":"2024-04-25T01:44:24.412242+0000","last_fullsized":"2024-04-25T01:44:24.412242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'163","last_scrub_stamp":"2024-04-25T01:44:20.601381+0000","last_deep_scrub":"30'163","last_deep_scrub_stamp":"2024-04-25T01:44:20.601381+0000","last_clean_scrub_stamp":"2024-04-25T01:44:20.601381+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:03.982746+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"31'6","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:27.579143+0000","last_change":"2024-04-25T01:44:10.535737+0000","last_active":"2024-04-25T01:44:27.579143+0000","last_peered":"2024-04-25T01:44:27.579143+0000","last_clean":"2024-04-25T01:44:27.579143+0000","last_became_active":"2024-04-25T01:39:23.377402+0000","last_became_peered":"2024-04-25T01:39:23.377402+0000","last_unstale":"2024-04-25T01:44:27.579143+0000","last_undegraded":"2024-04-25T01:44:27.579143+0000","last_fullsized":"2024-04-25T01:44:27.579143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2024-04-25T01:44:10.535621+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2024-04-25T01:44:10.535621+0000","last_clean_scrub_stamp":"2024-04-25T01:44:10.535621+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:58:39.984702+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"30'160","reported_seq":205,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.436105+0000","last_change":"2024-04-25T01:43:58.821243+0000","last_active":"2024-04-25T01:44:24.436105+0000","last_peered":"2024-04-25T01:44:24.436105+0000","last_clean":"2024-04-25T01:44:24.436105+0000","last_became_active":"2024-04-25T01:39:24.393954+0000","last_became_peered":"2024-04-25T01:39:24.393954+0000","last_unstale":"2024-04-25T01:44:24.436105+0000","last_undegraded":"2024-04-25T01:44:24.436105+0000","last_fullsized":"2024-04-25T01:44:24.436105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'160","last_scrub_stamp":"2024-04-25T01:43:58.821132+0000","last_deep_scrub":"30'160","last_deep_scrub_stamp":"2024-04-25T01:43:58.821132+0000","last_clean_scrub_stamp":"2024-04-25T01:43:58.821132+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:26.916069+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1807","reported_seq":1848,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.413172+0000","last_change":"2024-04-25T01:43:58.225246+0000","last_active":"2024-04-25T01:44:24.413172+0000","last_peered":"2024-04-25T01:44:24.413172+0000","last_clean":"2024-04-25T01:44:24.413172+0000","last_became_active":"2024-04-25T01:39:32.427955+0000","last_became_peered":"2024-04-25T01:39:32.427955+0000","last_unstale":"2024-04-25T01:44:24.413172+0000","last_undegraded":"2024-04-25T01:44:24.413172+0000","last_fullsized":"2024-04-25T01:44:24.413172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1807","last_scrub_stamp":"2024-04-25T01:43:58.225124+0000","last_deep_scrub":"30'1807","last_deep_scrub_stamp":"2024-04-25T01:43:58.225124+0000","last_clean_scrub_stamp":"2024-04-25T01:43:58.225124+0000","objects_scrubbed":1,"log_size":1807,"log_dups_size":0,"ondisk_log_size":1807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:10.777088+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3765045,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":3663,"num_write":1803,"num_write_kb":5411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"30'173","reported_seq":209,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.434901+0000","last_change":"2024-04-25T01:44:19.864933+0000","last_active":"2024-04-25T01:44:24.434901+0000","last_peered":"2024-04-25T01:44:24.434901+0000","last_clean":"2024-04-25T01:44:24.434901+0000","last_became_active":"2024-04-25T01:39:33.439555+0000","last_became_peered":"2024-04-25T01:39:33.439555+0000","last_unstale":"2024-04-25T01:44:24.434901+0000","last_undegraded":"2024-04-25T01:44:24.434901+0000","last_fullsized":"2024-04-25T01:44:24.434901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'173","last_scrub_stamp":"2024-04-25T01:44:19.864776+0000","last_deep_scrub":"30'173","last_deep_scrub_stamp":"2024-04-25T01:44:19.864776+0000","last_clean_scrub_stamp":"2024-04-25T01:44:19.864776+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:22:04.204623+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"30'3","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:27.580062+0000","last_change":"2024-04-25T01:44:08.568119+0000","last_active":"2024-04-25T01:44:27.580062+0000","last_peered":"2024-04-25T01:44:27.580062+0000","last_clean":"2024-04-25T01:44:27.580062+0000","last_became_active":"2024-04-25T01:39:23.376744+0000","last_became_peered":"2024-04-25T01:39:23.376744+0000","last_unstale":"2024-04-25T01:44:27.580062+0000","last_undegraded":"2024-04-25T01:44:27.580062+0000","last_fullsized":"2024-04-25T01:44:27.580062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-04-25T01:44:08.568004+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-04-25T01:44:08.568004+0000","last_clean_scrub_stamp":"2024-04-25T01:44:08.568004+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:03:46.791296+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"30'198","reported_seq":243,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.436356+0000","last_change":"2024-04-25T01:44:02.904563+0000","last_active":"2024-04-25T01:44:24.436356+0000","last_peered":"2024-04-25T01:44:24.436356+0000","last_clean":"2024-04-25T01:44:24.436356+0000","last_became_active":"2024-04-25T01:39:24.393005+0000","last_became_peered":"2024-04-25T01:39:24.393005+0000","last_unstale":"2024-04-25T01:44:24.436356+0000","last_undegraded":"2024-04-25T01:44:24.436356+0000","last_fullsized":"2024-04-25T01:44:24.436356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'198","last_scrub_stamp":"2024-04-25T01:44:02.904410+0000","last_deep_scrub":"30'198","last_deep_scrub_stamp":"2024-04-25T01:44:02.904410+0000","last_clean_scrub_stamp":"2024-04-25T01:44:02.904410+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:06.356118+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.410668+0000","last_change":"2024-04-25T01:43:56.214713+0000","last_active":"2024-04-25T01:44:24.410668+0000","last_peered":"2024-04-25T01:44:24.410668+0000","last_clean":"2024-04-25T01:44:24.410668+0000","last_became_active":"2024-04-25T01:39:32.428705+0000","last_became_peered":"2024-04-25T01:39:32.428705+0000","last_unstale":"2024-04-25T01:44:24.410668+0000","last_undegraded":"2024-04-25T01:44:24.410668+0000","last_fullsized":"2024-04-25T01:44:24.410668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-04-25T01:43:56.214583+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-04-25T01:43:56.214583+0000","last_clean_scrub_stamp":"2024-04-25T01:43:56.214583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:30.220750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"30'179","reported_seq":216,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.406027+0000","last_change":"2024-04-25T01:44:17.088738+0000","last_active":"2024-04-25T01:44:24.406027+0000","last_peered":"2024-04-25T01:44:24.406027+0000","last_clean":"2024-04-25T01:44:24.406027+0000","last_became_active":"2024-04-25T01:39:33.446234+0000","last_became_peered":"2024-04-25T01:39:33.446234+0000","last_unstale":"2024-04-25T01:44:24.406027+0000","last_undegraded":"2024-04-25T01:44:24.406027+0000","last_fullsized":"2024-04-25T01:44:24.406027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'179","last_scrub_stamp":"2024-04-25T01:44:17.088644+0000","last_deep_scrub":"30'179","last_deep_scrub_stamp":"2024-04-25T01:44:17.088644+0000","last_clean_scrub_stamp":"2024-04-25T01:44:17.088644+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:34:48.666791+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"30'156","reported_seq":201,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.415659+0000","last_change":"2024-04-25T01:43:56.065883+0000","last_active":"2024-04-25T01:44:24.415659+0000","last_peered":"2024-04-25T01:44:24.415659+0000","last_clean":"2024-04-25T01:44:24.415659+0000","last_became_active":"2024-04-25T01:39:24.398618+0000","last_became_peered":"2024-04-25T01:39:24.398618+0000","last_unstale":"2024-04-25T01:44:24.415659+0000","last_undegraded":"2024-04-25T01:44:24.415659+0000","last_fullsized":"2024-04-25T01:44:24.415659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'156","last_scrub_stamp":"2024-04-25T01:43:56.065744+0000","last_deep_scrub":"30'156","last_deep_scrub_stamp":"2024-04-25T01:43:56.065744+0000","last_clean_scrub_stamp":"2024-04-25T01:43:56.065744+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:31:50.550389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'7","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.412033+0000","last_change":"2024-04-25T01:44:09.559372+0000","last_active":"2024-04-25T01:44:24.412033+0000","last_peered":"2024-04-25T01:44:24.412033+0000","last_clean":"2024-04-25T01:44:24.412033+0000","last_became_active":"2024-04-25T01:39:23.377291+0000","last_became_peered":"2024-04-25T01:39:23.377291+0000","last_unstale":"2024-04-25T01:44:24.412033+0000","last_undegraded":"2024-04-25T01:44:24.412033+0000","last_fullsized":"2024-04-25T01:44:24.412033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'6","last_scrub_stamp":"2024-04-25T01:44:09.559244+0000","last_deep_scrub":"30'6","last_deep_scrub_stamp":"2024-04-25T01:44:09.559244+0000","last_clean_scrub_stamp":"2024-04-25T01:44:09.559244+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:15:44.580771+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"30'2","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.410911+0000","last_change":"2024-04-25T01:44:07.338776+0000","last_active":"2024-04-25T01:44:24.410911+0000","last_peered":"2024-04-25T01:44:24.410911+0000","last_clean":"2024-04-25T01:44:24.410911+0000","last_became_active":"2024-04-25T01:39:32.426529+0000","last_became_peered":"2024-04-25T01:39:32.426529+0000","last_unstale":"2024-04-25T01:44:24.410911+0000","last_undegraded":"2024-04-25T01:44:24.410911+0000","last_fullsized":"2024-04-25T01:44:24.410911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-25T01:44:07.338650+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-25T01:44:07.338650+0000","last_clean_scrub_stamp":"2024-04-25T01:44:07.338650+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:00:47.715989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"30'193","reported_seq":230,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.407262+0000","last_change":"2024-04-25T01:44:01.330827+0000","last_active":"2024-04-25T01:44:24.407262+0000","last_peered":"2024-04-25T01:44:24.407262+0000","last_clean":"2024-04-25T01:44:24.407262+0000","last_became_active":"2024-04-25T01:39:33.437483+0000","last_became_peered":"2024-04-25T01:39:33.437483+0000","last_unstale":"2024-04-25T01:44:24.407262+0000","last_undegraded":"2024-04-25T01:44:24.407262+0000","last_fullsized":"2024-04-25T01:44:24.407262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'193","last_scrub_stamp":"2024-04-25T01:44:01.330683+0000","last_deep_scrub":"30'193","last_deep_scrub_stamp":"2024-04-25T01:44:01.330683+0000","last_clean_scrub_stamp":"2024-04-25T01:44:01.330683+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:30:19.509062+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"30'164","reported_seq":209,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.419481+0000","last_change":"2024-04-25T01:44:12.395862+0000","last_active":"2024-04-25T01:44:24.419481+0000","last_peered":"2024-04-25T01:44:24.419481+0000","last_clean":"2024-04-25T01:44:24.419481+0000","last_became_active":"2024-04-25T01:39:24.386782+0000","last_became_peered":"2024-04-25T01:39:24.386782+0000","last_unstale":"2024-04-25T01:44:24.419481+0000","last_undegraded":"2024-04-25T01:44:24.419481+0000","last_fullsized":"2024-04-25T01:44:24.419481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'164","last_scrub_stamp":"2024-04-25T01:44:12.395734+0000","last_deep_scrub":"30'164","last_deep_scrub_stamp":"2024-04-25T01:44:12.395734+0000","last_clean_scrub_stamp":"2024-04-25T01:44:12.395734+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:19:45.931220+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.405235+0000","last_change":"2024-04-25T01:44:02.172418+0000","last_active":"2024-04-25T01:44:24.405235+0000","last_peered":"2024-04-25T01:44:24.405235+0000","last_clean":"2024-04-25T01:44:24.405235+0000","last_became_active":"2024-04-25T01:39:23.368183+0000","last_became_peered":"2024-04-25T01:39:23.368183+0000","last_unstale":"2024-04-25T01:44:24.405235+0000","last_undegraded":"2024-04-25T01:44:24.405235+0000","last_fullsized":"2024-04-25T01:44:24.405235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:02.172292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:02.172292+0000","last_clean_scrub_stamp":"2024-04-25T01:44:02.172292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:07.144202+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.412649+0000","last_change":"2024-04-25T01:44:00.188960+0000","last_active":"2024-04-25T01:44:24.412649+0000","last_peered":"2024-04-25T01:44:24.412649+0000","last_clean":"2024-04-25T01:44:24.412649+0000","last_became_active":"2024-04-25T01:39:32.427328+0000","last_became_peered":"2024-04-25T01:39:32.427328+0000","last_unstale":"2024-04-25T01:44:24.412649+0000","last_undegraded":"2024-04-25T01:44:24.412649+0000","last_fullsized":"2024-04-25T01:44:24.412649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:00.188846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:00.188846+0000","last_clean_scrub_stamp":"2024-04-25T01:44:00.188846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:10.545008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"30'191","reported_seq":228,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.411208+0000","last_change":"2024-04-25T01:44:15.269030+0000","last_active":"2024-04-25T01:44:24.411208+0000","last_peered":"2024-04-25T01:44:24.411208+0000","last_clean":"2024-04-25T01:44:24.411208+0000","last_became_active":"2024-04-25T01:39:33.445908+0000","last_became_peered":"2024-04-25T01:39:33.445908+0000","last_unstale":"2024-04-25T01:44:24.411208+0000","last_undegraded":"2024-04-25T01:44:24.411208+0000","last_fullsized":"2024-04-25T01:44:24.411208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'191","last_scrub_stamp":"2024-04-25T01:44:15.268891+0000","last_deep_scrub":"30'191","last_deep_scrub_stamp":"2024-04-25T01:44:15.268891+0000","last_clean_scrub_stamp":"2024-04-25T01:44:15.268891+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:12:34.044087+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"30'170","reported_seq":215,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.419502+0000","last_change":"2024-04-25T01:44:11.433295+0000","last_active":"2024-04-25T01:44:24.419502+0000","last_peered":"2024-04-25T01:44:24.419502+0000","last_clean":"2024-04-25T01:44:24.419502+0000","last_became_active":"2024-04-25T01:39:24.373311+0000","last_became_peered":"2024-04-25T01:39:24.373311+0000","last_unstale":"2024-04-25T01:44:24.419502+0000","last_undegraded":"2024-04-25T01:44:24.419502+0000","last_fullsized":"2024-04-25T01:44:24.419502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'170","last_scrub_stamp":"2024-04-25T01:44:11.433175+0000","last_deep_scrub":"30'170","last_deep_scrub_stamp":"2024-04-25T01:44:11.433175+0000","last_clean_scrub_stamp":"2024-04-25T01:44:11.433175+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:30:56.163864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.405960+0000","last_change":"2024-04-25T01:44:06.119051+0000","last_active":"2024-04-25T01:44:24.405960+0000","last_peered":"2024-04-25T01:44:24.405960+0000","last_clean":"2024-04-25T01:44:24.405960+0000","last_became_active":"2024-04-25T01:39:23.376826+0000","last_became_peered":"2024-04-25T01:39:23.376826+0000","last_unstale":"2024-04-25T01:44:24.405960+0000","last_undegraded":"2024-04-25T01:44:24.405960+0000","last_fullsized":"2024-04-25T01:44:24.405960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:06.118901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:06.118901+0000","last_clean_scrub_stamp":"2024-04-25T01:44:06.118901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:47:21.293873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"30'2","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.405651+0000","last_change":"2024-04-25T01:43:53.128417+0000","last_active":"2024-04-25T01:44:24.405651+0000","last_peered":"2024-04-25T01:44:24.405651+0000","last_clean":"2024-04-25T01:44:24.405651+0000","last_became_active":"2024-04-25T01:39:32.426545+0000","last_became_peered":"2024-04-25T01:39:32.426545+0000","last_unstale":"2024-04-25T01:44:24.405651+0000","last_undegraded":"2024-04-25T01:44:24.405651+0000","last_fullsized":"2024-04-25T01:44:24.405651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-25T01:43:53.128323+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-25T01:43:53.128323+0000","last_clean_scrub_stamp":"2024-04-25T01:43:53.128323+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:50.651934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"30'171","reported_seq":208,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.436752+0000","last_change":"2024-04-25T01:44:22.902601+0000","last_active":"2024-04-25T01:44:24.436752+0000","last_peered":"2024-04-25T01:44:24.436752+0000","last_clean":"2024-04-25T01:44:24.436752+0000","last_became_active":"2024-04-25T01:39:33.444350+0000","last_became_peered":"2024-04-25T01:39:33.444350+0000","last_unstale":"2024-04-25T01:44:24.436752+0000","last_undegraded":"2024-04-25T01:44:24.436752+0000","last_fullsized":"2024-04-25T01:44:24.436752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'171","last_scrub_stamp":"2024-04-25T01:44:22.902486+0000","last_deep_scrub":"30'171","last_deep_scrub_stamp":"2024-04-25T01:44:22.902486+0000","last_clean_scrub_stamp":"2024-04-25T01:44:22.902486+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:15.923076+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"30'147","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.412619+0000","last_change":"2024-04-25T01:44:02.223440+0000","last_active":"2024-04-25T01:44:24.412619+0000","last_peered":"2024-04-25T01:44:24.412619+0000","last_clean":"2024-04-25T01:44:24.412619+0000","last_became_active":"2024-04-25T01:39:24.386376+0000","last_became_peered":"2024-04-25T01:39:24.386376+0000","last_unstale":"2024-04-25T01:44:24.412619+0000","last_undegraded":"2024-04-25T01:44:24.412619+0000","last_fullsized":"2024-04-25T01:44:24.412619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'147","last_scrub_stamp":"2024-04-25T01:44:02.223318+0000","last_deep_scrub":"30'147","last_deep_scrub_stamp":"2024-04-25T01:44:02.223318+0000","last_clean_scrub_stamp":"2024-04-25T01:44:02.223318+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:45.420819+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.410728+0000","last_change":"2024-04-25T01:44:12.523014+0000","last_active":"2024-04-25T01:44:24.410728+0000","last_peered":"2024-04-25T01:44:24.410728+0000","last_clean":"2024-04-25T01:44:24.410728+0000","last_became_active":"2024-04-25T01:39:23.376908+0000","last_became_peered":"2024-04-25T01:39:23.376908+0000","last_unstale":"2024-04-25T01:44:24.410728+0000","last_undegraded":"2024-04-25T01:44:24.410728+0000","last_fullsized":"2024-04-25T01:44:24.410728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:12.522856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:12.522856+0000","last_clean_scrub_stamp":"2024-04-25T01:44:12.522856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:01:12.415523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"30'3","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.411734+0000","last_change":"2024-04-25T01:43:59.219645+0000","last_active":"2024-04-25T01:44:24.411734+0000","last_peered":"2024-04-25T01:44:24.411734+0000","last_clean":"2024-04-25T01:44:24.411734+0000","last_became_active":"2024-04-25T01:39:32.433307+0000","last_became_peered":"2024-04-25T01:39:32.433307+0000","last_unstale":"2024-04-25T01:44:24.411734+0000","last_undegraded":"2024-04-25T01:44:24.411734+0000","last_fullsized":"2024-04-25T01:44:24.411734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-04-25T01:43:59.219529+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-04-25T01:43:59.219529+0000","last_clean_scrub_stamp":"2024-04-25T01:43:59.219529+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:19.904283+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"30'175","reported_seq":212,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.418393+0000","last_change":"2024-04-25T01:44:17.385365+0000","last_active":"2024-04-25T01:44:24.418393+0000","last_peered":"2024-04-25T01:44:24.418393+0000","last_clean":"2024-04-25T01:44:24.418393+0000","last_became_active":"2024-04-25T01:39:33.426132+0000","last_became_peered":"2024-04-25T01:39:33.426132+0000","last_unstale":"2024-04-25T01:44:24.418393+0000","last_undegraded":"2024-04-25T01:44:24.418393+0000","last_fullsized":"2024-04-25T01:44:24.418393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'175","last_scrub_stamp":"2024-04-25T01:44:17.385255+0000","last_deep_scrub":"30'175","last_deep_scrub_stamp":"2024-04-25T01:44:17.385255+0000","last_clean_scrub_stamp":"2024-04-25T01:44:17.385255+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:50:49.373957+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"30'175","reported_seq":220,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.411855+0000","last_change":"2024-04-25T01:43:54.702539+0000","last_active":"2024-04-25T01:44:24.411855+0000","last_peered":"2024-04-25T01:44:24.411855+0000","last_clean":"2024-04-25T01:44:24.411855+0000","last_became_active":"2024-04-25T01:39:24.392209+0000","last_became_peered":"2024-04-25T01:39:24.392209+0000","last_unstale":"2024-04-25T01:44:24.411855+0000","last_undegraded":"2024-04-25T01:44:24.411855+0000","last_fullsized":"2024-04-25T01:44:24.411855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'175","last_scrub_stamp":"2024-04-25T01:43:54.702424+0000","last_deep_scrub":"30'175","last_deep_scrub_stamp":"2024-04-25T01:43:54.702424+0000","last_clean_scrub_stamp":"2024-04-25T01:43:54.702424+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:38.297342+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"30'4","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:27.575997+0000","last_change":"2024-04-25T01:44:03.061894+0000","last_active":"2024-04-25T01:44:27.575997+0000","last_peered":"2024-04-25T01:44:27.575997+0000","last_clean":"2024-04-25T01:44:27.575997+0000","last_became_active":"2024-04-25T01:39:23.379430+0000","last_became_peered":"2024-04-25T01:39:23.379430+0000","last_unstale":"2024-04-25T01:44:27.575997+0000","last_undegraded":"2024-04-25T01:44:27.575997+0000","last_fullsized":"2024-04-25T01:44:27.575997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-04-25T01:44:03.061757+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-04-25T01:44:03.061757+0000","last_clean_scrub_stamp":"2024-04-25T01:44:03.061757+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:43:17.753693+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"30'6","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.412287+0000","last_change":"2024-04-25T01:43:57.251398+0000","last_active":"2024-04-25T01:44:24.412287+0000","last_peered":"2024-04-25T01:44:24.412287+0000","last_clean":"2024-04-25T01:44:24.412287+0000","last_became_active":"2024-04-25T01:39:32.432482+0000","last_became_peered":"2024-04-25T01:39:32.432482+0000","last_unstale":"2024-04-25T01:44:24.412287+0000","last_undegraded":"2024-04-25T01:44:24.412287+0000","last_fullsized":"2024-04-25T01:44:24.412287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'6","last_scrub_stamp":"2024-04-25T01:43:57.251234+0000","last_deep_scrub":"30'6","last_deep_scrub_stamp":"2024-04-25T01:43:57.251234+0000","last_clean_scrub_stamp":"2024-04-25T01:43:57.251234+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:37.814148+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"30'176","reported_seq":213,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.411218+0000","last_change":"2024-04-25T01:44:12.305660+0000","last_active":"2024-04-25T01:44:24.411218+0000","last_peered":"2024-04-25T01:44:24.411218+0000","last_clean":"2024-04-25T01:44:24.411218+0000","last_became_active":"2024-04-25T01:39:33.445500+0000","last_became_peered":"2024-04-25T01:39:33.445500+0000","last_unstale":"2024-04-25T01:44:24.411218+0000","last_undegraded":"2024-04-25T01:44:24.411218+0000","last_fullsized":"2024-04-25T01:44:24.411218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'176","last_scrub_stamp":"2024-04-25T01:44:12.305536+0000","last_deep_scrub":"30'176","last_deep_scrub_stamp":"2024-04-25T01:44:12.305536+0000","last_clean_scrub_stamp":"2024-04-25T01:44:12.305536+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:45:32.666791+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"30'154","reported_seq":185,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.407812+0000","last_change":"2024-04-25T01:44:08.347554+0000","last_active":"2024-04-25T01:44:24.407812+0000","last_peered":"2024-04-25T01:44:24.407812+0000","last_clean":"2024-04-25T01:44:24.407812+0000","last_became_active":"2024-04-25T01:40:06.055084+0000","last_became_peered":"2024-04-25T01:40:06.055084+0000","last_unstale":"2024-04-25T01:44:24.407812+0000","last_undegraded":"2024-04-25T01:44:24.407812+0000","last_fullsized":"2024-04-25T01:44:24.407812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'154","last_scrub_stamp":"2024-04-25T01:44:08.347432+0000","last_deep_scrub":"30'154","last_deep_scrub_stamp":"2024-04-25T01:44:08.347432+0000","last_clean_scrub_stamp":"2024-04-25T01:44:08.347432+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:33:57.921914+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"31'31","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.408736+0000","last_change":"2024-04-25T01:44:07.087951+0000","last_active":"2024-04-25T01:44:24.408736+0000","last_peered":"2024-04-25T01:44:24.408736+0000","last_clean":"2024-04-25T01:44:24.408736+0000","last_became_active":"2024-04-25T01:39:23.377372+0000","last_became_peered":"2024-04-25T01:39:23.377372+0000","last_unstale":"2024-04-25T01:44:24.408736+0000","last_undegraded":"2024-04-25T01:44:24.408736+0000","last_fullsized":"2024-04-25T01:44:24.408736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2024-04-25T01:44:07.087835+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2024-04-25T01:44:07.087835+0000","last_clean_scrub_stamp":"2024-04-25T01:44:07.087835+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:40:48.046197+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":57,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.418394+0000","last_change":"2024-04-25T01:44:00.347642+0000","last_active":"2024-04-25T01:44:24.418394+0000","last_peered":"2024-04-25T01:44:24.418394+0000","last_clean":"2024-04-25T01:44:24.418394+0000","last_became_active":"2024-04-25T01:39:32.430537+0000","last_became_peered":"2024-04-25T01:39:32.430537+0000","last_unstale":"2024-04-25T01:44:24.418394+0000","last_undegraded":"2024-04-25T01:44:24.418394+0000","last_fullsized":"2024-04-25T01:44:24.418394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:00.347528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:00.347528+0000","last_clean_scrub_stamp":"2024-04-25T01:44:00.347528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:51.248028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"30'198","reported_seq":235,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.415296+0000","last_change":"2024-04-25T01:44:10.157724+0000","last_active":"2024-04-25T01:44:24.415296+0000","last_peered":"2024-04-25T01:44:24.415296+0000","last_clean":"2024-04-25T01:44:24.415296+0000","last_became_active":"2024-04-25T01:39:33.439796+0000","last_became_peered":"2024-04-25T01:39:33.439796+0000","last_unstale":"2024-04-25T01:44:24.415296+0000","last_undegraded":"2024-04-25T01:44:24.415296+0000","last_fullsized":"2024-04-25T01:44:24.415296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'198","last_scrub_stamp":"2024-04-25T01:44:10.157611+0000","last_deep_scrub":"30'198","last_deep_scrub_stamp":"2024-04-25T01:44:10.157611+0000","last_clean_scrub_stamp":"2024-04-25T01:44:10.157611+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:56.960529+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"30'173","reported_seq":218,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.406550+0000","last_change":"2024-04-25T01:43:59.162916+0000","last_active":"2024-04-25T01:44:24.406550+0000","last_peered":"2024-04-25T01:44:24.406550+0000","last_clean":"2024-04-25T01:44:24.406550+0000","last_became_active":"2024-04-25T01:39:24.376612+0000","last_became_peered":"2024-04-25T01:39:24.376612+0000","last_unstale":"2024-04-25T01:44:24.406550+0000","last_undegraded":"2024-04-25T01:44:24.406550+0000","last_fullsized":"2024-04-25T01:44:24.406550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'173","last_scrub_stamp":"2024-04-25T01:43:59.162791+0000","last_deep_scrub":"30'173","last_deep_scrub_stamp":"2024-04-25T01:43:59.162791+0000","last_clean_scrub_stamp":"2024-04-25T01:43:59.162791+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:43:45.418758+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.413830+0000","last_change":"2024-04-25T01:44:11.525754+0000","last_active":"2024-04-25T01:44:24.413830+0000","last_peered":"2024-04-25T01:44:24.413830+0000","last_clean":"2024-04-25T01:44:24.413830+0000","last_became_active":"2024-04-25T01:39:23.377677+0000","last_became_peered":"2024-04-25T01:39:23.377677+0000","last_unstale":"2024-04-25T01:44:24.413830+0000","last_undegraded":"2024-04-25T01:44:24.413830+0000","last_fullsized":"2024-04-25T01:44:24.413830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:11.525634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:11.525634+0000","last_clean_scrub_stamp":"2024-04-25T01:44:11.525634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:26:18.204766+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.411242+0000","last_change":"2024-04-25T01:44:08.637834+0000","last_active":"2024-04-25T01:44:24.411242+0000","last_peered":"2024-04-25T01:44:24.411242+0000","last_clean":"2024-04-25T01:44:24.411242+0000","last_became_active":"2024-04-25T01:39:32.431253+0000","last_became_peered":"2024-04-25T01:39:32.431253+0000","last_unstale":"2024-04-25T01:44:24.411242+0000","last_undegraded":"2024-04-25T01:44:24.411242+0000","last_fullsized":"2024-04-25T01:44:24.411242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:08.637697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:08.637697+0000","last_clean_scrub_stamp":"2024-04-25T01:44:08.637697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:19:33.197071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"30'188","reported_seq":225,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.411633+0000","last_change":"2024-04-25T01:44:12.623475+0000","last_active":"2024-04-25T01:44:24.411633+0000","last_peered":"2024-04-25T01:44:24.411633+0000","last_clean":"2024-04-25T01:44:24.411633+0000","last_became_active":"2024-04-25T01:39:33.448266+0000","last_became_peered":"2024-04-25T01:39:33.448266+0000","last_unstale":"2024-04-25T01:44:24.411633+0000","last_undegraded":"2024-04-25T01:44:24.411633+0000","last_fullsized":"2024-04-25T01:44:24.411633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'188","last_scrub_stamp":"2024-04-25T01:44:12.623367+0000","last_deep_scrub":"30'188","last_deep_scrub_stamp":"2024-04-25T01:44:12.623367+0000","last_clean_scrub_stamp":"2024-04-25T01:44:12.623367+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:32.546022+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"30'155","reported_seq":200,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.436178+0000","last_change":"2024-04-25T01:44:14.006423+0000","last_active":"2024-04-25T01:44:24.436178+0000","last_peered":"2024-04-25T01:44:24.436178+0000","last_clean":"2024-04-25T01:44:24.436178+0000","last_became_active":"2024-04-25T01:39:24.390543+0000","last_became_peered":"2024-04-25T01:39:24.390543+0000","last_unstale":"2024-04-25T01:44:24.436178+0000","last_undegraded":"2024-04-25T01:44:24.436178+0000","last_fullsized":"2024-04-25T01:44:24.436178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'155","last_scrub_stamp":"2024-04-25T01:44:14.006277+0000","last_deep_scrub":"30'155","last_deep_scrub_stamp":"2024-04-25T01:44:14.006277+0000","last_clean_scrub_stamp":"2024-04-25T01:44:14.006277+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:30:51.988621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.406563+0000","last_change":"2024-04-25T01:44:03.133528+0000","last_active":"2024-04-25T01:44:24.406563+0000","last_peered":"2024-04-25T01:44:24.406563+0000","last_clean":"2024-04-25T01:44:24.406563+0000","last_became_active":"2024-04-25T01:39:23.368272+0000","last_became_peered":"2024-04-25T01:39:23.368272+0000","last_unstale":"2024-04-25T01:44:24.406563+0000","last_undegraded":"2024-04-25T01:44:24.406563+0000","last_fullsized":"2024-04-25T01:44:24.406563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:03.133399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:03.133399+0000","last_clean_scrub_stamp":"2024-04-25T01:44:03.133399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:23:35.400104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.404942+0000","last_change":"2024-04-25T01:43:56.241017+0000","last_active":"2024-04-25T01:44:24.404942+0000","last_peered":"2024-04-25T01:44:24.404942+0000","last_clean":"2024-04-25T01:44:24.404942+0000","last_became_active":"2024-04-25T01:39:32.429759+0000","last_became_peered":"2024-04-25T01:39:32.429759+0000","last_unstale":"2024-04-25T01:44:24.404942+0000","last_undegraded":"2024-04-25T01:44:24.404942+0000","last_fullsized":"2024-04-25T01:44:24.404942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:43:56.240924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:43:56.240924+0000","last_clean_scrub_stamp":"2024-04-25T01:43:56.240924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:44:18.514419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"30'171","reported_seq":208,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.411109+0000","last_change":"2024-04-25T01:44:10.631120+0000","last_active":"2024-04-25T01:44:24.411109+0000","last_peered":"2024-04-25T01:44:24.411109+0000","last_clean":"2024-04-25T01:44:24.411109+0000","last_became_active":"2024-04-25T01:39:33.439344+0000","last_became_peered":"2024-04-25T01:39:33.439344+0000","last_unstale":"2024-04-25T01:44:24.411109+0000","last_undegraded":"2024-04-25T01:44:24.411109+0000","last_fullsized":"2024-04-25T01:44:24.411109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'171","last_scrub_stamp":"2024-04-25T01:44:10.630984+0000","last_deep_scrub":"30'171","last_deep_scrub_stamp":"2024-04-25T01:44:10.630984+0000","last_clean_scrub_stamp":"2024-04-25T01:44:10.630984+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:21:25.115508+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"30'179","reported_seq":224,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.413416+0000","last_change":"2024-04-25T01:44:04.260412+0000","last_active":"2024-04-25T01:44:24.413416+0000","last_peered":"2024-04-25T01:44:24.413416+0000","last_clean":"2024-04-25T01:44:24.413416+0000","last_became_active":"2024-04-25T01:39:24.388306+0000","last_became_peered":"2024-04-25T01:39:24.388306+0000","last_unstale":"2024-04-25T01:44:24.413416+0000","last_undegraded":"2024-04-25T01:44:24.413416+0000","last_fullsized":"2024-04-25T01:44:24.413416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'179","last_scrub_stamp":"2024-04-25T01:44:04.260286+0000","last_deep_scrub":"30'179","last_deep_scrub_stamp":"2024-04-25T01:44:04.260286+0000","last_clean_scrub_stamp":"2024-04-25T01:44:04.260286+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:01.991890+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.435911+0000","last_change":"2024-04-25T01:44:10.994347+0000","last_active":"2024-04-25T01:44:24.435911+0000","last_peered":"2024-04-25T01:44:24.435911+0000","last_clean":"2024-04-25T01:44:24.435911+0000","last_became_active":"2024-04-25T01:39:23.375488+0000","last_became_peered":"2024-04-25T01:39:23.375488+0000","last_unstale":"2024-04-25T01:44:24.435911+0000","last_undegraded":"2024-04-25T01:44:24.435911+0000","last_fullsized":"2024-04-25T01:44:24.435911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:10.994197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:10.994197+0000","last_clean_scrub_stamp":"2024-04-25T01:44:10.994197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:19.799758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.406477+0000","last_change":"2024-04-25T01:43:54.166999+0000","last_active":"2024-04-25T01:44:24.406477+0000","last_peered":"2024-04-25T01:44:24.406477+0000","last_clean":"2024-04-25T01:44:24.406477+0000","last_became_active":"2024-04-25T01:39:32.427282+0000","last_became_peered":"2024-04-25T01:39:32.427282+0000","last_unstale":"2024-04-25T01:44:24.406477+0000","last_undegraded":"2024-04-25T01:44:24.406477+0000","last_fullsized":"2024-04-25T01:44:24.406477+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:43:54.166904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:43:54.166904+0000","last_clean_scrub_stamp":"2024-04-25T01:43:54.166904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:10:18.605814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'200","reported_seq":237,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.408156+0000","last_change":"2024-04-25T01:43:53.375588+0000","last_active":"2024-04-25T01:44:24.408156+0000","last_peered":"2024-04-25T01:44:24.408156+0000","last_clean":"2024-04-25T01:44:24.408156+0000","last_became_active":"2024-04-25T01:39:33.438669+0000","last_became_peered":"2024-04-25T01:39:33.438669+0000","last_unstale":"2024-04-25T01:44:24.408156+0000","last_undegraded":"2024-04-25T01:44:24.408156+0000","last_fullsized":"2024-04-25T01:44:24.408156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'200","last_scrub_stamp":"2024-04-25T01:43:53.375449+0000","last_deep_scrub":"30'200","last_deep_scrub_stamp":"2024-04-25T01:43:53.375449+0000","last_clean_scrub_stamp":"2024-04-25T01:43:53.375449+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:27.541110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"30'162","reported_seq":207,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.404935+0000","last_change":"2024-04-25T01:44:01.155895+0000","last_active":"2024-04-25T01:44:24.404935+0000","last_peered":"2024-04-25T01:44:24.404935+0000","last_clean":"2024-04-25T01:44:24.404935+0000","last_became_active":"2024-04-25T01:39:24.377146+0000","last_became_peered":"2024-04-25T01:39:24.377146+0000","last_unstale":"2024-04-25T01:44:24.404935+0000","last_undegraded":"2024-04-25T01:44:24.404935+0000","last_fullsized":"2024-04-25T01:44:24.404935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'162","last_scrub_stamp":"2024-04-25T01:44:01.155728+0000","last_deep_scrub":"30'162","last_deep_scrub_stamp":"2024-04-25T01:44:01.155728+0000","last_clean_scrub_stamp":"2024-04-25T01:44:01.155728+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:57.937960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":327680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"30'5","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.407734+0000","last_change":"2024-04-25T01:43:56.353734+0000","last_active":"2024-04-25T01:44:24.407734+0000","last_peered":"2024-04-25T01:44:24.407734+0000","last_clean":"2024-04-25T01:44:24.407734+0000","last_became_active":"2024-04-25T01:39:23.370727+0000","last_became_peered":"2024-04-25T01:39:23.370727+0000","last_unstale":"2024-04-25T01:44:24.407734+0000","last_undegraded":"2024-04-25T01:44:24.407734+0000","last_fullsized":"2024-04-25T01:44:24.407734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2024-04-25T01:43:56.353596+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2024-04-25T01:43:56.353596+0000","last_clean_scrub_stamp":"2024-04-25T01:43:56.353596+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:05.975660+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'4","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.405737+0000","last_change":"2024-04-25T01:43:58.186020+0000","last_active":"2024-04-25T01:44:24.405737+0000","last_peered":"2024-04-25T01:44:24.405737+0000","last_clean":"2024-04-25T01:44:24.405737+0000","last_became_active":"2024-04-25T01:39:32.431335+0000","last_became_peered":"2024-04-25T01:39:32.431335+0000","last_unstale":"2024-04-25T01:44:24.405737+0000","last_undegraded":"2024-04-25T01:44:24.405737+0000","last_fullsized":"2024-04-25T01:44:24.405737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-04-25T01:43:58.185855+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-04-25T01:43:58.185855+0000","last_clean_scrub_stamp":"2024-04-25T01:43:58.185855+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:22:27.829213+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"30'173","reported_seq":210,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.436420+0000","last_change":"2024-04-25T01:44:16.944857+0000","last_active":"2024-04-25T01:44:24.436420+0000","last_peered":"2024-04-25T01:44:24.436420+0000","last_clean":"2024-04-25T01:44:24.436420+0000","last_became_active":"2024-04-25T01:39:33.438622+0000","last_became_peered":"2024-04-25T01:39:33.438622+0000","last_unstale":"2024-04-25T01:44:24.436420+0000","last_undegraded":"2024-04-25T01:44:24.436420+0000","last_fullsized":"2024-04-25T01:44:24.436420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'173","last_scrub_stamp":"2024-04-25T01:44:16.944693+0000","last_deep_scrub":"30'173","last_deep_scrub_stamp":"2024-04-25T01:44:16.944693+0000","last_clean_scrub_stamp":"2024-04-25T01:44:16.944693+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:13:30.106404+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"30'157","reported_seq":202,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.410974+0000","last_change":"2024-04-25T01:43:56.686976+0000","last_active":"2024-04-25T01:44:24.410974+0000","last_peered":"2024-04-25T01:44:24.410974+0000","last_clean":"2024-04-25T01:44:24.410974+0000","last_became_active":"2024-04-25T01:39:24.391093+0000","last_became_peered":"2024-04-25T01:39:24.391093+0000","last_unstale":"2024-04-25T01:44:24.410974+0000","last_undegraded":"2024-04-25T01:44:24.410974+0000","last_fullsized":"2024-04-25T01:44:24.410974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'157","last_scrub_stamp":"2024-04-25T01:43:56.686857+0000","last_deep_scrub":"30'157","last_deep_scrub_stamp":"2024-04-25T01:43:56.686857+0000","last_clean_scrub_stamp":"2024-04-25T01:43:56.686857+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:14:11.754552+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":311296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.410834+0000","last_change":"2024-04-25T01:44:13.509620+0000","last_active":"2024-04-25T01:44:24.410834+0000","last_peered":"2024-04-25T01:44:24.410834+0000","last_clean":"2024-04-25T01:44:24.410834+0000","last_became_active":"2024-04-25T01:39:23.379294+0000","last_became_peered":"2024-04-25T01:39:23.379294+0000","last_unstale":"2024-04-25T01:44:24.410834+0000","last_undegraded":"2024-04-25T01:44:24.410834+0000","last_fullsized":"2024-04-25T01:44:24.410834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:13.509453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:13.509453+0000","last_clean_scrub_stamp":"2024-04-25T01:44:13.509453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:58:48.683726+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"30'26","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.411995+0000","last_change":"2024-04-25T01:44:06.708309+0000","last_active":"2024-04-25T01:44:24.411995+0000","last_peered":"2024-04-25T01:44:24.411995+0000","last_clean":"2024-04-25T01:44:24.411995+0000","last_became_active":"2024-04-25T01:39:32.429189+0000","last_became_peered":"2024-04-25T01:39:32.429189+0000","last_unstale":"2024-04-25T01:44:24.411995+0000","last_undegraded":"2024-04-25T01:44:24.411995+0000","last_fullsized":"2024-04-25T01:44:24.411995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2024-04-25T01:44:06.708188+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2024-04-25T01:44:06.708188+0000","last_clean_scrub_stamp":"2024-04-25T01:44:06.708188+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:21:48.375302+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":46,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"30'171","reported_seq":208,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.410905+0000","last_change":"2024-04-25T01:44:18.608812+0000","last_active":"2024-04-25T01:44:24.410905+0000","last_peered":"2024-04-25T01:44:24.410905+0000","last_clean":"2024-04-25T01:44:24.410905+0000","last_became_active":"2024-04-25T01:39:33.438233+0000","last_became_peered":"2024-04-25T01:39:33.438233+0000","last_unstale":"2024-04-25T01:44:24.410905+0000","last_undegraded":"2024-04-25T01:44:24.410905+0000","last_fullsized":"2024-04-25T01:44:24.410905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'171","last_scrub_stamp":"2024-04-25T01:44:18.608682+0000","last_deep_scrub":"30'171","last_deep_scrub_stamp":"2024-04-25T01:44:18.608682+0000","last_clean_scrub_stamp":"2024-04-25T01:44:18.608682+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:47.693186+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"30'209","reported_seq":254,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.419717+0000","last_change":"2024-04-25T01:44:01.375626+0000","last_active":"2024-04-25T01:44:24.419717+0000","last_peered":"2024-04-25T01:44:24.419717+0000","last_clean":"2024-04-25T01:44:24.419717+0000","last_became_active":"2024-04-25T01:39:24.400502+0000","last_became_peered":"2024-04-25T01:39:24.400502+0000","last_unstale":"2024-04-25T01:44:24.419717+0000","last_undegraded":"2024-04-25T01:44:24.419717+0000","last_fullsized":"2024-04-25T01:44:24.419717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'209","last_scrub_stamp":"2024-04-25T01:44:01.375511+0000","last_deep_scrub":"30'209","last_deep_scrub_stamp":"2024-04-25T01:44:01.375511+0000","last_clean_scrub_stamp":"2024-04-25T01:44:01.375511+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:24.077492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.435020+0000","last_change":"2024-04-25T01:44:07.924175+0000","last_active":"2024-04-25T01:44:24.435020+0000","last_peered":"2024-04-25T01:44:24.435020+0000","last_clean":"2024-04-25T01:44:24.435020+0000","last_became_active":"2024-04-25T01:39:23.367520+0000","last_became_peered":"2024-04-25T01:39:23.367520+0000","last_unstale":"2024-04-25T01:44:24.435020+0000","last_undegraded":"2024-04-25T01:44:24.435020+0000","last_fullsized":"2024-04-25T01:44:24.435020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:07.924007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:07.924007+0000","last_clean_scrub_stamp":"2024-04-25T01:44:07.924007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:59:46.869223+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"30'119","reported_seq":205,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.411124+0000","last_change":"2024-04-25T01:44:07.545564+0000","last_active":"2024-04-25T01:44:24.411124+0000","last_peered":"2024-04-25T01:44:24.411124+0000","last_clean":"2024-04-25T01:44:24.411124+0000","last_became_active":"2024-04-25T01:39:12.917330+0000","last_became_peered":"2024-04-25T01:39:12.917330+0000","last_unstale":"2024-04-25T01:44:24.411124+0000","last_undegraded":"2024-04-25T01:44:24.411124+0000","last_fullsized":"2024-04-25T01:44:24.411124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'119","last_scrub_stamp":"2024-04-25T01:44:07.545447+0000","last_deep_scrub":"30'119","last_deep_scrub_stamp":"2024-04-25T01:44:07.545447+0000","last_clean_scrub_stamp":"2024-04-25T01:44:07.545447+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:31.695486+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.415526+0000","last_change":"2024-04-25T01:44:07.194746+0000","last_active":"2024-04-25T01:44:24.415526+0000","last_peered":"2024-04-25T01:44:24.415526+0000","last_clean":"2024-04-25T01:44:24.415526+0000","last_became_active":"2024-04-25T01:39:32.431523+0000","last_became_peered":"2024-04-25T01:39:32.431523+0000","last_unstale":"2024-04-25T01:44:24.415526+0000","last_undegraded":"2024-04-25T01:44:24.415526+0000","last_fullsized":"2024-04-25T01:44:24.415526+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:07.194627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:07.194627+0000","last_clean_scrub_stamp":"2024-04-25T01:44:07.194627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:00.008348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"30'174","reported_seq":211,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.408164+0000","last_change":"2024-04-25T01:44:03.304185+0000","last_active":"2024-04-25T01:44:24.408164+0000","last_peered":"2024-04-25T01:44:24.408164+0000","last_clean":"2024-04-25T01:44:24.408164+0000","last_became_active":"2024-04-25T01:39:33.440161+0000","last_became_peered":"2024-04-25T01:39:33.440161+0000","last_unstale":"2024-04-25T01:44:24.408164+0000","last_undegraded":"2024-04-25T01:44:24.408164+0000","last_fullsized":"2024-04-25T01:44:24.408164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'174","last_scrub_stamp":"2024-04-25T01:44:03.304058+0000","last_deep_scrub":"30'174","last_deep_scrub_stamp":"2024-04-25T01:44:03.304058+0000","last_clean_scrub_stamp":"2024-04-25T01:44:03.304058+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:08.092883+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"30'168","reported_seq":213,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.412739+0000","last_change":"2024-04-25T01:43:57.550975+0000","last_active":"2024-04-25T01:44:24.412739+0000","last_peered":"2024-04-25T01:44:24.412739+0000","last_clean":"2024-04-25T01:44:24.412739+0000","last_became_active":"2024-04-25T01:39:24.393235+0000","last_became_peered":"2024-04-25T01:39:24.393235+0000","last_unstale":"2024-04-25T01:44:24.412739+0000","last_undegraded":"2024-04-25T01:44:24.412739+0000","last_fullsized":"2024-04-25T01:44:24.412739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'168","last_scrub_stamp":"2024-04-25T01:43:57.550852+0000","last_deep_scrub":"30'168","last_deep_scrub_stamp":"2024-04-25T01:43:57.550852+0000","last_clean_scrub_stamp":"2024-04-25T01:43:57.550852+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:02.191209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.407936+0000","last_change":"2024-04-25T01:43:54.383599+0000","last_active":"2024-04-25T01:44:24.407936+0000","last_peered":"2024-04-25T01:44:24.407936+0000","last_clean":"2024-04-25T01:44:24.407936+0000","last_became_active":"2024-04-25T01:39:23.368075+0000","last_became_peered":"2024-04-25T01:39:23.368075+0000","last_unstale":"2024-04-25T01:44:24.407936+0000","last_undegraded":"2024-04-25T01:44:24.407936+0000","last_fullsized":"2024-04-25T01:44:24.407936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:43:54.383506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:43:54.383506+0000","last_clean_scrub_stamp":"2024-04-25T01:43:54.383506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:08.180243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.415417+0000","last_change":"2024-04-25T01:43:57.045856+0000","last_active":"2024-04-25T01:44:24.415417+0000","last_peered":"2024-04-25T01:44:24.415417+0000","last_clean":"2024-04-25T01:44:24.415417+0000","last_became_active":"2024-04-25T01:39:32.429721+0000","last_became_peered":"2024-04-25T01:39:32.429721+0000","last_unstale":"2024-04-25T01:44:24.415417+0000","last_undegraded":"2024-04-25T01:44:24.415417+0000","last_fullsized":"2024-04-25T01:44:24.415417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:43:57.045731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:43:57.045731+0000","last_clean_scrub_stamp":"2024-04-25T01:43:57.045731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:01:51.411381+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"30'171","reported_seq":208,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.408248+0000","last_change":"2024-04-25T01:44:06.339582+0000","last_active":"2024-04-25T01:44:24.408248+0000","last_peered":"2024-04-25T01:44:24.408248+0000","last_clean":"2024-04-25T01:44:24.408248+0000","last_became_active":"2024-04-25T01:39:33.446930+0000","last_became_peered":"2024-04-25T01:39:33.446930+0000","last_unstale":"2024-04-25T01:44:24.408248+0000","last_undegraded":"2024-04-25T01:44:24.408248+0000","last_fullsized":"2024-04-25T01:44:24.408248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'171","last_scrub_stamp":"2024-04-25T01:44:06.339465+0000","last_deep_scrub":"30'171","last_deep_scrub_stamp":"2024-04-25T01:44:06.339465+0000","last_clean_scrub_stamp":"2024-04-25T01:44:06.339465+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:58.352814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'173","reported_seq":218,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.436600+0000","last_change":"2024-04-25T01:44:00.852164+0000","last_active":"2024-04-25T01:44:24.436600+0000","last_peered":"2024-04-25T01:44:24.436600+0000","last_clean":"2024-04-25T01:44:24.436600+0000","last_became_active":"2024-04-25T01:39:24.393558+0000","last_became_peered":"2024-04-25T01:39:24.393558+0000","last_unstale":"2024-04-25T01:44:24.436600+0000","last_undegraded":"2024-04-25T01:44:24.436600+0000","last_fullsized":"2024-04-25T01:44:24.436600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'173","last_scrub_stamp":"2024-04-25T01:44:00.852044+0000","last_deep_scrub":"30'173","last_deep_scrub_stamp":"2024-04-25T01:44:00.852044+0000","last_clean_scrub_stamp":"2024-04-25T01:44:00.852044+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:45.745510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"30'2","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.407574+0000","last_change":"2024-04-25T01:44:05.130522+0000","last_active":"2024-04-25T01:44:24.407574+0000","last_peered":"2024-04-25T01:44:24.407574+0000","last_clean":"2024-04-25T01:44:24.407574+0000","last_became_active":"2024-04-25T01:39:23.370391+0000","last_became_peered":"2024-04-25T01:39:23.370391+0000","last_unstale":"2024-04-25T01:44:24.407574+0000","last_undegraded":"2024-04-25T01:44:24.407574+0000","last_fullsized":"2024-04-25T01:44:24.407574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-25T01:44:05.130409+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-25T01:44:05.130409+0000","last_clean_scrub_stamp":"2024-04-25T01:44:05.130409+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:23.578532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"30'7","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.411068+0000","last_change":"2024-04-25T01:44:05.684934+0000","last_active":"2024-04-25T01:44:24.411068+0000","last_peered":"2024-04-25T01:44:24.411068+0000","last_clean":"2024-04-25T01:44:24.411068+0000","last_became_active":"2024-04-25T01:39:32.429143+0000","last_became_peered":"2024-04-25T01:39:32.429143+0000","last_unstale":"2024-04-25T01:44:24.411068+0000","last_undegraded":"2024-04-25T01:44:24.411068+0000","last_fullsized":"2024-04-25T01:44:24.411068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'7","last_scrub_stamp":"2024-04-25T01:44:05.684809+0000","last_deep_scrub":"30'7","last_deep_scrub_stamp":"2024-04-25T01:44:05.684809+0000","last_clean_scrub_stamp":"2024-04-25T01:44:05.684809+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:02:36.499386+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"30'173","reported_seq":210,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.411402+0000","last_change":"2024-04-25T01:44:16.575827+0000","last_active":"2024-04-25T01:44:24.411402+0000","last_peered":"2024-04-25T01:44:24.411402+0000","last_clean":"2024-04-25T01:44:24.411402+0000","last_became_active":"2024-04-25T01:39:33.436861+0000","last_became_peered":"2024-04-25T01:39:33.436861+0000","last_unstale":"2024-04-25T01:44:24.411402+0000","last_undegraded":"2024-04-25T01:44:24.411402+0000","last_fullsized":"2024-04-25T01:44:24.411402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'173","last_scrub_stamp":"2024-04-25T01:44:16.575702+0000","last_deep_scrub":"30'173","last_deep_scrub_stamp":"2024-04-25T01:44:16.575702+0000","last_clean_scrub_stamp":"2024-04-25T01:44:16.575702+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:32:05.890826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"30'168","reported_seq":213,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.414636+0000","last_change":"2024-04-25T01:43:56.533497+0000","last_active":"2024-04-25T01:44:24.414636+0000","last_peered":"2024-04-25T01:44:24.414636+0000","last_clean":"2024-04-25T01:44:24.414636+0000","last_became_active":"2024-04-25T01:39:24.391811+0000","last_became_peered":"2024-04-25T01:39:24.391811+0000","last_unstale":"2024-04-25T01:44:24.414636+0000","last_undegraded":"2024-04-25T01:44:24.414636+0000","last_fullsized":"2024-04-25T01:44:24.414636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'168","last_scrub_stamp":"2024-04-25T01:43:56.533310+0000","last_deep_scrub":"30'168","last_deep_scrub_stamp":"2024-04-25T01:43:56.533310+0000","last_clean_scrub_stamp":"2024-04-25T01:43:56.533310+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:58:32.136707+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"30'3","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:27.575490+0000","last_change":"2024-04-25T01:43:55.354601+0000","last_active":"2024-04-25T01:44:27.575490+0000","last_peered":"2024-04-25T01:44:27.575490+0000","last_clean":"2024-04-25T01:44:27.575490+0000","last_became_active":"2024-04-25T01:39:23.369314+0000","last_became_peered":"2024-04-25T01:39:23.369314+0000","last_unstale":"2024-04-25T01:44:27.575490+0000","last_undegraded":"2024-04-25T01:44:27.575490+0000","last_fullsized":"2024-04-25T01:44:27.575490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-04-25T01:43:55.354499+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-04-25T01:43:55.354499+0000","last_clean_scrub_stamp":"2024-04-25T01:43:55.354499+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:19:30.954704+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.434721+0000","last_change":"2024-04-25T01:43:59.804457+0000","last_active":"2024-04-25T01:44:24.434721+0000","last_peered":"2024-04-25T01:44:24.434721+0000","last_clean":"2024-04-25T01:44:24.434721+0000","last_became_active":"2024-04-25T01:39:32.429358+0000","last_became_peered":"2024-04-25T01:39:32.429358+0000","last_unstale":"2024-04-25T01:44:24.434721+0000","last_undegraded":"2024-04-25T01:44:24.434721+0000","last_fullsized":"2024-04-25T01:44:24.434721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:43:59.804317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:43:59.804317+0000","last_clean_scrub_stamp":"2024-04-25T01:43:59.804317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:38:59.974939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"30'178","reported_seq":215,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.406497+0000","last_change":"2024-04-25T01:44:02.346857+0000","last_active":"2024-04-25T01:44:24.406497+0000","last_peered":"2024-04-25T01:44:24.406497+0000","last_clean":"2024-04-25T01:44:24.406497+0000","last_became_active":"2024-04-25T01:39:33.440054+0000","last_became_peered":"2024-04-25T01:39:33.440054+0000","last_unstale":"2024-04-25T01:44:24.406497+0000","last_undegraded":"2024-04-25T01:44:24.406497+0000","last_fullsized":"2024-04-25T01:44:24.406497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'178","last_scrub_stamp":"2024-04-25T01:44:02.346739+0000","last_deep_scrub":"30'178","last_deep_scrub_stamp":"2024-04-25T01:44:02.346739+0000","last_clean_scrub_stamp":"2024-04-25T01:44:02.346739+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:34:24.517647+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"30'179","reported_seq":209,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.408069+0000","last_change":"2024-04-25T01:44:07.348277+0000","last_active":"2024-04-25T01:44:24.408069+0000","last_peered":"2024-04-25T01:44:24.408069+0000","last_clean":"2024-04-25T01:44:24.408069+0000","last_became_active":"2024-04-25T01:40:05.826076+0000","last_became_peered":"2024-04-25T01:40:05.826076+0000","last_unstale":"2024-04-25T01:44:24.408069+0000","last_undegraded":"2024-04-25T01:44:24.408069+0000","last_fullsized":"2024-04-25T01:44:24.408069+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'179","last_scrub_stamp":"2024-04-25T01:44:07.348122+0000","last_deep_scrub":"30'179","last_deep_scrub_stamp":"2024-04-25T01:44:07.348122+0000","last_clean_scrub_stamp":"2024-04-25T01:44:07.348122+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:03:44.164106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"30'2","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.412200+0000","last_change":"2024-04-25T01:44:01.227568+0000","last_active":"2024-04-25T01:44:24.412200+0000","last_peered":"2024-04-25T01:44:24.412200+0000","last_clean":"2024-04-25T01:44:24.412200+0000","last_became_active":"2024-04-25T01:39:23.367054+0000","last_became_peered":"2024-04-25T01:39:23.367054+0000","last_unstale":"2024-04-25T01:44:24.412200+0000","last_undegraded":"2024-04-25T01:44:24.412200+0000","last_fullsized":"2024-04-25T01:44:24.412200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-25T01:44:01.227397+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-25T01:44:01.227397+0000","last_clean_scrub_stamp":"2024-04-25T01:44:01.227397+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:47:07.714385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.411925+0000","last_change":"2024-04-25T01:44:08.327233+0000","last_active":"2024-04-25T01:44:24.411925+0000","last_peered":"2024-04-25T01:44:24.411925+0000","last_clean":"2024-04-25T01:44:24.411925+0000","last_became_active":"2024-04-25T01:39:32.426599+0000","last_became_peered":"2024-04-25T01:39:32.426599+0000","last_unstale":"2024-04-25T01:44:24.411925+0000","last_undegraded":"2024-04-25T01:44:24.411925+0000","last_fullsized":"2024-04-25T01:44:24.411925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:08.327123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:08.327123+0000","last_clean_scrub_stamp":"2024-04-25T01:44:08.327123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:18.813118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"30'164","reported_seq":201,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.419138+0000","last_change":"2024-04-25T01:44:19.371253+0000","last_active":"2024-04-25T01:44:24.419138+0000","last_peered":"2024-04-25T01:44:24.419138+0000","last_clean":"2024-04-25T01:44:24.419138+0000","last_became_active":"2024-04-25T01:39:33.428626+0000","last_became_peered":"2024-04-25T01:39:33.428626+0000","last_unstale":"2024-04-25T01:44:24.419138+0000","last_undegraded":"2024-04-25T01:44:24.419138+0000","last_fullsized":"2024-04-25T01:44:24.419138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'164","last_scrub_stamp":"2024-04-25T01:44:19.371108+0000","last_deep_scrub":"30'164","last_deep_scrub_stamp":"2024-04-25T01:44:19.371108+0000","last_clean_scrub_stamp":"2024-04-25T01:44:19.371108+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:24:41.282250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"30'204","reported_seq":249,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.413313+0000","last_change":"2024-04-25T01:44:00.546628+0000","last_active":"2024-04-25T01:44:24.413313+0000","last_peered":"2024-04-25T01:44:24.413313+0000","last_clean":"2024-04-25T01:44:24.413313+0000","last_became_active":"2024-04-25T01:39:24.389656+0000","last_became_peered":"2024-04-25T01:39:24.389656+0000","last_unstale":"2024-04-25T01:44:24.413313+0000","last_undegraded":"2024-04-25T01:44:24.413313+0000","last_fullsized":"2024-04-25T01:44:24.413313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'204","last_scrub_stamp":"2024-04-25T01:44:00.546502+0000","last_deep_scrub":"30'204","last_deep_scrub_stamp":"2024-04-25T01:44:00.546502+0000","last_clean_scrub_stamp":"2024-04-25T01:44:00.546502+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:48:45.295003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"30'13","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:27.577107+0000","last_change":"2024-04-25T01:43:57.363201+0000","last_active":"2024-04-25T01:44:27.577107+0000","last_peered":"2024-04-25T01:44:27.577107+0000","last_clean":"2024-04-25T01:44:27.577107+0000","last_became_active":"2024-04-25T01:39:23.373281+0000","last_became_peered":"2024-04-25T01:39:23.373281+0000","last_unstale":"2024-04-25T01:44:27.577107+0000","last_undegraded":"2024-04-25T01:44:27.577107+0000","last_fullsized":"2024-04-25T01:44:27.577107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'13","last_scrub_stamp":"2024-04-25T01:43:57.363030+0000","last_deep_scrub":"30'13","last_deep_scrub_stamp":"2024-04-25T01:43:57.363030+0000","last_clean_scrub_stamp":"2024-04-25T01:43:57.363030+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:18:13.563068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":66,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.411794+0000","last_change":"2024-04-25T01:43:55.665384+0000","last_active":"2024-04-25T01:44:24.411794+0000","last_peered":"2024-04-25T01:44:24.411794+0000","last_clean":"2024-04-25T01:44:24.411794+0000","last_became_active":"2024-04-25T01:39:32.426499+0000","last_became_peered":"2024-04-25T01:39:32.426499+0000","last_unstale":"2024-04-25T01:44:24.411794+0000","last_undegraded":"2024-04-25T01:44:24.411794+0000","last_fullsized":"2024-04-25T01:44:24.411794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:43:55.665292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:43:55.665292+0000","last_clean_scrub_stamp":"2024-04-25T01:43:55.665292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:51.887061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"30'274","reported_seq":311,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.435722+0000","last_change":"2024-04-25T01:44:05.919958+0000","last_active":"2024-04-25T01:44:24.435722+0000","last_peered":"2024-04-25T01:44:24.435722+0000","last_clean":"2024-04-25T01:44:24.435722+0000","last_became_active":"2024-04-25T01:39:33.436001+0000","last_became_peered":"2024-04-25T01:39:33.436001+0000","last_unstale":"2024-04-25T01:44:24.435722+0000","last_undegraded":"2024-04-25T01:44:24.435722+0000","last_fullsized":"2024-04-25T01:44:24.435722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'274","last_scrub_stamp":"2024-04-25T01:44:05.919836+0000","last_deep_scrub":"30'274","last_deep_scrub_stamp":"2024-04-25T01:44:05.919836+0000","last_clean_scrub_stamp":"2024-04-25T01:44:05.919836+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:45:27.349965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"30'176","reported_seq":221,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.415267+0000","last_change":"2024-04-25T01:44:04.065381+0000","last_active":"2024-04-25T01:44:24.415267+0000","last_peered":"2024-04-25T01:44:24.415267+0000","last_clean":"2024-04-25T01:44:24.415267+0000","last_became_active":"2024-04-25T01:39:24.393958+0000","last_became_peered":"2024-04-25T01:39:24.393958+0000","last_unstale":"2024-04-25T01:44:24.415267+0000","last_undegraded":"2024-04-25T01:44:24.415267+0000","last_fullsized":"2024-04-25T01:44:24.415267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'176","last_scrub_stamp":"2024-04-25T01:44:04.065247+0000","last_deep_scrub":"30'176","last_deep_scrub_stamp":"2024-04-25T01:44:04.065247+0000","last_clean_scrub_stamp":"2024-04-25T01:44:04.065247+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:21:39.552629+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.415968+0000","last_change":"2024-04-25T01:43:59.033698+0000","last_active":"2024-04-25T01:44:24.415968+0000","last_peered":"2024-04-25T01:44:24.415968+0000","last_clean":"2024-04-25T01:44:24.415968+0000","last_became_active":"2024-04-25T01:39:23.372648+0000","last_became_peered":"2024-04-25T01:39:23.372648+0000","last_unstale":"2024-04-25T01:44:24.415968+0000","last_undegraded":"2024-04-25T01:44:24.415968+0000","last_fullsized":"2024-04-25T01:44:24.415968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:43:59.033534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:43:59.033534+0000","last_clean_scrub_stamp":"2024-04-25T01:43:59.033534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:35.286645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'1","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.419122+0000","last_change":"2024-04-25T01:44:02.380489+0000","last_active":"2024-04-25T01:44:24.419122+0000","last_peered":"2024-04-25T01:44:24.419122+0000","last_clean":"2024-04-25T01:44:24.419122+0000","last_became_active":"2024-04-25T01:39:32.431938+0000","last_became_peered":"2024-04-25T01:39:32.431938+0000","last_unstale":"2024-04-25T01:44:24.419122+0000","last_undegraded":"2024-04-25T01:44:24.419122+0000","last_fullsized":"2024-04-25T01:44:24.419122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2024-04-25T01:44:02.380371+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2024-04-25T01:44:02.380371+0000","last_clean_scrub_stamp":"2024-04-25T01:44:02.380371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:39:05.869163+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"30'185","reported_seq":222,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.435149+0000","last_change":"2024-04-25T01:44:21.904815+0000","last_active":"2024-04-25T01:44:24.435149+0000","last_peered":"2024-04-25T01:44:24.435149+0000","last_clean":"2024-04-25T01:44:24.435149+0000","last_became_active":"2024-04-25T01:39:33.441074+0000","last_became_peered":"2024-04-25T01:39:33.441074+0000","last_unstale":"2024-04-25T01:44:24.435149+0000","last_undegraded":"2024-04-25T01:44:24.435149+0000","last_fullsized":"2024-04-25T01:44:24.435149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'185","last_scrub_stamp":"2024-04-25T01:44:21.904693+0000","last_deep_scrub":"30'185","last_deep_scrub_stamp":"2024-04-25T01:44:21.904693+0000","last_clean_scrub_stamp":"2024-04-25T01:44:21.904693+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:11:20.255360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'214","reported_seq":259,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.411241+0000","last_change":"2024-04-25T01:43:58.581234+0000","last_active":"2024-04-25T01:44:24.411241+0000","last_peered":"2024-04-25T01:44:24.411241+0000","last_clean":"2024-04-25T01:44:24.411241+0000","last_became_active":"2024-04-25T01:39:24.389841+0000","last_became_peered":"2024-04-25T01:39:24.389841+0000","last_unstale":"2024-04-25T01:44:24.411241+0000","last_undegraded":"2024-04-25T01:44:24.411241+0000","last_fullsized":"2024-04-25T01:44:24.411241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'214","last_scrub_stamp":"2024-04-25T01:43:58.581061+0000","last_deep_scrub":"30'214","last_deep_scrub_stamp":"2024-04-25T01:43:58.581061+0000","last_clean_scrub_stamp":"2024-04-25T01:43:58.581061+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:30:20.805162+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.435758+0000","last_change":"2024-04-25T01:44:08.965079+0000","last_active":"2024-04-25T01:44:24.435758+0000","last_peered":"2024-04-25T01:44:24.435758+0000","last_clean":"2024-04-25T01:44:24.435758+0000","last_became_active":"2024-04-25T01:39:23.369151+0000","last_became_peered":"2024-04-25T01:39:23.369151+0000","last_unstale":"2024-04-25T01:44:24.435758+0000","last_undegraded":"2024-04-25T01:44:24.435758+0000","last_fullsized":"2024-04-25T01:44:24.435758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:08.964943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:08.964943+0000","last_clean_scrub_stamp":"2024-04-25T01:44:08.964943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:59:30.463100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'2028","reported_seq":2084,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.419827+0000","last_change":"2024-04-25T01:43:58.353685+0000","last_active":"2024-04-25T01:44:24.419827+0000","last_peered":"2024-04-25T01:44:24.419827+0000","last_clean":"2024-04-25T01:44:24.419827+0000","last_became_active":"2024-04-25T01:39:32.430187+0000","last_became_peered":"2024-04-25T01:39:32.430187+0000","last_unstale":"2024-04-25T01:44:24.419827+0000","last_undegraded":"2024-04-25T01:44:24.419827+0000","last_fullsized":"2024-04-25T01:44:24.419827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2028","last_scrub_stamp":"2024-04-25T01:43:58.353529+0000","last_deep_scrub":"30'2028","last_deep_scrub_stamp":"2024-04-25T01:43:58.353529+0000","last_clean_scrub_stamp":"2024-04-25T01:43:58.353529+0000","objects_scrubbed":4,"log_size":2028,"log_dups_size":0,"ondisk_log_size":2028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:09:23.141075+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":4133,"num_write":2022,"num_write_kb":6038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"30'182","reported_seq":219,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.419781+0000","last_change":"2024-04-25T01:44:18.386032+0000","last_active":"2024-04-25T01:44:24.419781+0000","last_peered":"2024-04-25T01:44:24.419781+0000","last_clean":"2024-04-25T01:44:24.419781+0000","last_became_active":"2024-04-25T01:39:33.427164+0000","last_became_peered":"2024-04-25T01:39:33.427164+0000","last_unstale":"2024-04-25T01:44:24.419781+0000","last_undegraded":"2024-04-25T01:44:24.419781+0000","last_fullsized":"2024-04-25T01:44:24.419781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'182","last_scrub_stamp":"2024-04-25T01:44:18.385858+0000","last_deep_scrub":"30'182","last_deep_scrub_stamp":"2024-04-25T01:44:18.385858+0000","last_clean_scrub_stamp":"2024-04-25T01:44:18.385858+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:11.034188+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"30'179","reported_seq":224,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.411024+0000","last_change":"2024-04-25T01:44:01.776446+0000","last_active":"2024-04-25T01:44:24.411024+0000","last_peered":"2024-04-25T01:44:24.411024+0000","last_clean":"2024-04-25T01:44:24.411024+0000","last_became_active":"2024-04-25T01:39:24.388594+0000","last_became_peered":"2024-04-25T01:39:24.388594+0000","last_unstale":"2024-04-25T01:44:24.411024+0000","last_undegraded":"2024-04-25T01:44:24.411024+0000","last_fullsized":"2024-04-25T01:44:24.411024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'179","last_scrub_stamp":"2024-04-25T01:44:01.776312+0000","last_deep_scrub":"30'179","last_deep_scrub_stamp":"2024-04-25T01:44:01.776312+0000","last_clean_scrub_stamp":"2024-04-25T01:44:01.776312+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:10:39.604115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"30'4","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.412499+0000","last_change":"2024-04-25T01:43:57.657782+0000","last_active":"2024-04-25T01:44:24.412499+0000","last_peered":"2024-04-25T01:44:24.412499+0000","last_clean":"2024-04-25T01:44:24.412499+0000","last_became_active":"2024-04-25T01:39:23.372617+0000","last_became_peered":"2024-04-25T01:39:23.372617+0000","last_unstale":"2024-04-25T01:44:24.412499+0000","last_undegraded":"2024-04-25T01:44:24.412499+0000","last_fullsized":"2024-04-25T01:44:24.412499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-04-25T01:43:57.657602+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-04-25T01:43:57.657602+0000","last_clean_scrub_stamp":"2024-04-25T01:43:57.657602+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:01:06.264256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":24,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"30'9","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.435659+0000","last_change":"2024-04-25T01:44:01.892477+0000","last_active":"2024-04-25T01:44:24.435659+0000","last_peered":"2024-04-25T01:44:24.435659+0000","last_clean":"2024-04-25T01:44:24.435659+0000","last_became_active":"2024-04-25T01:39:32.429900+0000","last_became_peered":"2024-04-25T01:39:32.429900+0000","last_unstale":"2024-04-25T01:44:24.435659+0000","last_undegraded":"2024-04-25T01:44:24.435659+0000","last_fullsized":"2024-04-25T01:44:24.435659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'9","last_scrub_stamp":"2024-04-25T01:44:01.892314+0000","last_deep_scrub":"30'9","last_deep_scrub_stamp":"2024-04-25T01:44:01.892314+0000","last_clean_scrub_stamp":"2024-04-25T01:44:01.892314+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:17:37.923615+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"30'217","reported_seq":254,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.418876+0000","last_change":"2024-04-25T01:44:23.458891+0000","last_active":"2024-04-25T01:44:24.418876+0000","last_peered":"2024-04-25T01:44:24.418876+0000","last_clean":"2024-04-25T01:44:24.418876+0000","last_became_active":"2024-04-25T01:39:33.439961+0000","last_became_peered":"2024-04-25T01:39:33.439961+0000","last_unstale":"2024-04-25T01:44:24.418876+0000","last_undegraded":"2024-04-25T01:44:24.418876+0000","last_fullsized":"2024-04-25T01:44:24.418876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'217","last_scrub_stamp":"2024-04-25T01:44:23.458731+0000","last_deep_scrub":"30'217","last_deep_scrub_stamp":"2024-04-25T01:44:23.458731+0000","last_clean_scrub_stamp":"2024-04-25T01:44:23.458731+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:43:41.104049+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'159","reported_seq":204,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.412311+0000","last_change":"2024-04-25T01:44:14.499372+0000","last_active":"2024-04-25T01:44:24.412311+0000","last_peered":"2024-04-25T01:44:24.412311+0000","last_clean":"2024-04-25T01:44:24.412311+0000","last_became_active":"2024-04-25T01:39:24.380330+0000","last_became_peered":"2024-04-25T01:39:24.380330+0000","last_unstale":"2024-04-25T01:44:24.412311+0000","last_undegraded":"2024-04-25T01:44:24.412311+0000","last_fullsized":"2024-04-25T01:44:24.412311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'159","last_scrub_stamp":"2024-04-25T01:44:14.499235+0000","last_deep_scrub":"30'159","last_deep_scrub_stamp":"2024-04-25T01:44:14.499235+0000","last_clean_scrub_stamp":"2024-04-25T01:44:14.499235+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:01.147320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'2026","reported_seq":2091,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:27.579594+0000","last_change":"2024-04-25T01:44:00.980746+0000","last_active":"2024-04-25T01:44:27.579594+0000","last_peered":"2024-04-25T01:44:27.579594+0000","last_clean":"2024-04-25T01:44:27.579594+0000","last_became_active":"2024-04-25T01:39:23.372984+0000","last_became_peered":"2024-04-25T01:39:23.372984+0000","last_unstale":"2024-04-25T01:44:27.579594+0000","last_undegraded":"2024-04-25T01:44:27.579594+0000","last_fullsized":"2024-04-25T01:44:27.579594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2025","last_scrub_stamp":"2024-04-25T01:44:00.980602+0000","last_deep_scrub":"30'2025","last_deep_scrub_stamp":"2024-04-25T01:44:00.980602+0000","last_clean_scrub_stamp":"2024-04-25T01:44:00.980602+0000","objects_scrubbed":4,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:42.747876+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":4169,"num_write":2020,"num_write_kb":6036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.404836+0000","last_change":"2024-04-25T01:44:00.196848+0000","last_active":"2024-04-25T01:44:24.404836+0000","last_peered":"2024-04-25T01:44:24.404836+0000","last_clean":"2024-04-25T01:44:24.404836+0000","last_became_active":"2024-04-25T01:39:32.433408+0000","last_became_peered":"2024-04-25T01:39:32.433408+0000","last_unstale":"2024-04-25T01:44:24.404836+0000","last_undegraded":"2024-04-25T01:44:24.404836+0000","last_fullsized":"2024-04-25T01:44:24.404836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:00.196735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:00.196735+0000","last_clean_scrub_stamp":"2024-04-25T01:44:00.196735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:05.696113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"30'189","reported_seq":226,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.404962+0000","last_change":"2024-04-25T01:44:12.049252+0000","last_active":"2024-04-25T01:44:24.404962+0000","last_peered":"2024-04-25T01:44:24.404962+0000","last_clean":"2024-04-25T01:44:24.404962+0000","last_became_active":"2024-04-25T01:39:33.432690+0000","last_became_peered":"2024-04-25T01:39:33.432690+0000","last_unstale":"2024-04-25T01:44:24.404962+0000","last_undegraded":"2024-04-25T01:44:24.404962+0000","last_fullsized":"2024-04-25T01:44:24.404962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'189","last_scrub_stamp":"2024-04-25T01:44:12.049150+0000","last_deep_scrub":"30'189","last_deep_scrub_stamp":"2024-04-25T01:44:12.049150+0000","last_clean_scrub_stamp":"2024-04-25T01:44:12.049150+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:18:02.068299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"30'179","reported_seq":224,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.413145+0000","last_change":"2024-04-25T01:44:05.285065+0000","last_active":"2024-04-25T01:44:24.413145+0000","last_peered":"2024-04-25T01:44:24.413145+0000","last_clean":"2024-04-25T01:44:24.413145+0000","last_became_active":"2024-04-25T01:39:24.390941+0000","last_became_peered":"2024-04-25T01:39:24.390941+0000","last_unstale":"2024-04-25T01:44:24.413145+0000","last_undegraded":"2024-04-25T01:44:24.413145+0000","last_fullsized":"2024-04-25T01:44:24.413145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'179","last_scrub_stamp":"2024-04-25T01:44:05.284889+0000","last_deep_scrub":"30'179","last_deep_scrub_stamp":"2024-04-25T01:44:05.284889+0000","last_clean_scrub_stamp":"2024-04-25T01:44:05.284889+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:58.184499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"30'9","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:27.577839+0000","last_change":"2024-04-25T01:44:04.091546+0000","last_active":"2024-04-25T01:44:27.577839+0000","last_peered":"2024-04-25T01:44:27.577839+0000","last_clean":"2024-04-25T01:44:27.577839+0000","last_became_active":"2024-04-25T01:39:23.368778+0000","last_became_peered":"2024-04-25T01:39:23.368778+0000","last_unstale":"2024-04-25T01:44:27.577839+0000","last_undegraded":"2024-04-25T01:44:27.577839+0000","last_fullsized":"2024-04-25T01:44:27.577839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'9","last_scrub_stamp":"2024-04-25T01:44:04.091424+0000","last_deep_scrub":"30'9","last_deep_scrub_stamp":"2024-04-25T01:44:04.091424+0000","last_clean_scrub_stamp":"2024-04-25T01:44:04.091424+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:14:04.097758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'4","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.413191+0000","last_change":"2024-04-25T01:43:55.264750+0000","last_active":"2024-04-25T01:44:24.413191+0000","last_peered":"2024-04-25T01:44:24.413191+0000","last_clean":"2024-04-25T01:44:24.413191+0000","last_became_active":"2024-04-25T01:39:32.431247+0000","last_became_peered":"2024-04-25T01:39:32.431247+0000","last_unstale":"2024-04-25T01:44:24.413191+0000","last_undegraded":"2024-04-25T01:44:24.413191+0000","last_fullsized":"2024-04-25T01:44:24.413191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-04-25T01:43:55.264588+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-04-25T01:43:55.264588+0000","last_clean_scrub_stamp":"2024-04-25T01:43:55.264588+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:59.794736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":24,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"30'233","reported_seq":270,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.415401+0000","last_change":"2024-04-25T01:44:13.166964+0000","last_active":"2024-04-25T01:44:24.415401+0000","last_peered":"2024-04-25T01:44:24.415401+0000","last_clean":"2024-04-25T01:44:24.415401+0000","last_became_active":"2024-04-25T01:39:33.446263+0000","last_became_peered":"2024-04-25T01:39:33.446263+0000","last_unstale":"2024-04-25T01:44:24.415401+0000","last_undegraded":"2024-04-25T01:44:24.415401+0000","last_fullsized":"2024-04-25T01:44:24.415401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'233","last_scrub_stamp":"2024-04-25T01:44:13.166811+0000","last_deep_scrub":"30'233","last_deep_scrub_stamp":"2024-04-25T01:44:13.166811+0000","last_clean_scrub_stamp":"2024-04-25T01:44:13.166811+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:43:18.883945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"30'153","reported_seq":198,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.411280+0000","last_change":"2024-04-25T01:43:52.659232+0000","last_active":"2024-04-25T01:44:24.411280+0000","last_peered":"2024-04-25T01:44:24.411280+0000","last_clean":"2024-04-25T01:44:24.411280+0000","last_became_active":"2024-04-25T01:39:24.403591+0000","last_became_peered":"2024-04-25T01:39:24.403591+0000","last_unstale":"2024-04-25T01:44:24.411280+0000","last_undegraded":"2024-04-25T01:44:24.411280+0000","last_fullsized":"2024-04-25T01:44:24.411280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'153","last_scrub_stamp":"2024-04-25T01:43:52.659097+0000","last_deep_scrub":"30'153","last_deep_scrub_stamp":"2024-04-25T01:43:52.659097+0000","last_clean_scrub_stamp":"2024-04-25T01:43:52.659097+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:15.244246+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.436280+0000","last_change":"2024-04-25T01:44:11.991559+0000","last_active":"2024-04-25T01:44:24.436280+0000","last_peered":"2024-04-25T01:44:24.436280+0000","last_clean":"2024-04-25T01:44:24.436280+0000","last_became_active":"2024-04-25T01:39:23.378635+0000","last_became_peered":"2024-04-25T01:39:23.378635+0000","last_unstale":"2024-04-25T01:44:24.436280+0000","last_undegraded":"2024-04-25T01:44:24.436280+0000","last_fullsized":"2024-04-25T01:44:24.436280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:11.991421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:11.991421+0000","last_clean_scrub_stamp":"2024-04-25T01:44:11.991421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:11:51.159997+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"30'12","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.418585+0000","last_change":"2024-04-25T01:43:54.400031+0000","last_active":"2024-04-25T01:44:24.418585+0000","last_peered":"2024-04-25T01:44:24.418585+0000","last_clean":"2024-04-25T01:44:24.418585+0000","last_became_active":"2024-04-25T01:39:32.427105+0000","last_became_peered":"2024-04-25T01:39:32.427105+0000","last_unstale":"2024-04-25T01:44:24.418585+0000","last_undegraded":"2024-04-25T01:44:24.418585+0000","last_fullsized":"2024-04-25T01:44:24.418585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'12","last_scrub_stamp":"2024-04-25T01:43:54.399899+0000","last_deep_scrub":"30'12","last_deep_scrub_stamp":"2024-04-25T01:43:54.399899+0000","last_clean_scrub_stamp":"2024-04-25T01:43:54.399899+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:36.318003+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":66,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'217","reported_seq":254,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.410593+0000","last_change":"2024-04-25T01:44:21.596077+0000","last_active":"2024-04-25T01:44:24.410593+0000","last_peered":"2024-04-25T01:44:24.410593+0000","last_clean":"2024-04-25T01:44:24.410593+0000","last_became_active":"2024-04-25T01:39:33.444489+0000","last_became_peered":"2024-04-25T01:39:33.444489+0000","last_unstale":"2024-04-25T01:44:24.410593+0000","last_undegraded":"2024-04-25T01:44:24.410593+0000","last_fullsized":"2024-04-25T01:44:24.410593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'217","last_scrub_stamp":"2024-04-25T01:44:21.595957+0000","last_deep_scrub":"30'217","last_deep_scrub_stamp":"2024-04-25T01:44:21.595957+0000","last_clean_scrub_stamp":"2024-04-25T01:44:21.595957+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:12.570789+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"30'235","reported_seq":280,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.435693+0000","last_change":"2024-04-25T01:44:04.963876+0000","last_active":"2024-04-25T01:44:24.435693+0000","last_peered":"2024-04-25T01:44:24.435693+0000","last_clean":"2024-04-25T01:44:24.435693+0000","last_became_active":"2024-04-25T01:39:24.391605+0000","last_became_peered":"2024-04-25T01:39:24.391605+0000","last_unstale":"2024-04-25T01:44:24.435693+0000","last_undegraded":"2024-04-25T01:44:24.435693+0000","last_fullsized":"2024-04-25T01:44:24.435693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'235","last_scrub_stamp":"2024-04-25T01:44:04.963755+0000","last_deep_scrub":"30'235","last_deep_scrub_stamp":"2024-04-25T01:44:04.963755+0000","last_clean_scrub_stamp":"2024-04-25T01:44:04.963755+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:12:09.031875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":565248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'1","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.416791+0000","last_change":"2024-04-25T01:44:02.016053+0000","last_active":"2024-04-25T01:44:24.416791+0000","last_peered":"2024-04-25T01:44:24.416791+0000","last_clean":"2024-04-25T01:44:24.416791+0000","last_became_active":"2024-04-25T01:39:23.376727+0000","last_became_peered":"2024-04-25T01:39:23.376727+0000","last_unstale":"2024-04-25T01:44:24.416791+0000","last_undegraded":"2024-04-25T01:44:24.416791+0000","last_fullsized":"2024-04-25T01:44:24.416791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2024-04-25T01:44:02.015929+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2024-04-25T01:44:02.015929+0000","last_clean_scrub_stamp":"2024-04-25T01:44:02.015929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:10:23.785928+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.418460+0000","last_change":"2024-04-25T01:43:55.391490+0000","last_active":"2024-04-25T01:44:24.418460+0000","last_peered":"2024-04-25T01:44:24.418460+0000","last_clean":"2024-04-25T01:44:24.418460+0000","last_became_active":"2024-04-25T01:39:32.424203+0000","last_became_peered":"2024-04-25T01:39:32.424203+0000","last_unstale":"2024-04-25T01:44:24.418460+0000","last_undegraded":"2024-04-25T01:44:24.418460+0000","last_fullsized":"2024-04-25T01:44:24.418460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:43:55.391399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:43:55.391399+0000","last_clean_scrub_stamp":"2024-04-25T01:43:55.391399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:13.223291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"30'172","reported_seq":209,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.416290+0000","last_change":"2024-04-25T01:44:12.155557+0000","last_active":"2024-04-25T01:44:24.416290+0000","last_peered":"2024-04-25T01:44:24.416290+0000","last_clean":"2024-04-25T01:44:24.416290+0000","last_became_active":"2024-04-25T01:39:33.445654+0000","last_became_peered":"2024-04-25T01:39:33.445654+0000","last_unstale":"2024-04-25T01:44:24.416290+0000","last_undegraded":"2024-04-25T01:44:24.416290+0000","last_fullsized":"2024-04-25T01:44:24.416290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'172","last_scrub_stamp":"2024-04-25T01:44:12.155397+0000","last_deep_scrub":"30'172","last_deep_scrub_stamp":"2024-04-25T01:44:12.155397+0000","last_clean_scrub_stamp":"2024-04-25T01:44:12.155397+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:05:07.145905+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.411537+0000","last_change":"2024-04-25T01:44:07.684903+0000","last_active":"2024-04-25T01:44:24.411537+0000","last_peered":"2024-04-25T01:44:24.411537+0000","last_clean":"2024-04-25T01:44:24.411537+0000","last_became_active":"2024-04-25T01:39:32.430220+0000","last_became_peered":"2024-04-25T01:39:32.430220+0000","last_unstale":"2024-04-25T01:44:24.411537+0000","last_undegraded":"2024-04-25T01:44:24.411537+0000","last_fullsized":"2024-04-25T01:44:24.411537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-04-25T01:44:07.684809+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-04-25T01:44:07.684809+0000","last_clean_scrub_stamp":"2024-04-25T01:44:07.684809+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:06.789551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"30'187","reported_seq":232,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.405016+0000","last_change":"2024-04-25T01:44:09.063840+0000","last_active":"2024-04-25T01:44:24.405016+0000","last_peered":"2024-04-25T01:44:24.405016+0000","last_clean":"2024-04-25T01:44:24.405016+0000","last_became_active":"2024-04-25T01:39:24.375178+0000","last_became_peered":"2024-04-25T01:39:24.375178+0000","last_unstale":"2024-04-25T01:44:24.405016+0000","last_undegraded":"2024-04-25T01:44:24.405016+0000","last_fullsized":"2024-04-25T01:44:24.405016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'187","last_scrub_stamp":"2024-04-25T01:44:09.063688+0000","last_deep_scrub":"30'187","last_deep_scrub_stamp":"2024-04-25T01:44:09.063688+0000","last_clean_scrub_stamp":"2024-04-25T01:44:09.063688+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:51:03.174886+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.435811+0000","last_change":"2024-04-25T01:44:09.955125+0000","last_active":"2024-04-25T01:44:24.435811+0000","last_peered":"2024-04-25T01:44:24.435811+0000","last_clean":"2024-04-25T01:44:24.435811+0000","last_became_active":"2024-04-25T01:39:23.369710+0000","last_became_peered":"2024-04-25T01:39:23.369710+0000","last_unstale":"2024-04-25T01:44:24.435811+0000","last_undegraded":"2024-04-25T01:44:24.435811+0000","last_fullsized":"2024-04-25T01:44:24.435811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:09.954971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:09.954971+0000","last_clean_scrub_stamp":"2024-04-25T01:44:09.954971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:16:24.034755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"30'192","reported_seq":229,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.411501+0000","last_change":"2024-04-25T01:44:11.595539+0000","last_active":"2024-04-25T01:44:24.411501+0000","last_peered":"2024-04-25T01:44:24.411501+0000","last_clean":"2024-04-25T01:44:24.411501+0000","last_became_active":"2024-04-25T01:39:33.447436+0000","last_became_peered":"2024-04-25T01:39:33.447436+0000","last_unstale":"2024-04-25T01:44:24.411501+0000","last_undegraded":"2024-04-25T01:44:24.411501+0000","last_fullsized":"2024-04-25T01:44:24.411501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'192","last_scrub_stamp":"2024-04-25T01:44:11.595397+0000","last_deep_scrub":"30'192","last_deep_scrub_stamp":"2024-04-25T01:44:11.595397+0000","last_clean_scrub_stamp":"2024-04-25T01:44:11.595397+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:57.614644+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'9","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.416673+0000","last_change":"2024-04-25T01:44:08.231361+0000","last_active":"2024-04-25T01:44:24.416673+0000","last_peered":"2024-04-25T01:44:24.416673+0000","last_clean":"2024-04-25T01:44:24.416673+0000","last_became_active":"2024-04-25T01:39:32.436000+0000","last_became_peered":"2024-04-25T01:39:32.436000+0000","last_unstale":"2024-04-25T01:44:24.416673+0000","last_undegraded":"2024-04-25T01:44:24.416673+0000","last_fullsized":"2024-04-25T01:44:24.416673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'9","last_scrub_stamp":"2024-04-25T01:44:08.231182+0000","last_deep_scrub":"30'9","last_deep_scrub_stamp":"2024-04-25T01:44:08.231182+0000","last_clean_scrub_stamp":"2024-04-25T01:44:08.231182+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:58.977971+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"30'190","reported_seq":235,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.418941+0000","last_change":"2024-04-25T01:44:13.411847+0000","last_active":"2024-04-25T01:44:24.418941+0000","last_peered":"2024-04-25T01:44:24.418941+0000","last_clean":"2024-04-25T01:44:24.418941+0000","last_became_active":"2024-04-25T01:39:24.387433+0000","last_became_peered":"2024-04-25T01:39:24.387433+0000","last_unstale":"2024-04-25T01:44:24.418941+0000","last_undegraded":"2024-04-25T01:44:24.418941+0000","last_fullsized":"2024-04-25T01:44:24.418941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'190","last_scrub_stamp":"2024-04-25T01:44:13.411731+0000","last_deep_scrub":"30'190","last_deep_scrub_stamp":"2024-04-25T01:44:13.411731+0000","last_clean_scrub_stamp":"2024-04-25T01:44:13.411731+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:20:39.085073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.418719+0000","last_change":"2024-04-25T01:44:10.476190+0000","last_active":"2024-04-25T01:44:24.418719+0000","last_peered":"2024-04-25T01:44:24.418719+0000","last_clean":"2024-04-25T01:44:24.418719+0000","last_became_active":"2024-04-25T01:39:23.377181+0000","last_became_peered":"2024-04-25T01:39:23.377181+0000","last_unstale":"2024-04-25T01:44:24.418719+0000","last_undegraded":"2024-04-25T01:44:24.418719+0000","last_fullsized":"2024-04-25T01:44:24.418719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T01:44:10.476054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T01:44:10.476054+0000","last_clean_scrub_stamp":"2024-04-25T01:44:10.476054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:07.684739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"30'209","reported_seq":245,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.406938+0000","last_change":"2024-04-25T01:44:15.027388+0000","last_active":"2024-04-25T01:44:24.406938+0000","last_peered":"2024-04-25T01:44:24.406938+0000","last_clean":"2024-04-25T01:44:24.406938+0000","last_became_active":"2024-04-25T01:39:33.444673+0000","last_became_peered":"2024-04-25T01:39:33.444673+0000","last_unstale":"2024-04-25T01:44:24.406938+0000","last_undegraded":"2024-04-25T01:44:24.406938+0000","last_fullsized":"2024-04-25T01:44:24.406938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'209","last_scrub_stamp":"2024-04-25T01:44:15.027277+0000","last_deep_scrub":"30'209","last_deep_scrub_stamp":"2024-04-25T01:44:15.027277+0000","last_clean_scrub_stamp":"2024-04-25T01:44:15.027277+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:04.451976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"31'4","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.670318+0000","last_change":"2024-04-25T01:43:59.990279+0000","last_active":"2024-04-25T01:44:24.670318+0000","last_peered":"2024-04-25T01:44:24.670318+0000","last_clean":"2024-04-25T01:44:24.670318+0000","last_became_active":"2024-04-25T01:39:23.372688+0000","last_became_peered":"2024-04-25T01:39:23.372688+0000","last_unstale":"2024-04-25T01:44:24.670318+0000","last_undegraded":"2024-04-25T01:44:24.670318+0000","last_fullsized":"2024-04-25T01:44:24.670318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-04-25T01:43:59.990129+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-04-25T01:43:59.990129+0000","last_clean_scrub_stamp":"2024-04-25T01:43:59.990129+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:43.228445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"30'158","reported_seq":203,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.412023+0000","last_change":"2024-04-25T01:44:00.771959+0000","last_active":"2024-04-25T01:44:24.412023+0000","last_peered":"2024-04-25T01:44:24.412023+0000","last_clean":"2024-04-25T01:44:24.412023+0000","last_became_active":"2024-04-25T01:39:24.387797+0000","last_became_peered":"2024-04-25T01:39:24.387797+0000","last_unstale":"2024-04-25T01:44:24.412023+0000","last_undegraded":"2024-04-25T01:44:24.412023+0000","last_fullsized":"2024-04-25T01:44:24.412023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'158","last_scrub_stamp":"2024-04-25T01:44:00.771742+0000","last_deep_scrub":"30'158","last_deep_scrub_stamp":"2024-04-25T01:44:00.771742+0000","last_clean_scrub_stamp":"2024-04-25T01:44:00.771742+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:58:58.719028+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"30'3","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.407756+0000","last_change":"2024-04-25T01:43:59.336785+0000","last_active":"2024-04-25T01:44:24.407756+0000","last_peered":"2024-04-25T01:44:24.407756+0000","last_clean":"2024-04-25T01:44:24.407756+0000","last_became_active":"2024-04-25T01:39:32.426626+0000","last_became_peered":"2024-04-25T01:39:32.426626+0000","last_unstale":"2024-04-25T01:44:24.407756+0000","last_undegraded":"2024-04-25T01:44:24.407756+0000","last_fullsized":"2024-04-25T01:44:24.407756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-04-25T01:43:59.336674+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-04-25T01:43:59.336674+0000","last_clean_scrub_stamp":"2024-04-25T01:43:59.336674+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:14:54.986133+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"30'170","reported_seq":206,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.412205+0000","last_change":"2024-04-25T01:44:14.246407+0000","last_active":"2024-04-25T01:44:24.412205+0000","last_peered":"2024-04-25T01:44:24.412205+0000","last_clean":"2024-04-25T01:44:24.412205+0000","last_became_active":"2024-04-25T01:39:33.445158+0000","last_became_peered":"2024-04-25T01:39:33.445158+0000","last_unstale":"2024-04-25T01:44:24.412205+0000","last_undegraded":"2024-04-25T01:44:24.412205+0000","last_fullsized":"2024-04-25T01:44:24.412205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'170","last_scrub_stamp":"2024-04-25T01:44:14.246280+0000","last_deep_scrub":"30'170","last_deep_scrub_stamp":"2024-04-25T01:44:14.246280+0000","last_clean_scrub_stamp":"2024-04-25T01:44:14.246280+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:24.942860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"31'1833","reported_seq":1882,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:32.016837+0000","last_change":"2024-04-25T01:44:09.468346+0000","last_active":"2024-04-25T01:44:32.016837+0000","last_peered":"2024-04-25T01:44:32.016837+0000","last_clean":"2024-04-25T01:44:32.016837+0000","last_became_active":"2024-04-25T01:39:23.371475+0000","last_became_peered":"2024-04-25T01:39:23.371475+0000","last_unstale":"2024-04-25T01:44:32.016837+0000","last_undegraded":"2024-04-25T01:44:32.016837+0000","last_fullsized":"2024-04-25T01:44:32.016837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1825","last_scrub_stamp":"2024-04-25T01:44:09.468232+0000","last_deep_scrub":"30'1825","last_deep_scrub_stamp":"2024-04-25T01:44:09.468232+0000","last_clean_scrub_stamp":"2024-04-25T01:44:09.468232+0000","objects_scrubbed":1,"log_size":1833,"log_dups_size":0,"ondisk_log_size":1833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:12:46.274766+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3815989,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":3717,"num_write":1829,"num_write_kb":5485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"30'150","reported_seq":195,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.410827+0000","last_change":"2024-04-25T01:44:03.227975+0000","last_active":"2024-04-25T01:44:24.410827+0000","last_peered":"2024-04-25T01:44:24.410827+0000","last_clean":"2024-04-25T01:44:24.410827+0000","last_became_active":"2024-04-25T01:39:24.387789+0000","last_became_peered":"2024-04-25T01:39:24.387789+0000","last_unstale":"2024-04-25T01:44:24.410827+0000","last_undegraded":"2024-04-25T01:44:24.410827+0000","last_fullsized":"2024-04-25T01:44:24.410827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'150","last_scrub_stamp":"2024-04-25T01:44:03.227822+0000","last_deep_scrub":"30'150","last_deep_scrub_stamp":"2024-04-25T01:44:03.227822+0000","last_clean_scrub_stamp":"2024-04-25T01:44:03.227822+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:51:10.185806+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.419410+0000","last_change":"2024-04-25T01:43:56.421467+0000","last_active":"2024-04-25T01:44:24.419410+0000","last_peered":"2024-04-25T01:44:24.419410+0000","last_clean":"2024-04-25T01:44:24.419410+0000","last_became_active":"2024-04-25T01:39:32.429361+0000","last_became_peered":"2024-04-25T01:39:32.429361+0000","last_unstale":"2024-04-25T01:44:24.419410+0000","last_undegraded":"2024-04-25T01:44:24.419410+0000","last_fullsized":"2024-04-25T01:44:24.419410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'6","last_scrub_stamp":"2024-04-25T01:43:56.421352+0000","last_deep_scrub":"30'6","last_deep_scrub_stamp":"2024-04-25T01:43:56.421352+0000","last_clean_scrub_stamp":"2024-04-25T01:43:56.421352+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:40:56.206033+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"30'221","reported_seq":258,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.420327+0000","last_change":"2024-04-25T01:44:06.435658+0000","last_active":"2024-04-25T01:44:24.420327+0000","last_peered":"2024-04-25T01:44:24.420327+0000","last_clean":"2024-04-25T01:44:24.420327+0000","last_became_active":"2024-04-25T01:39:33.426101+0000","last_became_peered":"2024-04-25T01:39:33.426101+0000","last_unstale":"2024-04-25T01:44:24.420327+0000","last_undegraded":"2024-04-25T01:44:24.420327+0000","last_fullsized":"2024-04-25T01:44:24.420327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'221","last_scrub_stamp":"2024-04-25T01:44:06.435482+0000","last_deep_scrub":"30'221","last_deep_scrub_stamp":"2024-04-25T01:44:06.435482+0000","last_clean_scrub_stamp":"2024-04-25T01:44:06.435482+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:33.943206+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"30'172","reported_seq":217,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.415259+0000","last_change":"2024-04-25T01:44:06.149873+0000","last_active":"2024-04-25T01:44:24.415259+0000","last_peered":"2024-04-25T01:44:24.415259+0000","last_clean":"2024-04-25T01:44:24.415259+0000","last_became_active":"2024-04-25T01:39:24.394816+0000","last_became_peered":"2024-04-25T01:39:24.394816+0000","last_unstale":"2024-04-25T01:44:24.415259+0000","last_undegraded":"2024-04-25T01:44:24.415259+0000","last_fullsized":"2024-04-25T01:44:24.415259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'172","last_scrub_stamp":"2024-04-25T01:44:06.149720+0000","last_deep_scrub":"30'172","last_deep_scrub_stamp":"2024-04-25T01:44:06.149720+0000","last_clean_scrub_stamp":"2024-04-25T01:44:06.149720+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:45:21.524509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"30'174","reported_seq":211,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.405487+0000","last_change":"2024-04-25T01:44:11.093090+0000","last_active":"2024-04-25T01:44:24.405487+0000","last_peered":"2024-04-25T01:44:24.405487+0000","last_clean":"2024-04-25T01:44:24.405487+0000","last_became_active":"2024-04-25T01:39:33.432266+0000","last_became_peered":"2024-04-25T01:39:33.432266+0000","last_unstale":"2024-04-25T01:44:24.405487+0000","last_undegraded":"2024-04-25T01:44:24.405487+0000","last_fullsized":"2024-04-25T01:44:24.405487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'174","last_scrub_stamp":"2024-04-25T01:44:11.092905+0000","last_deep_scrub":"30'174","last_deep_scrub_stamp":"2024-04-25T01:44:11.092905+0000","last_clean_scrub_stamp":"2024-04-25T01:44:11.092905+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:45.102307+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"30'158","reported_seq":208,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.407087+0000","last_change":"2024-04-25T01:44:09.322585+0000","last_active":"2024-04-25T01:44:24.407087+0000","last_peered":"2024-04-25T01:44:24.407087+0000","last_clean":"2024-04-25T01:44:24.407087+0000","last_became_active":"2024-04-25T01:40:06.450447+0000","last_became_peered":"2024-04-25T01:40:06.450447+0000","last_unstale":"2024-04-25T01:44:24.407087+0000","last_undegraded":"2024-04-25T01:44:24.407087+0000","last_fullsized":"2024-04-25T01:44:24.407087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'158","last_scrub_stamp":"2024-04-25T01:44:09.322470+0000","last_deep_scrub":"30'158","last_deep_scrub_stamp":"2024-04-25T01:44:09.322470+0000","last_clean_scrub_stamp":"2024-04-25T01:44:09.322470+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:36:14.273335+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"30'168","reported_seq":205,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.435068+0000","last_change":"2024-04-25T01:44:17.930492+0000","last_active":"2024-04-25T01:44:24.435068+0000","last_peered":"2024-04-25T01:44:24.435068+0000","last_clean":"2024-04-25T01:44:24.435068+0000","last_became_active":"2024-04-25T01:39:33.438811+0000","last_became_peered":"2024-04-25T01:39:33.438811+0000","last_unstale":"2024-04-25T01:44:24.435068+0000","last_undegraded":"2024-04-25T01:44:24.435068+0000","last_fullsized":"2024-04-25T01:44:24.435068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'168","last_scrub_stamp":"2024-04-25T01:44:17.930378+0000","last_deep_scrub":"30'168","last_deep_scrub_stamp":"2024-04-25T01:44:17.930378+0000","last_clean_scrub_stamp":"2024-04-25T01:44:17.930378+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:30:29.367211+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"30'143","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.435446+0000","last_change":"2024-04-25T01:43:55.741430+0000","last_active":"2024-04-25T01:44:24.435446+0000","last_peered":"2024-04-25T01:44:24.435446+0000","last_clean":"2024-04-25T01:44:24.435446+0000","last_became_active":"2024-04-25T01:39:24.399499+0000","last_became_peered":"2024-04-25T01:39:24.399499+0000","last_unstale":"2024-04-25T01:44:24.435446+0000","last_undegraded":"2024-04-25T01:44:24.435446+0000","last_fullsized":"2024-04-25T01:44:24.435446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'143","last_scrub_stamp":"2024-04-25T01:43:55.741303+0000","last_deep_scrub":"30'143","last_deep_scrub_stamp":"2024-04-25T01:43:55.741303+0000","last_clean_scrub_stamp":"2024-04-25T01:43:55.741303+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:02.676799+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":311296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"30'184","reported_seq":221,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.406873+0000","last_change":"2024-04-25T01:44:14.017371+0000","last_active":"2024-04-25T01:44:24.406873+0000","last_peered":"2024-04-25T01:44:24.406873+0000","last_clean":"2024-04-25T01:44:24.406873+0000","last_became_active":"2024-04-25T01:39:33.443796+0000","last_became_peered":"2024-04-25T01:39:33.443796+0000","last_unstale":"2024-04-25T01:44:24.406873+0000","last_undegraded":"2024-04-25T01:44:24.406873+0000","last_fullsized":"2024-04-25T01:44:24.406873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'184","last_scrub_stamp":"2024-04-25T01:44:14.017203+0000","last_deep_scrub":"30'184","last_deep_scrub_stamp":"2024-04-25T01:44:14.017203+0000","last_clean_scrub_stamp":"2024-04-25T01:44:14.017203+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:43.558981+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"30'124","reported_seq":169,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.411996+0000","last_change":"2024-04-25T01:44:04.733127+0000","last_active":"2024-04-25T01:44:24.411996+0000","last_peered":"2024-04-25T01:44:24.411996+0000","last_clean":"2024-04-25T01:44:24.411996+0000","last_became_active":"2024-04-25T01:39:24.390363+0000","last_became_peered":"2024-04-25T01:39:24.390363+0000","last_unstale":"2024-04-25T01:44:24.411996+0000","last_undegraded":"2024-04-25T01:44:24.411996+0000","last_fullsized":"2024-04-25T01:44:24.411996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'124","last_scrub_stamp":"2024-04-25T01:44:04.732945+0000","last_deep_scrub":"30'124","last_deep_scrub_stamp":"2024-04-25T01:44:04.732945+0000","last_clean_scrub_stamp":"2024-04-25T01:44:04.732945+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:47.799587+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"30'162","reported_seq":199,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.411768+0000","last_change":"2024-04-25T01:44:17.619873+0000","last_active":"2024-04-25T01:44:24.411768+0000","last_peered":"2024-04-25T01:44:24.411768+0000","last_clean":"2024-04-25T01:44:24.411768+0000","last_became_active":"2024-04-25T01:39:33.436131+0000","last_became_peered":"2024-04-25T01:39:33.436131+0000","last_unstale":"2024-04-25T01:44:24.411768+0000","last_undegraded":"2024-04-25T01:44:24.411768+0000","last_fullsized":"2024-04-25T01:44:24.411768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'162","last_scrub_stamp":"2024-04-25T01:44:17.619746+0000","last_deep_scrub":"30'162","last_deep_scrub_stamp":"2024-04-25T01:44:17.619746+0000","last_clean_scrub_stamp":"2024-04-25T01:44:17.619746+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:41:52.838499+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"30'148","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.420323+0000","last_change":"2024-04-25T01:44:15.389961+0000","last_active":"2024-04-25T01:44:24.420323+0000","last_peered":"2024-04-25T01:44:24.420323+0000","last_clean":"2024-04-25T01:44:24.420323+0000","last_became_active":"2024-04-25T01:39:24.389375+0000","last_became_peered":"2024-04-25T01:39:24.389375+0000","last_unstale":"2024-04-25T01:44:24.420323+0000","last_undegraded":"2024-04-25T01:44:24.420323+0000","last_fullsized":"2024-04-25T01:44:24.420323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'148","last_scrub_stamp":"2024-04-25T01:44:15.389806+0000","last_deep_scrub":"30'148","last_deep_scrub_stamp":"2024-04-25T01:44:15.389806+0000","last_clean_scrub_stamp":"2024-04-25T01:44:15.389806+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:06.011895+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"30'141","reported_seq":178,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.412722+0000","last_change":"2024-04-25T01:44:16.229473+0000","last_active":"2024-04-25T01:44:24.412722+0000","last_peered":"2024-04-25T01:44:24.412722+0000","last_clean":"2024-04-25T01:44:24.412722+0000","last_became_active":"2024-04-25T01:39:33.447588+0000","last_became_peered":"2024-04-25T01:39:33.447588+0000","last_unstale":"2024-04-25T01:44:24.412722+0000","last_undegraded":"2024-04-25T01:44:24.412722+0000","last_fullsized":"2024-04-25T01:44:24.412722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'141","last_scrub_stamp":"2024-04-25T01:44:16.229348+0000","last_deep_scrub":"30'141","last_deep_scrub_stamp":"2024-04-25T01:44:16.229348+0000","last_clean_scrub_stamp":"2024-04-25T01:44:16.229348+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:22:02.888376+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"30'156","reported_seq":201,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.407387+0000","last_change":"2024-04-25T01:44:08.112285+0000","last_active":"2024-04-25T01:44:24.407387+0000","last_peered":"2024-04-25T01:44:24.407387+0000","last_clean":"2024-04-25T01:44:24.407387+0000","last_became_active":"2024-04-25T01:39:24.373731+0000","last_became_peered":"2024-04-25T01:39:24.373731+0000","last_unstale":"2024-04-25T01:44:24.407387+0000","last_undegraded":"2024-04-25T01:44:24.407387+0000","last_fullsized":"2024-04-25T01:44:24.407387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'156","last_scrub_stamp":"2024-04-25T01:44:08.112186+0000","last_deep_scrub":"30'156","last_deep_scrub_stamp":"2024-04-25T01:44:08.112186+0000","last_clean_scrub_stamp":"2024-04-25T01:44:08.112186+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:44:37.020861+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"30'188","reported_seq":225,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.410050+0000","last_change":"2024-04-25T01:44:22.583345+0000","last_active":"2024-04-25T01:44:24.410050+0000","last_peered":"2024-04-25T01:44:24.410050+0000","last_clean":"2024-04-25T01:44:24.410050+0000","last_became_active":"2024-04-25T01:39:33.446652+0000","last_became_peered":"2024-04-25T01:39:33.446652+0000","last_unstale":"2024-04-25T01:44:24.410050+0000","last_undegraded":"2024-04-25T01:44:24.410050+0000","last_fullsized":"2024-04-25T01:44:24.410050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'188","last_scrub_stamp":"2024-04-25T01:44:22.583209+0000","last_deep_scrub":"30'188","last_deep_scrub_stamp":"2024-04-25T01:44:22.583209+0000","last_clean_scrub_stamp":"2024-04-25T01:44:22.583209+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:09.486351+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"30'224","reported_seq":269,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.416438+0000","last_change":"2024-04-25T01:43:58.017412+0000","last_active":"2024-04-25T01:44:24.416438+0000","last_peered":"2024-04-25T01:44:24.416438+0000","last_clean":"2024-04-25T01:44:24.416438+0000","last_became_active":"2024-04-25T01:39:24.398299+0000","last_became_peered":"2024-04-25T01:39:24.398299+0000","last_unstale":"2024-04-25T01:44:24.416438+0000","last_undegraded":"2024-04-25T01:44:24.416438+0000","last_fullsized":"2024-04-25T01:44:24.416438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'224","last_scrub_stamp":"2024-04-25T01:43:58.017263+0000","last_deep_scrub":"30'224","last_deep_scrub_stamp":"2024-04-25T01:43:58.017263+0000","last_clean_scrub_stamp":"2024-04-25T01:43:58.017263+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:44.739129+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":516096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"30'167","reported_seq":204,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.415297+0000","last_change":"2024-04-25T01:44:11.172011+0000","last_active":"2024-04-25T01:44:24.415297+0000","last_peered":"2024-04-25T01:44:24.415297+0000","last_clean":"2024-04-25T01:44:24.415297+0000","last_became_active":"2024-04-25T01:39:33.441104+0000","last_became_peered":"2024-04-25T01:39:33.441104+0000","last_unstale":"2024-04-25T01:44:24.415297+0000","last_undegraded":"2024-04-25T01:44:24.415297+0000","last_fullsized":"2024-04-25T01:44:24.415297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'167","last_scrub_stamp":"2024-04-25T01:44:11.171834+0000","last_deep_scrub":"30'167","last_deep_scrub_stamp":"2024-04-25T01:44:11.171834+0000","last_clean_scrub_stamp":"2024-04-25T01:44:11.171834+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:37:48.456453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"30'161","reported_seq":206,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.419249+0000","last_change":"2024-04-25T01:44:07.477306+0000","last_active":"2024-04-25T01:44:24.419249+0000","last_peered":"2024-04-25T01:44:24.419249+0000","last_clean":"2024-04-25T01:44:24.419249+0000","last_became_active":"2024-04-25T01:39:24.389809+0000","last_became_peered":"2024-04-25T01:39:24.389809+0000","last_unstale":"2024-04-25T01:44:24.419249+0000","last_undegraded":"2024-04-25T01:44:24.419249+0000","last_fullsized":"2024-04-25T01:44:24.419249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'161","last_scrub_stamp":"2024-04-25T01:44:07.477198+0000","last_deep_scrub":"30'161","last_deep_scrub_stamp":"2024-04-25T01:44:07.477198+0000","last_clean_scrub_stamp":"2024-04-25T01:44:07.477198+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:22:21.595744+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"30'188","reported_seq":225,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.419826+0000","last_change":"2024-04-25T01:44:16.394876+0000","last_active":"2024-04-25T01:44:24.419826+0000","last_peered":"2024-04-25T01:44:24.419826+0000","last_clean":"2024-04-25T01:44:24.419826+0000","last_became_active":"2024-04-25T01:39:33.426056+0000","last_became_peered":"2024-04-25T01:39:33.426056+0000","last_unstale":"2024-04-25T01:44:24.419826+0000","last_undegraded":"2024-04-25T01:44:24.419826+0000","last_fullsized":"2024-04-25T01:44:24.419826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'188","last_scrub_stamp":"2024-04-25T01:44:16.394769+0000","last_deep_scrub":"30'188","last_deep_scrub_stamp":"2024-04-25T01:44:16.394769+0000","last_clean_scrub_stamp":"2024-04-25T01:44:16.394769+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:58:00.369940+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"30'220","reported_seq":265,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.435045+0000","last_change":"2024-04-25T01:44:13.007679+0000","last_active":"2024-04-25T01:44:24.435045+0000","last_peered":"2024-04-25T01:44:24.435045+0000","last_clean":"2024-04-25T01:44:24.435045+0000","last_became_active":"2024-04-25T01:39:24.386809+0000","last_became_peered":"2024-04-25T01:39:24.386809+0000","last_unstale":"2024-04-25T01:44:24.435045+0000","last_undegraded":"2024-04-25T01:44:24.435045+0000","last_fullsized":"2024-04-25T01:44:24.435045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'220","last_scrub_stamp":"2024-04-25T01:44:13.007517+0000","last_deep_scrub":"30'220","last_deep_scrub_stamp":"2024-04-25T01:44:13.007517+0000","last_clean_scrub_stamp":"2024-04-25T01:44:13.007517+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:42.570944+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"30'189","reported_seq":226,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.414077+0000","last_change":"2024-04-25T01:44:15.531213+0000","last_active":"2024-04-25T01:44:24.414077+0000","last_peered":"2024-04-25T01:44:24.414077+0000","last_clean":"2024-04-25T01:44:24.414077+0000","last_became_active":"2024-04-25T01:39:33.436017+0000","last_became_peered":"2024-04-25T01:39:33.436017+0000","last_unstale":"2024-04-25T01:44:24.414077+0000","last_undegraded":"2024-04-25T01:44:24.414077+0000","last_fullsized":"2024-04-25T01:44:24.414077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'189","last_scrub_stamp":"2024-04-25T01:44:15.531094+0000","last_deep_scrub":"30'189","last_deep_scrub_stamp":"2024-04-25T01:44:15.531094+0000","last_clean_scrub_stamp":"2024-04-25T01:44:15.531094+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:56.277424+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"30'149","reported_seq":194,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.418698+0000","last_change":"2024-04-25T01:44:14.431853+0000","last_active":"2024-04-25T01:44:24.418698+0000","last_peered":"2024-04-25T01:44:24.418698+0000","last_clean":"2024-04-25T01:44:24.418698+0000","last_became_active":"2024-04-25T01:39:24.388793+0000","last_became_peered":"2024-04-25T01:39:24.388793+0000","last_unstale":"2024-04-25T01:44:24.418698+0000","last_undegraded":"2024-04-25T01:44:24.418698+0000","last_fullsized":"2024-04-25T01:44:24.418698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'149","last_scrub_stamp":"2024-04-25T01:44:14.431704+0000","last_deep_scrub":"30'149","last_deep_scrub_stamp":"2024-04-25T01:44:14.431704+0000","last_clean_scrub_stamp":"2024-04-25T01:44:14.431704+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:42:34.830506+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"30'196","reported_seq":233,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.407288+0000","last_change":"2024-04-25T01:44:04.308534+0000","last_active":"2024-04-25T01:44:24.407288+0000","last_peered":"2024-04-25T01:44:24.407288+0000","last_clean":"2024-04-25T01:44:24.407288+0000","last_became_active":"2024-04-25T01:39:33.440760+0000","last_became_peered":"2024-04-25T01:39:33.440760+0000","last_unstale":"2024-04-25T01:44:24.407288+0000","last_undegraded":"2024-04-25T01:44:24.407288+0000","last_fullsized":"2024-04-25T01:44:24.407288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'196","last_scrub_stamp":"2024-04-25T01:44:04.308408+0000","last_deep_scrub":"30'196","last_deep_scrub_stamp":"2024-04-25T01:44:04.308408+0000","last_clean_scrub_stamp":"2024-04-25T01:44:04.308408+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:04:04.433641+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"30'194","reported_seq":239,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.434987+0000","last_change":"2024-04-25T01:44:15.001453+0000","last_active":"2024-04-25T01:44:24.434987+0000","last_peered":"2024-04-25T01:44:24.434987+0000","last_clean":"2024-04-25T01:44:24.434987+0000","last_became_active":"2024-04-25T01:39:24.390591+0000","last_became_peered":"2024-04-25T01:39:24.390591+0000","last_unstale":"2024-04-25T01:44:24.434987+0000","last_undegraded":"2024-04-25T01:44:24.434987+0000","last_fullsized":"2024-04-25T01:44:24.434987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'194","last_scrub_stamp":"2024-04-25T01:44:15.001281+0000","last_deep_scrub":"30'194","last_deep_scrub_stamp":"2024-04-25T01:44:15.001281+0000","last_clean_scrub_stamp":"2024-04-25T01:44:15.001281+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:52.493067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"30'233","reported_seq":270,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.418696+0000","last_change":"2024-04-25T01:44:20.409734+0000","last_active":"2024-04-25T01:44:24.418696+0000","last_peered":"2024-04-25T01:44:24.418696+0000","last_clean":"2024-04-25T01:44:24.418696+0000","last_became_active":"2024-04-25T01:39:33.429158+0000","last_became_peered":"2024-04-25T01:39:33.429158+0000","last_unstale":"2024-04-25T01:44:24.418696+0000","last_undegraded":"2024-04-25T01:44:24.418696+0000","last_fullsized":"2024-04-25T01:44:24.418696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'233","last_scrub_stamp":"2024-04-25T01:44:20.409601+0000","last_deep_scrub":"30'233","last_deep_scrub_stamp":"2024-04-25T01:44:20.409601+0000","last_clean_scrub_stamp":"2024-04-25T01:44:20.409601+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:10:57.656251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"30'168","reported_seq":213,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.411541+0000","last_change":"2024-04-25T01:44:02.738292+0000","last_active":"2024-04-25T01:44:24.411541+0000","last_peered":"2024-04-25T01:44:24.411541+0000","last_clean":"2024-04-25T01:44:24.411541+0000","last_became_active":"2024-04-25T01:39:24.388619+0000","last_became_peered":"2024-04-25T01:39:24.388619+0000","last_unstale":"2024-04-25T01:44:24.411541+0000","last_undegraded":"2024-04-25T01:44:24.411541+0000","last_fullsized":"2024-04-25T01:44:24.411541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'168","last_scrub_stamp":"2024-04-25T01:44:02.738120+0000","last_deep_scrub":"30'168","last_deep_scrub_stamp":"2024-04-25T01:44:02.738120+0000","last_clean_scrub_stamp":"2024-04-25T01:44:02.738120+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:16:06.111704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"30'215","reported_seq":252,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.410621+0000","last_change":"2024-04-25T01:44:09.331411+0000","last_active":"2024-04-25T01:44:24.410621+0000","last_peered":"2024-04-25T01:44:24.410621+0000","last_clean":"2024-04-25T01:44:24.410621+0000","last_became_active":"2024-04-25T01:39:33.443257+0000","last_became_peered":"2024-04-25T01:39:33.443257+0000","last_unstale":"2024-04-25T01:44:24.410621+0000","last_undegraded":"2024-04-25T01:44:24.410621+0000","last_fullsized":"2024-04-25T01:44:24.410621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'215","last_scrub_stamp":"2024-04-25T01:44:09.331282+0000","last_deep_scrub":"30'215","last_deep_scrub_stamp":"2024-04-25T01:44:09.331282+0000","last_clean_scrub_stamp":"2024-04-25T01:44:09.331282+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:59:44.226490+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"30'188","reported_seq":233,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.415519+0000","last_change":"2024-04-25T01:44:05.105991+0000","last_active":"2024-04-25T01:44:24.415519+0000","last_peered":"2024-04-25T01:44:24.415519+0000","last_clean":"2024-04-25T01:44:24.415519+0000","last_became_active":"2024-04-25T01:39:24.394784+0000","last_became_peered":"2024-04-25T01:39:24.394784+0000","last_unstale":"2024-04-25T01:44:24.415519+0000","last_undegraded":"2024-04-25T01:44:24.415519+0000","last_fullsized":"2024-04-25T01:44:24.415519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'188","last_scrub_stamp":"2024-04-25T01:44:05.105868+0000","last_deep_scrub":"30'188","last_deep_scrub_stamp":"2024-04-25T01:44:05.105868+0000","last_clean_scrub_stamp":"2024-04-25T01:44:05.105868+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:03.686825+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"30'159","reported_seq":196,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.412694+0000","last_change":"2024-04-25T01:44:13.281105+0000","last_active":"2024-04-25T01:44:24.412694+0000","last_peered":"2024-04-25T01:44:24.412694+0000","last_clean":"2024-04-25T01:44:24.412694+0000","last_became_active":"2024-04-25T01:39:33.445949+0000","last_became_peered":"2024-04-25T01:39:33.445949+0000","last_unstale":"2024-04-25T01:44:24.412694+0000","last_undegraded":"2024-04-25T01:44:24.412694+0000","last_fullsized":"2024-04-25T01:44:24.412694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'159","last_scrub_stamp":"2024-04-25T01:44:13.280989+0000","last_deep_scrub":"30'159","last_deep_scrub_stamp":"2024-04-25T01:44:13.280989+0000","last_clean_scrub_stamp":"2024-04-25T01:44:13.280989+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:21:16.036513+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"30'196","reported_seq":241,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.413738+0000","last_change":"2024-04-25T01:44:06.573734+0000","last_active":"2024-04-25T01:44:24.413738+0000","last_peered":"2024-04-25T01:44:24.413738+0000","last_clean":"2024-04-25T01:44:24.413738+0000","last_became_active":"2024-04-25T01:39:24.379591+0000","last_became_peered":"2024-04-25T01:39:24.379591+0000","last_unstale":"2024-04-25T01:44:24.413738+0000","last_undegraded":"2024-04-25T01:44:24.413738+0000","last_fullsized":"2024-04-25T01:44:24.413738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'196","last_scrub_stamp":"2024-04-25T01:44:06.573550+0000","last_deep_scrub":"30'196","last_deep_scrub_stamp":"2024-04-25T01:44:06.573550+0000","last_clean_scrub_stamp":"2024-04-25T01:44:06.573550+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:07.137212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"30'233","reported_seq":270,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.434591+0000","last_change":"2024-04-25T01:44:18.903238+0000","last_active":"2024-04-25T01:44:24.434591+0000","last_peered":"2024-04-25T01:44:24.434591+0000","last_clean":"2024-04-25T01:44:24.434591+0000","last_became_active":"2024-04-25T01:39:33.439424+0000","last_became_peered":"2024-04-25T01:39:33.439424+0000","last_unstale":"2024-04-25T01:44:24.434591+0000","last_undegraded":"2024-04-25T01:44:24.434591+0000","last_fullsized":"2024-04-25T01:44:24.434591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'233","last_scrub_stamp":"2024-04-25T01:44:18.903099+0000","last_deep_scrub":"30'233","last_deep_scrub_stamp":"2024-04-25T01:44:18.903099+0000","last_clean_scrub_stamp":"2024-04-25T01:44:18.903099+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:29:02.942677+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"30'179","reported_seq":224,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.408540+0000","last_change":"2024-04-25T01:43:58.331752+0000","last_active":"2024-04-25T01:44:24.408540+0000","last_peered":"2024-04-25T01:44:24.408540+0000","last_clean":"2024-04-25T01:44:24.408540+0000","last_became_active":"2024-04-25T01:39:24.392605+0000","last_became_peered":"2024-04-25T01:39:24.392605+0000","last_unstale":"2024-04-25T01:44:24.408540+0000","last_undegraded":"2024-04-25T01:44:24.408540+0000","last_fullsized":"2024-04-25T01:44:24.408540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'179","last_scrub_stamp":"2024-04-25T01:43:58.331586+0000","last_deep_scrub":"30'179","last_deep_scrub_stamp":"2024-04-25T01:43:58.331586+0000","last_clean_scrub_stamp":"2024-04-25T01:43:58.331586+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:02:30.792195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"30'166","reported_seq":203,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.410853+0000","last_change":"2024-04-25T01:44:09.605991+0000","last_active":"2024-04-25T01:44:24.410853+0000","last_peered":"2024-04-25T01:44:24.410853+0000","last_clean":"2024-04-25T01:44:24.410853+0000","last_became_active":"2024-04-25T01:39:33.437795+0000","last_became_peered":"2024-04-25T01:39:33.437795+0000","last_unstale":"2024-04-25T01:44:24.410853+0000","last_undegraded":"2024-04-25T01:44:24.410853+0000","last_fullsized":"2024-04-25T01:44:24.410853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'166","last_scrub_stamp":"2024-04-25T01:44:09.605841+0000","last_deep_scrub":"30'166","last_deep_scrub_stamp":"2024-04-25T01:44:09.605841+0000","last_clean_scrub_stamp":"2024-04-25T01:44:09.605841+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:29.588591+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"30'199","reported_seq":244,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.437194+0000","last_change":"2024-04-25T01:44:06.882503+0000","last_active":"2024-04-25T01:44:24.437194+0000","last_peered":"2024-04-25T01:44:24.437194+0000","last_clean":"2024-04-25T01:44:24.437194+0000","last_became_active":"2024-04-25T01:39:24.390978+0000","last_became_peered":"2024-04-25T01:39:24.390978+0000","last_unstale":"2024-04-25T01:44:24.437194+0000","last_undegraded":"2024-04-25T01:44:24.437194+0000","last_fullsized":"2024-04-25T01:44:24.437194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'199","last_scrub_stamp":"2024-04-25T01:44:06.882378+0000","last_deep_scrub":"30'199","last_deep_scrub_stamp":"2024-04-25T01:44:06.882378+0000","last_clean_scrub_stamp":"2024-04-25T01:44:06.882378+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:54.683563+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"30'197","reported_seq":234,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.405530+0000","last_change":"2024-04-25T01:44:10.096851+0000","last_active":"2024-04-25T01:44:24.405530+0000","last_peered":"2024-04-25T01:44:24.405530+0000","last_clean":"2024-04-25T01:44:24.405530+0000","last_became_active":"2024-04-25T01:39:33.430982+0000","last_became_peered":"2024-04-25T01:39:33.430982+0000","last_unstale":"2024-04-25T01:44:24.405530+0000","last_undegraded":"2024-04-25T01:44:24.405530+0000","last_fullsized":"2024-04-25T01:44:24.405530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'197","last_scrub_stamp":"2024-04-25T01:44:10.096746+0000","last_deep_scrub":"30'197","last_deep_scrub_stamp":"2024-04-25T01:44:10.096746+0000","last_clean_scrub_stamp":"2024-04-25T01:44:10.096746+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:42:33.919070+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"30'161","reported_seq":206,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.434862+0000","last_change":"2024-04-25T01:43:54.716946+0000","last_active":"2024-04-25T01:44:24.434862+0000","last_peered":"2024-04-25T01:44:24.434862+0000","last_clean":"2024-04-25T01:44:24.434862+0000","last_became_active":"2024-04-25T01:39:24.399011+0000","last_became_peered":"2024-04-25T01:39:24.399011+0000","last_unstale":"2024-04-25T01:44:24.434862+0000","last_undegraded":"2024-04-25T01:44:24.434862+0000","last_fullsized":"2024-04-25T01:44:24.434862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'161","last_scrub_stamp":"2024-04-25T01:43:54.716825+0000","last_deep_scrub":"30'161","last_deep_scrub_stamp":"2024-04-25T01:43:54.716825+0000","last_clean_scrub_stamp":"2024-04-25T01:43:54.716825+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:36.557149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"30'187","reported_seq":224,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.411405+0000","last_change":"2024-04-25T01:44:10.318255+0000","last_active":"2024-04-25T01:44:24.411405+0000","last_peered":"2024-04-25T01:44:24.411405+0000","last_clean":"2024-04-25T01:44:24.411405+0000","last_became_active":"2024-04-25T01:39:33.443608+0000","last_became_peered":"2024-04-25T01:39:33.443608+0000","last_unstale":"2024-04-25T01:44:24.411405+0000","last_undegraded":"2024-04-25T01:44:24.411405+0000","last_fullsized":"2024-04-25T01:44:24.411405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'187","last_scrub_stamp":"2024-04-25T01:44:10.318137+0000","last_deep_scrub":"30'187","last_deep_scrub_stamp":"2024-04-25T01:44:10.318137+0000","last_clean_scrub_stamp":"2024-04-25T01:44:10.318137+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:22:56.984594+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"30'178","reported_seq":223,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.405467+0000","last_change":"2024-04-25T01:43:55.212398+0000","last_active":"2024-04-25T01:44:24.405467+0000","last_peered":"2024-04-25T01:44:24.405467+0000","last_clean":"2024-04-25T01:44:24.405467+0000","last_became_active":"2024-04-25T01:39:24.388690+0000","last_became_peered":"2024-04-25T01:39:24.388690+0000","last_unstale":"2024-04-25T01:44:24.405467+0000","last_undegraded":"2024-04-25T01:44:24.405467+0000","last_fullsized":"2024-04-25T01:44:24.405467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'178","last_scrub_stamp":"2024-04-25T01:43:55.212286+0000","last_deep_scrub":"30'178","last_deep_scrub_stamp":"2024-04-25T01:43:55.212286+0000","last_clean_scrub_stamp":"2024-04-25T01:43:55.212286+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:49.318102+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"30'175","reported_seq":212,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.434961+0000","last_change":"2024-04-25T01:44:15.985659+0000","last_active":"2024-04-25T01:44:24.434961+0000","last_peered":"2024-04-25T01:44:24.434961+0000","last_clean":"2024-04-25T01:44:24.434961+0000","last_became_active":"2024-04-25T01:39:33.436581+0000","last_became_peered":"2024-04-25T01:39:33.436581+0000","last_unstale":"2024-04-25T01:44:24.434961+0000","last_undegraded":"2024-04-25T01:44:24.434961+0000","last_fullsized":"2024-04-25T01:44:24.434961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'175","last_scrub_stamp":"2024-04-25T01:44:15.985527+0000","last_deep_scrub":"30'175","last_deep_scrub_stamp":"2024-04-25T01:44:15.985527+0000","last_clean_scrub_stamp":"2024-04-25T01:44:15.985527+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:34:13.960449+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"30'181","reported_seq":226,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.411004+0000","last_change":"2024-04-25T01:44:03.739284+0000","last_active":"2024-04-25T01:44:24.411004+0000","last_peered":"2024-04-25T01:44:24.411004+0000","last_clean":"2024-04-25T01:44:24.411004+0000","last_became_active":"2024-04-25T01:39:24.389254+0000","last_became_peered":"2024-04-25T01:39:24.389254+0000","last_unstale":"2024-04-25T01:44:24.411004+0000","last_undegraded":"2024-04-25T01:44:24.411004+0000","last_fullsized":"2024-04-25T01:44:24.411004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'181","last_scrub_stamp":"2024-04-25T01:44:03.739156+0000","last_deep_scrub":"30'181","last_deep_scrub_stamp":"2024-04-25T01:44:03.739156+0000","last_clean_scrub_stamp":"2024-04-25T01:44:03.739156+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:45:47.919671+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"30'237","reported_seq":274,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.411943+0000","last_change":"2024-04-25T01:44:01.538666+0000","last_active":"2024-04-25T01:44:24.411943+0000","last_peered":"2024-04-25T01:44:24.411943+0000","last_clean":"2024-04-25T01:44:24.411943+0000","last_became_active":"2024-04-25T01:39:33.433577+0000","last_became_peered":"2024-04-25T01:39:33.433577+0000","last_unstale":"2024-04-25T01:44:24.411943+0000","last_undegraded":"2024-04-25T01:44:24.411943+0000","last_fullsized":"2024-04-25T01:44:24.411943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'237","last_scrub_stamp":"2024-04-25T01:44:01.538514+0000","last_deep_scrub":"30'237","last_deep_scrub_stamp":"2024-04-25T01:44:01.538514+0000","last_clean_scrub_stamp":"2024-04-25T01:44:01.538514+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:42:59.494783+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"30'187","reported_seq":232,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.419028+0000","last_change":"2024-04-25T01:44:05.440951+0000","last_active":"2024-04-25T01:44:24.419028+0000","last_peered":"2024-04-25T01:44:24.419028+0000","last_clean":"2024-04-25T01:44:24.419028+0000","last_became_active":"2024-04-25T01:39:24.391352+0000","last_became_peered":"2024-04-25T01:39:24.391352+0000","last_unstale":"2024-04-25T01:44:24.419028+0000","last_undegraded":"2024-04-25T01:44:24.419028+0000","last_fullsized":"2024-04-25T01:44:24.419028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'187","last_scrub_stamp":"2024-04-25T01:44:05.440790+0000","last_deep_scrub":"30'187","last_deep_scrub_stamp":"2024-04-25T01:44:05.440790+0000","last_clean_scrub_stamp":"2024-04-25T01:44:05.440790+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:17:40.666618+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"30'186","reported_seq":223,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.418687+0000","last_change":"2024-04-25T01:44:21.451728+0000","last_active":"2024-04-25T01:44:24.418687+0000","last_peered":"2024-04-25T01:44:24.418687+0000","last_clean":"2024-04-25T01:44:24.418687+0000","last_became_active":"2024-04-25T01:39:33.436389+0000","last_became_peered":"2024-04-25T01:39:33.436389+0000","last_unstale":"2024-04-25T01:44:24.418687+0000","last_undegraded":"2024-04-25T01:44:24.418687+0000","last_fullsized":"2024-04-25T01:44:24.418687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'186","last_scrub_stamp":"2024-04-25T01:44:21.451633+0000","last_deep_scrub":"30'186","last_deep_scrub_stamp":"2024-04-25T01:44:21.451633+0000","last_clean_scrub_stamp":"2024-04-25T01:44:21.451633+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:16.655140+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"30'169","reported_seq":214,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.413126+0000","last_change":"2024-04-25T01:44:06.289707+0000","last_active":"2024-04-25T01:44:24.413126+0000","last_peered":"2024-04-25T01:44:24.413126+0000","last_clean":"2024-04-25T01:44:24.413126+0000","last_became_active":"2024-04-25T01:39:24.396023+0000","last_became_peered":"2024-04-25T01:39:24.396023+0000","last_unstale":"2024-04-25T01:44:24.413126+0000","last_undegraded":"2024-04-25T01:44:24.413126+0000","last_fullsized":"2024-04-25T01:44:24.413126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'169","last_scrub_stamp":"2024-04-25T01:44:06.289589+0000","last_deep_scrub":"30'169","last_deep_scrub_stamp":"2024-04-25T01:44:06.289589+0000","last_clean_scrub_stamp":"2024-04-25T01:44:06.289589+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:21.571404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"30'186","reported_seq":223,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.407676+0000","last_change":"2024-04-25T01:44:05.292355+0000","last_active":"2024-04-25T01:44:24.407676+0000","last_peered":"2024-04-25T01:44:24.407676+0000","last_clean":"2024-04-25T01:44:24.407676+0000","last_became_active":"2024-04-25T01:39:33.443163+0000","last_became_peered":"2024-04-25T01:39:33.443163+0000","last_unstale":"2024-04-25T01:44:24.407676+0000","last_undegraded":"2024-04-25T01:44:24.407676+0000","last_fullsized":"2024-04-25T01:44:24.407676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'186","last_scrub_stamp":"2024-04-25T01:44:05.292231+0000","last_deep_scrub":"30'186","last_deep_scrub_stamp":"2024-04-25T01:44:05.292231+0000","last_clean_scrub_stamp":"2024-04-25T01:44:05.292231+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:18:15.632592+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"30'212","reported_seq":257,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.415790+0000","last_change":"2024-04-25T01:43:55.105989+0000","last_active":"2024-04-25T01:44:24.415790+0000","last_peered":"2024-04-25T01:44:24.415790+0000","last_clean":"2024-04-25T01:44:24.415790+0000","last_became_active":"2024-04-25T01:39:24.403700+0000","last_became_peered":"2024-04-25T01:39:24.403700+0000","last_unstale":"2024-04-25T01:44:24.415790+0000","last_undegraded":"2024-04-25T01:44:24.415790+0000","last_fullsized":"2024-04-25T01:44:24.415790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'212","last_scrub_stamp":"2024-04-25T01:43:55.105868+0000","last_deep_scrub":"30'212","last_deep_scrub_stamp":"2024-04-25T01:43:55.105868+0000","last_clean_scrub_stamp":"2024-04-25T01:43:55.105868+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:40.542257+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":491520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"30'177","reported_seq":214,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.410947+0000","last_change":"2024-04-25T01:44:03.535742+0000","last_active":"2024-04-25T01:44:24.410947+0000","last_peered":"2024-04-25T01:44:24.410947+0000","last_clean":"2024-04-25T01:44:24.410947+0000","last_became_active":"2024-04-25T01:39:33.434446+0000","last_became_peered":"2024-04-25T01:39:33.434446+0000","last_unstale":"2024-04-25T01:44:24.410947+0000","last_undegraded":"2024-04-25T01:44:24.410947+0000","last_fullsized":"2024-04-25T01:44:24.410947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'177","last_scrub_stamp":"2024-04-25T01:44:03.535611+0000","last_deep_scrub":"30'177","last_deep_scrub_stamp":"2024-04-25T01:44:03.535611+0000","last_clean_scrub_stamp":"2024-04-25T01:44:03.535611+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:12:29.106608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"30'183","reported_seq":233,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.416423+0000","last_change":"2024-04-25T01:44:14.196143+0000","last_active":"2024-04-25T01:44:24.416423+0000","last_peered":"2024-04-25T01:44:24.416423+0000","last_clean":"2024-04-25T01:44:24.416423+0000","last_became_active":"2024-04-25T01:40:05.558954+0000","last_became_peered":"2024-04-25T01:40:05.558954+0000","last_unstale":"2024-04-25T01:44:24.416423+0000","last_undegraded":"2024-04-25T01:44:24.416423+0000","last_fullsized":"2024-04-25T01:44:24.416423+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'183","last_scrub_stamp":"2024-04-25T01:44:14.196027+0000","last_deep_scrub":"30'183","last_deep_scrub_stamp":"2024-04-25T01:44:14.196027+0000","last_clean_scrub_stamp":"2024-04-25T01:44:14.196027+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:03.282513+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"30'191","reported_seq":228,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.434759+0000","last_change":"2024-04-25T01:44:03.924649+0000","last_active":"2024-04-25T01:44:24.434759+0000","last_peered":"2024-04-25T01:44:24.434759+0000","last_clean":"2024-04-25T01:44:24.434759+0000","last_became_active":"2024-04-25T01:39:33.436193+0000","last_became_peered":"2024-04-25T01:39:33.436193+0000","last_unstale":"2024-04-25T01:44:24.434759+0000","last_undegraded":"2024-04-25T01:44:24.434759+0000","last_fullsized":"2024-04-25T01:44:24.434759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'191","last_scrub_stamp":"2024-04-25T01:44:03.924530+0000","last_deep_scrub":"30'191","last_deep_scrub_stamp":"2024-04-25T01:44:03.924530+0000","last_clean_scrub_stamp":"2024-04-25T01:44:03.924530+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:58:37.445651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"30'179","reported_seq":224,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.414371+0000","last_change":"2024-04-25T01:43:55.522282+0000","last_active":"2024-04-25T01:44:24.414371+0000","last_peered":"2024-04-25T01:44:24.414371+0000","last_clean":"2024-04-25T01:44:24.414371+0000","last_became_active":"2024-04-25T01:39:24.392836+0000","last_became_peered":"2024-04-25T01:39:24.392836+0000","last_unstale":"2024-04-25T01:44:24.414371+0000","last_undegraded":"2024-04-25T01:44:24.414371+0000","last_fullsized":"2024-04-25T01:44:24.414371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'179","last_scrub_stamp":"2024-04-25T01:43:55.522128+0000","last_deep_scrub":"30'179","last_deep_scrub_stamp":"2024-04-25T01:43:55.522128+0000","last_clean_scrub_stamp":"2024-04-25T01:43:55.522128+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:31.871799+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"30'168","reported_seq":205,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.419760+0000","last_change":"2024-04-25T01:44:22.451554+0000","last_active":"2024-04-25T01:44:24.419760+0000","last_peered":"2024-04-25T01:44:24.419760+0000","last_clean":"2024-04-25T01:44:24.419760+0000","last_became_active":"2024-04-25T01:39:33.439878+0000","last_became_peered":"2024-04-25T01:39:33.439878+0000","last_unstale":"2024-04-25T01:44:24.419760+0000","last_undegraded":"2024-04-25T01:44:24.419760+0000","last_fullsized":"2024-04-25T01:44:24.419760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'168","last_scrub_stamp":"2024-04-25T01:44:22.451402+0000","last_deep_scrub":"30'168","last_deep_scrub_stamp":"2024-04-25T01:44:22.451402+0000","last_clean_scrub_stamp":"2024-04-25T01:44:22.451402+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:27.851650+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"30'207","reported_seq":252,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.418788+0000","last_change":"2024-04-25T01:43:59.319266+0000","last_active":"2024-04-25T01:44:24.418788+0000","last_peered":"2024-04-25T01:44:24.418788+0000","last_clean":"2024-04-25T01:44:24.418788+0000","last_became_active":"2024-04-25T01:39:24.400509+0000","last_became_peered":"2024-04-25T01:39:24.400509+0000","last_unstale":"2024-04-25T01:44:24.418788+0000","last_undegraded":"2024-04-25T01:44:24.418788+0000","last_fullsized":"2024-04-25T01:44:24.418788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'207","last_scrub_stamp":"2024-04-25T01:43:59.319138+0000","last_deep_scrub":"30'207","last_deep_scrub_stamp":"2024-04-25T01:43:59.319138+0000","last_clean_scrub_stamp":"2024-04-25T01:43:59.319138+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:52.582377+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":491520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"30'180","reported_seq":217,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.416212+0000","last_change":"2024-04-25T01:44:09.200966+0000","last_active":"2024-04-25T01:44:24.416212+0000","last_peered":"2024-04-25T01:44:24.416212+0000","last_clean":"2024-04-25T01:44:24.416212+0000","last_became_active":"2024-04-25T01:39:33.438915+0000","last_became_peered":"2024-04-25T01:39:33.438915+0000","last_unstale":"2024-04-25T01:44:24.416212+0000","last_undegraded":"2024-04-25T01:44:24.416212+0000","last_fullsized":"2024-04-25T01:44:24.416212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'180","last_scrub_stamp":"2024-04-25T01:44:09.200857+0000","last_deep_scrub":"30'180","last_deep_scrub_stamp":"2024-04-25T01:44:09.200857+0000","last_clean_scrub_stamp":"2024-04-25T01:44:09.200857+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:52.478932+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"30'197","reported_seq":242,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.412870+0000","last_change":"2024-04-25T01:44:02.512491+0000","last_active":"2024-04-25T01:44:24.412870+0000","last_peered":"2024-04-25T01:44:24.412870+0000","last_clean":"2024-04-25T01:44:24.412870+0000","last_became_active":"2024-04-25T01:39:24.387674+0000","last_became_peered":"2024-04-25T01:39:24.387674+0000","last_unstale":"2024-04-25T01:44:24.412870+0000","last_undegraded":"2024-04-25T01:44:24.412870+0000","last_fullsized":"2024-04-25T01:44:24.412870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'197","last_scrub_stamp":"2024-04-25T01:44:02.512351+0000","last_deep_scrub":"30'197","last_deep_scrub_stamp":"2024-04-25T01:44:02.512351+0000","last_clean_scrub_stamp":"2024-04-25T01:44:02.512351+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:09.012294+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"30'205","reported_seq":242,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.406050+0000","last_change":"2024-04-25T01:44:16.044458+0000","last_active":"2024-04-25T01:44:24.406050+0000","last_peered":"2024-04-25T01:44:24.406050+0000","last_clean":"2024-04-25T01:44:24.406050+0000","last_became_active":"2024-04-25T01:39:33.444636+0000","last_became_peered":"2024-04-25T01:39:33.444636+0000","last_unstale":"2024-04-25T01:44:24.406050+0000","last_undegraded":"2024-04-25T01:44:24.406050+0000","last_fullsized":"2024-04-25T01:44:24.406050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'205","last_scrub_stamp":"2024-04-25T01:44:16.044348+0000","last_deep_scrub":"30'205","last_deep_scrub_stamp":"2024-04-25T01:44:16.044348+0000","last_clean_scrub_stamp":"2024-04-25T01:44:16.044348+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:48:58.067386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"30'159","reported_seq":204,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.434938+0000","last_change":"2024-04-25T01:43:57.835088+0000","last_active":"2024-04-25T01:44:24.434938+0000","last_peered":"2024-04-25T01:44:24.434938+0000","last_clean":"2024-04-25T01:44:24.434938+0000","last_became_active":"2024-04-25T01:39:24.399701+0000","last_became_peered":"2024-04-25T01:39:24.399701+0000","last_unstale":"2024-04-25T01:44:24.434938+0000","last_undegraded":"2024-04-25T01:44:24.434938+0000","last_fullsized":"2024-04-25T01:44:24.434938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'159","last_scrub_stamp":"2024-04-25T01:43:57.834971+0000","last_deep_scrub":"30'159","last_deep_scrub_stamp":"2024-04-25T01:43:57.834971+0000","last_clean_scrub_stamp":"2024-04-25T01:43:57.834971+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:42.596971+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"30'193","reported_seq":230,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.435632+0000","last_change":"2024-04-25T01:44:20.905179+0000","last_active":"2024-04-25T01:44:24.435632+0000","last_peered":"2024-04-25T01:44:24.435632+0000","last_clean":"2024-04-25T01:44:24.435632+0000","last_became_active":"2024-04-25T01:39:33.440679+0000","last_became_peered":"2024-04-25T01:39:33.440679+0000","last_unstale":"2024-04-25T01:44:24.435632+0000","last_undegraded":"2024-04-25T01:44:24.435632+0000","last_fullsized":"2024-04-25T01:44:24.435632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'193","last_scrub_stamp":"2024-04-25T01:44:20.905007+0000","last_deep_scrub":"30'193","last_deep_scrub_stamp":"2024-04-25T01:44:20.905007+0000","last_clean_scrub_stamp":"2024-04-25T01:44:20.905007+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:52.616463+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"30'177","reported_seq":222,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.410766+0000","last_change":"2024-04-25T01:44:04.544045+0000","last_active":"2024-04-25T01:44:24.410766+0000","last_peered":"2024-04-25T01:44:24.410766+0000","last_clean":"2024-04-25T01:44:24.410766+0000","last_became_active":"2024-04-25T01:39:24.379573+0000","last_became_peered":"2024-04-25T01:39:24.379573+0000","last_unstale":"2024-04-25T01:44:24.410766+0000","last_undegraded":"2024-04-25T01:44:24.410766+0000","last_fullsized":"2024-04-25T01:44:24.410766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'177","last_scrub_stamp":"2024-04-25T01:44:04.543926+0000","last_deep_scrub":"30'177","last_deep_scrub_stamp":"2024-04-25T01:44:04.543926+0000","last_clean_scrub_stamp":"2024-04-25T01:44:04.543926+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:39.797238+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"30'176","reported_seq":212,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.418544+0000","last_change":"2024-04-25T01:44:04.425570+0000","last_active":"2024-04-25T01:44:24.418544+0000","last_peered":"2024-04-25T01:44:24.418544+0000","last_clean":"2024-04-25T01:44:24.418544+0000","last_became_active":"2024-04-25T01:39:33.426090+0000","last_became_peered":"2024-04-25T01:39:33.426090+0000","last_unstale":"2024-04-25T01:44:24.418544+0000","last_undegraded":"2024-04-25T01:44:24.418544+0000","last_fullsized":"2024-04-25T01:44:24.418544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'176","last_scrub_stamp":"2024-04-25T01:44:04.425420+0000","last_deep_scrub":"30'176","last_deep_scrub_stamp":"2024-04-25T01:44:04.425420+0000","last_clean_scrub_stamp":"2024-04-25T01:44:04.425420+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:37:40.742324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"30'192","reported_seq":237,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.436045+0000","last_change":"2024-04-25T01:43:56.791271+0000","last_active":"2024-04-25T01:44:24.436045+0000","last_peered":"2024-04-25T01:44:24.436045+0000","last_clean":"2024-04-25T01:44:24.436045+0000","last_became_active":"2024-04-25T01:39:24.398449+0000","last_became_peered":"2024-04-25T01:39:24.398449+0000","last_unstale":"2024-04-25T01:44:24.436045+0000","last_undegraded":"2024-04-25T01:44:24.436045+0000","last_fullsized":"2024-04-25T01:44:24.436045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'192","last_scrub_stamp":"2024-04-25T01:43:56.791099+0000","last_deep_scrub":"30'192","last_deep_scrub_stamp":"2024-04-25T01:43:56.791099+0000","last_clean_scrub_stamp":"2024-04-25T01:43:56.791099+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:26:54.917826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"30'187","reported_seq":223,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.407161+0000","last_change":"2024-04-25T01:44:00.289098+0000","last_active":"2024-04-25T01:44:24.407161+0000","last_peered":"2024-04-25T01:44:24.407161+0000","last_clean":"2024-04-25T01:44:24.407161+0000","last_became_active":"2024-04-25T01:39:33.436224+0000","last_became_peered":"2024-04-25T01:39:33.436224+0000","last_unstale":"2024-04-25T01:44:24.407161+0000","last_undegraded":"2024-04-25T01:44:24.407161+0000","last_fullsized":"2024-04-25T01:44:24.407161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'187","last_scrub_stamp":"2024-04-25T01:44:00.288895+0000","last_deep_scrub":"30'187","last_deep_scrub_stamp":"2024-04-25T01:44:00.288895+0000","last_clean_scrub_stamp":"2024-04-25T01:44:00.288895+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:24:38.338401+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"30'175","reported_seq":220,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.411639+0000","last_change":"2024-04-25T01:43:59.728909+0000","last_active":"2024-04-25T01:44:24.411639+0000","last_peered":"2024-04-25T01:44:24.411639+0000","last_clean":"2024-04-25T01:44:24.411639+0000","last_became_active":"2024-04-25T01:39:24.386568+0000","last_became_peered":"2024-04-25T01:39:24.386568+0000","last_unstale":"2024-04-25T01:44:24.411639+0000","last_undegraded":"2024-04-25T01:44:24.411639+0000","last_fullsized":"2024-04-25T01:44:24.411639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'175","last_scrub_stamp":"2024-04-25T01:43:59.728720+0000","last_deep_scrub":"30'175","last_deep_scrub_stamp":"2024-04-25T01:43:59.728720+0000","last_clean_scrub_stamp":"2024-04-25T01:43:59.728720+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:52.823655+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"30'223","reported_seq":260,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.410126+0000","last_change":"2024-04-25T01:44:19.621717+0000","last_active":"2024-04-25T01:44:24.410126+0000","last_peered":"2024-04-25T01:44:24.410126+0000","last_clean":"2024-04-25T01:44:24.410126+0000","last_became_active":"2024-04-25T01:39:33.440480+0000","last_became_peered":"2024-04-25T01:39:33.440480+0000","last_unstale":"2024-04-25T01:44:24.410126+0000","last_undegraded":"2024-04-25T01:44:24.410126+0000","last_fullsized":"2024-04-25T01:44:24.410126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'223","last_scrub_stamp":"2024-04-25T01:44:19.621594+0000","last_deep_scrub":"30'223","last_deep_scrub_stamp":"2024-04-25T01:44:19.621594+0000","last_clean_scrub_stamp":"2024-04-25T01:44:19.621594+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:54:19.995836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"30'160","reported_seq":205,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.405960+0000","last_change":"2024-04-25T01:43:57.233837+0000","last_active":"2024-04-25T01:44:24.405960+0000","last_peered":"2024-04-25T01:44:24.405960+0000","last_clean":"2024-04-25T01:44:24.405960+0000","last_became_active":"2024-04-25T01:39:24.386531+0000","last_became_peered":"2024-04-25T01:39:24.386531+0000","last_unstale":"2024-04-25T01:44:24.405960+0000","last_undegraded":"2024-04-25T01:44:24.405960+0000","last_fullsized":"2024-04-25T01:44:24.405960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'160","last_scrub_stamp":"2024-04-25T01:43:57.233727+0000","last_deep_scrub":"30'160","last_deep_scrub_stamp":"2024-04-25T01:43:57.233727+0000","last_clean_scrub_stamp":"2024-04-25T01:43:57.233727+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:59:41.047375+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"30'214","reported_seq":250,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.410132+0000","last_change":"2024-04-25T01:44:05.575773+0000","last_active":"2024-04-25T01:44:24.410132+0000","last_peered":"2024-04-25T01:44:24.410132+0000","last_clean":"2024-04-25T01:44:24.410132+0000","last_became_active":"2024-04-25T01:39:33.436134+0000","last_became_peered":"2024-04-25T01:39:33.436134+0000","last_unstale":"2024-04-25T01:44:24.410132+0000","last_undegraded":"2024-04-25T01:44:24.410132+0000","last_fullsized":"2024-04-25T01:44:24.410132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'214","last_scrub_stamp":"2024-04-25T01:44:05.575639+0000","last_deep_scrub":"30'214","last_deep_scrub_stamp":"2024-04-25T01:44:05.575639+0000","last_clean_scrub_stamp":"2024-04-25T01:44:05.575639+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:25.075860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"30'170","reported_seq":215,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T01:44:24.414261+0000","last_change":"2024-04-25T01:43:59.535762+0000","last_active":"2024-04-25T01:44:24.414261+0000","last_peered":"2024-04-25T01:44:24.414261+0000","last_clean":"2024-04-25T01:44:24.414261+0000","last_became_active":"2024-04-25T01:39:24.395958+0000","last_became_peered":"2024-04-25T01:39:24.395958+0000","last_unstale":"2024-04-25T01:44:24.414261+0000","last_undegraded":"2024-04-25T01:44:24.414261+0000","last_fullsized":"2024-04-25T01:44:24.414261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'170","last_scrub_stamp":"2024-04-25T01:43:59.535576+0000","last_deep_scrub":"30'170","last_deep_scrub_stamp":"2024-04-25T01:43:59.535576+0000","last_clean_scrub_stamp":"2024-04-25T01:43:59.535576+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:37:28.417859+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12101,"ondisk_log_size":12101,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":7961223,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":239,"num_read_kb":8015,"num_write":3918,"num_write_kb":11482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15990784,"data_stored":15922446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3937,"ondisk_log_size":3937,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11255,"ondisk_log_size":11255,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8012268,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":243,"num_read_kb":8106,"num_write":3953,"num_write_kb":11559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16089088,"data_stored":16024536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3966,"ondisk_log_size":3966,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574916,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67696,"kb_used_data":4648,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94304144,"statfs":{"total":96636764160,"available":96567443456,"internally_reserved":0,"allocated":4759552,"data_stored":4556431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":64551370},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574915,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61992,"kb_used_data":4444,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94309848,"statfs":{"total":96636764160,"available":96573284352,"internally_reserved":0,"allocated":4550656,"data_stored":4344994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574916,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45416,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326424,"statfs":{"total":96636764160,"available":96590258176,"internally_reserved":0,"allocated":356352,"data_stored":150568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67088,"kb_used_data":4036,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94304752,"statfs":{"total":96636764160,"available":96568066048,"internally_reserved":0,"allocated":4132864,"data_stored":3915081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123420,"kb_used_data":15956,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94248420,"statfs":{"total":96636764160,"available":96510382080,"internally_reserved":0,"allocated":16338944,"data_stored":16120915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":110033351},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57888,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313952,"statfs":{"total":96636764160,"available":96577486848,"internally_reserved":0,"allocated":348160,"data_stored":149977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49516,"kb_used_data":4448,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94322324,"statfs":{"total":96636764160,"available":96586059776,"internally_reserved":0,"allocated":4554752,"data_stored":4344560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45992,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325848,"statfs":{"total":96636764160,"available":96589668352,"internally_reserved":0,"allocated":946176,"data_stored":740408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8024064,"data_stored":8011470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3821568,"data_stored":3816571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4194998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7974912,"data_stored":7960043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3780608,"data_stored":3765553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T01:44:36.543 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T01:44:36.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.679+0000 7f9d83bf4640 1 Processor -- start 2024-04-25T01:44:36.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.679+0000 7f9d83bf4640 1 -- start start 2024-04-25T01:44:36.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.680+0000 7f9d83bf4640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d7c0c4280 0x7f9d7c1538f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:36.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.680+0000 7f9d83bf4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d7c0c7040 con 0x7f9d7c0c4cb0 2024-04-25T01:44:36.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.680+0000 7f9d83bf4640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d7c0ac010 con 0x7f9d7c073450 2024-04-25T01:44:36.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.680+0000 7f9d83bf4640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9d7c0c1cd0 con 0x7f9d7c0c4280 2024-04-25T01:44:36.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.680+0000 7f9d82191640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9d7c0c4cb0 0x7f9d7c15d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36696/0 (socket says 172.21.15.77:36696) 2024-04-25T01:44:36.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.680+0000 7f9d82191640 1 -- 172.21.15.77:0/2438455767 learned_addr learned my addr 172.21.15.77:0/2438455767 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:44:36.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.680+0000 7f9d8098e640 1 -- 172.21.15.77:0/2438455767 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2082804106 0 0) 0x7f9d7c0c7040 con 0x7f9d7c0c4cb0 2024-04-25T01:44:36.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.680+0000 7f9d81990640 1 --2- 172.21.15.77:0/2438455767 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d7c0c4280 0x7f9d7c1538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:36.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.680+0000 7f9d8098e640 1 -- 172.21.15.77:0/2438455767 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d68005730 con 0x7f9d7c0c4cb0 2024-04-25T01:44:36.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.681+0000 7f9d8098e640 1 -- 172.21.15.77:0/2438455767 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2398529970 0 0) 0x7f9d68005730 con 0x7f9d7c0c4cb0 2024-04-25T01:44:36.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.681+0000 7f9d8098e640 1 -- 172.21.15.77:0/2438455767 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d7c0c4280 msgr2=0x7f9d7c1538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:36.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.681+0000 7f9d8098e640 1 --2- 172.21.15.77:0/2438455767 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d7c0c4280 0x7f9d7c1538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:36.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.681+0000 7f9d8098e640 1 -- 172.21.15.77:0/2438455767 >> v1:172.21.15.121:6789/0 conn(0x7f9d7c073450 legacy=0x7f9d7c0c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:36.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.681+0000 7f9d8098e640 1 -- 172.21.15.77:0/2438455767 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d7c0ac2f0 con 0x7f9d7c0c4cb0 2024-04-25T01:44:36.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.681+0000 7f9d8098e640 1 -- 172.21.15.77:0/2438455767 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7f9d740019f0 con 0x7f9d7c0c4cb0 2024-04-25T01:44:36.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.681+0000 7f9d8098e640 1 -- 172.21.15.77:0/2438455767 >> v1:172.21.15.77:6789/0 conn(0x7f9d7c0c4cb0 legacy=0x7f9d7c15d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:36.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.681+0000 7f9d8098e640 1 --2- 172.21.15.77:0/2438455767 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d68005bf0 0x7f9d68006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:36.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.681+0000 7f9d8098e640 1 --2- 172.21.15.77:0/2438455767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d68006a10 0x7f9d68006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:36.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.681+0000 7f9d8098e640 1 --2- 172.21.15.77:0/2438455767 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d7c0c4280 0x7f9d680073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:36.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.681+0000 7f9d8098e640 1 -- 172.21.15.77:0/2438455767 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7c0c1cd0 con 0x7f9d68006a10 2024-04-25T01:44:36.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.681+0000 7f9d8098e640 1 -- 172.21.15.77:0/2438455767 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6800dcb0 con 0x7f9d68005bf0 2024-04-25T01:44:36.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.681+0000 7f9d8098e640 1 -- 172.21.15.77:0/2438455767 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9d6800deb0 con 0x7f9d7c0c4280 2024-04-25T01:44:36.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.681+0000 7f9d8118f640 1 --2- 172.21.15.77:0/2438455767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d68006a10 0x7f9d68006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:36.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.681+0000 7f9d81990640 1 --2- 172.21.15.77:0/2438455767 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d68005bf0 0x7f9d68006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:36.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.681+0000 7f9d82191640 1 --2- 172.21.15.77:0/2438455767 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d7c0c4280 0x7f9d680073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:36.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.681+0000 7f9d8118f640 1 -- 172.21.15.77:0/2438455767 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d7c0c4280 msgr2=0x7f9d680073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:36.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.681+0000 7f9d8118f640 1 --2- 172.21.15.77:0/2438455767 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d7c0c4280 0x7f9d680073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:36.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.681+0000 7f9d8118f640 1 -- 172.21.15.77:0/2438455767 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d68005bf0 msgr2=0x7f9d68006010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:36.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.681+0000 7f9d8118f640 1 --2- 172.21.15.77:0/2438455767 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d68005bf0 0x7f9d68006010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:36.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.681+0000 7f9d8118f640 1 -- 172.21.15.77:0/2438455767 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d68005730 con 0x7f9d68006a10 2024-04-25T01:44:36.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.681+0000 7f9d81990640 1 --2- 172.21.15.77:0/2438455767 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d68005bf0 0x7f9d68006010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:44:36.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.682+0000 7f9d8118f640 1 --2- 172.21.15.77:0/2438455767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d68006a10 0x7f9d68006e90 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c073830 tx=0x7f9d68007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26adaf178ece4e44 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:36.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.682+0000 7f9d8098e640 1 -- 172.21.15.77:0/2438455767 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c001370 con 0x7f9d68006a10 2024-04-25T01:44:36.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.682+0000 7f9d8098e640 1 -- 172.21.15.77:0/2438455767 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d6c0052d0 con 0x7f9d68006a10 2024-04-25T01:44:36.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.682+0000 7f9d8098e640 1 -- 172.21.15.77:0/2438455767 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c02ab70 con 0x7f9d68006a10 2024-04-25T01:44:36.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.682+0000 7f9d83bf4640 1 -- 172.21.15.77:0/2438455767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d68006a10 msgr2=0x7f9d68006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:36.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.682+0000 7f9d83bf4640 1 --2- 172.21.15.77:0/2438455767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d68006a10 0x7f9d68006e90 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c073830 tx=0x7f9d68007a40 comp rx=0 tx=0).stop 2024-04-25T01:44:36.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.682+0000 7f9d82191640 1 -- 172.21.15.77:0/2438455767 reap_dead start 2024-04-25T01:44:36.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.682+0000 7f9d83bf4640 1 -- 172.21.15.77:0/2438455767 shutdown_connections 2024-04-25T01:44:36.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.682+0000 7f9d83bf4640 1 -- 172.21.15.77:0/2438455767 >> 172.21.15.77:0/2438455767 conn(0x7f9d7c0c7580 msgr2=0x7f9d7c0c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:36.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.682+0000 7f9d83bf4640 1 -- 172.21.15.77:0/2438455767 shutdown_connections 2024-04-25T01:44:36.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.682+0000 7f9d83bf4640 1 -- 172.21.15.77:0/2438455767 wait complete. 2024-04-25T01:44:36.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.684+0000 7f9d83bf4640 1 Processor -- start 2024-04-25T01:44:36.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.684+0000 7f9d83bf4640 1 -- start start 2024-04-25T01:44:36.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.684+0000 7f9d83bf4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d68006a10 0x7f9d7c1442b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:36.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.684+0000 7f9d83bf4640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d7c144be0 0x7f9d7c155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:36.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.684+0000 7f9d83bf4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d7c155940 0x7f9d7c1e7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:36.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.684+0000 7f9d83bf4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7c0c1a90 con 0x7f9d7c155940 2024-04-25T01:44:36.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.684+0000 7f9d83bf4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7c0c1910 con 0x7f9d68006a10 2024-04-25T01:44:36.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.684+0000 7f9d83bf4640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9d7c0c4660 con 0x7f9d7c144be0 2024-04-25T01:44:36.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.684+0000 7f9d82191640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d7c155940 0x7f9d7c1e7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:36.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.684+0000 7f9d82191640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d7c155940 0x7f9d7c1e7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49458/0 (socket says 172.21.15.77:49458) 2024-04-25T01:44:36.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.684+0000 7f9d82191640 1 -- 172.21.15.77:0/2595641629 learned_addr learned my addr 172.21.15.77:0/2595641629 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:36.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.685+0000 7f9d82191640 1 -- 172.21.15.77:0/2595641629 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d7c144be0 msgr2=0x7f9d7c155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:36.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.685+0000 7f9d81990640 1 --2- 172.21.15.77:0/2595641629 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d68006a10 0x7f9d7c1442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:36.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.685+0000 7f9d8118f640 1 --2- 172.21.15.77:0/2595641629 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d7c144be0 0x7f9d7c155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:36.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.685+0000 7f9d82191640 1 --2- 172.21.15.77:0/2595641629 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d7c144be0 0x7f9d7c155400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:36.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.685+0000 7f9d82191640 1 -- 172.21.15.77:0/2595641629 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d68006a10 msgr2=0x7f9d7c1442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:36.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.685+0000 7f9d82191640 1 --2- 172.21.15.77:0/2595641629 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d68006a10 0x7f9d7c1442b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:36.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.685+0000 7f9d82191640 1 -- 172.21.15.77:0/2595641629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d7c073180 con 0x7f9d7c155940 2024-04-25T01:44:36.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.685+0000 7f9d82191640 1 --2- 172.21.15.77:0/2595641629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d7c155940 0x7f9d7c1e7770 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9d740013d0 tx=0x7f9d7400a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:36.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.685+0000 7f9d727fc640 1 -- 172.21.15.77:0/2595641629 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7400ac70 con 0x7f9d7c155940 2024-04-25T01:44:36.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.685+0000 7f9d727fc640 1 -- 172.21.15.77:0/2595641629 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d74018070 con 0x7f9d7c155940 2024-04-25T01:44:36.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.685+0000 7f9d727fc640 1 -- 172.21.15.77:0/2595641629 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d74013610 con 0x7f9d7c155940 2024-04-25T01:44:36.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.685+0000 7f9d83bf4640 1 -- 172.21.15.77:0/2595641629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d7c0729c0 con 0x7f9d7c155940 2024-04-25T01:44:36.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.685+0000 7f9d83bf4640 1 -- 172.21.15.77:0/2595641629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d7c070590 con 0x7f9d7c155940 2024-04-25T01:44:36.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.686+0000 7f9d83bf4640 1 -- 172.21.15.77:0/2595641629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d7c04f500 con 0x7f9d7c155940 2024-04-25T01:44:36.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.686+0000 7f9d727fc640 1 -- 172.21.15.77:0/2595641629 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9d740137b0 con 0x7f9d7c155940 2024-04-25T01:44:36.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.687+0000 7f9d727fc640 1 --2- 172.21.15.77:0/2595641629 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9d6006be30 0x7f9d6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:36.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.687+0000 7f9d81990640 1 --2- 172.21.15.77:0/2595641629 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9d6006be30 0x7f9d6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:36.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.687+0000 7f9d727fc640 1 -- 172.21.15.77:0/2595641629 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7153+0+0 (secure 0 0 0) 0x7f9d7408b970 con 0x7f9d7c155940 2024-04-25T01:44:36.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.687+0000 7f9d81990640 1 --2- 172.21.15.77:0/2595641629 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9d6006be30 0x7f9d6006e2f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9d78009930 tx=0x7f9d78008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:36.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.691+0000 7f9d727fc640 1 -- 172.21.15.77:0/2595641629 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9d74059e00 con 0x7f9d7c155940 2024-04-25T01:44:36.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.864+0000 7f9d83bf4640 1 -- 172.21.15.77:0/2595641629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f9d7c145130 con 0x7f9d7c155940 2024-04-25T01:44:36.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.869+0000 7f9d727fc640 1 -- 172.21.15.77:0/2595641629 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f9d74059700 con 0x7f9d7c155940 2024-04-25T01:44:36.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.870+0000 7f9d727fc640 1 -- 172.21.15.77:0/2595641629 <== mon.0 v2:172.21.15.77:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9d7405dab0 con 0x7f9d7c155940 2024-04-25T01:44:36.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.872+0000 7f9d83bf4640 1 -- 172.21.15.77:0/2595641629 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9d6006be30 msgr2=0x7f9d6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:36.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.872+0000 7f9d83bf4640 1 --2- 172.21.15.77:0/2595641629 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9d6006be30 0x7f9d6006e2f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9d78009930 tx=0x7f9d78008040 comp rx=0 tx=0).stop 2024-04-25T01:44:36.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.872+0000 7f9d83bf4640 1 -- 172.21.15.77:0/2595641629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d7c155940 msgr2=0x7f9d7c1e7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:36.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.872+0000 7f9d83bf4640 1 --2- 172.21.15.77:0/2595641629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d7c155940 0x7f9d7c1e7770 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9d740013d0 tx=0x7f9d7400a640 comp rx=0 tx=0).stop 2024-04-25T01:44:36.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.872+0000 7f9d83bf4640 1 -- 172.21.15.77:0/2595641629 shutdown_connections 2024-04-25T01:44:36.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.872+0000 7f9d83bf4640 1 --2- 172.21.15.77:0/2595641629 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f9d6006be30 0x7f9d6006e2f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:36.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.872+0000 7f9d83bf4640 1 --2- 172.21.15.77:0/2595641629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d7c155940 0x7f9d7c1e7770 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:36.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.872+0000 7f9d83bf4640 1 --2- 172.21.15.77:0/2595641629 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d7c144be0 0x7f9d7c155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:36.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.872+0000 7f9d83bf4640 1 --2- 172.21.15.77:0/2595641629 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d68006a10 0x7f9d7c1442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:36.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.872+0000 7f9d83bf4640 1 -- 172.21.15.77:0/2595641629 >> 172.21.15.77:0/2595641629 conn(0x7f9d7c0c7580 msgr2=0x7f9d7c0ab220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:36.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.872+0000 7f9d83bf4640 1 -- 172.21.15.77:0/2595641629 shutdown_connections 2024-04-25T01:44:36.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.872+0000 7f9d83bf4640 1 -- 172.21.15.77:0/2595641629 wait complete. 2024-04-25T01:44:36.875 INFO:tasks.cephfs.filesystem:Destroying file system a and related pools 2024-04-25T01:44:36.875 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:44:36.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.979+0000 7f97fbc4d640 1 Processor -- start 2024-04-25T01:44:36.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.980+0000 7f97fbc4d640 1 -- start start 2024-04-25T01:44:36.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.980+0000 7f97fbc4d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f97f4156c80 0x7f97f40c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:36.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.980+0000 7f97fbc4d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f97f406c280 0x7f97f40c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:36.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.980+0000 7f97fbc4d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97f4157130 con 0x7f97f4150090 2024-04-25T01:44:36.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.980+0000 7f97fbc4d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f97f406b830 con 0x7f97f4156c80 2024-04-25T01:44:36.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.980+0000 7f97fbc4d640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f97f40c9de0 con 0x7f97f406c280 2024-04-25T01:44:36.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.980+0000 7f97f91e8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f97f4156c80 0x7f97f40c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:36.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.980+0000 7f97f99e9640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f97f4150090 0x7f97f40c8200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36704/0 (socket says 172.21.15.77:36704) 2024-04-25T01:44:36.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.980+0000 7f97f91e8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f97f4156c80 0x7f97f40c98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49468/0 (socket says 172.21.15.77:49468) 2024-04-25T01:44:36.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.980+0000 7f97f99e9640 1 -- 172.21.15.77:0/1063775799 learned_addr learned my addr 172.21.15.77:0/1063775799 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:44:36.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.981+0000 7f97f91e8640 1 -- 172.21.15.77:0/1063775799 >> v2:172.21.15.121:3300/0 conn(0x7f97f406c280 msgr2=0x7f97f40c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:36.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.981+0000 7f97fa1ea640 1 --2- 172.21.15.77:0/1063775799 >> v2:172.21.15.121:3300/0 conn(0x7f97f406c280 0x7f97f40c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:36.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.981+0000 7f97f89e7640 1 -- 172.21.15.77:0/1063775799 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2941554006 0 0) 0x7f97e8001110 con 0x7f97f4150090 2024-04-25T01:44:36.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.981+0000 7f97f91e8640 1 --2- 172.21.15.77:0/1063775799 >> v2:172.21.15.121:3300/0 conn(0x7f97f406c280 0x7f97f40c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:36.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.981+0000 7f97f91e8640 1 -- 172.21.15.77:0/1063775799 >> v1:172.21.15.77:6789/0 conn(0x7f97f4150090 legacy=0x7f97f40c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:36.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.981+0000 7f97f91e8640 1 -- 172.21.15.77:0/1063775799 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97f40c89c0 con 0x7f97f4156c80 2024-04-25T01:44:36.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.981+0000 7f97fa1ea640 1 --2- 172.21.15.77:0/1063775799 >> v2:172.21.15.121:3300/0 conn(0x7f97f406c280 0x7f97f40c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:44:36.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.981+0000 7f97f91e8640 1 --2- 172.21.15.77:0/1063775799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f4156c80 0x7f97f40c98a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f97f40c78d0 tx=0x7f97f002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c0dedfb1ce6a49 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:36.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.981+0000 7f97f89e7640 1 -- 172.21.15.77:0/1063775799 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f0037070 con 0x7f97f4156c80 2024-04-25T01:44:36.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.982+0000 7f97f89e7640 1 -- 172.21.15.77:0/1063775799 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f97f0032440 con 0x7f97f4156c80 2024-04-25T01:44:36.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.982+0000 7f97f89e7640 1 -- 172.21.15.77:0/1063775799 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f0032830 con 0x7f97f4156c80 2024-04-25T01:44:36.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.982+0000 7f97fbc4d640 1 -- 172.21.15.77:0/1063775799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f4156c80 msgr2=0x7f97f40c98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:36.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.982+0000 7f97fbc4d640 1 --2- 172.21.15.77:0/1063775799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f4156c80 0x7f97f40c98a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f97f40c78d0 tx=0x7f97f002a1a0 comp rx=0 tx=0).stop 2024-04-25T01:44:36.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.982+0000 7f97fbc4d640 1 -- 172.21.15.77:0/1063775799 shutdown_connections 2024-04-25T01:44:36.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.982+0000 7f97fbc4d640 1 --2- 172.21.15.77:0/1063775799 >> v2:172.21.15.121:3300/0 conn(0x7f97f406c280 0x7f97f40c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:36.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.982+0000 7f97fbc4d640 1 --2- 172.21.15.77:0/1063775799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f4156c80 0x7f97f40c98a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:36.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.982+0000 7f97fbc4d640 1 -- 172.21.15.77:0/1063775799 >> 172.21.15.77:0/1063775799 conn(0x7f97f40ad4d0 msgr2=0x7f97f40ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:36.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.982+0000 7f97fbc4d640 1 -- 172.21.15.77:0/1063775799 shutdown_connections 2024-04-25T01:44:36.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.982+0000 7f97fbc4d640 1 -- 172.21.15.77:0/1063775799 wait complete. 2024-04-25T01:44:36.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.983+0000 7f97fbc4d640 1 Processor -- start 2024-04-25T01:44:36.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.983+0000 7f97fbc4d640 1 -- start start 2024-04-25T01:44:36.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.984+0000 7f97fbc4d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97f406c280 0x7f97f41e8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:36.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.984+0000 7f97fbc4d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f97f4150090 0x7f97f41e9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:36.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.984+0000 7f97fbc4d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f4156c80 0x7f97f41514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:36.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.984+0000 7f97fbc4d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f97f406bd60 con 0x7f97f4156c80 2024-04-25T01:44:36.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.984+0000 7f97fbc4d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f97f406ba80 con 0x7f97f406c280 2024-04-25T01:44:36.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.984+0000 7f97fbc4d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f97f406c690 con 0x7f97f4150090 2024-04-25T01:44:36.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.984+0000 7f97fa1ea640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f4156c80 0x7f97f41514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:36.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.984+0000 7f97fa1ea640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f4156c80 0x7f97f41514c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49482/0 (socket says 172.21.15.77:49482) 2024-04-25T01:44:36.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.984+0000 7f97fa1ea640 1 -- 172.21.15.77:0/1745994345 learned_addr learned my addr 172.21.15.77:0/1745994345 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:36.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.984+0000 7f97f91e8640 1 --2- 172.21.15.77:0/1745994345 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f97f4150090 0x7f97f41e9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:36.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.984+0000 7f97f99e9640 1 --2- 172.21.15.77:0/1745994345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97f406c280 0x7f97f41e8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:36.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.984+0000 7f97fa1ea640 1 -- 172.21.15.77:0/1745994345 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f97f4150090 msgr2=0x7f97f41e9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:36.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.984+0000 7f97fa1ea640 1 --2- 172.21.15.77:0/1745994345 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f97f4150090 0x7f97f41e9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:36.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.984+0000 7f97fa1ea640 1 -- 172.21.15.77:0/1745994345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97f406c280 msgr2=0x7f97f41e8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:36.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.984+0000 7f97fa1ea640 1 --2- 172.21.15.77:0/1745994345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97f406c280 0x7f97f41e8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:36.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.984+0000 7f97fa1ea640 1 -- 172.21.15.77:0/1745994345 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97f41532a0 con 0x7f97f4156c80 2024-04-25T01:44:36.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.984+0000 7f97fa1ea640 1 --2- 172.21.15.77:0/1745994345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f4156c80 0x7f97f41514c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00cef0 tx=0x7f97ec00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:36.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.985+0000 7f97e67fc640 1 -- 172.21.15.77:0/1745994345 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec01a070 con 0x7f97f4156c80 2024-04-25T01:44:36.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.985+0000 7f97e67fc640 1 -- 172.21.15.77:0/1745994345 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f97ec00d860 con 0x7f97f4156c80 2024-04-25T01:44:36.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.985+0000 7f97fbc4d640 1 -- 172.21.15.77:0/1745994345 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97f41efca0 con 0x7f97f4156c80 2024-04-25T01:44:36.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.985+0000 7f97e67fc640 1 -- 172.21.15.77:0/1745994345 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec00dc70 con 0x7f97f4156c80 2024-04-25T01:44:36.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.985+0000 7f97fbc4d640 1 -- 172.21.15.77:0/1745994345 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97f40c5c80 con 0x7f97f4156c80 2024-04-25T01:44:36.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.986+0000 7f97fbc4d640 1 -- 172.21.15.77:0/1745994345 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97f40c6020 con 0x7f97f4156c80 2024-04-25T01:44:36.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.986+0000 7f97e67fc640 1 -- 172.21.15.77:0/1745994345 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f97ec01d070 con 0x7f97f4156c80 2024-04-25T01:44:36.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.986+0000 7f97e67fc640 1 --2- 172.21.15.77:0/1745994345 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f97d806be30 0x7f97d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:36.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.987+0000 7f97e67fc640 1 -- 172.21.15.77:0/1745994345 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7153+0+0 (secure 0 0 0) 0x7f97ec08bcd0 con 0x7f97f4156c80 2024-04-25T01:44:36.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.987+0000 7f97f99e9640 1 --2- 172.21.15.77:0/1745994345 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f97d806be30 0x7f97d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:36.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.987+0000 7f97f99e9640 1 --2- 172.21.15.77:0/1745994345 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f97d806be30 0x7f97d806e2f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f97e8000f60 tx=0x7f97e8007970 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:36.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:36.991+0000 7f97e67fc640 1 -- 172.21.15.77:0/1745994345 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f97f41532a0 con 0x7f97f4156c80 2024-04-25T01:44:37.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.201+0000 7f97fbc4d640 1 -- 172.21.15.77:0/1745994345 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97f406cec0 con 0x7f97f4156c80 2024-04-25T01:44:37.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.202+0000 7f97e67fc640 1 -- 172.21.15.77:0/1745994345 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+6485 (secure 0 0 0) 0x7f97ec05a190 con 0x7f97f4156c80 2024-04-25T01:44:37.194 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:44:37.194 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5964,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1289251527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1289251527},{"type":"v1","addr":"172.21.15.77:6835","nonce":1289251527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:44:27.568589+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5622":{"gid":5622,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":14,"addr":"172.21.15.77:6837/1570919706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1570919706},{"type":"v1","addr":"172.21.15.77:6837","nonce":1570919706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5622,"qdb_cluster":[5622]},"id":1},{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:43:32.407370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":22,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5179,"qdb_cluster":[5179]},"id":2}]} 2024-04-25T01:44:37.194 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 38 2024-04-25T01:44:37.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.203+0000 7f97fbc4d640 1 -- 172.21.15.77:0/1745994345 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f97d806be30 msgr2=0x7f97d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:37.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.203+0000 7f97fbc4d640 1 --2- 172.21.15.77:0/1745994345 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f97d806be30 0x7f97d806e2f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f97e8000f60 tx=0x7f97e8007970 comp rx=0 tx=0).stop 2024-04-25T01:44:37.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.203+0000 7f97fbc4d640 1 -- 172.21.15.77:0/1745994345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f4156c80 msgr2=0x7f97f41514c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:37.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.203+0000 7f97fbc4d640 1 --2- 172.21.15.77:0/1745994345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f4156c80 0x7f97f41514c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00cef0 tx=0x7f97ec00a710 comp rx=0 tx=0).stop 2024-04-25T01:44:37.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.204+0000 7f97fbc4d640 1 -- 172.21.15.77:0/1745994345 shutdown_connections 2024-04-25T01:44:37.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.204+0000 7f97fbc4d640 1 --2- 172.21.15.77:0/1745994345 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f97d806be30 0x7f97d806e2f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.204+0000 7f97fbc4d640 1 --2- 172.21.15.77:0/1745994345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f4156c80 0x7f97f41514c0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.204+0000 7f97fbc4d640 1 --2- 172.21.15.77:0/1745994345 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f97f4150090 0x7f97f41e9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.204+0000 7f97fbc4d640 1 --2- 172.21.15.77:0/1745994345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97f406c280 0x7f97f41e8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.204+0000 7f97fbc4d640 1 -- 172.21.15.77:0/1745994345 >> 172.21.15.77:0/1745994345 conn(0x7f97f40ad4d0 msgr2=0x7f97f40cab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:37.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.204+0000 7f97fbc4d640 1 -- 172.21.15.77:0/1745994345 shutdown_connections 2024-04-25T01:44:37.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.204+0000 7f97fbc4d640 1 -- 172.21.15.77:0/1745994345 wait complete. 2024-04-25T01:44:37.207 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:44:37.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.311+0000 7f1bc05b0640 1 Processor -- start 2024-04-25T01:44:37.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.311+0000 7f1bc05b0640 1 -- start start 2024-04-25T01:44:37.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.312+0000 7f1bc05b0640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1bb80c38d0 0x7f1bb8156170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:37.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.312+0000 7f1bc05b0640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1bb814fdd0 0x7f1bb806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:37.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.312+0000 7f1bc05b0640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bb80c2cb0 con 0x7f1bb80ad3a0 2024-04-25T01:44:37.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.312+0000 7f1bc05b0640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f1bb80c30e0 con 0x7f1bb80c38d0 2024-04-25T01:44:37.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.312+0000 7f1bc05b0640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb8152f80 con 0x7f1bb814fdd0 2024-04-25T01:44:37.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.312+0000 7f1bbeb4d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1bb814fdd0 0x7f1bb806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:37.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.312+0000 7f1bbdb4b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1bb80c38d0 0x7f1bb8156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:37.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.312+0000 7f1bbe34c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f1bb80ad3a0 0x7f1bb8155a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.77:56482/0 (socket says 172.21.15.77:56482) 2024-04-25T01:44:37.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.312+0000 7f1bbe34c640 1 -- 172.21.15.77:0/3579305074 learned_addr learned my addr 172.21.15.77:0/3579305074 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:44:37.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.312+0000 7f1bbeb4d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1bb814fdd0 0x7f1bb806d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.77:55444/0 (socket says 172.21.15.77:55444) 2024-04-25T01:44:37.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.313+0000 7f1bbdb4b640 1 -- 172.21.15.77:0/3579305074 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1bb814fdd0 msgr2=0x7f1bb806d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:37.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.313+0000 7f1bbdb4b640 1 --2- 172.21.15.77:0/3579305074 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1bb814fdd0 0x7f1bb806d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.313+0000 7f1bbdb4b640 1 -- 172.21.15.77:0/3579305074 >> v1:172.21.15.121:6789/0 conn(0x7f1bb80ad3a0 legacy=0x7f1bb8155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:37.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.313+0000 7f1bbdb4b640 1 -- 172.21.15.77:0/3579305074 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb8153260 con 0x7f1bb80c38d0 2024-04-25T01:44:37.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.313+0000 7f1bbd34a640 1 -- 172.21.15.77:0/3579305074 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3866876589 0 0) 0x7f1bb80c2cb0 con 0x7f1bb80ad3a0 2024-04-25T01:44:37.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.313+0000 7f1bbeb4d640 1 --2- 172.21.15.77:0/3579305074 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1bb814fdd0 0x7f1bb806d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T01:44:37.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.314+0000 7f1bbdb4b640 1 --2- 172.21.15.77:0/3579305074 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bb80c38d0 0x7f1bb8156170 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1ba80097a0 tx=0x7f1ba802a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3fb58c925194ae8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:37.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.314+0000 7f1bbd34a640 1 -- 172.21.15.77:0/3579305074 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba8037070 con 0x7f1bb80c38d0 2024-04-25T01:44:37.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.314+0000 7f1bbd34a640 1 -- 172.21.15.77:0/3579305074 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1ba802adb0 con 0x7f1bb80c38d0 2024-04-25T01:44:37.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.314+0000 7f1bbd34a640 1 -- 172.21.15.77:0/3579305074 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba8032680 con 0x7f1bb80c38d0 2024-04-25T01:44:37.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.314+0000 7f1bc05b0640 1 -- 172.21.15.77:0/3579305074 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bb80c38d0 msgr2=0x7f1bb8156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:37.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.314+0000 7f1bc05b0640 1 --2- 172.21.15.77:0/3579305074 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bb80c38d0 0x7f1bb8156170 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1ba80097a0 tx=0x7f1ba802a060 comp rx=0 tx=0).stop 2024-04-25T01:44:37.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.314+0000 7f1bc05b0640 1 -- 172.21.15.77:0/3579305074 shutdown_connections 2024-04-25T01:44:37.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.314+0000 7f1bc05b0640 1 --2- 172.21.15.77:0/3579305074 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1bb814fdd0 0x7f1bb806d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.314+0000 7f1bc05b0640 1 --2- 172.21.15.77:0/3579305074 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bb80c38d0 0x7f1bb8156170 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.314+0000 7f1bc05b0640 1 -- 172.21.15.77:0/3579305074 >> 172.21.15.77:0/3579305074 conn(0x7f1bb80c3f80 msgr2=0x7f1bb80c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:37.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.314+0000 7f1bc05b0640 1 -- 172.21.15.77:0/3579305074 shutdown_connections 2024-04-25T01:44:37.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.314+0000 7f1bc05b0640 1 -- 172.21.15.77:0/3579305074 wait complete. 2024-04-25T01:44:37.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.315+0000 7f1bc05b0640 1 Processor -- start 2024-04-25T01:44:37.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.315+0000 7f1bc05b0640 1 -- start start 2024-04-25T01:44:37.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.316+0000 7f1bc05b0640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1bb80ad3a0 0x7f1bb8153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:37.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.316+0000 7f1bc05b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bb80c38d0 0x7f1bb8154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:37.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.316+0000 7f1bc05b0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bb814fdd0 0x7f1bb8151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:37.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.316+0000 7f1bc05b0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb80c28f0 con 0x7f1bb80c38d0 2024-04-25T01:44:37.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.316+0000 7f1bc05b0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb81566b0 con 0x7f1bb814fdd0 2024-04-25T01:44:37.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.316+0000 7f1bc05b0640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb80c2a70 con 0x7f1bb80ad3a0 2024-04-25T01:44:37.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.316+0000 7f1bbdb4b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bb80c38d0 0x7f1bb8154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:37.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.316+0000 7f1bbdb4b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bb80c38d0 0x7f1bb8154230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49488/0 (socket says 172.21.15.77:49488) 2024-04-25T01:44:37.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.316+0000 7f1bbdb4b640 1 -- 172.21.15.77:0/139168642 learned_addr learned my addr 172.21.15.77:0/139168642 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:37.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.316+0000 7f1bbeb4d640 1 --2- 172.21.15.77:0/139168642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bb814fdd0 0x7f1bb8151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:37.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.316+0000 7f1bbe34c640 1 --2- 172.21.15.77:0/139168642 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1bb80ad3a0 0x7f1bb8153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:37.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.317+0000 7f1bbdb4b640 1 -- 172.21.15.77:0/139168642 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1bb80ad3a0 msgr2=0x7f1bb8153cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:37.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.317+0000 7f1bbdb4b640 1 --2- 172.21.15.77:0/139168642 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1bb80ad3a0 0x7f1bb8153cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.317+0000 7f1bbdb4b640 1 -- 172.21.15.77:0/139168642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bb814fdd0 msgr2=0x7f1bb8151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:37.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.317+0000 7f1bbdb4b640 1 --2- 172.21.15.77:0/139168642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bb814fdd0 0x7f1bb8151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.317+0000 7f1bbdb4b640 1 -- 172.21.15.77:0/139168642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb8155450 con 0x7f1bb80c38d0 2024-04-25T01:44:37.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.317+0000 7f1bbeb4d640 1 --2- 172.21.15.77:0/139168642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bb814fdd0 0x7f1bb8151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:44:37.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.317+0000 7f1bbdb4b640 1 --2- 172.21.15.77:0/139168642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bb80c38d0 0x7f1bb8154230 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8035040 tx=0x7f1ba80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:37.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.317+0000 7f1baeffd640 1 -- 172.21.15.77:0/139168642 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba8037040 con 0x7f1bb80c38d0 2024-04-25T01:44:37.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.317+0000 7f1baeffd640 1 -- 172.21.15.77:0/139168642 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1ba8004230 con 0x7f1bb80c38d0 2024-04-25T01:44:37.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.317+0000 7f1baeffd640 1 -- 172.21.15.77:0/139168642 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba8003610 con 0x7f1bb80c38d0 2024-04-25T01:44:37.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.317+0000 7f1bc05b0640 1 -- 172.21.15.77:0/139168642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bb8155110 con 0x7f1bb80c38d0 2024-04-25T01:44:37.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.317+0000 7f1bc05b0640 1 -- 172.21.15.77:0/139168642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bb81537d0 con 0x7f1bb80c38d0 2024-04-25T01:44:37.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.318+0000 7f1bc05b0640 1 -- 172.21.15.77:0/139168642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bb804f500 con 0x7f1bb80c38d0 2024-04-25T01:44:37.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.319+0000 7f1baeffd640 1 -- 172.21.15.77:0/139168642 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1ba802ac30 con 0x7f1bb80c38d0 2024-04-25T01:44:37.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.319+0000 7f1baeffd640 1 --2- 172.21.15.77:0/139168642 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1b9c06be30 0x7f1b9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:37.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.319+0000 7f1baeffd640 1 -- 172.21.15.77:0/139168642 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7153+0+0 (secure 0 0 0) 0x7f1ba80ac3c0 con 0x7f1bb80c38d0 2024-04-25T01:44:37.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.319+0000 7f1bbe34c640 1 --2- 172.21.15.77:0/139168642 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1b9c06be30 0x7f1b9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:37.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.319+0000 7f1bbe34c640 1 --2- 172.21.15.77:0/139168642 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1b9c06be30 0x7f1b9c06e2f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4000f60 tx=0x7f1bb4007b50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:37.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.323+0000 7f1baeffd640 1 -- 172.21.15.77:0/139168642 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1ba807a730 con 0x7f1bb80c38d0 2024-04-25T01:44:37.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.539+0000 7f1bc05b0640 1 -- 172.21.15.77:0/139168642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1bb8073750 con 0x7f1bb80c38d0 2024-04-25T01:44:37.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.539+0000 7f1baeffd640 1 -- 172.21.15.77:0/139168642 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+6485 (secure 0 0 0) 0x7f1ba807a030 con 0x7f1bb80c38d0 2024-04-25T01:44:37.531 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:44:37.531 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5964,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1289251527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1289251527},{"type":"v1","addr":"172.21.15.77:6835","nonce":1289251527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:23.701997+0000","modified":"2024-04-25T01:44:27.568589+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5622":{"gid":5622,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":14,"addr":"172.21.15.77:6837/1570919706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1570919706},{"type":"v1","addr":"172.21.15.77:6837","nonce":1570919706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5622,"qdb_cluster":[5622]},"id":1},{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:43:32.407370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":22,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5179,"qdb_cluster":[5179]},"id":2}]} 2024-04-25T01:44:37.532 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 38 2024-04-25T01:44:37.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.541+0000 7f1bc05b0640 1 -- 172.21.15.77:0/139168642 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1b9c06be30 msgr2=0x7f1b9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:37.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.541+0000 7f1bc05b0640 1 --2- 172.21.15.77:0/139168642 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1b9c06be30 0x7f1b9c06e2f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4000f60 tx=0x7f1bb4007b50 comp rx=0 tx=0).stop 2024-04-25T01:44:37.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.541+0000 7f1bc05b0640 1 -- 172.21.15.77:0/139168642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bb80c38d0 msgr2=0x7f1bb8154230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:37.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.541+0000 7f1bc05b0640 1 --2- 172.21.15.77:0/139168642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bb80c38d0 0x7f1bb8154230 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8035040 tx=0x7f1ba80046c0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.541+0000 7f1bc05b0640 1 -- 172.21.15.77:0/139168642 shutdown_connections 2024-04-25T01:44:37.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.541+0000 7f1bc05b0640 1 --2- 172.21.15.77:0/139168642 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f1b9c06be30 0x7f1b9c06e2f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.541+0000 7f1bc05b0640 1 --2- 172.21.15.77:0/139168642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bb80c38d0 0x7f1bb8154230 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.541+0000 7f1bc05b0640 1 --2- 172.21.15.77:0/139168642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bb814fdd0 0x7f1bb8151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.541+0000 7f1bc05b0640 1 --2- 172.21.15.77:0/139168642 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1bb80ad3a0 0x7f1bb8153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.541+0000 7f1bc05b0640 1 -- 172.21.15.77:0/139168642 >> 172.21.15.77:0/139168642 conn(0x7f1bb80c3f80 msgr2=0x7f1bb8072270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:37.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.542+0000 7f1bc05b0640 1 -- 172.21.15.77:0/139168642 shutdown_connections 2024-04-25T01:44:37.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.542+0000 7f1bc05b0640 1 -- 172.21.15.77:0/139168642 wait complete. 2024-04-25T01:44:37.545 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T01:44:37.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.650+0000 7f89323b0640 1 Processor -- start 2024-04-25T01:44:37.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.650+0000 7f89323b0640 1 -- start start 2024-04-25T01:44:37.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.651+0000 7f89323b0640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f892c06d0a0 0x7f892c06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:37.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.651+0000 7f89323b0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f892c154380 0x7f892c154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:37.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.651+0000 7f89323b0640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f892c153be0 con 0x7f892c150320 2024-04-25T01:44:37.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.651+0000 7f89323b0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f892c152fd0 con 0x7f892c154380 2024-04-25T01:44:37.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.651+0000 7f89323b0640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f892c1532b0 con 0x7f892c06d0a0 2024-04-25T01:44:37.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.651+0000 7f893094d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f892c154380 0x7f892c154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:37.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.651+0000 7f893094d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f892c154380 0x7f892c154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59342/0 (socket says 172.21.15.77:59342) 2024-04-25T01:44:37.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.651+0000 7f893094d640 1 -- 172.21.15.77:0/1305124075 learned_addr learned my addr 172.21.15.77:0/1305124075 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:37.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.651+0000 7f893094d640 1 -- 172.21.15.77:0/1305124075 >> v2:172.21.15.121:3300/0 conn(0x7f892c06d0a0 msgr2=0x7f892c06d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:37.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.651+0000 7f892b7fe640 1 --2- 172.21.15.77:0/1305124075 >> v2:172.21.15.121:3300/0 conn(0x7f892c06d0a0 0x7f892c06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:37.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.651+0000 7f893094d640 1 --2- 172.21.15.77:0/1305124075 >> v2:172.21.15.121:3300/0 conn(0x7f892c06d0a0 0x7f892c06d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.651+0000 7f893094d640 1 -- 172.21.15.77:0/1305124075 >> v1:172.21.15.121:6789/0 conn(0x7f892c150320 legacy=0x7f892c156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:37.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.651+0000 7f893094d640 1 -- 172.21.15.77:0/1305124075 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f892c153590 con 0x7f892c154380 2024-04-25T01:44:37.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.652+0000 7f893094d640 1 --2- 172.21.15.77:0/1305124075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f892c154380 0x7f892c154830 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f892c06e450 tx=0x7f892402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2991b56313f0c58e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:37.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.652+0000 7f892affd640 1 -- 172.21.15.77:0/1305124075 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924036070 con 0x7f892c154380 2024-04-25T01:44:37.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.652+0000 7f892affd640 1 -- 172.21.15.77:0/1305124075 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8924031600 con 0x7f892c154380 2024-04-25T01:44:37.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.652+0000 7f892affd640 1 -- 172.21.15.77:0/1305124075 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89240319f0 con 0x7f892c154380 2024-04-25T01:44:37.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.653+0000 7f89323b0640 1 -- 172.21.15.77:0/1305124075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f892c154380 msgr2=0x7f892c154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:37.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.653+0000 7f89323b0640 1 --2- 172.21.15.77:0/1305124075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f892c154380 0x7f892c154830 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f892c06e450 tx=0x7f892402a660 comp rx=0 tx=0).stop 2024-04-25T01:44:37.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.653+0000 7f89323b0640 1 -- 172.21.15.77:0/1305124075 shutdown_connections 2024-04-25T01:44:37.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.653+0000 7f89323b0640 1 --2- 172.21.15.77:0/1305124075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f892c154380 0x7f892c154830 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.653+0000 7f89323b0640 1 --2- 172.21.15.77:0/1305124075 >> v2:172.21.15.121:3300/0 conn(0x7f892c06d0a0 0x7f892c06d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.653+0000 7f89323b0640 1 -- 172.21.15.77:0/1305124075 >> 172.21.15.77:0/1305124075 conn(0x7f892c0c3f80 msgr2=0x7f892c0c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:37.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.653+0000 7f89323b0640 1 -- 172.21.15.77:0/1305124075 shutdown_connections 2024-04-25T01:44:37.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.653+0000 7f89323b0640 1 -- 172.21.15.77:0/1305124075 wait complete. 2024-04-25T01:44:37.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.654+0000 7f89323b0640 1 Processor -- start 2024-04-25T01:44:37.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.654+0000 7f89323b0640 1 -- start start 2024-04-25T01:44:37.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.655+0000 7f89323b0640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f892c06d0a0 0x7f892c0715d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:37.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.655+0000 7f89323b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f892c150320 0x7f892c0a7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:37.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.655+0000 7f89323b0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f892c154380 0x7f892c0a8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:37.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.655+0000 7f89323b0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f892c152d70 con 0x7f892c150320 2024-04-25T01:44:37.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.655+0000 7f89323b0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f892c152bf0 con 0x7f892c154380 2024-04-25T01:44:37.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.655+0000 7f89323b0640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f892c0c3100 con 0x7f892c06d0a0 2024-04-25T01:44:37.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.655+0000 7f892b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f892c150320 0x7f892c0a7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:37.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.655+0000 7f892b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f892c150320 0x7f892c0a7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59344/0 (socket says 172.21.15.77:59344) 2024-04-25T01:44:37.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.655+0000 7f892b7fe640 1 -- 172.21.15.77:0/1371847968 learned_addr learned my addr 172.21.15.77:0/1371847968 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:37.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.655+0000 7f893094d640 1 --2- 172.21.15.77:0/1371847968 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f892c154380 0x7f892c0a8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:37.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.655+0000 7f892bfff640 1 --2- 172.21.15.77:0/1371847968 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f892c06d0a0 0x7f892c0715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:37.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.655+0000 7f892b7fe640 1 -- 172.21.15.77:0/1371847968 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f892c06d0a0 msgr2=0x7f892c0715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:37.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.655+0000 7f892b7fe640 1 --2- 172.21.15.77:0/1371847968 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f892c06d0a0 0x7f892c0715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.655+0000 7f892b7fe640 1 -- 172.21.15.77:0/1371847968 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f892c154380 msgr2=0x7f892c0a8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:37.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.655+0000 7f892b7fe640 1 --2- 172.21.15.77:0/1371847968 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f892c154380 0x7f892c0a8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.655+0000 7f892b7fe640 1 -- 172.21.15.77:0/1371847968 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f892c0a8a70 con 0x7f892c150320 2024-04-25T01:44:37.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.655+0000 7f892b7fe640 1 --2- 172.21.15.77:0/1371847968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f892c150320 0x7f892c0a7ff0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f892000c820 tx=0x7f892000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:37.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.655+0000 7f8928ff9640 1 -- 172.21.15.77:0/1371847968 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8920004030 con 0x7f892c150320 2024-04-25T01:44:37.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.655+0000 7f8928ff9640 1 -- 172.21.15.77:0/1371847968 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f89200041d0 con 0x7f892c150320 2024-04-25T01:44:37.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.655+0000 7f89323b0640 1 -- 172.21.15.77:0/1371847968 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f892c0708c0 con 0x7f892c150320 2024-04-25T01:44:37.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.655+0000 7f8928ff9640 1 -- 172.21.15.77:0/1371847968 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8920007830 con 0x7f892c150320 2024-04-25T01:44:37.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.655+0000 7f89323b0640 1 -- 172.21.15.77:0/1371847968 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f892c1eb7c0 con 0x7f892c150320 2024-04-25T01:44:37.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.656+0000 7f89323b0640 1 -- 172.21.15.77:0/1371847968 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f892c04f500 con 0x7f892c150320 2024-04-25T01:44:37.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.657+0000 7f8928ff9640 1 -- 172.21.15.77:0/1371847968 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f89200079d0 con 0x7f892c150320 2024-04-25T01:44:37.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.657+0000 7f8928ff9640 1 --2- 172.21.15.77:0/1371847968 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f891806be60 0x7f891806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:37.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.657+0000 7f8928ff9640 1 -- 172.21.15.77:0/1371847968 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7153+0+0 (secure 0 0 0) 0x7f892008b2a0 con 0x7f892c150320 2024-04-25T01:44:37.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.657+0000 7f892bfff640 1 --2- 172.21.15.77:0/1371847968 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f891806be60 0x7f891806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:37.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.658+0000 7f892bfff640 1 --2- 172.21.15.77:0/1371847968 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f891806be60 0x7f891806e320 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f891c006fd0 tx=0x7f891c009060 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:37.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.662+0000 7f8928ff9640 1 -- 172.21.15.77:0/1371847968 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8920015020 con 0x7f892c150320 2024-04-25T01:44:37.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.838+0000 7f89323b0640 1 -- 172.21.15.77:0/1371847968 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f892c06bd20 con 0x7f892c150320 2024-04-25T01:44:37.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.840+0000 7f8928ff9640 1 -- 172.21.15.77:0/1371847968 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+21302 (secure 0 0 0) 0x7f892008b0c0 con 0x7f892c150320 2024-04-25T01:44:37.832 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:44:37.832 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":31,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:44:24.400948+0000","last_up_change":"2024-04-25T01:39:10.729600+0000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T01:39:11.681151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T01:39:21.606752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T01:39:22.677664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T01:39:30.501700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T01:39:31.740717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6811","nonce":3366980158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6817","nonce":3366980158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6828","nonce":3366980158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6825","nonce":3366980158}]},"public_addr":"172.21.15.77:6811/3366980158","cluster_addr":"172.21.15.77:6817/3366980158","heartbeat_back_addr":"172.21.15.77:6828/3366980158","heartbeat_front_addr":"172.21.15.77:6825/3366980158","state":["exists","up"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6801","nonce":3971619298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6803","nonce":3971619298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6807","nonce":3971619298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6805","nonce":3971619298}]},"public_addr":"172.21.15.77:6801/3971619298","cluster_addr":"172.21.15.77:6803/3971619298","heartbeat_back_addr":"172.21.15.77:6807/3971619298","heartbeat_front_addr":"172.21.15.77:6805/3971619298","state":["exists","up"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6810","nonce":4103452689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6813","nonce":4103452689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6823","nonce":4103452689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6818","nonce":4103452689}]},"public_addr":"172.21.15.77:6810/4103452689","cluster_addr":"172.21.15.77:6813/4103452689","heartbeat_back_addr":"172.21.15.77:6823/4103452689","heartbeat_front_addr":"172.21.15.77:6818/4103452689","state":["exists","up"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6819","nonce":217398906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6824","nonce":217398906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6831","nonce":217398906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6829","nonce":217398906}]},"public_addr":"172.21.15.77:6819/217398906","cluster_addr":"172.21.15.77:6824/217398906","heartbeat_back_addr":"172.21.15.77:6831/217398906","heartbeat_front_addr":"172.21.15.77:6829/217398906","state":["exists","up"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6801","nonce":2565483070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6803","nonce":2565483070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6810","nonce":2565483070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6806","nonce":2565483070}]},"public_addr":"172.21.15.121:6801/2565483070","cluster_addr":"172.21.15.121:6803/2565483070","heartbeat_back_addr":"172.21.15.121:6810/2565483070","heartbeat_front_addr":"172.21.15.121:6806/2565483070","state":["exists","up"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6807","nonce":2785294752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6809","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6811","nonce":2785294752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6815","nonce":2785294752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6813","nonce":2785294752}]},"public_addr":"172.21.15.121:6807/2785294752","cluster_addr":"172.21.15.121:6811/2785294752","heartbeat_back_addr":"172.21.15.121:6815/2785294752","heartbeat_front_addr":"172.21.15.121:6813/2785294752","state":["exists","up"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6820","nonce":523906818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6824","nonce":523906818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6831","nonce":523906818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6828","nonce":523906818}]},"public_addr":"172.21.15.121:6820/523906818","cluster_addr":"172.21.15.121:6824/523906818","heartbeat_back_addr":"172.21.15.121:6831/523906818","heartbeat_front_addr":"172.21.15.121:6828/523906818","state":["exists","up"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6817","nonce":1683602459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6819","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6821","nonce":1683602459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6829","nonce":1683602459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6823","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6825","nonce":1683602459}]},"public_addr":"172.21.15.121:6817/1683602459","cluster_addr":"172.21.15.121:6821/1683602459","heartbeat_back_addr":"172.21.15.121:6829/1683602459","heartbeat_front_addr":"172.21.15.121:6825/1683602459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.839443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.818842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.776243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.793085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.822396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.907311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.918374+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.848430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:6837/2398109146":"2024-04-26T01:43:29.392514+0000","172.21.15.77:6836/2398109146":"2024-04-26T01:43:29.392514+0000","172.21.15.121:6834/1039950655":"2024-04-26T01:42:04.378069+0000","172.21.15.77:6835/1958322306":"2024-04-26T01:41:34.373188+0000","172.21.15.77:6834/1958322306":"2024-04-26T01:41:34.373188+0000","172.21.15.121:6835/2449150984":"2024-04-26T01:41:34.373282+0000","172.21.15.77:6835/1935321501":"2024-04-26T01:44:24.400835+0000","172.21.15.121:6832/1039950655":"2024-04-26T01:42:04.378069+0000","172.21.15.121:6833/2449150984":"2024-04-26T01:41:34.373282+0000","172.21.15.77:6837/3454203695":"2024-04-26T01:40:59.368156+0000","172.21.15.77:6834/1935321501":"2024-04-26T01:44:24.400835+0000","172.21.15.77:6836/3454203695":"2024-04-26T01:40:59.368156+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:44:37.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.842+0000 7f89323b0640 1 -- 172.21.15.77:0/1371847968 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f891806be60 msgr2=0x7f891806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:37.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.842+0000 7f89323b0640 1 --2- 172.21.15.77:0/1371847968 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f891806be60 0x7f891806e320 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f891c006fd0 tx=0x7f891c009060 comp rx=0 tx=0).stop 2024-04-25T01:44:37.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.842+0000 7f89323b0640 1 -- 172.21.15.77:0/1371847968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f892c150320 msgr2=0x7f892c0a7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:37.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.842+0000 7f89323b0640 1 --2- 172.21.15.77:0/1371847968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f892c150320 0x7f892c0a7ff0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f892000c820 tx=0x7f892000cce0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.842+0000 7f89323b0640 1 -- 172.21.15.77:0/1371847968 shutdown_connections 2024-04-25T01:44:37.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.842+0000 7f89323b0640 1 --2- 172.21.15.77:0/1371847968 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f891806be60 0x7f891806e320 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.842+0000 7f89323b0640 1 --2- 172.21.15.77:0/1371847968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f892c150320 0x7f892c0a7ff0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.842+0000 7f89323b0640 1 --2- 172.21.15.77:0/1371847968 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f892c154380 0x7f892c0a8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.842+0000 7f89323b0640 1 --2- 172.21.15.77:0/1371847968 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f892c06d0a0 0x7f892c0715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.842+0000 7f89323b0640 1 -- 172.21.15.77:0/1371847968 >> 172.21.15.77:0/1371847968 conn(0x7f892c0c3f80 msgr2=0x7f892c143ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:37.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.842+0000 7f89323b0640 1 -- 172.21.15.77:0/1371847968 shutdown_connections 2024-04-25T01:44:37.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.842+0000 7f89323b0640 1 -- 172.21.15.77:0/1371847968 wait complete. 2024-04-25T01:44:37.845 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail a 2024-04-25T01:44:37.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.950+0000 7f655f8f5640 1 Processor -- start 2024-04-25T01:44:37.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.950+0000 7f655f8f5640 1 -- start start 2024-04-25T01:44:37.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.951+0000 7f655f8f5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f65580bef50 0x7f65581595f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:37.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.951+0000 7f655f8f5640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f65580c97c0 0x7f6558159b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:37.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.951+0000 7f655f8f5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f655806d110 con 0x7f6558153530 2024-04-25T01:44:37.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.951+0000 7f655f8f5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f6558153910 con 0x7f65580bef50 2024-04-25T01:44:37.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.951+0000 7f655f8f5640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f6558156980 con 0x7f65580c97c0 2024-04-25T01:44:37.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.951+0000 7f655ce90640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f65580bef50 0x7f65581595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:37.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.951+0000 7f655ce90640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f65580bef50 0x7f65581595f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59358/0 (socket says 172.21.15.77:59358) 2024-04-25T01:44:37.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.951+0000 7f655ce90640 1 -- 172.21.15.77:0/916080667 learned_addr learned my addr 172.21.15.77:0/916080667 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:37.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.951+0000 7f655de92640 1 --2- 172.21.15.77:0/916080667 >> v2:172.21.15.121:3300/0 conn(0x7f65580c97c0 0x7f6558159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:37.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.952+0000 7f655ce90640 1 -- 172.21.15.77:0/916080667 >> v2:172.21.15.121:3300/0 conn(0x7f65580c97c0 msgr2=0x7f6558159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:37.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.952+0000 7f655ce90640 1 --2- 172.21.15.77:0/916080667 >> v2:172.21.15.121:3300/0 conn(0x7f65580c97c0 0x7f6558159b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.952+0000 7f655ce90640 1 -- 172.21.15.77:0/916080667 >> v1:172.21.15.77:6789/0 conn(0x7f6558153530 legacy=0x7f65580c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:37.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.952+0000 7f654ffff640 1 -- 172.21.15.77:0/916080667 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1272896818 0 0) 0x7f655806d110 con 0x7f6558153530 2024-04-25T01:44:37.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.952+0000 7f655ce90640 1 -- 172.21.15.77:0/916080667 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6558156c60 con 0x7f65580bef50 2024-04-25T01:44:37.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.952+0000 7f655ce90640 1 --2- 172.21.15.77:0/916080667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65580bef50 0x7f65581595f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f655806c880 tx=0x7f654802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e69f7a70488c95 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:37.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.952+0000 7f654ffff640 1 -- 172.21.15.77:0/916080667 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6548004030 con 0x7f65580bef50 2024-04-25T01:44:37.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.952+0000 7f654ffff640 1 -- 172.21.15.77:0/916080667 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f65480041d0 con 0x7f65580bef50 2024-04-25T01:44:37.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.952+0000 7f654ffff640 1 -- 172.21.15.77:0/916080667 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6548003610 con 0x7f65580bef50 2024-04-25T01:44:37.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.953+0000 7f655f8f5640 1 -- 172.21.15.77:0/916080667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65580bef50 msgr2=0x7f65581595f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:37.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.953+0000 7f655f8f5640 1 --2- 172.21.15.77:0/916080667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65580bef50 0x7f65581595f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f655806c880 tx=0x7f654802a1c0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.953+0000 7f655f8f5640 1 -- 172.21.15.77:0/916080667 shutdown_connections 2024-04-25T01:44:37.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.953+0000 7f655f8f5640 1 --2- 172.21.15.77:0/916080667 >> v2:172.21.15.121:3300/0 conn(0x7f65580c97c0 0x7f6558159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.953+0000 7f655f8f5640 1 --2- 172.21.15.77:0/916080667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65580bef50 0x7f65581595f0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.953+0000 7f655f8f5640 1 -- 172.21.15.77:0/916080667 >> 172.21.15.77:0/916080667 conn(0x7f65580672c0 msgr2=0x7f65580676d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:37.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.953+0000 7f655f8f5640 1 -- 172.21.15.77:0/916080667 shutdown_connections 2024-04-25T01:44:37.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.953+0000 7f655f8f5640 1 -- 172.21.15.77:0/916080667 wait complete. 2024-04-25T01:44:37.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.954+0000 7f655f8f5640 1 Processor -- start 2024-04-25T01:44:37.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.954+0000 7f655f8f5640 1 -- start start 2024-04-25T01:44:37.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.955+0000 7f655f8f5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65580bef50 0x7f65581ef8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:37.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.955+0000 7f655f8f5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65580c97c0 0x7f6558150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:37.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.955+0000 7f655f8f5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6558153530 0x7f65580c4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:37.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.955+0000 7f655f8f5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f65580c6950 con 0x7f65580c97c0 2024-04-25T01:44:37.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.955+0000 7f655f8f5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f65580cc250 con 0x7f65580bef50 2024-04-25T01:44:37.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.955+0000 7f655f8f5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f65580c6ad0 con 0x7f6558153530 2024-04-25T01:44:37.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.955+0000 7f655ce90640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65580c97c0 0x7f6558150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:37.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.955+0000 7f655ce90640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65580c97c0 0x7f6558150440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59370/0 (socket says 172.21.15.77:59370) 2024-04-25T01:44:37.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.955+0000 7f655ce90640 1 -- 172.21.15.77:0/4223459179 learned_addr learned my addr 172.21.15.77:0/4223459179 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:37.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.955+0000 7f655d691640 1 --2- 172.21.15.77:0/4223459179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65580bef50 0x7f65581ef8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:37.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.955+0000 7f655de92640 1 --2- 172.21.15.77:0/4223459179 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6558153530 0x7f65580c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:37.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.955+0000 7f655ce90640 1 -- 172.21.15.77:0/4223459179 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6558153530 msgr2=0x7f65580c4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:37.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.955+0000 7f655ce90640 1 --2- 172.21.15.77:0/4223459179 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6558153530 0x7f65580c4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.955+0000 7f655ce90640 1 -- 172.21.15.77:0/4223459179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65580bef50 msgr2=0x7f65581ef8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:37.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.955+0000 7f655ce90640 1 --2- 172.21.15.77:0/4223459179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65580bef50 0x7f65581ef8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:37.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.955+0000 7f655ce90640 1 -- 172.21.15.77:0/4223459179 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65581521d0 con 0x7f65580c97c0 2024-04-25T01:44:37.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.955+0000 7f655d691640 1 --2- 172.21.15.77:0/4223459179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65580bef50 0x7f65581ef8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:44:37.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.955+0000 7f655ce90640 1 --2- 172.21.15.77:0/4223459179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65580c97c0 0x7f6558150440 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6548000c00 tx=0x7f65480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:37.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.955+0000 7f654dffb640 1 -- 172.21.15.77:0/4223459179 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6548004030 con 0x7f65580c97c0 2024-04-25T01:44:37.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.956+0000 7f654dffb640 1 -- 172.21.15.77:0/4223459179 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6548005b90 con 0x7f65580c97c0 2024-04-25T01:44:37.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.956+0000 7f655f8f5640 1 -- 172.21.15.77:0/4223459179 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65581524b0 con 0x7f65580c97c0 2024-04-25T01:44:37.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.956+0000 7f654dffb640 1 -- 172.21.15.77:0/4223459179 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654803d650 con 0x7f65580c97c0 2024-04-25T01:44:37.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.956+0000 7f655f8f5640 1 -- 172.21.15.77:0/4223459179 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65580c3d90 con 0x7f65580c97c0 2024-04-25T01:44:37.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.957+0000 7f655f8f5640 1 -- 172.21.15.77:0/4223459179 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f655804f500 con 0x7f65580c97c0 2024-04-25T01:44:37.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.957+0000 7f654dffb640 1 -- 172.21.15.77:0/4223459179 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f654802ad10 con 0x7f65580c97c0 2024-04-25T01:44:37.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.957+0000 7f654dffb640 1 --2- 172.21.15.77:0/4223459179 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f653c06be60 0x7f653c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:37.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.958+0000 7f654dffb640 1 -- 172.21.15.77:0/4223459179 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7153+0+0 (secure 0 0 0) 0x7f65480ac170 con 0x7f65580c97c0 2024-04-25T01:44:37.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.958+0000 7f655d691640 1 --2- 172.21.15.77:0/4223459179 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f653c06be60 0x7f653c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:37.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.958+0000 7f655d691640 1 --2- 172.21.15.77:0/4223459179 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f653c06be60 0x7f653c06e320 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6550007fd0 tx=0x7f6550009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:37.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:37.962+0000 7f654dffb640 1 -- 172.21.15.77:0/4223459179 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f654804a030 con 0x7f65580c97c0 2024-04-25T01:44:38.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.171+0000 7f655f8f5640 1 -- 172.21.15.77:0/4223459179 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "a"} v 0) -- 0x7f655806cd20 con 0x7f65580c97c0 2024-04-25T01:44:38.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.173+0000 7f654dffb640 1 -- 172.21.15.77:0/4223459179 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "a"}]=0 a marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) ==== 151+0+0 (secure 0 0 0) 0x7f6548041030 con 0x7f65580c97c0 2024-04-25T01:44:38.165 INFO:teuthology.orchestra.run.smithi077.stderr:a marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T01:44:38.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.178+0000 7f655f8f5640 1 -- 172.21.15.77:0/4223459179 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f653c06be60 msgr2=0x7f653c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:38.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.178+0000 7f655f8f5640 1 --2- 172.21.15.77:0/4223459179 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f653c06be60 0x7f653c06e320 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6550007fd0 tx=0x7f6550009040 comp rx=0 tx=0).stop 2024-04-25T01:44:38.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.178+0000 7f655f8f5640 1 -- 172.21.15.77:0/4223459179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65580c97c0 msgr2=0x7f6558150440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:38.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.178+0000 7f655f8f5640 1 --2- 172.21.15.77:0/4223459179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65580c97c0 0x7f6558150440 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6548000c00 tx=0x7f65480046c0 comp rx=0 tx=0).stop 2024-04-25T01:44:38.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.178+0000 7f655f8f5640 1 -- 172.21.15.77:0/4223459179 shutdown_connections 2024-04-25T01:44:38.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.178+0000 7f655f8f5640 1 --2- 172.21.15.77:0/4223459179 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f653c06be60 0x7f653c06e320 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:38.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.178+0000 7f655f8f5640 1 --2- 172.21.15.77:0/4223459179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65580c97c0 0x7f6558150440 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:38.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.178+0000 7f655f8f5640 1 --2- 172.21.15.77:0/4223459179 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6558153530 0x7f65580c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:38.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.178+0000 7f655f8f5640 1 --2- 172.21.15.77:0/4223459179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65580bef50 0x7f65581ef8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:38.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.178+0000 7f655f8f5640 1 -- 172.21.15.77:0/4223459179 >> 172.21.15.77:0/4223459179 conn(0x7f65580672c0 msgr2=0x7f65580676a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:38.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.178+0000 7f655f8f5640 1 -- 172.21.15.77:0/4223459179 shutdown_connections 2024-04-25T01:44:38.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.178+0000 7f655f8f5640 1 -- 172.21.15.77:0/4223459179 wait complete. 2024-04-25T01:44:38.178 INFO:tasks.ceph.mds.c.smithi077.stderr: -232> 2024-04-25T01:44:32.436+0000 7f07ae3f2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T01:44:38.181 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm a --yes-i-really-mean-it 2024-04-25T01:44:38.204 INFO:tasks.ceph.mds.c.smithi077.stdout:starting mds.c at 2024-04-25T01:44:38.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.288+0000 7f61d5dee640 1 Processor -- start 2024-04-25T01:44:38.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.288+0000 7f61d5dee640 1 -- start start 2024-04-25T01:44:38.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.289+0000 7f61d5dee640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61d00c3b40 0x7f61d00c1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:38.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.289+0000 7f61d5dee640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f61d00c1fe0 0x7f61d00c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:38.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.289+0000 7f61d5dee640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61d00c6de0 con 0x7f61d00c1270 2024-04-25T01:44:38.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.289+0000 7f61d5dee640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f61d00c1b90 con 0x7f61d00c1fe0 2024-04-25T01:44:38.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.289+0000 7f61d5dee640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f61d00c7580 con 0x7f61d00c3b40 2024-04-25T01:44:38.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.289+0000 7f61cffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f61d00c1fe0 0x7f61d00c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:38.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.289+0000 7f61cffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f61d00c1fe0 0x7f61d00c5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59392/0 (socket says 172.21.15.77:59392) 2024-04-25T01:44:38.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.289+0000 7f61cffff640 1 -- 172.21.15.77:0/1578641745 learned_addr learned my addr 172.21.15.77:0/1578641745 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:38.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.289+0000 7f61ceffd640 1 --2- 172.21.15.77:0/1578641745 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61d00c3b40 0x7f61d00c1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:38.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.289+0000 7f61cffff640 1 -- 172.21.15.77:0/1578641745 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61d00c3b40 msgr2=0x7f61d00c1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:38.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.289+0000 7f61cffff640 1 --2- 172.21.15.77:0/1578641745 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61d00c3b40 0x7f61d00c1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:38.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.289+0000 7f61cffff640 1 -- 172.21.15.77:0/1578641745 >> v1:172.21.15.121:6789/0 conn(0x7f61d00c1270 legacy=0x7f61d00c3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:38.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.289+0000 7f61cffff640 1 -- 172.21.15.77:0/1578641745 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d00c7860 con 0x7f61d00c1fe0 2024-04-25T01:44:38.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.289+0000 7f61ceffd640 1 --2- 172.21.15.77:0/1578641745 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61d00c3b40 0x7f61d00c1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:44:38.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.290+0000 7f61cffff640 1 --2- 172.21.15.77:0/1578641745 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d00c1fe0 0x7f61d00c5b10 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009e50 tx=0x7f61c802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18f16d65c0c52cb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:38.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.290+0000 7f61ce7fc640 1 -- 172.21.15.77:0/1578641745 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c8036070 con 0x7f61d00c1fe0 2024-04-25T01:44:38.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.290+0000 7f61ce7fc640 1 -- 172.21.15.77:0/1578641745 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f61c8031600 con 0x7f61d00c1fe0 2024-04-25T01:44:38.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.290+0000 7f61ce7fc640 1 -- 172.21.15.77:0/1578641745 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c80319f0 con 0x7f61d00c1fe0 2024-04-25T01:44:38.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.291+0000 7f61d5dee640 1 -- 172.21.15.77:0/1578641745 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d00c1fe0 msgr2=0x7f61d00c5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:38.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.291+0000 7f61d5dee640 1 --2- 172.21.15.77:0/1578641745 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d00c1fe0 0x7f61d00c5b10 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009e50 tx=0x7f61c802a710 comp rx=0 tx=0).stop 2024-04-25T01:44:38.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.291+0000 7f61d5dee640 1 -- 172.21.15.77:0/1578641745 shutdown_connections 2024-04-25T01:44:38.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.291+0000 7f61d5dee640 1 --2- 172.21.15.77:0/1578641745 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d00c1fe0 0x7f61d00c5b10 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:38.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.291+0000 7f61d5dee640 1 --2- 172.21.15.77:0/1578641745 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61d00c3b40 0x7f61d00c1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:38.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.291+0000 7f61d5dee640 1 -- 172.21.15.77:0/1578641745 >> 172.21.15.77:0/1578641745 conn(0x7f61d00c46d0 msgr2=0x7f61d00c4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:38.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.291+0000 7f61d5dee640 1 -- 172.21.15.77:0/1578641745 shutdown_connections 2024-04-25T01:44:38.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.291+0000 7f61d5dee640 1 -- 172.21.15.77:0/1578641745 wait complete. 2024-04-25T01:44:38.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.292+0000 7f61d5dee640 1 Processor -- start 2024-04-25T01:44:38.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.292+0000 7f61d5dee640 1 -- start start 2024-04-25T01:44:38.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.293+0000 7f61d5dee640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d00c1270 0x7f61d01e1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:38.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.293+0000 7f61d5dee640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61d00c1fe0 0x7f61d00714e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:38.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.293+0000 7f61d5dee640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61d00c3b40 0x7f61d0071a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:38.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.293+0000 7f61d5dee640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f61d006d980 con 0x7f61d00c1270 2024-04-25T01:44:38.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.293+0000 7f61d5dee640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f61d00a7300 con 0x7f61d00c3b40 2024-04-25T01:44:38.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.293+0000 7f61d5dee640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f61d006db00 con 0x7f61d00c1fe0 2024-04-25T01:44:38.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.293+0000 7f61cf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d00c1270 0x7f61d01e1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:38.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.293+0000 7f61cf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d00c1270 0x7f61d01e1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59398/0 (socket says 172.21.15.77:59398) 2024-04-25T01:44:38.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.293+0000 7f61cf7fe640 1 -- 172.21.15.77:0/323352377 learned_addr learned my addr 172.21.15.77:0/323352377 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:38.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.293+0000 7f61ceffd640 1 --2- 172.21.15.77:0/323352377 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61d00c1fe0 0x7f61d00714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:38.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.293+0000 7f61cffff640 1 --2- 172.21.15.77:0/323352377 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61d00c3b40 0x7f61d0071a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:38.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.293+0000 7f61cf7fe640 1 -- 172.21.15.77:0/323352377 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61d00c1fe0 msgr2=0x7f61d00714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:38.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.293+0000 7f61cf7fe640 1 --2- 172.21.15.77:0/323352377 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61d00c1fe0 0x7f61d00714e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:38.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.293+0000 7f61cf7fe640 1 -- 172.21.15.77:0/323352377 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61d00c3b40 msgr2=0x7f61d0071a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:38.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.293+0000 7f61cf7fe640 1 --2- 172.21.15.77:0/323352377 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61d00c3b40 0x7f61d0071a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:38.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.293+0000 7f61cf7fe640 1 -- 172.21.15.77:0/323352377 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d01eb830 con 0x7f61d00c1270 2024-04-25T01:44:38.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.293+0000 7f61ceffd640 1 --2- 172.21.15.77:0/323352377 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61d00c1fe0 0x7f61d00714e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:44:38.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.293+0000 7f61cffff640 1 --2- 172.21.15.77:0/323352377 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61d00c3b40 0x7f61d0071a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:44:38.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.293+0000 7f61cf7fe640 1 --2- 172.21.15.77:0/323352377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d00c1270 0x7f61d01e1670 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f61c000c430 tx=0x7f61c000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:38.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.293+0000 7f61b7fff640 1 -- 172.21.15.77:0/323352377 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c00052d0 con 0x7f61d00c1270 2024-04-25T01:44:38.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.293+0000 7f61b7fff640 1 -- 172.21.15.77:0/323352377 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f61c0005490 con 0x7f61d00c1270 2024-04-25T01:44:38.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.293+0000 7f61d5dee640 1 -- 172.21.15.77:0/323352377 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61d01ebaf0 con 0x7f61d00c1270 2024-04-25T01:44:38.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.293+0000 7f61b7fff640 1 -- 172.21.15.77:0/323352377 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c0007280 con 0x7f61d00c1270 2024-04-25T01:44:38.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.293+0000 7f61d5dee640 1 -- 172.21.15.77:0/323352377 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61d01ec0b0 con 0x7f61d00c1270 2024-04-25T01:44:38.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.294+0000 7f61d5dee640 1 -- 172.21.15.77:0/323352377 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61d004f500 con 0x7f61d00c1270 2024-04-25T01:44:38.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.295+0000 7f61b7fff640 1 -- 172.21.15.77:0/323352377 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f61c0007420 con 0x7f61d00c1270 2024-04-25T01:44:38.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.295+0000 7f61b7fff640 1 --2- 172.21.15.77:0/323352377 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f61bc06be30 0x7f61bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:38.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.295+0000 7f61b7fff640 1 -- 172.21.15.77:0/323352377 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7239+0+0 (secure 0 0 0) 0x7f61c008aa70 con 0x7f61d00c1270 2024-04-25T01:44:38.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.295+0000 7f61ceffd640 1 --2- 172.21.15.77:0/323352377 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f61bc06be30 0x7f61bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:38.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.296+0000 7f61ceffd640 1 --2- 172.21.15.77:0/323352377 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f61bc06be30 0x7f61bc06e2f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f61c4006fd0 tx=0x7f61c4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:38.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.299+0000 7f61b7fff640 1 -- 172.21.15.77:0/323352377 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f61c0058d90 con 0x7f61d00c1270 2024-04-25T01:44:38.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:38.513+0000 7f61d5dee640 1 -- 172.21.15.77:0/323352377 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "a", "yes_i_really_mean_it": true} v 0) -- 0x7f61d0157810 con 0x7f61d00c1270 2024-04-25T01:44:39.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.174+0000 7f61b7fff640 1 -- 172.21.15.77:0/323352377 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "a", "yes_i_really_mean_it": true}]=0 v40) ==== 99+0+0 (secure 0 0 0) 0x7f61c0058690 con 0x7f61d00c1270 2024-04-25T01:44:39.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.177+0000 7f61d5dee640 1 -- 172.21.15.77:0/323352377 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f61bc06be30 msgr2=0x7f61bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:39.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.177+0000 7f61d5dee640 1 --2- 172.21.15.77:0/323352377 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f61bc06be30 0x7f61bc06e2f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f61c4006fd0 tx=0x7f61c4008040 comp rx=0 tx=0).stop 2024-04-25T01:44:39.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.177+0000 7f61d5dee640 1 -- 172.21.15.77:0/323352377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d00c1270 msgr2=0x7f61d01e1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:39.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.177+0000 7f61d5dee640 1 --2- 172.21.15.77:0/323352377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d00c1270 0x7f61d01e1670 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f61c000c430 tx=0x7f61c000c8f0 comp rx=0 tx=0).stop 2024-04-25T01:44:39.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.177+0000 7f61d5dee640 1 -- 172.21.15.77:0/323352377 shutdown_connections 2024-04-25T01:44:39.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.177+0000 7f61d5dee640 1 --2- 172.21.15.77:0/323352377 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f61bc06be30 0x7f61bc06e2f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:39.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.177+0000 7f61d5dee640 1 --2- 172.21.15.77:0/323352377 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61d00c3b40 0x7f61d0071a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:39.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.177+0000 7f61d5dee640 1 --2- 172.21.15.77:0/323352377 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61d00c1fe0 0x7f61d00714e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:39.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.177+0000 7f61d5dee640 1 --2- 172.21.15.77:0/323352377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d00c1270 0x7f61d01e1670 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:39.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.177+0000 7f61d5dee640 1 -- 172.21.15.77:0/323352377 >> 172.21.15.77:0/323352377 conn(0x7f61d00c46d0 msgr2=0x7f61d0150600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:39.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.178+0000 7f61d5dee640 1 -- 172.21.15.77:0/323352377 shutdown_connections 2024-04-25T01:44:39.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.178+0000 7f61d5dee640 1 -- 172.21.15.77:0/323352377 wait complete. 2024-04-25T01:44:39.183 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm a_metadata a_metadata --yes-i-really-really-mean-it 2024-04-25T01:44:39.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.334+0000 7f895e0a5640 1 Processor -- start 2024-04-25T01:44:39.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.334+0000 7f895e0a5640 1 -- start start 2024-04-25T01:44:39.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.334+0000 7f895e0a5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8958072dd0 0x7f8958073300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:39.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.334+0000 7f895e0a5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89580c2980 0x7f895806da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:39.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.335+0000 7f895e0a5640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8958152c20 con 0x7f8958072740 2024-04-25T01:44:39.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.335+0000 7f895e0a5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f8958156490 con 0x7f8958072dd0 2024-04-25T01:44:39.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.335+0000 7f895e0a5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f8958156770 con 0x7f89580c2980 2024-04-25T01:44:39.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.335+0000 7f8956ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8958072dd0 0x7f8958073300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:39.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.335+0000 7f8956ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8958072dd0 0x7f8958073300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59402/0 (socket says 172.21.15.77:59402) 2024-04-25T01:44:39.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.335+0000 7f8956ffd640 1 -- 172.21.15.77:0/3772697999 learned_addr learned my addr 172.21.15.77:0/3772697999 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:39.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.335+0000 7f8957fff640 1 --2- 172.21.15.77:0/3772697999 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89580c2980 0x7f895806da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:39.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.335+0000 7f8956ffd640 1 -- 172.21.15.77:0/3772697999 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89580c2980 msgr2=0x7f895806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:39.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.335+0000 7f8956ffd640 1 --2- 172.21.15.77:0/3772697999 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89580c2980 0x7f895806da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:39.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.335+0000 7f8956ffd640 1 -- 172.21.15.77:0/3772697999 >> v1:172.21.15.121:6789/0 conn(0x7f8958072740 legacy=0x7f8958152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:39.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.335+0000 7f8956ffd640 1 -- 172.21.15.77:0/3772697999 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89580c38d0 con 0x7f8958072dd0 2024-04-25T01:44:39.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.336+0000 7f8956ffd640 1 --2- 172.21.15.77:0/3772697999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8958072dd0 0x7f8958073300 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f8948009870 tx=0x7f894802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394b04a1730eb940 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:39.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.336+0000 7f89567fc640 1 -- 172.21.15.77:0/3772697999 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8948037070 con 0x7f8958072dd0 2024-04-25T01:44:39.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.336+0000 7f89567fc640 1 -- 172.21.15.77:0/3772697999 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8948032440 con 0x7f8958072dd0 2024-04-25T01:44:39.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.336+0000 7f89567fc640 1 -- 172.21.15.77:0/3772697999 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8948032830 con 0x7f8958072dd0 2024-04-25T01:44:39.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.336+0000 7f895e0a5640 1 -- 172.21.15.77:0/3772697999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8958072dd0 msgr2=0x7f8958073300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:39.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.336+0000 7f895e0a5640 1 --2- 172.21.15.77:0/3772697999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8958072dd0 0x7f8958073300 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f8948009870 tx=0x7f894802a130 comp rx=0 tx=0).stop 2024-04-25T01:44:39.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.336+0000 7f895e0a5640 1 -- 172.21.15.77:0/3772697999 shutdown_connections 2024-04-25T01:44:39.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.336+0000 7f895e0a5640 1 --2- 172.21.15.77:0/3772697999 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89580c2980 0x7f895806da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:39.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.336+0000 7f895e0a5640 1 --2- 172.21.15.77:0/3772697999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8958072dd0 0x7f8958073300 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:39.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.336+0000 7f895e0a5640 1 -- 172.21.15.77:0/3772697999 >> 172.21.15.77:0/3772697999 conn(0x7f89580a9230 msgr2=0x7f89580a9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:39.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.336+0000 7f895e0a5640 1 -- 172.21.15.77:0/3772697999 shutdown_connections 2024-04-25T01:44:39.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.336+0000 7f895e0a5640 1 -- 172.21.15.77:0/3772697999 wait complete. 2024-04-25T01:44:39.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.337+0000 7f895e0a5640 1 Processor -- start 2024-04-25T01:44:39.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.338+0000 7f895e0a5640 1 -- start start 2024-04-25T01:44:39.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.338+0000 7f895e0a5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8958072740 0x7f895814c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:39.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.338+0000 7f895e0a5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8958072dd0 0x7f89580c0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:39.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.338+0000 7f895e0a5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89580c2980 0x7f89580712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:39.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.338+0000 7f895e0a5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f89580c34e0 con 0x7f8958072dd0 2024-04-25T01:44:39.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.338+0000 7f895e0a5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f89580c3200 con 0x7f8958072740 2024-04-25T01:44:39.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.338+0000 7f895e0a5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f8958072b20 con 0x7f89580c2980 2024-04-25T01:44:39.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.338+0000 7f8956ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8958072dd0 0x7f89580c0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:39.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.338+0000 7f8956ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8958072dd0 0x7f89580c0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59406/0 (socket says 172.21.15.77:59406) 2024-04-25T01:44:39.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.338+0000 7f8956ffd640 1 -- 172.21.15.77:0/3747084769 learned_addr learned my addr 172.21.15.77:0/3747084769 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:39.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.339+0000 7f8957fff640 1 --2- 172.21.15.77:0/3747084769 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89580c2980 0x7f89580712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:39.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.339+0000 7f89577fe640 1 --2- 172.21.15.77:0/3747084769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8958072740 0x7f895814c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:39.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.339+0000 7f8956ffd640 1 -- 172.21.15.77:0/3747084769 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89580c2980 msgr2=0x7f89580712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:39.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.339+0000 7f8956ffd640 1 --2- 172.21.15.77:0/3747084769 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89580c2980 0x7f89580712d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:39.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.339+0000 7f8956ffd640 1 -- 172.21.15.77:0/3747084769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8958072740 msgr2=0x7f895814c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:39.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.339+0000 7f8956ffd640 1 --2- 172.21.15.77:0/3747084769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8958072740 0x7f895814c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:39.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.339+0000 7f8956ffd640 1 -- 172.21.15.77:0/3747084769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8958153880 con 0x7f8958072dd0 2024-04-25T01:44:39.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.339+0000 7f8956ffd640 1 --2- 172.21.15.77:0/3747084769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8958072dd0 0x7f89580c0d50 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8948000c00 tx=0x7f89480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:39.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.339+0000 7f893ffff640 1 -- 172.21.15.77:0/3747084769 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8948037040 con 0x7f8958072dd0 2024-04-25T01:44:39.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.339+0000 7f893ffff640 1 -- 172.21.15.77:0/3747084769 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8948042070 con 0x7f8958072dd0 2024-04-25T01:44:39.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.339+0000 7f893ffff640 1 -- 172.21.15.77:0/3747084769 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89480309d0 con 0x7f8958072dd0 2024-04-25T01:44:39.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.339+0000 7f895e0a5640 1 -- 172.21.15.77:0/3747084769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8958155150 con 0x7f8958072dd0 2024-04-25T01:44:39.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.339+0000 7f895e0a5640 1 -- 172.21.15.77:0/3747084769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8958155710 con 0x7f8958072dd0 2024-04-25T01:44:39.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.340+0000 7f895e0a5640 1 -- 172.21.15.77:0/3747084769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8958075d10 con 0x7f8958072dd0 2024-04-25T01:44:39.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.340+0000 7f893ffff640 1 -- 172.21.15.77:0/3747084769 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8948030b70 con 0x7f8958072dd0 2024-04-25T01:44:39.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.341+0000 7f893ffff640 1 --2- 172.21.15.77:0/3747084769 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f894406be30 0x7f894406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:39.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.341+0000 7f893ffff640 1 -- 172.21.15.77:0/3747084769 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7239+0+0 (secure 0 0 0) 0x7f89480abe40 con 0x7f8958072dd0 2024-04-25T01:44:39.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.341+0000 7f89577fe640 1 --2- 172.21.15.77:0/3747084769 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f894406be30 0x7f894406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:39.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.341+0000 7f89577fe640 1 --2- 172.21.15.77:0/3747084769 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f894406be30 0x7f894406e2f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f894c001640 tx=0x7f894c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:39.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.345+0000 7f893ffff640 1 -- 172.21.15.77:0/3747084769 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f894807a1f0 con 0x7f8958072dd0 2024-04-25T01:44:39.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:39.517+0000 7f895e0a5640 1 -- 172.21.15.77:0/3747084769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "a_metadata", "pool2": "a_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f89580ab590 con 0x7f8958072dd0 2024-04-25T01:44:40.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.175+0000 7f893ffff640 1 -- 172.21.15.77:0/3747084769 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "a_metadata", "pool2": "a_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'a_metadata' removed v33) ==== 166+0+0 (secure 0 0 0) 0x7f8948079af0 con 0x7f8958072dd0 2024-04-25T01:44:40.168 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'a_metadata' removed 2024-04-25T01:44:40.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.179+0000 7f895e0a5640 1 -- 172.21.15.77:0/3747084769 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f894406be30 msgr2=0x7f894406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:40.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.179+0000 7f895e0a5640 1 --2- 172.21.15.77:0/3747084769 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f894406be30 0x7f894406e2f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f894c001640 tx=0x7f894c009040 comp rx=0 tx=0).stop 2024-04-25T01:44:40.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.179+0000 7f895e0a5640 1 -- 172.21.15.77:0/3747084769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8958072dd0 msgr2=0x7f89580c0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:40.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.179+0000 7f895e0a5640 1 --2- 172.21.15.77:0/3747084769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8958072dd0 0x7f89580c0d50 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8948000c00 tx=0x7f89480046c0 comp rx=0 tx=0).stop 2024-04-25T01:44:40.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.182+0000 7f895e0a5640 1 -- 172.21.15.77:0/3747084769 shutdown_connections 2024-04-25T01:44:40.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.182+0000 7f895e0a5640 1 --2- 172.21.15.77:0/3747084769 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f894406be30 0x7f894406e2f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:40.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.182+0000 7f895e0a5640 1 --2- 172.21.15.77:0/3747084769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8958072dd0 0x7f89580c0d50 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:40.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.182+0000 7f895e0a5640 1 --2- 172.21.15.77:0/3747084769 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89580c2980 0x7f89580712d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:40.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.182+0000 7f895e0a5640 1 --2- 172.21.15.77:0/3747084769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8958072740 0x7f895814c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:40.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.182+0000 7f895e0a5640 1 -- 172.21.15.77:0/3747084769 >> 172.21.15.77:0/3747084769 conn(0x7f89580a9230 msgr2=0x7f895814e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:40.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.184+0000 7f895e0a5640 1 -- 172.21.15.77:0/3747084769 shutdown_connections 2024-04-25T01:44:40.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.184+0000 7f895e0a5640 1 -- 172.21.15.77:0/3747084769 wait complete. 2024-04-25T01:44:40.190 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm a_data a_data --yes-i-really-really-mean-it 2024-04-25T01:44:40.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.306+0000 7f45e3970640 1 Processor -- start 2024-04-25T01:44:40.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.306+0000 7f45e3970640 1 -- start start 2024-04-25T01:44:40.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.307+0000 7f45e3970640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45dc152b90 0x7f45dc06d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:40.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.307+0000 7f45e3970640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45dc0c2f90 con 0x7f45dc06d0a0 2024-04-25T01:44:40.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.307+0000 7f45e3970640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45dc0c2380 con 0x7f45dc0c1e80 2024-04-25T01:44:40.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.307+0000 7f45e3970640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f45dc0c2660 con 0x7f45dc152b90 2024-04-25T01:44:40.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.307+0000 7f45e170c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f45dc06d0a0 0x7f45dc154360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50648/0 (socket says 172.21.15.77:50648) 2024-04-25T01:44:40.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.307+0000 7f45e170c640 1 -- 172.21.15.77:0/2259261989 learned_addr learned my addr 172.21.15.77:0/2259261989 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:44:40.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.307+0000 7f45d3fff640 1 -- 172.21.15.77:0/2259261989 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3557363020 0 0) 0x7f45dc0c2f90 con 0x7f45dc06d0a0 2024-04-25T01:44:40.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.307+0000 7f45e1f0d640 1 --2- 172.21.15.77:0/2259261989 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45dc152b90 0x7f45dc06d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:40.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.307+0000 7f45d3fff640 1 -- 172.21.15.77:0/2259261989 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45c8003520 con 0x7f45dc06d0a0 2024-04-25T01:44:40.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.308+0000 7f45d3fff640 1 -- 172.21.15.77:0/2259261989 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 708191806 0 0) 0x7f45c8003520 con 0x7f45dc06d0a0 2024-04-25T01:44:40.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.308+0000 7f45d3fff640 1 -- 172.21.15.77:0/2259261989 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45dc152b90 msgr2=0x7f45dc06d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:40.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.308+0000 7f45d3fff640 1 --2- 172.21.15.77:0/2259261989 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45dc152b90 0x7f45dc06d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:40.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.308+0000 7f45d3fff640 1 -- 172.21.15.77:0/2259261989 >> v1:172.21.15.121:6789/0 conn(0x7f45dc0c1e80 legacy=0x7f45dc154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:40.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.308+0000 7f45d3fff640 1 -- 172.21.15.77:0/2259261989 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45dc0c2940 con 0x7f45dc06d0a0 2024-04-25T01:44:40.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.308+0000 7f45d3fff640 1 -- 172.21.15.77:0/2259261989 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7f45d8001670 con 0x7f45dc06d0a0 2024-04-25T01:44:40.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.308+0000 7f45d3fff640 1 -- 172.21.15.77:0/2259261989 >> v1:172.21.15.77:6789/0 conn(0x7f45dc06d0a0 legacy=0x7f45dc154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:40.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.308+0000 7f45d3fff640 1 --2- 172.21.15.77:0/2259261989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45c8003a50 0x7f45c8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:40.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.308+0000 7f45d3fff640 1 --2- 172.21.15.77:0/2259261989 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45dc152b90 0x7f45c8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:40.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.308+0000 7f45d3fff640 1 --2- 172.21.15.77:0/2259261989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45c8004d40 0x7f45c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:40.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.308+0000 7f45d3fff640 1 -- 172.21.15.77:0/2259261989 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f45dc0c2660 con 0x7f45c8003a50 2024-04-25T01:44:40.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.308+0000 7f45d3fff640 1 -- 172.21.15.77:0/2259261989 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f45c800bb80 con 0x7f45c8004d40 2024-04-25T01:44:40.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.308+0000 7f45d3fff640 1 -- 172.21.15.77:0/2259261989 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f45c800df90 con 0x7f45dc152b90 2024-04-25T01:44:40.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.308+0000 7f45e170c640 1 --2- 172.21.15.77:0/2259261989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45c8003a50 0x7f45c8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:40.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.308+0000 7f45e0f0b640 1 --2- 172.21.15.77:0/2259261989 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45dc152b90 0x7f45c8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:40.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.308+0000 7f45e1f0d640 1 --2- 172.21.15.77:0/2259261989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45c8004d40 0x7f45c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:40.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.308+0000 7f45e170c640 1 -- 172.21.15.77:0/2259261989 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45dc152b90 msgr2=0x7f45c8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:40.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.308+0000 7f45e170c640 1 --2- 172.21.15.77:0/2259261989 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45dc152b90 0x7f45c8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:40.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.308+0000 7f45e170c640 1 -- 172.21.15.77:0/2259261989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45c8004d40 msgr2=0x7f45c80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:40.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.308+0000 7f45e170c640 1 --2- 172.21.15.77:0/2259261989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45c8004d40 0x7f45c80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:40.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.308+0000 7f45e170c640 1 -- 172.21.15.77:0/2259261989 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c8003520 con 0x7f45c8003a50 2024-04-25T01:44:40.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.308+0000 7f45e1f0d640 1 --2- 172.21.15.77:0/2259261989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45c8004d40 0x7f45c80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:44:40.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.309+0000 7f45e170c640 1 --2- 172.21.15.77:0/2259261989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45c8003a50 0x7f45c8003e30 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f45d800c190 tx=0x7f45c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a896955049f1d33e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:40.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.309+0000 7f45d3fff640 1 -- 172.21.15.77:0/2259261989 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d8007cc0 con 0x7f45c8003a50 2024-04-25T01:44:40.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.309+0000 7f45d3fff640 1 -- 172.21.15.77:0/2259261989 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f45d8005ad0 con 0x7f45c8003a50 2024-04-25T01:44:40.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.309+0000 7f45d3fff640 1 -- 172.21.15.77:0/2259261989 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d8007070 con 0x7f45c8003a50 2024-04-25T01:44:40.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.309+0000 7f45e3970640 1 -- 172.21.15.77:0/2259261989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45c8003a50 msgr2=0x7f45c8003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:40.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.309+0000 7f45e3970640 1 --2- 172.21.15.77:0/2259261989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45c8003a50 0x7f45c8003e30 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f45d800c190 tx=0x7f45c8005830 comp rx=0 tx=0).stop 2024-04-25T01:44:40.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.309+0000 7f45e1f0d640 1 -- 172.21.15.77:0/2259261989 reap_dead start 2024-04-25T01:44:40.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.309+0000 7f45e3970640 1 -- 172.21.15.77:0/2259261989 shutdown_connections 2024-04-25T01:44:40.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.309+0000 7f45e3970640 1 -- 172.21.15.77:0/2259261989 >> 172.21.15.77:0/2259261989 conn(0x7f45dc0a9230 msgr2=0x7f45dc0a9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:40.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.309+0000 7f45e3970640 1 -- 172.21.15.77:0/2259261989 shutdown_connections 2024-04-25T01:44:40.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.309+0000 7f45e3970640 1 -- 172.21.15.77:0/2259261989 wait complete. 2024-04-25T01:44:40.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.310+0000 7f45e3970640 1 Processor -- start 2024-04-25T01:44:40.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.311+0000 7f45e3970640 1 -- start start 2024-04-25T01:44:40.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.311+0000 7f45e3970640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45c8003a50 0x7f45dc14f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:40.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.311+0000 7f45e3970640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45dc0bc4a0 0x7f45dc1eb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:40.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.311+0000 7f45e3970640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45dc1eb8a0 0x7f45dc0c0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:40.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.311+0000 7f45e3970640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f45dc155e90 con 0x7f45dc0bc4a0 2024-04-25T01:44:40.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.311+0000 7f45e3970640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f45dc06c4a0 con 0x7f45c8003a50 2024-04-25T01:44:40.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.311+0000 7f45e3970640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f45dc06d480 con 0x7f45dc1eb8a0 2024-04-25T01:44:40.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.311+0000 7f45e0f0b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45dc0bc4a0 0x7f45dc1eb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:40.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.311+0000 7f45e0f0b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45dc0bc4a0 0x7f45dc1eb360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59424/0 (socket says 172.21.15.77:59424) 2024-04-25T01:44:40.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.311+0000 7f45e0f0b640 1 -- 172.21.15.77:0/1213936847 learned_addr learned my addr 172.21.15.77:0/1213936847 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:40.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.311+0000 7f45e1f0d640 1 --2- 172.21.15.77:0/1213936847 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45dc1eb8a0 0x7f45dc0c0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:40.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.311+0000 7f45e170c640 1 --2- 172.21.15.77:0/1213936847 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45c8003a50 0x7f45dc14f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:40.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.312+0000 7f45e0f0b640 1 -- 172.21.15.77:0/1213936847 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45dc1eb8a0 msgr2=0x7f45dc0c0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:40.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.312+0000 7f45e0f0b640 1 --2- 172.21.15.77:0/1213936847 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45dc1eb8a0 0x7f45dc0c0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:40.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.312+0000 7f45e0f0b640 1 -- 172.21.15.77:0/1213936847 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45c8003a50 msgr2=0x7f45dc14f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:40.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.312+0000 7f45e0f0b640 1 --2- 172.21.15.77:0/1213936847 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45c8003a50 0x7f45dc14f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:40.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.312+0000 7f45e0f0b640 1 -- 172.21.15.77:0/1213936847 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45dc070ee0 con 0x7f45dc0bc4a0 2024-04-25T01:44:40.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.312+0000 7f45e170c640 1 --2- 172.21.15.77:0/1213936847 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45c8003a50 0x7f45dc14f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:44:40.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.312+0000 7f45e1f0d640 1 --2- 172.21.15.77:0/1213936847 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45dc1eb8a0 0x7f45dc0c0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:44:40.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.312+0000 7f45e0f0b640 1 --2- 172.21.15.77:0/1213936847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45dc0bc4a0 0x7f45dc1eb360 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f45cc00f8d0 tx=0x7f45cc00fd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:40.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.312+0000 7f45d1ffb640 1 -- 172.21.15.77:0/1213936847 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45cc01a070 con 0x7f45dc0bc4a0 2024-04-25T01:44:40.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.312+0000 7f45d1ffb640 1 -- 172.21.15.77:0/1213936847 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f45cc005320 con 0x7f45dc0bc4a0 2024-04-25T01:44:40.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.312+0000 7f45d1ffb640 1 -- 172.21.15.77:0/1213936847 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45cc007290 con 0x7f45dc0bc4a0 2024-04-25T01:44:40.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.312+0000 7f45e3970640 1 -- 172.21.15.77:0/1213936847 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45dc1eae80 con 0x7f45dc0bc4a0 2024-04-25T01:44:40.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.312+0000 7f45e3970640 1 -- 172.21.15.77:0/1213936847 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45dc071460 con 0x7f45dc0bc4a0 2024-04-25T01:44:40.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.313+0000 7f45e3970640 1 -- 172.21.15.77:0/1213936847 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45dc075d10 con 0x7f45dc0bc4a0 2024-04-25T01:44:40.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.313+0000 7f45d1ffb640 1 -- 172.21.15.77:0/1213936847 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f45cc01d070 con 0x7f45dc0bc4a0 2024-04-25T01:44:40.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.314+0000 7f45d1ffb640 1 --2- 172.21.15.77:0/1213936847 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f45c006be60 0x7f45c006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:40.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.314+0000 7f45e170c640 1 --2- 172.21.15.77:0/1213936847 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f45c006be60 0x7f45c006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:40.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.314+0000 7f45d1ffb640 1 -- 172.21.15.77:0/1213936847 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6811+0+0 (secure 0 0 0) 0x7f45cc08aa10 con 0x7f45dc0bc4a0 2024-04-25T01:44:40.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.314+0000 7f45e170c640 1 --2- 172.21.15.77:0/1213936847 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f45c006be60 0x7f45c006e320 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f45d8032000 tx=0x7f45d802d000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:40.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.318+0000 7f45d1ffb640 1 -- 172.21.15.77:0/1213936847 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f45cc059000 con 0x7f45dc0bc4a0 2024-04-25T01:44:40.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:40.495+0000 7f45e3970640 1 -- 172.21.15.77:0/1213936847 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "a_data", "pool2": "a_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f45dc150f20 con 0x7f45dc0bc4a0 2024-04-25T01:44:41.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.180+0000 7f45d1ffb640 1 -- 172.21.15.77:0/1213936847 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "a_data", "pool2": "a_data", "yes_i_really_really_mean_it": true}]=0 pool 'a_data' removed v34) ==== 154+0+0 (secure 0 0 0) 0x7f45cc058900 con 0x7f45dc0bc4a0 2024-04-25T01:44:41.173 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'a_data' removed 2024-04-25T01:44:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.183+0000 7f45e3970640 1 -- 172.21.15.77:0/1213936847 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f45c006be60 msgr2=0x7f45c006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.183+0000 7f45e3970640 1 --2- 172.21.15.77:0/1213936847 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f45c006be60 0x7f45c006e320 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f45d8032000 tx=0x7f45d802d000 comp rx=0 tx=0).stop 2024-04-25T01:44:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.183+0000 7f45e3970640 1 -- 172.21.15.77:0/1213936847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45dc0bc4a0 msgr2=0x7f45dc1eb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.183+0000 7f45e3970640 1 --2- 172.21.15.77:0/1213936847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45dc0bc4a0 0x7f45dc1eb360 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f45cc00f8d0 tx=0x7f45cc00fd90 comp rx=0 tx=0).stop 2024-04-25T01:44:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.183+0000 7f45e3970640 1 -- 172.21.15.77:0/1213936847 shutdown_connections 2024-04-25T01:44:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.183+0000 7f45e3970640 1 --2- 172.21.15.77:0/1213936847 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f45c006be60 0x7f45c006e320 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.183+0000 7f45e3970640 1 --2- 172.21.15.77:0/1213936847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45dc0bc4a0 0x7f45dc1eb360 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.183+0000 7f45e3970640 1 --2- 172.21.15.77:0/1213936847 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45dc1eb8a0 0x7f45dc0c0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.183+0000 7f45e3970640 1 --2- 172.21.15.77:0/1213936847 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45c8003a50 0x7f45dc14f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.183+0000 7f45e3970640 1 -- 172.21.15.77:0/1213936847 >> 172.21.15.77:0/1213936847 conn(0x7f45dc0a9230 msgr2=0x7f45dc0a9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.183+0000 7f45e3970640 1 -- 172.21.15.77:0/1213936847 shutdown_connections 2024-04-25T01:44:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.183+0000 7f45e3970640 1 -- 172.21.15.77:0/1213936847 wait complete. 2024-04-25T01:44:41.189 INFO:tasks.cephfs.filesystem:Destroying file system b and related pools 2024-04-25T01:44:41.189 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:44:41.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.306+0000 7fc1d37a5640 1 Processor -- start 2024-04-25T01:44:41.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.306+0000 7fc1d37a5640 1 -- start start 2024-04-25T01:44:41.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.307+0000 7fc1d37a5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1cc150320 0x7fc1cc156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:41.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.307+0000 7fc1d37a5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc1cc06d0a0 0x7fc1cc06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:41.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.307+0000 7fc1d37a5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1cc153be0 con 0x7fc1cc154380 2024-04-25T01:44:41.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.307+0000 7fc1d37a5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc1cc152fd0 con 0x7fc1cc06d0a0 2024-04-25T01:44:41.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.307+0000 7fc1d37a5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc1cc1532b0 con 0x7fc1cc150320 2024-04-25T01:44:41.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.307+0000 7fc1d0d40640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc1cc06d0a0 0x7fc1cc06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:41.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.307+0000 7fc1d1d42640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc1cc154380 0x7fc1cc1547e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50660/0 (socket says 172.21.15.77:50660) 2024-04-25T01:44:41.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.307+0000 7fc1d1d42640 1 -- 172.21.15.77:0/475621585 learned_addr learned my addr 172.21.15.77:0/475621585 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:44:41.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.307+0000 7fc1d1541640 1 --2- 172.21.15.77:0/475621585 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1cc150320 0x7fc1cc156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:41.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.307+0000 7fc1d0d40640 1 -- 172.21.15.77:0/475621585 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1cc150320 msgr2=0x7fc1cc156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:41.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.307+0000 7fc1d0d40640 1 --2- 172.21.15.77:0/475621585 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1cc150320 0x7fc1cc156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.307+0000 7fc1d0d40640 1 -- 172.21.15.77:0/475621585 >> v1:172.21.15.77:6789/0 conn(0x7fc1cc154380 legacy=0x7fc1cc1547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:41.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.307+0000 7fc1d0d40640 1 -- 172.21.15.77:0/475621585 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1cc157100 con 0x7fc1cc06d0a0 2024-04-25T01:44:41.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.307+0000 7fc1c3fff640 1 -- 172.21.15.77:0/475621585 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1409469885 0 0) 0x7fc1cc153be0 con 0x7fc1cc154380 2024-04-25T01:44:41.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.308+0000 7fc1d0d40640 1 --2- 172.21.15.77:0/475621585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1cc06d0a0 0x7fc1cc06d4e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc0097a0 tx=0x7fc1bc02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b8600fd6744b88 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:41.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.308+0000 7fc1c3fff640 1 -- 172.21.15.77:0/475621585 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc037070 con 0x7fc1cc06d0a0 2024-04-25T01:44:41.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.308+0000 7fc1c3fff640 1 -- 172.21.15.77:0/475621585 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc1bc02ae50 con 0x7fc1cc06d0a0 2024-04-25T01:44:41.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.308+0000 7fc1c3fff640 1 -- 172.21.15.77:0/475621585 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc032680 con 0x7fc1cc06d0a0 2024-04-25T01:44:41.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.309+0000 7fc1d37a5640 1 -- 172.21.15.77:0/475621585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1cc06d0a0 msgr2=0x7fc1cc06d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:41.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.309+0000 7fc1d37a5640 1 --2- 172.21.15.77:0/475621585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1cc06d0a0 0x7fc1cc06d4e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc0097a0 tx=0x7fc1bc02a100 comp rx=0 tx=0).stop 2024-04-25T01:44:41.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.309+0000 7fc1d37a5640 1 -- 172.21.15.77:0/475621585 shutdown_connections 2024-04-25T01:44:41.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.309+0000 7fc1d37a5640 1 --2- 172.21.15.77:0/475621585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1cc06d0a0 0x7fc1cc06d4e0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.309+0000 7fc1d37a5640 1 --2- 172.21.15.77:0/475621585 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1cc150320 0x7fc1cc156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.309+0000 7fc1d37a5640 1 -- 172.21.15.77:0/475621585 >> 172.21.15.77:0/475621585 conn(0x7fc1cc0c3f80 msgr2=0x7fc1cc0c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:41.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.309+0000 7fc1d37a5640 1 -- 172.21.15.77:0/475621585 shutdown_connections 2024-04-25T01:44:41.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.309+0000 7fc1d37a5640 1 -- 172.21.15.77:0/475621585 wait complete. 2024-04-25T01:44:41.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.310+0000 7fc1d37a5640 1 Processor -- start 2024-04-25T01:44:41.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.310+0000 7fc1d37a5640 1 -- start start 2024-04-25T01:44:41.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.311+0000 7fc1d37a5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1cc06d0a0 0x7fc1cc0ab720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:41.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.311+0000 7fc1d37a5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1cc150320 0x7fc1cc1eec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:41.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.311+0000 7fc1d37a5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1cc154380 0x7fc1cc0aad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:41.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.311+0000 7fc1d37a5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc1cc152bf0 con 0x7fc1cc150320 2024-04-25T01:44:41.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.311+0000 7fc1d37a5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc1cc153870 con 0x7fc1cc06d0a0 2024-04-25T01:44:41.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.311+0000 7fc1d37a5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc1cc152d70 con 0x7fc1cc154380 2024-04-25T01:44:41.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.311+0000 7fc1d0d40640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1cc150320 0x7fc1cc1eec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:41.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.311+0000 7fc1d0d40640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1cc150320 0x7fc1cc1eec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59452/0 (socket says 172.21.15.77:59452) 2024-04-25T01:44:41.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.311+0000 7fc1d0d40640 1 -- 172.21.15.77:0/3099260108 learned_addr learned my addr 172.21.15.77:0/3099260108 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:41.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.311+0000 7fc1d1541640 1 --2- 172.21.15.77:0/3099260108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1cc06d0a0 0x7fc1cc0ab720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:41.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.311+0000 7fc1d0d40640 1 -- 172.21.15.77:0/3099260108 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1cc154380 msgr2=0x7fc1cc0aad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:41.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.311+0000 7fc1d0d40640 1 --2- 172.21.15.77:0/3099260108 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1cc154380 0x7fc1cc0aad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.311+0000 7fc1d0d40640 1 -- 172.21.15.77:0/3099260108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1cc06d0a0 msgr2=0x7fc1cc0ab720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:41.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.311+0000 7fc1d0d40640 1 --2- 172.21.15.77:0/3099260108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1cc06d0a0 0x7fc1cc0ab720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.311+0000 7fc1d0d40640 1 -- 172.21.15.77:0/3099260108 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1cc14a090 con 0x7fc1cc150320 2024-04-25T01:44:41.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.311+0000 7fc1d0d40640 1 --2- 172.21.15.77:0/3099260108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1cc150320 0x7fc1cc1eec70 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc035040 tx=0x7fc1bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:41.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.311+0000 7fc1c1ffb640 1 -- 172.21.15.77:0/3099260108 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc041030 con 0x7fc1cc150320 2024-04-25T01:44:41.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.311+0000 7fc1c1ffb640 1 -- 172.21.15.77:0/3099260108 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc1bc02ac50 con 0x7fc1cc150320 2024-04-25T01:44:41.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.311+0000 7fc1d37a5640 1 -- 172.21.15.77:0/3099260108 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1cc0abdb0 con 0x7fc1cc150320 2024-04-25T01:44:41.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.311+0000 7fc1c1ffb640 1 -- 172.21.15.77:0/3099260108 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc037040 con 0x7fc1cc150320 2024-04-25T01:44:41.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.311+0000 7fc1d37a5640 1 -- 172.21.15.77:0/3099260108 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1cc154b60 con 0x7fc1cc150320 2024-04-25T01:44:41.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.312+0000 7fc1d37a5640 1 -- 172.21.15.77:0/3099260108 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1cc04f500 con 0x7fc1cc150320 2024-04-25T01:44:41.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.313+0000 7fc1c1ffb640 1 -- 172.21.15.77:0/3099260108 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc1bc044070 con 0x7fc1cc150320 2024-04-25T01:44:41.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.313+0000 7fc1c1ffb640 1 --2- 172.21.15.77:0/3099260108 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc1b006be30 0x7fc1b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:41.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.313+0000 7fc1c1ffb640 1 -- 172.21.15.77:0/3099260108 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6291+0+0 (secure 0 0 0) 0x7fc1bc0ab770 con 0x7fc1cc150320 2024-04-25T01:44:41.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.313+0000 7fc1d1541640 1 --2- 172.21.15.77:0/3099260108 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc1b006be30 0x7fc1b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:41.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.314+0000 7fc1d1541640 1 --2- 172.21.15.77:0/3099260108 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc1b006be30 0x7fc1b006e2f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8006fd0 tx=0x7fc1c8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:41.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.318+0000 7fc1c1ffb640 1 -- 172.21.15.77:0/3099260108 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc1bc044e40 con 0x7fc1cc150320 2024-04-25T01:44:41.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.525+0000 7fc1d37a5640 1 -- 172.21.15.77:0/3099260108 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1cc073750 con 0x7fc1cc150320 2024-04-25T01:44:41.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.526+0000 7fc1c1ffb640 1 -- 172.21.15.77:0/3099260108 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5174 (secure 0 0 0) 0x7fc1bc079f60 con 0x7fc1cc150320 2024-04-25T01:44:41.518 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:44:41.518 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5964,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1289251527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1289251527},{"type":"v1","addr":"172.21.15.77:6835","nonce":1289251527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6027,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2393074023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2393074023},{"type":"v1","addr":"172.21.15.77:6837","nonce":2393074023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:43:32.407370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":22,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5179,"qdb_cluster":[5179]},"id":2}]} 2024-04-25T01:44:41.518 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 40 2024-04-25T01:44:41.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.528+0000 7fc1d37a5640 1 -- 172.21.15.77:0/3099260108 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc1b006be30 msgr2=0x7fc1b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:41.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.528+0000 7fc1d37a5640 1 --2- 172.21.15.77:0/3099260108 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc1b006be30 0x7fc1b006e2f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8006fd0 tx=0x7fc1c8008040 comp rx=0 tx=0).stop 2024-04-25T01:44:41.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.528+0000 7fc1d37a5640 1 -- 172.21.15.77:0/3099260108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1cc150320 msgr2=0x7fc1cc1eec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:41.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.528+0000 7fc1d37a5640 1 --2- 172.21.15.77:0/3099260108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1cc150320 0x7fc1cc1eec70 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc035040 tx=0x7fc1bc0046c0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.528+0000 7fc1d37a5640 1 -- 172.21.15.77:0/3099260108 shutdown_connections 2024-04-25T01:44:41.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.528+0000 7fc1d37a5640 1 --2- 172.21.15.77:0/3099260108 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fc1b006be30 0x7fc1b006e2f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.528+0000 7fc1d37a5640 1 --2- 172.21.15.77:0/3099260108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1cc150320 0x7fc1cc1eec70 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.528+0000 7fc1d37a5640 1 --2- 172.21.15.77:0/3099260108 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1cc154380 0x7fc1cc0aad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.528+0000 7fc1d37a5640 1 --2- 172.21.15.77:0/3099260108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1cc06d0a0 0x7fc1cc0ab720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.528+0000 7fc1d37a5640 1 -- 172.21.15.77:0/3099260108 >> 172.21.15.77:0/3099260108 conn(0x7fc1cc0c3f80 msgr2=0x7fc1cc0c2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:41.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.528+0000 7fc1d37a5640 1 -- 172.21.15.77:0/3099260108 shutdown_connections 2024-04-25T01:44:41.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.528+0000 7fc1d37a5640 1 -- 172.21.15.77:0/3099260108 wait complete. 2024-04-25T01:44:41.531 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T01:44:41.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.636+0000 7faea8d12640 1 Processor -- start 2024-04-25T01:44:41.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.636+0000 7faea8d12640 1 -- start start 2024-04-25T01:44:41.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.637+0000 7faea8d12640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7faea406c280 0x7faea40c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:41.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.637+0000 7faea8d12640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faea4157130 con 0x7faea4150090 2024-04-25T01:44:41.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.637+0000 7faea8d12640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faea40c89c0 con 0x7faea4156c80 2024-04-25T01:44:41.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.637+0000 7faea8d12640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7faea406b830 con 0x7faea406c280 2024-04-25T01:44:41.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.637+0000 7faea259c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7faea4150090 0x7faea40c8200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50670/0 (socket says 172.21.15.77:50670) 2024-04-25T01:44:41.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.637+0000 7faea259c640 1 -- 172.21.15.77:0/1839987909 learned_addr learned my addr 172.21.15.77:0/1839987909 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:44:41.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.637+0000 7faea2d9d640 1 --2- 172.21.15.77:0/1839987909 >> v2:172.21.15.121:3300/0 conn(0x7faea406c280 0x7faea40c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:41.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.638+0000 7faea159a640 1 -- 172.21.15.77:0/1839987909 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 832418362 0 0) 0x7fae94001490 con 0x7faea4150090 2024-04-25T01:44:41.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.638+0000 7faea159a640 1 -- 172.21.15.77:0/1839987909 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae8c003520 con 0x7faea4150090 2024-04-25T01:44:41.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.638+0000 7faea159a640 1 -- 172.21.15.77:0/1839987909 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4060280522 0 0) 0x7fae8c003520 con 0x7faea4150090 2024-04-25T01:44:41.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.638+0000 7faea159a640 1 -- 172.21.15.77:0/1839987909 >> v2:172.21.15.121:3300/0 conn(0x7faea406c280 msgr2=0x7faea40c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:41.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.638+0000 7faea159a640 1 --2- 172.21.15.77:0/1839987909 >> v2:172.21.15.121:3300/0 conn(0x7faea406c280 0x7faea40c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.638+0000 7faea159a640 1 -- 172.21.15.77:0/1839987909 >> v1:172.21.15.121:6789/0 conn(0x7faea4156c80 legacy=0x7faea40c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:41.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.638+0000 7faea159a640 1 -- 172.21.15.77:0/1839987909 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea40c8ca0 con 0x7faea4150090 2024-04-25T01:44:41.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.638+0000 7faea159a640 1 -- 172.21.15.77:0/1839987909 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7fae94001bc0 con 0x7faea4150090 2024-04-25T01:44:41.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.638+0000 7faea159a640 1 -- 172.21.15.77:0/1839987909 >> v1:172.21.15.77:6789/0 conn(0x7faea4150090 legacy=0x7faea40c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:41.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.638+0000 7faea159a640 1 --2- 172.21.15.77:0/1839987909 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae8c0039b0 0x7fae8c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:41.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.638+0000 7faea159a640 1 --2- 172.21.15.77:0/1839987909 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae8c004800 0x7fae8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:41.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.638+0000 7faea159a640 1 --2- 172.21.15.77:0/1839987909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae8c0051c0 0x7fae8c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:41.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.638+0000 7faea159a640 1 -- 172.21.15.77:0/1839987909 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faea406b830 con 0x7fae8c0051c0 2024-04-25T01:44:41.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.638+0000 7faea159a640 1 -- 172.21.15.77:0/1839987909 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fae8c00c060 con 0x7fae8c0039b0 2024-04-25T01:44:41.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.638+0000 7faea159a640 1 -- 172.21.15.77:0/1839987909 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fae8c00c260 con 0x7fae8c004800 2024-04-25T01:44:41.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.638+0000 7faea2d9d640 1 --2- 172.21.15.77:0/1839987909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae8c0051c0 0x7fae8c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:41.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.638+0000 7faea259c640 1 --2- 172.21.15.77:0/1839987909 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae8c0039b0 0x7fae8c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:41.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.638+0000 7faea1d9b640 1 --2- 172.21.15.77:0/1839987909 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae8c004800 0x7fae8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:41.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.638+0000 7faea2d9d640 1 -- 172.21.15.77:0/1839987909 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae8c004800 msgr2=0x7fae8c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:41.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.638+0000 7faea2d9d640 1 --2- 172.21.15.77:0/1839987909 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae8c004800 0x7fae8c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.638+0000 7faea2d9d640 1 -- 172.21.15.77:0/1839987909 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae8c0039b0 msgr2=0x7fae8c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:41.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.638+0000 7faea2d9d640 1 --2- 172.21.15.77:0/1839987909 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae8c0039b0 0x7fae8c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.638+0000 7faea2d9d640 1 -- 172.21.15.77:0/1839987909 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae8c003520 con 0x7fae8c0051c0 2024-04-25T01:44:41.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.639+0000 7faea2d9d640 1 -- 172.21.15.77:0/1839987909 reap_dead start 2024-04-25T01:44:41.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.639+0000 7faea2d9d640 1 --2- 172.21.15.77:0/1839987909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae8c0051c0 0x7fae8c00b9c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fae9c009ac0 tx=0x7fae8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2b2aebf9728406 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:41.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.639+0000 7faea159a640 1 -- 172.21.15.77:0/1839987909 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9c009690 con 0x7fae8c0051c0 2024-04-25T01:44:41.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.639+0000 7faea159a640 1 -- 172.21.15.77:0/1839987909 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fae9c004020 con 0x7fae8c0051c0 2024-04-25T01:44:41.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.639+0000 7faea159a640 1 -- 172.21.15.77:0/1839987909 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9c004430 con 0x7fae8c0051c0 2024-04-25T01:44:41.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.640+0000 7faea8d12640 1 -- 172.21.15.77:0/1839987909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae8c0051c0 msgr2=0x7fae8c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:41.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.640+0000 7faea8d12640 1 --2- 172.21.15.77:0/1839987909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae8c0051c0 0x7fae8c00b9c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fae9c009ac0 tx=0x7fae8c005830 comp rx=0 tx=0).stop 2024-04-25T01:44:41.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.640+0000 7faea8d12640 1 -- 172.21.15.77:0/1839987909 shutdown_connections 2024-04-25T01:44:41.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.640+0000 7faea8d12640 1 --2- 172.21.15.77:0/1839987909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae8c0051c0 0x7fae8c00b9c0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.640+0000 7faea8d12640 1 -- 172.21.15.77:0/1839987909 >> 172.21.15.77:0/1839987909 conn(0x7faea40ad4d0 msgr2=0x7faea40ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:41.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.640+0000 7faea8d12640 1 -- 172.21.15.77:0/1839987909 shutdown_connections 2024-04-25T01:44:41.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.640+0000 7faea8d12640 1 -- 172.21.15.77:0/1839987909 wait complete. 2024-04-25T01:44:41.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.641+0000 7faea8d12640 1 Processor -- start 2024-04-25T01:44:41.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.641+0000 7faea8d12640 1 -- start start 2024-04-25T01:44:41.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.642+0000 7faea8d12640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae8c0051c0 0x7faea40b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:41.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.642+0000 7faea8d12640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faea40ae5c0 0x7faea40aff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:41.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.642+0000 7faea8d12640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faea40b0470 0x7faea414add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:41.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.642+0000 7faea8d12640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faea406c690 con 0x7faea40ae5c0 2024-04-25T01:44:41.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.642+0000 7faea8d12640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faea406bd60 con 0x7fae8c0051c0 2024-04-25T01:44:41.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.642+0000 7faea8d12640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7faea406c810 con 0x7faea40b0470 2024-04-25T01:44:41.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.642+0000 7faea1d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faea40ae5c0 0x7faea40aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:41.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.642+0000 7faea1d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faea40ae5c0 0x7faea40aff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59478/0 (socket says 172.21.15.77:59478) 2024-04-25T01:44:41.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.642+0000 7faea1d9b640 1 -- 172.21.15.77:0/2799674084 learned_addr learned my addr 172.21.15.77:0/2799674084 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:41.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.642+0000 7faea259c640 1 --2- 172.21.15.77:0/2799674084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae8c0051c0 0x7faea40b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:41.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.642+0000 7faea2d9d640 1 --2- 172.21.15.77:0/2799674084 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faea40b0470 0x7faea414add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:41.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.642+0000 7faea1d9b640 1 -- 172.21.15.77:0/2799674084 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faea40b0470 msgr2=0x7faea414add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:41.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.642+0000 7faea1d9b640 1 --2- 172.21.15.77:0/2799674084 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faea40b0470 0x7faea414add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.642+0000 7faea1d9b640 1 -- 172.21.15.77:0/2799674084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae8c0051c0 msgr2=0x7faea40b0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:41.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.642+0000 7faea1d9b640 1 --2- 172.21.15.77:0/2799674084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae8c0051c0 0x7faea40b0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.642+0000 7faea1d9b640 1 -- 172.21.15.77:0/2799674084 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea40b14b0 con 0x7faea40ae5c0 2024-04-25T01:44:41.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.642+0000 7faea2d9d640 1 --2- 172.21.15.77:0/2799674084 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faea40b0470 0x7faea414add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:44:41.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.642+0000 7faea1d9b640 1 --2- 172.21.15.77:0/2799674084 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faea40ae5c0 0x7faea40aff30 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fae9800f5f0 tx=0x7fae9800fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:41.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.642+0000 7fae92ffd640 1 -- 172.21.15.77:0/2799674084 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae980052e0 con 0x7faea40ae5c0 2024-04-25T01:44:41.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.643+0000 7fae92ffd640 1 -- 172.21.15.77:0/2799674084 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fae98018070 con 0x7faea40ae5c0 2024-04-25T01:44:41.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.643+0000 7faea8d12640 1 -- 172.21.15.77:0/2799674084 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faea41ec4a0 con 0x7faea40ae5c0 2024-04-25T01:44:41.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.643+0000 7fae92ffd640 1 -- 172.21.15.77:0/2799674084 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae98003830 con 0x7faea40ae5c0 2024-04-25T01:44:41.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.643+0000 7faea8d12640 1 -- 172.21.15.77:0/2799674084 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faea40af450 con 0x7faea40ae5c0 2024-04-25T01:44:41.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.643+0000 7faea8d12640 1 -- 172.21.15.77:0/2799674084 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faea404f500 con 0x7faea40ae5c0 2024-04-25T01:44:41.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.644+0000 7fae92ffd640 1 -- 172.21.15.77:0/2799674084 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fae980039d0 con 0x7faea40ae5c0 2024-04-25T01:44:41.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.644+0000 7fae92ffd640 1 --2- 172.21.15.77:0/2799674084 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fae8406be30 0x7fae8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:41.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.644+0000 7faea259c640 1 --2- 172.21.15.77:0/2799674084 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fae8406be30 0x7fae8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:41.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.644+0000 7fae92ffd640 1 -- 172.21.15.77:0/2799674084 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6291+0+0 (secure 0 0 0) 0x7fae9808ae70 con 0x7faea40ae5c0 2024-04-25T01:44:41.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.645+0000 7faea259c640 1 --2- 172.21.15.77:0/2799674084 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fae8406be30 0x7fae8406e2f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7faea40c5ca0 tx=0x7fae94006040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:41.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.649+0000 7fae92ffd640 1 -- 172.21.15.77:0/2799674084 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fae98059660 con 0x7faea40ae5c0 2024-04-25T01:44:41.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.872+0000 7faea8d12640 1 -- 172.21.15.77:0/2799674084 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faea406cec0 con 0x7faea40ae5c0 2024-04-25T01:44:41.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.873+0000 7fae92ffd640 1 -- 172.21.15.77:0/2799674084 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5174 (secure 0 0 0) 0x7fae98058f60 con 0x7faea40ae5c0 2024-04-25T01:44:41.865 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:44:41.865 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1537604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1537604},{"type":"v1","addr":"172.21.15.121:6835","nonce":1537604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5964,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1289251527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1289251527},{"type":"v1","addr":"172.21.15.77:6835","nonce":1289251527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6027,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2393074023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2393074023},{"type":"v1","addr":"172.21.15.77:6837","nonce":2393074023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T01:39:32.761220+0000","modified":"2024-04-25T01:43:32.407370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5179":{"gid":5179,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":22,"addr":"172.21.15.121:6834/747036410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":747036410},{"type":"v1","addr":"172.21.15.121:6834","nonce":747036410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5179,"qdb_cluster":[5179]},"id":2}]} 2024-04-25T01:44:41.865 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 40 2024-04-25T01:44:41.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.875+0000 7faea8d12640 1 -- 172.21.15.77:0/2799674084 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fae8406be30 msgr2=0x7fae8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:41.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.875+0000 7faea8d12640 1 --2- 172.21.15.77:0/2799674084 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fae8406be30 0x7fae8406e2f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7faea40c5ca0 tx=0x7fae94006040 comp rx=0 tx=0).stop 2024-04-25T01:44:41.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.875+0000 7faea8d12640 1 -- 172.21.15.77:0/2799674084 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faea40ae5c0 msgr2=0x7faea40aff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:41.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.875+0000 7faea8d12640 1 --2- 172.21.15.77:0/2799674084 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faea40ae5c0 0x7faea40aff30 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fae9800f5f0 tx=0x7fae9800fab0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.875+0000 7faea8d12640 1 -- 172.21.15.77:0/2799674084 shutdown_connections 2024-04-25T01:44:41.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.875+0000 7faea8d12640 1 --2- 172.21.15.77:0/2799674084 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fae8406be30 0x7fae8406e2f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.875+0000 7faea8d12640 1 --2- 172.21.15.77:0/2799674084 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faea40ae5c0 0x7faea40aff30 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.875+0000 7faea8d12640 1 --2- 172.21.15.77:0/2799674084 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faea40b0470 0x7faea414add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.875+0000 7faea8d12640 1 --2- 172.21.15.77:0/2799674084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae8c0051c0 0x7faea40b0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.875+0000 7faea8d12640 1 -- 172.21.15.77:0/2799674084 >> 172.21.15.77:0/2799674084 conn(0x7faea40ad4d0 msgr2=0x7faea40c6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:41.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.875+0000 7faea8d12640 1 -- 172.21.15.77:0/2799674084 shutdown_connections 2024-04-25T01:44:41.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.875+0000 7faea8d12640 1 -- 172.21.15.77:0/2799674084 wait complete. 2024-04-25T01:44:41.878 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T01:44:41.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.983+0000 7f45ac563640 1 Processor -- start 2024-04-25T01:44:41.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.983+0000 7f45ac563640 1 -- start start 2024-04-25T01:44:41.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.983+0000 7f45ac563640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f45a4153cf0 0x7f45a40acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:41.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.983+0000 7f45ac563640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f45a41558f0 0x7f45a415e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:41.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.983+0000 7f45ac563640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a4155d60 con 0x7f45a40ac840 2024-04-25T01:44:41.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.983+0000 7f45ac563640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f45a4151780 con 0x7f45a4153cf0 2024-04-25T01:44:41.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.983+0000 7f45ac563640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f45a406d0a0 con 0x7f45a41558f0 2024-04-25T01:44:41.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.984+0000 7f45a9afe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f45a4153cf0 0x7f45a40acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:41.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.984+0000 7f45a9afe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f45a4153cf0 0x7f45a40acc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59480/0 (socket says 172.21.15.77:59480) 2024-04-25T01:44:41.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.984+0000 7f45a9afe640 1 -- 172.21.15.77:0/1443364440 learned_addr learned my addr 172.21.15.77:0/1443364440 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:41.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.984+0000 7f45aab00640 1 --2- 172.21.15.77:0/1443364440 >> v2:172.21.15.121:3300/0 conn(0x7f45a41558f0 0x7f45a415e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:41.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.984+0000 7f45a9afe640 1 -- 172.21.15.77:0/1443364440 >> v2:172.21.15.121:3300/0 conn(0x7f45a41558f0 msgr2=0x7f45a415e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:41.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.984+0000 7f45a9afe640 1 --2- 172.21.15.77:0/1443364440 >> v2:172.21.15.121:3300/0 conn(0x7f45a41558f0 0x7f45a415e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.984+0000 7f45a9afe640 1 -- 172.21.15.77:0/1443364440 >> v1:172.21.15.121:6789/0 conn(0x7f45a40ac840 legacy=0x7f45a41551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:41.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.984+0000 7f45a9afe640 1 -- 172.21.15.77:0/1443364440 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a406b480 con 0x7f45a4153cf0 2024-04-25T01:44:41.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.985+0000 7f45a9afe640 1 --2- 172.21.15.77:0/1443364440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45a4153cf0 0x7f45a40acc20 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f45a4070c10 tx=0x7f459402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a029f97dca9066 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:41.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.985+0000 7f45a92fd640 1 -- 172.21.15.77:0/1443364440 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4594037070 con 0x7f45a4153cf0 2024-04-25T01:44:41.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.985+0000 7f45a92fd640 1 -- 172.21.15.77:0/1443364440 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4594032440 con 0x7f45a4153cf0 2024-04-25T01:44:41.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.985+0000 7f45a92fd640 1 -- 172.21.15.77:0/1443364440 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4594032830 con 0x7f45a4153cf0 2024-04-25T01:44:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.985+0000 7f45ac563640 1 -- 172.21.15.77:0/1443364440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45a4153cf0 msgr2=0x7f45a40acc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.985+0000 7f45ac563640 1 --2- 172.21.15.77:0/1443364440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45a4153cf0 0x7f45a40acc20 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f45a4070c10 tx=0x7f459402a1a0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.985+0000 7f45ac563640 1 -- 172.21.15.77:0/1443364440 shutdown_connections 2024-04-25T01:44:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.985+0000 7f45ac563640 1 --2- 172.21.15.77:0/1443364440 >> v2:172.21.15.121:3300/0 conn(0x7f45a41558f0 0x7f45a415e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.985+0000 7f45ac563640 1 --2- 172.21.15.77:0/1443364440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45a4153cf0 0x7f45a40acc20 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.985+0000 7f45ac563640 1 -- 172.21.15.77:0/1443364440 >> 172.21.15.77:0/1443364440 conn(0x7f45a40c3f80 msgr2=0x7f45a40c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.985+0000 7f45ac563640 1 -- 172.21.15.77:0/1443364440 shutdown_connections 2024-04-25T01:44:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.985+0000 7f45ac563640 1 -- 172.21.15.77:0/1443364440 wait complete. 2024-04-25T01:44:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.986+0000 7f45ac563640 1 Processor -- start 2024-04-25T01:44:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.986+0000 7f45ac563640 1 -- start start 2024-04-25T01:44:41.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.987+0000 7f45ac563640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45a40ac840 0x7f45a40c0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:41.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.987+0000 7f45ac563640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45a4153cf0 0x7f45a414a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:41.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.987+0000 7f45ac563640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45a41558f0 0x7f45a414a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:41.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.987+0000 7f45ac563640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f45a406d5d0 con 0x7f45a40ac840 2024-04-25T01:44:41.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.987+0000 7f45ac563640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f45a406dc20 con 0x7f45a41558f0 2024-04-25T01:44:41.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.987+0000 7f45ac563640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f45a406d8b0 con 0x7f45a4153cf0 2024-04-25T01:44:41.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.987+0000 7f45aa2ff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45a40ac840 0x7f45a40c0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:41.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.987+0000 7f45aa2ff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45a40ac840 0x7f45a40c0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59492/0 (socket says 172.21.15.77:59492) 2024-04-25T01:44:41.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.987+0000 7f45aa2ff640 1 -- 172.21.15.77:0/896194463 learned_addr learned my addr 172.21.15.77:0/896194463 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:41.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.987+0000 7f45aab00640 1 --2- 172.21.15.77:0/896194463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45a41558f0 0x7f45a414a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:41.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.987+0000 7f45a9afe640 1 --2- 172.21.15.77:0/896194463 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45a4153cf0 0x7f45a414a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:41.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.987+0000 7f45aa2ff640 1 -- 172.21.15.77:0/896194463 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45a4153cf0 msgr2=0x7f45a414a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:41.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.987+0000 7f45aa2ff640 1 --2- 172.21.15.77:0/896194463 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45a4153cf0 0x7f45a414a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.987+0000 7f45aa2ff640 1 -- 172.21.15.77:0/896194463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45a41558f0 msgr2=0x7f45a414a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:41.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.987+0000 7f45aa2ff640 1 --2- 172.21.15.77:0/896194463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45a41558f0 0x7f45a414a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:41.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.987+0000 7f45aa2ff640 1 -- 172.21.15.77:0/896194463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a41527c0 con 0x7f45a40ac840 2024-04-25T01:44:41.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.988+0000 7f45aa2ff640 1 --2- 172.21.15.77:0/896194463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45a40ac840 0x7f45a40c0b20 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f45a000b3f0 tx=0x7f45a000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:41.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.988+0000 7f459affd640 1 -- 172.21.15.77:0/896194463 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a0015020 con 0x7f45a40ac840 2024-04-25T01:44:41.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.988+0000 7f459affd640 1 -- 172.21.15.77:0/896194463 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f45a0011830 con 0x7f45a40ac840 2024-04-25T01:44:41.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.988+0000 7f45ac563640 1 -- 172.21.15.77:0/896194463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45a4152aa0 con 0x7f45a40ac840 2024-04-25T01:44:41.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.988+0000 7f459affd640 1 -- 172.21.15.77:0/896194463 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a0011c40 con 0x7f45a40ac840 2024-04-25T01:44:41.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.988+0000 7f45ac563640 1 -- 172.21.15.77:0/896194463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45a40ac4e0 con 0x7f45a40ac840 2024-04-25T01:44:41.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.989+0000 7f45ac563640 1 -- 172.21.15.77:0/896194463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45a404f500 con 0x7f45a40ac840 2024-04-25T01:44:41.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.989+0000 7f459affd640 1 -- 172.21.15.77:0/896194463 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f45a0018020 con 0x7f45a40ac840 2024-04-25T01:44:41.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.989+0000 7f459affd640 1 --2- 172.21.15.77:0/896194463 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f458806be30 0x7f458806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:41.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.990+0000 7f459affd640 1 -- 172.21.15.77:0/896194463 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6291+0+0 (secure 0 0 0) 0x7f45a008acd0 con 0x7f45a40ac840 2024-04-25T01:44:41.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.990+0000 7f45a9afe640 1 --2- 172.21.15.77:0/896194463 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f458806be30 0x7f458806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:41.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.990+0000 7f45a9afe640 1 --2- 172.21.15.77:0/896194463 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f458806be30 0x7f458806e2f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4594034000 tx=0x7f459402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:41.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:41.994+0000 7f459affd640 1 -- 172.21.15.77:0/896194463 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f45a001f030 con 0x7f45a40ac840 2024-04-25T01:44:42.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.168+0000 7f45ac563640 1 -- 172.21.15.77:0/896194463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f45a4155090 con 0x7f45a40ac840 2024-04-25T01:44:42.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.169+0000 7f459affd640 1 -- 172.21.15.77:0/896194463 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+17550 (secure 0 0 0) 0x7f45a00172c0 con 0x7f45a40ac840 2024-04-25T01:44:42.161 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-25T01:44:42.161 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":34,"fsid":"70f1c0d7-4e08-4883-a8bd-1451a32d9af1","created":"2024-04-25T01:38:59.578174+0000","modified":"2024-04-25T01:44:41.177114+0000","last_up_change":"2024-04-25T01:39:10.729600+0000","last_in_change":"2024-04-25T01:39:01.685420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T01:39:11.681151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T01:39:30.501700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T01:39:31.740717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f3767c8-b5d1-49e1-abe4-798fcdcdbc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6811","nonce":3366980158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6817","nonce":3366980158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6828","nonce":3366980158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":3366980158},{"type":"v1","addr":"172.21.15.77:6825","nonce":3366980158}]},"public_addr":"172.21.15.77:6811/3366980158","cluster_addr":"172.21.15.77:6817/3366980158","heartbeat_back_addr":"172.21.15.77:6828/3366980158","heartbeat_front_addr":"172.21.15.77:6825/3366980158","state":["exists","up"]},{"osd":1,"uuid":"6875d6d8-0333-44a3-b953-d26a412bbd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6801","nonce":3971619298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6803","nonce":3971619298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6807","nonce":3971619298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3971619298},{"type":"v1","addr":"172.21.15.77:6805","nonce":3971619298}]},"public_addr":"172.21.15.77:6801/3971619298","cluster_addr":"172.21.15.77:6803/3971619298","heartbeat_back_addr":"172.21.15.77:6807/3971619298","heartbeat_front_addr":"172.21.15.77:6805/3971619298","state":["exists","up"]},{"osd":2,"uuid":"32d40ac0-e89d-4dfe-9d8c-86d7de6c73f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6810","nonce":4103452689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6813","nonce":4103452689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6823","nonce":4103452689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":4103452689},{"type":"v1","addr":"172.21.15.77:6818","nonce":4103452689}]},"public_addr":"172.21.15.77:6810/4103452689","cluster_addr":"172.21.15.77:6813/4103452689","heartbeat_back_addr":"172.21.15.77:6823/4103452689","heartbeat_front_addr":"172.21.15.77:6818/4103452689","state":["exists","up"]},{"osd":3,"uuid":"6e5b36dd-f7cb-41d6-9a42-10ac20ae21a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6819","nonce":217398906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6824","nonce":217398906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6831","nonce":217398906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":217398906},{"type":"v1","addr":"172.21.15.77:6829","nonce":217398906}]},"public_addr":"172.21.15.77:6819/217398906","cluster_addr":"172.21.15.77:6824/217398906","heartbeat_back_addr":"172.21.15.77:6831/217398906","heartbeat_front_addr":"172.21.15.77:6829/217398906","state":["exists","up"]},{"osd":4,"uuid":"edab5c68-4240-461d-8dd9-ccabe9ab07b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6801","nonce":2565483070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6803","nonce":2565483070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6810","nonce":2565483070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":2565483070},{"type":"v1","addr":"172.21.15.121:6806","nonce":2565483070}]},"public_addr":"172.21.15.121:6801/2565483070","cluster_addr":"172.21.15.121:6803/2565483070","heartbeat_back_addr":"172.21.15.121:6810/2565483070","heartbeat_front_addr":"172.21.15.121:6806/2565483070","state":["exists","up"]},{"osd":5,"uuid":"6eb36566-eb7d-4601-a24a-59f721295c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6807","nonce":2785294752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6809","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6811","nonce":2785294752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6815","nonce":2785294752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2785294752},{"type":"v1","addr":"172.21.15.121:6813","nonce":2785294752}]},"public_addr":"172.21.15.121:6807/2785294752","cluster_addr":"172.21.15.121:6811/2785294752","heartbeat_back_addr":"172.21.15.121:6815/2785294752","heartbeat_front_addr":"172.21.15.121:6813/2785294752","state":["exists","up"]},{"osd":6,"uuid":"4eaa0ce4-1dc4-4d47-812b-5c76b4874a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6820","nonce":523906818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6824","nonce":523906818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6831","nonce":523906818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":523906818},{"type":"v1","addr":"172.21.15.121:6828","nonce":523906818}]},"public_addr":"172.21.15.121:6820/523906818","cluster_addr":"172.21.15.121:6824/523906818","heartbeat_back_addr":"172.21.15.121:6831/523906818","heartbeat_front_addr":"172.21.15.121:6828/523906818","state":["exists","up"]},{"osd":7,"uuid":"15a060af-3466-410b-84d5-08f95afba2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6817","nonce":1683602459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6819","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6821","nonce":1683602459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6829","nonce":1683602459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6823","nonce":1683602459},{"type":"v1","addr":"172.21.15.121:6825","nonce":1683602459}]},"public_addr":"172.21.15.121:6817/1683602459","cluster_addr":"172.21.15.121:6821/1683602459","heartbeat_back_addr":"172.21.15.121:6829/1683602459","heartbeat_front_addr":"172.21.15.121:6825/1683602459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.839443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.818842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.776243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.793085+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.822396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.907311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.918374+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T01:39:06.848430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:6837/1570919706":"2024-04-26T01:44:38.172476+0000","172.21.15.77:6837/3454203695":"2024-04-26T01:40:59.368156+0000","172.21.15.121:6833/2449150984":"2024-04-26T01:41:34.373282+0000","172.21.15.121:6832/1039950655":"2024-04-26T01:42:04.378069+0000","172.21.15.77:6834/1935321501":"2024-04-26T01:44:24.400835+0000","172.21.15.77:6835/1935321501":"2024-04-26T01:44:24.400835+0000","172.21.15.77:6836/1570919706":"2024-04-26T01:44:38.172476+0000","172.21.15.121:6835/2449150984":"2024-04-26T01:41:34.373282+0000","172.21.15.77:6834/1958322306":"2024-04-26T01:41:34.373188+0000","172.21.15.77:6835/1958322306":"2024-04-26T01:41:34.373188+0000","172.21.15.77:6836/3454203695":"2024-04-26T01:40:59.368156+0000","172.21.15.121:6834/1039950655":"2024-04-26T01:42:04.378069+0000","172.21.15.77:6836/2398109146":"2024-04-26T01:43:29.392514+0000","172.21.15.77:6837/2398109146":"2024-04-26T01:43:29.392514+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T01:44:42.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.171+0000 7f45ac563640 1 -- 172.21.15.77:0/896194463 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f458806be30 msgr2=0x7f458806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:42.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.171+0000 7f45ac563640 1 --2- 172.21.15.77:0/896194463 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f458806be30 0x7f458806e2f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4594034000 tx=0x7f459402e000 comp rx=0 tx=0).stop 2024-04-25T01:44:42.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.171+0000 7f45ac563640 1 -- 172.21.15.77:0/896194463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45a40ac840 msgr2=0x7f45a40c0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:42.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.171+0000 7f45ac563640 1 --2- 172.21.15.77:0/896194463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45a40ac840 0x7f45a40c0b20 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f45a000b3f0 tx=0x7f45a000b8b0 comp rx=0 tx=0).stop 2024-04-25T01:44:42.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.171+0000 7f45ac563640 1 -- 172.21.15.77:0/896194463 shutdown_connections 2024-04-25T01:44:42.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.171+0000 7f45ac563640 1 --2- 172.21.15.77:0/896194463 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f458806be30 0x7f458806e2f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:42.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.171+0000 7f45ac563640 1 --2- 172.21.15.77:0/896194463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45a41558f0 0x7f45a414a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:42.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.171+0000 7f45ac563640 1 --2- 172.21.15.77:0/896194463 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45a4153cf0 0x7f45a414a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:42.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.171+0000 7f45ac563640 1 --2- 172.21.15.77:0/896194463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45a40ac840 0x7f45a40c0b20 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:42.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.171+0000 7f45ac563640 1 -- 172.21.15.77:0/896194463 >> 172.21.15.77:0/896194463 conn(0x7f45a40c3f80 msgr2=0x7f45a414bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:42.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.171+0000 7f45ac563640 1 -- 172.21.15.77:0/896194463 shutdown_connections 2024-04-25T01:44:42.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.171+0000 7f45ac563640 1 -- 172.21.15.77:0/896194463 wait complete. 2024-04-25T01:44:42.174 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail b 2024-04-25T01:44:42.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.279+0000 7f43b31b0640 1 Processor -- start 2024-04-25T01:44:42.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.279+0000 7f43b31b0640 1 -- start start 2024-04-25T01:44:42.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.280+0000 7f43b31b0640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f43ac0c4280 0x7f43ac1538f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:42.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.280+0000 7f43b31b0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f43ac0c4cb0 0x7f43ac153e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:42.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.280+0000 7f43b31b0640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43ac0c7040 con 0x7f43ac073450 2024-04-25T01:44:42.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.280+0000 7f43b31b0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f43ac0c1cd0 con 0x7f43ac0c4cb0 2024-04-25T01:44:42.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.280+0000 7f43b31b0640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f43ac0ac010 con 0x7f43ac0c4280 2024-04-25T01:44:42.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.280+0000 7f43b174d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f43ac0c4cb0 0x7f43ac153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:42.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.280+0000 7f43b174d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f43ac0c4cb0 0x7f43ac153e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59494/0 (socket says 172.21.15.77:59494) 2024-04-25T01:44:42.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.280+0000 7f43b174d640 1 -- 172.21.15.77:0/324508055 learned_addr learned my addr 172.21.15.77:0/324508055 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:42.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.280+0000 7f43b0f4c640 1 --2- 172.21.15.77:0/324508055 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f43ac0c4280 0x7f43ac1538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:42.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.280+0000 7f43b174d640 1 -- 172.21.15.77:0/324508055 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f43ac0c4280 msgr2=0x7f43ac1538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:42.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.280+0000 7f43b174d640 1 --2- 172.21.15.77:0/324508055 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f43ac0c4280 0x7f43ac1538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:42.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.280+0000 7f43b174d640 1 -- 172.21.15.77:0/324508055 >> v1:172.21.15.121:6789/0 conn(0x7f43ac073450 legacy=0x7f43ac0c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:42.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.280+0000 7f43b174d640 1 -- 172.21.15.77:0/324508055 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43ac0ac2f0 con 0x7f43ac0c4cb0 2024-04-25T01:44:42.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.281+0000 7f43b174d640 1 --2- 172.21.15.77:0/324508055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43ac0c4cb0 0x7f43ac153e30 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009e50 tx=0x7f43a402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ceccb8248975d04 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:42.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.281+0000 7f43ab7fe640 1 -- 172.21.15.77:0/324508055 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4036070 con 0x7f43ac0c4cb0 2024-04-25T01:44:42.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.281+0000 7f43ab7fe640 1 -- 172.21.15.77:0/324508055 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f43a4031600 con 0x7f43ac0c4cb0 2024-04-25T01:44:42.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.281+0000 7f43ab7fe640 1 -- 172.21.15.77:0/324508055 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a40319f0 con 0x7f43ac0c4cb0 2024-04-25T01:44:42.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.282+0000 7f43b31b0640 1 -- 172.21.15.77:0/324508055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43ac0c4cb0 msgr2=0x7f43ac153e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:42.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.282+0000 7f43b31b0640 1 --2- 172.21.15.77:0/324508055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43ac0c4cb0 0x7f43ac153e30 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009e50 tx=0x7f43a402a6c0 comp rx=0 tx=0).stop 2024-04-25T01:44:42.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.282+0000 7f43b31b0640 1 -- 172.21.15.77:0/324508055 shutdown_connections 2024-04-25T01:44:42.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.282+0000 7f43b31b0640 1 --2- 172.21.15.77:0/324508055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43ac0c4cb0 0x7f43ac153e30 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:42.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.282+0000 7f43b31b0640 1 --2- 172.21.15.77:0/324508055 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f43ac0c4280 0x7f43ac1538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:42.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.282+0000 7f43b31b0640 1 -- 172.21.15.77:0/324508055 >> 172.21.15.77:0/324508055 conn(0x7f43ac0c7580 msgr2=0x7f43ac0c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:42.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.282+0000 7f43b31b0640 1 -- 172.21.15.77:0/324508055 shutdown_connections 2024-04-25T01:44:42.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.282+0000 7f43b31b0640 1 -- 172.21.15.77:0/324508055 wait complete. 2024-04-25T01:44:42.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.283+0000 7f43b31b0640 1 Processor -- start 2024-04-25T01:44:42.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.283+0000 7f43b31b0640 1 -- start start 2024-04-25T01:44:42.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.284+0000 7f43b31b0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ac073450 0x7f43ac1e9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:42.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.284+0000 7f43b31b0640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f43ac0c4280 0x7f43ac14de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:42.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.284+0000 7f43b31b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43ac0c4cb0 0x7f43ac072b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:42.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.284+0000 7f43b31b0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac0c1a90 con 0x7f43ac0c4cb0 2024-04-25T01:44:42.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.284+0000 7f43b31b0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac0c1910 con 0x7f43ac073450 2024-04-25T01:44:42.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.284+0000 7f43b31b0640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f43ac0c4660 con 0x7f43ac0c4280 2024-04-25T01:44:42.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.284+0000 7f43b174d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43ac0c4cb0 0x7f43ac072b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:42.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.284+0000 7f43b174d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43ac0c4cb0 0x7f43ac072b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59510/0 (socket says 172.21.15.77:59510) 2024-04-25T01:44:42.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.284+0000 7f43b174d640 1 -- 172.21.15.77:0/1926519056 learned_addr learned my addr 172.21.15.77:0/1926519056 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:42.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.284+0000 7f43b0f4c640 1 --2- 172.21.15.77:0/1926519056 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ac073450 0x7f43ac1e9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:42.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.284+0000 7f43abfff640 1 --2- 172.21.15.77:0/1926519056 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f43ac0c4280 0x7f43ac14de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:42.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.284+0000 7f43b174d640 1 -- 172.21.15.77:0/1926519056 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f43ac0c4280 msgr2=0x7f43ac14de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:42.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.284+0000 7f43b174d640 1 --2- 172.21.15.77:0/1926519056 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f43ac0c4280 0x7f43ac14de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:42.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.284+0000 7f43b174d640 1 -- 172.21.15.77:0/1926519056 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ac073450 msgr2=0x7f43ac1e9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:42.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.284+0000 7f43b174d640 1 --2- 172.21.15.77:0/1926519056 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ac073450 0x7f43ac1e9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:42.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.284+0000 7f43b174d640 1 -- 172.21.15.77:0/1926519056 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43ac1dcb90 con 0x7f43ac0c4cb0 2024-04-25T01:44:42.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.284+0000 7f43abfff640 1 --2- 172.21.15.77:0/1926519056 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f43ac0c4280 0x7f43ac14de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:44:42.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.284+0000 7f43b174d640 1 --2- 172.21.15.77:0/1926519056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43ac0c4cb0 0x7f43ac072b40 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009e50 tx=0x7f43a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:42.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.284+0000 7f43a97fa640 1 -- 172.21.15.77:0/1926519056 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4036050 con 0x7f43ac0c4cb0 2024-04-25T01:44:42.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.284+0000 7f43a97fa640 1 -- 172.21.15.77:0/1926519056 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f43a4042070 con 0x7f43ac0c4cb0 2024-04-25T01:44:42.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.284+0000 7f43b31b0640 1 -- 172.21.15.77:0/1926519056 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43ac1dfec0 con 0x7f43ac0c4cb0 2024-04-25T01:44:42.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.284+0000 7f43a97fa640 1 -- 172.21.15.77:0/1926519056 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4009510 con 0x7f43ac0c4cb0 2024-04-25T01:44:42.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.284+0000 7f43b31b0640 1 -- 172.21.15.77:0/1926519056 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43ac14e3c0 con 0x7f43ac0c4cb0 2024-04-25T01:44:42.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.285+0000 7f43b31b0640 1 -- 172.21.15.77:0/1926519056 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43ac04f500 con 0x7f43ac0c4cb0 2024-04-25T01:44:42.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.286+0000 7f43a97fa640 1 -- 172.21.15.77:0/1926519056 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f43a4007bf0 con 0x7f43ac0c4cb0 2024-04-25T01:44:42.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.286+0000 7f43a97fa640 1 --2- 172.21.15.77:0/1926519056 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f439806be30 0x7f439806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:42.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.286+0000 7f43a97fa640 1 -- 172.21.15.77:0/1926519056 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6291+0+0 (secure 0 0 0) 0x7f43a40abf80 con 0x7f43ac0c4cb0 2024-04-25T01:44:42.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.286+0000 7f43b0f4c640 1 --2- 172.21.15.77:0/1926519056 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f439806be30 0x7f439806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:42.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.287+0000 7f43b0f4c640 1 --2- 172.21.15.77:0/1926519056 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f439806be30 0x7f439806e2f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f439c006fd0 tx=0x7f439c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:42.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.291+0000 7f43a97fa640 1 -- 172.21.15.77:0/1926519056 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f43a407a770 con 0x7f43ac0c4cb0 2024-04-25T01:44:42.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.499+0000 7f43b31b0640 1 -- 172.21.15.77:0/1926519056 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "b"} v 0) -- 0x7f43ac0c6bf0 con 0x7f43ac0c4cb0 2024-04-25T01:44:42.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.501+0000 7f43a97fa640 1 -- 172.21.15.77:0/1926519056 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "b"}]=0 b marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) ==== 151+0+0 (secure 0 0 0) 0x7f43a407a070 con 0x7f43ac0c4cb0 2024-04-25T01:44:42.493 INFO:teuthology.orchestra.run.smithi077.stderr:b marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T01:44:42.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.504+0000 7f43b31b0640 1 -- 172.21.15.77:0/1926519056 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f439806be30 msgr2=0x7f439806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:42.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.504+0000 7f43b31b0640 1 --2- 172.21.15.77:0/1926519056 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f439806be30 0x7f439806e2f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f439c006fd0 tx=0x7f439c008040 comp rx=0 tx=0).stop 2024-04-25T01:44:42.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.504+0000 7f43b31b0640 1 -- 172.21.15.77:0/1926519056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43ac0c4cb0 msgr2=0x7f43ac072b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:42.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.504+0000 7f43b31b0640 1 --2- 172.21.15.77:0/1926519056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43ac0c4cb0 0x7f43ac072b40 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009e50 tx=0x7f43a4004a40 comp rx=0 tx=0).stop 2024-04-25T01:44:42.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.504+0000 7f43b31b0640 1 -- 172.21.15.77:0/1926519056 shutdown_connections 2024-04-25T01:44:42.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.504+0000 7f43b31b0640 1 --2- 172.21.15.77:0/1926519056 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f439806be30 0x7f439806e2f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:42.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.504+0000 7f43b31b0640 1 --2- 172.21.15.77:0/1926519056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43ac0c4cb0 0x7f43ac072b40 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:42.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.504+0000 7f43b31b0640 1 --2- 172.21.15.77:0/1926519056 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f43ac0c4280 0x7f43ac14de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:42.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.504+0000 7f43b31b0640 1 --2- 172.21.15.77:0/1926519056 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ac073450 0x7f43ac1e9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:42.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.505+0000 7f43b31b0640 1 -- 172.21.15.77:0/1926519056 >> 172.21.15.77:0/1926519056 conn(0x7f43ac0c7580 msgr2=0x7f43ac150fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:42.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.505+0000 7f43b31b0640 1 -- 172.21.15.77:0/1926519056 shutdown_connections 2024-04-25T01:44:42.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.505+0000 7f43b31b0640 1 -- 172.21.15.77:0/1926519056 wait complete. 2024-04-25T01:44:42.508 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm b --yes-i-really-mean-it 2024-04-25T01:44:42.508 INFO:tasks.ceph.mds.b.smithi121.stderr: -2478> 2024-04-25T01:43:36.065+0000 7f9f56d18640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T01:44:42.537 INFO:tasks.ceph.mds.b.smithi121.stdout:starting mds.b at 2024-04-25T01:44:42.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.615+0000 7f304759b640 1 Processor -- start 2024-04-25T01:44:42.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.615+0000 7f304759b640 1 -- start start 2024-04-25T01:44:42.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.615+0000 7f304759b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30400c4280 0x7f30401538f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:42.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.616+0000 7f304759b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3040073450 0x7f3040153e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:42.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.616+0000 7f304759b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f30400c4cb0 0x7f30400c5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:42.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.616+0000 7f304759b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f30400c1cd0 con 0x7f30400c4cb0 2024-04-25T01:44:42.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.616+0000 7f304759b640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f30400c7040 con 0x7f3040073450 2024-04-25T01:44:42.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.616+0000 7f304759b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f30400ac010 con 0x7f30400c4280 2024-04-25T01:44:42.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.616+0000 7f3045b38640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f30400c4cb0 0x7f30400c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:42.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.616+0000 7f3045b38640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f30400c4cb0 0x7f30400c5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59526/0 (socket says 172.21.15.77:59526) 2024-04-25T01:44:42.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.616+0000 7f3045b38640 1 -- 172.21.15.77:0/3537425249 learned_addr learned my addr 172.21.15.77:0/3537425249 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:42.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.616+0000 7f3044b36640 1 --2- 172.21.15.77:0/3537425249 >> v2:172.21.15.121:3300/0 conn(0x7f3040073450 0x7f3040153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:42.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.616+0000 7f3045337640 1 --2- 172.21.15.77:0/3537425249 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30400c4280 0x7f30401538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:42.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.616+0000 7f3045b38640 1 -- 172.21.15.77:0/3537425249 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30400c4280 msgr2=0x7f30401538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:42.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.616+0000 7f3045b38640 1 --2- 172.21.15.77:0/3537425249 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30400c4280 0x7f30401538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:42.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.616+0000 7f3045b38640 1 -- 172.21.15.77:0/3537425249 >> v2:172.21.15.121:3300/0 conn(0x7f3040073450 msgr2=0x7f3040153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:42.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.616+0000 7f3045b38640 1 --2- 172.21.15.77:0/3537425249 >> v2:172.21.15.121:3300/0 conn(0x7f3040073450 0x7f3040153e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:42.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.616+0000 7f3045b38640 1 -- 172.21.15.77:0/3537425249 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30400ac2f0 con 0x7f30400c4cb0 2024-04-25T01:44:42.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.617+0000 7f3045b38640 1 --2- 172.21.15.77:0/3537425249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30400c4cb0 0x7f30400c5480 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f304006f4b0 tx=0x7f303802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aab219367a6de34 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:42.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.617+0000 7f3037fff640 1 -- 172.21.15.77:0/3537425249 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3038036070 con 0x7f30400c4cb0 2024-04-25T01:44:42.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.617+0000 7f3037fff640 1 -- 172.21.15.77:0/3537425249 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3038031600 con 0x7f30400c4cb0 2024-04-25T01:44:42.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.617+0000 7f3037fff640 1 -- 172.21.15.77:0/3537425249 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30380319f0 con 0x7f30400c4cb0 2024-04-25T01:44:42.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.617+0000 7f304759b640 1 -- 172.21.15.77:0/3537425249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30400c4cb0 msgr2=0x7f30400c5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:42.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.617+0000 7f304759b640 1 --2- 172.21.15.77:0/3537425249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30400c4cb0 0x7f30400c5480 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f304006f4b0 tx=0x7f303802a6a0 comp rx=0 tx=0).stop 2024-04-25T01:44:42.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.617+0000 7f304759b640 1 -- 172.21.15.77:0/3537425249 shutdown_connections 2024-04-25T01:44:42.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.617+0000 7f304759b640 1 --2- 172.21.15.77:0/3537425249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30400c4cb0 0x7f30400c5480 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:42.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.617+0000 7f304759b640 1 --2- 172.21.15.77:0/3537425249 >> v2:172.21.15.121:3300/0 conn(0x7f3040073450 0x7f3040153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:42.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.617+0000 7f304759b640 1 --2- 172.21.15.77:0/3537425249 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30400c4280 0x7f30401538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:42.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.617+0000 7f304759b640 1 -- 172.21.15.77:0/3537425249 >> 172.21.15.77:0/3537425249 conn(0x7f30400c7580 msgr2=0x7f30400c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:42.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.617+0000 7f304759b640 1 -- 172.21.15.77:0/3537425249 shutdown_connections 2024-04-25T01:44:42.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.617+0000 7f304759b640 1 -- 172.21.15.77:0/3537425249 wait complete. 2024-04-25T01:44:42.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.618+0000 7f304759b640 1 Processor -- start 2024-04-25T01:44:42.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.618+0000 7f304759b640 1 -- start start 2024-04-25T01:44:42.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.619+0000 7f304759b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3040073450 0x7f30400a9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:42.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.619+0000 7f304759b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30400c4280 0x7f30401e8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:42.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.619+0000 7f304759b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30400c4cb0 0x7f30401e9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:42.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.619+0000 7f304759b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f30400c1a90 con 0x7f30400c4cb0 2024-04-25T01:44:42.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.619+0000 7f304759b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f30400c1910 con 0x7f30400c4280 2024-04-25T01:44:42.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.619+0000 7f304759b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f30400c4660 con 0x7f3040073450 2024-04-25T01:44:42.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.619+0000 7f3045b38640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30400c4cb0 0x7f30401e9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:42.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.619+0000 7f3045b38640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30400c4cb0 0x7f30401e9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59536/0 (socket says 172.21.15.77:59536) 2024-04-25T01:44:42.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.619+0000 7f3045b38640 1 -- 172.21.15.77:0/4223344561 learned_addr learned my addr 172.21.15.77:0/4223344561 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:42.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.619+0000 7f3044b36640 1 --2- 172.21.15.77:0/4223344561 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30400c4280 0x7f30401e8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:42.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.619+0000 7f3045337640 1 --2- 172.21.15.77:0/4223344561 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3040073450 0x7f30400a9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:42.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.619+0000 7f3045b38640 1 -- 172.21.15.77:0/4223344561 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3040073450 msgr2=0x7f30400a9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:42.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.619+0000 7f3045b38640 1 --2- 172.21.15.77:0/4223344561 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3040073450 0x7f30400a9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:42.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.619+0000 7f3045b38640 1 -- 172.21.15.77:0/4223344561 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30400c4280 msgr2=0x7f30401e8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:42.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.619+0000 7f3045b38640 1 --2- 172.21.15.77:0/4223344561 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30400c4280 0x7f30401e8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:42.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.619+0000 7f3045b38640 1 -- 172.21.15.77:0/4223344561 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30401ec150 con 0x7f30400c4cb0 2024-04-25T01:44:42.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.620+0000 7f3045b38640 1 --2- 172.21.15.77:0/4223344561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30400c4cb0 0x7f30401e9140 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f3038034040 tx=0x7f3038004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:42.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.620+0000 7f3035ffb640 1 -- 172.21.15.77:0/4223344561 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3038009510 con 0x7f30400c4cb0 2024-04-25T01:44:42.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.620+0000 7f3035ffb640 1 -- 172.21.15.77:0/4223344561 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f30380079b0 con 0x7f30400c4cb0 2024-04-25T01:44:42.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.620+0000 7f304759b640 1 -- 172.21.15.77:0/4223344561 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30401ec430 con 0x7f30400c4cb0 2024-04-25T01:44:42.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.620+0000 7f3035ffb640 1 -- 172.21.15.77:0/4223344561 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3038007da0 con 0x7f30400c4cb0 2024-04-25T01:44:42.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.620+0000 7f304759b640 1 -- 172.21.15.77:0/4223344561 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30401ec9f0 con 0x7f30400c4cb0 2024-04-25T01:44:42.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.621+0000 7f304759b640 1 -- 172.21.15.77:0/4223344561 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f304004f500 con 0x7f30400c4cb0 2024-04-25T01:44:42.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.621+0000 7f3035ffb640 1 -- 172.21.15.77:0/4223344561 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3038039400 con 0x7f30400c4cb0 2024-04-25T01:44:42.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.622+0000 7f3035ffb640 1 --2- 172.21.15.77:0/4223344561 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f302406be60 0x7f302406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:42.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.622+0000 7f3035ffb640 1 -- 172.21.15.77:0/4223344561 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6377+0+0 (secure 0 0 0) 0x7f30380add10 con 0x7f30400c4cb0 2024-04-25T01:44:42.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.622+0000 7f3045337640 1 --2- 172.21.15.77:0/4223344561 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f302406be60 0x7f302406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:42.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.622+0000 7f3045337640 1 --2- 172.21.15.77:0/4223344561 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f302406be60 0x7f302406e320 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f303c009a50 tx=0x7f303c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:42.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.626+0000 7f3035ffb640 1 -- 172.21.15.77:0/4223344561 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f303807c4b0 con 0x7f30400c4cb0 2024-04-25T01:44:42.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:42.836+0000 7f304759b640 1 -- 172.21.15.77:0/4223344561 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "b", "yes_i_really_mean_it": true} v 0) -- 0x7f30400c6bf0 con 0x7f30400c4cb0 2024-04-25T01:44:43.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.503+0000 7f3035ffb640 1 -- 172.21.15.77:0/4223344561 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "b", "yes_i_really_mean_it": true}]=0 v42) ==== 99+0+0 (secure 0 0 0) 0x7f303807bdb0 con 0x7f30400c4cb0 2024-04-25T01:44:43.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.506+0000 7f304759b640 1 -- 172.21.15.77:0/4223344561 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f302406be60 msgr2=0x7f302406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:43.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.506+0000 7f304759b640 1 --2- 172.21.15.77:0/4223344561 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f302406be60 0x7f302406e320 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f303c009a50 tx=0x7f303c008040 comp rx=0 tx=0).stop 2024-04-25T01:44:43.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.506+0000 7f304759b640 1 -- 172.21.15.77:0/4223344561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30400c4cb0 msgr2=0x7f30401e9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:43.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.506+0000 7f304759b640 1 --2- 172.21.15.77:0/4223344561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30400c4cb0 0x7f30401e9140 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f3038034040 tx=0x7f3038004a40 comp rx=0 tx=0).stop 2024-04-25T01:44:43.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.506+0000 7f304759b640 1 -- 172.21.15.77:0/4223344561 shutdown_connections 2024-04-25T01:44:43.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.506+0000 7f304759b640 1 --2- 172.21.15.77:0/4223344561 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7f302406be60 0x7f302406e320 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:43.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.506+0000 7f304759b640 1 --2- 172.21.15.77:0/4223344561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30400c4cb0 0x7f30401e9140 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:43.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.506+0000 7f304759b640 1 --2- 172.21.15.77:0/4223344561 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30400c4280 0x7f30401e8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:43.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.506+0000 7f304759b640 1 --2- 172.21.15.77:0/4223344561 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3040073450 0x7f30400a9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:43.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.506+0000 7f304759b640 1 -- 172.21.15.77:0/4223344561 >> 172.21.15.77:0/4223344561 conn(0x7f30400c7580 msgr2=0x7f30400c5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:43.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.506+0000 7f304759b640 1 -- 172.21.15.77:0/4223344561 shutdown_connections 2024-04-25T01:44:43.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.506+0000 7f304759b640 1 -- 172.21.15.77:0/4223344561 wait complete. 2024-04-25T01:44:43.512 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm b_metadata b_metadata --yes-i-really-really-mean-it 2024-04-25T01:44:43.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.626+0000 7fa470a10640 1 Processor -- start 2024-04-25T01:44:43.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.626+0000 7fa470a10640 1 -- start start 2024-04-25T01:44:43.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.626+0000 7fa470a10640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa46c06bbf0 0x7fa46c06c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:43.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.626+0000 7fa470a10640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa46c1565f0 con 0x7fa46c156110 2024-04-25T01:44:43.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.626+0000 7fa470a10640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa46c1568d0 con 0x7fa46c0c85a0 2024-04-25T01:44:43.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.626+0000 7fa470a10640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fa46c0c9f30 con 0x7fa46c06bbf0 2024-04-25T01:44:43.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.626+0000 7fa463fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa46c156110 0x7fa46c153290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50684/0 (socket says 172.21.15.77:50684) 2024-04-25T01:44:43.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.626+0000 7fa463fff640 1 -- 172.21.15.77:0/3092583926 learned_addr learned my addr 172.21.15.77:0/3092583926 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-04-25T01:44:43.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.627+0000 7fa46ad9d640 1 --2- 172.21.15.77:0/3092583926 >> v2:172.21.15.121:3300/0 conn(0x7fa46c06bbf0 0x7fa46c06c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:43.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.627+0000 7fa469d9b640 1 -- 172.21.15.77:0/3092583926 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3701081827 0 0) 0x7fa46c1565f0 con 0x7fa46c156110 2024-04-25T01:44:43.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.627+0000 7fa469d9b640 1 -- 172.21.15.77:0/3092583926 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa458003520 con 0x7fa46c156110 2024-04-25T01:44:43.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.627+0000 7fa469d9b640 1 -- 172.21.15.77:0/3092583926 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2815080439 0 0) 0x7fa458003520 con 0x7fa46c156110 2024-04-25T01:44:43.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.627+0000 7fa469d9b640 1 -- 172.21.15.77:0/3092583926 >> v2:172.21.15.121:3300/0 conn(0x7fa46c06bbf0 msgr2=0x7fa46c06c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:43.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.627+0000 7fa469d9b640 1 --2- 172.21.15.77:0/3092583926 >> v2:172.21.15.121:3300/0 conn(0x7fa46c06bbf0 0x7fa46c06c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:43.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.627+0000 7fa469d9b640 1 -- 172.21.15.77:0/3092583926 >> v1:172.21.15.121:6789/0 conn(0x7fa46c0c85a0 legacy=0x7fa46c0c9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:43.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.627+0000 7fa469d9b640 1 -- 172.21.15.77:0/3092583926 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46c156bb0 con 0x7fa46c156110 2024-04-25T01:44:43.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.627+0000 7fa469d9b640 1 -- 172.21.15.77:0/3092583926 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3320866606 0 0) 0x7fa454001670 con 0x7fa46c156110 2024-04-25T01:44:43.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.627+0000 7fa469d9b640 1 -- 172.21.15.77:0/3092583926 >> v1:172.21.15.77:6789/0 conn(0x7fa46c156110 legacy=0x7fa46c153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:43.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.627+0000 7fa469d9b640 1 --2- 172.21.15.77:0/3092583926 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa458003a70 0x7fa458003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:43.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.627+0000 7fa469d9b640 1 --2- 172.21.15.77:0/3092583926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa458004800 0x7fa458004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:43.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.627+0000 7fa469d9b640 1 --2- 172.21.15.77:0/3092583926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4580052e0 0x7fa45800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:43.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.627+0000 7fa469d9b640 1 -- 172.21.15.77:0/3092583926 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c0c9f30 con 0x7fa4580052e0 2024-04-25T01:44:43.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.627+0000 7fa469d9b640 1 -- 172.21.15.77:0/3092583926 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa45800c1b0 con 0x7fa458004800 2024-04-25T01:44:43.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.627+0000 7fa469d9b640 1 -- 172.21.15.77:0/3092583926 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fa45800c3b0 con 0x7fa458003a70 2024-04-25T01:44:43.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.627+0000 7fa46ad9d640 1 --2- 172.21.15.77:0/3092583926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4580052e0 0x7fa45800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:43.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.627+0000 7fa463fff640 1 --2- 172.21.15.77:0/3092583926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa458004800 0x7fa458004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:43.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.627+0000 7fa46a59c640 1 --2- 172.21.15.77:0/3092583926 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa458003a70 0x7fa458003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:43.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.627+0000 7fa46ad9d640 1 -- 172.21.15.77:0/3092583926 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa458003a70 msgr2=0x7fa458003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:43.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.627+0000 7fa46ad9d640 1 --2- 172.21.15.77:0/3092583926 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa458003a70 0x7fa458003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:43.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.627+0000 7fa46ad9d640 1 -- 172.21.15.77:0/3092583926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa458004800 msgr2=0x7fa458004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:43.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.627+0000 7fa46ad9d640 1 --2- 172.21.15.77:0/3092583926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa458004800 0x7fa458004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:43.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.627+0000 7fa46ad9d640 1 -- 172.21.15.77:0/3092583926 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa458003520 con 0x7fa4580052e0 2024-04-25T01:44:43.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.627+0000 7fa46a59c640 1 --2- 172.21.15.77:0/3092583926 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa458003a70 0x7fa458003e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:44:43.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.628+0000 7fa46ad9d640 1 -- 172.21.15.77:0/3092583926 reap_dead start 2024-04-25T01:44:43.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.628+0000 7fa46ad9d640 1 --2- 172.21.15.77:0/3092583926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4580052e0 0x7fa45800b9c0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fa464009fc0 tx=0x7fa458005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0731644c5ac2f12 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:43.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.628+0000 7fa469d9b640 1 -- 172.21.15.77:0/3092583926 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa464035020 con 0x7fa4580052e0 2024-04-25T01:44:43.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.628+0000 7fa469d9b640 1 -- 172.21.15.77:0/3092583926 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa464003bd0 con 0x7fa4580052e0 2024-04-25T01:44:43.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.628+0000 7fa469d9b640 1 -- 172.21.15.77:0/3092583926 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa464009c10 con 0x7fa4580052e0 2024-04-25T01:44:43.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.629+0000 7fa470a10640 1 -- 172.21.15.77:0/3092583926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4580052e0 msgr2=0x7fa45800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:43.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.629+0000 7fa470a10640 1 --2- 172.21.15.77:0/3092583926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4580052e0 0x7fa45800b9c0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fa464009fc0 tx=0x7fa458005830 comp rx=0 tx=0).stop 2024-04-25T01:44:43.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.629+0000 7fa470a10640 1 -- 172.21.15.77:0/3092583926 shutdown_connections 2024-04-25T01:44:43.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.629+0000 7fa470a10640 1 --2- 172.21.15.77:0/3092583926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4580052e0 0x7fa45800b9c0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:43.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.629+0000 7fa470a10640 1 -- 172.21.15.77:0/3092583926 >> 172.21.15.77:0/3092583926 conn(0x7fa46c0675b0 msgr2=0x7fa46c0ad450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:43.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.629+0000 7fa470a10640 1 -- 172.21.15.77:0/3092583926 shutdown_connections 2024-04-25T01:44:43.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.629+0000 7fa470a10640 1 -- 172.21.15.77:0/3092583926 wait complete. 2024-04-25T01:44:43.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.630+0000 7fa470a10640 1 Processor -- start 2024-04-25T01:44:43.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.630+0000 7fa470a10640 1 -- start start 2024-04-25T01:44:43.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.631+0000 7fa470a10640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4580052e0 0x7fa46c157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:43.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.631+0000 7fa470a10640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa46c0c1c10 0x7fa46c0c0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:43.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.631+0000 7fa470a10640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa46c1ef2b0 0x7fa46c14cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:43.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.631+0000 7fa470a10640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c0c8b00 con 0x7fa4580052e0 2024-04-25T01:44:43.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.631+0000 7fa470a10640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c0c8980 con 0x7fa46c0c1c10 2024-04-25T01:44:43.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.631+0000 7fa470a10640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fa46c0c9820 con 0x7fa46c1ef2b0 2024-04-25T01:44:43.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.631+0000 7fa46a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4580052e0 0x7fa46c157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:43.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.631+0000 7fa46a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4580052e0 0x7fa46c157b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59566/0 (socket says 172.21.15.77:59566) 2024-04-25T01:44:43.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.631+0000 7fa46a59c640 1 -- 172.21.15.77:0/567703572 learned_addr learned my addr 172.21.15.77:0/567703572 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:43.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.631+0000 7fa463fff640 1 --2- 172.21.15.77:0/567703572 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa46c0c1c10 0x7fa46c0c0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:43.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.631+0000 7fa46ad9d640 1 --2- 172.21.15.77:0/567703572 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa46c1ef2b0 0x7fa46c14cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:43.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.631+0000 7fa46a59c640 1 -- 172.21.15.77:0/567703572 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa46c1ef2b0 msgr2=0x7fa46c14cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:43.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.631+0000 7fa46a59c640 1 --2- 172.21.15.77:0/567703572 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa46c1ef2b0 0x7fa46c14cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:43.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.631+0000 7fa46a59c640 1 -- 172.21.15.77:0/567703572 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa46c0c1c10 msgr2=0x7fa46c0c0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:43.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.631+0000 7fa46a59c640 1 --2- 172.21.15.77:0/567703572 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa46c0c1c10 0x7fa46c0c0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:43.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.631+0000 7fa46a59c640 1 -- 172.21.15.77:0/567703572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46c0c0b60 con 0x7fa4580052e0 2024-04-25T01:44:43.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.631+0000 7fa46ad9d640 1 --2- 172.21.15.77:0/567703572 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa46c1ef2b0 0x7fa46c14cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:44:43.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.631+0000 7fa46a59c640 1 --2- 172.21.15.77:0/567703572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4580052e0 0x7fa46c157b20 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa45c00e410 tx=0x7fa45c00e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:43.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.631+0000 7fa462ffd640 1 -- 172.21.15.77:0/567703572 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c019070 con 0x7fa4580052e0 2024-04-25T01:44:43.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.632+0000 7fa462ffd640 1 -- 172.21.15.77:0/567703572 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa45c0052e0 con 0x7fa4580052e0 2024-04-25T01:44:43.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.632+0000 7fa470a10640 1 -- 172.21.15.77:0/567703572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa46c1efbf0 con 0x7fa4580052e0 2024-04-25T01:44:43.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.632+0000 7fa462ffd640 1 -- 172.21.15.77:0/567703572 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c003850 con 0x7fa4580052e0 2024-04-25T01:44:43.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.632+0000 7fa470a10640 1 -- 172.21.15.77:0/567703572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa46c0c0ff0 con 0x7fa4580052e0 2024-04-25T01:44:43.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.633+0000 7fa470a10640 1 -- 172.21.15.77:0/567703572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa46c075d10 con 0x7fa4580052e0 2024-04-25T01:44:43.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.633+0000 7fa462ffd640 1 -- 172.21.15.77:0/567703572 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa45c01c070 con 0x7fa4580052e0 2024-04-25T01:44:43.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.633+0000 7fa462ffd640 1 --2- 172.21.15.77:0/567703572 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa44c06be30 0x7fa44c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:43.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.634+0000 7fa463fff640 1 --2- 172.21.15.77:0/567703572 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa44c06be30 0x7fa44c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:43.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.634+0000 7fa462ffd640 1 -- 172.21.15.77:0/567703572 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6377+0+0 (secure 0 0 0) 0x7fa45c08a600 con 0x7fa4580052e0 2024-04-25T01:44:43.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.634+0000 7fa463fff640 1 --2- 172.21.15.77:0/567703572 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa44c06be30 0x7fa44c06e2f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0c1ba0 tx=0x7fa454000f80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:43.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.638+0000 7fa462ffd640 1 -- 172.21.15.77:0/567703572 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa45c0586c0 con 0x7fa4580052e0 2024-04-25T01:44:43.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:43.811+0000 7fa470a10640 1 -- 172.21.15.77:0/567703572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "b_metadata", "pool2": "b_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa46c154080 con 0x7fa4580052e0 2024-04-25T01:44:44.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.508+0000 7fa462ffd640 1 -- 172.21.15.77:0/567703572 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "b_metadata", "pool2": "b_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'b_metadata' removed v36) ==== 166+0+0 (secure 0 0 0) 0x7fa45c05c9c0 con 0x7fa4580052e0 2024-04-25T01:44:44.500 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'b_metadata' removed 2024-04-25T01:44:44.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.511+0000 7fa470a10640 1 -- 172.21.15.77:0/567703572 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa44c06be30 msgr2=0x7fa44c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:44.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.511+0000 7fa470a10640 1 --2- 172.21.15.77:0/567703572 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa44c06be30 0x7fa44c06e2f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0c1ba0 tx=0x7fa454000f80 comp rx=0 tx=0).stop 2024-04-25T01:44:44.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.511+0000 7fa470a10640 1 -- 172.21.15.77:0/567703572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4580052e0 msgr2=0x7fa46c157b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:44.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.511+0000 7fa470a10640 1 --2- 172.21.15.77:0/567703572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4580052e0 0x7fa46c157b20 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa45c00e410 tx=0x7fa45c00e8d0 comp rx=0 tx=0).stop 2024-04-25T01:44:44.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.511+0000 7fa470a10640 1 -- 172.21.15.77:0/567703572 shutdown_connections 2024-04-25T01:44:44.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.511+0000 7fa470a10640 1 --2- 172.21.15.77:0/567703572 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7fa44c06be30 0x7fa44c06e2f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:44.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.511+0000 7fa470a10640 1 --2- 172.21.15.77:0/567703572 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa46c1ef2b0 0x7fa46c14cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:44.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.511+0000 7fa470a10640 1 --2- 172.21.15.77:0/567703572 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa46c0c1c10 0x7fa46c0c0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:44.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.511+0000 7fa470a10640 1 --2- 172.21.15.77:0/567703572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4580052e0 0x7fa46c157b20 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:44.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.511+0000 7fa470a10640 1 -- 172.21.15.77:0/567703572 >> 172.21.15.77:0/567703572 conn(0x7fa46c0675b0 msgr2=0x7fa46c14f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:44.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.512+0000 7fa470a10640 1 -- 172.21.15.77:0/567703572 shutdown_connections 2024-04-25T01:44:44.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.512+0000 7fa470a10640 1 -- 172.21.15.77:0/567703572 wait complete. 2024-04-25T01:44:44.517 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm b_data b_data --yes-i-really-really-mean-it 2024-04-25T01:44:44.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.627+0000 7febf409a640 1 Processor -- start 2024-04-25T01:44:44.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.627+0000 7febf409a640 1 -- start start 2024-04-25T01:44:44.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.628+0000 7febf409a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7febec157e60 0x7febec06d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:44.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.628+0000 7febf409a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7febec0c2a00 0x7febec0aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:44.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.628+0000 7febf409a640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7febec06d5e0 0x7febec06b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:44.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.628+0000 7febf409a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7febec0c2570 con 0x7febec157e60 2024-04-25T01:44:44.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.628+0000 7febf409a640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7febec0ad640 con 0x7febec06d5e0 2024-04-25T01:44:44.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.628+0000 7febf409a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7febec0c3d60 con 0x7febec0c2a00 2024-04-25T01:44:44.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.628+0000 7febf1e36640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7febec157e60 0x7febec06d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:44.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.628+0000 7febf1e36640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7febec157e60 0x7febec06d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59580/0 (socket says 172.21.15.77:59580) 2024-04-25T01:44:44.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.628+0000 7febf1e36640 1 -- 172.21.15.77:0/176577357 learned_addr learned my addr 172.21.15.77:0/176577357 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:44.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.628+0000 7febf1635640 1 --2- 172.21.15.77:0/176577357 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7febec0c2a00 0x7febec0aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:44.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.628+0000 7febf2637640 1 --2- 172.21.15.77:0/176577357 >> v2:172.21.15.121:3300/0 conn(0x7febec06d5e0 0x7febec06b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:44.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.628+0000 7febf1e36640 1 -- 172.21.15.77:0/176577357 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7febec0c2a00 msgr2=0x7febec0aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:44.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.628+0000 7febf1e36640 1 --2- 172.21.15.77:0/176577357 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7febec0c2a00 0x7febec0aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:44.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.628+0000 7febf1e36640 1 -- 172.21.15.77:0/176577357 >> v2:172.21.15.121:3300/0 conn(0x7febec06d5e0 msgr2=0x7febec06b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T01:44:44.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.628+0000 7febf1e36640 1 --2- 172.21.15.77:0/176577357 >> v2:172.21.15.121:3300/0 conn(0x7febec06d5e0 0x7febec06b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:44.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.628+0000 7febf1e36640 1 -- 172.21.15.77:0/176577357 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febec0c3a80 con 0x7febec157e60 2024-04-25T01:44:44.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.628+0000 7febf2637640 1 --2- 172.21.15.77:0/176577357 >> v2:172.21.15.121:3300/0 conn(0x7febec06d5e0 0x7febec06b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T01:44:44.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.629+0000 7febf1e36640 1 --2- 172.21.15.77:0/176577357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7febec157e60 0x7febec06d0a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7febec0a9130 tx=0x7febe802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c86353dac0be5e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:44.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.629+0000 7febf0e34640 1 -- 172.21.15.77:0/176577357 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe8037070 con 0x7febec157e60 2024-04-25T01:44:44.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.629+0000 7febf0e34640 1 -- 172.21.15.77:0/176577357 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7febe8032440 con 0x7febec157e60 2024-04-25T01:44:44.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.629+0000 7febf0e34640 1 -- 172.21.15.77:0/176577357 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe8032830 con 0x7febec157e60 2024-04-25T01:44:44.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.629+0000 7febf409a640 1 -- 172.21.15.77:0/176577357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7febec157e60 msgr2=0x7febec06d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:44.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.629+0000 7febf409a640 1 --2- 172.21.15.77:0/176577357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7febec157e60 0x7febec06d0a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7febec0a9130 tx=0x7febe802a1e0 comp rx=0 tx=0).stop 2024-04-25T01:44:44.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.629+0000 7febf409a640 1 -- 172.21.15.77:0/176577357 shutdown_connections 2024-04-25T01:44:44.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.629+0000 7febf409a640 1 --2- 172.21.15.77:0/176577357 >> v2:172.21.15.121:3300/0 conn(0x7febec06d5e0 0x7febec06b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:44.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.629+0000 7febf409a640 1 --2- 172.21.15.77:0/176577357 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7febec0c2a00 0x7febec0aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:44.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.629+0000 7febf409a640 1 --2- 172.21.15.77:0/176577357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7febec157e60 0x7febec06d0a0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:44.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.629+0000 7febf409a640 1 -- 172.21.15.77:0/176577357 >> 172.21.15.77:0/176577357 conn(0x7febec0a9230 msgr2=0x7febec0a9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:44.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.630+0000 7febf409a640 1 -- 172.21.15.77:0/176577357 shutdown_connections 2024-04-25T01:44:44.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.630+0000 7febf409a640 1 -- 172.21.15.77:0/176577357 wait complete. 2024-04-25T01:44:44.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.631+0000 7febf409a640 1 Processor -- start 2024-04-25T01:44:44.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.631+0000 7febf409a640 1 -- start start 2024-04-25T01:44:44.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.631+0000 7febf409a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7febec06d5e0 0x7febec15bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:44.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.631+0000 7febf409a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febec0c2a00 0x7febec1595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:44.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.631+0000 7febf409a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7febec157e60 0x7febec1f35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:44.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.631+0000 7febf409a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7febec0aaa70 con 0x7febec06d5e0 2024-04-25T01:44:44.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.631+0000 7febf409a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7febec0c2200 con 0x7febec0c2a00 2024-04-25T01:44:44.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.631+0000 7febf409a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7febec0aabf0 con 0x7febec157e60 2024-04-25T01:44:44.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.631+0000 7febf1e36640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7febec06d5e0 0x7febec15bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:44.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.631+0000 7febf1e36640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7febec06d5e0 0x7febec15bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59590/0 (socket says 172.21.15.77:59590) 2024-04-25T01:44:44.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.631+0000 7febf1e36640 1 -- 172.21.15.77:0/418116095 learned_addr learned my addr 172.21.15.77:0/418116095 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-04-25T01:44:44.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.632+0000 7febf1635640 1 --2- 172.21.15.77:0/418116095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febec0c2a00 0x7febec1595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:44.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.632+0000 7febf2637640 1 --2- 172.21.15.77:0/418116095 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7febec157e60 0x7febec1f35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:44.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.632+0000 7febf1e36640 1 -- 172.21.15.77:0/418116095 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7febec157e60 msgr2=0x7febec1f35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:44.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.632+0000 7febf1e36640 1 --2- 172.21.15.77:0/418116095 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7febec157e60 0x7febec1f35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:44.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.632+0000 7febf1e36640 1 -- 172.21.15.77:0/418116095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febec0c2a00 msgr2=0x7febec1595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:44.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.632+0000 7febf1e36640 1 --2- 172.21.15.77:0/418116095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febec0c2a00 0x7febec1595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:44.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.632+0000 7febf1e36640 1 -- 172.21.15.77:0/418116095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febec15a910 con 0x7febec06d5e0 2024-04-25T01:44:44.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.632+0000 7febf1635640 1 --2- 172.21.15.77:0/418116095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febec0c2a00 0x7febec1595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:44:44.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.632+0000 7febf2637640 1 --2- 172.21.15.77:0/418116095 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7febec157e60 0x7febec1f35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T01:44:44.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.632+0000 7febf1e36640 1 --2- 172.21.15.77:0/418116095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7febec06d5e0 0x7febec15bc90 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7febe802a220 tx=0x7febe80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:44.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.632+0000 7febe27fc640 1 -- 172.21.15.77:0/418116095 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe8041020 con 0x7febec06d5e0 2024-04-25T01:44:44.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.632+0000 7febe27fc640 1 -- 172.21.15.77:0/418116095 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7febe8030990 con 0x7febec06d5e0 2024-04-25T01:44:44.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.632+0000 7febf409a640 1 -- 172.21.15.77:0/418116095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febec15abf0 con 0x7febec06d5e0 2024-04-25T01:44:44.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.632+0000 7febe27fc640 1 -- 172.21.15.77:0/418116095 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe8037040 con 0x7febec06d5e0 2024-04-25T01:44:44.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.632+0000 7febf409a640 1 -- 172.21.15.77:0/418116095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febec158da0 con 0x7febec06d5e0 2024-04-25T01:44:44.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.633+0000 7febf409a640 1 -- 172.21.15.77:0/418116095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febec075d10 con 0x7febec06d5e0 2024-04-25T01:44:44.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.633+0000 7febe27fc640 1 -- 172.21.15.77:0/418116095 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7febe8044020 con 0x7febec06d5e0 2024-04-25T01:44:44.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.634+0000 7febe27fc640 1 --2- 172.21.15.77:0/418116095 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7febd006be30 0x7febd006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:44:44.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.634+0000 7febe27fc640 1 -- 172.21.15.77:0/418116095 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5949+0+0 (secure 0 0 0) 0x7febe80ab820 con 0x7febec06d5e0 2024-04-25T01:44:44.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.634+0000 7febf1635640 1 --2- 172.21.15.77:0/418116095 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7febd006be30 0x7febd006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:44:44.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.634+0000 7febf1635640 1 --2- 172.21.15.77:0/418116095 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7febd006be30 0x7febd006e2f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7febec0c7340 tx=0x7febdc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:44:44.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.638+0000 7febe27fc640 1 -- 172.21.15.77:0/418116095 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7febe804b030 con 0x7febec06d5e0 2024-04-25T01:44:44.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:44.816+0000 7febf409a640 1 -- 172.21.15.77:0/418116095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "b_data", "pool2": "b_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7febec1571c0 con 0x7febec06d5e0 2024-04-25T01:44:45.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:45.509+0000 7febe27fc640 1 -- 172.21.15.77:0/418116095 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "b_data", "pool2": "b_data", "yes_i_really_really_mean_it": true}]=0 pool 'b_data' removed v37) ==== 154+0+0 (secure 0 0 0) 0x7febe807a170 con 0x7febec06d5e0 2024-04-25T01:44:45.502 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'b_data' removed 2024-04-25T01:44:45.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:45.514+0000 7febf409a640 1 -- 172.21.15.77:0/418116095 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7febd006be30 msgr2=0x7febd006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:45.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:45.514+0000 7febf409a640 1 --2- 172.21.15.77:0/418116095 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7febd006be30 0x7febd006e2f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7febec0c7340 tx=0x7febdc008040 comp rx=0 tx=0).stop 2024-04-25T01:44:45.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:45.514+0000 7febf409a640 1 -- 172.21.15.77:0/418116095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7febec06d5e0 msgr2=0x7febec15bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:44:45.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:45.514+0000 7febf409a640 1 --2- 172.21.15.77:0/418116095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7febec06d5e0 0x7febec15bc90 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7febe802a220 tx=0x7febe80046c0 comp rx=0 tx=0).stop 2024-04-25T01:44:45.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:45.514+0000 7febf409a640 1 -- 172.21.15.77:0/418116095 shutdown_connections 2024-04-25T01:44:45.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:45.514+0000 7febf409a640 1 --2- 172.21.15.77:0/418116095 >> [v2:172.21.15.77:6832/4208232183,v1:172.21.15.77:6833/4208232183] conn(0x7febd006be30 0x7febd006e2f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:45.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:45.514+0000 7febf409a640 1 --2- 172.21.15.77:0/418116095 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7febec157e60 0x7febec1f35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:45.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:45.514+0000 7febf409a640 1 --2- 172.21.15.77:0/418116095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febec0c2a00 0x7febec1595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:45.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:45.514+0000 7febf409a640 1 --2- 172.21.15.77:0/418116095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7febec06d5e0 0x7febec15bc90 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:44:45.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:45.514+0000 7febf409a640 1 -- 172.21.15.77:0/418116095 >> 172.21.15.77:0/418116095 conn(0x7febec0a9230 msgr2=0x7febec156360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:44:45.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:45.514+0000 7febf409a640 1 -- 172.21.15.77:0/418116095 shutdown_connections 2024-04-25T01:44:45.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-25T01:44:45.514+0000 7febf409a640 1 -- 172.21.15.77:0/418116095 wait complete. 2024-04-25T01:44:45.523 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T01:44:45.523 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T01:44:45.523 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T01:44:45.533 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T01:44:45.533 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T01:44:45.533 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T01:44:45.583 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T01:44:45.583 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T01:44:45.583 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T01:44:45.594 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T01:44:45.594 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T01:44:45.594 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T01:44:45.645 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T01:44:45.645 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T01:44:45.645 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T01:44:45.645 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T01:44:45.683 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T01:44:45.683 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T01:44:45.683 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T01:44:45.758 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T01:44:45.758 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T01:44:45.758 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T01:44:45.833 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T01:44:45.833 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T01:44:45.833 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T01:44:45.908 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T01:44:45.909 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T01:44:45.909 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T01:44:45.944 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T01:44:45.945 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T01:44:45.945 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T01:44:46.022 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T01:44:46.022 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T01:44:46.022 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T01:44:46.095 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T01:44:46.095 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T01:44:46.095 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T01:44:46.170 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T01:44:46.170 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T01:44:46.170 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T01:44:46.171 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T01:44:46.199 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T01:44:46.199 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T01:44:46.199 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T01:44:46.237 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T01:44:46.237 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T01:44:46.237 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T01:44:46.237 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T01:44:46.251 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T01:44:46.252 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T01:44:46.252 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T01:44:46.289 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T01:44:46.290 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T01:44:46.290 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T01:44:46.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-04-25T01:44:46.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-25T01:44:46.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-25T01:44:46.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-04-25T01:44:46.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-04-25T01:44:46.343 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-04-25T01:44:46.343 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T01:44:46.343 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T01:44:46.343 DEBUG:teuthology.orchestra.run.smithi077:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'Replacing daemon mds' | head -n 1 2024-04-25T01:44:46.381 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T01:44:46.381 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T01:44:46.591 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T01:44:46.591 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T01:44:46.745 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T01:44:46.745 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T01:44:46.801 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T01:44:46.801 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T01:44:46.856 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi121.front.sepia.ceph.com 2024-04-25T01:44:46.857 DEBUG:teuthology.orchestra.run.smithi121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T01:44:47.180 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi121.front.sepia.ceph.com 2024-04-25T01:44:47.180 DEBUG:teuthology.orchestra.run.smithi121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T01:44:47.257 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi121.front.sepia.ceph.com 2024-04-25T01:44:47.257 DEBUG:teuthology.orchestra.run.smithi121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T01:44:47.314 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi121.front.sepia.ceph.com 2024-04-25T01:44:47.314 DEBUG:teuthology.orchestra.run.smithi121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T01:44:47.373 INFO:tasks.ceph:Archiving mon data... 2024-04-25T01:44:47.376 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672336/data/mon.a.tgz 2024-04-25T01:44:47.376 DEBUG:teuthology.orchestra.run.smithi077:> mktemp 2024-04-25T01:44:47.394 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.McKzlFxNhV 2024-04-25T01:44:47.395 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.McKzlFxNhV 2024-04-25T01:44:47.553 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0666 /tmp/tmp.McKzlFxNhV 2024-04-25T01:44:47.636 DEBUG:teuthology.orchestra.remote:smithi077:/tmp/tmp.McKzlFxNhV is 392KB 2024-04-25T01:44:47.738 DEBUG:teuthology.orchestra.run.smithi077:> rm -fr /tmp/tmp.McKzlFxNhV 2024-04-25T01:44:47.753 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672336/data/mon.b.tgz 2024-04-25T01:44:47.753 DEBUG:teuthology.orchestra.run.smithi121:> mktemp 2024-04-25T01:44:47.769 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.0loEqm7wzT 2024-04-25T01:44:47.770 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.0loEqm7wzT 2024-04-25T01:44:47.954 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.0loEqm7wzT 2024-04-25T01:44:48.034 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.0loEqm7wzT is 519KB 2024-04-25T01:44:48.134 DEBUG:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.0loEqm7wzT 2024-04-25T01:44:48.148 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672336/data/mon.c.tgz 2024-04-25T01:44:48.149 DEBUG:teuthology.orchestra.run.smithi121:> mktemp 2024-04-25T01:44:48.202 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.kj5wPOHFQG 2024-04-25T01:44:48.203 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.kj5wPOHFQG 2024-04-25T01:44:48.368 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.kj5wPOHFQG 2024-04-25T01:44:48.449 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.kj5wPOHFQG is 519KB 2024-04-25T01:44:48.547 DEBUG:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.kj5wPOHFQG 2024-04-25T01:44:48.561 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T01:44:48.561 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T01:44:48.564 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T01:44:48.644 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T01:44:48.679 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T01:44:48.679 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T01:44:48.680 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672336/remote/smithi077/crash 2024-04-25T01:44:48.681 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T01:44:48.710 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672336/remote/smithi121/crash 2024-04-25T01:44:48.711 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T01:44:48.741 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T01:44:48.741 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:44:48.755 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:44:49.109 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T01:44:49.134 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T01:44:49.158 INFO:tasks.ceph:Compressing logs... 2024-04-25T01:44:49.158 DEBUG:teuthology.orchestra.run.smithi077:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T01:44:49.177 DEBUG:teuthology.orchestra.run.smithi121:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T01:44:49.244 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34578.log 2024-04-25T01:44:49.244 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T01:44:49.244 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.34578.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T01:44:49.244 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-25T01:44:49.244 INFO:teuthology.orchestra.run.smithi121.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34578.log.gz 2024-04-25T01:44:49.244 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T01:44:49.244 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T01:44:49.244 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-25T01:44:49.244 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34407.log 2024-04-25T01:44:49.245 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.40888.log 2024-04-25T01:44:49.245 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.34407.log: 91.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T01:44:49.245 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.1.40888.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34407.log.gz 2024-04-25T01:44:49.245 INFO:teuthology.orchestra.run.smithi121.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.40888.log.gz 2024-04-25T01:44:49.245 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T01:44:49.245 INFO:teuthology.orchestra.run.smithi121.stderr: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T01:44:49.245 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T01:44:49.245 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-25T01:44:49.245 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34618.log 2024-04-25T01:44:49.245 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34698.log 2024-04-25T01:44:49.245 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.34618.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.34618.log.gz 2024-04-25T01:44:49.245 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34487.log 2024-04-25T01:44:49.246 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.34698.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34698.log.gz 2024-04-25T01:44:49.246 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34658.log 2024-04-25T01:44:49.246 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.34487.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34487.log.gz 2024-04-25T01:44:49.246 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34531.log 2024-04-25T01:44:49.246 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.34658.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34658.log.gz 2024-04-25T01:44:49.246 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.40893.log 2024-04-25T01:44:49.246 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.34531.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34531.log.gz 2024-04-25T01:44:49.246 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34447.log 2024-04-25T01:44:49.246 INFO:teuthology.orchestra.run.smithi121.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T01:44:49.246 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.1.40893.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-25T01:44:49.246 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.34447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.40893.log.gz 2024-04-25T01:44:49.246 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T01:44:49.247 INFO:teuthology.orchestra.run.smithi121.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34447.log.gz 2024-04-25T01:44:49.262 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.b.log: 94.9% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-25T01:44:49.307 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45905.log 2024-04-25T01:44:49.307 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49625.log 2024-04-25T01:44:49.307 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42050.log 2024-04-25T01:44:49.307 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42609.log 2024-04-25T01:44:49.307 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45905.log.gz 2024-04-25T01:44:49.307 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49625.log.gz 2024-04-25T01:44:49.307 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48968.log 2024-04-25T01:44:49.308 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42609.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42050.log.gz 2024-04-25T01:44:49.308 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42945.log 2024-04-25T01:44:49.308 INFO:teuthology.orchestra.run.smithi077.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42609.log.gz 2024-04-25T01:44:49.308 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52177.log 2024-04-25T01:44:49.308 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42945.log: gzip -5 --verbose -- 88.4% /var/log/ceph/ceph-client.admin.40685.log 2024-04-25T01:44:49.308 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48968.log.gz 2024-04-25T01:44:49.308 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41445.log 2024-04-25T01:44:49.308 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42945.log.gz 2024-04-25T01:44:49.308 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40685.log: gzip 88.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.52177.log.gz --verbose 2024-04-25T01:44:49.308 INFO:teuthology.orchestra.run.smithi077.stderr: -- /var/log/ceph/ceph-client.admin.41109.log 2024-04-25T01:44:49.308 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41445.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40685.log.gz 2024-04-25T01:44:49.308 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51001.log 2024-04-25T01:44:49.309 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41445.log.gz 2024-04-25T01:44:49.309 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50297.log 2024-04-25T01:44:49.309 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41109.log.gz 2024-04-25T01:44:49.309 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43142.log 2024-04-25T01:44:49.309 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50129.log 2024-04-25T01:44:49.309 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51001.log.gz 2024-04-25T01:44:49.309 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43142.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.50297.log.gz 2024-04-25T01:44:49.309 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42603.log 2024-04-25T01:44:49.309 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43142.log.gz 2024-04-25T01:44:49.309 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48017.log 2024-04-25T01:44:49.309 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42603.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50129.log.gz 2024-04-25T01:44:49.310 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50627.log 2024-04-25T01:44:49.310 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42603.log.gz 2024-04-25T01:44:49.310 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43730.log 2024-04-25T01:44:49.310 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52219.log 2024-04-25T01:44:49.310 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48017.log.gz 2024-04-25T01:44:49.310 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43730.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.50627.log.gz 2024-04-25T01:44:49.310 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50543.log 2024-04-25T01:44:49.310 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52219.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43730.log.gz 2024-04-25T01:44:49.310 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51306.log 2024-04-25T01:44:49.310 INFO:teuthology.orchestra.run.smithi077.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52219.log.gz 2024-04-25T01:44:49.310 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52783.log 2024-04-25T01:44:49.311 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51306.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50543.log.gz 2024-04-25T01:44:49.311 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40769.log 2024-04-25T01:44:49.311 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51306.log.gz 2024-04-25T01:44:49.311 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52265.log 2024-04-25T01:44:49.311 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40769.log: gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52783.log.gz -5 2024-04-25T01:44:49.311 INFO:teuthology.orchestra.run.smithi077.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48368.log 2024-04-25T01:44:49.311 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40769.log.gz 2024-04-25T01:44:49.311 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41798.log 2024-04-25T01:44:49.311 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45821.log 2024-04-25T01:44:49.311 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52265.log.gz 2024-04-25T01:44:49.311 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41798.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48368.log.gz 2024-04-25T01:44:49.311 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51726.log 2024-04-25T01:44:49.312 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41798.log.gz 2024-04-25T01:44:49.312 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42270.log 2024-04-25T01:44:49.312 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51726.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45821.log.gz 2024-04-25T01:44:49.312 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52951.log 2024-04-25T01:44:49.312 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42270.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51726.log.gz 2024-04-25T01:44:49.312 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48740.log 2024-04-25T01:44:49.312 INFO:teuthology.orchestra.run.smithi077.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42270.log.gz 2024-04-25T01:44:49.312 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46325.log 2024-04-25T01:44:49.312 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48101.log 2024-04-25T01:44:49.312 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52951.log.gz 2024-04-25T01:44:49.312 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46325.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48740.log.gz 2024-04-25T01:44:49.313 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52741.log 2024-04-25T01:44:49.313 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46325.log.gz 2024-04-25T01:44:49.313 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48101.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T01:44:49.313 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52741.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48101.log.gz 2024-04-25T01:44:49.313 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40498.log 2024-04-25T01:44:49.313 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52741.log.gz 2024-04-25T01:44:49.313 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50339.log 2024-04-25T01:44:49.313 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45863.log 2024-04-25T01:44:49.313 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44486.log 2024-04-25T01:44:49.313 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40498.log.gz 2024-04-25T01:44:49.313 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45863.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50339.log.gz 2024-04-25T01:44:49.314 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49667.log 2024-04-25T01:44:49.314 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45863.log.gz/var/log/ceph/ceph-client.admin.44486.log: 2024-04-25T01:44:49.314 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47725.log 2024-04-25T01:44:49.314 INFO:teuthology.orchestra.run.smithi077.stderr: 85.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T01:44:49.314 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49667.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44486.log.gz 2024-04-25T01:44:49.314 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44402.log 2024-04-25T01:44:49.314 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49667.log.gz 2024-04-25T01:44:49.314 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48156.log 2024-04-25T01:44:49.314 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44402.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47725.log.gz 2024-04-25T01:44:49.314 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45653.log 2024-04-25T01:44:49.314 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44402.log.gz 2024-04-25T01:44:49.315 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47060.log 2024-04-25T01:44:49.315 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45653.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48156.log.gz 2024-04-25T01:44:49.315 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41361.log 2024-04-25T01:44:49.315 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45653.log.gz 2024-04-25T01:44:49.315 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43562.log 2024-04-25T01:44:49.315 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41361.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47060.log.gz 2024-04-25T01:44:49.315 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49806.log 2024-04-25T01:44:49.315 INFO:teuthology.orchestra.run.smithi077.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41361.log.gz 2024-04-25T01:44:49.315 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43772.log 2024-04-25T01:44:49.315 INFO:teuthology.orchestra.run.smithi077.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43562.log.gz 2024-04-25T01:44:49.315 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49806.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T01:44:49.316 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49806.log.gz 2024-04-25T01:44:49.316 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50585.log 2024-04-25T01:44:49.316 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43772.log.gz 2024-04-25T01:44:49.316 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46241.log 2024-04-25T01:44:49.316 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45442.log 2024-04-25T01:44:49.316 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46241.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50585.log.gzgzip 2024-04-25T01:44:49.316 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43814.log 2024-04-25T01:44:49.316 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46241.log.gz 2024-04-25T01:44:49.316 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51474.log 2024-04-25T01:44:49.316 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43814.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45442.log.gz 2024-04-25T01:44:49.316 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53035.log 2024-04-25T01:44:49.316 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43814.log.gz 2024-04-25T01:44:49.317 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42263.log 2024-04-25T01:44:49.317 INFO:teuthology.orchestra.run.smithi077.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51474.log.gz 2024-04-25T01:44:49.317 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51894.log 2024-04-25T01:44:49.317 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50940.log 2024-04-25T01:44:49.317 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53035.log.gz 2024-04-25T01:44:49.317 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42263.log.gz 2024-04-25T01:44:49.317 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47893.log 2024-04-25T01:44:49.317 INFO:teuthology.orchestra.run.smithi077.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51894.log.gz 2024-04-25T01:44:49.317 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44108.log 2024-04-25T01:44:49.317 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47893.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50940.log.gz 2024-04-25T01:44:49.317 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46619.log 2024-04-25T01:44:49.318 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47893.log.gz 2024-04-25T01:44:49.318 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49848.log 2024-04-25T01:44:49.318 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44108.log.gz 2024-04-25T01:44:49.318 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51600.log 2024-04-25T01:44:49.318 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49848.log: gzip -5 88.9% --verbose -- replaced with /var/log/ceph/ceph-client.admin.46619.log.gz -- 2024-04-25T01:44:49.318 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph.audit.log 2024-04-25T01:44:49.318 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49848.log.gz 2024-04-25T01:44:49.318 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48473.log 2024-04-25T01:44:49.318 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph.audit.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51600.log.gz 2024-04-25T01:44:49.318 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48800.log 2024-04-25T01:44:49.318 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41966.log 2024-04-25T01:44:49.318 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48800.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48473.log.gz 2024-04-25T01:44:49.319 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50856.log 2024-04-25T01:44:49.319 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49890.log 2024-04-25T01:44:49.319 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1%/var/log/ceph/ceph-client.admin.41966.log: -- replaced with /var/log/ceph/ceph-client.admin.48800.log.gz 2024-04-25T01:44:49.319 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T01:44:49.319 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50856.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28360.log 2024-04-25T01:44:49.319 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41966.log.gz 2024-04-25T01:44:49.319 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49890.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50856.log.gz 2024-04-25T01:44:49.319 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52512.log 2024-04-25T01:44:49.319 INFO:teuthology.orchestra.run.smithi077.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49890.log.gz 2024-04-25T01:44:49.319 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43520.log 2024-04-25T01:44:49.319 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph.tmp-client.admin.28360.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28360.log.gz 2024-04-25T01:44:49.319 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42610.log 2024-04-25T01:44:49.320 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47977.log 2024-04-25T01:44:49.320 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52512.log.gz 2024-04-25T01:44:49.320 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42610.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43520.log.gz 2024-04-25T01:44:49.320 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48219.log 2024-04-25T01:44:49.320 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42610.log.gz 2024-04-25T01:44:49.320 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43224.log 2024-04-25T01:44:49.320 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46661.log 2024-04-25T01:44:49.320 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47977.log.gz 2024-04-25T01:44:49.320 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48219.log.gz 2024-04-25T01:44:49.320 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42940.log 2024-04-25T01:44:49.320 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7%/var/log/ceph/ceph-client.admin.46661.log: -- replaced with /var/log/ceph/ceph-client.admin.43224.log.gz 2024-04-25T01:44:49.320 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50711.log 2024-04-25T01:44:49.321 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46661.log.gz 2024-04-25T01:44:49.321 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41487.log 2024-04-25T01:44:49.321 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42940.log.gz 2024-04-25T01:44:49.321 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41025.log 2024-04-25T01:44:49.321 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41487.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50711.log.gz 2024-04-25T01:44:49.321 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47809.log 2024-04-25T01:44:49.321 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41487.log.gz 2024-04-25T01:44:49.321 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44066.log 2024-04-25T01:44:49.321 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41025.log.gz 2024-04-25T01:44:49.321 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46493.log 2024-04-25T01:44:49.321 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44066.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47809.log.gz 2024-04-25T01:44:49.321 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46874.log 2024-04-25T01:44:49.322 INFO:teuthology.orchestra.run.smithi077.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44066.log.gz 2024-04-25T01:44:49.322 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46493.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T01:44:49.322 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46493.log.gz 2024-04-25T01:44:49.322 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52909.log 2024-04-25T01:44:49.322 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.3.log: gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46874.log.gz -5 2024-04-25T01:44:49.322 INFO:teuthology.orchestra.run.smithi077.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40983.log 2024-04-25T01:44:49.322 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41575.log 2024-04-25T01:44:49.323 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52909.log.gz 2024-04-25T01:44:49.323 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42092.log 2024-04-25T01:44:49.323 INFO:teuthology.orchestra.run.smithi077.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40983.log.gz 2024-04-25T01:44:49.323 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45400.log 2024-04-25T01:44:49.323 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41575.log: /var/log/ceph/ceph-client.admin.42092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49105.log 2024-04-25T01:44:49.323 INFO:teuthology.orchestra.run.smithi077.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41575.log.gz 2024-04-25T01:44:49.323 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45400.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42092.log.gz 2024-04-25T01:44:49.323 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41882.log 2024-04-25T01:44:49.323 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45400.log.gz 2024-04-25T01:44:49.323 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44612.log 2024-04-25T01:44:49.323 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49105.log: /var/log/ceph/ceph-client.admin.41882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52388.log 2024-04-25T01:44:49.323 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49105.log.gz 2024-04-25T01:44:49.324 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44612.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41882.log.gz 2024-04-25T01:44:49.324 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49437.log 2024-04-25T01:44:49.324 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44612.log.gz 2024-04-25T01:44:49.324 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42274.log 2024-04-25T01:44:49.324 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52388.log: /var/log/ceph/ceph-client.admin.49437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44252.log 2024-04-25T01:44:49.324 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52388.log.gz 2024-04-25T01:44:49.324 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42274.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49437.log.gz 2024-04-25T01:44:49.324 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44528.log 2024-04-25T01:44:49.325 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42274.log.gz 2024-04-25T01:44:49.325 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49010.log 2024-04-25T01:44:49.325 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44252.log: /var/log/ceph/ceph-client.admin.44528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46073.log 2024-04-25T01:44:49.325 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44252.log.gz 2024-04-25T01:44:49.325 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49010.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44528.log.gz 2024-04-25T01:44:49.325 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43898.log 2024-04-25T01:44:49.325 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49010.log.gz 2024-04-25T01:44:49.325 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49710.log 2024-04-25T01:44:49.325 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46073.log: /var/log/ceph/ceph-client.admin.43898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52124.log 2024-04-25T01:44:49.325 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46073.log.gz 2024-04-25T01:44:49.325 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43898.log.gz 2024-04-25T01:44:49.325 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51135.log 2024-04-25T01:44:49.326 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49710.log.gz 2024-04-25T01:44:49.326 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-25T01:44:49.326 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52124.log: /var/log/ceph/ceph-client.admin.51135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40727.log 2024-04-25T01:44:49.326 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52124.log.gz 2024-04-25T01:44:49.326 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-mds.c.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51135.log.gz 2024-04-25T01:44:49.326 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49195.log 2024-04-25T01:44:49.326 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49522.log 2024-04-25T01:44:49.326 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40727.log: /var/log/ceph/ceph-client.admin.49195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43304.log 2024-04-25T01:44:49.327 INFO:teuthology.orchestra.run.smithi077.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40727.log.gz 2024-04-25T01:44:49.327 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49195.log.gz 2024-04-25T01:44:49.327 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41193.log 2024-04-25T01:44:49.327 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42596.log 2024-04-25T01:44:49.327 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49522.log.gz 2024-04-25T01:44:49.327 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43304.log: /var/log/ceph/ceph-client.admin.41193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46577.log 2024-04-25T01:44:49.327 INFO:teuthology.orchestra.run.smithi077.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43304.log.gz 2024-04-25T01:44:49.327 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41193.log.gz 2024-04-25T01:44:49.327 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52554.log 2024-04-25T01:44:49.327 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46577.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42596.log.gz 2024-04-25T01:44:49.327 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47347.log 2024-04-25T01:44:49.328 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46577.log.gz 2024-04-25T01:44:49.328 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43182.log 2024-04-25T01:44:49.328 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52554.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T01:44:49.328 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47347.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52554.log.gz 2024-04-25T01:44:49.328 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43182.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T01:44:49.328 INFO:teuthology.orchestra.run.smithi077.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47347.log.gz 2024-04-25T01:44:49.328 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43182.log.gz 2024-04-25T01:44:49.328 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40643.log 2024-04-25T01:44:49.328 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose/var/log/ceph/ceph-mgr.y.log: -- /var/log/ceph/ceph-client.admin.53077.log 2024-04-25T01:44:49.329 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46958.log 2024-04-25T01:44:49.329 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53077.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40643.log.gz 2024-04-25T01:44:49.329 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41277.log 2024-04-25T01:44:49.329 INFO:teuthology.orchestra.run.smithi077.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53077.log.gz 2024-04-25T01:44:49.329 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42273.log 2024-04-25T01:44:49.329 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46958.log: /var/log/ceph/ceph-client.admin.41277.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41277.log.gz 2024-04-25T01:44:49.329 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46958.log.gz 2024-04-25T01:44:49.329 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T01:44:49.329 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51348.log 2024-04-25T01:44:49.329 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.0.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42273.log.gz 2024-04-25T01:44:49.329 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51852.log 2024-04-25T01:44:49.330 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42606.log 2024-04-25T01:44:49.330 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51348.log.gz 2024-04-25T01:44:49.330 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51852.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51852.log.gz 2024-04-25T01:44:49.330 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42826.log 2024-04-25T01:44:49.330 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46031.log 2024-04-25T01:44:49.330 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42606.log: /var/log/ceph/ceph-client.admin.42826.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42606.log.gz 2024-04-25T01:44:49.330 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42826.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47495.log 2024-04-25T01:44:49.330 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-04-25T01:44:49.330 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46031.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46031.log.gz 2024-04-25T01:44:49.331 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44294.log 2024-04-25T01:44:49.331 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47933.log 2024-04-25T01:44:49.331 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44294.log: /var/log/ceph/ceph-client.admin.47495.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47495.log.gz 2024-04-25T01:44:49.331 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50459.log 2024-04-25T01:44:49.331 INFO:teuthology.orchestra.run.smithi077.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.44294.log.gz 2024-04-25T01:44:49.331 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47933.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47933.log.gz 2024-04-25T01:44:49.331 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41067.log 2024-04-25T01:44:49.331 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41531.log 2024-04-25T01:44:49.331 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50459.log: /var/log/ceph/ceph-client.admin.41067.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50459.log.gz 2024-04-25T01:44:49.332 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45183.log 2024-04-25T01:44:49.332 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41067.log.gz 2024-04-25T01:44:49.332 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41531.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41531.log.gz 2024-04-25T01:44:49.332 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52470.log 2024-04-25T01:44:49.332 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45779.log 2024-04-25T01:44:49.332 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.0.45183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45183.log.gz 2024-04-25T01:44:49.332 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45358.log 2024-04-25T01:44:49.332 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52470.log.gz 2024-04-25T01:44:49.332 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45779.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45779.log.gz 2024-04-25T01:44:49.332 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47018.log 2024-04-25T01:44:49.333 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42946.log 2024-04-25T01:44:49.333 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45358.log: /var/log/ceph/ceph-client.admin.47018.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45358.log.gz 2024-04-25T01:44:49.333 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47018.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47455.log 2024-04-25T01:44:49.333 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-04-25T01:44:49.333 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42946.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42946.log.gz 2024-04-25T01:44:49.333 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40540.log 2024-04-25T01:44:49.333 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43982.log 2024-04-25T01:44:49.333 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47455.log: /var/log/ceph/ceph-client.admin.40540.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47455.log.gz 2024-04-25T01:44:49.334 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40540.log.gz 2024-04-25T01:44:49.334 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43302.log 2024-04-25T01:44:49.334 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43982.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43982.log.gz 2024-04-25T01:44:49.334 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49932.log 2024-04-25T01:44:49.334 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42272.log 2024-04-25T01:44:49.334 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43302.log: /var/log/ceph/ceph-client.admin.49932.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43302.log.gz 2024-04-25T01:44:49.334 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46832.log 2024-04-25T01:44:49.334 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49932.log.gz 2024-04-25T01:44:49.334 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42272.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42272.log.gz 2024-04-25T01:44:49.334 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43181.log 2024-04-25T01:44:49.335 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47197.log 2024-04-25T01:44:49.335 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46832.log: /var/log/ceph/ceph-client.admin.43181.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46832.log.gz 2024-04-25T01:44:49.335 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43181.log.gz 2024-04-25T01:44:49.335 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51093.log 2024-04-25T01:44:49.335 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47197.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47197.log.gz 2024-04-25T01:44:49.335 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52825.log 2024-04-25T01:44:49.335 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48282.log 2024-04-25T01:44:49.335 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51093.log: /var/log/ceph/ceph-client.admin.52825.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51093.log.gz 2024-04-25T01:44:49.335 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52825.log.gz 2024-04-25T01:44:49.335 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45611.log 2024-04-25T01:44:49.335 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48282.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48282.log.gz 2024-04-25T01:44:49.335 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45737.log 2024-04-25T01:44:49.336 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43688.log 2024-04-25T01:44:49.336 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45611.log: /var/log/ceph/ceph-client.admin.45737.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45611.log.gz 2024-04-25T01:44:49.336 INFO:teuthology.orchestra.run.smithi077.stderr: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42008.log 2024-04-25T01:44:49.336 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45737.log.gz 2024-04-25T01:44:49.336 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43688.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43688.log.gz 2024-04-25T01:44:49.336 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T01:44:49.336 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42944.log 2024-04-25T01:44:49.336 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42008.log: /var/log/ceph/ceph-mon.a.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42008.log.gz 2024-04-25T01:44:49.336 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46283.log 2024-04-25T01:44:49.336 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42944.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42944.log.gz 2024-04-25T01:44:49.336 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43478.log 2024-04-25T01:44:49.336 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46283.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46283.log.gz 2024-04-25T01:44:49.337 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44840.log 2024-04-25T01:44:49.337 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43478.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43478.log.gz 2024-04-25T01:44:49.337 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49063.log 2024-04-25T01:44:49.337 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44840.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44840.log.gz 2024-04-25T01:44:49.337 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41626.log 2024-04-25T01:44:49.337 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49063.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49063.log.gz 2024-04-25T01:44:49.337 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34620.log 2024-04-25T01:44:49.337 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41626.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41626.log.gz 2024-04-25T01:44:49.337 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49993.log 2024-04-25T01:44:49.337 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34620.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34620.log.gz 2024-04-25T01:44:49.337 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40899.log 2024-04-25T01:44:49.337 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49993.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49993.log.gz 2024-04-25T01:44:49.338 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47286.log 2024-04-25T01:44:49.338 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40899.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.40899.log.gz 2024-04-25T01:44:49.338 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49564.log 2024-04-25T01:44:49.338 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47286.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47286.log.gz 2024-04-25T01:44:49.338 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51980.log 2024-04-25T01:44:49.338 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49564.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49564.log.gz 2024-04-25T01:44:49.338 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44444.log 2024-04-25T01:44:49.339 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51980.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51980.log.gz 2024-04-25T01:44:49.339 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41840.log 2024-04-25T01:44:49.339 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44444.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44444.log.gz 2024-04-25T01:44:49.339 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44738.log 2024-04-25T01:44:49.339 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41840.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41840.log.gz 2024-04-25T01:44:49.339 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43940.log 2024-04-25T01:44:49.339 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44738.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.44738.log.gz 2024-04-25T01:44:49.339 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40417.log 2024-04-25T01:44:49.339 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43940.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43940.log.gz 2024-04-25T01:44:49.339 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48061.log 2024-04-25T01:44:49.339 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40417.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40417.log.gz 2024-04-25T01:44:49.339 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46115.log 2024-04-25T01:44:49.340 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48061.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48061.log.gz 2024-04-25T01:44:49.340 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40813.log 2024-04-25T01:44:49.340 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46115.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46115.log.gz 2024-04-25T01:44:49.340 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48884.log 2024-04-25T01:44:49.340 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40813.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40813.log.gz 2024-04-25T01:44:49.340 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40601.log 2024-04-25T01:44:49.340 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48884.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48884.log.gz 2024-04-25T01:44:49.340 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46367.log 2024-04-25T01:44:49.340 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40601.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40601.log.gz 2024-04-25T01:44:49.340 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51810.log 2024-04-25T01:44:49.340 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46367.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46367.log.gz 2024-04-25T01:44:49.340 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51642.log 2024-04-25T01:44:49.341 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51810.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51810.log.gz 2024-04-25T01:44:49.341 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45178.log 2024-04-25T01:44:49.341 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51642.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51642.log.gz 2024-04-25T01:44:49.341 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52993.log 2024-04-25T01:44:49.341 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.0.45178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45178.log.gz 2024-04-25T01:44:49.341 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50501.log 2024-04-25T01:44:49.341 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52993.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52993.log.gz 2024-04-25T01:44:49.341 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41924.log 2024-04-25T01:44:49.341 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50501.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50501.log.gz 2024-04-25T01:44:49.341 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51937.log 2024-04-25T01:44:49.341 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41924.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41924.log.gz 2024-04-25T01:44:49.341 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45484.log 2024-04-25T01:44:49.342 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51937.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51937.log.gz 2024-04-25T01:44:49.342 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43223.log 2024-04-25T01:44:49.342 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45484.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45484.log.gz 2024-04-25T01:44:49.342 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50814.log 2024-04-25T01:44:49.342 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43223.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43223.log.gz 2024-04-25T01:44:49.342 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46409.log 2024-04-25T01:44:49.342 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50814.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50814.log.gz 2024-04-25T01:44:49.342 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41710.log 2024-04-25T01:44:49.342 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46409.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46409.log.gz 2024-04-25T01:44:49.342 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42265.log 2024-04-25T01:44:49.342 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41710.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41710.log.gz 2024-04-25T01:44:49.342 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48196.log 2024-04-25T01:44:49.343 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42265.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42265.log.gz 2024-04-25T01:44:49.343 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48390.log 2024-04-25T01:44:49.343 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48196.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48196.log.gz 2024-04-25T01:44:49.343 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40941.log 2024-04-25T01:44:49.343 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48390.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48390.log.gz 2024-04-25T01:44:49.343 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51516.log 2024-04-25T01:44:49.343 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40941.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40941.log.gz 2024-04-25T01:44:49.343 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44570.log 2024-04-25T01:44:49.343 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51516.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51516.log.gz 2024-04-25T01:44:49.343 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52638.log 2024-04-25T01:44:49.343 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44570.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44570.log.gz 2024-04-25T01:44:49.343 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47537.log 2024-04-25T01:44:49.343 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52638.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52638.log.gz 2024-04-25T01:44:49.344 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41235.log 2024-04-25T01:44:49.344 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47537.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47537.log.gz 2024-04-25T01:44:49.344 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45568.log 2024-04-25T01:44:49.344 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41235.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41235.log.gz 2024-04-25T01:44:49.344 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43303.log 2024-04-25T01:44:49.344 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45568.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45568.log.gz 2024-04-25T01:44:49.344 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52596.log 2024-04-25T01:44:49.344 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43303.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43303.log.gz 2024-04-25T01:44:49.344 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44654.log 2024-04-25T01:44:49.345 INFO:teuthology.orchestra.run.smithi121.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T01:44:49.373 INFO:teuthology.orchestra.run.smithi121.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T01:44:49.390 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52596.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52596.log.gz 2024-04-25T01:44:49.391 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46790.log 2024-04-25T01:44:49.391 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44654.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44654.log.gz 2024-04-25T01:44:49.391 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48698.log 2024-04-25T01:44:49.391 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46790.log: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T01:44:49.391 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46790.log.gz 2024-04-25T01:44:49.391 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42605.log 2024-04-25T01:44:49.391 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42607.log 2024-04-25T01:44:49.391 INFO:teuthology.orchestra.run.smithi077.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48698.log.gz 2024-04-25T01:44:49.391 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48328.log 2024-04-25T01:44:49.391 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42607.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42605.log.gz 2024-04-25T01:44:49.391 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43856.log 2024-04-25T01:44:49.392 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42607.log.gz 2024-04-25T01:44:49.392 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52867.log 2024-04-25T01:44:49.392 INFO:teuthology.orchestra.run.smithi077.stderr: 89.3%/var/log/ceph/ceph-client.admin.43856.log: -- replaced with /var/log/ceph/ceph-client.admin.48328.log.gz 2024-04-25T01:44:49.392 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43856.log.gz 2024-04-25T01:44:49.392 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41668.log 2024-04-25T01:44:49.392 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47102.log 2024-04-25T01:44:49.392 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52867.log.gz 2024-04-25T01:44:49.392 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41403.log 2024-04-25T01:44:49.392 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47102.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41668.log.gz 2024-04-25T01:44:49.392 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51768.log 2024-04-25T01:44:49.392 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47102.log.gz 2024-04-25T01:44:49.393 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48926.log 2024-04-25T01:44:49.393 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51768.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41403.log.gz 2024-04-25T01:44:49.393 INFO:teuthology.orchestra.run.smithi077.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51768.log.gz 2024-04-25T01:44:49.393 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51043.log 2024-04-25T01:44:49.393 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46157.log 2024-04-25T01:44:49.393 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48926.log: /var/log/ceph/ceph-client.admin.51043.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48926.log.gz 2024-04-25T01:44:49.393 INFO:teuthology.orchestra.run.smithi077.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51043.log.gz 2024-04-25T01:44:49.393 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45947.log 2024-04-25T01:44:49.393 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34341.log 2024-04-25T01:44:49.393 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46157.log: /var/log/ceph/ceph-client.admin.45947.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46157.log.gz 2024-04-25T01:44:49.393 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45947.log.gz 2024-04-25T01:44:49.393 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51558.log 2024-04-25T01:44:49.393 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51684.log 2024-04-25T01:44:49.394 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34341.log: /var/log/ceph/ceph-client.admin.51558.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.34341.log.gz 2024-04-25T01:44:49.394 INFO:teuthology.orchestra.run.smithi077.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51558.log.gz 2024-04-25T01:44:49.394 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41756.log 2024-04-25T01:44:49.394 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52022.log 2024-04-25T01:44:49.394 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51684.log: /var/log/ceph/ceph-client.admin.41756.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51684.log.gz 2024-04-25T01:44:49.394 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41756.log.gz 2024-04-25T01:44:49.394 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45989.log 2024-04-25T01:44:49.394 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46451.log 2024-04-25T01:44:49.394 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52022.log: /var/log/ceph/ceph-client.admin.45989.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52022.log.gz 2024-04-25T01:44:49.394 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45989.log.gz 2024-04-25T01:44:49.394 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41151.log 2024-04-25T01:44:49.394 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47239.log 2024-04-25T01:44:49.395 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46451.log: /var/log/ceph/ceph-client.admin.41151.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46451.log.gz 2024-04-25T01:44:49.395 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41151.log.gz 2024-04-25T01:44:49.395 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49151.log 2024-04-25T01:44:49.395 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47641.log 2024-04-25T01:44:49.395 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47239.log: /var/log/ceph/ceph-client.admin.49151.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47239.log.gz 2024-04-25T01:44:49.395 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49151.log.gz 2024-04-25T01:44:49.395 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52326.log 2024-04-25T01:44:49.395 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41319.log 2024-04-25T01:44:49.395 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47641.log: /var/log/ceph/ceph-client.admin.52326.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47641.log.gz 2024-04-25T01:44:49.395 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52326.log.gz 2024-04-25T01:44:49.395 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51221.log 2024-04-25T01:44:49.395 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50213.log 2024-04-25T01:44:49.396 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41319.log: /var/log/ceph/ceph-client.admin.51221.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41319.log.gz 2024-04-25T01:44:49.396 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51221.log.gz 2024-04-25T01:44:49.396 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40321.log 2024-04-25T01:44:49.396 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50898.log 2024-04-25T01:44:49.396 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50213.log: /var/log/ceph/ceph-client.admin.40321.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50213.log.gz 2024-04-25T01:44:49.396 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40321.log.gz 2024-04-25T01:44:49.396 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52696.log 2024-04-25T01:44:49.396 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.50898.log: /var/log/ceph/ceph-client.admin.47581.log 2024-04-25T01:44:49.396 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50898.log.gz 2024-04-25T01:44:49.396 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52082.log 2024-04-25T01:44:49.396 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47581.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52696.log.gz 2024-04-25T01:44:49.396 INFO:teuthology.orchestra.run.smithi077.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47581.log.gz 2024-04-25T01:44:49.397 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45526.log 2024-04-25T01:44:49.397 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.52082.log: /var/log/ceph/ceph-client.admin.46916.log 2024-04-25T01:44:49.397 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52082.log.gz 2024-04-25T01:44:49.397 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43646.log 2024-04-25T01:44:49.397 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46916.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45526.log.gz 2024-04-25T01:44:49.397 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46916.log.gz 2024-04-25T01:44:49.397 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50381.log 2024-04-25T01:44:49.397 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49238.log 2024-04-25T01:44:49.397 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50381.log: /var/log/ceph/ceph-client.admin.43646.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43646.log.gz 2024-04-25T01:44:49.397 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50381.log.gz 2024-04-25T01:44:49.397 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45316.log 2024-04-25T01:44:49.397 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44360.log 2024-04-25T01:44:49.398 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49238.log: /var/log/ceph/ceph-client.admin.45316.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49238.log.gz 2024-04-25T01:44:49.398 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45316.log.gz 2024-04-25T01:44:49.398 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51179.log 2024-04-25T01:44:49.398 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47767.log 2024-04-25T01:44:49.398 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44360.log: /var/log/ceph/ceph-client.admin.51179.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44360.log.gz 2024-04-25T01:44:49.398 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51179.log.gz 2024-04-25T01:44:49.399 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T01:44:49.399 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50171.log 2024-04-25T01:44:49.399 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.47767.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47767.log.gz 2024-04-25T01:44:49.399 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46199.log 2024-04-25T01:44:49.399 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50171.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50171.log.gz 2024-04-25T01:44:49.399 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42269.log 2024-04-25T01:44:49.399 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46199.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46199.log.gz 2024-04-25T01:44:49.399 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42608.log 2024-04-25T01:44:49.399 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42269.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42269.log.gz 2024-04-25T01:44:49.399 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42825.log 2024-04-25T01:44:49.399 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42608.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42608.log.gz 2024-04-25T01:44:49.399 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45695.log 2024-04-25T01:44:49.399 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42825.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42825.log.gz 2024-04-25T01:44:49.400 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40229.log 2024-04-25T01:44:49.400 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45695.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45695.log.gz 2024-04-25T01:44:49.400 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49479.log 2024-04-25T01:44:49.400 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40229.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40229.log.gz 2024-04-25T01:44:49.400 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47144.log 2024-04-25T01:44:49.400 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49479.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49479.log.gz 2024-04-25T01:44:49.400 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43604.log 2024-04-25T01:44:49.400 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47144.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47144.log.gz 2024-04-25T01:44:49.401 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44210.log 2024-04-25T01:44:49.401 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43604.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43604.log.gz 2024-04-25T01:44:49.401 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42935.log 2024-04-25T01:44:49.401 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44210.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44210.log.gz 2024-04-25T01:44:49.401 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50669.log 2024-04-25T01:44:49.401 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42935.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42935.log.gz 2024-04-25T01:44:49.401 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51264.log 2024-04-25T01:44:49.401 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50669.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50669.log.gz 2024-04-25T01:44:49.401 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47409.log 2024-04-25T01:44:49.401 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51264.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51264.log.gz 2024-04-25T01:44:49.401 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48842.log 2024-04-25T01:44:49.401 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47409.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47409.log.gz 2024-04-25T01:44:49.402 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42942.log 2024-04-25T01:44:49.402 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48842.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48842.log.gz 2024-04-25T01:44:49.402 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52430.log 2024-04-25T01:44:49.402 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42942.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42942.log.gz 2024-04-25T01:44:49.402 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42271.log 2024-04-25T01:44:49.402 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52430.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52430.log.gz 2024-04-25T01:44:49.402 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44696.log 2024-04-25T01:44:49.402 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42271.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42271.log.gz 2024-04-25T01:44:49.403 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47683.log 2024-04-25T01:44:49.403 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44696.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44696.log.gz 2024-04-25T01:44:49.403 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50055.log 2024-04-25T01:44:49.403 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47683.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47683.log.gz 2024-04-25T01:44:49.403 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40857.log 2024-04-25T01:44:49.403 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50055.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50055.log.gz 2024-04-25T01:44:49.403 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46535.log 2024-04-25T01:44:49.403 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40857.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40857.log.gz 2024-04-25T01:44:49.403 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50255.log 2024-04-25T01:44:49.403 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46535.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46535.log.gz 2024-04-25T01:44:49.403 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48535.log 2024-04-25T01:44:49.403 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50255.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50255.log.gz 2024-04-25T01:44:49.404 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44024.log 2024-04-25T01:44:49.404 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48535.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48535.log.gz 2024-04-25T01:44:49.404 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51432.log 2024-04-25T01:44:49.404 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44024.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44024.log.gz 2024-04-25T01:44:49.404 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44150.log 2024-04-25T01:44:49.404 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51432.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51432.log.gz 2024-04-25T01:44:49.404 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34721.log 2024-04-25T01:44:49.404 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44150.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44150.log.gz 2024-04-25T01:44:49.404 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51390.log 2024-04-25T01:44:49.405 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34721.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34721.log.gz 2024-04-25T01:44:49.405 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47849.log 2024-04-25T01:44:49.405 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51390.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51390.log.gz 2024-04-25T01:44:49.405 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47849.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47849.log.gz 2024-04-25T01:44:49.445 INFO:teuthology.orchestra.run.smithi121.stderr: 95.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T01:44:49.689 INFO:teuthology.orchestra.run.smithi077.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T01:44:50.050 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T01:44:50.570 INFO:teuthology.orchestra.run.smithi121.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T01:44:50.604 INFO:teuthology.orchestra.run.smithi121.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T01:44:50.644 INFO:teuthology.orchestra.run.smithi077.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T01:44:50.645 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T01:44:50.678 INFO:teuthology.orchestra.run.smithi121.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T01:44:50.688 INFO:teuthology.orchestra.run.smithi121.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T01:44:50.691 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-04-25T01:44:50.691 INFO:teuthology.orchestra.run.smithi121.stderr:real 0m1.478s 2024-04-25T01:44:50.691 INFO:teuthology.orchestra.run.smithi121.stderr:user 0m5.911s 2024-04-25T01:44:50.691 INFO:teuthology.orchestra.run.smithi121.stderr:sys 0m0.267s 2024-04-25T01:44:50.783 INFO:teuthology.orchestra.run.smithi077.stderr: 95.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-25T01:44:50.936 INFO:teuthology.orchestra.run.smithi077.stderr: 95.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T01:44:51.343 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-04-25T01:44:51.343 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-25T01:44:51.343 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-25T01:44:51.343 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-04-25T01:44:51.343 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-04-25T01:44:51.344 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-04-25T01:44:51.612 INFO:teuthology.orchestra.run.smithi077.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T01:44:51.614 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-04-25T01:44:51.614 INFO:teuthology.orchestra.run.smithi077.stderr:real 0m2.424s 2024-04-25T01:44:51.614 INFO:teuthology.orchestra.run.smithi077.stderr:user 0m9.470s 2024-04-25T01:44:51.614 INFO:teuthology.orchestra.run.smithi077.stderr:sys 0m0.504s 2024-04-25T01:44:51.615 INFO:tasks.ceph:Archiving logs... 2024-04-25T01:44:51.615 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672336/remote/smithi077/log 2024-04-25T01:44:51.616 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T01:44:53.010 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672336/remote/smithi121/log 2024-04-25T01:44:53.011 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T01:44:53.887 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T01:44:53.896 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T01:44:53.897 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T01:44:53.899 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T01:44:53.988 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T01:44:53.997 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T01:44:53.997 DEBUG:teuthology.orchestra.run.smithi077:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T01:44:53.999 DEBUG:teuthology.orchestra.run.smithi121:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T01:44:54.013 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: ntpq: command not found 2024-04-25T01:44:54.014 INFO:teuthology.orchestra.run.smithi121.stderr:bash: line 1: ntpq: command not found 2024-04-25T01:44:54.018 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T01:44:54.018 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2024-04-25T01:44:54.018 INFO:teuthology.orchestra.run.smithi077.stdout:^- hv01.front.sepia.ceph.com 2 6 377 59 +1483us[+1483us] +/- 583ms 2024-04-25T01:44:54.019 INFO:teuthology.orchestra.run.smithi077.stdout:^* hv02.front.sepia.ceph.com 3 6 377 60 -234us[ -235us] +/- 66ms 2024-04-25T01:44:54.019 INFO:teuthology.orchestra.run.smithi077.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 57 +264us[ +264us] +/- 73ms 2024-04-25T01:44:54.019 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:44:54.020 INFO:teuthology.orchestra.run.smithi121.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T01:44:54.020 INFO:teuthology.orchestra.run.smithi121.stdout:=============================================================================== 2024-04-25T01:44:54.020 INFO:teuthology.orchestra.run.smithi121.stdout:^- hv01.front.sepia.ceph.com 2 6 377 59 +1482us[+1482us] +/- 583ms 2024-04-25T01:44:54.020 INFO:teuthology.orchestra.run.smithi121.stdout:^* hv02.front.sepia.ceph.com 3 6 377 61 -224us[ -220us] +/- 66ms 2024-04-25T01:44:54.020 INFO:teuthology.orchestra.run.smithi121.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 60 +246us[ +246us] +/- 73ms 2024-04-25T01:44:54.021 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:44:54.021 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T01:44:54.029 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T01:44:54.030 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T01:44:54.097 DEBUG:teuthology.orchestra.run.smithi077:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T01:44:54.184 DEBUG:teuthology.orchestra.run.smithi121:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T01:44:54.247 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T01:44:54.276 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T01:44:54.276 DEBUG:teuthology.orchestra.run.smithi121:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T01:44:54.303 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T01:44:54.303 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T01:44:54.313 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T01:44:54.379 INFO:teuthology.task.internal:Duration was 728.803274 seconds 2024-04-25T01:44:54.379 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T01:44:54.423 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T01:44:54.424 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T01:44:54.426 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T01:44:54.464 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T01:44:54.464 INFO:teuthology.orchestra.run.smithi121.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T01:44:54.830 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T01:44:54.830 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi077.front.sepia.ceph.com 2024-04-25T01:44:54.831 DEBUG:teuthology.orchestra.run.smithi077:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T01:44:54.852 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi121.front.sepia.ceph.com 2024-04-25T01:44:54.853 DEBUG:teuthology.orchestra.run.smithi121:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T01:44:54.904 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T01:44:54.905 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T01:44:54.907 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T01:44:54.971 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T01:44:54.971 DEBUG:teuthology.orchestra.run.smithi077:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T01:44:54.974 DEBUG:teuthology.orchestra.run.smithi121:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T01:44:55.112 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T01:44:55.127 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T01:44:55.127 DEBUG:teuthology.orchestra.run.smithi077:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T01:44:55.151 DEBUG:teuthology.orchestra.run.smithi121:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T01:44:55.174 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T01:44:55.185 DEBUG:teuthology.orchestra.run.smithi077:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T01:44:55.193 DEBUG:teuthology.orchestra.run.smithi121:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T01:44:55.213 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = core 2024-04-25T01:44:55.236 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = core 2024-04-25T01:44:55.248 DEBUG:teuthology.orchestra.run.smithi077:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T01:44:55.280 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T01:44:55.280 DEBUG:teuthology.orchestra.run.smithi121:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T01:44:55.302 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T01:44:55.302 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T01:44:55.313 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T01:44:55.314 DEBUG:teuthology.misc:Transferring archived files from smithi077:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672336/remote/smithi077 2024-04-25T01:44:55.314 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T01:44:55.352 DEBUG:teuthology.misc:Transferring archived files from smithi121:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672336/remote/smithi121 2024-04-25T01:44:55.353 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T01:44:55.385 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T01:44:55.385 DEBUG:teuthology.orchestra.run.smithi077:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T01:44:55.389 DEBUG:teuthology.orchestra.run.smithi121:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T01:44:55.434 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T01:44:55.445 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T01:44:55.445 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T01:44:55.506 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T01:44:55.506 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T01:44:55.509 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T01:44:55.520 INFO:teuthology.orchestra.run.smithi077.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 01:44 /home/ubuntu/cephtest 2024-04-25T01:44:55.523 INFO:teuthology.orchestra.run.smithi121.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 01:44 /home/ubuntu/cephtest 2024-04-25T01:44:55.524 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T01:44:55.582 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T01:44:55.713 INFO:teuthology.run:Summary data: description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/iozone}} duration: 728.8032736778259 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-25T01:44:55.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T01:44:55.794 INFO:teuthology.run:pass